Wesley D.

Back-end and Systems Engineer

Web Scraping Data Engineer
7/1/2022 - Present

Contributed to the data collection team responsible for various company sectors, focusing on both the creation of new automation robots and the maintenance of existing ones. Managed the entire development lifecycle, from initial coding to deployment within an AWS architecture. Utilized Python as the main programming language, employing Selenium for automation in building various Crawlers and Beautiful Soup for scraping thousands of HTML pages. Conducted extensive ETL (Extract, Transform, Load) processes to standardize the delivery of millions of daily data collections. Leveraged a wide range of AWS services including S3, EC2, ECS, SQS, Lambda, and CloudWatch to ensure efficient and reliable data handling and operational monitoring.

Systems Analyst II
2/1/2022 - 6/1/2022

Served as a Data Engineer in a data-centric team responsible for creating and maintaining robust data pipelines to ensure organized and accessible data for various departments across the organization. Developed proficiency in Python and SQL for data extraction, transformation, and loading (ETL) processes. Utilized Apache Airflow for workflow automation and scheduling, ensuring timely and reliable data pipeline execution. Leveraged AWS services, including S3, Redshift, and Lambda, to build scalable and cost-efficient data infrastructure. Demonstrated expertise in data warehousing solutions and implemented data modeling best practices to optimize query performance and data storage. Employed version control systems like Git for collaborative development and code maintenance. Skills in troubleshooting and performance tuning were applied to enhance the efficiency and reliability of data pipelines. Conducted data quality assessments and implemented validation strategies to ensure data integrity. Collaborated closely with data analysts, data scientists, and other stakeholders to understand data requirements and provide actionable insights.

Python Developer
9/1/2020 - 1/1/2022

Gained substantial experience in automating banking processes and routines by creating robots using Python. Utilized tools such as Beautiful Soup (Bs4), Requests, Django, and Celery to enhance task efficiency and execution.

Intern
7/2/2015 - 1/2/2016

Developed competency in assisting with basic computer activities and tasks. Gained proficiency in utilizing the Office suite, including Word, Excel, and PowerPoint, to create and manage documents, spreadsheets, and presentations. Demonstrated ability to guide and support users in effectively operating these software programs and troubleshooting common issues.

Computer Science at State University of Piauí
2013 - 2019

Data Mesh: Data as Products at Alura
12/1/2023

Apache Airflow: Orchestrating Your First Data Pipeline at Alura
11/1/2023

Kafka: Producers, Consumers, and Streams at Alura
7/1/2023

Data Mesh: A Distributed Approach to Data at Alura
7/1/2023

Spark: Data Streaming at Alura
2/1/2023

Apache Airflow: Data Extraction at Alura
2/1/2023

Spark: Introducing the Tool at Alura
1/1/2023

String in Python: Extracting Information from a URL at Alura
6/1/2021

Automated Tests: TDD with Python at Alura
6/1/2021

Design Patterns Python I: Good Programming Practices at Alura
6/1/2021

Amazon Lambda: Running Serverless Code at Alura
5/1/2021

Scraping with Python: data collection on the web at Alura
3/1/2021

Image Recognition: Twitter and Computer Vision API at Alura
3/1/2021

Python: Advancing in Object Orientation at Alura
2/1/2021

API with Django 3: Django Rest Framework at Alura
2/1/2021

Python for Data Science: Functions, Packages, and Pandas at Alura
2/1/2021