Moyses S.
Data Engineer

Skills

Spark

Sql

Python

Amazon Aws

Docker Cloud

Moyses is available for hire

Hire Moyses S.

All Howdy Candidates are vetted for skills and english proficiency.

Bio

Data Engineer Professional with five years of experience in Brazil, seeking to advance my career in Ireland. Proficient in Data Analysis across diverse sectors, including Banking, Distance Education, Logistics, and Insurance, particularly within Technological Innovation and Research & Development projects.

Acquired expertise includes the implementation of data pipelines and support for data lakes, development and validation of static models and machine learning solutions, migration and data ingestion processes, data visualization techniques, and the creation and maintenance of chatbots. Core competencies encompass Big Data, Business Intelligence, Data Engineering, DataOps, Data Mining, Data Warehousing, ETL processes, and Machine Learning. Demonstrates adaptability, flexibility, teamwork, determination, and resilience, reflecting a strong performance in both professional and academic pursuits.

Data Engineer
1/1/2022 - 3/1/2023

Allocated in the Data Analytics squad for Logistics management, implementing robust data solutions. Relocated to Information Systems management to gain insights into data ingestion and processing routines. Spearheaded the implementation of data ingestion pipelines within the data lake, creating data frames using PySpark to populate Apache Hive tables. Conducted data transformation on Redshift using DBT to support dashboard loads on Power BI. Utilized Python scripts for data manipulation, pre-processing, and seamless extractions and ingestions between diverse environments. Organized tasks and maintained comprehensive documentation using Scrum methodologies, and tools such as Atlassian Jira and Confluence. Developed technical expertise in PySpark, Apache Hive, Redshift, DBT, Power BI, and Python, alongside strong proficiency in Scrum project management principles.
Data Engineer
10/1/2021 - 1/1/2022

Specialized in the purchase and management of non-performing loans (NPL). Developed technical expertise using Terraform for provisioning and orchestrating data lake resources. Conducted presentations and training sessions on the platform and technologies for team adoption. Supported routine jobs for data extraction and loading, and implemented an automation plan for the monitoring process. Achieved the implementation of AWS DynamoDB via Terraform and managed AWS Redshift user creation and permission settings. Organized tasks effectively using Trello and applied Scrum methodologies to maintain workflow efficiency.
Data Engineer
1/1/2021 - 10/1/2021

Implemented a scalable and easily manageable data lake using AWS, focusing on designing the architecture service interactions and processes of the data lake with Draw. Documented comprehensive processes and guidelines in Atlassian Confluence. Managed data ingestion summarized in JSON file uploads in the Landing layer, and ensured data quality and processing with the use of Pandas, JSON, Great Expectations libraries, and the AWS SDK boto3. Conducted queries in AWS Athena to support report generation. Created bucket access policies to restrict user access to their respective buckets, enhancing security. Conducted platform research and documented findings to build Open Assurance. Developed proofs of concept (POCs) to estimate new development resources such as Infrastructure as Code (IaC) with AWS Cloud Development Kit (CDK) using YAML.
Data Engineer
6/1/2020 - 10/1/2020

Developed proficiency in prospecting emerging technologies for virtual agents and innovating processes within implemented corpora architectures. Gained significant experience with data analysis and imports as part of the Data Analytics Squad. Contributed to the Curation squad by performing analytics on feedbacks for conversational agents. Researched and evaluated AI platforms including Rasa IA and Sophie Voice for deploying chatbots on social networks. Demonstrated expertise in data modeling for ingestion and created comprehensive dashboards using Power BI.
Data Analyst
7/1/2018 - 3/1/2020

Developed proficiency in prospecting software and computational techniques to tailor teaching according to students' experiences. Led a Text Analysis project focused on recognizing patterns of user experiences on the teaching platform. Successfully created and maintained Data Warehouse and Data Mart, including pre-processing data, creating dataframes, and executing DML and DDL operations in databases. Demonstrated expertise in manipulating text files and developing chatbots using DialogFlow, effectively optimizing the handling of simple and recurring questions from service teams to students and tutors.