André B.Data Engineer
Skills
With over 15 years of experience in the IT field, the candidate has honed expertise in designing and developing data ingestion and transformation solutions within big data environments. Proficiency spans cutting-edge tools and technologies, including Databricks, Data Factory, SQL Azure, Synapse Warehouse, Synapse Pipelines, Pentaho PDI, and Talend for Big Data. Collaborative efforts with international teams have provided a global perspective, enriching professional capabilities. The candidate's contributions extend to implementing machine learning models using Python, PySpark, Hadoop, and Docker. Proficiency also includes Business Intelligence tools such as Qlik Sense, Metabase, PowerBI, and Tableau, with a focus on developing customized dashboards and performing dimensional data modeling. Leadership has been demonstrated through the coordination of engineering and BI projects, applying agile methodologies such as Scrum to enhance team efficiency and collaboration. Strategic relationships with partners are maintained, alongside a commitment to internal team training and client education. This diverse experience and dedication to excellence equip the candidate to address complex challenges, thereby significantly contributing to organizational success.
Data Engineer Specialist
1/1/2022 - Present
Designed and developed ELT ingestion processes within big data environments, utilizing expertise in Synapse DW, Synapse Pipelines, and Data Factory. Developed robust data workflows and orchestrated seamless data integration, ensuring efficient data movement and transformation. Leveraged advanced data warehousing techniques in Synapse DW alongside creating and managing scalable data pipelines using Synapse Pipelines and Data Factory. Demonstrated technical proficiency in handling large volumes of data, ensuring optimized performance, reliability, and structural integrity across the ingestion process.Data Engineer Specialist
8/1/2021 - 12/1/2021
Specialized in the design and development of ETL processes and job scheduling within big data environments. Leveraged tools and technologies including Talend for Big Data, Azure DataLake Storage, Synapse Data Warehouse, DataBricks, Hive HQL, and SQL to manage and manipulate large datasets. Demonstrated expertise in Azure DevOps and Azure Data Factory (ADF) integrated with Git for seamless continuous integration and deployment. Applied Agile methodologies, particularly Scrum, to ensure efficient project management and development cycles within an international, cross-functional squad.Data Engineer of Machine Learning
4/1/2021 - 8/1/2021
Implemented machine learning models utilizing the bank's data pipeline. Developed proficiency in Python, PySpark, Hadoop (including Spark and HDFS), and containerization through Docker and OpenShift. Ensured continuous integration and deployment (CI/CD) with Jenkins and version control using Git. Managed job scheduling with Control-M and maintained project organization and issues tracking in Jira. Collaborated and documented processes in Confluence while applying the Agile model, specifically Scrum, for project management.Data Analyst
11/1/2020 - 3/1/2021
Specialized in the use of BI tools such as Metabase, Tableau, and PowerBI, aiding in the enhancement of data visualization and business intelligence capabilities. Consistently maintained and developed integration routines in SQL Server, employing advanced techniques including Triggers, Procedures, and Views to ensure seamless data integration and operational efficiency.Business Intelligence Analyst/Data Engineer
3/1/2010 - 11/1/2020
Developed and customized indicator dashboards utilizing Qlik, excelling in dimensional data modeling and managing BI environment structures. Demonstrated expertise in developing and maintaining ETL processes using AQL language within Qlik Sense. Played a crucial role in coordinating and providing technical leadership for various BI projects. Created effective routines in Jobs format, including procedures and triggers, specifically tailored for Oracle, SQLServer, and IBM Informix databases to support BI project feasibility. Proficient in designing ETL processes with Pentaho Data Integration (PDI) for efficient data loading into Stage and Dimensional environments. Maintained a strategic partnership with Qlik by staying updated through courses covering vision, products (technical), and commercial aspects. Provided consistent end-user support and facilitated internal team training. Additionally, conducted training sessions for customers to enhance their proficiency in Qlik development.
Computer Science at Barão de Mauá University
2004 - 2008Database at University of Ribeirão Preto – UNAERP
2009 - 2011Business Intelligence & Analytics at Pontifical Catholic University – PUC
2020 - 2022
DP-203 Azure Data Engineer Associate at Microsoft Azure
9/1/2023Azure Data Fundamentals at Azure Microsoft
4/1/2022AZ-900 Azure Fundamentals at Azure Microsoft
3/1/2022
André is available for hire
Hire André B.
All Howdy Candidates are vetted for skills and english proficiency.
