Vinícius F.Data Engineer
Skills
A Data Engineer with over three years of experience and a Bachelor of Science in Software Engineering offers a well-rounded skill set that combines technical proficiency, adaptability, and effective communication. This expertise is applied to solving complex problems and delivering impactful solutions within dynamic and collaborative environments. Proficiency in various data tools has been developed alongside a talent for communicating intricate concepts clearly, adapting to new technologies, and managing projects from inception to completion. Each project is approached with a growth mindset and a dedication to learning and innovation, ensuring alignment with organizational strategic objectives.
Expertise encompasses Python, Spark, and SQL within data engineering; Azure, GCP, and AWS for cloud architecture; and Databricks and Snowflake for cloud lakehouses. Skills include ETL tools such as PDI, Hop, and Airflow, as well as managing BI tools like Looker, Qlik, and PowerBI. Knowledge extends to data governance and compliance, particularly with OpenMetadata, and includes strong capabilities in data ingestion and integration, modern data stack and ops architectures, and data quality and observability.
Additional project work can be viewed at: https://github.com/ViniSpeck/DataPlatform
Languages spoken fluently include Portuguese, English, German, and Spanish.
Data Engineer
9/1/2023 - Present
Supervised projects across diverse industries such as energy, agriculture, manufacturing, transportation, logistics, and concessions. Spearheaded initiatives utilizing cutting-edge technologies and architectures, including Apache Airflow, Azure Synapse Analytics, Data Factory, Apache Hop, and Databricks, to enhance operational efficiency and promote business growth while aligning with organizational goals and budget constraints. Led the development and deployment of innovative data products, prioritizing cost-effectiveness, value generation, scalability, and reusability. Collaborated extensively with cross-functional teams and stakeholders to ensure seamless project execution and alignment with strategic business objectives.Data Engineer
3/1/2022 - 10/1/2023
Specialized in building and maintaining scalable data pipelines using PySpark and the AWS cloud stack. Contributed to the Data Warehouse's architecture and infrastructure with Snowflake, ensuring a performant environment to enhance decision-making. Assured best practices and data governance, focusing on observability, quality, lineage, and GDPR compliance, utilizing tools such as OpenMetadata and GreatExpectations. Developed data monitoring processes to ensure quality and availability. Maintained code versioning with GitHub and employed software engineering best practices, including CI/CD, Containers, and Infrastructure as Code (IaC).ETL Developer
3/1/2021 - 3/1/2022
Developed a data visualization infrastructure from the ground up, utilizing Pentaho’s PDI, Apache Airflow, BigQuery, and Looker to extract and process data from the company's ERP system. Constructed, maintained, and audited comprehensive dashboards, and manipulated custom filters through SQL queries. Managed various projects while ensuring collaborative and secure code maintenance via GitHub. Applied software engineering best practices, particularly Continuous Integration/Continuous Deployment (CI/CD), containerization, and Infrastructure as Code (IaC).Data Intern
7/1/2019 - 3/1/2021
Integrated process data through ETL tools, initially leveraging Pentaho (PDI/Kettle) and subsequently migrating to Apache Hop. Created and managed balance sheets, handled bank payments, and ensured robust cybersecurity measures. Provided exceptional customer service while ensuring collaborative code versioning with GitHub. Applied software engineering best practices, including Continuous Integration/Continuous Deployment (CI/CD), containerization, and Infrastructure as Code (IaaC).
Computer Software Engineering at Catholic University of Santa Catarina - University Center
2019 - 2023
Databricks Lakehouse Fundamentals at Databricks
11/1/2023Apache Airflow: Orchestrating Your First Data Pipeline at Alura
3/1/2023
Vinícius is available for hire
Hire Vinícius F.
All Howdy Candidates are vetted for skills and english proficiency.
