Caique C.Data Engineer
Skills
Data Engineer with four years of experience specializing in Azure tools, including Databricks (Lakehouse, Delta, Auto Loader, Spark, SQL), Data Factory, Synapse, SQL, and Data Lake (Medallion Architecture, Blob Storage). Demonstrates proficiency in leading data management tools and holds certifications such as Azure Databricks Platform Architect and Databricks Lakehouse Fundamentals from Databricks, as well as Azure Fundamentals - AZ900 and Azure Data Fundamentals - DP900 from Microsoft. Key skills encompass Azure Cloud Architecture, the design and implementation of Data Lakes and Lakehouses with Delta Lake, data ingestion, orchestration, and pipeline creation using Azure Data Factory, and data processing with Databricks (SQL and PySpark). Additionally experienced in utilizing Azure Synapse Analytics, managing Azure SQL Databases, SQL Server, T-SQL, API data ingestion, Python programming, and advanced reporting with Power BI (Power Query, DAX). Demonstrates capability in automating tasks via Azure Functions and integrating services through Azure Logic Apps. Experienced in leveraging Microsoft's suite for development operations, including DevOps practices with repositories and CI/CD pipelines using Build and Release features.
Data Architect
11/1/2023 - Present
As a Cloud Data Architect, led a data environment modernization project, migrating tools and processes from an on-premise environment to Azure Cloud. Responsible for data architecture, governance, and implementing best practices in Data Engineering. Modernized data architecture on Azure, provisioning resources for development and production environments. Developed robust and parameterized data pipelines using Data Factory and processed data in Medallion and Delta Lake architecture with Databricks. Created CI/CD pipelines for automated deployments with Azure DevOps, encompassing Databricks and Data Factory components. Implemented DevOps processes and utilized GIT for version control. Planned and executed the Lakehouse modernization with Delta Lake and automated processes using applications and services developed in Python.
Additional responsibilities in an on-premise environment included managing SQL Oracle 11g for Data Warehouse operations, utilizing Aecorsoft Data Integrator, and working with Analysis Services.Data Engineer
5/1/2022 - 11/1/2023
Worked as a Data Engineer on a modernization and data democratization project within the Hyper Automation & FinOps team. Improved data environments by applying best practices and development standards, collaborating with the development team to create high-quality data pipelines aimed at providing the FinOps team with processed data for significant savings. Utilized tools and technologies including Databricks, Data Factory, Data Lake Gen2 with Medallion architecture, Azure DevOps, Rundeck for Python-based process automation, Logic Apps for low-code automation, and SQL for data modeling.
Played a key role in the data modernization and democratization project within the Data Center & Cloud team. Provisioned entire data architecture and integrated tools, later developing the team's data pipelines. Deployed data architecture components including Databricks, Azure Data Factory, Data Lake Gen2, Key Vault, and Medallion Architecture. Acquired data from various APIs (ServiceNow, Azure DevOps, Log Analytics, Azure Resource Graph, RedHat, WSUS), databases, and other data sources. Developed robust, automated data pipelines using Azure Data Factory, performed data processing and ETL tasks with Databricks (PySpark and SQL), and provisioned data for BI and Data Science. Created dashboards in Power BI, documented processes, and maintained governance. Automated processes using Logic Apps, Power Automate, Rundeck, and Python.Data Analyst I
1/1/2021 - 5/1/2022
Worked as a Data Analyst focusing on data engineering to establish a data team in the TechOps area at a prominent technology organization. Undertook comprehensive data engineering responsibilities using Azure tools, including data collection from various APIs like Service Now, MoviDesk, ZenDesk, as well as databases such as SQL Server, MySQL, DB2, SFTP, and File Servers. Handled data ingestion and pipeline orchestration with Azure Data Factory and developed ETL processes using Databricks with PySpark and SQL. Conducted data queries and in-depth analysis using Metabase and Presto, and developed insightful dashboards in Power BI and Metabase. Ensured collaborative code versioning and repository management using GitHub and implemented an efficient data catalog system with Purview.Computer Technician II
3/1/2020 - 1/1/2021
Provided assistance to users of the CSC Excellence Center, supporting IT equipment including Dell Thin Clients, Lenovo Desktops, and Notebooks with Microsoft Intune AD management. Delivered support for infrastructure, network, and telecom equipment such as racks, patch panels, fiber optic converters, and structured cabling. Configured switches and network equipment for Zabbix monitoring, ensuring seamless operation and connectivity.Systems Implementation Analyst
1/1/2019 - 3/1/2020
Coordinated deployment teams for the implementation of ERP systems, PDV, Mobile POS, ensuring comprehensive client onboarding through training and follow-ups. Successfully implemented ManagerGold, Marketplace, POS Gold, and GoldChef systems across various industries, including distributors, restaurants, show houses, and general commerce. Developed significant expertise in ERP deployment, alongside training and support skills to facilitate seamless transitions for new clients.Support Lead
1/1/2018 - 1/1/2019
Coordinated the Support Team to enhance customer service delivery. Installed and configured new databases while performing preventive maintenance tasks, including backups and security routines, to ensure data integrity for clients. Conducted monthly quality assessments to improve customer service standards. Executed routines and queries within SQL Server databases to maintain operational efficiency. Performed basic maintenance tasks on FAST Report reports, thereby ensuring the consistent reliability and accuracy of generated reports.Support Analyst
3/1/2016 - 12/1/2017
Developed expertise in providing customer service for complex systems, focusing on ERP system setup and maintenance. Acquired proficiency in offering remote support to customers using tools such as TeamViewer. Demonstrated significant skills in querying and correcting routines via SQL Server, along with the installation and configuration of SQL Server databases.
Computer Technician at Senai São Paulo
2013 - 2015IT Project Management at Cruzeiro do Sul University
2020 - 2021Postgraduate in Data Engineering at Anhanguera College
2023 - 2023
Microsoft Certified: Azure Fundamentals AZ900 at Microsoft
12/1/2023Databricks Academy Accreditation - Azure Databricks Platform Architect at Databricks
11/1/2023Azure Data Fundamentals - DP900 at Microsoft
2/1/2023Databricks Lakehouse Accreditation at Databricks Academy
9/1/2022Power Automate - RPA Beginner at Udemy
1/1/2022Processing Large Datasets in a Parallel and Distributed Manner with Spark at Digital Innovation One Inc.
10/1/2021Spark and Python for Big Data with PySpark at Udemy
8/1/2021REST / RESTful APIs Documentation at Udemy
7/1/2021Introduction to Data Science: Basic Concepts at LinkedIn
3/1/2021Introduction to Data Science: How to Tell Stories with Data at LinkedIn
3/1/2021Foundations of Statistics: Part 1 at LinkedIn
3/1/2021Data Engineering with Azure - Basic at Udemy
2/1/2021ETL Integration Services - BI SQL at Udemy
2/1/2021Lean Six Sigma Yellow Belt Certification at 6SIGMAstudy - The global certification body for six sigma certifications
2/1/2020Lean Six Sigma White Belt Certification. at FM2S Treinamentos e Desenvolvimento Profissional e Gerencial Ltda.
2/1/2020Windows Server 2019 and Active Directory at Udemy
1/1/2020Power BI at Udemy
11/1/2019SQL Server and MySQL Database Certificate - T-S at Udemy
9/1/2019Data Cabling System Furukawa and Fluke Networks at Educare
9/1/2014
Caique is available for hire
Hire Caique C.
All Howdy Candidates are vetted for skills and english proficiency.
