André F.
Data Engineer

Skills

Spark

Github

Databricks

Microsoft Sql Server

Html

Javascript

Python

Jira

André is available for hire

Hire André F.

All Howdy Candidates are vetted for skills and english proficiency.

Bio

Software Developer with over four years of experience in programming, specializing in ASP.Net Core C#, C, JavaScript, and Python. Expertise includes working with Excel, messaging and streaming technologies, API integration, and data formats such as CSV and JSON. Holds a degree in Computer Engineering with a solid foundation in Spark, SQL, and Unix systems. Has practical experience in DevOps practices, Azure Portal management, Databricks, Datafactory processes, Spark applications, SSMS for database management, and Blob Storage techniques. Possesses an intermediate level of English proficiency with strong reading comprehension and a focus on improving pronunciation.

Data Engineer
4/1/2021 - 11/1/2021

Created SQL queries and utilized Apache Spark to design and populate tables for feeding machine learning models. Developed and executed Python scripts in Jupyter notebooks to process data and save it on the Hive platform. Employed database administration tools such as DBeaver to visualize relationships between database tables and generate complex queries. Operated within a Scrum framework, participating in sprints, daily scrums, and sprint reviews to ensure iterative progress and collaboration.
Data Engineer
1/1/2022 - 3/1/2024

Developed expertise in creating tables and queries for machine learning models using Spark. Utilized manual methods with Excel and CSV tables for data management. Implemented messaging (streaming) and API (JSON) protocols to retrieve and send data efficiently. Executed the complete ETL process, transforming raw data into structured tables and processes suitable for machine learning models. Leveraged Databricks and Azure, specifically employing Azure Data Factory and Blob Storage for data operations. Utilized database administration tools, including SQL Server Management Studio (SSMS), to visualize the relationships between database tables and create precise queries. Engaged in Scrum methodology, participating actively in sprints, daily stand-ups, refining sessions, retrospectives, and sprint reviews. Managed tasks, cards, and comments using Jira and Azure Boards, ensuring effective project tracking and collaboration.
Full Stack Developer
1/1/2019 - 3/1/2021

Developed proficiency in Entity Framework and relational database modeling in SQL Server. Designed and implemented applications for people management and financial management, including logging user-made changes to records. Utilized DevOps in conjunction with Scrum methodology, focusing on task creation, sprint definition, and version control with Git. Leveraged Azure Portal for managing cloud resources, particularly for IoT solutions, and implemented encryption for file storage in the cloud. Created dynamic HTML pages using JavaScript and jQuery to enhance user experience.
Office Assistant
1/1/2015 - 12/31/2015

Assisted with a wide range of general administrative activities, demonstrating proficiency in handling office tasks efficiently. Ensured accurate and timely copying of essential documents, contributing to organized and effective workflow. Played a crucial role in internal service functions, facilitating smooth operations within the organization. Developed strong organizational skills and attention to detail. Familiarized with standard office software and tools, enhancing overall productivity. Proved reliability and commitment to maintaining high standards of service and support.