Azure Adf Engineer

Onebridge is a Consulting firm with an HQ in Indianapolis, and clients dispersed throughout North America and beyond. We have an exciting opportunity for a highly skilled Azure ADF Engineer to join an innovative and dynamic group of professionals at a company rated among the top Best Places to Work in Indianapolis since 2015.

Azure ADF Engineer | About You

As an Azure ADF Engineer, you are responsible for designing, developing, and implementing data solutions within the Azure cloud environment. Your expertise in Azure ADF will be instrumental in orchestrating data workflows, managing data pipelines, and ensuring efficient data integration processes. Your strong SQL skills for data manipulation and querying further enhance your ability to optimize and streamline data processes effectively. Collaborate with cross-functional teams to translate business requirements into scalable and reliable data solutions, contributing to the overall success of data-driven initiatives.

Azure ADF Engineer | Day-to-Day

• Design and develop data pipelines using Azure Data Factory, ensuring optimal performance and reliability.
• Implement and manage end-to-end data workflows, coordinating the execution of tasks and processes within Azure ADF.
• Collaborate with data engineers, analysts, and other stakeholders to integrate data from various sources into Azure Data Factory.
• Monitor the performance of data pipelines, troubleshoot issues, and optimize processes for efficiency and scalability.
• Set up, monitor, and report on Azure AI environment.
• Implement security measures and ensure compliance with data governance and privacy policies in all data-related activities.
• Maintain thorough documentation of data solutions, including pipeline configurations, dependencies, and troubleshooting procedures.

Azure ADF Engineer | Skills & Experience

• 8+ years of progressive Data engineering experience with a focus on Azure Data Factory.
• Hands-on experience with Azure Cloud services and architecture, including pipeline development, orchestration, ADF, ADS, ADB, and ADLS.
• Experience setting up, monitoring, and reporting on Azure AI environment.
• Deep SQL experience and proficiency with Python.
• Experience with data modeling, ETL processes, and ingesting semi-structured and unstructured data.
• Excellent problem-solving and analytical skills, with the ability to troubleshoot and optimize data pipelines.
• Ability to adapt to evolving technologies and changing business requirements.
• Certifications: Azure certifications related to data engineering or data analytics (e.g., DP-203, DP-200, DP-201) are a bonus!

A Best Place to Work in Indiana since 2015