Job Description
Role : Senior Azure Data Engineer
Skills : Azure Data Factory, Spark, SQL, Python, Databricks, Snowflake
Job Responsibilities:
- Design, develop, and implement robust and scalable data solutions using Azure technologies, including Azure Data Factory, Azure SQL Data Warehouse, Azure Databricks, and/or Azure Synapse Analytics.
- Proficient in programming languages like Spark (with either Python or Scala), SQL
- Experience with Databases like Sql Server, Teradata, Snowflake, Synapse.
- Good understanding of Data Engineering principles, data modelling, data warehousing, and ETL/ELT processes which includes data testing, validation and reconciliation processes.
- Hands-on experience with data integration and data transformation frameworks, tools, and methodologies.
- Experience with version control systems like Git, GitHub etc
- Collaborate with cross-functional teams and business teams to understand business requirements and translate them into technical designs and solutions.
- Build and maintain data pipelines, data integrations, and data transformations to enable efficient data processing, storage, and retrieval.
- Optimize data infrastructure and solutions for performance, scalability, and cost-efficiency, ensuring high availability and reliability.
- Conduct data profiling, data validation, and data cleansing activities to ensure data integrity and accuracy.
- Mentor and provide technical guidance to junior Data Engineers, freshers/interns, fostering knowledge sharing and skills development within the team.
Good to have:
- Experience with version control systems, CI/CD pipelines, and automated testing frameworks.
- Knowledge in streaming technologies, pipelines and frameworks like Kafka, EventHub, Azure Stream Analytics.
Thanks & Regards
Alamgir Ansari | Technical Recruiter
alamgir.a@smarttechlink.com| www.smarttechlink.com
LinkedIn:www.linkedin.com/in/me-badshaah1
Smart TechLink Solutions Inc. firmly opposes e-mail "spamming". This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. We apologize to those who do not wish to receive this e-mail and to those who have accidentally received it again. Please reply with REMOVE in the subject listing, with all aliases email addresses that you would want to be removed, and any inconvenience caused is highly regretted. Please then delete the original message (including any attachments) in its entirety. We appreciate your patience and cooperation.