Azure Data Engineer

Job Title: Data Engineer

Location: Sacramento, CA (Onsite)

Description

1. Excellent written and verbal communication
2. Must have worked on several (5+) projects building solutions for Data Pipelines, Data warehousing, Data Modelling on Azure Data Platform (AWS, Google Cloud Platform - good to have)
3. Expertise in design and development of Data pipelines and ETL using ADF, Databricks to move data from relational/structured/unstructured data from source to data lake to data warehouse, on Azure
1. Creating Pipelines and integrations of multiple data sources
2. Data processing and transformation using Databricks (Scala/Python)
3. Expertise in optimizing cost and performance of data pipelines
4. Experience working with Data Lake, Synapse on Azure
1. Designing Data Lake storage layer (Landing/staging, raw, trusted/curated zones)
2. Designing data storage DB schema, data models and processing on Azure Synapse DW
3. Experience with Synapse Spark Pool
5. Experience in Data Modelling
1. Building Data Models from structured and semi-structured data (Data Model, Common Data Model etc.)
2. Performance optimization of data model for high performance analytical and reporting workloads
6. Expertise with SQL Server and extensive experience with SQL programming
1. Programming and optimizing DB objects Views, Stored Procs, Functions
7. Good experience in defining data access policy and security for azure data services
8. Experience with Oracle EDW
9. Knowledge/Experience migrating from Oracle EDW to any cloud DW
10. Experience integrating AI skills/ML models with Data and reporting solutions
11. Experience in building API layer for downstream consumption