Data Warehouse Architect

Job Title: Data Architect (needed12-15 years)

Location: Springfield, Massachusetts

Responsibilities

· Develop and maintain data pipelines using SQL, Python, and PySpark within Microsoft Azure environment.

· Implement Medallion Lakehouse architecture using Azure Synapse or Microsoft Fabric.

· Design, develop, and deploy modern data processing solutions using notebook data pipelines.

· Integrate Microsoft Key Vault with data pipelines to ensure secure storage of credentials and sensitive information.

· Deploy data pipelines using CI/CD patterns with Microsoft Azure DevOps for automated and efficient deployment processes.

· Orchestrate resilient and observable data pipelines to ensure reliability and visibility into data processing workflows.

· Utilize Git version control system for managing codebase and facilitating collaboration within the team.

· Incorporate development environments, testing, and validation into Power BI solutions.

· Migrate content from IBM/Cognos to Power BI for improved data visualization and reporting capabilities.

· Implement role-based and attribute-based data security patterns within Power BI using Microsoft Azure services such as Microsoft Entitlement Management (Entara ID) and Microsoft Purview.

· Configure Power BI row-level security (RLS) and utilize Azure managed identities, service principal accounts, and multi-factor authentication for enhanced data security.

· Implement data encryption and data loss prevention measures using Azure sensitivity labels.

· Manage Power BI Premium per capacity licensing to optimize resources and performance.

· Utilize Microsoft PowerShell scripting for automation and administration tasks.

Requirements:

· Bachelor's degree in Computer Science, Engineering, or related field.

· Proven experience in data engineering with proficiency in SQL, Python, and PySpark.

· Hands-on experience with Microsoft Azure services including Azure Data Warehouse, Azure Data Lake, Azure Synapse, Delta Lake, and Azure Data Factory.

· Familiarity with Medallion Lakehouse architecture and its implementation using Azure Synapse or Microsoft Fabric.

· Strong understanding of CI/CD patterns and experience deploying data pipelines using Azure DevOps.

· Knowledge of data security best practices and experience implementing security measures within Power BI and Azure services.

· Experience with Power BI development, migration, and administration.

· Familiarity with Git version control system.

· Excellent communication and problem-solving skills.

Preferred Qualifications

· 10 to 15 Years of experience in Datawarehouse Architect

· Microsoft certification in Azure or Power BI.

· Experience with PowerShell scripting for automation tasks.

· Knowledge of data visualization best practices and experience with Power BI Premium features.

Job Type: Contract

Pay: $103,332.54 - $124,443.49 per year

Experience level:

• 10 years

Schedule:

• 8 hour shift

Ability to Relocate:

• Springfield, MA: Relocate before starting work (Required)

Work Location: In person