Address
Form of workJob Description
Hi,
Greetings to you!!!
This is Ravi Kiran from Echo IT Solutions INC. We are looking for the position of Data Engineer at NYC, NY- Onsite.
Data Engineer
C2C
Hybrid NYC,NY
9+Years
Independent visa (No Employers)
Candidates would be working on the Enterprise Data and Analytics Platform. Responsible for the system architecture and solution design, ensuring the platform is scalable while performant.
1. Design and implement data pipelines using Databricks, Spark, and other Big Data technologies.
2. Collaborate with data scientists, analysts, and business stakeholders to understand their data needs and build solutions that meet those needs.
3. Build and maintain data warehouse and data lake solutions that can scale with the business.
4. Develop and maintain ETL workflows, including data transformation, validation, and loading.
5. Implement and maintain data security policies and procedures to ensure the confidentiality, integrity, and availability of data.
6. Build and maintain monitoring, alerting, and logging solutions to ensure the health and performance of data pipelines.
7. Optimize data pipelines for performance, scalability, and cost.
8. Keep up-to-date with emerging trends and technologies in the Big Data ecosystem.
Skills & Requirements
Experience with software and cloud engineering and architecture in building enterprise data analytics platforms
Experience in implementing solutions using Azure Data lake, Azure Databricks and PowerBI
Experience creating data ingestion and data pipelines using python / datadricks
Experience configuring and deploying Azure services.
expertise with Python development
Expertise with Databricks
Experienced in creating Analytics and reporting solutions.
The following are not required for this position but would be considered as a valuable asset in a potential candidate.
Excellent communication skills verbal and written
Experienced in facilitating meetings and working sessions
Experience in Azure DevOps and working in an Agile methodology.
