Sr. Data Engineer

Responsibilities:

• Design, develop, and maintain data pipelines and ETL processes in the AWS cloud environment.
• Collaborate with cross-functional teams to gather requirements and translate them into scalable AWS-based data solutions.
• Utilize AWS services such as EC2, S3, EKS, OpenShift, Lambda, API Gateway, RDS, CFT, etc., to build robust and efficient data pipelines.
• Implement data governance and security best practices within the AWS infrastructure to ensure data integrity and compliance.
• Optimize data storage and retrieval mechanisms using AWS technologies to achieve high performance and scalability.
• Develop and maintain documentation for data pipelines, configurations, and architecture in the AWS environment.
• Troubleshoot and resolve issues related to data processing, storage, and integration within the AWS ecosystem.
• Stay updated on the latest AWS services and features to leverage new capabilities for enhancing Data Engineering solutions.

Requirements:

• Bachelor's degree in Computer Science, Information Technology, or related field.
• Minimum of 5 years of hands-on experience working with AWS cloud services.
• Strong understanding of AWS architecture principles and best practices.
• Proficiency in using AWS services such as EC2, S3, EKS, OpenShift, Lambda, API Gateway, RDS, CFT, etc.
• Experience with building and optimizing data pipelines using AWS data services (e.g., AWS Glue, AWS Data Pipeline).
• Knowledge of data modeling, data warehousing, and data integration concepts.
• Familiarity with SQL and NoSQL databases, data lakes, and big data technologies.
• Excellent problem-solving skills and ability to troubleshoot complex Data Engineering issues.

Preferred Qualifications:

• AWS certification (e.g., AWS Certified Solutions Architect, AWS Certified Data Engineer – Specialty).
• Experience with containerization technologies such as Docker and Kubernetes.
• Knowledge of DevOps practices and tools for automated deployment and infrastructure as code (IaC).

Job Types: Full-time, Contract

Salary: $70.00 - $90.00 per hour

Expected hours: 40 per week

Experience level:

• 9 years

Schedule:

• 8 hour shift

Application Question(s):

• Can you work on W2?

Experience:

• Data Engineering: 10 years (Required)

Ability to Relocate:

• New York, NY 10171: Relocate before starting work (Required)

Work Location: In person