Address
Form of workJob Description
Senior Data Engineer (DevOps Automation)
Location: Alameda, CA (Hybrid)
Duration: Contract
Rate: DOE
US Citizens, GC, EAD ( H4, L2), E3 TN visa holders preferred, NO third party corp to corp accepted for this job
Key Responsibilities:
Qualifications:
Location: Alameda, CA (Hybrid)
Duration: Contract
Rate: DOE
US Citizens, GC, EAD ( H4, L2), E3 TN visa holders preferred, NO third party corp to corp accepted for this job
Key Responsibilities:
- Design, implement, and maintain robust, scalable, and automated Data Engineering solutions.
- Develop and manage data pipelines using AWS services like Glue, S3, and Redshift.
- Utilize Terraform for infrastructure as code (IaC) to ensure consistent and reliable environment provisioning.
- Maintain and enhance CI/CD pipelines for Data Engineering applications, ensuring seamless integration and deployment.
- Collaborate with Data Engineers to understand data needs and implement solutions that meet these requirements.
- Develop scripts and tools in Python to automate various Data Engineering tasks.
- Manage source control using GitHub, including branching, merging, and version control.
- Ensure data security and compliance with industry standards and company policies.
- Monitor, troubleshoot, and optimize data systems for performance and efficiency.
- Stay updated with the latest trends and technologies in DevOps and Data Engineering.
Qualifications:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- At least 9+ years of experience in a DevOps role with a focus on Data Engineering infrastructure.
- Strong experience with AWS services, especially Glue, S3, and Redshift.
- Proficient in Terraform for infrastructure automation.
- Extensive experience in Python programming, specifically for Data Engineering tasks.
- Solid understanding of data pipeline and workflow management tools.
- Expertise in source control management using GitHub.
- Excellent problem-solving skills and ability to work under tight deadlines.
- Strong communication and teamwork skills.
