Address
Form of workJob Description
Title: Cloud Data Engineer
Location: Kansas MO or Boston MA
Hire Type:
Overview:
Sterling has helped build careers for thousands of professionals like yourself. Our expert recruiters support you at every step in the process and as a Best of Staffing company, Sterling provides exciting work with exceptional employers across the U.S.
As a contract employee of Sterling, you are eligible to receive aFull Employee Benefits Package that includes paid time off, paid holidays, 3 medical plans to choose from, dental & vision plans, 401(k), and an Employee Stock Ownership (ESOP) plan.
Job Summary:
I am looking for an experienced Cloud Data Engineer to join our team and help build and maintain DeltaLake platform on the cloud, leveraging Databricks. As a Cloud Data Engineer, you will be expected to contribute to all stages of the data lifecycle, including data ingestion, modeling, profiling, quality, transformation, movement, and curation.
Job Duties:
- Design, implement, and support on-premise and cloud-based data infrastructure that is resilient to disruptions and failures.
- Provide subject matter expertise and hands-on delivery of data acquisition, curation, and consumption pipelines on Azure, Databricks, AWS, and Confluent.
- Maintain the current and emerging state-of-the-art compute and cloud-based solutions and technologies.
- Enhance and support corporate SQL, DWH assets, and streaming data solutions.
- Ensure high uptime for all data services and consider enhanced solutions through scheduled or event-driven design.
- Bring multi-cloud/cross-platform agnostic technologies and practices into the system to enhance reliability and support rapid scaling of the business's data needs.
- Scale up our data infrastructure to meet cross-functional, multi-industry business needs.
- Develop, leverage, and maintain end-to-end data pipelines in production.
- Build effective relationships with internal stakeholders.
- Have familiarity with the technology stack available in the industry for metadata management, including Data Governance, Data Quality, MDM, Lineage, and Data Catalog.
- Have hands-on experience implementing analytics solutions leveraging Python, Spark SQL, Databricks Lakehouse Architecture, and orchestration tools like Kubernetes and Docker.
Qualifications:
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Proven experience as a Data Engineer, with a strong background in data infrastructure design and implementation.
- Hands-on experience with cloud-based data platforms like Azure, AWS, and Databricks.
- Strong proficiency in SQL, Python, and Spark.
- Familiarity with metadata management tools and practices.
- Excellent problem-solving skills and attention to detail.
- Strong communication and interpersonal skills.
- Ability to work independently and as part of a team.
#NS
Qualified applicants will receive consideration for employment without regard to race, color, age, religion, sex, sexual orientation, gender identify, national origin, disability, protected veteran status, or genetic information.
