Address
Form of workLead Data Engineer
@ large Media company
Quick Facts:
12 Month Contract
Hybrid, Los Angeles OR NYC Office (2 days onsite. Tue/Th w. flexibility)
Experience level: Expert
Top Skills:
- Must have extensive experience building real-time data processing solutions.
- Must have advanced technical skills: Databricks, Snowflake, Python, DBT, AWS, Data Warehousing, BI, SQL
- Experience working with Apache AirFlow (fully automated workflow scheduling services)
Description:
Our client is seeking an experienced Sr. Data Engineer with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join their engineering team. If you enjoy designing and building innovative Data Engineering solutions using the latest tech stack in a fast-paced environment, this role is for you.
Three Pillars of the role:
Technical Leadership: They will need the expert on all the tools and technologies they have in their environment.
Project Management: Doing a light amount of PM but must know who is doing what and where they are. Good at delegating and managing tasks and keeping track of project progress.
Technical Architecture: This person will be the technical architect for the project. They’ll be creating the strategy and plans for the engineers to follow.
Primary Job Duties and Responsibilities:
• Collaborate with and across Agile teams to design and develop Data Engineering solutions by rapidly delivering value to our customers.
• Build distributed, low latency, reliable data pipelines ensuring high availability and timely delivery of data
• Design and develop highly optimized Data Engineering solutions for Big Data workloads to efficiently handle continuous increase in data volume and complexity
• Build highly performing real-time data ingestion solutions for streaming workloads.
• Adhere to best practices and agreed upon design patterns across all Data Engineering solutions
• Ensure the code is elegantly designed, efficiently coded, and effectively tuned for performance
• Focus on data quality and consistency, implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
• Create design (Data Flow Diagrams, Technical Design Specs, Source to Target Mapping documents) and test (unit/integration tests) documentation
• Perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
Focus on end-to-end automation of Data Engineering pipelines and data validations (audit, balance
controls) without any manual intervention
• Focus on data security and privacy by implementing proper access controls, key management, and
encryption techniques.
• Take a proactive approach in learning new technologies, stay on top of tech trends, experimenting with
new tools & technologies and educate other team members.
• Collaborate with analytics and business teams to improve data models that feed business intelligence
tools, increasing data accessibility, and fostering data-driven decision making across the organization.
• Communicate clearly and effectively to technical and non-Technical Leadership.
About TEKsystems:We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.
The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.
