Lead Data Engineer

About Client:
The client is a global provider of digital business transformation, digital engineering, and information technology (IT) outsourcing services that accelerate our clients’ journey to their digital future. The company readily understands its clients' business challenges and uses its domain expertise to deliver innovative applications of technology to address their critical business challenges.
It helps clients execute successful end-to-end digital business transformation initiatives.
Rate Range: $70-$80/Hr on c2c
Job Description:

• We are seeking a highly skilled and experienced Lead Data Engineer with a proven track record of at least 9 years in the field.
• The ideal candidate will have extensive hands-on experience with Google Cloud Platform (GCP) services, particularly DataProc and Pub/Sub, and proficiency in programming languages such as Java (required), Pyspark, and Scala.
• Experience with the Hadoop ecosystem, including YARN scheduler and Apache Livy, is essential.

• Proven experience (9+ years) as a Data Engineer.
• Extensive hands-on experience with GCP services including DataProc and Pub/Sub.
• Proficiency in programming languages such as Java (must), Pyspark and Scala.
• Experience working with Hadoop eco system including YARN scheduler and Apache livy.
• Good to have experience in AWS EMR, Kinesis and migration project.
• GCP certification(s) is a strong advantage.
• Develop, implement, and optimize real-time data processing workflows using GCP services such as dataproc and Pub/Sub.
• Provide technical leadership and mentorship to junior Data Engineers, fostering skill development and best practices.
• Diagnose and resolve issues related to batch and stream job processing.
• Strong communication skills to effectively interact with both technical and non-technical stakeholders.
• Create and maintain comprehensive documentation for data processing workflows, ensuring easy knowledge transfer and compliance with data governance standards.

About ApTask:
Join ApTask, a global leader in workforce solutions and talent acquisition services, as we shape the future of work. We offer a comprehensive suite of offerings, including staffing and recruitment services, managed services, IT consulting, and project management, providing unparalleled opportunities for professional growth and development. As a member of our dynamic team, you'll have the chance to connect businesses with top-tier professionals, optimize workforce performance, and drive success for our clients across diverse industries. If you are passionate about excellence, collaboration, and innovation, and aspire to make a meaningful impact in the world of work, come join us at ApTask and be a part of our mission to empower organizations to thrive.
Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.
Candidate Data Collection Disclaimer:
At ApTask, we prioritize safeguarding your privacy. As part of our recruitment process, certain Personally Identifiable Information (PII) may be requested by our clients for verification and application purposes. Rest assured, we strictly adhere to confidentiality standards and comply with all relevant data protection laws. Please note that we only collect the necessary information as specified by each client and do not request sensitive details during the initial stages of recruitment.
If you have any concerns or queries about your personal information, please feel free to contact our compliance team at businessexcellence@aptask.com.