Job ID: 24-03990
Location: Jersey City, NJ
Duration: 6 Months
Job Vacancies: 2
Note: Only W2 (No Corp-to-Corp)
Job Description
- Must have hands on experience :
- min. 10 year programing experience
- Cloud - AWS
- Spark - performance tuning
- Machine learning ops
Key Responsibilities:
- Design & Develop spark data processing pipelines that can apply complex transformations on large volumes of data
- Help teams with Performance tuning of complex spark jobs processing huge volumes of data in limited time
- Develop and enhance common data processing frameworks focusing on efficiency, scalability and code reusability
- Implement and optimize streaming data processing pipelines using Kafka, Flink
- Provide mentorship and technical guidance to junior team members, promoting best practices in data processing & Streaming
- Stay current with the latest trends and technologies in Java, Spark, streaming and big data processing, AWS services
- Lead code reviews, ensuring high coding standards and practices
Qualifications:
- Bachelor’s or Master’s degree in computer science, engineering or related field
- 10+ years of relevant professional experience in software development with a focus on Java, spark, streaming and batch high volume data processing
- Proven experience in performance tuning of Spark jobs in large-scale data environments
- Strong background in streaming data technologies and real-time data processing using kafka, spark, flink
- Experience building common frameworks/libraries, particularly for data processing
- Exceptional problem solving skills and algorithmic thinking
- Experience with AWS cloud platform and services (including SNS, SQS, Event bridge, lambda, glue, lake formation etc.)
- Knowledge of Docker, Kubernetes and other containerization and orchestration tools
- Candidate little short on above experience can still apply if they have experience in working with MLOps with specific expertise in implementing and managing offline/online/in-line feature stores using vendor products like Sagemaker, Tecton, Feast, Databricks etc.
Please apply on our company website (www.artechinfo.com) with reference to job ID, or contact me at vishal.kumar3@artech.com / 973 604 7572
Vishal Kumar
Lead Recruiter
Office: +1 973 604 7572
Email: vishal.kumar3@artech.com
360 Mt. Kemble Avenue, Suite 2000, Morristown, NJ 07960
Website: www.artech.com
About Artech Information Systems LLC
Artech is a full-service staff augmentation firm dedicated to providing mission critical human capital solutions. Founded in 1992, Artech has an estimated $810M annual revenue run rate for 2019 and about 10,500 employees and consultants across the US, Canada, India, and China.
Artech is a minorityand women-owned enterprise (MWBE) and is certified by the WBENC, NMSDC, and CPUC. Artech is also a NMSDC Corporate Plus member and was recently ranked as the 11th largest IT staffing firm and the #1 Largest Women-Owned IT Staffing Companies in the U.S. by Staffing Industry Analysts (SIA).
As a Tier-1 Preferred Supplier to over 80 Fortune 500 clients and federal government entities, Artech has extensive staff augmentation experience in both IT and non-IT categories. Artech provides a variety of workforce solutions to meet the needs of its clients in support of job categories such as Information Technology (IT); Engineering; Professional and Managerial; Scientific, Clinical and regulatory; HR; Legal; Sales and Marketing; and Finance and Accounting.