Data Pipeline Engineer

Software Resources has an immediate job opportunity for a Pipeline Engineer with a major corporation CA. (Need to be local to either Santa Monica or Burbank/Glendale.)
Duration: 24 month(s)
Pay Rate: $90-$100/hr DOE
Must Have Skills:

• Spark, Scala, Spring/Springboot/Java
• 3-5 years general experience in addition to having experience in production
• Having worked at a company in production environments, Operationalize and Productionize of systems having worked on both
• Data pipeline experience
• Software engineering in Big Data experience
• Ad targeting business domain experience

Description:
The Ad Intelligence team is under Ad Platforms and its mission is to transform advertising and Ad platform with data and AI across TV and streaming video. We build solutions to measure and optimize every aspect of the advertising life cycle. Our tenant is a strong cross-domain team to deliver E2E solutions covering tech areas ranging from machine learning, big data, microservices to data visualization. Our team is seeking a senior software engineer who will be a core team member for our advertising data platform engineering group. This engineering group focuses on big data infrastructure, operational data, audience solution, inventory forecasting and full funnel measurements as a foundation layer for addressable Ad Platforms.
Basic Qualifications:
WHAT YOU'LL DO

• Build components of large-scale data platform for real-time and batch processing, and own features of big data applications to fit evolving business needs
• Build next-gen cloud based big data infrastructure for batch and streaming data applications, and continuously improve performance, scalability and availability
• Contribute to the best engineering practices, including the use of design patterns, CI/CD, code review and automated test
• Chip in ground-breaking innovation and apply the state-of-the-art technologies
• As a key member of the team, contribute to all aspects of the software lifecycle: design, experimentation, implementation and testing.
• Collaborate with program managers, product managers, SDET, and researchers in an open and innovative environment

WHAT TO BRING:

• Bachelor or above in computer science or EE
• 4+ years of professional programming in Java, Scala, Python, and etc.
• 3+ years of big data development experience with technical stacks like Spark, Flink, Singlestore, Kafka, Nifi and AWS big data technologies
• Knowledge of system, application design and architecture
• Experience of build industry level high available and scalable service
• Passion about technologies, and openness to interdisciplinary work

Preferred Qualifications:

• Experience with processing large amount of data at petabyte level
• Demonstrated ability with cloud infrastructure technologies, including Terraform, K8S, Spinnaker, IAM, ALB, and etc.
• Experience with ClickHouse, Druid, Snowflake, Impala, Presto, Kinesis, etc.
• Experience in widely used Web framework (React.js, Vue.js, Angular, etc.) and good knowledge of Web stack HTML, CSS, Webpack

Required Education:
BS STEM- MUST
Don't delay. Join the Software Resources team today!
Software Resources specializes in connecting talented IT professionals with challenging job opportunities that transform jobs into careers.
To meet our clients hiring needs, we continuously source talented IT Professionals with all levels of expertise and in all disciplines. We offer world class major medical, dental and vision benefits, 401(k) with match, short term disability, Life Insurance and AD&D. You, our future employees, can make a tremendous difference to our company and our clients. Please apply to this job and experience the Software Resources difference. You can view all of our jobs at https://www.softwareresources.com/careers/