Curation Pipeline Engineer

Curation Pipeline Engineer

Salary Range: $83,200 - $104,000 per year

Location: Remote - PST schedule

Responsibilities

• Develop data pipeline to orchestrate the lifecycle of crowd grading tasks, build dashboard to monitoring and reporting the quality of tasks
• Programming in one of the following languages: Java, Python, Scala
• Audit a wide variety of data for correctness

Required Skills

• Programming language - Python, Java, or Scala
• Familiarity with Git or similar version control system
• Good understanding of data processing concepts and data engineering process.
• Able to frequently collaborate closely with a diverse tight-knit team
• Experience investigating and/or debugging problems
• Able to track, analyze, and report issues in a timely manner
• Attention to detail and a commitment to quality, while delivering work on schedule
• Highly organized and efficient
• Flexibility to respond and react to changing priorities quickly and efficiently
• Excellent oral and written communication in English

Highly Desired Skills

• Big data processing, e.g., Spark/Hadoop
• Cloud based services, e.g., AWS
• Workflow management tools, e.g., Apache Airflow
• SQL
• UI design fundamentals
• Web development technologies, such as React for JS
• QA/QE

Education

• BA or BS degree or equivalent work experience.