Job Description
- At least 4 good years of experience using Spark , SQL and Python (or Scala) on Databricks
- Software solution development experience using agile and devops to implement Data Engineering workflows on Databricks
- Experience using Scala to deploy end to end Data Engineering applications
- Experience deploying Data Analytics and Engineering related resources on AWS using Terraform
- Kubernetes, Docker and Jenkins experience preferred, but not required.
- Being adaptable and having a flexible approach to problem-solving would be beneficial.