Job Description
- Strong experience in Spark, need to be able to tune the spark jobs.
- Strong Python programmer.
- Very good experience Bigdata( In GCP it is Data Proc), programming and Hadoop admin level.
- Google cloud platform experience like BQ (Big Query), Dataproc, Serverless, cloud functions, GCR (Google Container Registry) etc.
- Good at orchestration tolls like cloud composer
- Good experience Kubernetes (GKE or EKS )
- Experience in Docker images and corresponding repositories.
- CI/CD experience like Jenkins.
- Need good experience in how machine learning models work , what are different algorithms, how each model performance will be measured etc. Entire life cycle of machine learning model.