Lead Hadoop Admin/Developer

Role: Lead Hadoop Admin/Developer

Location: Foster City CA (Onsite Hybrid)

Duration: 6+ Months

Job Description:

Key skills required for Lead Hadoop Admin:

Hadoop (preferably Hortonworks/Open Distribution), HDFS, Hive, Kafka, Spark, Oozie/Airflow, HBase

Intermediate proficiency in SQL & HQL

Solid understanding of Linux, and scripting skills would be advantageous

Experience with Kerberos, TLS, Ranger, and data encryption

JD:

Basic to intermediate experience with Spark

Good experience with SQL. Should be able to understand and implement performance optimization.

Memory management experience

Queue allocation, distribution experience in Hadoop/Cloudera environments

Should be able to scale clusters in production and have experience with 18/5 or 24/5 production environments.

Good with one programming language.

Good exposure to Hive and Hadoop systems with exposure to monitoring tools. Sqoop, Oozie and other external tools.

Familiar with patch upgrades.