Address
Form of work Job Title: Hadoop Developer
Location: Remote
Duration: 6 months
Job Description:
Location: Remote
Duration: 6 months
Job Description:
- Strong communication skills able to interact with the business to explain concepts and understand requirements.
- Strong critical thinker.
- Able to drive initiatives forward.
- Hadoop background for more than 4 years.
- Spark - familiar with programming within a Spark context.
- Strong Scala/Java programing skill is required.
- Strong SQL background
- Comfortability with the Linux operating system.
- Strong streaming programing experience reading from Kafka and/or Azure event hub and/or AWS SQS is a desired skill set.
- Azure Cloud experience a plus.
- HDFS - Fundamental understanding of how HDFS works is a minimum.
- NiFi - Experience using NiFi in different use cases would be a plus.
- Hive - Should be able to understand the limitations and benefits of using Hive. What the differences between it and Impala are. And when best to use it.
- Impala - Same as Hive.
- Parquet and AVRO file experience.
- HBase - Some experience in working on use cases that dealt with NoSQL/unstructured data.
- Yarn - Basic understanding of how Yarn works and how to use it.
