Address
Form of workJob Description
Big Data Engineer
Location: Ridgefield, NJ
Interview: Phone + Skype
Job description: Responsibilities include:
Location: Ridgefield, NJ
Interview: Phone + Skype
Job description: Responsibilities include:
Translate complex functional and technical requirements into detailed design.
Design for now and future success
Hadoop technical development and implementation.
Loading from disparate data sets. by leveraging various Big Data technology e.g. Kafka
Pre-processing using Hive, Impala, Spark, and Pig
Design and implement data modeling
Maintain security and data privacy in an environment secured using Kerberos and LDAP
High-speed querying using in-memory technologies such as Spark.
Following and contributing best engineering practice for source control, release management, deployment etc
Production support, job scheduling/monitoring, ETL data quality, data freshness reporting
Skills Required:
5-8 years of experience writing complex SQL queries.
4+ years of Python development experience
5+ years of demonstrated technical proficiency with Hadoop and Big Data projects
3+ years of demonstrated experience and success in data modeling.
Ability to automate and implement ETLs to reduce manual work.
Fluent in writing shell scripts [bash, korn]
Writing high-performance, reliable and maintainable code.
Knowledge and ability to implement workflow/schedulers within Oozie
Experience working with AWS components
Analytical and problem solving skills, applied to Big Data domain
Proven understanding and hands on experience with Hadoop, Hive, Presto and Spark
Good aptitude in multi-threading and concurrency concepts.
B.S. or M.S. in Computer Science or Engineering
Yogesh Sharma
("Believe you can and you're halfway there.")
Theodore Roosevelt
Sr. IT Tech Recruiter
(Java, Security, Embedded, Network, Salesforce, DBA)
Phone: 2017789311 Email: Yogesh@stellentit.comGtalk: Yogesh@stellentit.com
LinkedIn: https://www.linkedin.com/in/yogesh-sharma-520957223/
Vendor list
