Address
Form of workSenior Data Engineer
Location: OFallon, MO/ Hybrid
Duration: 12 months with possible extension/ possible contract to hire
Job Description:
Summary:
As a Sr. Data Engineer in Data Platform and Engineering Services, you will have the opportunity to build high performance data pipelines to load into Client Data Warehouse. Our Data Warehouse provides analytical capabilities to a number of business users who help different customers provide answers to their business problems through data. You will play a vital role within a rapidly growing organization, while working closely with experienced and driven engineers to solve challenging problems.
Role:
-Develop high quality, secure and scalable data pipelines using spark, Java/Scala on object storage and Hadoop
-Follow Client Quality Assurance and Quality Control processes
-Leverage new technologies and approaches to innovating with increasingly large data sets
-Work with project team to meet scheduled due dates, while identifying emerging issues and recommending solutions for problems
-Perform assigned tasks and production incident independently
-Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency
All About Candidate:
-7 to 9 years of experience in Data Engineering and implementing multiple end-to-end DW projects in Big Data environment
-Experience of building data pipelines through Spark with Java/Scala on Hadoop or Object storage
-Experience of working with Databases like Oracle, Netezza and have strong SQL knowledge
-Experience of working on Nifi will be an added advantage
-Experience of working with APIs will be an added advantage
Experience and working in Unix environment is added advantage
-Experience of working in Agile teams
-Strong analytical skills required for debugging production issues, providing root cause and implementing mitigation plan
-Strong communication skills - both verbal and written and strong relationship, collaboration skills and organizational skills
-Ability to multi-task across multiple projects, interface with external / internal resources and provide technical leadership to junior team members
-Ability to be high-energy, detail-oriented, proactive and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results
-Ability to quickly learn and implement new technologies, and perform POC to explore best solution for the problem statement
-Flexibility to work as a member of a matrix based diverse and geographically distributed project teams
Overall client organization:
Merchant Enrichment Services
Data Platforms and Engineering Services
Data Warehouse
This person be supporting:
Data Platforms and Engineering ( previously DataWarehouse)
Software Development Engineering Guild
Teams main responsibility:
Provide Merchant location Data and Services to Enterprise.
Describe the culture of your team:
3 groups on a global level. They are very passionate about their quality of work, the tech lead they would work with is very helpful in growing the newer members of the team. Very involved and collaborative, but at the same time the opportunity is more on the candidate to prusue their growth. It's limitless opportunity and scope with the team and knowledge
Describe your management style:
Very flexible, very approachable, very technical and data metrics driven.
Typical work day:
This is a borderline tech lead role. 2 scrum calls per week, and the coordination is one of the most important pieces since we have 3 groups in 3 locations. The team lead will assign stories and expected outcome is coordinated by them. Monthly iterations
Top 3 required technical skills:
NiFi using spark, Java/Scala on object storage and Hadoop
Data Analysis , Sql knowledge with scripting
Basic Unix knowledge with some scripting
Hadoop Knowledge
Data Science Knowledge will be helpful
Couple of desired/nice to have skills:
API knowledge
Big Data Environment
Skills would you like to see in a candidate:
Excellent communication skills
Ability to work in multi group environment both functionally and geographically
Level of competency is required [Please use: Foundational, Intermediate, or Advanced]
Advanced
Any specific accreditations:
Any certification is good to have, but not specifically looking
Kind of accesses will this person need:
Network & Badge
Location: OFallon, MO/ Hybrid
Duration: 12 months with possible extension/ possible contract to hire
Job Description:
Summary:
As a Sr. Data Engineer in Data Platform and Engineering Services, you will have the opportunity to build high performance data pipelines to load into Client Data Warehouse. Our Data Warehouse provides analytical capabilities to a number of business users who help different customers provide answers to their business problems through data. You will play a vital role within a rapidly growing organization, while working closely with experienced and driven engineers to solve challenging problems.
Role:
-Develop high quality, secure and scalable data pipelines using spark, Java/Scala on object storage and Hadoop
-Follow Client Quality Assurance and Quality Control processes
-Leverage new technologies and approaches to innovating with increasingly large data sets
-Work with project team to meet scheduled due dates, while identifying emerging issues and recommending solutions for problems
-Perform assigned tasks and production incident independently
-Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency
All About Candidate:
-7 to 9 years of experience in Data Engineering and implementing multiple end-to-end DW projects in Big Data environment
-Experience of building data pipelines through Spark with Java/Scala on Hadoop or Object storage
-Experience of working with Databases like Oracle, Netezza and have strong SQL knowledge
-Experience of working on Nifi will be an added advantage
-Experience of working with APIs will be an added advantage
Experience and working in Unix environment is added advantage
-Experience of working in Agile teams
-Strong analytical skills required for debugging production issues, providing root cause and implementing mitigation plan
-Strong communication skills - both verbal and written and strong relationship, collaboration skills and organizational skills
-Ability to multi-task across multiple projects, interface with external / internal resources and provide technical leadership to junior team members
-Ability to be high-energy, detail-oriented, proactive and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results
-Ability to quickly learn and implement new technologies, and perform POC to explore best solution for the problem statement
-Flexibility to work as a member of a matrix based diverse and geographically distributed project teams
Overall client organization:
Merchant Enrichment Services
Data Platforms and Engineering Services
Data Warehouse
This person be supporting:
Data Platforms and Engineering ( previously DataWarehouse)
Software Development Engineering Guild
Teams main responsibility:
Provide Merchant location Data and Services to Enterprise.
Describe the culture of your team:
3 groups on a global level. They are very passionate about their quality of work, the tech lead they would work with is very helpful in growing the newer members of the team. Very involved and collaborative, but at the same time the opportunity is more on the candidate to prusue their growth. It's limitless opportunity and scope with the team and knowledge
Describe your management style:
Very flexible, very approachable, very technical and data metrics driven.
Typical work day:
This is a borderline tech lead role. 2 scrum calls per week, and the coordination is one of the most important pieces since we have 3 groups in 3 locations. The team lead will assign stories and expected outcome is coordinated by them. Monthly iterations
Top 3 required technical skills:
NiFi using spark, Java/Scala on object storage and Hadoop
Data Analysis , Sql knowledge with scripting
Basic Unix knowledge with some scripting
Hadoop Knowledge
Data Science Knowledge will be helpful
Couple of desired/nice to have skills:
API knowledge
Big Data Environment
Skills would you like to see in a candidate:
Excellent communication skills
Ability to work in multi group environment both functionally and geographically
Level of competency is required [Please use: Foundational, Intermediate, or Advanced]
Advanced
Any specific accreditations:
Any certification is good to have, but not specifically looking
Kind of accesses will this person need:
Network & Badge
