Senior Data Engineer

at American Express in Boise, Idaho, United States

Description

Accertify is the trusted partner to the world's leading eCommerce brands. We help our clients grow revenue and protect against loss with industry-leading fraud prevention and digital identity offerings. When you join Accertify, you become part of the digital solution to enable legitimate eCommerce, delivering peace of mind to merchants and their customers across the globe. #TeamAccertify provides a solution merchants trust and a career you can trust.

Accertify is a wholly owned subsidiary of American Express-which means our team has access to the amazing perks and benefits offered by our parent company. We are proud to be #TeamAmex and #TeamAccertify.

Accertify is growing, and we are looking to add a Senior Data Engineer to our global fraud-fighting team.

How will you make an impact in this role?

The Senior Data Engineer will work with large volumes of data supporting our products fighting Payment Fraud and Account Protection by crafting innovative solutions supporting the Product and Decision Science's needs. The Senior Data Engineer will work with the latest technology solutions in the industry and actively participate in brainstorming and solution design sessions along with other Data Engineers.

Essential Duties and Responsibilities:

• Design, build, and maintain complex data processing systems, both structured and unstructured.

• Build efficient data workflows and data ingestion mechanisms to hydrate the data lake environment.

• Build data pipelines leveraging Hadoop and Spark to aggregate data and create features from a streaming data source.

• Performing QA testing on the data pipelines to validate the accuracy, scalability, and maintainability requirements.

• Package the data pipeline jobs and run them on Kubernetes clusters.

• Develop simplified yet scalable data processing patterns to streamline the existing pipelines for maintainability.

• Experiment with various tools and packages to be added to the current stack.

Preferred Qualifications

• Bachelor's degree- Preferred

• 6 years of experience with Hadoop FS and building data pipelines and workflows preferred

• 4 years of experience in building streaming solutions leveraging Kafka queues preferred

• 5 years of experience in building Spark applications leveraging either Python and/or Scala and a deeper understanding of Spark architecture preferred

• 3 years of working with Docker and Kubernetes in building and deploying containers preferred

• 7 years of experience working with Jupyter Notebooks preferred

• At least 5 years of strong programming experience in Python/Java is highly preferred

• Experience with MapR (HPE- hpe-ezmeral-data-fabric)-Preferred

• Experience with Scala, Functional languages & AWS Kinesis-Preferred

Qualifications

Salary Range: $110,000.00 to $190,000.00 annually bonus benefits

Employment eligibility to work with American Express in the U.S. is required as the company will not pursue visa sponsorship for these positions.

The above represents the expected salary range for this job requisition. Ultimately, in determining your pay, we'll consider your location, experience, and other job-related factors.

We back our colleagues and their loved ones with benefits and programs that support their holistic well-being. That means we prioritize their physical, financial, and mental health through each stage of life. Benefits include:

+ Competitive base salaries

+ Bonus incentives

+ 6% Company Match on retirement savings plan

+ Free financial coaching and financial well-being support

+ Comprehensive medical, dental, vision, life insurance, and disability benefits

+ Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need

+ 20 weeks paid parental leave for all parents, regardless of gender, offered for pregnancy, adoption or surrogacy

+ Free access to global on-site wellness centers staffed with nurses and doctors (depending on