Senior Data Engineer

Job Description
About the company
Albertsons Companies is at the forefront of the revolution in retail. With a fixation on raising the bar with innovation and building belonging through our culture, our team is rallying our company around a unique purpose: to create joy around each table and inspire a healthier tomorrow for every community.
Albertsons Companies is one of the largest food and drug retailers in the United States, with over 2,200 stores in 34 states and the District of Columbia. Our well-known banners include Albertsons, Safeway, Vons, Jewel-Osco, Shaw's, Acme, Tom Thumb, Randalls, United Supermarkets, Pavilions, Star Market, Haggen, Carrs, Kings Food Markets, and Balducci's Food Lovers Market. We support our stores with 22 distribution centers and 19 manufacturing plants.
Placing a premium on adaptability, safety and family well-being, our work model, Presence with a Purpose, offers a hybrid work environment between remote work and office time. A one-size-fits-all approach does not apply to everyone, and teams are empowered to make decisions best for them.
Bring your flavor
Building the future of food and well-being starts with you. Join our team and bring your best self to the table.
What you will be doing
The Senior Data Engineer works on various projects to optimize data collection, integration, aggregation, analysis, and data visualizations that support business objectives in a BigData Cloud environment.
The position will be based in Pleasanton, CA, or one of our main corporate offices (Boise ID, Plano, TX, or Deer Valley, AZ).
Main responsibilities

• Provide technical guidance, leadership and work in conjunction with other augmented staff to ingest data from varying technologies including internal and external sources.
• Create standards and best practices.
• Ensure that incremental and historical data ingested with an emphasis on streaming and a frameworkContent Integration Network (CIN) will be developed with a goal to:
  • Create re-usable components
  • Auditability and logging
  • Governance and Security
  • Standards for DevOps manageability
  • Data Quality integrated
  • Configuration driven

The salary range is $120,670 to $156,838 annually. Starting salary will vary based on criteria such as location, experience, and qualifications. There may be flexibility for exceptional candidates.
A copy of the full job description can be made available to you.
What we are searching for

• The ideal candidate requires a strong understanding of Oracle Cloud HCM, extensive experience in maintaining systems related to HR operations, ability to create quick reports and analyze data, broad set of problem-solving techniques, analytical skillset, open mindset and capable of strategic and tactical thinking.

We believe the successful candidate has these qualifications and experience:

• BS in Computer Science, Information Systems, Engineering or Mathematics,
• 5+ years proven experience in developing and deploying data pipelines, preferably in the Cloud; Azure and Snowflake experience is a plus.
• 5+ years proven expertise in creating pipelines for real time and near real time integration.
• 5+ years proven experience with Spark SQL, Spark Streaming and using Core Spark API to explore Spark features to build data pipelines.
• 5+ years of experience with at least one programming language like Python, Java or Scala.
• Experience in analyzing existing SQL queries for performance improvements and writing complex queries.
• Hands on experience with Azure data platform stack: Azure Databricks, Azure Data Factory, ADLS.
• Databricks and Delta table knowledge is a plus.
• Extensive experience in data transformations for various business use cases.
• Knowledge of handling exceptions and automated re-processing and reconciling.
• Passion for Data Quality with an ability to integrate these capabilities into the deliverables.
• Prior use of Big Data components and the ability to rationalize and align their fit for a business case.
• Experience in working with different data sources - flat files, XML, JSON, Avro files and databases.
• Proficiency in techniques for slowly changing dimensions.
• Knowledge of Jenkins for continuous integration and End-to-End automation for application build and deployments.
• Proven experience and ability to work with people across the organization.
• Proven capabilities for strong written and oral communication skills.
• Ability to integrate into a project team environment and contribute to project planning activities.
• Experience in developing implementation plans and schedules and preparing documentation for the jobs according to the business requirements.

What is it like at Albertsons?
Our 290,000 associates have a passion for great service and building lasting relationships with our customers. Through a companywide focus on innovation, we are continually enhancing our digital and product offerings, making it easy for customers to get what they need, wherever they are.