Address
Form of workJob Description
TITLE: Senior Cloud Native Developer
Location: New York, NY
Our financial services client is searching for a Senior Cloud Native Developer in New York City to help with their AWS migration. This is a hybrid role where the team is in the office 3 days per week.
What You'll Do:
Location: New York, NY
Our financial services client is searching for a Senior Cloud Native Developer in New York City to help with their AWS migration. This is a hybrid role where the team is in the office 3 days per week.
What You'll Do:
- Drive a high impact and high visibility project that enables data availability, encompasses data analytics, machine learning, and petabyte scale datasets, and provides reliable and timely access to thousands of data sources
- Design, architect and support systems for collecting, storing, and analyzing data at scale
- Recommend improvements and modifications on new and existing data and ETL pipelines. Create optimal data pipeline architecture and systems using Apache Airflow
- Create data analytics for data scientists to innovate, build and optimize our ecosystem
- Assemble large, complex data sets that meet functional and non-functional business requirements
- Be responsible for ingesting data into our data lake and providing frameworks and services for operating on that data including the use of Spark
- Analyze, debug and correct issues with data pipelines
- Operate on or build solution required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, AWS and Spark technologies
- 8+ years of experience building high performance scalable enterprise analytics or data centric solutions
- 5+ years of experience in the design and build of data extraction, transformation, and loading processes by writing custom data pipelines
- At least 5 years of experience implementing complex ETL pipelines preferably in connection with Glue and/or Spark
- Exceptional coding and design skills in Python or Java/Scala
- Hands-on experience with AWS (i.e. Glue, Aurora Postgres, Lambda, EMR, EKS, Redshift, etc.)
- Experience with visualization tools like QuickSight, PowerBI, Looker or Tableau
- Experience with Talend (ETL) is a big plus
