Data Engineer

Job title: Data Engineer

Location: Plano, TX 75024 (Hybrid)

Duration: 09+ months

Job Description:

•     Understand existing workflows and underlying frameworks

•     Migrate these existing workflows to new ***** specific data ingestion framework

•     Collaborate with and across Agile teams

•     to gather metadata to meet the current data governance standards

•     Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance

•     Build scripts/utilities to accelerate migration

•     Analyze data & generate reports

•     Learn-unlearn-relearn concepts with an open and analytical mindset.

•     Troubleshooting & Critical thinking

•     Develop & review technical documentation for artifacts delivered.

Requirements:

•     Minimum 7 years of experience in Data Engineering and Data Pipelines

•     Minimum 5 years of extensive experience in Python Programming

•     Minimum 3 years of extensive experience in SQL, Unix/Linux Shell Scripting

•     Hands-on experience writing complex SQL queries, exporting, and importing large amounts of data using utilities.

•     Minimum 3 year of AWS experience

•     Basic Knowledge of CI/CD

•     Excellent communication skills and Good Customer Centricity.

Nice to Have's:

•     Prior experience with data migration project

•     Experience with Kafka Streams/building data intensive streaming applications (stream processing, e.g. Kafka, Spark Streaming)

•     Experience/Knowledge of Scala or Java Programming

•     Experience with at least one Cloud DW such as Snowflake

•     Experience with Distributed Computing Platforms

Job Types: Full-time, Contract

Salary: $60.00 - $78.00 per hour

Expected hours: 40 per week

Schedule:

• Day shift
• Monday to Friday

Ability to Commute:

• Plano, TX 75024 (Required)

Ability to Relocate:

• Plano, TX 75024: Relocate before starting work (Required)

Work Location: In person