Job Description
Please share me the updated resume as per client requirements arjun@srivensys.com
H1B Transfer or W2
Sr. Data Engineer
Hybrid ( LA or New York)
12 month contract
Top Skills - Must Haves
Hybrid with 2 days onsite at Fox office in LA or NYC (Tues and Thurs)
Must have technical skills:
1. Databricks
2. Snowflake
3. Python
4. DBT
5. AWS
Overall Skills = Data Warehousing, BI types of skills, strong with SQL
JOB DESCRIPTION
Fox Technology Data Products team is seeking an experienced Sr. Data Engineer with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering team. If you enjoy designing and building innovative Data Engineering solutions using the latest tech stack in a fast-paced environment, this role is for you.
Primary Job Duties and Responsibilities
Collaborate with and across Agile teams to design and develop Data Engineering solutions by rapidly delivering value to our customers.
Build distributed, low latency, reliable data pipelines ensuring high availability and timely delivery of data
Design and develop highly optimized Data Engineering solutions for Big Data workloads to efficiently handle continuous increase in data volume and complexity
Build highly performing real-time data ingestion solutions for streaming workloads.
Adhere to best practices and agreed upon design patterns across all Data Engineering solutions
Ensure the code is elegantly designed, efficiently coded, and effectively tuned for performance
Focus on data quality and consistency, implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
Create design (Data Flow Diagrams, Technical Design Specs, Source to Target Mapping documents) and test (unit/integration tests) documentation
Perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
Focus on end-to-end automation of Data Engineering pipelines and data validations (audit, balance controls) without any manual intervention
Focus on data security and privacy by implementing proper access controls, key management, and encryption techniques.
Take a proactive approach in learning new technologies, stay on top of tech trends, experimenting with new tools & technologies and educate other team members.
Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility, and fostering data-driven decision making across the organization.
Communicate clearly and effectively to technical and non-technical leadership.
Additional Skills & Qualifications
WHAT YOU WILL NEED
Education: Bachelor's degree in Computer Science, Computer Engineering, or relevant field
Work Experience: 7+ years of experience in architecting, designing and building Data Engineering solutions and Data Platforms
Experience in building Data Warehouses/Data Platforms on Redshift/Snowflake
Extensive experience building real-time data processing solutions.
Extensive experience building highly optimized data pipelines and data models for big data processing.
Experience working with data acquisition and transformation tools such as Fivetran and DBT
Experience building highly optimized & efficient Data Engineering pipelines using Python, PySpark, Snowpark
Experience working with distributed data processing frameworks such as Apache Hadoop, or Apache Spark or Flink
Experience working with real-time data streams processing using Apache Kafka, Kinesis or Flink
Experience working with various AWS Services (S3, EC2, EMR, Lambda, RDS, DynamoDB, Redshift, Glue Catalog)
Expertise in Advanced SQL programming and SQL Performance Tuning
Experience with version control tools such as GitHub or Bitbucket.
Expert level understanding of dimensional modeling techniques
Excellent communication, adaptability, and collaboration skills
Excellent analytical skills, strong attention to detail with emphasis on accuracy, consistency, and quality
Strong logical and problem-solving skills with critical thinking
Good to Have:
Experience in designing and building applications using Container and serverless technologies
Experience working with fully automated workflow scheduling and orchestration services such as Apache Airflow
Experience working with semi-structured, unstructured data, No SQL databases
Experience with CI/CD using GitHub Actions or Jenkins
Experience designing and building APIs
Experience working with low-code, no-code platforms
Employee Value Proposition (EVP)
Under the FOX banner, we produce and distribute content through some of the world's leading and most valued brands, including: FOX News, FOX Sports, the Fox Network, and the FOX Television Stations. We empower a diverse range of creators to imagine and develop culturally significant content, while building an organization that thrives on creative ideas, operational expertise and strategic thinking.
Work Environment
Engineer team under Oliver (VP of the Data Team) is in 3 pillars:
1. Platform (Tissa) - AWS, Data bricks, Snowflake, Redshift. His job is to figure out "how do you make the developers use these platforms." Builds frameworks, uses the data around them to improve process and create frameworks. This team does not use the tech for business related activities.
2. Data (Sourav) - This group uses the tech Tissa builds to solve business challenges. After the framework is built they take it and input all the business data. They create actionable/usable data for the BI team to use and present to the business.
Redshift, Snowflake, SQL, Python, DBT
3. BI (Farhad)
Thanks & Regards,
Arjun K
Accounts Manager - Recruitment
Sriven Systems, Inc
Direct : 6313156999 / Ext : 1005
Mobile- +1 (951)-299-5015
arjun@srivensys.com
https://www.linkedin.com/in/arjun-k-2302b62a/
F: 516-908-3640
545 S. Kimball avenue, Suite 100, Southlake, TX 76092 (New Address)
www.srivensys.com
Winner of "Inc 500 & Inc 5000: Fastest Growing Companies in America" " 8 years in a Row : 2008 to 2016".
1999 2023: 23 + years of Excellence