Data Engineer

Requisition Title

Description

Summary

The Data Engineer, Business Analytics will be the leader in building, developing, and expanding data strategy in support of artificial intelligence products for the organization. The Data Engineer will work with internal and external clients to identify opportunities for optimization in processing, storing, and retrieve unstructured data across the product pipeline including ingestion, transformations, storage, access, and design that facilitates operational interactions.

Responsibilities

• Provide thought leadership on architecture and design for Generative AI products

• Be a SME in technical and functional aspects of products and data integrations

• Proactive identification of internal and external dependencies, highlighting issues, scope changes, and progress against project plan

• Facilitate cross-team development with the technical team including ML Engineers, Data Analysts, and Web App/Dashboard Developers to implement feature pipelines and product databases

• Collaborate with business stakeholders to understand data requirements

• Provide technical support to assist clients and partners during and after product implementation

• Develop and expand our data strategy best practices for developing Gen AI products

• Engage in professional development opportunities to remain up to date on best practices surrounding data strategy to support Gen AI products

Education

• Undergraduate Degree required

[if !supportAnnotations]

Experience and Skills

• 3+ years of relevant work experience

• Understanding of Agile Software Development Lifecycle and Scrum project planning/execution skills

• Understanding of complex data flows, identification of data processing bottlenecks and designing and implementing solutions

• Ability to assess business rules, collaborate with stakeholders and perform source-to-target data mapping, design and review

• Proficient in Python, SQL, Scala

• Experience in software development in a production environment.

• Experience in cloud computing and data storage

• Experience with vector databases and various lookup techniques (Pinecone, Faiss, etc.)

• Experience processing large sets of structured, semi-structured, and unstructured data (cleansing, storage, retrieval)

• Experience working with MLOps teams is preferred

• Experience supporting Web Applications is preferred

• Work experience with batch and real-time processing frameworks (Hadoop, Apache Storm, Apache Kafka, Apache Spark etc.) is a plus

• Proven ability to balance and manage multiple, competing priorities

• Collaborative interpersonal skills and ability to work within cross-functional teams

Other

• Some travel may be required