The Catalyst team at Kensho Technologies is at the forefront of designing and applying cutting-edge Machine Learning in the domains of natural language and speech. We are continuously expanding our portfolio of projects and are looking for passionate researcher-engineers to help us build and deploy state-of-the-art ML systems!
Recently RAG-based systems that integrate structured and unstructured data are at the core of our team's projects. These solutions are integrated into the S&P Global platforms, providing users with the ability to find and analyze complex financial data efficiently.
The Catalyst team works closely with the Data, Product, Design, Backend & Frontend teams, and has the full support of our ML ops and Infrastructure teams.
We are seeking a mid-level ML Engineer to help accelerate and improve our ML development cycle, continually raising standards of prototyping, building, and maintaining SOTA ML solutions.
Kensho states that the anticipated base salary range for the position is 150k - 200k. In addition, this role is eligible for an annual incentive bonus and equity plans. At Kensho, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case.
What You’ll Do:
- Work closely with Data, Product, Design, and Engineering teams to design and develop Large Language Model (LLM)-based systems that integrate structured and unstructured data, ensuring the delivery of innovative ML solutions that meet customer needs
- Solve unique challenges around LLM-orchestration, such as data access patterns, memory and context management, and conducting thorough evaluations
- Actively participate in all stages of the ML lifecycle, from problem framing and data exploration to model experimentation, deployment, and monitoring in production, ensuring the continuous improvement and optimization of our ML solutions
- Work with unique proprietary unstructured data and structured datasets, applying advanced NLP techniques to extract insights and build solutions that drive business value
- Work closely with Product and Design teams to build ML-based solutions that enhance user experiences and meet business objectives
- Collaborate closely with the ML Operations team to create automated solutions for managing the entire ML systems lifecycle, from initial technical design to seamless implementation
What You'll Need:
- Bachelor's degree or higher in Computer Science, Engineering, or a related field
- 3+ years of significant, hands-on industry experience with Machine Learning, natural language processing (NLP), and information retrieval systems, including designing, shipping, and maintaining production systems
- Strong proficiency in Python
- Experience working with Machine Learning libraries/frameworks for Large Language Model (LLM) orchestration, such as Langchain, Semantic Kernel, LLamaIndex, etc.
- Proven experience building ML pipelines for data processing, training, inference, maintenance, evaluation, versioning, and experimentation
- Demonstrated effective coding, documentation, collaboration, and communication habits
- Strong problem-solving skills and a proactive approach to addressing challenges
- Ability to adapt to a fast-paced and dynamic work environment
Technology You'll Encounter:
- ML: PyTorch, Transformers, HuggingFace, LangChain
- Tools/Toolkits: DVC, MosaicML, NVIDIA NeMo, LabelBox, Weights & Biases
- Techniques: RAG, Prompt Engineering, Information Retrieval, Data Embedding
- Deployment: Airflow, Docker, Kubernetes, Jenkins, AWS
- Medical, Dental, and Vision insurance
- 100% company paid premiums
- Unlimited Paid Time Off
- 26 weeks of 100% paid Parental Leave (paternity and maternity)
- 401(k) plan with 6% employer matching
- Generous company matching on donations to non-profit charities
- Up to $20,000 tuition assistance toward degree programs, plus up to $4,000/year for ongoing professional education such as industry conferences
- Plentiful snacks, drinks, and regularly catered lunches
- Dog-friendly office (CAM office)
- Bike sharing program memberships
- Compassion leave and elder care leave
- Mentoring and additional learning opportunities
- Opportunity to expand professional network and participate in conferences and events