Research Scientist, Machine Learning And Eye Tracking

Summary
Reality Labs Research (RLR) brings together a world-class, cross-disciplinary R&D team to develop the next generation of AR and VR technologies. Come work alongside a world leading team of interdisciplinary scientists and engineers to create the technology that makes AR and VR pervasive and universal. Our research focuses on developing comprehensive solutions to complex Eye Tracking problems, including both algorithms and hardware for AR and VR systems. We are currently seeking researchers with experience in Machine Learning for computer vision applications, to help build Eye Tracking models that leverage multiple sensing modalities and that are personalized for best performance on every user of the system.
Required Skills
Research Scientist, Machine Learning and Eye Tracking Responsibilities:

• Research and develop novel Machine Learning and Computer Vision based methods in the area of personalized models for Eye Tracking.
• Incorporate data from multiple sensor modalities to build robust, efficient models.
• Work with large-scale user-study data collected from AR and VR eye trackers to build models that work across the diversity of the entire human population.
• Explore multiple paths to personalized models, including using neural encodings to improve robustness
• working at the intersection of ML, Optimization, and Sensor systems to model how Eye Tracking sensors can best track the eye
• and leveraging 3D scans and other anatomical models of eyes as priors for better tracking.
• Quantify the robustness and accuracy of these models using statistical analysis of the data.
• Categorize failures and mine the data for difficult edge cases, and use this to improve the worst-case performance of Eye Tracking algorithms.
• Collaborate with other Research Scientists, hardware and software engineers to develop innovative Machine Learning techniques for Eye Tracking use-cases.

Minimum Qualification
Minimum Qualifications:

• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
• PhD degree in Computer Science, Machine Learning, or equivalent experience in a related field.
• 5+ years experience in Machine Learning for computer vision applications.
• Experience building CV, ML, or optimization systems that fuse multiple sensor modalities with different data rates to improve model performance and robustness.
• 3+ years of programming experience in Python and experience with ML frameworks such as PyTorch.

Preferred Qualification
Preferred Qualifications:

• Experience building personalized models for Eye Tracking or other human tracking tasks such as body, face or hand tracking.
• Experience with large-scale Machine Learning techniques like semi-supervised learning, weakly-supervised Learning and online adaptation of ML models.
• Experience with Transformers for vision applications.
• Proven track record in publishing papers in Machine Learning and/or computer vision conferences including CVPR, ICCV, ISMAR, ECCV, NeurIPS, AAAI, ICLR.

EOE
Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and Machine Learning technologies in connection with applications for employment.
Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@fb.com.