Research Scientist, Computer Vision Silicon Architect (Phd)

The Sensors and Systems Research (SSR) group at Meta Reality Labs Research (formerly Facebook Reality Labs Research) is currently searching for a full-time Research Scientist to pioneer, design, and prototype innovative SoC and algorithms for intelligent sensing systems. We encourage candidates with a proven track record in low-power compute architectures for efficient Computer Vision (CV) and machine learning (ML) algorithm deployment, as well as those skilled in software/hardware co-design for distributed ML, multi-modal learning, self-supervised learning, and privacy-preserving ML applications and systems to apply. This role presents a unique opportunity to work at the intersection of hardware and software, and drive innovation at the forefront of the AR/VR technology revolution while collaborating with a diverse group of cross-disciplinary experts to create next-generation, human-oriented sensing and computing solutions.

• Explore ground breaking intelligent vision and sensing technologies for AR/VR systems.
• Implement machine perception and artificial intelligent algorithms and SoC that are suitable for on-sensor integration for low-power, low latency cognitive systems.
• Design and develop sensing and vision processing circuit and hardware, investigate innovative sensor architectures and on-sensor vision processing compute engines.
• System performance and evaluation by modeling, simulation, experimenting, data collection, and tradeoff study.
• Collaborate with internal and external Computer Vision scientists, hardware and software architects, perception scientists, and optical experts on cutting edge vision systems.
• Mentor MS/PhD interns and collaborate with external academic groups to advance our research goals.

• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
• Currently has or is in the process of obtaining a PhD in the field of sensor design, VLSI circuit design, computation architecture, machine learning and artificial intelligence, a related field, or equivalent practical experience. Degree must be completed prior to joining Meta.
• Research experience in sensor system, Computer Vision system, machine learning algorithm and hardware developments in academic research.
• Proficient in architecting and designing ultra-low power SoC platforms on leading-edge nodes.
• Experience with novel computer paradigms (such as Compute in Memory) and technologies (such as emerging embedded memory technologies).
• Proficient programming skills with C/C++, Python, MATLAB, Torch, etc. languages.
• Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment.

• Experience in system modeling across data/image capture, signal processing pipeline, algorithms.
• Experience in 3D Computer Vision algorithms including Calibration, SLAM, Reconstruction, Mapping, Localization, Tracking and Image Processing.
• Experience with formulating and solving algorithm optimization problems.
• Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as publications at leading workshops, journals or conferences such as IEEE VLSI Symposium, IEEE ISSCC, IEEE IEDM, JSSC, IEEE TCAS, ICCV, ISCA, TinyML, Micro, or similar.
• Past experience in system modeling across data/image capture, signal processing pipeline, algorithm, and functional behaviors.
• Demonstrated research and software engineering experience via an internship, work experience, coding competitions, or widely used contributions in open source repositories (e.g. GitHub).
• Experience solving complex problems and comparing alternative solutions, tradeoffs, and diverse points of view to determine a path forward.
• Experience working and communicating cross functionally in a team environment.