Research Engineer, Multimodal Sensing Systems and Machine Learning (ML)

$146,994 - $208,000/Yr

Meta - Burlingame, CA

Full-time - Mid Level

Burlingame, CA

Web Search Portals, Libraries, Archives, and Other Information Services

About the position

The Research Engineer position at Meta's Reality Labs Research focuses on advancing multimodal sensing systems and machine learning technologies for augmented and virtual reality applications. The role involves designing and implementing machine learning pipelines, developing computer vision models, and collaborating with a diverse team to create innovative human-computer interaction technologies. This position offers the opportunity to work with cutting-edge technology in a fast-paced, interdisciplinary environment.

Responsibilities

• Design and implement ML pipelines and systems that collect and process datasets and enable algorithm experimentation.
• Build and bring-up complex prototype wearable sensor software and hardware systems for multimodal data collection.
• Develop machine learning and computer vision models for applications such as gesture recognition, hand pose estimation, object detection, contextual understanding, and physiological signal processing.
• Collaborate across an interdisciplinary team of researchers and engineers to collect multimodal training datasets and to develop real-time interaction demos.

Requirements

• 3+ years of experience developing ML pipelines with a focus on dataset preprocessing, model experimentation and evaluation, software integration, and real-time deployment.
• 2+ years of experience developing and evaluating ML/CV models.
• 3+ years of experience coding with Python and software engineering best practices (version control, code reviews).
• Experience bringing-up and debugging prototype/scientific software-hardware systems (e.g., multi-camera sensing/tracking solutions like OptiTrack, wearable sensing systems like electromyography (EMG) etc.).
• Experience working and communicating in a diverse, collaborative, interdisciplinary team environment.
• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.

Nice-to-haves

• Master's degree and 5+ years of industry experience or PhD degree and 3+ years of industry experience.
• Experience in computer vision, multimodal representation learning, self-supervised learning, adaptive ML, reinforcement learning, transfer learning, or other advanced ML/CV techniques.
• Experience with Human-Computer Interaction (HCI) and real-time applications of ML.
• Experience designing data collection protocols and constructing high quality diverse machine learning datasets.

Benefits

• $70.67/hour to $208,000/year + bonus + equity + benefits
• Reasonable support in recruiting processes for candidates with disabilities, long term conditions, mental health conditions, or sincerely held religious beliefs.