AI Research Scientist - Multimodal Machine Learning

Meta - Redmond, WA

Full-time - Senior

Redmond, WA

Web Search Portals, Libraries, Archives, and Other Information Services

About the position

At Reality Labs Research (RL-R), our goal is to explore, innovate and design novel interfaces and hardware subsystems for the next generation of virtual, augmented, and mixed reality experiences. We are driving research towards a vision of an always-on augmented reality device that can enable high-quality contextually relevant interactions across a range of complex, dynamic, real-world tasks in natural environments. To achieve this goal, our team draws on and fundamentally advances methods and knowledge from artificial intelligence, multimodal machine learning, computer vision, and signal processing. We are looking for a skilled and motivated researcher with expertise in multimodal machine learning and large scale multimodal representation learning. The chosen candidate will work with a diverse and highly interdisciplinary team of researchers and engineers and will have access to cutting edge technology, resources, and testing facilities.

Responsibilities

• Lead, collaborate, and execute on research that pushes forward the state of the art in multimodal reasoning and generation research.
• Work collaboratively with other research scientists to develop novel solutions and models in service of contextualized AI for augmented reality.
• Work on curation of large datasets across many modalities (e.g., vision, audio, IMU, sEMG).
• Lead experimental design, implementation, evaluation, and reporting results to enable new capabilities for multimodal LLMs.
• Mentor other team members and play a significant role in healthy cross-functional collaboration.

Requirements

• PhD degree or equivalent experience in Computer Science, Mathematics, Engineering or a related field.
• Publication record in machine learning, AI, computer science, statistics, applied mathematics, data science, or related technical fields.
• 6+ years of experience in one or more of the following areas: Deep Learning, NLP, Multimodal, Computer Vision, Speech.
• 6+ years of experience developing end-to-end ML pipelines with a focus on dataset preprocessing, model development and evaluation, software integration, and real-time deployment.
• Experience writing software (Python and C/C++) and executing complex machine learning experiments.
• Research experience in one or more of these areas: NLP, computer vision, Multimodal, Speech.
• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.

Nice-to-haves

• Publication record in AI conferences like NeurIPS, EMNLP, ACL, ICCV, CVPR, ICML, NAACL, ICLR, Interspeech, ICASSP.
• Programming experience in Python and hands-on experience with frameworks such as PyTorch.
• Experience with developing machine learning models at scale from inception to deployment.