Research Scientist - Efficient Audio Visual Machine Learning

$213,000 - $293,000/Yr

Meta - Redmond, WA

Full-time - Senior

Redmond, WA

Web Search Portals, Libraries, Archives, and Other Information Services

About the position

The Research Scientist position at Meta's Reality Labs Research focuses on developing innovative audio-visual machine learning technologies to enhance listener experiences in augmented and virtual reality environments. The role involves conducting core and applied research to create efficient AI algorithms and systems that improve hearing abilities in challenging conditions, leveraging expertise in computer vision, acoustics, and signal processing.

Responsibilities

• Develop novel AI algorithms and associated real-time systems for source tracking, localization, diarization, and semantic scene understanding in AR and VR.
• Design and develop efficient AI frameworks and real-time systems with constraints on low-compute, low-power, and overall system latency.
• Lead the development of systems and methods for quick prototyping and proof of concept demonstrations.
• Contribute to dataset designs and large-scale data processing for real-time evaluations of audio-visual machine learning methods.
• Establish new execution methods for efficient compute-driven AI systems in Audio AR and VR applications.
• Summarize technical findings for cross-organizational collaborators and influence system design decisions.

Requirements

• PhD degree or equivalent experience in Deep Learning, AI, Machine Learning, Computer Science, Robotics, Computer Vision, Computational Neuroscience, Signal Processing, or related field.
• 4+ years of experience in applied computer vision methods for wearable computing.
• 2+ years of experience in efficient multimodal machine learning algorithms for low-compute and low-power devices.
• Research-oriented software engineering skills, including fluency with machine learning libraries like PyTorch, TensorFlow, and Scikit-learn.
• Experience with cross-group and cross-cultural collaboration.

Nice-to-haves

• 8+ years of experience in core and applied computer vision methods.
• Experience with real-time AI modeling and systems design for wearable computing.
• 3+ years of experience in audio-visual and multi-modal learning methods for egocentric perception.
• Experience with real-time statistical modeling and heuristics-driven computer vision methods.
• Experience developing end-to-end ML pipelines and integrating software into platforms.
• Experience with large-scale or distributed cluster computing for machine learning models.

Benefits

• Competitive salary ranging from $213,000 to $293,000 per year.
• Bonus and equity opportunities.
• Comprehensive health insurance coverage.
• Paid time off and holidays.
• Retirement savings plan with company matching contributions.