Research Engineer, Language - Generative AI

About the position

Meta is seeking a Research Engineer to join our Large Language Model (LLM) Research team. We conduct focused research and engineering to build state-of-the-art LLMs, which we often open-source, like our team's recent Llama 2. We are looking for strong engineers who have a background in generative AI and NLP, with experience in areas like language model evaluation, data processing for pre-training and fine-tuning, responsible LLMs, LLM alignment, reinforcement learning for language model tuning, efficient training and inference, and multilingual and multimodal modeling.

Responsibilities

• Conduct research and engineering to build state-of-the-art LLMs.
• Evaluate language models and their performance.
• Process data for pre-training and fine-tuning of models.
• Ensure responsible development and deployment of LLMs.
• Align LLMs with user needs and ethical standards.
• Tune language models using reinforcement learning techniques.
• Optimize training and inference processes for efficiency.
• Work on multilingual and multimodal modeling.

Requirements

• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
• Research experience in machine learning, deep learning, and/or natural language processing.
• Experience with developing machine learning models at scale from inception to business impact.
• Programming experience in Python and hands-on experience with frameworks such as PyTorch.
• Exposure to architectural patterns of large scale software applications.

Nice-to-haves

• Master's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
• PhD in AI, computer science, data science, or related technical fields.
• Direct experience in generative AI and LLM research.
• First author publications at peer-reviewed AI conferences (e.g., NeurIPS, CVPR, ICML, ICLR, ICCV, and ACL).