Meta Platforms - Seattle, WA
posted 5 days ago
- Mid Level
Seattle, WA
Broadcasting and Content Providers
About the position
Meta is seeking a Research Engineer to join our Large Language Model (LLM) Research team. We conduct focused research and engineering to build state-of-the-art LLMs, which we often open-source, like our team's recent Llama 2. We are looking for strong engineers who have a background in generative AI and NLP, with experience in areas like language model evaluation, data processing for pre-training and fine-tuning, responsible LLMs, LLM alignment, reinforcement learning for language model tuning, efficient training and inference, and multilingual and multimodal modeling.
Responsibilities
- Conduct research and engineering to build state-of-the-art LLMs.
- Evaluate language models and their performance.
- Process data for pre-training and fine-tuning of models.
- Ensure responsible development and deployment of LLMs.
- Align LLMs with user needs and ethical standards.
- Tune language models using reinforcement learning techniques.
- Optimize training and inference processes for efficiency.
- Work on multilingual and multimodal modeling.
Requirements
- Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
- Research experience in machine learning, deep learning, and/or natural language processing.
- Experience with developing machine learning models at scale from inception to business impact.
- Programming experience in Python and hands-on experience with frameworks such as PyTorch.
- Exposure to architectural patterns of large scale software applications.
Nice-to-haves
- Master's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
- PhD in AI, computer science, data science, or related technical fields.
- Direct experience in generative AI and LLM research.
- First author publications at peer-reviewed AI conferences (e.g., NeurIPS, CVPR, ICML, ICLR, ICCV, and ACL).
