Senior Machine Learning Engineer, NLU & Agentic AI
Moveworks - San Francisco, CA
posted 16 days ago
About the position
We are looking for an experienced software engineer with machine learning expertise to join us in expanding Moveworks NLU (natural language understanding) and agentic AI capabilities, enabling increasingly magical user experiences and improving Moveworks generative and conversational AI capabilities platform-wide. As a member of the NLU team, you will have all the tools of modern NLP and NLG at your disposal, from best-in-class LLMs, multimodal foundation models, and hybrid vector databases to all the infrastructure needed to fine-tune, evaluate, and serve your own models in production. We are a data-centric team, and you will have the assistance of a world-class annotation team to build error-free, inclusive, and privacy-preserving datasets for model training and evaluation. You will also go beyond model training to achieve state-of-the-art AI performance in production, in every meaning of the word "performance": not just accuracy and quality of outputs, but also latency, reliability, and capability of the end-to-end user-facing system as a whole. Successful machine learning engineers on the team are just as motivated to design and evolve great compound AI systems and their components as they are to train great models. Our team indexes on increasing our ability to move fast, solving challenging product and engineering challenges, and pushing the envelope of value provided to customers. Your work will impact our team's core objectives to understand every enterprise issue and build the most reliable copilot the world has ever seen, in deep collaboration with other functions within Moveworks.
Responsibilities
- Apply software engineering, machine learning, and compound AI system engineering to create lasting value for all our customers
- Take on exciting and difficult challenges in conversational agent domains, such as agent cognitive architecture iteration, multimodal agents, multilingual agents, conversational memory management, reasoning strategies, fine-tuning LLMs for tool use and enterprise reasoning, agent evaluation, active learning of exemplars for few-shot text classification, abstractive summarization, and grounding & verifiability for generated text
- Push the envelope of Moveworks commitments to responsible AI, expanding our infrastructure for ensuring models work equally well for all people, red-teaming models to ensure they behave safely and as intended, and keeping our ML at the cutting edge of data privacy and security
- Use your knowledge of machine learning fundamentals and LLMs to design new algorithms and architectures, evaluate them with small scale experiments and productionize your solutions at scale
- Research and develop innovative, scalable and dynamic solutions to hard problems
- Use the latest advances in machine learning and LLMs to enhance our products and create delightful user experiences
- Spend time weekly reading, discussing, and potentially building models out of the latest ML research and open-source code
Requirements
- Drive to ship product improvements with production-quality, fully unit-tested code and rigorously-evaluated updates to models, prompts, or other tunable system components
- Ability to solve problems end-to-end with machine learning
- Solid grasp of model evaluation fundamentals, especially for text generation, text classification, and non-uniform sampling regimes
- Attention to detail and high standard of data quality for training and especially evaluation datasets
- Readiness to hit the ground running in a Mac development environment, programming in Python and/or Golang
- Knowledge of deep learning architectures and algorithms and leading large language models
- Desire to work at a startup pace in a medium-sized company with a high degree of ownership
- Strong appetite for continuous incremental wins and completing challenging projects fast
- High level of curiosity about engineering outside of immediate discipline and ongoing desire to learn and stay at the cutting edge of NLU & AI
Nice-to-haves
- Experience productionizing ML models at scale
- Experience in AI fairness, privacy, permission controls, safety, and/or security
- Working familiarity with machine learning frameworks such as PyTorch and LightGBM
- Experience with NLP libraries such as HuggingFace Transformers, PEFT, and SpaCy 3
- Experience iterating on prompts for large language models in a data-driven way
