Software Engineer, Agentic AI Platform
Moveworks - Mountain View, CA
posted 16 days ago
About the position
Are you up for an exciting challenge? Picture yourself scaling and optimizing a cutting-edge Generative AI product that offers instant assistance to enterprise users. Ever wondered how to apply abstraction, scalability, and optimization to a dynamic, probabilistic, and generative conversational system? If so, we invite you to join our Conversation Engine team. At our company, you'll have the unique opportunity to work at the core of Moveworks Generative AI product. Your main focus will be scaling and optimizing it to meet the growing demands of the enterprise solution space. Take a look at our recent posts (Moveworks Live, Creator Studio) on Moveworks's groundbreaking solutions for enterprise AI. As pioneers in enterprise AI, we don't follow a set formula for building the next solution. Instead, we encourage you to bring your innovative ideas and imagination to solve unsolved problems. You'll collaborate closely with machine learning experts and cross-functional teams, rapidly iterating over new ideas, and leveraging user behavior data to make informed decisions. Your challenge will be to scale and optimize our conversation engine to support hundreds of millions of users, across multiple chat channels and use cases, and enhance our end-to-end product infrastructure with the utmost engineering quality and robustness.
Responsibilities
- Construct an extensive product infrastructure, complete with user-friendly interfaces that empower engineers and configurators to effortlessly customize and optimize generative AI models.
- Design scalable API abstractions for our conversation platform, which supports all popular chat clients (for example, MSTeams, Slack, and Web) and offers a neutral API for developing other parts of the engineering system.
- Optimize the dialog engine to accommodate a wide range of conversational features, leveraging private domain knowledge unique to each enterprise customer in the cloud, and enable real-time multilingual translation.
- Champion the best practices for coding patterns, API design, scalability, robustness, and optimization. Foster a culture of excellence and continuous improvements among fellow engineers.
- Provide comprehensive insights and visibility into the performance of our conversational AI product, implementing a robust logging and tracing framework, user-friendly debugging and triaging tools, and automated metrics for efficient monitoring and analysis.
- Collaborate closely with ML engineers, application engineers, product teams, and customer support teams to drive the development of new features and scalability initiatives.
Requirements
- A strong foundation in computer science and software engineering, coupled with expertise in building scalable systems.
- A deep understanding of clean, modular, and scalable API design, with the ability to champion best coding practices and influence fellow engineers to uphold high standards of code quality and craftsmanship.
- A passion for optimizing systems and improving performance, well-versed in tracing, logging, and metrics frameworks, with a systematic approach to quickly identify and resolve latency bottlenecks, race conditions, and throughput limitations.
- The ability to independently research new requirements and develop innovative solutions, thriving in an environment of fast-paced coding and execution, embracing rapid iterations to deliver results.
- Strong communication skills to effectively articulate rationales and design approaches, with cross-functional awareness enabling seamless collaboration with various teams.
- A bachelor's degree or higher in computer science or a related field, demonstrating academic foundation in the field.
- 3+ years of professional development experience, specifically in building systems at scale.
Nice-to-haves
- Experience with scaling ML systems
- Experience with Agentic AI product or LLMs
