Senior Applied Research Scientist - RLHF & Alignment

$151,900 - $258,100/Yr

ServiceNow - Santa Clara, CA

Full-time - Mid Level

Santa Clara, CA

5,001-10,000 employees

Professional, Scientific, and Technical Services

About the position

The role involves building next-generation Large Language Models (LLMs) for Enterprise Language Generation at ServiceNow. As part of the Advanced Technology Group, you will leverage your AI/ML expertise to develop innovative solutions that enhance the NOW platform, enabling smarter work experiences for over 9,000 enterprise customers globally. This position requires collaboration with a diverse team to design, implement, and scale AI-driven products while addressing real-world challenges in a practical and scalable manner.

Responsibilities

• Use AI/ML expertise to apply existing methods and develop new ones to solve real-world challenges and datasets.
• Research and propose appropriate models/techniques, and implement, train, and evaluate the models.
• Contribute to the design, implementation, and scaling of LLMs as a key AI-first platform offering.
• Collaborate with developers, applied research scientists, product managers, and quality engineers to produce quality software.
• Work with product owners to understand detailed requirements and own the code from design to delivery of high-quality solutions.

Requirements

• 4+ years of related experience with a Bachelor's degree; or 2 years and a Master's degree; or a PhD without experience; or equivalent work experience.
• Expertise in Python, OOP, and Design Patterns.
• Experience with Instruction fine tuning and other fine tuning techniques is a must.
• Ability to read latest papers and experiment with the ideas.
• Creating and maintaining large-scale data processing pipelines.

Nice-to-haves

• Experience in Pretraining of an LLM is preferred but not mandatory.
• Experience with Reinforcement learning is preferred but not mandatory.
• Experience with various transformer architectures (auto-regressive, sequence-to-sequence, etc).
• Ability to communicate research findings to both technical and non-technical stakeholders.

Benefits

• Base pay of $151,900 - $258,100, plus equity and variable/incentive compensation.
• Health plans, including flexible spending accounts.
• 401(k) Plan with company match.
• Employee Stock Purchase Plan (ESPP).
• Flexible time away plan and family leave programs.