Senior/Lead Quality Engineer - AI Platform

$165,600 - $265,200/Yr

Salesforce - San Francisco, CA

Full-time - Mid Level

San Francisco, CA

Publishing Industries

About the position

As a Quality Engineer for the Salesforce AI platform, you will lead the design, development, and execution of comprehensive test plans and quality strategies with a strong emphasis on automation. This role involves close collaboration with engineering and product teams to ensure the quality of new features and the successful execution of regression tests across various environments. You will work in a fast-paced environment, understanding complex backend AI flow systems and strategically planning testing efforts to ensure stability and reliability.

Responsibilities

• Lead the design, development, and execution of comprehensive test plans and quality strategies.
• Collaborate closely with engineering and product teams to contribute to the quality of new features.
• Execute regression tests in various environments to ensure successful feature releases.
• Identify potential risks in backend AI flow systems and plan comprehensive testing efforts accordingly.
• Monitor and report on test stability metrics for pre-production and production environments.
• Configure tooling and runners for automated tests used by scrum teams.
• Define and measure quality metrics to ensure goals are met for machine learning foundations.

Requirements

• A related 4-year technical degree is required.
• 6+ years of Quality Engineering experience.
• 2+ years of experience leading projects and mentoring junior team members.
• Strong knowledge of automation tools and continuous automation systems.
• Technical expertise in developing and maintaining tests involving API, databases, and web UI tests.
• Excellent communication skills for generating reports and presenting quality metrics.

Nice-to-haves

• Understanding of LLM Model hosting with Sagemaker.
• Experience with LLM Finetuning and Inferencing.
• Testing integrations with Cohere, Anthropic, Dolly, Google, etc.
• Experience with Azure Open AI.

Benefits

• Health insurance coverage
• Dental insurance coverage
• 401(k) retirement savings plan
• Paid holidays and vacation time
• Flexible scheduling options
• Professional development opportunities