This job is closed
We regret to inform you that the job you were interested in has been closed. Although this specific position is no longer available, we encourage you to continue exploring other opportunities on our job board.
Program Manager III, GenAI Adversarial Testing, YouTube
YouTube - San Bruno, CA
posted 2 months ago
About the position
As a Program Manager III for GenAI Adversarial Testing at YouTube, you will lead complex, multi-disciplinary projects focused on assessing and mitigating adversarial risks associated with Generative AI models. This role involves collaborating with various cross-functional teams to design and implement scalable adversarial testing processes, ensuring that YouTube's innovation remains responsible and aligned with content policies. You will be responsible for managing the lifecycle of adversarial testing, from risk assessment to launch readiness, while fostering a diverse and inclusive work environment.
Responsibilities
- Design, manage and continuously improve the lifecycle of adversarial testing, from intake and risk assessment to test set generation, execution, evaluation, and launch readiness in partnership with cross-functional teams.
- Conduct feature risk assessments to identify vulnerabilities, weak points, abuse vectors, and sensitive output types.
- Build infrastructure and processes to operationalize strategies and experience across Responsibility launch-readiness workflow.
- Work closely with Product and Policy teams driving alignment on policy issues and decisions.
- Establish program metrics and feedback loops to continuously improve the program health, quality of test sets, Red Teaming program and raters.
- Identify process bottlenecks, develop solutions, and drive continuous improvement and organizational awareness across YouTube.
Requirements
- Bachelor's degree or equivalent practical experience.
- 5 years of experience in program or project management.
- Experience with Generative AI models, including their capabilities, limitations, and potential risks.
- Experience in a Trust and Safety domain.
Nice-to-haves
- 5 years of experience managing cross-functional or cross-team projects.
- Experience in designing and implementing adversarial testing or red teaming programs for large-scale AI systems.
- Experience in developing content policies for consumer products, with a view towards GenAI responsibility.
- Experience with release management lifecycles and project milestones, keeping up a high velocity in a fluid environment.
- Ability to be an influential member of a team composed of both technical and non-technical members.
Benefits
- Health insurance
- Dental insurance
- Vision insurance
- 401(k) plan with matching contributions
- Paid time off
- Parental leave
- Employee stock purchase plan
- Tuition reimbursement
- Professional development opportunities
