AIML - ML Engineer, Safety & Red Teaming

Apple - Seattle, WA

Full-time

Seattle, WA

Computer and Electronic Product Manufacturing

About the position

As an AIML - ML Engineer focused on Safety & Red Teaming at Apple, you will play a crucial role in shaping the future of generative AI applications. This position is part of the Apple HCMI group, where you will engage in innovative projects that have the potential to impact not only Apple’s products but also the broader technological landscape. Your primary focus will be on developing and evaluating generative models, particularly in the context of safety, robustness, and uncertainty. You will be tasked with creating models, tools, metrics, and datasets that assess the safety of generative models throughout their deployment lifecycle. This includes interpreting and explaining failures in language and diffusion models, which is essential for ensuring the reliability and effectiveness of AI systems. In addition to model development, you will build and maintain human annotation and red teaming pipelines. These pipelines are vital for assessing the quality and risk associated with various Apple products, ensuring that they meet the highest standards of safety and performance. You will also prototype, implement, and evaluate new machine learning models and algorithms specifically designed for red teaming large language models (LLMs). This role requires a blend of technical expertise, creativity, and a commitment to quality, as you will be working on cutting-edge technologies that are at the forefront of AI research and application.

Responsibilities

• Develop models, tools, metrics, and datasets for assessing and evaluating the safety of generative models over the model deployment lifecycle.
• Develop models and tools to interpret and explain failures in language and diffusion models.
• Build and maintain human annotation and red teaming pipelines to assess quality and risk of various Apple products.
• Prototype, implement, and evaluate new ML models and algorithms for red teaming LLMs.

Requirements

• Strong engineering skills and experience in writing production-quality code in Python, Swift, or other programming languages.
• Background in generative models, natural language processing, LLMs, or diffusion models.
• Experience with failure analysis, quality engineering, or robustness analysis for AI/ML based features.
• Experience working with crowd-based annotations and human evaluations.
• Experience working on explainability and interpretation of AI/ML models.

Nice-to-haves

• BS, MS or PhD in Computer Science, Machine Learning, or related fields or an equivalent qualification acquired through other avenues.
• Proven track record of contributing to diverse teams in a collaborative environment.