AIML - ML Engineer, Safety & Red Teaming

Apple - Cambridge, MA

Full-time

Cambridge, MA

Computer and Electronic Product Manufacturing

About the position

In this role at Apple, you will be part of a dynamic team focused on building the next generation of generative AI applications. As a member of the Apple HCMI group, you will engage in ambitious projects that aim to influence the future of Apple and its products. Your work will primarily revolve around innovative challenges in machine learning, particularly in the realm of generative AI. You will have the opportunity to contribute to the development of large generative models for vision and language, with a keen focus on safety, robustness, and uncertainty in these models. Your responsibilities will include developing models, tools, metrics, and datasets that are essential for assessing and evaluating the safety of generative models throughout their deployment lifecycle. You will also be tasked with creating models and tools that help interpret and explain failures in language and diffusion models. Additionally, you will build and maintain human annotation and red teaming pipelines to evaluate the quality and risk associated with various Apple products. Prototyping, implementing, and evaluating new machine learning models and algorithms for red teaming large language models (LLMs) will also be a key part of your role. This position offers a unique opportunity to work on cutting-edge technology that will have a significant impact on Apple's future offerings.

Responsibilities

• Develop models, tools, metrics, and datasets for assessing and evaluating the safety of generative models over the model deployment lifecycle.
• Develop models and tools to interpret and explain failures in language and diffusion models.
• Build and maintain human annotation and red teaming pipelines to assess quality and risk of various Apple products.
• Prototype, implement, and evaluate new ML models and algorithms for red teaming LLMs.

Requirements

• Strong engineering skills and experience in writing production-quality code in Python, Swift, or other programming languages.
• Background in generative models, natural language processing, LLMs, or diffusion models.
• Experience with failure analysis, quality engineering, or robustness analysis for AI/ML based features.
• Experience working with crowd-based annotations and human evaluations.
• Experience working on explainability and interpretation of AI/ML models.

Nice-to-haves

• BS, MS or PhD in Computer Science, Machine Learning, or related fields or an equivalent qualification acquired through other avenues.
• Proven track record of contributing to diverse teams in a collaborative environment.

Benefits

• Equal opportunity employer committed to inclusion and diversity.