Sr. Manager, Data Quality Operations, Apple Services Engineering

$200,400 - $358,200/Yr

Apple - Cupertino, CA

Full-time - Senior

Cupertino, CA

Computer and Electronic Product Manufacturing

About the position

The Head of Data Quality Operations at Apple Services Engineering (ASE) is responsible for ensuring the quality of training data used for AI and LLM features across various platforms. This role involves leading a global team, developing training programs, and driving thought leadership on data quality to enhance customer experience. The position requires a blend of critical thinking, data analysis, and operational management to scale data collection and improve annotation quality.

Responsibilities

• Create and scale a data innovation team to ensure annotation quality and increase data value via machine learning or AI methods.
• Key collaborator in planning, designing, implementing, and testing annotation tooling.
• Own communication and thought leadership around data quality with key customers and collaborators.
• Lead a global workforce of over a thousand annotators, including a data science team and a data quality assurance team.
• Work with project teams to understand challenges in developing good training data and relay perspectives to customers.
• Collaborate with linguists, annotators, academics, and researchers to define data quality standards.
• Supervise the training materials and curriculum for the entire annotator base.
• Supervise the creation of 'golden datasets' to evaluate annotators.

Requirements

• PhD or equivalent experience with a focus on applied machine learning.
• 7+ years of overall relevant experience with 5+ years in management or leadership roles.
• Strong written and verbal communication skills.
• Experience with executive-level communication.

Nice-to-haves

• 3 years of demonstrated ability with LLMs.
• Experience in creating datasets from scratch and repurposing/reannotating.
• Excited to solve ambiguous problems.
• A relentless attitude of testing and iterating.

Benefits

• Comprehensive medical and dental coverage
• Retirement benefits
• Discounted products and free services
• Reimbursement for certain educational expenses including tuition
• Discretionary bonuses or commission payments
• Relocation assistance