Apple - Cupertino, CA
posted 4 days ago
Full-time - Senior
Cupertino, CA
10,001+ employees
Computer and Electronic Product Manufacturing
About the position
The Software Development Automation Engineering Lead for ML Systems Evaluation Engineering at Apple is responsible for leading the quality assurance of AIML products across new platforms. This role involves developing automation frameworks and methodologies to evaluate user experiences of Siri and other machine learning-based products. The engineer will collaborate with innovative product development teams to craft evaluation tools that enhance the functionality and user satisfaction of AIML technologies.
Responsibilities
- Lead the qualification of Siri and AIML future technologies and customer-facing product features.
- Develop automation and test methodologies for evaluating user experiences.
- Define and lead all aspects of user impact and success metrics.
- Create test frameworks, tooling, and test automation at scale.
- Innovate solutions and strategies to expand feature coverage for customer delivery.
Requirements
- 10+ years as a Software Development Engineer with demonstrated technical leadership experience.
- 4+ years of designing and architecting tools and frameworks.
- Depth of knowledge in statistics-based evaluation methodologies or user success metrics.
- Deep understanding of ML-based concepts and data usage in ML, experimentation, and analytics.
- Understanding of generative AI and experience using Gen AI for various applications.
Nice-to-haves
- Extensive experience working and leveraging cross-functional partnerships.
- Experience with CI/CD technologies.
- Expertise in investigating, debugging, and triaging difficult problems both independently and collaboratively.
Benefits
- Comprehensive medical and dental coverage
- Retirement benefits
- Discounted products and free services
- Reimbursement for certain educational expenses including tuition
- Discretionary bonuses or commission payments
- Relocation assistance
