AIML – Engineering Manager, ML Systems Evaluation Engineering

Summary

Posted: Nov 22, 2024

Role Number:200575746

Would you like to play a part in shipping groundbreaking technology for large-scale systems, natural language, and artificial intelligence powering Apple Intelligence? The Global Evaluation Engineering team is hiring an Engineering Manager to help lead evaluation for large-scale, end-to-end ML systems. Join us to build the next-generation Siri, our intelligent assistant that helps millions of people get things done — just by asking. The Global Evaluation Engineering team within the AIML org is looking for an Engineering Manager to drive the evaluation of our Machine Learning systems globally and deliver the best customer experience. In this role, you will work closely with multiple engineering teams and make an impact on the design, planning, and execution of the evaluation strategy for Apple Intelligence, released in 40 languages and on multiple Apple platforms. You will operate in a highly cross-functional environment to keep moving the boundaries of automation and ML evaluation. You will play a meaningful role in crafting success metrics, defining program scope/vision, and driving execution to delivery in production.

Description

We are looking for a motivated and results-focused Engineering Manager with excellent communication and problem-solving skills and extensive experience in Project and Program management. You enjoy working on large-scale projects in a fast-paced environment that cultivates growth, collaboration, and innovation. Some of your responsibilities include – Partner with cross-functional teams to define datasets, metrics, quality plans, and evaluation methodologies to assess Apple Intelligence quality at scale and track their status. – Coordinate the execution, tracking, and reporting of quality metrics for Siri and ML-powered systems. – Be the liaison among Product, Engineering, and Eval organizations by keeping the teams focused and aligned on top priorities. – Optimize and coordinate Siri evaluation and ensure issues are addressed promptly before product release. – Participate in the creation of new evaluation datasets and strategies for Apple Intelligence.

Minimum Qualifications

• 5+ years engineering management experience working with E2E systems, preferably ML-powered.
• Experience managing projects spanning multiple cross-functional teams.
• Experience with testing and evaluating complex Machine Learning products.
• Experience with ML development lifecycle, including ML algorithm development and accuracy hillclimbing.

Preferred Qualifications

• M.S. in Computer Science or equivalent.
• Experience building evaluation datasets.
• Outstanding communication and presentation abilities, written and verbal, to all levels of an organization.
• Self-motivated and proactive, with multi-tasking, creative, and critical thinking capabilities.

Pay & Benefits

• At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $219,300 and $329,600, and your base pay will depend on your skills, qualifications, experience, and location.
  
  Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.
  
  Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.