AIML – Sr Software Development Engineer in Test, ML Systems Evaluation Engineering

Summary

Posted: Oct 22, 2024

Weekly Hours: 40

Role Number:200553996

Are you passionate about creating ground-breaking technology for next generation of voice assistant technology (Siri) and spatial recognition that will usher the next revolution of human-computer interaction? Join the team that plays a key part in shipping groundbreaking technology for large scale systems in natural language, and artificial intelligence pertaining to Siri and Apple ecosystem that impacts day to day life of billions globally. Join ML Systems Evaluation Engineering (MLSEE) team at Apple and contribute to a highly accomplished team that evaluates AIML products, that will delight and inspire billions of people! We are looking for Software Development Engineer in Test with a strong background and experience in Machine-Learning, audio and visual technologies, Conversational and Generative AI. We are seeking an engineer to lead the high quality of AIML products and collaborate with the most innovative product development teams in the world. This team crafts and builds evaluation tools, automation frameworks, acoustic evaluation labs, and methodologies that enable product teams across Apple to develop machine-learning solutions that power amazingly intelligent user experiences. You will engage with innovative new-product teams around Apple, bringing your expertise and passion for innovation to solving technical problems for our next-generation products.

Description

This role as Software Development Engineer in Test will own the qualification of spatial perception that is the critical part for invoking Siri and other Apple user experiences on AIML future technologies and customer facing product features by developing product evaluation, automation and test methodologies. You will be leveraging innovative AI models to build applications and testing solutions on top of Apple’s most advanced technologies. As a Software Engineer focused on product quality of ML models and features, you will be responsible for designing and implementing testing solutions, automation and build AI models for quality insights and testing frameworks. You will work closely with other cross-functional teams to align research, messaging, contribute to roadmaps and development of world class products. You will prototype and test new ideas and bring your research to life. You will be playing a pivotal role in testing, maintaining and shipping artifacts/features to make Siri and other AIML related products empowering customers lives. The primary responsibilities associated with this position range from data insights, design and implementation of product quality measures, ability to convert research findings into product quality improvement or frameworks, and work closely with product teams before and after product/feature launch. You will write clean, maintainable and production code with appropriate documentation and tests. You will contribute to architecture decisions, design reviews and peer code reviews. This role as a Software Development Engineer in Test will own the qualification of Siri and AIML future technologies and customer facing product features by developing automation and test methodologies. This role will be responsible for Quality Planning and Test creation, build automation to simulate and evaluate user experiences of Apple Intelligence, Siri and other ML-based products. In this role, your responsibilities include defining and leading all aspects of user impact and success metrics. Innovative solutions and strategies that allow the team to expand the coverage of the features we ultimately deliver to our customers are a must. We provide the right balance between research and product quality to deliver Apple quality state-of-the-art experiences on various Apple products.

Minimum Qualifications

• 6+ years as Software Development Engineer.
• Experience designing and architecting tools and frameworks.
• Expertise in dealing with datasets and performing analysis for product quality insights
• Demonstrated depth of knowledge and application of statistics-based evaluation methodologies or user success metrics
• Deep Understanding of ML-based concepts including awareness of how data is used to support ML, experimentation and analytics
• Experience with analyzing user behavior, deriving patterns and designing test strategies, automation frameworks
• Deep understanding of Prompt Engineering and Build Prompt fine-tuning
• Understanding of generative AI and experience in using Gen AI for various applications

Preferred Qualifications

• Experience with conversational AI technologies and frameworks
• Familiarity with Apple’s research and products is a plus
• Experience with audio signals and analysis
• Experience with computer vision
• Experience with robotics and automation

Pay & Benefits

• At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $175,800 and $312,200, and your base pay will depend on your skills, qualifications, experience, and location.
  
  Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.
  
  Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.