Data Infrastructure/Platform Engineer for Lakehouse, ASE

Summary

Posted: Nov 20, 2024

Weekly Hours: 40

Role Number:200579167

The Apple Data Platform team, part of the Services organization, powers analytics and machine learning across Apple. Our mission is to deliver cutting-edge, reliable, and user-friendly infrastructure for data ingestion, storage, processing, and interaction, enabling teams to build data-intensive applications with ease and success! This role sits within the Data Lakehouse team, a part of the Apple Data Platform. The team provides a managed Lakehouse solution powered by Apache Iceberg, a REST Catalog, and custom-built services to manage data at scale. We continuously innovate to meet evolving customer needs and market trends. We seek engineers passionate about building world-class infrastructure products. In this role, you will lead the data lakehouse team, guiding team members in both technical and professional growth. You will collaborate closely with cross-functional teams to lead the planning, execution, and success of technical projects, with a focus on enhancing the experience for Apple’s internal customers!

Description

The ideal candidate will have outstanding communication skills, proven data infrastructure/platform design and implementation capabilities, strong business acumen, and an innate drive to deliver results. They will be a self-starter, comfortable with ambiguity and will enjoy working in a fast-paced dynamic environment. Responsibilities will include – Build and operate Apple’s largest data platform supporting exabyte scale. – Scale and operationalize the largest custom build multi-tenant, highly secure, privacy enabled Data Lakehouse. – Ensure data platform offers reliable high quality data with consistent SLAs with good monitoring, alerting and incident response and continual investment to reduce tech-debt – Write code, documentation, participate in code reviews, and mentor other engineers

Minimum Qualifications

• 10+ years of experience in design and development of scaling, and operation of distributed systems, including technologies like Apache Spark, Kafka, Flink, Iceberg, and Hive, along with resource management systems like Apache Mesos and Kubernetes.
• Proficient in Java or Scala.
• Proven expertise in designing and developing scalable, reliable APIs.
• A hands-on approach with a willingness to engage in daily technical work.
• Skilled at debugging complex issues in large-scale distributed systems.
• Driven by a passion for building reliable, maintainable, and user-friendly products and services.
• Exceptional communication and collaboration skills, with the ability to work effectively across multiple teams and functions.
• B.S., M.S., or PhD in Computer Science, Computer Engineering, or equivalent practical experience

Preferred Qualifications

• Expertise in public cloud platform’s like AWS, S3, EKS, IAM.
• Contributor to open source technologies like Spark or Iceberg.
• Expertise in building Lakehouse for large scale data platforms.

Pay & Benefits

• At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $207,800 and $312,200, and your base pay will depend on your skills, qualifications, experience, and location.
  
  Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.
  
  Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.