Principal Engineer, Search and AI Infrastructure, Machine Learning Platform & Infrastructure

Imagine what you could do here. At Apple, great ideas have a way of becoming great products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you could accomplish.

Do you want to make Apple products more intelligent for our users? As part of Apple Services Engineering organization, Machine Learning Platform & Infrastructure team is building groundbreaking technology for search, natural language processing, artificial intelligence and machine learning. Our infrastructure is the back-bone of Apple Intelligence. It powers the largest Apple foundation models on servers and a wide gamut of services at Apple including Siri, Apple Music, AppleTV, AppStore, Photos & Camera, Spotlight, Safari, and upcoming ever exciting Apple products serving millions of queries every day with incredible low latencies, drawing every ounce of compute from our hardware.

As part of this group, you will work with one of the most exciting high performance computing environments, with petabytes of data, millions of queries per second, and have an opportunity to imagine and build products that delight our customers every single day. You will have a chance to work on optimizing billions of parameter language and vision and speech models using state of the art technologies and make it run at scale of Apple.

Description

We are seeking a Principal Engineer to provide leadership in building and evolving next-generation AI infrastructure for search and other product needs at Apple. In this role, you will shape the architecture and long-term technical strategy for large-scale inference systems that handle both internal workload and production traffic, integrate and evolve the web-scale search systems, work at the intersection of product innovation, AI research, and large scale distributed systems.

We design, build and maintain infrastructure to support features that empower billions of Apple users. We take full end-to-end ownership of our services, driving them through every stage meticulously, encompassing conception, design, implementation, deployment, and maintenance. As a result, each one of us takes our responsibilities seriously. In this team, you'll have the opportunity to work on incredibly complex large scale systems with trillions of records and petabytes of data, work along side teams to optimize inference for cutting edge model architectures, and build production grade solutions for millions of customers in real time.

Responsibilities:

Set the technical vision and define the roadmap for large-scale and high performance inference systems

Provide technical leadership to evolve search systems with AI capabilities at scale

Lead and develop the engineering team to deliver high quality AI infrastructure for for search and other product needs at Apple

Evolves team structures and processes to drive increased operational efficiency in a growth environment

Establish partnerships with cross-functional stakeholders and teams, collaborate with teams across cloud infrastructure, business operations, finance, and engineering

Influences and drives consensus on business priorities and engineering focus areas at the executive level

Preferred Qualifications

Preferred qualifications

Master's degree or PhD in Computer Science or related technical fields

Experience supporting distributed training inference workloads in production, ML systems performance profiling, debugging, and optimization

Proficiency in cloud-native architectures and orchestration platforms (e.g., Kubernetes)

Familiar with fundamental Deep Learning architectures such as Transformers, Encoder/Decoder models

Familiarity with Nvidia TensorRT-LLM, vLLLM, DeepSpeed, Nvidia Triton Server etc