856 jobs for "Infrastructure Cloud Architecture"

Sr. Machine Learning Engineer, Foundation Models Inference - Cloud OS & Inference

At Apple - Santa Clara

Posted on Oct 17

View job Apply on company site

Software Engineer, Cloud Services ASE

At Apple - Austin

Posted on Oct 17

View job Apply on company site

DevOps Engineer - Emerging Technologies

At Apple

Posted on Oct 16

View job Apply on company site

Backup & Storage Product Architect

At Jabil

Posted on Oct 26

View job Apply on company site

Solutions & Platform Architect - Microsoft

At Trupanion - Remote / Flexible

Posted on Oct 14

View job Apply on company site

Senior Backend Software Engineer — Python & Java

At Broadridge - Dublin

Posted on Oct 18

View job Apply on company site

Cloud Architect

At Waters - Cheshire-Wilmslow

Posted on Oct 22

View job Apply on company site

Cloud Architect

At Kyndryl - Bangalore · Hyderabad

Posted on Nov 5

View job Apply on company site

Vulnerability Researcher

At Delta Dental Ins. - Remote / Flexible

Posted on Oct 20

View job Apply on company site

Information Security Engineer - DevSecOps

At Fisher Investments - Plano

Posted on Oct 13

View job Apply on company site

Financial Operations Lead

At Hitachi Energy - Krakow

Posted on Oct 30

View job Apply on company site

Enterprise Infrastructure Architect

At Kyndryl - Mumbai

Posted on Oct 26

View job Apply on company site

Senior Software Engineer (Oracle Cloud Financials)

At Delta Dental Ins. - Oakland · Alpharetta

Posted on Oct 19

View job Apply on company site

Senior Solutions Architect II (AI/ML)

At DigitalOcean - San Francisco

Posted on Nov 5

View job Apply on company site

Staff Database Reliability Engineer

At Checkr - Denver · San Francisco

Posted on Oct 26

View job Apply on company site

Senior Engineer, Platform Security and Reliability

At Kairos Power - Remote / Flexible

Posted on Oct 13

View job Apply on company site

Software Engineer II - Post Detection Enablement

At Abnormal Security - Bangalore

Posted on Oct 14

View job Apply on company site

IT Architect - Network

At Eaton - Menomonee Falls

Posted on Sep 11

View job Apply on company site

Senior Cloud Network Engineer

At Morgan Stanley - New York

Posted on Oct 6

View job Apply on company site

Lead Software Engineer - (14-18 years - Java, Distributed Systems, Microservices, Cloud, Security, Platform Engineering, Gen AI)

At Visa - Bengaluru

Posted on Oct 8

View job Apply on company site

Apple

Sr. Machine Learning Engineer, Foundation Models Inference - Cloud OS & Inference

Santa Clara, CA$175,000 – $308,500Posted 22 days ago

Apply on company site View full job

We are the Foundation Model Inference team within Cloud OS and AI Inference organization. We are on a mission to build the most highly performant, secure and private inference stack that powers Siri AI, Apple Intelligence and Apps that are powered with the largest foundation models.

Our systems serve billions of queries daily across Siri AI, Apple Intelligence, Apple Search, Apple Music, Apple TV, App Store, iMessage, Photos, Camera, Spotlight & Safari, at remarkably low latency with every ounce of compute extracted from the hardware beneath them. We optimize language, vision, and speech models with billions of parameters using state-of-the-art techniques and ship them at Apple scale.

This is a rare opportunity to directly shape how AI reaches billions of people worldwide.

Description

You will work at the intersection of research and production, partnering closely with the Foundation Model Research team and our external partners to bring cutting-edge model architectures from prototype to planetary-scale deployment. You will own hard problems in inference efficiency, hardware/software codesign, systems architecture, and tooling, and help set the technical direction for the engineers around you.

This role sits within CloudOS and Private Cloud Compute (PCC) - Apple's purpose-built, privacy-preserving cloud infrastructure for AI workloads. PCC represents a first-of-its-kind approach to running foundation models in the cloud with verifiable privacy guarantees, and CloudOS is the systems foundation that makes it possible. You will be building and optimizing inference systems on top of this infrastructure, working closely with platform and security teams to deliver both performance and trust at scale.","responsibilities":"Partner with the Foundation Model Research team and our external partners to optimize inference for the latest model architectures across language, vision, and speech.

Design and ship production-grade inference systems serving millions of customers in real time.

Build profiling tools and simulators to identify and resolve performance bottlenecks across different hardware configurations and use cases.

Drive technical decisions on high-throughput, low-latency serving at supercomputing scale.

Mentor and grow engineers across the organization.

Preferred Qualifications

Experience building productions systems in Go or Python.

Strong knowledge of deep learning architectures including Transformers, encoder/decoder models, and multimodal variants.

Experience with inference optimization frameworks such as TensorRT-LLM, vLLM, SGLang, TGI, or Nvidia Triton Server.

Experience authoring custom CUDA kernels using CUDA C++ or OpenAI Triton.

MS in Computer Science, Machine Learning, Artificial Intelligence, Data Science, or a related field.

Minimum Qualifications

5+ years of experience leading complex, ambiguous technical projects from end to end.

Hands-on experience with LLM inference stacks.

Working knowledge of GPU or TPU programming concepts.

Proficiency with PyTorch, JAX, or TensorFlow.

Experience building and operating high-throughput services at large distributed scale.

Proficiency deploying applications on cloud platforms (AWS, GCP, or equivalent) using Kubernetes and Docker.

BS in Computer Science, Machine Learning, Artificial Intelligence, Data Science, or a related field.

Pay & Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $175,000 and $308,500, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

About Apple

Working at Apple means doing more than you ever thought possible and having more impact than you ever imagined.

Size: 10,000+ employees
Industry: Technology

View company profile