1,404 jobs for "Software Engineer - Distributed Systems"

Software Engineer, Athena Platform Team, IS&T Ai & Data Platforms

At Apple

Posted on Oct 15

View job Apply on company site

Senior Software Engineer, Find My

At Apple - Hyderabad

Posted on Oct 15

View job Apply on company site

Sr. AI Inference Platform Engineer

At Apple - Seattle

Posted on Oct 15

View job Apply on company site

SRE Software Engineer III

At JPMorgan Chase - Columbus

Posted on Oct 2

View job Apply on company site

Lead Software Engineer - Java, Go

At JPMorgan Chase - Bournemouth

Posted on Sep 7

View job Apply on company site

Site Reliability Engineer - TikTok Shop

At TikTok

Posted on Oct 10

View job Apply on company site

Senior Staff Software Engineer - Financial Products (Backend)

At Uber - Sunnyvale

Posted on Jul 7

View job Apply on company site

Software Engineer II: R&D Hardware Verification

At Cadence - Belo Horizonte

Posted on Sep 28

View job Apply on company site

Site Reliability Engineer (Component Platform) - TikTok Shop

At TikTok

Posted on Oct 10

View job Apply on company site

Sr Staff Engineer, Backend - Core Services

At Uber - Sao Paulo · Rio de Janeiro

Posted on Apr 22

View job Apply on company site

Software Engineer II: Innovus R&D

At Cadence - Belo Horizonte

Posted on Sep 16

View job Apply on company site

Backend Software Engineer, TikTok Live (Fund Safety) - Singapore

At TikTok

Posted on Jun 26

View job Apply on company site

Sr. Staff Software Engineer- Eng

At UKG - Lowell

Posted on Sep 8

View job Apply on company site

Senior Principal Al Engineer

At Cornerstone OnDemand - Hyderabad

Posted on Sep 11

View job Apply on company site

Staff Software Engineer - Agentic First

At Sonatype - Remote / Flexible

Posted on Apr 27

View job Apply on company site

Systems Engineer - R&D

At Hudson River Trading - Austin · Chicago

Posted on Feb 23

View job Apply on company site

Senior Software Engineer, Creator Services Translation

At Roblox - San Mateo

Posted on Sep 25

View job Apply on company site

Senior Android Software Engineer, Consumer Engineering

At Reddit - Remote / Flexible

Posted on Oct 8

View job Apply on company site

Senior Systems Engineer

At Cloudflare - In-Office

Posted on Jul 17

View job Apply on company site

Staff Embedded Software Engineer, Platform Networking

At Intuitive - Sunnyvale

Posted on Sep 4

View job Apply on company site

Apple

Sr. AI Inference Platform Engineer

Seattle, WA$175,000 – $308,500Posted 25 days ago

Apply on company site View full job

We are looking for senior engineer to build tooling, automation, and analysis capabilities that strengthen our AI inference platform. This role will focus on developing sophisticated performance benchmarking systems, capacity projection models, and data analysis pipelines that directly inform our AI infrastructure teams and capacity planners. You'll work at the intersection of AI systems performance, distributed infrastructure, and software engineering to help the team make data-driven decisions about scaling and optimizing our inference platform.

Description

At Apple, we believe the future of AI is defined not just by models, but by the infrastructure that powers them. Our AI inference platform sits at the heart of products and experiences used by hundreds of millions of people worldwide, and we are building the systems that ensure it scales reliably, efficiently, and intelligently.

As part of our next-generation datacenter engineering team, you will play a critical role in shaping how we understand, measure, and grow our AI infrastructure. You will design and build the tooling and analysis systems that give our engineers and capacity planners a clear, real-time picture of performance across our fleet. Your work will directly influence how we invest in hardware, how we detect regressions before they reach production, and how we forecast capacity needs months in advance.

This is a high-impact, cross-functional role for an engineer who is energized by complexity, thrives on turning raw data into actionable insight, and wants to work on problems that matter at massive scale.","responsibilities":"Design and build automations to evaluate AI inference performance across hardware generations and configurations.

Develop tooling to surface performance trends, regressions, and insights to infrastructure and planning teams.

Build projection and forecasting models to support long-term capacity planning decisions.

Analyze performance and utilization data to identify bottlenecks, trends, and optimization opportunities.

Partner with AI infrastructure engineers, hardware teams, and capacity planners to deliver critical data and tooling.

Create and enhance performance analysis workflows to increase team velocity and data reliability.

Continuously improve the accuracy, coverage, and usability of performance measurement and analysis systems.

Preferred Qualifications

Experience with performance benchmarking and methodologies for AI/ML inference systems.

Familiarity with capacity planning and forecasting/projection models for large-scale infrastructure.

Experience with GPU profiling and observability tools (e.g., Nsight, other vendor-specific profilers).

Experience with data visualization and reporting tools/frameworks for surfacing performance trends to stakeholders.

Familiarity with ML serving frameworks and runtimes (e.g., Triton, TensorRT-LLM, vLLM, or similar).

Experience with CI/CD and workflow orchestration tools for building automated performance analysis pipelines.

Knowledge of cluster schedulers and orchestration platforms (e.g., Kubernetes).

Experience with metrics and logging tools (e.g., Prometheus, Grafana, Splunk).

Minimum Qualifications

BS or MS in Computer Science or related technical field.

Solid understanding of AI/ML inference architecture and the performance characteristics of serving systems.

7 or more years of experience with performance and infrastructure engineering in distributed systems.

7 years of experience coding in Python, Go, C++, or other programming languages.

Experience with automation engineering, tooling, and data pipelines to support engineering workflows.

Strong knowledge of GPU/accelerator architecture as it relates to AI workloads.

Practical statistical knowledge applicable to performance analysis and forecasting.

Excellent communication skills and ability to turn data into clear guidance for infrastructure teams and capacity planners.

Pay & Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $175,000 and $308,500, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

About Apple

Working at Apple means doing more than you ever thought possible and having more impact than you ever imagined.

Size: 10,000+ employees
Industry: Technology

View company profile