368 jobs for "Machine Learning System Software Engineer"

On-device ML Performance Engineer, Graphics, Games and Machine Learning

At Apple - Seattle

Posted on Oct 9

View job Apply on company site

Machine Learning Engineer Intern (Brand Ads) - 2027 Summer

At TikTok - San Jose

Posted on Aug 4

View job Apply on company site

Machine Learning Engineer Graduate (Audio Understanding) - 2027 Start (PhD)

At TikTok

Posted on Aug 3

View job Apply on company site

Tech Lead, Machine Learning Engineer - Search E-commerce

At TikTok

Posted on Feb 6

View job Apply on company site

Machine Learning Engineer, Search & Knowledge Quality

At Apple - Santa Clara

Posted on Oct 19

View job Apply on company site

Machine Learning Engineer - Intelligent Quality Systems

At Apple - Cupertino

Posted on Oct 17

View job Apply on company site

Intern: AI for Silicon Test Data Analytics & Failure Analysis

At Cadence - Sophia

Posted on Oct 20

View job Apply on company site

Machine Learning Engineer

At Uber - Sao Paulo

Posted on Oct 21

View job Apply on company site

Machine Learning Engineer

At Atlassian - Remote / Flexible

Posted on Nov 6

View job Apply on company site

Lead Software Engineer

At JPMorgan Chase - Jersey City · Palo Alto

Posted on Nov 6

View job Apply on company site

Real-Time Software Engineer

At Leidos - Arlington

Posted on Nov 6

View job Apply on company site

Full-stack Engineer 4 - Machine Learning Experiences (MLX)

At Capital One - San Jose · Richmond

Posted on Oct 25

View job Apply on company site

Manager, AV Planner Evaluation

At General Motors - Sunnyvale

Posted on Oct 21

View job Apply on company site

Lead Software Engineer - AI Governance Engineering

At JPMorgan Chase

Posted on Oct 27

View job Apply on company site

Software Engineering Intern

At Leidos - Arlington

Posted on Nov 3

View job Apply on company site

Senior Security Architect

At Leidos - Bethesda

Posted on Oct 27

View job Apply on company site

Senior Embedded Software Engineer - Platform Software

At Intuitive - Sunnyvale

Posted on Nov 6

View job Apply on company site

AI/ML Engineer Intern

At Intuitive - Sunnyvale

Posted on Nov 2

View job Apply on company site

Senior Machine Learning Engineer

At Intuitive - Sunnyvale

Posted on Nov 2

View job Apply on company site

Applied ML - Functional Verification Engineer

At Cadence - San Jose

Posted on Mar 6

View job Apply on company site

Apple

On-device ML Performance Engineer, Graphics, Games and Machine Learning

Seattle, WA$142,300 – $263,300Posted 29 days ago

Apply on company site View full job

The On-Device Machine Learning team at Apple is responsible for enabling the Research to Production lifecycle of cutting edge machine learning models that power magical user experiences on Apple's hardware and software platforms. Apple is the best place to do on-device machine learning, and this team sits at the heart of that discipline, interfacing with research, SW engineering, HW engineering, and products.

The On-device ML Performance team has the responsibility to analyze latency, memory, power and numerical correctness of the latest machine learning models running on Apple SoC's, and to make Apple's ML software stack take full advantage of the capabilities in Apple's ML accelerators. The work from this cross functional team enables model developers' decisions to optimize performance via advanced techniques such as quantization, sparsity, performance and accuracy tradeoffs. The work of this team impacts all new Apple HW and ML Inference on them.

Our group is looking for an On-device ML Performance Engineer, with technical expertise in computer architecture, performance, memory, power, ML model architectures and on-device ML inference. The role entails deep analysis of ML inference from the SW stack and low level drivers to HW debug involving CPU, GPU, Apple Neural Engine, system memory and power.

Description

As an engineer in this role, you will be primarily focused on analyzing and optimizing the performance of the latest ML models on the latest iPhones and Mac's. You will work with models created by the most popular ML frameworks (PyTorch, MLX, etc) and will analyze the inference of those models on device to ensure the stack achieves full machine performance on Apple Silicon. The role also includes scripting, coding, and generation of utilities and debug tools to extract, analyze, and report performance and power related metrics for Apple HW. The ideal candidate will have a passion for ML model architectures and ML inference, deep knowledge of GPU and CPU, computer architecture and memory, compilers and HW drivers.

","responsibilities":"Driving the on-device performance analysis of Apple SoC's and ML SW stack across a wide range of Apple internal or open-source ML models

Optimize model conversion, compilation and on-device inference for Apple SoC's, achieving objectives such as performance, memory, and energy efficiency

Developing tools and scripts to generate and analyze ML performance data

Work across multiple teams and organizations to support the design and delivery of best in class on-device ML hardware and software stack

Generate and present ML performance data to internal and external teams and stakeholders

Preferred Qualifications

Masters or PhDs in Computer Science or relevant disciplines.

Experience with Apple's CoreML, MPS Graph, Metal Performance Shader's or MLX frameworks

Experience with any on-device ML stack, such as TFLite, ONNX, ExecuTorch, etc.

Experience with any ML authoring framework (PyTorch, TensorFlow, JAX, etc.).

Experience with Apple's App development framework such as Xcode, Swift, Objective-C

Experience with any compiler stack (MLIR/LLVM/TVM etc.)

Minimum Qualifications

Experience with ML inference, quantization, performance and accuracy

Familiarity and experience with the most popular ML architectures (e.g. LLM's, Diffusion models, CNN's)

A passion to explore and learn about the latest advances in ML model design and architecture, particularly as related to model implementation on HW and on-device inference

Familiarity with Operating Systems, embedded systems, and CPU/GPU HW architectures

Highly proficient in Python/C++ and shell scripting

Familiarity with Linux or macOS

Exceptional clarity in verbal and written communication, including the ability to present and lead discussions in larger groups

Pay & Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $142,300 and $263,300, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

About Apple

Working at Apple means doing more than you ever thought possible and having more impact than you ever imagined.

Size: 10,000+ employees
Industry: Technology

View company profile