516 jobs for "Machine Learning Evaluation Engineer"

AIML - Sr Machine Learning Engineer, Data and ML Innovation

At Apple - Cupertino

Posted on Oct 8

View job Apply on company site

Sr Machine Learning Engineer - Consumer Incentives

At Uber - San Francisco · New York

Posted on Nov 5

View job Apply on company site

Machine Learning Engineer, Specialist

At Vanguard - Malvern

Posted on Oct 1

View job Apply on company site

Staff AI & Machine Learning Engineer

At UKG - Noida

Posted on Sep 3

View job Apply on company site

Senior Machine Learning Engineer

At Exadel - Bulgaria

Posted on Sep 28

View job Apply on company site

Principal Engineer, UAIS

At Uber - San Francisco · Sunnyvale

Posted on Nov 3

View job Apply on company site

Senior Data Engineer

At General Motors - Austin

Posted on Nov 6

View job Apply on company site

Data Scientist SME

At Leidos - St. Louis

Posted on Oct 16

View job Apply on company site

Applied Researcher 5 (AI Foundations: Evaluation and Agentic Workflows)

At Capital One - McLean · Cambridge

Posted on Nov 8

View job Apply on company site

Director, Software Engineering- Machine Learning (Individual Contributor)

At Fidelity Investments - Boston

Posted on Oct 28

View job Apply on company site

Machine Learning Engineer - Generative AI & Agents

At Apple

Posted on Oct 19

View job Apply on company site

Data Scientist - Retail Banking (ML & Predictive Modeling)

At PNC - Pittsburgh

Posted on Oct 31

View job Apply on company site

Lead AI Engineer - Generative AI & Data Platforms

At Vanguard - Hyderabad

Posted on Oct 24

View job Apply on company site

GE Vernova AI Engineer

At GE Vernova - Greenville

Posted on Oct 27

View job Apply on company site

Principal Machine Learning Engineer (Memory & Context)

At Zillow - Remote / Flexible

Posted on Oct 21

View job Apply on company site

Senior Software Engineer

At Atlassian - Remote / Flexible

Posted on Nov 1

View job Apply on company site

Machine Learning Scientist II - Content Intelligence

At Booking.com - Tel Aviv

Posted on Nov 4

View job Apply on company site

Lead Software Engineer

At JPMorgan Chase - Jersey City · Palo Alto

Posted on Nov 6

View job Apply on company site

Research Engineer, Agentic Video Editing - TikTok

At TikTok - San Jose

Posted on Nov 6

View job Apply on company site

Senior Director AI, Chief Revenue Organization

At Equinix, Inc - Remote / Flexible

Posted on Oct 29

View job Apply on company site

Apple

AIML - Sr Machine Learning Engineer, Data and ML Innovation

Cupertino, CA$150,400 – $277,600Posted Oct 8, 2026

Apply on company site View full job

Do you want to play a part in the revolution in Foundation Models? Contribute to model hillclimbing for Apple Intelligence features that leverage Apple Foundation Models, and work with the people who built the intelligent products that helps millions of people get things done - just by asking or typing? The vision for AIML FM Data organization is to improve Foundation Models by leveraging data and cutting-edge LLM techniques. As a Sr ML Engineering on the team, you will drive ML innovations, identify key opportunity areas and experiment with various techniques to improve model training and evaluation efficiency and performance.

Description

As a Senior Machine Learning Engineer, you will join end-to-end development of large language models and agentic systems, from training pipelines to evaluation frameworks and production deployment. You will work at the intersection of modeling, infrastructure, and product, helping push model quality through systematic experimentation and iteration. You'll collaborate closely with research, infrastructure, and product teams to design robust training pipelines, build agent environments, and ship high-impact AI capabilities into real-world applications. This role blends deep modeling expertise with strong engineering fundamentals and offers the opportunity to shape both the technical direction and the ML platform powering Apple products.","responsibilities":"Model Training & Optimization

Design and implement large-scale LLM pretraining and post-training pipelines, including supervised fine-tuning, preference optimization, and continual learning.

Drive model hillclimbing through disciplined experimentation: dataset curation, hyperparameter tuning, and ablation studies.

Work on scalable training workflows using distributed frameworks.

Evaluation, Reward, and Data Systems

Develop evaluation frameworks for both offline benchmarks and online metrics, covering reasoning, tool use, and task success.

Design and maintain verifiers / rubric-based reward systems for agentic tasks and model alignment.

Build data pipelines for data generation, filtering, labeling, and replay buffers.

Agent & Environment Infrastructure

Build and maintain agent training environments, including tool APIs, simulators, and sandboxed runtimes.

Implement environment abstractions to support reinforcement learning and agent evaluation at scale.

Collaborate on large scale RL-infra: RL-trainer, rollout system, and containerized environments.

Preferred Qualifications

Direct experience with agentic systems, including tool use, environment design, or reinforcement learning.

Experience with building or operating training environments or simulators (gym-style, tool-based, or sandboxed environments).

Experience with model hillclimbing workflows: systematic experimentation, ablations, dataset iteration, and continuous quality improvement.

Ability to work across research and engineering boundaries, turning ideas into scalable systems.

Have demonstrated creative and critical thinking with an innate drive to improve how things work. Have a high tolerance for ambiguity.

Minimum Qualifications

5+ years of hands on ML engineering experiences, with at least 1+ years working directly on large language models or generative AI.

Bachelor's, Master's, or PhD in Computer Science, Machine Learning, or a related technical field - or equivalent practical experience.

Hands-on experience with LLM training workflows, including one or more of: Pretraining or continued pretraining, Supervised fine-tuning (SFT), Preference optimization (e.g., RLHF, DPO, PPO).

Strong software engineering fundamentals: debugging, testing, code reviews, and production reliability.

Demonstrated publication records in relevant conferences (e.g., NeurIPS, ICML, ICLR, etc.).

Pay & Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $150,400 and $277,600, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

About Apple

Working at Apple means doing more than you ever thought possible and having more impact than you ever imagined.

Size: 10,000+ employees
Industry: Technology

View company profile