34 jobs for "Machine Learning Engineer - AI & ML Evaluation Frameworks"

Machine Learning Engineer - AI & ML Evaluation Frameworks

At Apple - Cupertino

Posted on Oct 11

View job Apply on company site

Machine Learning Engineer - AI Evaluation & LLM Systems

At Apple - Cupertino

Posted on Oct 19

View job Apply on company site

ML Engineer

At Aristocrat

Posted on Nov 3

View job Apply on company site

Machine Learning Engineer, Human Centered AI - Evaluations & Insights

At Apple - Seattle

Posted on Aug 29

View job Apply on company site

Senior Machine Learning Engineer, AI-Native Evaluation & Search

At Atlassian - Remote / Flexible

Posted on Sep 15

View job Apply on company site

Machine Learning Engineer Project Intern (MultiModal ML Direction) - 2026 Start (BS/MS)

At TikTok

Posted on Jun 30

View job Apply on company site

Software Engineer (AML), AI & Data Platforms (AiDP)

At Apple - Austin

Posted on Oct 19

View job Apply on company site

Platform Engineer, Privacy Preserving ML

At Apple - Cupertino

Posted on Oct 19

View job Apply on company site

Principal Machine Learning Engineer, AI & Data Platforms (AiDP)

At Apple - London

Posted on Sep 30

View job Apply on company site

Platform Engineer, Privacy Preserving ML

At Apple - Cupertino

Posted on Oct 19

View job Apply on company site

AIML - Sr Machine Learning Engineer, Data and ML Innovation

At Apple - Cupertino

Posted on Oct 8

View job Apply on company site

Staff Machine Learning Engineer, Traffic Intelligence

At Airbnb

Posted on Aug 13

View job Apply on company site

Senior Machine Learning Engineer

At Exadel - Bulgaria

Posted on Sep 28

View job Apply on company site

Neural Graphics and World Models Research Scientist/Software Engineer Graduate (TikTok, Engine&Tools) - 2027 Start (PhD)

At TikTok - San Jose

Posted on Nov 2

View job Apply on company site

Applied AI ML Lead-AI Engineer

At JPMorgan Chase - Bengaluru

Posted on Nov 2

View job Apply on company site

C++/Python Software Engineer

At Cadence - Shanghai

Posted on Nov 2

View job Apply on company site

Senior AI/ML Engineer

At EcoVadis - Remote / Flexible

Posted on Oct 15

View job Apply on company site

Senior AI/ML Engineer

At EcoVadis - Remote / Flexible

Posted on Oct 15

View job Apply on company site

2027 Summer Intern - Machine Learning Intern, Autonomous Vehicles: Software Validation (PhD)

At General Motors - Sunnyvale

Posted on Oct 5

View job Apply on company site

Principal Machine Learning Systems Engineer - Search & Intelligence

At Atlassian - Remote / Flexible

Posted on Sep 15

View job Apply on company site

Apple

Machine Learning Engineer - AI & ML Evaluation Frameworks

Cupertino, CA$150,400 – $277,600Posted 27 days ago

Apply on company site View full job

The Health Sensing Machine Learning Interpretability & Analytics (MLIA) team ensures clinical rigor and contextual trust are at the foundation of Apple's health sensing features. We are looking for an exceptional ML Engineer to help us build the next generation of scalable evaluation infrastructure and lead rigorous investigations into model performance. You will develop cutting-edge tools, synthetic data pipelines, and automated frameworks that ensure our health features are mathematically sound, demographically equitable, and clinically safe. If you are passionate about AI safety, robust software architecture, and pushing the boundaries of ML innovation, come join us!

Description

In this role, you will architect and build large-scale evaluation frameworks to interrogate unimodal ML systems and multi-modal foundation models. Beyond infrastructure, you will lead deep-dive ML evaluations, performing failure analysis to uncover performance gaps, reasoning flaws, and edge cases. You will translate findings into actionable insights and work directly with algorithm teams to improve the safety and reliability of our health features. Your work will empower teams across Apple to rapidly evaluate multi-modal sensor fusion while upholding Apple's privacy standards.","responsibilities":"Design robust methodologies and scalable frameworks to assess the performance, reliability, and safety of both traditional ML and foundation models (e.g., LLMs, diffusion models).

Drive failure analysis along with building instrumentation to detect clinical hallucinations, reasoning flaws, and edge cases.

Expand LLM/diffusion-based data generation pipelines that enable model training and evaluation without exposing real user data.

Build data adaptors and visualizers to fuse asynchronous time-series signals (wearables, camera, behavioral metadata).

Develop generalizable tools and metrics to discover biases and measure demographic equity across diverse populations

Translate evaluation results into actionable engineering insights for GenAI researchers, algorithm leads, and clinical experts.

Preferred Qualifications

MS/PhD in Computer Science, Machine Learning, Statistics, or related field

Experience evaluating LLMs or agentic systems (e.g., LLM-as-a-judge, RAG evaluation)

Experience with synthetic data generation and prompt engineering

Experience in parallel data processing (Spark, Kubernetes, Airflow) or privacy-preserving ML (Federated Learning)

Background in AI Safety, model interpretability, or adversarial testing

Interest in digital health and clinical rigor

Minimum Qualifications

BS in Computer Science, Machine Learning, Statistics, or related field

3+ years of experience in ML Engineering or Applied ML

Strong experience in evaluating supervised, unsupervised, LLMs and deep learning models.

Proficiency in Python with the ability to write production-grade code (OOP, CI/CD, Git)

Hands-on experience in failure analysis, evaluating LLMs and driving subsequent model improvements

Experience building data pipelines, inference frameworks, and automated evaluation systems

Strong communication skills to articulate complex technical concepts across technical and non-technical audiences

Pay & Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $150,400 and $277,600, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

About Apple

Working at Apple means doing more than you ever thought possible and having more impact than you ever imagined.

Size: 10,000+ employees
Industry: Technology

View company profile