16 jobs for "Machine Learning Engineer - AI Evaluation & LLM Systems"

Machine Learning Engineer - AI Evaluation & LLM Systems

At Apple - Cupertino

Posted on Oct 19

View job Apply on company site

Senior Machine Learning Engineer

At Apple - Cupertino

Posted on Oct 16

View job Apply on company site

Senior Machine Learning Engineer

At Apple - Cupertino

Posted on Oct 16

View job Apply on company site

Machine Learning Engineer Graduate (Conversational AI) - 2027 Start

At TikTok - San Jose

Posted on Oct 10

View job Apply on company site

Machine Learning Engineer Graduate (Conversational AI) - 2027 Start

At TikTok - Seattle

Posted on Oct 10

View job Apply on company site

Machine Learning Engineer Intern (Conversational AI) - 2027 Start (PhD)

At TikTok - Seattle

Posted on Oct 10

View job Apply on company site

Machine Learning Engineer - LLMs, Agent Systems, and Simulation Tooling, Siri Core Modeling

At Apple - Cupertino

Posted on Oct 15

View job Apply on company site

AI Research and Development Engineer

At ASML - San Jose

Posted on Oct 28

View job Apply on company site

Senior Software Development Engineer, Agentic Memory & Evals Team

At Zillow - Remote / Flexible

Posted on Nov 5

View job Apply on company site

Principal Software Engineer, GenAI Platform

At Roblox - San Mateo

Posted on Oct 28

View job Apply on company site

Machine Learning Engineer, Answers Relevance

At Reddit - Remote / Flexible

Posted on Oct 18

View job Apply on company site

Director, Software Engineering- Machine Learning (Individual Contributor)

At Fidelity Investments - Boston

Posted on Oct 28

View job Apply on company site

Machine Learning Engineer 2

At Twilio - Remote / Flexible

Posted on Oct 28

View job Apply on company site

Technology Lead

At Infosys - Sao Paulo

Posted on Oct 29

View job Apply on company site

Senior Machine Learning Engineer- Worldwide Product Marketing

At Apple - Cupertino

Posted on Oct 12

View job Apply on company site

Research Engineer, Agentic Video Editing - TikTok

At TikTok - San Jose

Posted on Nov 6

View job Apply on company site

Apple

Machine Learning Engineer - AI Evaluation & LLM Systems

Cupertino, CA$150,400 – $225,300Posted 20 days ago

Apply on company site View full job

Join the team building the evaluation systems that enable Apple's next generation of AI experiences. As a Machine Learning Engineer, you will develop scalable infrastructure, intelligent evaluators, and data-driven methodologies that measure and improve the quality of large language models and multimodal AI systems used across Apple products.

You'll partner closely with ML researchers, software engineers, and product teams to design novel evaluation techniques, analyze model behavior, and translate research into production-ready systems. This role requires strong engineering fundamentals, a passion for machine learning, and the curiosity to solve challenging problems at the intersection of AI, data, and software engineering.

If you're excited about building the tools that help define the future of AI quality at Apple, we'd love to hear from you.

Description

As a Machine Learning Engineer, you will build the systems that measure and improve the quality of AI experiences used by millions of people. You will develop machine learning models, evaluation frameworks, and scalable infrastructure that enable teams to understand model behavior, identify regressions, and accelerate the development of large language models and multimodal AI. Working closely with researchers, software engineers, and product teams, you will transform cutting-edge research into production-ready solutions, analyze large-scale datasets, and develop new approaches for benchmarking and improving AI quality. This is a unique opportunity to solve challenging technical problems at the intersection of machine learning, software engineering, and data, while helping shape the future of AI at Apple.","responsibilities":"Design, develop, and deploy evaluation systems and scalable software that improve the quality of AI experiences.

Build robust infrastructure to support model training, benchmarking, and large-scale evaluation.

Analyze model performance, identify quality issues, and develop innovative techniques to measure and improve AI behavior.

Collaborate with machine learning researchers, software engineers, and product teams to translate research into production-ready solutions.

Drive technical excellence by contributing to architecture, code reviews, experimentation, and engineering best practices.

Preferred Qualifications

Experience with large language models (LLMs), multimodal AI, or generative AI through internships, research, or personal projects.

Experience building software or machine learning projects using modern engineering practices (Git, testing, CI/CD).

Familiarity with distributed computing, cloud platforms, or large-scale data processing.

Publications, open-source contributions, or participation in machine learning competitions.

MS or PhD specializing in Machine Learning, Artificial Intelligence, or a related field.

Minimum Qualifications

MS, or PhD in Computer Science, Machine Learning, Electrical Engineering, or a related technical field, or equivalent practical experience.

1-2 years of industry experience, or equivalent academic or internship experience, developing machine learning or AI solutions.

Proficiency in Python and familiarity with C++ or another object-oriented programming language.

Experience with one or more machine learning frameworks such as PyTorch, TensorFlow, or JAX.

Understanding of machine learning fundamentals, including supervised learning, model evaluation, and statistical analysis.

Experience working with data processing, model training, or experimentation through coursework, research, internships, or industry projects.

Strong analytical, problem-solving, and communication skills with the ability to collaborate effectively in a team environment.

Pay & Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $150,400 and $225,300, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

About Apple

Working at Apple means doing more than you ever thought possible and having more impact than you ever imagined.

Size: 10,000+ employees
Industry: Technology

View company profile