519 jobs for "Machine Learning Evaluation Engineer"

Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build is the result of us making each other's ideas stronger. That happens because every one of us shares a belief that we can make something wonderful and share it with the world, changing lives for the better. It's the diversity of our people and their thinking that inspires the innovation that runs through everything we do. When we bring everybody in, we can do the best work of our lives.

Our Developer Publications Intelligence team seeks a creative engineer with strong engineering fundamentals and a robust knowledge of Large Language Models (LLMs), agentic workflows, and LLM evaluations at scale.

Description
As an Applied Machine Learning Engineer on the Developer Publications Intelligence team, you will join a multidisciplinary group of passionate Machine Learning and Software engineers to build and integrate ML models into existing and future tools produced by Apple for third-party developers. We strive for excellence and believe strongly in the quality of our output. You will work alongside domain experts across core subject areas, enable cross-functional collaboration with other departments at Apple, and contribute to architecture discussions, code reviews, and proposals.","responsibilities":"Building and maintaining LLM evaluation pipelines to assess model quality, track regressions, and support continuous improvement cycles.
Designing and implementing agentic workflows and on-device model solutions.
Engaging in code reviews, pair programming, and architecture discussions with other members of the team.

Preferred Qualifications
BS, MS, or PhD in Computer Science, Artificial Intelligence, or Machine Learning (or equivalent experience).
Experience developing for Apple's platforms using Xcode and Swift.
Experience with on-device LLMs.

Minimum Qualifications
Strong programming skills in Python, with additional experience in Swift, C++, or similar languages.
Comprehensive knowledge and hands-on experience with LLM evaluations.
Experience building and maintaining production-grade ML systems at scale.
Experience with agentic or multi-step LLM-based systems.

About Apple

Working at Apple means doing more than you ever thought possible and having more impact than you ever imagined.

Size: 10,000+ employees
Industry: Technology

View company profile