283 jobs for "Machine Learning Evaluation Engineer"

Machine Learning Engineer - Generative AI & Agents

At Apple

Posted on Oct 19

View job Apply on company site

Lead AI Engineer - Generative AI & Data Platforms

At Vanguard - Hyderabad

Posted on Oct 24

View job Apply on company site

GE Vernova AI Engineer

At GE Vernova - Greenville

Posted on Oct 27

View job Apply on company site

Principal Machine Learning Engineer (Memory & Context)

At Zillow - Remote / Flexible

Posted on Oct 21

View job Apply on company site

Senior Software Engineer

At Atlassian - Remote / Flexible

Posted on Nov 1

View job Apply on company site

Machine Learning Scientist II - Content Intelligence

At Booking.com - Tel Aviv

Posted on Nov 4

View job Apply on company site

Lead Software Engineer

At JPMorgan Chase - Jersey City · Palo Alto

Posted on Nov 6

View job Apply on company site

Research Engineer, Agentic Video Editing - TikTok

At TikTok - San Jose

Posted on Nov 6

View job Apply on company site

Senior Director AI, Chief Revenue Organization

At Equinix, Inc - Remote / Flexible

Posted on Oct 29

View job Apply on company site

Data Scientist SME

At Leidos - Alexandria

Posted on Oct 16

View job Apply on company site

Principle Machine Learning Systems Engineer

At Atlassian - Remote / Flexible

Posted on Oct 21

View job Apply on company site

Applied Researcher 5

At Capital One - San Jose · San Francisco

Posted on Nov 6

View job Apply on company site

Manager, AV Planner Evaluation

At General Motors - Sunnyvale

Posted on Oct 21

View job Apply on company site

Senior Machine Learning Engineer, Rich Media Experiences

At Zillow - Remote / Flexible

Posted on Oct 19

View job Apply on company site

Sr Staff Machine Learning Engineer- Consumer Incentives

At Uber - Sunnyvale · San Francisco

Posted on Oct 24

View job Apply on company site

Staff Machine Learning Engineer, Siri Runtime Systems and Interaction

At Apple

Posted on Oct 19

View job Apply on company site

Senior Director AI, Chief Revenue Organization

At Equinix, Inc - Remote / Flexible

Posted on Oct 21

View job Apply on company site

Applied AI ML Lead-AI Engineer

At JPMorgan Chase - Bengaluru

Posted on Nov 2

View job Apply on company site

Director, Software Engineering

At Fidelity Investments - Durham

Posted on Oct 26

View job Apply on company site

Principal Machine Learning Engineer, Agentic AI

At Zillow - Remote / Flexible

Posted on Oct 19

View job Apply on company site

Apple

Machine Learning Engineer - Generative AI & Agents

ChinaPosted 20 days ago

Apply on company site View full job

Imagine what you could do here! The people here at Apple don't just create products - they build the kind of wonder that's revolutionized industries. It's the diversity of those people and their ideas that encourages the innovation that runs through everything we do, from amazing technology to industry-leading environmental efforts. At Apple, inclusion is a shared responsibility, and we work together to develop a culture where everyone belongs and is inspired to do their best work.

People here at Apple don't just build products; we craft the kind of wonder that's revolutionized entire industries. It's the diversity of those people and their ideas that inspire the innovation that runs through everything we do, from extraordinary technology to industry-leading environmental efforts. Join Apple, and help us leave the world better than we found it.

Apple's Channel Sales team in Greater China is responsible for the development and implementation of all indirect sales efforts for Apple's full product offerings in China, HK, and Taiwan. To continue growing our GC business, we're looking experienced engineers / data scientists with a passion for using machine learning to transform people's life by innovating on intelligent user experiences to join our Analytics & Optimizations on the Sales Analytics Team in China.

In this position, you won't just implement solutions-you'll shape strategies, drive innovation, and elevate industry standards. Your work will empower businesses, optimize performance, and unlock new possibilities for growth.

If you're ready to challenge yourself, expand your expertise, and contribute to a high-impact team, we'd love to hear from you!

Description
Architect AI Agents - Design, orchestrate, and deploy robust AI agent architectures, including multi-agent systems, reasoning frameworks, and dynamic tool-use capabilities (RAG, APIs) to automate complex business workflows and analytics.
Develop Agent Harnesses & Evaluation Pipelines - Build and maintain robust testing harnesses (Agent Harness), simulation environments, and CI/CD pipelines to rigorously evaluate agent performance, safety, reasoning logic, and tool-calling accuracy before production deployment.
Collaborate & Innovate - Work closely with cross-functional teams to identify opportunities, gather requirements, and transform business challenges into scalable, agentic AI solutions.
Build Robust Systems - Partner with data engineers and platform architects to implement high-performance, real-time GenAI applications. Ensure robust state management, secure memory handling, safety guardrails, and low-latency decisioning.
Explore & Evolve - Stay at the forefront of LLM advancements and agentic frameworks (e.g., LangChain, LlamaIndex, AutoGen, Semantic Kernel). Continuously research and implement new paradigms in AI reasoning, planning, and evaluation to refine the team's capabilities.
Communicate Insights - Present complex agent architectures and GenAI strategies to business stakeholders and executives, ensuring technical innovations translate into meaningful business outcomes.

Preferred Qualifications
Advanced Agentic Patterns: Familiarity with advanced reasoning and planning paradigms (e.g., ReAct, Chain-of-Thought, Tree-of-Thoughts) and experience in building evaluation frameworks/sandboxes for generative systems.
Insight: Ability to extract meaningful business insights from complex data interactions and identify the stories behind the patterns.
Creativity: A drive to engineer novel features, design innovative agent tools, and push beyond current off-the-shelf LLM approaches.
Bilingual: Excellent verbal and written communication skills, in both Mandarin Chinese and English.

Minimum Qualifications
AI & Agent Architecture: Deep understanding of Large Language Models (LLMs), prompt engineering, and hands-on experience building autonomous agents or multi-agent orchestration frameworks.
LLMOps & Agent Harness: Practical experience building agent evaluation harnesses, automated testing frameworks, and monitoring pipelines to track hallucination rates, safety metrics, and overall LLM reliability.
System Design: Proven experience in designing scalable software systems, integrating LLMs with external environments (APIs, databases, enterprise tools), and managing complex conversational state/memory.
Machine Learning: Understanding of common machine/deep learning algorithms and practical experience in one or more of the following areas: time series forecasting, anomaly detection, convex optimization, computer vision, NLP, LLM, recommendation system, and Auto ML.
Programming Language: Strong ability to implement AI pipelines and scalable applications in Python (essential), along with familiarity in Scala, Java, or C++.
Communication & Presentation: Superior verbal and written communication skills, with the ability to convey meticulous architectural concepts and AI considerations to non-experts.
Databases: Solid understanding of relational databases (SQL), vector databases for RAG applications, and large-scale distributed systems.
PhD in Computer Science, Artificial Intelligence, Machine Learning, or related field; or PhD in Math, Engineering, Economics, or hard science with AI/data science fellowship; or M.S. in a related field with strong industry experience applying LLMs and AI agent architectures to real business problems.

About Apple

Working at Apple means doing more than you ever thought possible and having more impact than you ever imagined.

Size: 10,000+ employees
Industry: Technology

View company profile