43 jobs for "Machine Learning Evaluation Engineer"

Senior Software Development Engineer, Agentic Memory & Evals Team

At Zillow - Remote / Flexible

Posted on Nov 5

View job Apply on company site

Sr Machine Learning Engineer - Consumer Incentives

At Uber - San Francisco · New York

Posted on Nov 5

View job Apply on company site

Machine Learning Scientist II - Content Intelligence

At Booking.com - Tel Aviv

Posted on Nov 4

View job Apply on company site

Principal Engineer, UAIS

At Uber - San Francisco · Sunnyvale

Posted on Nov 3

View job Apply on company site

Lead Software Engineer

At JPMorgan Chase - Jersey City · Palo Alto

Posted on Nov 6

View job Apply on company site

Research Engineer, Agentic Video Editing - TikTok

At TikTok - San Jose

Posted on Nov 6

View job Apply on company site

Data Scientist - Retail Banking (ML & Predictive Modeling)

At PNC - Pittsburgh

Posted on Nov 8

View job Apply on company site

Senior Data Engineer

At General Motors - Austin

Posted on Nov 6

View job Apply on company site

Applied Researcher 5 (AI Foundations: Evaluation and Agentic Workflows)

At Capital One - McLean · Cambridge

Posted on Nov 8

View job Apply on company site

Applied AI ML Lead-AI Engineer

At JPMorgan Chase - Bengaluru

Posted on Nov 2

View job Apply on company site

Applied Researcher 5

At Capital One - San Jose · San Francisco

Posted on Nov 6

View job Apply on company site

Applied Researcher 4

At Capital One - San Jose · San Francisco

Posted on Nov 6

View job Apply on company site

Senior MLOps Engineer

At Fisher Investments - Tampa

Posted on Nov 7

View job Apply on company site

Senior Machine Learning Engineer (Casualty / Claims Intelligence)

At CCC Intelligent Solutions - Remote / Flexible

Posted on Nov 2

View job Apply on company site

Senior Data Scientist

At Aristocrat

Posted on Nov 6

View job Apply on company site

ML Engineer

At Aristocrat

Posted on Nov 3

View job Apply on company site

Sr. Simulation & Synthetic Data Engineer - Remote

At Intuitive - Sunnyvale

Posted on Nov 4

View job Apply on company site

Software Engineer II, Attack Detection

At Abnormal Security - Remote / Flexible

Posted on Nov 6

View job Apply on company site

Applied Researcher 4 (AI Safety & Multimodal)

At Capital One - New York · McLean

Posted on Nov 6

View job Apply on company site

Applied Researcher 5 (AI Foundations)

At Capital One - New York · McLean

Posted on Nov 5

View job Apply on company site

TikTok

Research Engineer, Agentic Video Editing - TikTok

San Jose$162,000 – $387,600Posted 2 days ago

Apply on company site View full job

Responsibilities

We are building the next generation of AI-native creation tools powered by intelligent AI agents. Our mission is to transform how people create by embedding agentic AI directly into creative workflows-from AI-powered camera effect generation to AI-driven video editing and storytelling.

Our team operates at the intersection of AI research, systems engineering, and creative product development, translating advances in agentic AI into scalable, real-world creation tools used by millions of creators. We work closely with product and design partners to ensure that sophisticated AI systems result in simple, powerful, and intuitive creative experiences.

Responsibilities
- Build end-to-end agentic video editing systems, working across the agent harness, backend services, and evaluation pipelines. Own scoped features and improvements from prototyping through production.
- Develop and improve the agent harness, including planning, tool use, context management, and error recovery for multimodal editing workflows.
- Build reliable backend services for agent execution, session management, and media processing, and improve system latency, cost, and reliability.
- Develop evaluation and feedback loops, including LLM judges, benchmarks, and human review workflows, to measure editing quality, diagnose failures, and catch regressions.
- Propose new ideas and adapt advances from research and industry into practical experiments, using evaluation results and user feedback to continuously improve agent capabilities and video quality.
- Collaborate with research, engineering, and product partners to turn successful experiments into useful editing experiences for creators.

Qualifications

Minimum Qualifications
- Bachelor's or Master's degree in Computer Science, AI, or a related field, or equivalent practical experience.
- Strong programming skills in Python and solid software engineering fundamentals.
- Foundational knowledge of machine learning and large language models.
- Hands-on experience building an LLM application, AI Agent, or multimodal AI project through coursework, research, internships, or personal projects.
- Ability to design experiments, analyze failures, and turn findings into working improvements.
- Interest in video creation and building useful tools for creators.

Preferred Qualifications
- Experience with tool-use agents, context management, or debugging and improving multi-step agent workflows.
- Familiarity with video understanding, audio and visual processing.
- Experience with evaluation datasets, human annotation, or model-based evaluation.
- Familiarity with video editing tools or media processing libraries such as FFmpeg.
- Relevant research, open-source contributions, or projects that demonstrate the ability to build and evaluate AI systems.

Job Information

[For Pay Transparency] Compensation Description (annually)

The base salary range for this position in the selected city is $162000 - $387600 annually.

Compensation may vary outside of this range depending on a number of factors, including a candidate's qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.

Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).

The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

For Los Angeles County (unincorporated) Candidates:

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:

1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;

2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and

3. Exercising sound judgment.

Responsibilities

Qualifications

Qualifications

Minimum Qualifications
- Bachelor's or Master's degree in Computer Science, AI, or a related field, or equivalent practical experience.
- Strong programming skills in Python and solid software engineering fundamentals.
- Foundational knowledge of machine learning and large language models.
- Hands-on experience building an LLM application, AI Agent, or multimodal AI project through coursework, research, internships, or personal projects.
- Ability to design experiments, analyze failures, and turn findings into working improvements.
- Interest in video creation and building useful tools for creators.

Preferred Qualifications
- Experience with tool-use agents, context management, or debugging and improving multi-step agent workflows.
- Familiarity with video understanding, audio and visual processing.
- Experience with evaluation datasets, human annotation, or model-based evaluation.
- Familiarity with video editing tools or media processing libraries such as FFmpeg.
- Relevant research, open-source contributions, or projects that demonstrate the ability to build and evaluate AI systems.

About TikTok

TikTok is the leading destination for short-form mobile video and our mission is to inspire creativity and bring joy.

Size: 5,001 - 10,000 employees
Industry: Entertainment & Gaming

View company profile