Skip to main contentA logo with &quat;the muse&quat; in dark blue text.

Product Operations Manager - LLM

AT TikTok
TikTok

Product Operations Manager - LLM

San Jose, CA

Responsibilities

About the team
TikTok Content Ecosystem team's goal is to ensure that TikTok is safe and welcoming for everyone, including minors. This encourages creators to create good content, and improves user satisfaction in the long run. We also work with the recommendation and personalization team to tailor the feed to everyone's interests, with a goal to make our users happier. This goes towards TikTok's mission of inspiring creativity and bringing joy. We're looking for seasoned Product Managers and leads, who can understand the quality issues in various markets, understand external factors including government regulations, and deliver on improving quality for TikTok feed.

Responsibilities
- Own the product operation of TikTok Content Ecosystem's large model data pipeline, including pipeline architecture, data collection, quality assurance, and policy alignment.

Want more jobs like this?

Get jobs in San Jose, CA delivered to your inbox every week.

By signing up, you agree to our Terms of Service & Privacy Policy.

- Design and implement workflows that enable LLMs to ingest, learn, and apply content moderation rules, continuously iterating to improve accuracy and coverage across multiple languages and content categories.
- Collaborate with recommendation algorithm, Trust & Safety, Policy, and R&D teams to ensure model outputs meet content governance standards and production-level requirements.

Qualifications

Minimum Qualifications
- Bachelor's degree or above with 1 year or more of product management work experience in recommendation system/ LLM related fields.
-In - depth knowledge of popular LLMs. Understand how to interact with LLMs through APIs, fine - tune them for specific tasks, and optimize their performance.
- Strong analytical and critical-thinking abilities to identify complex problems in model sample production and operation, and develop effective solutions.
- Strong collaboration skills to work closely with different teams, share ideas, and achieve common goals related to model sample production and operation.

Preferred Qualifications
- Familiarity with LLM
- Knowledge of trust and safety or content governance.

Job Information

[For Pay Transparency] Compensation Description (annually)

The base salary range for this position in the selected city is $88000 - $202667 annually.

Compensation may vary outside of this range depending on a number of factors, including a candidate's qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.

Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).

The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

For Los Angeles County (unincorporated) Candidates:

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:

1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;

2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and

3. Exercising sound judgment.

Client-provided location(s): San Jose, CA, USA
Job ID: TikTok-7521589686948432135
Employment Type: Other

Perks and Benefits

  • Health and Wellness

    • Health Insurance
    • Dental Insurance
    • Vision Insurance
    • HSA
    • Life Insurance
    • Fitness Subsidies
    • Short-Term Disability
    • Long-Term Disability
    • On-Site Gym
    • Mental Health Benefits
    • Virtual Fitness Classes
  • Parental Benefits

    • Fertility Benefits
    • Adoption Assistance Program
    • Family Support Resources
  • Work Flexibility

    • Flexible Work Hours
    • Hybrid Work Opportunities
  • Office Life and Perks

    • Casual Dress
    • Snacks
    • Pet-friendly Office
    • Happy Hours
    • Some Meals Provided
    • Company Outings
    • On-Site Cafeteria
    • Holiday Events
  • Vacation and Time Off

    • Paid Vacation
    • Paid Holidays
    • Personal/Sick Days
    • Leave of Absence
  • Financial and Retirement

    • 401(K) With Company Matching
    • Performance Bonus
    • Company Equity
  • Professional Development

    • Promote From Within
    • Access to Online Courses
    • Leadership Training Program
    • Associate or Rotational Training Program
    • Mentor Program
  • Diversity and Inclusion

    • Diversity, Equity, and Inclusion Program
    • Employee Resource Groups (ERG)

Company Videos

Hear directly from employees about what it is like to work at TikTok.