AIGT Agent Operations Specialist, Model Data Operations, Platform Responsibility
Responsibilities
About the Team
The Platform Responsibility team is bringing disruptive innovation to content safety through the deep application of AI. We are building next-generation infrastructure that leverages advanced LLMs to reshape risk detection and governance. By engineering high-quality data pipelines and integrating AI into core decision-making, we drive exponential efficiency gains and precision. Working at the intersection of scalable engineering and technology, we empower global business growth while serving as the foundation of user trust.
About the Role
Under the spirit of TikTok Community Guidelines, the team leverages the capabilities of LLM and prompt engineering to deliver a large model Agent that can represent "absolute correctness", providing stable evaluation capabilities for TikTok content safety. This role will lead the team to refine strategy operations and prompt optimization to enhance the Agent's precise recall ability for risky content.
Want more jobs like this?
Get jobs in Singapore delivered to your inbox every week.
Responsibilities:
Prompt Engineering and Prompt Tuning
- Refined Prompting: Responsible for writing and debugging Prompts for specific risk scenarios. Maintain the Prompt version library to ensure the most appropriate instruction combinations are used for different scenarios.
- Few-shot Sample Library Management: Filter and maintain high-quality Few-shot samples (Examples). Ensure that the samples cover the latest underground industry variants and edge cases.
Badcase Attribution and Closed Loop Iteration
- Root Cause Analysis: Conduct in-depth analysis of cases that slipped through online (False Negative) or were wrongly removed (False Positive). Determine whether it is due to ambiguous Prompt instructions, outdated samples, or ambiguity in the Policy itself.
- In response to sudden public opinion events or new types of underground industry attacks, quickly adjust the Prompt strategy for interception, and convert the temporary strategy into long-term capabilities during the post-event review.
Knowledge Base and Evaluation Operations
- Knowledge Base Maintenance: For political and current affairs, and person-related risks, maintain the external Knowledge Base (Knowledge Base) of the RAG system to ensure that the Agent can identify the latest sensitive vocabulary.
- Daily Monitoring: Monitor and evaluate metrics daily, and output daily/weekly operation reports. When abnormal fluctuations in metrics are detected, issue timely warnings and troubleshoot the causes.
Qualifications
Minimum Qualifications:
- Bachelor's degree or above with 3+ years of experience in content risk control, strategy operation, Search Suggestion strategy, or AI Product Operation. Deep understanding of content safety business.
- Has a deep understanding of LLM principles and practical experience in Prompt Engineering. Demonstrated experience in significantly improving model performance by adjusting Context, Persona, and Examples.
- Has excellent Data Analysis skills, capable of quickly identifying strategic issues through data fluctuations.
Preferred Qualifications
- Self-motivated and results-driven, able to influence stakeholders in fast-paced, ambiguous environments.
Perks and Benefits
Health and Wellness
- Health Insurance
- Dental Insurance
- Vision Insurance
- HSA
- Life Insurance
- Fitness Subsidies
- Short-Term Disability
- Long-Term Disability
- On-Site Gym
- Mental Health Benefits
- Virtual Fitness Classes
Parental Benefits
- Fertility Benefits
- Adoption Assistance Program
- Family Support Resources
Work Flexibility
- Flexible Work Hours
- Hybrid Work Opportunities
Office Life and Perks
- Casual Dress
- Snacks
- Pet-friendly Office
- Happy Hours
- Some Meals Provided
- Company Outings
- On-Site Cafeteria
- Holiday Events
Vacation and Time Off
- Paid Vacation
- Paid Holidays
- Personal/Sick Days
- Leave of Absence
Financial and Retirement
- 401(K) With Company Matching
- Performance Bonus
- Company Equity
Professional Development
- Promote From Within
- Access to Online Courses
- Leadership Training Program
- Associate or Rotational Training Program
- Mentor Program
Diversity and Inclusion
- Diversity, Equity, and Inclusion Program
- Employee Resource Groups (ERG)
Company Videos
Hear directly from employees about what it is like to work at TikTok.