Product Manager, LLM Data Acquisition and Production

Join us.

About The Team:
LLM Global Data is a team focused on producing international data for LLMs. For the training of large models, data is the lifeline of model quality - and the Global Data team is working closely with technical, product, and operations teams to ensure effective data production strategies and execution management. There's a lot to do, and there's substantial room for impact, similar to TikTok 5 years ago.

The primary job responsibilities include:
1. Collaborate with technical teams to precisely define the data requirements necessary for aligning Large Language Models (LLMs) across global markets.
2. Develop methodologies for data acquisition and production, while also monitoring costs and assessing the effectiveness and efficiency of these processes. Ensure data quality is maintained at high standards and continually enhance processes based on both quantitative and qualitative feedback.
3. Evaluate the impact of data production tools on the effectiveness and quality of data production. Work closely with technical teams to enhance both the quality and effectiveness of these tools.
4. Proactively identify and mitigate potential biases and vulnerabilities in the data production process. This includes, but is not limited to, addressing human and system biases through the implementation of technical, product, and operational solutions.

Qualifications

1. Solid understanding of alignment and related approaches, such as Supervised Fine-Tuning (SFT), Reinforcement Learning from Human Feedback (RLHF), and others. Or solid experience in moderation, labeling, search quality, or data synthesis.
2. Minimum of three years of experience as a product manager or product strategist, including process design experience.
3. A strong interest in both LLMs and human behavior/experience/wellbeing. Must be an enthusiastic learner. This position is not suitable for individuals who find reading papers and books to be tedious.
4. Collaborative team player who knows how to assertively advocate for their ideas without being overbearing. Skilled in maintaining attention to detail while staying focused on prioritized goals and the bigger picture.
---
TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
---
TikTok is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://shorturl.at/cdpT2
---

#LI-Hybrid"

Job Information

[For Pay Transparency] Compensation Description (annually)

The base salary range for this position in the selected city is $199500 - $393300 annually.

Compensation may vary outside of this range depending on a number of factors, including a candidate's qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.

Our company benefits are designed to convey company culture and values, to create an efficient and inspiring work environment, and to support our employees to give their best in both work and life. We offer the following benefits to eligible employees:

We cover 100% premium coverage for employee medical insurance, approximately 75% premium coverage for dependents and offer a Health Savings Account(HSA) with a company match. As well as Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life and AD&D insurance plans. In addition to Flexible Spending Account(FSA) Options like Health Care, Limited Purpose and Dependent Care.

Our time off and leave plans are: 10 paid holidays per year plus 17 days of Paid Personal Time Off (PPTO) (prorated upon hire and increased by tenure) and 10 paid sick days per year as well as 12 weeks of paid Parental leave and 8 weeks of paid Supplemental Disability.

We also provide generous benefits like mental and emotional health benefits through our EAP and Lyra. A 401K company match, gym and cellphone service reimbursements. The Company reserves the right to modify or change these benefits programs at any time, with or without notice.