2,129 jobs for "Product Validation Engineer"

Responsibilities

The Transparency & Observability Data Science team builds the data, metrics, and analytical capabilities that help us understand how our enforcement systems perform. Our work supports both internal decision-making and external transparency reporting, while improving the reliability, explainability, and quality of Trust & Safety data.

As a Lead Data Scientist on this team, you will be the technical architect for how Trust & Safety measures, monitors, and explains itself. You will design the systems and data foundations behind our metrics, observability, and transparency reporting, and serve as the AI and data architecture lead who drives AI readiness across Trust & Safety.

Responsibilities:
- Architect Transparency & Observability Systems:
- Establish the Transparency & Observability architecture for Trust & Safety, covering metrics, data pipelines, monitoring, and reporting.
- Design end-to-end observability for the enforcement lifecycle, from detection and review to actions and outcomes, so that every enforcement decision can be traced, measured, and explained.
- Set standards for metric definitions, anomaly detection, and alerting, and make sure Trust & Safety reports one consistent view of its enforcement.
- Build Governed, AI-Ready Data Foundations:
- Set up data quality, lineage, and governance practices (SLAs, validation, reconciliation, documentation) so that Trust & Safety data is accurate, timely, and audit-ready for regulatory reporting.
- Design and oversee ETL pipelines and workflow orchestration that turn scattered inputs into reliable, well-documented data products.
- Build data systems designed for agent consumption across Trust & Safety, covering canonical data models, semantic layers, intelligent workflows, and evals.
- Drive AI Readiness and Technical Leadership Across Trust & Safety:
- Partner with Product, Engineering, Policy, Operations, Legal, and Comms to find high-impact opportunities where AI and data can improve operational efficiency and safety outcomes, and take solutions from experimentation to reliable production.
- Own the long-term technical roadmap for Trust & Safety observability and AI readiness, and lead the program and change management needed to land it across teams.
- Create reusable architecture principles, reference architectures, and best practices for responsible, explainable AI adoption across Trust & Safety teams, and mentor data scientists and engineers in applying them.

Qualifications

Minimum Qualification(s):
- 5+ years of experience in Data Science, Data Engineering, Data Architecture, Analytics, or a related quantitative field, including technical leadership of cross-team initiatives.
- A track record of designing scalable data ecosystems: data modeling, governed analytics layers, and production pipelines on large-scale platforms (e.g. Hive, Spark).
- Strong SQL and Python skills.
- Experience building data quality, monitoring, or observability solutions, and designing metrics frameworks used across organizations.
- A solid understanding of AI architecture patterns (e.g. RAG, embeddings, knowledge systems) and responsible AI practices, applied to operational workflows.
- Ability to translate ambiguous business problems into technical strategy, and to influence both technical and non-technical stakeholders, including leadership.
- Bachelor's degree or above in a quantitative discipline such as Statistics, Computer Science, Mathematics, Engineering, or Economics.

Preferred Qualification(s):
- Experience in Trust & Safety, regulatory reporting, or compliance domains.
- Familiarity with transparency and regulatory requirements such as the EU Digital Services Act (DSA) and similar global frameworks.
- Experience driving program and change management across global, cross-functional teams.

Job Information

[For Pay Transparency] Compensation Description (annually)

The base salary range for this position in the selected city is $219000 - $353600 annually.

Compensation may vary outside of this range depending on a number of factors, including a candidate's qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.

Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).

The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

For Los Angeles County (unincorporated) Candidates:

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:

1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;

2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and

3. Exercising sound judgment.

Responsibilities

Qualifications

Qualifications

Minimum Qualification(s):
- 5+ years of experience in Data Science, Data Engineering, Data Architecture, Analytics, or a related quantitative field, including technical leadership of cross-team initiatives.
- A track record of designing scalable data ecosystems: data modeling, governed analytics layers, and production pipelines on large-scale platforms (e.g. Hive, Spark).
- Strong SQL and Python skills.
- Experience building data quality, monitoring, or observability solutions, and designing metrics frameworks used across organizations.
- A solid understanding of AI architecture patterns (e.g. RAG, embeddings, knowledge systems) and responsible AI practices, applied to operational workflows.
- Ability to translate ambiguous business problems into technical strategy, and to influence both technical and non-technical stakeholders, including leadership.
- Bachelor's degree or above in a quantitative discipline such as Statistics, Computer Science, Mathematics, Engineering, or Economics.

Preferred Qualification(s):
- Experience in Trust & Safety, regulatory reporting, or compliance domains.
- Familiarity with transparency and regulatory requirements such as the EU Digital Services Act (DSA) and similar global frameworks.
- Experience driving program and change management across global, cross-functional teams.

About TikTok

TikTok is the leading destination for short-form mobile video and our mission is to inspire creativity and bring joy.

Size: 5,001 - 10,000 employees
Industry: Entertainment & Gaming

View company profile