Global Lead, AI Content Red Team - Trust and Safety

Responsibilities

The Trust & Safety (T&S) GenAI & Emerging Product team's mission is to empower the development of GenAI models and applications. We do this by building a world-class safety, testing, and risk management system that ensures GenAI innovations are launched responsibly.

The AI Content Red Team sits within the T&S GenAI and Emerging Products pillar. The team is responsible for conducting unstructured adversarial testing of generative AI products and models to uncover emerging risks, alongside our structured evaluations.

This team combines attacker-minded testing, risk discovery, and clear operational feedback loops to inform product decisions, policy development, mitigations, and longer-term evaluation strategy. We probe models and product experiences across modalities, use cases, and abuse patterns to identify failure modes, stress-test safeguards, and help teams improve safety before and after launch.

We work closely with Trust & Safety teams (policy, product, engineering, data science, operations), and business teams across global markets. Success in this team requires strong judgment, creativity, analytical rigor, and the ability to translate ambiguous findings into actionable recommendations.

Responsibilities:
- Lead the global AI Content Red Team, including team strategy, hiring, people management, and capability building.
- Design and oversee end-to-end adversarial testing programs for GenAI products.
- Establish testing methodologies to simulate adversarial behaviors, edge cases, and real-world abuse scenarios.
- Drive discovery of emerging content risks, abuse patterns, and safety strategy failure modes across text, image, video, audio, agentic modalities.
- Develop mechanisms to track themes, trends, and escalate high-severity findings that may impact user safety, compliance, or brand risk. Ensure testing outputs are actionable and well-documented.
- Partner with Product, Policy, and business teams to ensure red-teaming insights directly inform product design, safety mitigations, and policy frameworks.
- Represent team in cross-functional forums, and serve as a key risk voice in product readiness discussions.

Qualifications

Minimum Qualifications:
- Minimum 5 years in Trust & Safety, cybersecurity, risk/adversarial testing, or related fields.
- Minimum 5 years in a lead role (team lead, program lead, or equivalent).
- Direct experience in adversarial testing / red-teaming / vulnerability discovery, particularly of Generative AI.
- Strong understanding of LLM behavior, model failure modes, and safety risks.
- Experience building or scaling safety, QA, or risk-focused teams.
- Strong ability to influence product and launch decisions.
- Proven cross-functional leadership with Product, Engineering, Policy, Risk, and business teams.

Preferred Qualifications:
- Experience working with agentic AI tools to scale your impact, including building/operating AI tools to make processes efficient and effective.

Job Information

[For Pay Transparency] Compensation Description (annually)

The base salary range for this position in the selected city is $159000 - $384000 annually.

Compensation may vary outside of this range depending on a number of factors, including a candidate's qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.

Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).

The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

For Los Angeles County (unincorporated) Candidates:

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:

1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;

2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and

3. Exercising sound judgment.