Critical Harms Intelligence Analyst (Threats of Violent Extremism, Dangerous Orgs)
Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators.
At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there.
A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone.
Want more jobs like this?
Get jobs in San Mateo, CA delivered to your inbox every week.
The Safety Operations team is focused (okay, maybe obsessed) on scaling Roblox’s Moderation Operations and redefining our user experience through our multi-year vision and strategy execution. We’re seeking a passionate Threats of Violent Extremism (TVE) subject matter expert dedicated to finding malicious actors and supporting the development of scalable solutions to mitigate their activities. You’ll join our Critical Harms Intelligence, Investigations, and Operations (CHIIOPS) team, applying expertise to high-risk behaviors and collaborating with Safety Product and Engineering teams to improve detection and enforcement. CHIIOPS Intelligence Analysts are responsible for uncovering “unknown unknowns” of how malicious actors bypass existing systems, educate cross-functional partners on these patterns, and support proactive lead identification for automated detection system development.
Please note: This role may review graphic, controversial, and sometimes offensive content in line with Roblox’s handling policies. This role will also require some on-call support.
You will report to the Critical Harms Intelligence, Investigations, and Operations Manager.
You Will:
- Conduct in-depth analysis of platform content to identify violative or evasive behaviors employed by TVE actors, encompassing a wide range of user-generated content types.
- Utilize both internal and open-source data to identify risk leads and gather relevant content samples for specialized moderator review, supporting analytic hypothesis testing and Machine Learning (ML) detection development.
- Deliver analytic risk assessments to cross-functional partners, highlighting gaps in current detection and enforcement processes, and collaborate with these partners to identify effective risk mitigation strategies.
- Develop comprehensive expertise in Roblox's internal and external safety policies and tools, leveraging data to drive improvements in the company's overall escalation ecosystem.
You Have
- Demonstrated subject-matter expertise in the online expression of Terrorism/Extremist behavior, with a minimum of 4 years of direct experience addressing such behavior in a user-generated content environment.
- Experience combining internal data analysis and subject-matter research to identify behavioral trends and risks and relevant content samples.
- Experience in developing strategic project plans, roadmaps for tracking progress, and defining success and impact measures.
- Experience supporting scaled solutions for platform risks.
- Competence in data analysis and basic querying, including foundational Python or SQL knowledge.
For roles that are based at our headquarters in San Mateo, CA: The starting base pay for this position is as shown below. The actual base pay is dependent upon a variety of job-related factors such as professional background, training, work experience, location, business needs and market demand. Therefore, in some circumstances, the actual salary could fall outside of this expected range. This pay range is subject to change and may be modified in the future. All full-time employees are also eligible for equity compensation and for benefits as described on this page.
Roles that are based in an office are onsite Tuesday, Wednesday, and Thursday, with optional presence on Monday and Friday (unless otherwise noted).
Roblox provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. Roblox also provides reasonable accommodations for all candidates during the interview process.
Perks and Benefits
Health and Wellness
Parental Benefits
Work Flexibility
Office Life and Perks
Vacation and Time Off
Financial and Retirement
Professional Development
Diversity and Inclusion