Sr. Manager, Experimentation Science

Warner Bros. Discovery's DTC technology and product organization sits at the intersection of tech, entertainment, and everyday utility. We are continuously leveraging new technology to build immersive and interactive viewing experiences. Our platform covers everything from search, content catalog, and video transcoding, to personalization, global subscriptions, and more. We are committed to delivering quality user experiences, ranging from video streaming to applications across connected TV, mobile, web and consoles. As a pure tech organization, we are essential to WBD's continued growth, building world-class products from the ground-up for our iconic brands like HBO Max, Discovery Channel, CNN, Food Network, HGTV, Eurosport, MotorTrend, and many more.

About You:

We are looking for a Sr. Manager, Experimentation Science to drive all our in-app and signup experiences with hypothesis-based experimentation and data-driven decision making. We want someone who comes from a culture of experimentation with a strong background in statistics and data science. As a leader directing this area, you will lead a team of Data Scientists dedicated to different customer surfaces within Max and Discovery Plus. You will manage internal client stakeholders and help drive innovation in the way we experiment and what we experiment on. You are well-versed in experimental design and AB testing, critical thinking, exploratory data analysis and science, and Bayesian approaches to causal inference. You are as comfortable with technical depth in this area as you are with the industry trends to ensure that our decisions are data-driven, and sound from both statistical and business perspectives. You can communicate results and proposed changes to partners/stakeholders across product, UX design, and technology areas (data, machine learning, data science, and analytics).

Responsibilities:

• Lead a team of data scientists and analysts under our Experimentation organization to build, test, and analyze all experiments with the objective of increasing user engagement, retention and customer signup.
• Work in close collaboration with data engineers, machine learning scientists/engineers and product managers who lead search, personalization and content flow on the app
• Leverage our institutional knowledge and user data to find new ideas and insights for a better search and personalization experience
• Partner with product managers to build metrics that help the business understand user satisfaction and engagement
• Partner with machine learning scientists/engineers to analyze feature and model performance (correlation analysis, bias check, fairness analysis etc) towards content discovery business goals
• Partner with the experimentation platform team to innovate (user segmentation and targeting for experiments) and automate the repetitive aspects of experimental design (power analysis, fast bootstrapping for large data sets, reducing test variance, etc)
• Conduct post-experimental analysis and deep dives to derive insights that inform our models/algorithms for iterative improvement of our product
• Build reporting tools/dashboards as well as experimentation and analytics solutions using enterprise infrastructure that allow us and our stakeholders to monitor the health of our search and personalization efforts
• Communicate experimental findings with the wider organization and translate them into actionable decisions
• Motivate, inspire and create a culture of experimentation and data-driven innovation

Requirements:

• 10+ years of experience within Data Science, Applied Science, Machine Learning, etc., ideally in the recommendations/personalization domain
• 2+ years experience leading and managing a team of data scientists/analysts, with a solid understanding of machine learning
• M.S. or Ph.D. in an applied quantitative discipline (e.g. Statistics, Data Science, Economics, Applied Math/Physics) is preferred
• Strong background in statistics, experimentation, data visualization with hands-on expertise in SQL, Python, R, or other similar language
• Excellent communication and collaborative skills
• Prior experience partnering with engineers, product managers and technical program managers
• Prior experience working with digital commerce, digital advertising and video streaming is a huge plus

How We Get Things Done...

This last bit is probably the most important! Here at WBD, our guiding principles are the core values by which we operate and are central to how we get things done. You can find them at www.wbd.com/guiding-principles/ along with some insights from the team on what they mean and how they show up in their day to day. We hope they resonate with you and look forward to discussing them during your interview.

The Legal Bits...
In compliance with local law, we are disclosing the compensation, or a range thereof, for roles in locations where legally required. Actual salaries will vary based on several factors, including but not limited to external market data, internal equity, location, skill set, experience, and/or performance. Base pay is just one component of Warner Bros. Discovery's total compensation package for employees. Pay Range: $175,700.00 - $326,300.00 salary per year. Other rewards may include annual bonuses, short- and long-term incentives, and program-specific awards. In addition, Warner Bros. Discovery provides a variety of benefits to employees, including health insurance coverage, an employee wellness program, life and disability insurance, a retirement savings plan, paid holidays and sick time and vacation.

Warner Bros. Discovery embraces the opportunity to build a workforce that reflects the diversity of our society and the world around us. Being an equal opportunity employer means that we take seriously our responsibility to consider qualified candidates on the basis of merit, without regard to race, color, religion, national origin, gender, sexual orientation, gender identity or expression, age, mental or physical disability, and genetic information, marital status, citizenship status, military status, protected veteran status or any other category protected by law.

If you're a qualified candidate and you require adjustments or accommodations to search for a job opening or apply for a position, please contact us at recruitadmin@wbd.com.