Skip to main contentA logo with &quat;the muse&quat; in dark blue text.

Research Engineer, Experimentation & Evaluation

AT TikTok
TikTok

Research Engineer, Experimentation & Evaluation

San Jose, CA

Responsibilities

Our mission in the experimentation and evaluation team is to build the next-gen A/B testing platform, that empowers the company to make data-driven decisions for the products. The supported scenarios include recommendations, push, ads, search, mobile app, UI interaction and service upgrades etc.
Our platform's capabilities cover the entire experiment life cycle, from experiment design, experiment creation, metrics calculation, and statistical analysis to final evaluation and launch. In the process of rapid iteration, we provide reliable services for businesses to make bold hypotheses and cautious verification.

Position Responsibilities
- Analytics: Work independently to define, design, prototype, and implement complex exploratory analysis, w.r.t both theoretical and business perspectives.

Want more jobs like this?

Get Science and Engineering jobs in San Jose, CA delivered to your inbox every week.

By signing up, you agree to our Terms of Service & Privacy Policy.

- Methodology development: Leverage deep statistical expertise to improve and/or create methodologies
- Teamwork: Participate actively and thoughtfully in multidisciplinary teams to implement algorithms in production
- Communication: Effectively communicate insights and recommendations to support decisions on future research directions
- Mentorship: Oversee the analyses of junior statisticians and data scientists, and support their professional development

Qualifications

Minimum Qualification
- M.S. or Ph.D. in Statistics, Econometrics, Operations Research, Mathematics, Computer Science, or other quantitative fields
- Passion for solving unstructured and non-standard mathematical problems
- Expertise in experimental design and/or Bayesian inference & optimization
- Fluency with SQL or similar
- Proficiency with Python, or other interpreted programming languages like R or Matlab

Preferred Qualification
- Experience with Bayesian experiment/optimization system design
- Experience with quasi-experimental causal inference (Rubin causal model/ structural causal model/ instrumental variables etc.)
- In-depth understanding and hands-on experience in wielding tools like graphs.
- Experience with applying modern machine learning techniques and/or collaborating with ML scientists
- Excellent written and oral communication skills, including an ability to translate statistical methods and findings for a non-technical audience
- Comfortable with massive paper searching, reading and composing.

Job Information

[For Pay Transparency] Compensation Description (annually)

The base salary range for this position in the selected city is $164160 - $416100 annually.

Compensation may vary outside of this range depending on a number of factors, including a candidate's qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.

Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).

The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

For Los Angeles County (unincorporated) Candidates:

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:

1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;

2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and

3. Exercising sound judgment.

Client-provided location(s): San Jose, CA, USA
Job ID: TikTok-7395331555982248218
Employment Type: Other

Perks and Benefits

  • Health and Wellness

    • Health Insurance
    • Dental Insurance
    • Vision Insurance
    • HSA
    • Life Insurance
    • Fitness Subsidies
    • Short-Term Disability
    • Long-Term Disability
    • On-Site Gym
    • Mental Health Benefits
    • Virtual Fitness Classes
  • Parental Benefits

    • Fertility Benefits
    • Adoption Assistance Program
    • Family Support Resources
  • Work Flexibility

    • Flexible Work Hours
    • Hybrid Work Opportunities
  • Office Life and Perks

    • Casual Dress
    • Snacks
    • Pet-friendly Office
    • Happy Hours
    • Some Meals Provided
    • Company Outings
    • On-Site Cafeteria
    • Holiday Events
  • Vacation and Time Off

    • Paid Vacation
    • Paid Holidays
    • Personal/Sick Days
    • Leave of Absence
  • Financial and Retirement

    • 401(K) With Company Matching
    • Performance Bonus
    • Company Equity
  • Professional Development

    • Promote From Within
    • Access to Online Courses
    • Leadership Training Program
    • Associate or Rotational Training Program
    • Mentor Program
  • Diversity and Inclusion

    • Diversity, Equity, and Inclusion Program
    • Employee Resource Groups (ERG)

Company Videos

Hear directly from employees about what it is like to work at TikTok.