Skip to main contentA logo with &quat;the muse&quat; in dark blue text.
Meta

Research Scientist, Generative AI - Speech & Audio

New York, NY

The Generatlve AI Org at Meta builds industry leading LLM Foundation models to enable many Meta products and open source. As an Applied Research Scientist in Generative AI, you have the opportunity to help push state of the art research, build industry leading foundation models, and bring them to products to impact billions of users.GenAI Audio 's mission is to build industry leading Speech & Audio foundation models, to enable Meta products. Our current focus is on controllable generative speech synthesis, to give our AI agents human-like voices.The current status:We have built a Speech foundation model that is capable of generating high quality voice given 10 - 20 seconds of target speaker voice, and can support deep cloning with 30 - 60 minutes voices.

Want more jobs like this?

Get Data and Analytics jobs in New York, NY delivered to your inbox every week.

By signing up, you agree to our Terms of Service & Privacy Policy.


Research Scientist, Generative AI - Speech & Audio Responsibilities:
  • Independently design and implement algorithms, train state of the art speech recognition models on large data, and evaluate their performance.
  • Perform research to tackle unsolved real-world problems and push state of the art speech recognition.
  • Develop machine learning models for both server-based and embedded systems.
  • Contribute research that can be applied to Meta product development.
Minimum Qualifications:
  • Has PhD in the field of Artificial Intelligence, a related field, or equivalent practical experience. Degree must be completed prior to joining Meta.
  • Research experience in one or more of these areas: speech recognition, speech processing, machine learning, deep learning, or related fields.
  • Experience with development and implementation of speech recognition algorithm/systems and model training.
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
  • Knowledge of deep learning and neural networks.
  • Experience working with machine learning libraries like Pytorch, Tensorflow, etc.
  • Familiar with scripting languages such as Python and shell scripts.
  • Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment.
Preferred Qualifications:
  • Experience with developing scalable machine learning models in at least one of the following areas: automatic speech recognition, speech synthesis, LLM, or relevant areas.
  • Experience with large scale model training, implementing algorithms, and evaluating Speech systems.
  • Proven track record of achieving significant results as demonstrated by publications at leading workshops, journals or conferences such as ICASSP, INTERSPEECH, or similar.
  • Experience taking ideas from research to production.
  • Experience solving complex problems and comparing alternative solutions, tradeoffs, and diverse points of view to determine a path forward.
  • Experience working and communicating cross functionally in a team environment.
About Meta:

Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today-beyond the constraints of screens, the limits of distance, and even the rules of physics.

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@fb.com.

Client-provided location(s): New York, NY, USA
Job ID: a1K2K00000903vQUAQ_1003
Employment Type: Other

Perks and Benefits

  • Health and Wellness

    • Health Insurance
    • Health Reimbursement Account
    • Dental Insurance
    • Vision Insurance
    • Life Insurance
    • Short-Term Disability
    • Long-Term Disability
    • FSA
    • FSA With Employer Contribution
    • HSA
    • HSA With Employer Contribution
    • Fitness Subsidies
    • On-Site Gym
    • Mental Health Benefits
  • Parental Benefits

    • Birth Parent or Maternity Leave
    • Non-Birth Parent or Paternity Leave
    • Fertility Benefits
    • Adoption Assistance Program
    • Family Support Resources
  • Work Flexibility

    • Flexible Work Hours
    • Remote Work Opportunities
    • Hybrid Work Opportunities
  • Office Life and Perks

    • Commuter Benefits Program
    • Casual Dress
    • Happy Hours
    • Snacks
    • Some Meals Provided
    • Company Outings
    • On-Site Cafeteria
    • Holiday Events
  • Vacation and Time Off

    • Paid Vacation
    • Unlimited Paid Time Off
    • Paid Holidays
    • Personal/Sick Days
    • Sabbatical
    • Leave of Absence
  • Financial and Retirement

    • 401(K)
    • 401(K) With Company Matching
    • Pension
    • Company Equity
    • Performance Bonus
    • Relocation Assistance
    • Financial Counseling
  • Professional Development

    • Learning and Development Stipend
    • Promote From Within
    • Mentor Program
    • Shadowing Opportunities
    • Access to Online Courses
    • Lunch and Learns
    • Internship Program
  • Diversity and Inclusion

    • Diversity, Equity, and Inclusion Program
    • Employee Resource Groups (ERG)
    • Founder led

Company Videos

Hear directly from employees about what it is like to work at Meta.