As a research scientist in this role, your primary objective will be to develop creative solutions that optimize computational efficiency for training and on-device inference of foundational vision and language models for use cases in VR, AR and mobile devices. Models of interest range from foundational models like Segment Anything, Anything 3D, to multi-modal LLMs and diffusion models. Optimizations can range all the way from kernel level optimizations, efficient building blocks for models, improved model architectures and pre-training techniques. Strong expertise in building efficient models is preferred for this position.
Research Scientist, Optimization (PhD) Responsibilities:
- Develop model optimization algorithms and infrastructure to enable deployment of models in resource-constrained settings, such as mobile phones and AR/VR and MR devices.
- Optimize models on hardware to achieve the best performance given various real time latency and power constraints.
- Develop novel techniques to improve training efficiency and data efficiency.
- Lead and contribute to cutting-edge research that results in industry-leading tech demos and/or publications.
- Collaborate with cross-disciplinary research and engineering teams.
Want more jobs like this?
Get Science and Engineering jobs in Seattle, WA delivered to your inbox every week.
- Currently has, or is in the process of obtaining, a PhD degree in Machine Learning (ML) Systems, Natural Language Processing (NLP), Machine Learning, Artificial Intelligence, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta.
- Currently has, or is in the process of obtaining a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta.
- Hands-on experience in deep learning algorithms and techniques, e.g., transformers, convolutional neural networks, quantization and/or related areas.
- 3+ years experience with deep learning software libraries such as PyTorch or TensorFlow.
- Demonstrated software engineering experience within a complex codebase via an internship, work experience, coding competitions, or widely used contributions to open source repositories such as GitHub.
- Must obtain work authorization in country of employment at the time of hire, and maintain ongoing work authorization during employment.
- Contribution (as the first author) to publications on machine learning at leading workshops or conferences such as ICLR, NeurIPS, ACL, EMNLP, ICML, MLSys, KDD, OSDI etc.
- Experience, including PhD research, in related fields of improving the training and inference efficiency, data efficient learning, domain adaptation and semi-supervised learning.
- Experience, including PhD research, in kernel development for both GPU and mobile devices.
- Experience, including PhD research, in in related fields of efficient deep learning, training acceleration, quantization, model/accelerator co-design, and co-optimization.
- Interpersonal experience: cross-group and cross-culture collaboration
Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today-beyond the constraints of screens, the limits of distance, and even the rules of physics.
Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.
Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@fb.com.