This team works at the center of some of the most exciting and innovative parts of AI. This is an opportunity to ensure Meta continues to scale and optimize next generation ML models and training clusters by working across multiple products groups, next generation model architectures, scale up AI training, and hardware accelerators (GPUs).
Engineering Manager, Software Engineering, PyTorch Training Acceleration Responsibilities:
- Develop the foundational technology to unlock new model development paradigms and bring the state of the art algorithms and infra to PyTorch.
- Develop systems and techniques to leverage Accelerators like NVIDIA and AMD GPUs to scale and optimize AI Training
- Explore and adapt PyTorch technologies to the right problems that Meta Product Groups are facing. Along the way, optimize, improve, and work closely with other PyTorch teams to push forward in directions that maintain PyTorch as an industry leading ML framework that users love.
- Manage engineers and help them develop their careers, assigning them to projects tailored to their skill levels, long-term skill development, personalities, and work styles.
- Communicate and collaborate effectively with cross-functional hardware and software engineering teams.
- Operate strategically and tactically. Develop the vision and strategy to help set direction for the team.
- Work closely with dedicated recruiting staff to expand the team, including sourcing candidates, interviewing candidates, participating in conferences/events, and onboarding new employees.
Want more jobs like this?
Get Software Engineering jobs in Menlo Park, CA delivered to your inbox every week.
- At least 8 years of experience in managing a software team in a fast-paced environment, including managing managers.
- Worked on Large scale distributed training, Fully Sharded Data Parallel, Parallelism Mechanisms (Tensor Parallelism, Pipeline Parallelism, Expert parallelism)
- Understand and analyze the interplay of hardware and software architectures on future algorithms, programming models and applications.
- Demonstrated experience recruiting, building, structuring, leading technical organizations, including performance management.
- Managed an org that has done Accelerator (GPU/ASIC) kernel development and optimization.
- Managed org that has experience in accelerating libraries on AI hardware, similar to cuBLAS, cuDNN, CUTLASS, HIP, ROCm etc.
- Experience working closely with hardware architectures such as Intel SIMD, GPU, RISC-V, AI Accelerators etc.
- Knowledge of ML frameworks like PyTorch, TensorFlow, ONNX, MXNet, etc.
Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today-beyond the constraints of screens, the limits of distance, and even the rules of physics.
Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.
Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@fb.com.
$213,000/year to $293,000/year + bonus + equity + benefits
Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.