Production Systems Engineer, Sustaining
This job is no longer available.
Meta is seeking an experienced Production Systems Engineer to join our Release to Production (RTP) team. Our servers and data centers are the foundation upon which our rapidly scaling infrastructure operates efficiently to deliver our innovative services. The RTP team is responsible for the Hardware Lifecycle of all Meta servers including pre-production hands-on system and hardware debugging and stress testing, enabling production-ready system monitoring, automated provisioning and automated remediation of issues. RTP Engineers work closely with hardware designers, system manufacturers, component vendors, capacity engineering, production engineering, Facebook services, and data center operations teams to test systems before release to our production data centers, and to track the health and life cycle of servers in production.
Production Systems Engineer, Sustaining Responsibilities:
- Develop robust, industry leading practices for supporting AI and HPC infrastructure at scale
- Interface with external vendors and internal hardware, mechanical, power, thermal, manufacturing and software engineers to understand system architecture to develop and execute the test suites for various architectures
- Proactively create experiments and tooling to detect and diagnose hardware/firmware/software health issues
- Implement sustaining workflows across hardware and software stacks, develop and communicate sustaining practices internally
- Troubleshoot, diagnose and root cause of system failures and isolate components and failure scenarios while working with .internal and external stakeholders
- Drive necessary discussions with external and internal teams on test specification and methodologies to improve test quality on an ongoing basis
- Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
- 6+ years of experience in hardware systems technologies or supporting production hardware at scale
- Experience in deploying and productionizing AI/HPC systems and/or related components at scale
- Experience in software and hardware co-design for hyperscale systems
- Experience in object oriented programming (e.g., Python, C/C++)
- Experience in different server and network datacenter systems
- 8+ years of experience in providing production support for large-scale systems
- 8+ years of experience in working with AI/HPC systems, including hardware and software components, co-design
- Experience in developing or debugging AI/HPC systems, performance optimizations, including familiarity with relevant tools, libraries, and frameworks (e.g., NCCL, PyTorch, CUDA)
- Knowledge of AI/HPC hardware requirements and specifications (e.g., configuring hardware components, GPU, memory, network for AI/HPC workloads)
Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today-beyond the constraints of screens, the limits of distance, and even the rules of physics.
Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.
Want more jobs like this?
Get jobs in Menlo Park, CA delivered to your inbox every week.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@fb.com.
$132,000/year to $191,000/year + bonus + equity + benefits
Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.
Perks and Benefits
Health and Wellness
- Health Insurance
- Health Reimbursement Account
- Dental Insurance
- Vision Insurance
- Life Insurance
- Short-Term Disability
- Long-Term Disability
- FSA
- FSA With Employer Contribution
- HSA
- HSA With Employer Contribution
- Fitness Subsidies
- On-Site Gym
- Mental Health Benefits
Parental Benefits
- Birth Parent or Maternity Leave
- Non-Birth Parent or Paternity Leave
- Fertility Benefits
- Adoption Assistance Program
- Family Support Resources
Work Flexibility
- Flexible Work Hours
- Remote Work Opportunities
- Hybrid Work Opportunities
Office Life and Perks
- Commuter Benefits Program
- Casual Dress
- Happy Hours
- Snacks
- Some Meals Provided
- Company Outings
- On-Site Cafeteria
- Holiday Events
Vacation and Time Off
- Paid Vacation
- Unlimited Paid Time Off
- Paid Holidays
- Personal/Sick Days
- Sabbatical
- Leave of Absence
Financial and Retirement
- 401(K)
- 401(K) With Company Matching
- Pension
- Company Equity
- Performance Bonus
- Relocation Assistance
- Financial Counseling
Professional Development
- Learning and Development Stipend
- Promote From Within
- Mentor Program
- Shadowing Opportunities
- Access to Online Courses
- Lunch and Learns
- Internship Program
Diversity and Inclusion
Company Videos
Hear directly from employees about what it is like to work at Meta.