Program Manager, AI Models - Product Operations

Meta is seeking a Program Manager to lead our AI Model Portfolio on the Product Operations team. Our mission is to improve how product teams resolve user issues by being the experts on product quality. Those who join our team are interested in solving the most critical user issues and are advocates for the Meta community. We need influencers who can align our engineering customers and cross-functional partners to ensure the best possible experience for our platforms. If you like working with data and helping users, Product Operations is for you.We are looking for an individual contributor with data and AI modeling expertise who can partner with cross functional teams in complex, multi-platform user response quality efforts to improve the AI experience. This role will form part of the Product Operations central foundations team, which enables all of Product Operations to deliver on strategic investments across the company. This role requires candidates to balance high touch strategy engagements and be able to roll up their sleeves and "do the work". This role centers on closing the loop between product teams, ProdOps and critical AI models that enable teams to improve the user experience - leveraging user feedback, model evaluations, and annotations to refine and scale our AI systems.

Program Manager, AI Models - Product Operations Responsibilities:

• Portfolio & Program Leadership: Lead and manage multiple concurrent AI agentic automation portfolios and programs, coordinating cross-functional stakeholders and technical teams
• User Feedback & Program Development: Establish and lead programs and systems that leverage user feedback for model foundation teams, including 0 → 1 initiatives and ongoing feedback loop programs
• Project Execution & Governance: Monitor portfolio progress, manage project scope and timelines, facilitate execution sync meetings, and ensure clear communication of next steps and responsibilities
• Metrics & Data Reporting: Design, implement, and maintain clear, measurable metrics and KPIs aligned with business objectives. Ensure accuracy, consistency, and transparency of data definitions and reporting
• Stakeholder Communication & Influence: Effectively communicate analyses, complex data concepts, and recommendations to technical and non-technical stakeholders. Influence roadmaps and strategic decisions
• Process Improvement & Automation: Continuously improve processes, documentation, workflows, and system access. Proactively identify and implement opportunities for agentic automation and efficiency
• Risk Management & Reporting: Engage project sponsors and stakeholders for input, communicate risks and mitigation plans, and provide transparent, timely reporting
• Analytical & Strategic Problem Solving: Apply analytical and strategic thinking to complex problems, evaluate multiple perspectives, and recommend optimal, AI-driven solutions
• Organizational Advocacy: Champion agentic automation and data-driven approaches across the organization, influencing solution design and fostering cross-functional collaboration and innovation
• Mentorship & Team Enablement: Mentor team members, providing continual support to unblock and enable them to complete their respective projects

• Bachelor's degree in a directly related field, or equivalent practical experience
• 6+ years of experience in strategy, operations, consulting, or data analysis
• Experience managing and creating AI models, including model development, performance evaluation, and human-in-the-loop processes and crafting effective prompts to evaluate prompt performance for generative AI systems
• Experience designing, testing, and optimizing prompts for large language models (LLMs) to improve model outputs and user experience
• Hands-on experience deploying, managing, and evaluating AI agents and agentic automation systems in production environments
• Proficiency in designing and deploying human-in-the-loop processes, including annotation, model evaluation, and feedback loop integration for continuous model improvement
• Proficiency in using data and intermediate to advanced SQL to influence product direction
• Experience building executive dashboards, identifying organizational opportunities and influencing key decision-makers
• Proven track record managing time-sensitive projects with multiple stakeholders and shifting priorities
• Commitment to process improvement and operational efficiency, including budget management
• Experience supporting AI/ML projects with relevant data analysis and business acumen

• Master's degree in a related field, or equivalent practical experience
• 8+ years of experience in product operations, ML evaluation, user research, or similar roles
• Proven experience managing user feedback loops, model evaluations, or annotation workflows at scale
• Experience with vibe coding language or similar agentic automation frameworks
• Advanced analytical skills and proficiency with data tools (SQL, Python, experimentation platforms) and experience building data pipelines, reports, dashboards (e.g., Unidash), and visualizations for executive stakeholders
• Strong executive communication skills and experience engaging with product and operations leaders
• Executive communication skills and experience engaging with product and operations leaders
• Demonstrated stakeholder management and ability to influence cross-functional teams with data-driven insights
• Experience building internal tools
• Experience coordinating technical specifications for agentic automation across platforms