Product Manager
Introduction
A career in IBM Software means you'll be part of a team that transforms our customer's challenges into industry-leading solutions.
We are an infinitely curious team, always seeking new possibilities, and dedicated to creating the world's leading AI-powered, cloud-native software solutions. Our renowned legacy creates endless global opportunities for our network of IBMers. We are a team of deep product experts, ensuring exceptional client experiences, with a focus on delivery, excellence, and obsession over customer outcomes.
IBM's product and technology landscape includes Research, Software, and Infrastructure. Entering this domain positions you at the heart of IBM, where growth and innovation thrive.
Your role and responsibilities
We're looking for a Product Manager to lead Observability for applications that leverage Generative AI, agents and tools.
In this role, you will define and drive the roadmap for Observability of GenAI models, inference pipelines, and hybrid deployments, ensuring transparency, reliability, and performance in modern AI-powered systems.
Own the product strategy and roadmap for Generative AI observability, including
• monitoring and alerting for model performance and latency, token consumption and costs, model drift and quality degradation, hallucination detection, retrieval accuracy and relevance, agent success rates and failure modes
• root cause investigation and remediation for generative AI integrated applications across cloud and on-prem environments.
• integrating telemetry from emerging technologies of generative AI stack components into the observability platform
Foster an Agile team environment, maximizing productivity throughout the entire product development lifecycle.
Collaborate with product, marketing, and customer success teams to communicate new AI observability capabilities and gather feedback to drive future roadmap.
Stay ahead of industry trends in GenAI Observability to inform roadmap and work with research teams to drive innovation.
Hiring manager and Recruiter should collaborate to create the relevant verbiage.
Required education
Bachelor's Degree
Preferred education
Master's Degree
Required technical and professional expertise
- Hands-on experience in Product Management or a related technical role with exposure to generative AI technologies and systems.
- Understanding of agile development practices
- Understanding of AI observability fundamentals: model metrics, drift detection, token usage, and bias monitoring.
- Familiarity with cloud-native AI services
- Strong collaboration and communication skills across cross-functional teams.
- Ability to balance technical depth with customer and business priorities.
Preferred technical and professional experience
- Technical background (e.g., degree in Computer Science, Engineering, or related field).
- Product Management experience in an Agile development environment. Track record of driving significant product growth on a cloud-focused SaaS platform.
- Experience with APM or observability tools.
- Hands-on experience with AI monitoring tools (LangSmith, LangFuse, Arize AI, WhyLabs) or OpenTelemetry extensions for AI.
- Hands on experience with GenAI frameworks (LangChain, LangGraph , CrewAI, LiteLLM)
- Understanding of LLM architectures, prompting techniques, and Retrieval-Augmented Generation
- Familiarity with agent frameworks and multi-agent orchestration
- Knowledge of one or more programming languages (Python, Go, Java).
ABOUT BUSINESS UNIT
IBM Software infuses core business operations with intelligence-from machine learning to generative AI-to help make organizations more responsive, productive, and resilient. IBM Software helps clients put AI into action now to create real value with trust, speed, and confidence across digital labor, IT automation, application modernization, security, and sustainability. Critical to this is the ability to make use of all data, because AI is only as good as the data that fuels it. In most organizations data is spread across multiple clouds, on premises, in private datacenters, and at the edge. IBM's AI and data platform scales and accelerates the impact of AI with trusted data, and provides leading capabilities to train, tune and deploy AI across business. IBM's hybrid cloud platform is one of the most comprehensive and consistent approach to development, security, and operations across hybrid environments-a flexible foundation for leveraging data, wherever it resides, to extend AI deep into a business.
YOUR LIFE @ IBM
In a world where technology never stands still, we understand that, dedication to our clients success, innovation that matters, and trust and personal responsibility in all our relationships, lives in what we do as IBMers as we strive to be the catalyst that makes the world work better.
Being an IBMer means you'll be able to learn and develop yourself and your career, you'll be encouraged to be courageous and experiment everyday, all whilst having continuous trust and support in an environment where everyone can thrive whatever their personal or professional background.
Our IBMers are growth minded, always staying curious, open to feedback and learning new information and skills to constantly transform themselves and our company. They are trusted to provide on-going feedback to help other IBMers grow, as well as collaborate with colleagues keeping in mind a team focused approach to include different perspectives to drive exceptional outcomes for our customers. The courage our IBMers have to make critical decisions everyday is essential to IBM becoming the catalyst for progress, always embracing challenges with resources they have to hand, a can-do attitude and always striving for an outcome focused approach within everything that they do.
Are you ready to be an IBMer?
ABOUT IBM
IBM's greatest invention is the IBMer. We believe that through the application of intelligence, reason and science, we can improve business, society and the human condition, bringing the power of an open hybrid cloud and AI strategy to life for our clients and partners around the world.
Want more jobs like this?
Get jobs in Markham, Canada delivered to your inbox every week.

Restlessly reinventing since 1911, we are not only one of the largest corporate organizations in the world, we're also one of the biggest technology and consulting employers, with many of the Fortune 500 companies relying on the IBM Cloud to run their business.
At IBM, we pride ourselves on being an early adopter of artificial intelligence, quantum computing and blockchain. Now it's time for you to join us on our journey to being a responsible technology innovator and a force for good in the world.
IBM is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, neurodivergence, age, or other characteristics protected by the applicable law. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
OTHER RELEVANT JOB DETAILS
Must have the ability to work in Canada without sponsorship.
This role will involve working with technology that is covered by Export Regulations sanctions. If you are a Foreign National from any of the following US sanctioned countries (Cuba, Iran, North Korea, Syria, and the Crimea, Luhansk, Donetsk, Kherson, and Zaporizhia regions of Ukraine) on a work permit, you are not eligible for employment in this position.
Perks and Benefits
Health and Wellness
Parental Benefits
Work Flexibility
Office Life and Perks
Vacation and Time Off
Financial and Retirement
Professional Development
Diversity and Inclusion
Company Videos
Hear directly from employees about what it is like to work at IBM.