AI Systems Architect
Who We Are
At Kyndryl, we run and reimagine the mission-critical technology systems that drive advantage for the world's leading businesses. We are at the heart of progress; with proven expertise and a continuous flow of AI-powered insight, enabling smarter decisions, faster innovation, and a lasting competitive edge. For our people-Kyndryls-that means doing purposeful work that powers human progress. Join us and experience a flexible, supportive environment where your well-being is prioritized and your potential can thrive.
The Role
The AI Systems Architect is responsible for designing and evolving an enterprise-scale Agentic AI platform that enables engineering teams to build, deploy, and operate production-ready AI agents in a secure, governed, and reusable manner.
Key Responsibilities
- Architect a reusable enterprise Agentic AI platform, including agent runtime, orchestration, context management, memory, evaluation, guardrails, and observability.
- Develop and maintain an Agent Harness that provides standardized runtime capabilities and Model Context Protocol (MCP) integration.
- Define "Golden Paths" that standardize AI agent development and deployment across engineering teams.
- Build a model-agnostic AI runtime supporting multiple LLM providers, AI gateways, and enterprise integrations.
- Collaborate with infrastructure teams on Kubernetes, GPU platforms, networking, and cloud-native AI infrastructure.
- Establish enterprise AI governance covering policy enforcement, security, prompt/model lifecycle management, human-in-the-loop workflows, evaluation, and cost optimization.
- Integrate AI agents with enterprise platforms such as CI/CD, ITSM, observability, cloud services, and business applications.
- Define engineering standards and mentor teams to drive enterprise adoption of Agentic AI best practices.
Overall Focus
This is a senior platform architecture role rather than an application development role. The emphasis is on building the foundational enterprise AI platform-including agent runtime, governance, orchestration, and developer experience-that enables multiple engineering teams to deliver scalable, secure, model-agnostic AI agents across the organization.
Your Future at Kyndryl
As an IT/Cloud Consultant at Kyndryl you will join the Kyndryl Consultant Profession, working with other Kyndryl Consultants, Architects, Project Managers, and cross-functional Technical Subject Matter Experts - presenting unlimited opportunities with unmatched support through our investment in your learning, training, and career growth.
Want more jobs like this?
Get jobs in Flexible / Remote delivered to your inbox every week.

Who You Are
Required Experience
- 5+ years designing cloud-native platforms or enterprise software architectures.
- Strong hands-on experience with Agentic AI architectures, orchestration, tool integration, memory, evaluation, and guardrails.
- Experience with agent frameworks such as LangGraph, CrewAI, Semantic Kernel, or AutoGen.
- Strong Python software engineering skills.
- Expertise in Kubernetes, containers, Infrastructure as Code, and cloud-native architectures.
- Understanding of AI infrastructure, including GPUs, model serving, AI gateways, and observability.
- Experience designing developer platforms and reusable services rather than standalone applications.
- Professional proficiency in both English and Spanish.
Preferred Skills
- Experience with LiteLLM, OpenRouter, NVIDIA NIM, vLLM, or Triton Inference Server.
- Knowledge of LLMOps, AI governance, and model lifecycle management.
- Experience with RAG, vector databases, and semantic search.
- Familiarity with observability tools such as Prometheus, Grafana, OpenTelemetry, or Langfuse.
- Experience with AI coding assistants (Claude Code, GitHub Copilot, Codex).
- Experience in regulated industries such as Financial Services, Telecommunications, or Public Sector.
Being You
The "Kyn" in Kyndryl means kinship, which represents the strong bonds we have with each other, our customers and our communities. We focus on ensuring all Kyndryls feel included and we welcome people of all cultures, backgrounds, and experiences. Even if you don't meet every requirement, we encourage you to apply. We believe in growth, and we're excited to see what you can bring. At Kyndryl, employee feedback has told us that our number one driver of employee engagement is belonging. That sense of belonging - being a valued, respected, trusted member of the team - is fundamental to our culture and fueling great experiences for our customers. This dedication to welcoming everyone into our company means that Kyndryl gives you the ability to thrive and contribute to our culture of empathy and shared success. That's The Kyndryl Way.
What You Can Expect
Your career with us isn't just a job-it's an adventure with purpose. We offer a dynamic, hybrid-friendly culture that supports your well-being and empowers you to grow. Our Be Well programs are thoughtfully designed to support your financial, mental, physical, and social health-because we know that when you feel your best, you do your best.
From your very first day, you'll dive into impactful work that powers the systems our customers rely on every day. You won't just contribute-you'll make a difference, tackling meaningful projects that sharpen your skills and fuel your growth.
We're here to champion your journey. With powerful tools to chart your career path, personalized development goals aligned with your ambitions, and continuous feedback to keep you inspired and on track, you'll have everything you need to thrive and evolve. You'll develop in-demand skills to grow your career and achieve your ambitions with access to cutting-edge learning opportunities-from certifications with Microsoft, Google, and Amazon to coaching and hands-on experiences. And through it all, you'll be part of a culture that values empathy, restless learning, and a devotion to shared success.
We want you to thrive here-and we're committed to helping you do just that. Ready to make an impact? Join us and help shape what's next.
Get Referred!
If you know someone that works at Kyndryl, when asked 'How Did You Hear About Us' during the application process, select 'Employee Referral' and enter your contact's Kyndryl email address.
Perks and Benefits
Health and Wellness
- Health Insurance
- Vision Insurance
- Life Insurance
- Dental Insurance
- Health Reimbursement Account
- Mental Health Benefits
- Short-Term Disability
- Long-Term Disability
- FSA
- FSA With Employer Contribution
- HSA
- HSA With Employer Contribution
- Virtual Fitness Classes
Parental Benefits
- Birth Parent or Maternity Leave
- Adoption Leave
- Non-Birth Parent or Paternity Leave
- Fertility Benefits
- Adoption Assistance Program
- Family Support Resources
Work Flexibility
- Remote Work Opportunities
- Flexible Work Hours
- Hybrid Work Opportunities
Office Life and Perks
- Company Outings
- Holiday Events
Vacation and Time Off
- Paid Vacation
- Paid Holidays
- Personal/Sick Days
- Volunteer Time Off
Financial and Retirement
- 401(K) With Company Matching
- Company Equity
- Stock Purchase Program
- Financial Counseling
Professional Development
- Mentor Program
- Access to Online Courses
- Lunch and Learns
- Internship Program
- Leadership Training Program
- Tuition Reimbursement
- Promote From Within
Diversity and Inclusion
- Employee Resource Groups (ERG)
- Unconscious Bias Training
- Diversity, Equity, and Inclusion Program
Company Videos
Hear directly from employees about what it is like to work at Kyndryl.