AI Architect
Who We Are
At Kyndryl, we run and reimagine the mission-critical technology systems that drive advantage for the world's leading businesses. We are at the heart of progress; with proven expertise and a continuous flow of AI-powered insight, enabling smarter decisions, faster innovation, and a lasting competitive edge. For our people-Kyndryls-that means doing purposeful work that powers human progress. Join us and experience a flexible, supportive environment where your well-being is prioritized and your potential can thrive.
The Role
Job Description
As a AI Architect at Kyndryl, you'll play a key role in designing, refining, and implementing the architectures behind next-generation AI and Agentic AI solutions.
You'll work at the intersection of innovation and engineering, translating strategic business objectives into tangible, enterprise-ready architectures that are scalable, secure, reliable, and maintainable.
You'll collaborate with architects, data scientists, ML engineers, software engineers, cloud specialists, security teams, and business stakeholders to design systems that combine technological excellence with measurable business value - systems that are not only intelligent, but also trustworthy, traceable, governable, and sustainable.
Want more jobs like this?
Get jobs in Flexible / Remote delivered to your inbox every week.

Your Mission
- Design and implement end-to-end AI and Agentic AI architectures that align business objectives with technical excellence.
- Transform functional, analytical, and non-functional requirements into efficient, modular, scalable, and maintainable system designs.
- Define architecture patterns covering areas such as AI agents, foundation models, data platforms, APIs, integration layers, orchestration, observability, security, and cloud infrastructure.
- Collaborate with cross-functional teams to ensure solutions meet high standards of scalability, performance, resilience, security, and reliability.
- Contribute to the creation of reference architectures, reusable components, design patterns, and technical standards that accelerate the delivery of AI solutions across the organization.
- Act as a trusted technical partner throughout the solution lifecycle, contributing to architecture and design reviews and providing guidance during implementation.
- Evaluate emerging technologies across the AI, Agentic AI, data, automation, and cloud ecosystems, identifying opportunities that can deliver tangible business value.
- Ensure AI solutions integrate effectively with existing enterprise systems, data platforms, applications, APIs, and cloud environments.
- Champion responsible AI and secure-by-design principles, embedding governance, traceability, privacy, security, and compliance into the architecture.
- Promote sustainable engineering practices, considering cost efficiency, infrastructure utilization, model efficiency, operational complexity, and long-term maintainability when making architectural decisions.
- Help bridge the gap between experimentation and production, ensuring AI concepts can evolve into robust, enterprise-grade solutions.
Who You Are
Essential Qualifications
- 3-6 years of experience in designing and implementing AI/ML solutions or advanced analytics architectures.
- Proven experience integrating AI models into production environments (APIs, microservices, or data pipelines).
- Solid understanding of AI and ML architectures, including model lifecycle (data ingestion, training, validation, deployment).
- Proficiency with cloud ecosystems (Azure, AWS, GCP) and their AI/ML services (e.g., Azure ML, Vertex AI, OpenShift AI).
- Hands-on experience with MLOps tools (MLflow, Kubeflow, Airflow) and container orchestration (Kubernetes, Docker).
- Familiarity with agentic AI frameworks (LangChain, CrewAI, AutoGen, LlamaIndex) and RAG architectures.
- Working knowledge of vector databases, APIs, and integration patterns for intelligent systems.
- Understanding of data privacy and regulatory frameworks (GDPR, EU AI Act, Responsible AI principles).
Education & Certifications
- Bachelor's or Master's degree in Computer Engineering, Artificial Intelligence, Data Science, or related field.
- Postgraduate studies (Master's or PhD) in AI, Big Data, or Cloud Computing are highly valued.
- Certifications in cloud architecture (Azure, AWS, or GCP) and MLOps frameworks are a plus.
- Continuous learning mindset and strong curiosity about emerging AI paradigms and technologies.
Preferred Skills
- Experience designing modular, scalable, and maintainable architectures for AI-driven solutions.
- Knowledge of hybrid or federated AI deployments, integrating enterprise data and large language models.
- Exposure to observability and monitoring practices in AI workloads.
- Familiarity with semantic search, knowledge graphs, or LLM optimization pipelines.
- Experience collaborating in agile or DevOps environments, bridging data science and engineering teams.
- Ability to document and communicate architecture decisions clearly, supporting alignment across stakeholders.
- Curiosity to experiment with new frameworks and evaluate their maturity for enterprise adoption.
Being You
The "Kyn" in Kyndryl means kinship, which represents the strong bonds we have with each other, our customers and our communities. We focus on ensuring all Kyndryls feel included and we welcome people of all cultures, backgrounds, and experiences. Even if you don't meet every requirement, we encourage you to apply. We believe in growth, and we're excited to see what you can bring. At Kyndryl, employee feedback has told us that our number one driver of employee engagement is belonging. That sense of belonging - being a valued, respected, trusted member of the team - is fundamental to our culture and fueling great experiences for our customers. This dedication to welcoming everyone into our company means that Kyndryl gives you the ability to thrive and contribute to our culture of empathy and shared success. That's The Kyndryl Way.
What You Can Expect
Your career with us isn't just a job-it's an adventure with purpose. We offer a dynamic, hybrid-friendly culture that supports your well-being and empowers you to grow. Our Be Well programs are thoughtfully designed to support your financial, mental, physical, and social health-because we know that when you feel your best, you do your best.
From your very first day, you'll dive into impactful work that powers the systems our customers rely on every day. You won't just contribute-you'll make a difference, tackling meaningful projects that sharpen your skills and fuel your growth.
We're here to champion your journey. With powerful tools to chart your career path, personalized development goals aligned with your ambitions, and continuous feedback to keep you inspired and on track, you'll have everything you need to thrive and evolve. You'll develop in-demand skills to grow your career and achieve your ambitions with access to cutting-edge learning opportunities-from certifications with Microsoft, Google, and Amazon to coaching and hands-on experiences. And through it all, you'll be part of a culture that values empathy, restless learning, and a devotion to shared success.
We want you to thrive here-and we're committed to helping you do just that. Ready to make an impact? Join us and help shape what's next.
Get Referred!
If you know someone that works at Kyndryl, when asked 'How Did You Hear About Us' during the application process, select 'Employee Referral' and enter your contact's Kyndryl email address.
Perks and Benefits
Health and Wellness
- Health Insurance
- Vision Insurance
- Life Insurance
- Dental Insurance
- Health Reimbursement Account
- Mental Health Benefits
- Short-Term Disability
- Long-Term Disability
- FSA
- FSA With Employer Contribution
- HSA
- HSA With Employer Contribution
- Virtual Fitness Classes
Parental Benefits
- Birth Parent or Maternity Leave
- Adoption Leave
- Non-Birth Parent or Paternity Leave
- Fertility Benefits
- Adoption Assistance Program
- Family Support Resources
Work Flexibility
- Remote Work Opportunities
- Flexible Work Hours
- Hybrid Work Opportunities
Office Life and Perks
- Company Outings
- Holiday Events
Vacation and Time Off
- Paid Vacation
- Paid Holidays
- Personal/Sick Days
- Volunteer Time Off
Financial and Retirement
- 401(K) With Company Matching
- Company Equity
- Stock Purchase Program
- Financial Counseling
Professional Development
- Mentor Program
- Access to Online Courses
- Lunch and Learns
- Internship Program
- Leadership Training Program
- Tuition Reimbursement
- Promote From Within
Diversity and Inclusion
- Employee Resource Groups (ERG)
- Unconscious Bias Training
- Diversity, Equity, and Inclusion Program
Company Videos
Hear directly from employees about what it is like to work at Kyndryl.