2,305 jobs for "AI Infrastructure Engineer"

Who We Are

At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward - always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities.

The Role

Owns observability/monitoring, utilization analysis, demand insight, capacity forecasting, scaling triggers, and recommendations for NVIDIA AI infrastructure and workloads.

Kyndryl currently does not require employees to be fully vaccinated against COVID-19, however, if you are hired to work at a client, customer, or partner location, you may be required to show proof of vaccination to align with their respective COVID-19 vaccination policies. Those who believe they are eligible may apply for a medical or religious accommodation prior to the start of employment.

Who You Are

Responsibilities

• Implement and maintain monitoring using DCGM, Prometheus, Grafana, and related telemetry sources.

• Define service health, GPU, fabric, storage, queue, workload, and utilization measures.

• Build dashboards, alerts, thresholds, and operational views for platform teams and leaders.

• Analyze utilization, queue depth, workload demand, bottlenecks, and capacity trends.

• Develop forecasts, scaling triggers, and evidence-based capacity recommendations.

• Partner with platform operations, FDE, architecture, finance, and customer teams on demand and growth planning.

• Validate monitoring coverage during deployment and maintain baselines through the lifecycle.

• Improve data quality and automate recurring performance and capacity reporting.

Required Professional Experience

• Experience in infrastructure monitoring, observability, performance analysis, or capacity management.

• Hands-on experience with Prometheus, Grafana, or comparable monitoring platforms.

• Experience analyzing time-series data and translating trends into operational recommendations.

• Working knowledge of Linux, containers, GPU infrastructure, and distributed platforms.

Preferred Qualifications

• Experience with NVIDIA DCGM and GPU telemetry.

• Experience with Run:ai Scheduler, Kubernetes scheduling, queue analysis, or AI workload demand.

• Experience with Python, APIs, data analytics, and dashboard automation.

Required Skills

NVIDIA DCGM | Prometheus | Grafana | GPU Monitoring | Observability | Capacity Planning | Utilization Analysis | Performance Analysis | Forecasting | Scaling Triggers | Dashboard Development

Travel Requirements

Limited nationwide travel may be required; percentage to be confirmed.

The compensation range for the position in the U.S. is - $115,080 to $218,520 based on a full-time schedule. Your actual compensation may vary depending on your geography, job-related skills and experience. For part time roles, the compensation will be adjusted appropriately. The pay or salary range will not be below any applicable state, city or local minimum wage requirement. There is a different applicable compensation range for the following work locations:

California (San Francisco Bay Area): $138,120 to $262,320

California (All Other): $126,600 to $240,480

Colorado: $115,080 to $218,520

Massachusetts $115,080 to $240,480

New York City: $138,120 to $262,320

Washington: $126,600 to $240,480

Washington DC: $126,600 to $240,480

This position will be eligible for Kyndryl's discretionary annual bonus program, based on performance and subject to the terms of Kyndryl's applicable plans. You may also receive a comprehensive benefits package which includes medical and dental coverage, disability, retirement benefits, paid leave, and paid time off.

Note: If this is a sales commission eligible role, you will be eligible to participate in a sales commission plan in lieu of the annual discretionary bonus program.

Applications will be accepted on a rolling basis.

Being You

Diversity is a whole lot more than what we look like or where we come from, it's how we think and who we are. We welcome people of all cultures, backgrounds, and experiences. But we're not doing it single-handily: Our Kyndryl Inclusion Networks are only one of many ways we create a workplace where all Kyndryls can find and provide support and advice. This dedication to welcoming everyone into our company means that Kyndryl gives you - and everyone next to you - the ability to bring your whole self to work, individually and collectively, and support the activation of our equitable culture. That's the Kyndryl Way.

What You Can Expect

With state-of-the-art resources and Fortune 100 clients, every day is an opportunity to innovate, build new capabilities, new relationships, new processes, and new value. Kyndryl cares about your well-being and prides itself on offering benefits that give you choice, reflect the diversity of our employees and support you and your family through the moments that matter - wherever you are in your life journey. Our employee learning programs give you access to the best learning in the industry to receive certifications, including Microsoft, Google, Amazon, Skillsoft, and many more. Through our company-wide volunteering and giving platform, you can donate, start fundraisers, volunteer, and search over 2 million non-profit organizations. At Kyndryl, we invest heavily in you, we want you to succeed so that together, we will all succeed.

Get Referred!
If you know someone that works at Kyndryl, when asked 'How Did You Hear About Us' during the application process, select 'Employee Referral' and enter your contact's Kyndryl email address.

About Kyndryl

We design, build, manage and modernize the mission-critical technology systems that the world depends on every day.

Size: 10,000+ employees
Industry: Consulting

View company profile

Perks and Benefits

Health and Wellness
- Health Insurance
- Vision Insurance
- Life Insurance
- Dental Insurance
- Health Reimbursement Account (HRA)
- Mental Health Benefits
- Short-Term Disability
- Long-Term Disability
- FSA
- FSA with Employer Contribution
- HSA
- HSA with Employer Contribution
- Virtual Fitness Classes
Parental Benefits
- Birth Parent or Maternity Leave
- Adoption Leave
- Non-Birth Parent or Paternity Leave
- Fertility Benefits
- Adoption Assistance Program
- Family Support Resources
Work Flexibility
- Remote Work Opportunities
- Flexible Work Hours
- Hybrid Work Opportunities
Vacation and Time Off
- Paid Vacation
- Paid Holidays
- Personal/Sick Days
- Volunteer Time Off
Financial and Retirement
- 401(k) With Company Matching
- Company Equity
- Stock Purchase Program
- Financial Counseling
Office Life and Perks
- Company Outings
- Holiday Events
Professional Development
- Mentor Program
- Access to Online Courses
- Lunch and Learns
- Internship Program
- Leadership Training Program
- Tuition Reimbursement
- Promote from Within
Diversity And Inclusion
- Employee Resource Groups (ERG)
- Unconscious Bias Training
- Diversity, Equity, and Inclusion Program