---
title: 'Infrastructure SRE - HPC at Sarvam'
canonical: 'https://feeny.ai/job/infrastructure-sre-hpc-sarvam-bengaluru-0crc6t8ajvv3'
type: 'job'
last_seen: '2026-10-17'
---

# Infrastructure SRE - HPC at Sarvam

- **Company:** [Sarvam](https://feeny.ai/companies/sarvam)
- **Location:** Bengaluru, India
- **Employment:** full-time
- **Work type:** onsite
- **Posted:** 2026-06-26
- **Last confirmed live:** 2026-10-17
- **Apply:** https://jobs.ashbyhq.com/sarvam/e1dd678f-6e25-48b4-82d8-a1a7d10a78d6/application

**Skills:** Python, Go, GPU cluster operation, Site reliability engineering, Infrastructure management, Slurm, Kubernetes, On-premise GPU deployment, InfiniBand, NCPs, DGX SuperPOD, Lambda, CoreWeave, NeevCloud, Multi-tenant GPU isolation, MIG, MPS, Time-slicing

> The Infrastructure SRE will manage a large, multi-vendor GPU fleet serving training and inference workloads. Responsibilities include end-to-end fleet operation, on-call rotation, tooling development, and incident resolution for parallel filesystems, RDMA fabrics, and distributed training failures.

## Job description

## About Sarvam

Sarvam is building the bedrock of Sovereign AI for India. The company is developing India’s full-stack sovereign AI platform, building across research, models, infrastructure and applications with a singular focus on making AI genuinely work for India. Sarvam works with leading enterprises and public institutions and is backed by Lightspeed, Peak XV, and Khosla Ventures. Sarvam partners with India’s leading brands, including Tata Capital, SBI Life, CRED, IDFC, and LIC.

## About the Role

Sarvam runs a large, multi-vendor GPU fleet that serves two demanding workloads on the same physical infrastructure: training jobs that span hundreds of GPUs and must run uninterrupted for weeks, and inference services that must hold a flat p99 under production load. Keeping both healthy at once is a hard, specialized reliability problem, and it is the problem this team exists to solve. This is not a Kubernetes administration role. We assume Kubernetes fluency as a baseline. The difficulty lies above and below it - in parallel filesystems under heavy checkpoint load, in RDMA fabrics that degrade quietly, in NCCL hangs whose root cause may be the network or the kernel, in driver and firmware drift across heterogeneous hardware, and in distributed training failures that masquerade as infrastructure faults. We are hiring a team of specialists rather than a set of identical generalists. This posting covers five areas of focus. We expect candidates to bring genuine depth in one and working fluency across the others, because on a shared fleet a storage problem often first appears as a training hang, and the engineer on call must route an incident correctly before anyone can resolve it. When you apply, please indicate the area of focus that best matches your experience. Strong generalists are welcome; we will place you where your depth is most useful.

## What You’ll Do

- Operate the GPU fleet end to end across training and serving - provisioning, observability, capacity, and fleet health.
- Hold a meaningful on-call rotation, write runbooks that hold up under pressure, and drive postmortems that produce durable fixes.
- Build the internal tooling the team relies on, rather than operating off-the-shelf systems alone.
- Partner with ML and platform teams to keep large runs alive and serving latency predictable.

## What We're Looking For

- 5+ years in infrastructure or site reliability engineering, including 2+ years operating GPU clusters at scale.*
- Demonstrated on-call ownership of infrastructure that mattered, with a track record of postmortems that led to real change.
- Proficiency in Python or Go, used to build and maintain internal tooling.
- Working fluency across all five areas of focus below - enough to recognize, triage, and route a problem outside your specialty, even if the fix belongs to a teammate.
- For the Storage and Fabric areas of focus, we will weigh deep domain expertise against the GPU-cluster requirement; exceptional specialists with less direct GPU-fleet time are encouraged to apply.

Bring depth in one of the five areas below; expect to be conversational across the rest.

- Distributed high-performance storage — operate a parallel filesystem (Lustre, GPFS, WEKA, or BeeGFS) at scale and keep it from stalling under checkpoint-write storms.
- Fabric & RDMA networking — InfiniBand or RoCE health, NVLink/NVSwitch topology, and RDMA debugging that catches degradation before the workload feels it.
- GPU systems reliability — NCCL debugging, driver and firmware lifecycle across a mixed fleet, and DCGM-based node health at scale.
- Kubernetes platform reliability — the GPU operator stack, scheduling (Slurm-on-k8s or pure k8s), multi-tenant isolation, and cost/SLO primitives.
- Training & inference workload reliability — hang and straggler detection, checkpoint/restart, and protecting serving p99 with HA and DR.

Bonus Points

- Slurm and Kubernetes hybrid environments.
- On-premise GPU deployment, including coordination with datacenter operations on power, cooling, and InfiniBand cabling.
- Experience with Indian NCPs, DGX SuperPOD, Lambda, CoreWeave, NeevCloud etc.
- Multi-tenant GPU isolation (MIG, MPS, time-slicing) in production.

Why Sarvam? Sarvam is a fast-moving, high talent-density team building full-stack AI for India, working on problems that push the frontiers of AI with real population-scale impact. Work alongside researchers, engineers, builders, and business leaders who move fast and hold each other to a very high bar High ownership and high impact, from day one Everything we do is AI-first, from the way we build and ship to the way we think about problems You can work on problems that could change how an entire country learns, works, and communicates If you want to work on problems at the frontier of AI in India, Sarvam is the place to be.

## About Sarvam

## Company Overview
- **One-liner**: Sarvam is building India's full-stack sovereign AI platform, delivering state-of-the-art models and enterprise-grade applications for Indic languages.
- **Entity Type**: Private (Series A – $41M raised)
- **Headquarters**: Bengaluru, India
- **Founded**: August 2023
- **Founders**: Dr. Vivek Raghavan, Dr. Pratyush Kumar

## Core Business
- Primary industry: Artificial Intelligence / Generative AI
- Target customers: Enterprises, Government, Developers (B2B, B2G)
- Mission: Make AI widely accessible to everyone in India by building foundational components that reflect how the country thinks, speaks, reasons, and solves problems.

## Products & Services
- **Sarvam Cloud**: Fully managed, automatically scaling API platform for Indic AI capabilities.
- **Speech to Text (Saaras)**: High‑accuracy ASR across 12 Indic languages.
- **Text to Speech (Bulbul)**: Natural voices across 11 Indic languages.
- **Translation**: State‑of‑the‑art translation across 23 languages.
- **Document Digitisation (Akshar)**: Convert PDFs and images into structured data.
- **Vision Models**: Image understanding and processing.
- **Samvaad**: Conversational AI studio for building voice agents.
- **Arya**: AI‑for‑work platform with forward‑deployed engineers for custom agent design and integration.
- **Deployment Options**: Private cloud, on‑premise, hybrid, or air‑gapped environments.

## Market Standing
- **Valuation/Market Cap**: Not disclosed (private)
- **Key Metric**: Total funding $41M (from Khosla Ventures, Lightspeed, Peak XV Partners)
- **Notable Investors/Partners**: Khosla Ventures, Lightspeed, Peak XV Partners
- **Growth Signals**: 62 open positions across engineering, models, product, sales, and more; case studies with large‑scale deployments (50,000+ farmer feedback calls, millions of policy calls); SOC 2 Type II, ISO 27001, DPDP compliant.

## Competitive Advantages
- **Sovereign AI**: All technology developed and operated entirely in India, with full data control and compliance with Indian data protection laws.
- **Full‑stack platform**: From foundational models to enterprise agents, everything built in‑house.
- **Forward‑deployed engineering**: Dedicated engineers embedded with customer teams to ensure successful delivery.
- **Population‑scale impact**: Proven ability to serve millions of users in Indic languages across government and BFSI.
- **Deployment flexibility**: Can run on any infrastructure, including air‑gapped for regulated industries.

## Strategic Focus
- Continue building state‑of‑the‑art models and tools for Indic languages.
- Expand enterprise and government adoption of conversational AI agents.
- Nurture the Indian AI ecosystem by open‑sourcing models and tools.
- Scale team rapidly (62 open roles) to support growing customer demand.

## Why Work Here
- **Mission‑driven opportunity**: Shape AI that serves India’s linguistic and cultural diversity.
- **On‑site first**: All roles are based in Bengaluru (Delhi also available), fostering deep collaboration.
- **Cutting‑edge work**: Foundational model research, ML infrastructure, full‑stack product engineering.
- **High‑impact culture**: Teams work directly with customers via forward‑deployed engineers, seeing immediate real‑world use.
- **Backed by top investors**: Financial stability and growth runway from Lightspeed, Peak XV, and Khosla Ventures.

## Sources
1. [sarvam.ai](https://www.sarvam.ai/)
2. [sarvam.ai/about-us](https://www.sarvam.ai/about-us)
3. [sarvam.ai/careers](https://www.sarvam.ai/careers)
4. [jobs.ashbyhq.com/sarvam](https://jobs.ashbyhq.com/sarvam)
5. [linkedin.com/company/sarvam-ai](https://www.linkedin.com/company/sarvam-ai)

## Other roles at Sarvam

- [Software Engineer - Model API Platform](https://feeny.ai/job/software-engineer-model-api-platform-sarvam-bengaluru-6252xtzyzy9f) — Bengaluru, India
- [ML Engineer (Training Infra), Foundational Models](https://feeny.ai/job/ml-engineer-training-infra-foundational-models-sarvam-bengaluru-byw6f3s2ty06) — Bengaluru, India
- [Staff Engineer - Telephony](https://feeny.ai/job/staff-engineer-telephony-sarvam-bengaluru-4mt7q90ph60d) — Bengaluru, India
- [Staff Engineer - Systems Engineering](https://feeny.ai/job/staff-engineer-systems-engineering-sarvam-bengaluru-z6az3vchvm99) — Bengaluru, India
- [Growth Marketing Intern](https://feeny.ai/job/growth-marketing-intern-sarvam-bengaluru-nd6d1ycn199k) — Bengaluru, India
- [Marketing Intern](https://feeny.ai/job/marketing-intern-sarvam-bengaluru-d560v4tmah8c) — Bengaluru, India
- [Staff Software Engineer - Frontend](https://feeny.ai/job/staff-software-engineer-frontend-sarvam-bengaluru-tae371pf8h7r) — Bengaluru, India
- [GTM Strategy - Chanakya](https://feeny.ai/job/gtm-strategy-chanakya-sarvam-delhi-zp2xxvmq6s2z) — Delhi, India
- [DevOps Engineer](https://feeny.ai/job/devops-engineer-sarvam-bengaluru-5ss75qfs1rn0) — Bengaluru, India
- [Product Manager, Model APIs](https://feeny.ai/job/product-manager-model-apis-sarvam-bengaluru-jrkanrnc39wr) — Bengaluru, India