---
title: 'SDE2 - API Platform at Sarvam'
canonical: 'https://feeny.ai/job/sde2-api-platform-sarvam-bengaluru-mmq7ahafqqwj'
type: 'job'
last_seen: '2026-10-31'
---

# SDE2 - API Platform at Sarvam

- **Company:** [Sarvam](https://feeny.ai/companies/sarvam)
- **Location:** Bengaluru, India
- **Employment:** full-time
- **Work type:** onsite
- **Posted:** 2026-10-29
- **Last confirmed live:** 2026-10-31
- **Apply:** https://jobs.ashbyhq.com/sarvam/fd9ca9f7-c546-4264-acc6-ee4e58c0e693

## Job description

## About the Role

Sarvam's model APIs (LLM, ASR, TTS, Vision, Translate) are how developers and enterprises ship products on our foundation models. Our OpenAI-compatible LLM APIs route every request across multiple model deployments, with streaming, failover, metering, billing, and rate-limiting all part of the same stack. Today it's FastAPI and Python; we're in the middle of rewriting it in Go. We're hiring a Software Engineer (SDE 2) to own core parts of this platform. The features. The reliability. The performance. This is an IC role.

## What You'll Do

- Building and evolving the LLM API platform, from the moment a request hits the edge to the response that goes back out
- The Python→Go rewrite: building services in Go alongside the existing Python stack, without compromising reliability
- Streaming infrastructure: SSE for Chat Completions and Responses, long-lived connections, clean handling of cancellations and client disconnects
- Routing and failover: weighted provider chains, retries with backoff, and latency-driven admission control across model deployments
- Protocol compatibility: keeping the API faithful to the OpenAI spec across inference servers (vLLM, SGLang, Dynamo) that each behave slightly differently
- The commercial layer: metering, billing, and rate-limiting, engineered to the same bar as the model APIs themselves
- Performance and reliability for a multi-tenant platform serving long-context agentic and coding workloads
- Observability (logging, metrics, tracing), so the team can debug production confidently and quickly
- Integration and load testing: the harness that lets us ship fast without breaking customer-facing APIs
- Close partnership with the Inference and MLOps teams on production readiness for new model launches
- Design-first, documentation-first engineering culture within the team: RFCs before code, decisions written down, no tribal knowledge

## What We're Looking For

- 3+ years building production backend systems
- Strong Python in production: asyncio, FastAPI or similar, and services you've built and operated under real load
- Working knowledge of Go, or a strong willingness to learn it: you'll work in both languages through the rewrite
- Experience building low-latency, multi-tenant backend services
- Hands-on experience with streaming systems: SSE or WebSockets, long-lived connections, backpressure
- Strong PostgreSQL and Redis fundamentals: schema design, query performance, caching, and rate limiting
- Comfort running services on Kubernetes in production
- An ownership mindset: you test before you ship, debug production with metrics, logs, and traces, and write the RCA afterwards

Bonus Points

- Experience serving or integrating LLMs in production, especially OpenAI-compatible APIs
- Familiarity with inference servers (vLLM, SGLang, Dynamo) and latency metrics such as time to first token and inter-token latency
- Experience building metering, billing, or usage-based pricing infrastructure
- Time at an early- or growth-stage startup: comfort with ambiguity, speed, and ownership

Why Sarvam? Sarvam is a fast-moving, high talent-density team building full-stack AI for India, working on problems that push the frontiers of AI with real population-scale impact.

- Work alongside researchers, engineers, builders, and business leaders who move fast and hold each other to a very high bar
- High ownership and high impact, from day one
- Everything we do is AI-first, from the way we build and ship to the way we think about problems
- You can work on problems that could change how an entire country learns, works, and communicates

If you want to work on problems at the frontier of AI in India, Sarvam is the place to be.

## About Sarvam

## Company Overview
- **One-liner**: Sarvam is building India's full-stack sovereign AI platform, delivering state-of-the-art models and enterprise-grade applications for Indic languages.
- **Entity Type**: Private (Series A – $41M raised)
- **Headquarters**: Bengaluru, India
- **Founded**: August 2023
- **Founders**: Dr. Vivek Raghavan, Dr. Pratyush Kumar

## Core Business
- Primary industry: Artificial Intelligence / Generative AI
- Target customers: Enterprises, Government, Developers (B2B, B2G)
- Mission: Make AI widely accessible to everyone in India by building foundational components that reflect how the country thinks, speaks, reasons, and solves problems.

## Products & Services
- **Sarvam Cloud**: Fully managed, automatically scaling API platform for Indic AI capabilities.
- **Speech to Text (Saaras)**: High‑accuracy ASR across 12 Indic languages.
- **Text to Speech (Bulbul)**: Natural voices across 11 Indic languages.
- **Translation**: State‑of‑the‑art translation across 23 languages.
- **Document Digitisation (Akshar)**: Convert PDFs and images into structured data.
- **Vision Models**: Image understanding and processing.
- **Samvaad**: Conversational AI studio for building voice agents.
- **Arya**: AI‑for‑work platform with forward‑deployed engineers for custom agent design and integration.
- **Deployment Options**: Private cloud, on‑premise, hybrid, or air‑gapped environments.

## Market Standing
- **Valuation/Market Cap**: Not disclosed (private)
- **Key Metric**: Total funding $41M (from Khosla Ventures, Lightspeed, Peak XV Partners)
- **Notable Investors/Partners**: Khosla Ventures, Lightspeed, Peak XV Partners
- **Growth Signals**: 62 open positions across engineering, models, product, sales, and more; case studies with large‑scale deployments (50,000+ farmer feedback calls, millions of policy calls); SOC 2 Type II, ISO 27001, DPDP compliant.

## Competitive Advantages
- **Sovereign AI**: All technology developed and operated entirely in India, with full data control and compliance with Indian data protection laws.
- **Full‑stack platform**: From foundational models to enterprise agents, everything built in‑house.
- **Forward‑deployed engineering**: Dedicated engineers embedded with customer teams to ensure successful delivery.
- **Population‑scale impact**: Proven ability to serve millions of users in Indic languages across government and BFSI.
- **Deployment flexibility**: Can run on any infrastructure, including air‑gapped for regulated industries.

## Strategic Focus
- Continue building state‑of‑the‑art models and tools for Indic languages.
- Expand enterprise and government adoption of conversational AI agents.
- Nurture the Indian AI ecosystem by open‑sourcing models and tools.
- Scale team rapidly (62 open roles) to support growing customer demand.

## Why Work Here
- **Mission‑driven opportunity**: Shape AI that serves India’s linguistic and cultural diversity.
- **On‑site first**: All roles are based in Bengaluru (Delhi also available), fostering deep collaboration.
- **Cutting‑edge work**: Foundational model research, ML infrastructure, full‑stack product engineering.
- **High‑impact culture**: Teams work directly with customers via forward‑deployed engineers, seeing immediate real‑world use.
- **Backed by top investors**: Financial stability and growth runway from Lightspeed, Peak XV, and Khosla Ventures.

## Sources
1. [sarvam.ai](https://www.sarvam.ai/)
2. [sarvam.ai/about-us](https://www.sarvam.ai/about-us)
3. [sarvam.ai/careers](https://www.sarvam.ai/careers)
4. [jobs.ashbyhq.com/sarvam](https://jobs.ashbyhq.com/sarvam)
5. [linkedin.com/company/sarvam-ai](https://www.linkedin.com/company/sarvam-ai)

## Other roles at Sarvam

- [Product & Strategy Associate](https://feeny.ai/job/product-strategy-associate-sarvam-bengaluru-h592ah8z91et) — Bengaluru, India
- [SDE3, Infrastructure Security Engineer (DevSecOps)](https://feeny.ai/job/sde3-infrastructure-security-engineer-devsecops-sarvam-bengaluru-f76y1pzvww4h) — Bengaluru, India
- [Infrastructure Engineer](https://feeny.ai/job/infrastructure-engineer-sarvam-bengaluru-rfqe8sbcff7f) — Bengaluru, India
- [Marketing internship (brand & communication)](https://feeny.ai/job/marketing-internship-brand-communication-sarvam-bengaluru-fy8nbbwdvcs6) — Bengaluru, India
- [Software Development Engineer - Tejas](https://feeny.ai/job/software-development-engineer-tejas-sarvam-bengaluru-kth87y46fjd3) — Bengaluru, India
- [Software Engineer - Model API Platform](https://feeny.ai/job/software-engineer-model-api-platform-sarvam-bengaluru-6252xtzyzy9f) — Bengaluru, India
- [ML Engineer (Training Infra), Foundational Models](https://feeny.ai/job/ml-engineer-training-infra-foundational-models-sarvam-bengaluru-byw6f3s2ty06) — Bengaluru, India
- [Staff Engineer - Telephony](https://feeny.ai/job/staff-engineer-telephony-sarvam-bengaluru-4mt7q90ph60d) — Bengaluru, India
- [Staff Engineer - Systems Engineering](https://feeny.ai/job/staff-engineer-systems-engineering-sarvam-bengaluru-z6az3vchvm99) — Bengaluru, India
- [Growth Marketing Intern](https://feeny.ai/job/growth-marketing-intern-sarvam-bengaluru-nd6d1ycn199k) — Bengaluru, India