---
title: 'DevOps Engineer - AI Runtime Services at Demandbase'
canonical: 'https://feeny.ai/job/devops-engineer-ai-runtime-services-demandbase-hyderabad-edvdsga4zx1q'
type: 'job'
last_seen: '2026-10-15'
---

# DevOps Engineer - AI Runtime Services at Demandbase

- **Company:** Demandbase
- **Location:** Hyderabad, India
- **Employment:** full-time
- **Work type:** hybrid
- **Posted:** 2026-07-24
- **Last confirmed live:** 2026-10-15
- **Apply:** https://jobs.ashbyhq.com/demandbase/0cdcc3bc-843f-41d8-a6cc-fcc97f96c5ad

## Job description

Introduction to Demandbase: Demandbase is the only pipeline AI platform that empowers GTM teams to automate growth at scale. With a unified view of data, insights, actions, and outcomes, B2B enterprises can seamlessly align and execute their account-based GTM strategies with confidence. Thousands of businesses trust Demandbase to maximize revenue, minimize waste, and consolidate their data and tech stacks – all in one platform. As a company, we’re as committed to growing careers as we are to building world-class technology. We invest heavily in people, our culture, and the community around us. We have also continuously been recognized as One of The Best Places To Work in the San Francisco Bay Area by Fortune, and One of The 60 Best Companies To Sell For by Selling Power. Our offices are located in San Francisco, New York, Austin, Seattle, India, and the United Kingdom.

## About the Role

AI Runtime Services owns the shared runtime that AI at Demandbase runs on — two ways. First, it's the layer that enables and supports the AI features in the Demandbase platform: product teams ship LLM features on top of it without reinventing model access, spend control, safety, and observability. Second, the team builds and supports internal AI solutions — the tooling and services the company uses to work with LLMs day to day. The pillars underneath both: the LLM gateway, cost controls, observability, evals infra, caching, and guardrails. The surface is broad and the team is early. You won't be handed a narrow slice: expect to move across the gateway one week and the ingest pipeline the next — and across product-facing runtime and internal tooling — and to own what you build in production.

## What you'll own

- The LLM gateway. The single front door to every model provider we use — keys, routing, rate limits, failover, provider quotas. When it's down, every AI feature at Demandbase is down.
- Reliability, for real. SLOs, on-call, incident response, and the postmortems for the runtime. This is a genuine SRE ownership role, not "build it and let someone else run it."
- Cost control. Per-team and per-model attribution, budgets, quotas. LLM spend is the kind of line item that quietly triples; your job is to make it legible and then make it smaller.
- LLM observability. Traces, spans, prompt/response capture, ingest and billing visibility for every AI feature in the company.
- Evals and experimentation infra. The shared harnesses, datasets, and scoring plumbing product teams use to know whether a prompt or model change actually made things better.
- Caching and guardrails. Response and semantic caching to cut latency and redundant spend; input/output safety, PII handling, and policy enforcement at the gateway.

## What we need

- Strong production infrastructure background: Kubernetes, AWS, Terraform, GitOps. You've operated systems that people were paged for, and you've been the one paged.
- Python, at a level where you're comfortable owning services and tooling in it — not just scripting.
- Real on-call and incident-response experience. You can talk about an incident you ran, what you got wrong, and what you changed afterward.
- Observability fluency beyond "we have dashboards": you've instrumented systems, chased cardinality and cost in a metrics/logging backend, and built alerts that fire when they should.
- Hands-on familiarity with how LLM systems actually work. You don't need production ML experience. But you need to have built something with these tools — an agent, a RAG pipeline, an internal tool — and to have used evals or experiments to decide whether it was any good. Tokens, context windows, prompt/response tracing, and why an eval suite is fundamental should all be familiar ground. Candidates who have only read about this are not a fit.

## Nice to have

- An LLM gateway or proxy (LiteLLM or similar) in production.
- LLM observability tooling: Datadog LLM Observability, LangSmith, Braintrust, Arize, or similar.
- Eval frameworks and LLM-as-judge scoring in a real workflow, not a demo.
- FinOps instincts — cost attribution, showback, quota design.
- Guardrails, PII detection, or content-filtering systems.
- GCP alongside AWS.

## Our stack

AWS - GCP · EKS, Flux/GitOps, Karpenter · Python · LiteLLM · Datadog (LLM observability, APM) · Prometheus, Loki, ClickHouse · Terraform · GitLab CI

## Benefits

Our benefits include Group Medical, Personal Accident, and Term Life Insurance for comprehensive protection. Preventive healthcare covers dental, vision, and OPD needs, complemented by strong mental health support. We also provide a fitness benefit, car lease policy, and gratuity for long-term financial well-being. Our Commitment to Diversity, Equity, and Inclusion at Demandbase At Demandbase, we believe in creating a workplace culture that values and celebrates diversity in all its forms. We recognize that everyone brings unique experiences, perspectives, and identities to the table, and we are committed to building a community where everyone feels valued, respected, and supported. Discrimination of any kind is not tolerated, and we strive to ensure that every individual has an equal opportunity to succeed and grow, regardless of their gender identity, sexual orientation, disability, race, ethnicity, background, marital status, genetic information, education level, veteran status, national origin, or any other protected status. We do not automatically disqualify applicants with criminal records and will consider each applicant on a case-by-case basis. We recognize that not all candidates will have every skill or qualification listed in this job description. If you feel you have the level of experience to be successful in the role, we encourage you to apply! We acknowledge that true diversity and inclusion requires ongoing effort, and we are committed to doing the work required to make our workplace a safe and equitable space for all. Join us in building a community where we can learn from each other, celebrate our differences, and work together. Unsolicited Submissions At Demandbase, we value thoughtful partnerships and direct connections with candidates. We’re not accepting unsolicited resumes or outreach from third-party recruiting agencies. Any unsolicited submissions will not be reviewed, and no fees will be paid.

## About Demandbase

## Company Overview
- **One-liner**: Demandbase provides a Pipeline AI platform that helps B2B go-to-market teams unify data, target the right accounts, and automate pipeline generation.
- **Entity Type**: Private (growth stage, backed by venture capital)
- **Headquarters**: San Francisco, California, USA (office locations also include Austin, Texas) [demandbase.com/about-us/careers/job-openings]
- **Founded**: 2006 [demandbase.com/about-us]
- **Founders**: Chris Golec (original founder); current CEO is Gabe Rogol [demandbase.com/about-us]

## Core Business
- **Primary industry/industries**: B2B marketing & sales technology, specifically Account-Based Marketing (ABM) and pipeline intelligence.
- **Target customers**: B2B enterprises and mid-market companies; customers include marketing, sales, revenue operations, and customer success teams.
- **Mission or purpose statement**: "Transform how B2B companies go to market" and make growth feel "automatic" by connecting people, processes, and platforms [demandbase.com/about-us].

## Products & Services
- **Sales Intelligence**: Provides account-level activity, buying group identification, and prioritized outreach guidance for sellers [demandbase.com].
- **Advertising**: Enables targeted ad programs across channels to engage in-market accounts and buying groups [demandbase.com].
- **Data**: Unifies firmographic, technographic, intent, account identification, and contact data to power the platform [demandbase.com].
- **Pipeline AI** (flagship): Combines signals from across the platform to automate go-to-market execution, prioritize opportunities, and measure pipeline impact [demandbase.com/about-us].

## Market Standing
- **Valuation/Market Cap**: Not publicly disclosed (private company).
- **Key Metric**: Annual revenue not publicly available; total funding not specified in search results. Company reports 1,000+ customers, 750+ employees, and a 367% average customer ROI [demandbase.com/about-us].
- **Notable Investors/Partners**: Not listed in provided results; the company has made multiple acquisitions (InsideView, DemandMatrix, Engagio, Spiderbook) suggesting strong backing [demandbase.com/about-us].
- **Growth Signals**: 367% average customer ROI, 750+ employees, ISO/IEC 27001 certification, and ongoing product innovation with Pipeline AI [demandbase.com/about-us].

## Competitive Advantages
- **Unified go-to-market platform**: Combines data, sales intelligence, advertising, and orchestration in one system, reducing reliance on fragmented tools [demandbase.com].
- **AI-driven pipeline engine**: Uses artificial intelligence to analyze signals, identify buying groups, and automate cross-functional actions [demandbase.com].
- **Deep B2B focus**: Decades of ABM and intent data expertise, reinforced by strategic acquisitions [demandbase.com/about-us].
- **Strong customer support**: Rated 4.9/5 stars for customer support [demandbase.com/about-us].

## Strategic Focus
- **Pipeline AI**: The company is doubling down on AI to make go-to-market execution "automatic" and more predictable [demandbase.com/about-us].
- **Cross-functional orchestration**: Aligning marketing, sales, and customer success around shared pipeline priorities [demandbase.com].
- **Data quality and unification**: Ongoing investment in comprehensive B2B data (firmographics, technographics, intent, contacts) to power the platform [demandbase.com/about-us].

## Why Work Here
- **Hybrid work environment**: Full-time remote, office-based, or hybrid depending on role and location [demandbase.com/about-us/careers].
- **Culture**: Inclusive and open with employee resource groups (AAPI Rise, Women’s Group, Neurodiverse@DB, DBQ LGBTQ+), transparency, and recognition [demandbase.com/about-us/careers].
- **Benefits**: Stock options for all employees, flexible time off plus two company-wide week-long breaks, health & wellness plans (medical, dental, vision, 401k, Modern Health, Headspace), family-friendly benefits including parental leave for all caregivers [demandbase.com/about-us/careers].
- **Professional development**: Leadership training, coaching, learning days, and subscriptions to Masterclass, Coursera, A Cloud Guru, and Pavilion [demandbase.com/about-us/careers].
- **Current openings**: Roles in Engineering (e.g., Principal Software Engineer, Applied AI Scientist), Sales, Marketing, Customer Success, and Finance, with US-remote or Austin/San Francisco locations [demandbase.com/about-us/careers/job-openings].

## Sources
1. [demandbase.com](https://www.demandbase.com/)
2. [demandbase.com/about-us](https://www.demandbase.com/about-us/)
3. [demandbase.com/about-us/careers](https://www.demandbase.com/about-us/careers/)
4. [demandbase.com/about-us/careers/job-openings](https://www.demandbase.com/about-us/careers/job-openings/)
5. [linkedin.com/company/demandbase](https://www.linkedin.com/company/demandbase)

## Other roles at Demandbase

- [Senior Security Engineer](https://feeny.ai/job/senior-security-engineer-demandbase-hyderabad-yac347svb80t) — Hyderabad, India
- [Advertising Campaign Strategist](https://feeny.ai/job/advertising-campaign-strategist-demandbase-united-states-1n9tp7bht6p7) — United States
- [Staff DevOps Engineer, Developer Experience (DevEx)](https://feeny.ai/job/staff-devops-engineer-developer-experience-devex-demandbase-united-states-d4d9fgemk3c9) — United States
- [Senior FP&A Manager](https://feeny.ai/job/senior-fp-a-manager-demandbase-united-states-5gzbvarr0e5m) — United States
- [Senior Customer Lifecycle Marketing Manager](https://feeny.ai/job/senior-customer-lifecycle-marketing-manager-demandbase-united-states-cxx90wsgcfck) — United States
- [Senior Product Manager, AI Adoption & Growth](https://feeny.ai/job/senior-product-manager-ai-adoption-growth-demandbase-united-states-7mt1p5fcd1wf) — United States
- [Advertising Account Director, Mid-Market](https://feeny.ai/job/advertising-account-director-mid-market-demandbase-united-states-4qy929cgasww) — United States
- [Customer Success Manager II](https://feeny.ai/job/customer-success-manager-ii-demandbase-london-qnbjgjcrxz7r) — London, United Kingdom
- [Global Payroll Manager](https://feeny.ai/job/global-payroll-manager-demandbase-united-states-kqzy8cdt7hq2) — United States
- [Machine Learning Engineer II](https://feeny.ai/job/machine-learning-engineer-ii-demandbase-hyderabad-57wxgbn4taf9) — Hyderabad, India