---
title: 'Systems Architect AI/ML Infrastructure at Deepgram'
canonical: 'https://feeny.ai/job/systems-architect-ai-ml-infrastructure-deepgram-united-states-5yjkwhaa86vz'
type: 'job'
last_seen: '2026-09-13'
---

# Systems Architect AI/ML Infrastructure at Deepgram

- **Company:** Deepgram
- **Location:** United States
- **Compensation:** $160k–$239k
- **Employment:** full-time
- **Work type:** remote
- **Posted:** 2026-04-06
- **Last confirmed live:** 2026-09-13
- **Apply:** https://jobs.ashbyhq.com/deepgram/ff392127-1eb6-4fc7-838e-a3243923ba76/application

**Skills:** Infrastructure Engineering, Systems Architecture, Multi-cloud Architecture, AWS, Storage System Design, Compute Orchestration, Kubernetes, GPU Infrastructure, Capacity Planning, Networking Fundamentals, ML Training Workload Architecture, Distributed Training, Cost Optimization, FinOps, Colocation Management, Network Architecture Design, High-bandwidth GPU Interconnects, Infrastructure Modeling, Slurm, Ray

> Design and own end-to-end infrastructure architecture for Deepgram's AI/ML workloads, including production inference and research training. Build multi-cloud strategies, optimize costs, and manage compute, storage, and networking systems for large-scale voice AI operations.

## Job description

Company Overview Deepgram is the leading platform underpinning the emerging trillion-dollar Voice AI economy, providing real-time APIs for speech-to-text (STT), text-to-speech (TTS), and building production-grade voice agents at scale. More than 200,000 developers and 1,300+ organizations build voice offerings that are ‘Powered by Deepgram’, including Twilio, Cloudflare, Sierra, Decagon, Vapi, Daily, Cresta, Granola, and Jack in the Box. Deepgram’s voice-native foundation models are accessed through cloud APIs or as self-hosted and on-premises software, with unmatched accuracy, low latency, and cost efficiency. Backed by a recent Series C led by leading global investors and strategic partners, Deepgram has processed over 50,000 years of audio and transcribed more than 1 trillion words. There is no organization in the world that understands voice better than Deepgram.

Company Operating Rhythm At Deepgram, we expect an AI-first mindset—AI use and comfort aren’t optional, they’re core to how we operate, innovate, and measure performance. Every team member who works at Deepgram is expected to actively use and experiment with advanced AI tools, and even build your own into your everyday work. We measure how effectively AI is applied to deliver results, and consistent, creative use of the latest AI capabilities is key to success here. Candidates should be comfortable adopting new models and modes quickly, integrating AI into their workflows, and continuously pushing the boundaries of what these technologies can do. Additionally, we move at the pace of AI. Change is rapid, and you can expect your day-to-day work to evolve just as quickly. This may not be the right role if you’re not excited to experiment, adapt, think on your feet, and learn constantly, or if you’re seeking something highly prescriptive with a traditional 9-to-5.

The Opportunity Deepgram's infrastructure spans bare metal GPU clusters, multi-cloud deployments, and global edge presence -- all serving real-time voice AI at massive scale while simultaneously powering large-scale model training. As a Systems Architect, you will own the end-to-end infrastructure architecture that makes this possible. You will design the compute, storage, and networking systems that serve both production inference and research training workloads, build multi-cloud strategies that balance performance with cost, and create burstable infrastructure that scales with Deepgram's rapidly growing demands. This is a senior technical leadership role where your architectural decisions shape the foundation everything at Deepgram runs on.

## What You'll Do

- Define and drive the end-to-end infrastructure architecture for Deepgram's AI/ML workloads across production inference and research training
- Design multi-cloud and hybrid infrastructure strategies that balance performance, reliability, cost, and vendor flexibility
- Architect compute orchestration systems that efficiently schedule and manage GPU and CPU workloads across heterogeneous infrastructure
- Design storage architectures that handle the massive datasets required for speech and audio ML -- from high-throughput training data pipelines to low-latency model serving
- Lead capacity planning across all infrastructure dimensions, modeling growth and ensuring Deepgram can scale ahead of demand
- Drive cost optimization and FinOps practices, identifying opportunities to reduce infrastructure spend without compromising performance or reliability
- Design burstable, elastic training infrastructure that can scale up for large training runs and scale down to minimize idle cost
- Architect research compute infrastructure that gives ML teams the resources they need while maintaining operational efficiency
- Establish architectural standards, design review processes, and technical documentation practices for infrastructure decisions
- Collaborate with engineering leadership to align infrastructure strategy with product roadmap and business objectives
- Evaluate emerging hardware, cloud services, and infrastructure technologies for potential adoption

You'll Love This Role If You

- Think in systems -- you naturally see the connections between compute, storage, network, and how they interact under load
- Are motivated by designing infrastructure that operates at the intersection of real-time production systems and large-scale ML training
- Enjoy making architectural trade-offs where cost, performance, reliability, and velocity are all in tension
- Want to work across the full infrastructure stack -- from bare metal and GPUs to cloud services and container orchestration
- Are excited about building cost-effective, burstable infrastructure that enables world-class AI research
- Like operating at a strategic level while staying technically deep enough to validate designs and debug complex issues

It's Important To Us That You Have

- 7+ years of experience in infrastructure engineering, systems architecture, or a senior technical role focused on large-scale infrastructure
- Proven experience designing multi-cloud architectures spanning AWS and at least one other major cloud provider or on-premises environment
- Deep expertise in storage system design -- block, object, and file storage, including performance tuning for large-scale data workloads
- Strong experience with compute orchestration using Kubernetes, and an understanding of how to schedule diverse workloads efficiently
- Hands-on experience with GPU infrastructure -- procurement considerations, cluster design, driver and runtime management
- Track record of capacity planning and infrastructure scaling for high-growth environments
- Ability to communicate complex architectural decisions clearly to both technical and non-technical stakeholders
- Strong understanding of networking fundamentals as they relate to infrastructure architecture (see our Network Engineer role for the deep specialist)

It Would Be Great If You Had

- Direct experience architecting infrastructure for ML training workloads -- distributed training, large dataset management, experiment infrastructure
- Background in cost optimization and FinOps practices for large-scale cloud and bare metal infrastructure
- Experience operating and managing bare metal infrastructure in colocation facilities
- Expertise in network architecture design, including high-bandwidth GPU interconnects and global traffic routing
- Experience with infrastructure modeling and simulation for capacity planning
- Familiarity with Slurm, Ray, or other HPC/ML job scheduling systems
- Understanding of power, cooling, and physical infrastructure considerations for GPU-dense deployments

Notice: We're aware of individuals impersonating Deepgram recruiters. All legitimate Deepgram recruiting communication comes from an @[deepgram.com](http://deepgram.com) email address. If you've received a message claiming to be Deepgram, please forward it to careers@deepgram.com.

## About Deepgram

## Company Overview
- **One-liner**: Deepgram is a foundational AI company building real-time voice AI infrastructure for developers and enterprises to power speech-to-text, text-to-speech, and voice agent applications.
- **Entity Type**: Private (Series C, Unicorn status)
- **Headquarters**: San Francisco, California, USA (remote-first, distributed across 20+ states and 5+ countries)
- **Founded**: 2015
- **Founders**: Scott Stephenson (CEO), Adam Sypniewski, Noah Shutty

## Core Business
- **Primary industry**: Voice AI / Artificial Intelligence / Speech Recognition
- **Target customers**: Developers, product teams, enterprises, and platforms embedding voice AI (B2B, B2D)
- **Mission statement**: To transform the way humans interact with machines by unlocking the productivity of the world through voice technology

## Products & Services
- **Speech-to-Text (STT)**: Real-time and batch transcription with models like Nova-3 (world’s most accurate real-time STT) and Flux Multilingual (first conversational STT in 10 languages). Available via cloud or self-hosted. [deepgram.com](https://deepgram.com/)
- **Text-to-Speech (TTS)**: Aura-2, professional-grade enterprise TTS for natural voice output. [deepgram.com](https://deepgram.com/)
- **Voice Agent API**: A unified API that combines STT, TTS, and LLM orchestration into a single endpoint, reducing complexity, latency, and cost for building conversational AI agents. [deepgram.com](https://deepgram.com/)
- **Custom Models**: Ability to train custom speech models for unique use cases and domain-specific vocabulary. [deepgram.com](https://deepgram.com/)
- **Saga (Voice OS)**: An operating system for voice applications, announced as a platform-level offering. [linkedin.com](https://www.linkedin.com/company/deepgram)
- **Deepgram for Restaurants**: Vertical solution for drive-thru and restaurant voice ordering (95%+ containment), powered by the acquisition of OfOne. [linkedin.com](https://www.linkedin.com/company/deepgram)

## Market Standing
- **Valuation**: $1.3 billion unicorn status (as of Series C in 2024) [deepgram.com](https://deepgram.com/about)
- **Key Metric**: $130 million in Series C funding (total raised: ~$202M+ including $72M Series B) [deepgram.com](https://deepgram.com/about)
- **Notable Investors/Partners**: Y Combinator, NVIDIA (proud partner), with Series C led by prominent venture firms [ycombinator.com](https://www.ycombinator.com/companies/deepgram)
- **Growth Signals**: Processed 50,000+ years of audio and 1 trillion+ words; trusted by 200,000+ developers and 1,300+ organizations; acquired OfOne for restaurant voice AI; launched Flux Multilingual, Nova-3, Aura-2, and Saga in rapid succession [linkedin.com](https://www.linkedin.com/company/deepgram)

## Competitive Advantages
- **Foundational AI moat**: Deepgram is a research-driven company that builds its own end-to-end deep learning models (not wrappers), giving them control over accuracy, latency, and cost.
- **Unified API advantage**: A single Voice Agent API that replaces the need to stitch together separate STT, TTS, and LLM components—reducing complexity and latency.
- **Scale and experience**: The most experienced voice AI platform in the world, having processed the largest volume of voice data (50,000+ years of audio).
- **Enterprise-grade reliability**: Offers on-premise/self-hosted deployment options for compliance-heavy industries (healthcare, finance, legal).
- **NVIDIA partnership**: Access to scalable GPU infrastructure for training and inference, differentiating them from competitors.

## Strategic Focus
- **Voice AI Economy leadership**: Positioning Deepgram as the infrastructure layer for the emerging "trillion-dollar Voice AI economy."
- **Multilingual expansion**: Launching Flux Multilingual to capture global markets beyond English.
- **Vertical industry penetration**: Moving beyond horizontal API into vertical solutions (restaurants via OfOne acquisition, medical transcription).
- **Agentic AI**: Doubling down on Voice Agent API and autonomous voice agents as the next growth vector.
- **Platform expansion**: Building Saga (Voice OS) to become the operating system for all voice applications.

## Why Work Here
- **Remote-first culture**: Deepgram is a remote-first company with employees across 20+ states in the US and 5+ countries. They offer freedom and flexibility to work from anywhere. [deepgram.com](https://deepgram.com/careers)
- **Strong benefits package**: Medical, dental, vision insurance; mental health support; unlimited PTO; 12 paid US holidays; parental leave; 401(k) with company match; wellness stipend; learning/education stipend; quarterly productivity stipend; one-time office upgrade stipend. [deepgram.com](https://deepgram.com/careers)
- **Inclusive environment**: Active Employee Resource Groups (ERGs) and a stated commitment to "every voice, heard and understood." [deepgram.com](https://deepgram.com/careers)
- **Annual offsites**: While remote-first, the company convenes annually for in-person offsites to foster collaboration and connection. [deepgram.com](https://deepgram.com/careers)
- **Engineering culture**: Values include "be curious," "grow together," "do the right thing," "think smart, act fast," and "put the customer first." The culture is described as self-motivated, positive, passionate, and competitive. [deepgram.com](https://deepgram.com/careers)
- **Research-driven environment**: Deepgram was founded by physicists and maintains a strong research team (Research Scientist, Research Engineer roles), offering the chance to work on cutting-edge AI. [ycombinator.com](https://www.ycombinator.com/companies/deepgram)
- **Salary transparency**: Publicly lists salary ranges for roles (e.g., Research Scientist $150K-$250K, SDR $50K-$60K), indicating compensation transparency. [ycombinator.com](https://www.ycombinator.com/companies/deepgram)

## Sources
1. [deepgram.com - Careers Page](https://deepgram.com/careers)
2. [deepgram.com - Product Page](https://deepgram.com/)
3. [deepgram.com - About Page](https://deepgram.com/about)
4. [ycombinator.com - Deepgram Profile](https://www.ycombinator.com/companies/deepgram)
5. [linkedin.com - Deepgram Company Page](https://www.linkedin.com/company/deepgram)

## Other roles at Deepgram

- [People AI & Automation Engineer](https://feeny.ai/job/people-ai-automation-engineer-deepgram-united-states-akjthancr1e0) — United States
- [Staff Product Analyst (Product-Led Growth)](https://feeny.ai/job/staff-product-analyst-product-led-growth-deepgram-united-states-y9yx4qqcqe57) — United States
- [Associate General Counsel Corporate](https://feeny.ai/job/associate-general-counsel-corporate-deepgram-united-states-vmfe7xype1r6) — United States
- [Senior Commercial Counsel](https://feeny.ai/job/senior-commercial-counsel-deepgram-emea-j5bmzjzbpdh5) — EMEA
- [AI Data Readiness Lead](https://feeny.ai/job/ai-data-readiness-lead-deepgram-united-states-6jtn75s3fyd1) — United States
- [Talent Acquisition Manager](https://feeny.ai/job/talent-acquisition-manager-deepgram-united-states-37a7eh07z31n) — United States
- [Strategic Account Execustive (New York City)](https://feeny.ai/job/strategic-account-execustive-new-york-city-deepgram-new-york-pddfzv4pr2rs) — New York, NY
- [Executive Business Parter, Customer Success](https://feeny.ai/job/executive-business-parter-customer-success-deepgram-united-states-v8qhnkgewtt2) — United States
- [Senior Forward Deployed Engineer (FDE), Strategic Accounts](https://feeny.ai/job/senior-forward-deployed-engineer-fde-strategic-accounts-deepgram-new-york-g66c10a7xrb5) — New York, NY
- [Software Test Engineer](https://feeny.ai/job/software-test-engineer-deepgram-united-states-dhq28zwk1dr0) — United States