---
title: 'Senior Infrastructure Engineer at Deep Infra Inc.'
canonical: 'https://feeny.ai/job/senior-infrastructure-engineer-deep-infra-inc-palo-alto-nv00kz3p7edg'
type: 'job'
last_seen: '2026-10-19'
---

# Senior Infrastructure Engineer at Deep Infra Inc.

- **Company:** Deep Infra Inc.
- **Location:** Palo Alto, CA
- **Compensation:** $180k–$210k
- **Employment:** full-time
- **Work type:** onsite
- **Posted:** 2026-10-07
- **Last confirmed live:** 2026-10-19
- **Apply:** https://jobs.gem.com/deep-infra/am9icG9zdDoTo9ts6bn9YxgFYMI8p4tS

## Job description

## About DeepInfra

DeepInfra is building the foundation for companies to use modern AI in production — simply, reliably, and at scale. Our team has deep experience building large systems that serve hundreds of millions of users, and we're bringing that same level of rigor to a rapidly evolving AI inference space. Our mission is to make advanced AI available to people and teams everywhere.

We're an early, tight-knit team where you can influence product direction, try bold ideas, and drive meaningful work forward quickly. If you want to join a fast-growing company at a defining moment, we'd love to talk.

DeepInfra is backed by leading investors including A.Capital, Felicis, 500 Global, Georges Harik, Samsung Next, Supermicro, Upper90, Peak6, SVAngel, and NVIDIA.

## Why This Role Matters

Demand for AI inference is growing fast, and DeepInfra runs on GPU infrastructure we own and operate. Every new site, rack, and network link we bring online translates directly into capacity our customers can build on — so how quickly, reliably, and cost-effectively we expand our physical footprint is central to how we grow.

This role spans the full lifecycle of that expansion. You'll find and evaluate data center space, negotiate with colocation and hardware vendors, design and build the networks that tie our clusters together, and run the projects that take a site from signed contract to serving production traffic. You'll work closely with Engineering and our co-founders, and you'll be as comfortable reviewing a colo contract as you are on the data center floor with a console cable.

## What You'll Do

- Design, build, and operate high-performance data center networks — including spine/leaf fabrics, BGP, transit and peering, and network security — across multiple colocation sites.
- Own site bring-ups end to end: low- and high-level designs, capacity planning, rack and power layouts, cabling plans, hardware installation, turn-up, and handoff to production.
- Operate and improve the underlying infrastructure that our compute platform runs on, with strong Linux fundamentals, monitoring, and automation.
- Run infrastructure projects across multiple vendors and sites, managing timelines, dependencies, shipment and logistics coordination, and risk.
- Travel to data centers to install, connect, and troubleshoot hardware alongside remote-hands and vendor teams.
- Serve as the primary technical point of contact for data center vendors and for customers whose infrastructure we manage.
- Build repeatable playbooks, standards, and automation that make every new site faster to stand up than the last.

## What You Bring

- Experience: 10+ years building and operating infrastructure for 24/7 production environments, including significant hands-on experience with data center infrastructure and networking.
- Data Center Networking: Deep experience designing and operating high-performance data center networks, including spine/leaf or Clos architectures, BGP, and network security. Experience with EVPN/VXLAN, transit, and peering is strongly preferred.
- Site Deployment: Experience bringing colocation or data center infrastructure online, including network design, rack layouts, cabling, hardware installation, turn-up, and coordination with on-site or remote-hands teams.
- Infrastructure Operations: Strong Linux fundamentals and the ability to troubleshoot across networking, compute, storage, and the physical layer.
- Automation: Strong scripting and automation skills using Python, Bash, Ansible, or similar tools.
- Project Ownership: Proven ability to drive complex infrastructure projects across multiple vendors, dependencies, and locations from planning through production.
- Vendor Management: Experience working directly with data center, network, or hardware vendors. Experience with capacity planning, procurement, or commercial negotiations is a strong plus.

## Preferred Qualifications

- Experience deploying GPU infrastructure, including high-speed interconnects such as InfiniBand or RoCE and high-density power and cooling environments.
- On-prem private cloud experience with KVM, Proxmox, OpenStack, Ceph, or similar technologies.
- Kubernetes and containers in production, along with observability tooling such as Prometheus and Grafana.
- Experience managing internet resources at scale, including ASNs, IP prefixes, IRR records, and routing policy with ISPs and IXPs.
- Experience owning hardware procurement, colocation contracts, capacity planning, or infrastructure vendor negotiations.
- Source, evaluate, and secure data center and colocation space across power, cooling, density, connectivity, and cost.
- Lead commercial negotiations with data center, network, and hardware vendors across pricing, contract terms, SLAs, and expansion options.

## How We Work

Three traits define the people who thrive here, and this role leans on all three.

Initiative. We take ownership and step in where we can add value. Whether it's starting something new, improving what exists, or helping move ideas forward, we aim to be proactive and thoughtful in how we contribute.

Drive. We're energized by hard problems. Building AI infrastructure is complex, and we lean into that. We care about doing things well, moving fast, and continuously improving — because solving meaningful challenges is what motivates us.

Grit. Things don't always work on the first try — and that's expected. You'll balance negotiations, network design, and hands-on site work at once, often across multiple vendors, time zones, and shifting delivery timelines. We stay persistent, adapt quickly, and learn as we go.

## About Deep Infra Inc.

## Company Overview
- **One-liner**: DeepInfra operates a purpose-built AI inference cloud that provides developer-friendly APIs for running open-source and proprietary machine learning models at scale.
- **Entity Type**: Private (Series B)
- **Headquarters**: Palo Alto, California, United States
- **Founded**: September 2022
- **Founders**: Nikola Borisov (CEO), Georgios Papoutsis, and Yessenzhar Kanapin

## Core Business
- **Primary industry/industries**: Artificial Intelligence / Machine Learning Infrastructure
- **Target customers**: B2B; startups, enterprises, and developers needing high-throughput, low-latency AI model inference.
- **Mission or purpose statement**: To provide a reliable, non-lock-in inference provider built on open-source models, giving companies full control over their AI stack with purpose-built, inference-optimized infrastructure from the GPU hardware layer up to the API.

## Products & Services
- **DeepInfra Inference API**: A developer-friendly, OpenAI-compatible API offering access to over 100 open-source and proprietary models (including GLM-5.3-Flash, Kimi K3). Features pay-as-you-go pricing with no long-term contracts.
- **Private GPU Clusters**: Dedicated NVIDIA B300 GPU clusters for enterprise customers, available on 5-year terms at significantly below-market rates (e.g., $1.98/GPU-hr vs. $6.50/GPU-hr on public cloud). Scales from 256 to 5,000 GPUs.
- **Custom Model Hosting**: A service allowing customers to deploy their own models on DeepInfra’s optimized infrastructure.

## Market Standing
- **Valuation/Market Cap**: Not publicly disclosed for the Series B round.
- **Key Metric (Funding)**: Total funding of approximately **$153.6M** across 5 rounds, according to LinkedIn. The most recent round was a **$107M Series B** co-led by 500 Global and Georges Harik, with participation from A.Capital Ventures, Crescent Cove, Felicis, NVIDIA, Peak6, Samsung Next, Supermicro, and Upper90.
- **Notable Investors/Partners**: NVIDIA, Felicis, 500 Global, Samsung Next, Supermicro, Peak6, A.Capital Ventures, Crescent Cove, Georges Harik.
- **Growth Signals**: 
    - Processes over **four trillion tokens per week**.
    - **25x token volume growth** since Series A.
    - Workforce grew **312.5% year-over-year** (to 27 employees).
    - LinkedIn follower count grew **160.7% Year-over-Year**.
    - Revenue estimated by LinkedIn at **$3.8M annually** (likely early-stage metric).

## Competitive Advantages
- **Vertically Integrated Infrastructure**: Unlike many competitors that run on top of public clouds, DeepInfra owns and operates its own GPU hardware in US-based data centers, giving it direct control over cost and performance.
- **Cost Leadership**: Advertising pricing up to 70% cheaper than public cloud alternatives for dedicated clusters (e.g., $1.98/GPU-hr for B300).
- **Enterprise Security & Compliance**: SOC 2 and ISO 27001 certified with a strict zero data retention policy, ensuring data privacy.
- **Open-Source Focus**: DeepInfra is built on the belief that open-source models are the future, offering a wide variety (100+ models) without vendor lock-in.

## Strategic Focus
- **Scale and Product Expansion**: The Series B funding is specifically earmarked for scaling the "inference cloud," likely meaning expanding GPU capacity and geographic footprint.
- **Supporting Agentic and Complex Workloads**: The platform is optimized for long-horizon agent tasks, coding, and complex multimodal workflows, indicating a focus on the most compute-intensive and emerging AI use cases.
- **Enterprise Deployments**: The offering of dedicated, long-term GPU clusters signals a push for larger, more stable enterprise contracts.

## Why Work Here
- **Culture & Impact**: DeepInfra operates at the core of the AI infrastructure boom. Employees get to work on hard performance engineering problems (every millisecond matters) that directly affect how AI products are built and scaled across the world.
- **Engineering DNA**: The leadership previously built the backend infrastructure for imo messenger, a platform with 1 billion+ downloads. The current team is engineering-heavy (45% of staff in technical roles) and is distributed across the US and Europe (Bulgaria, Poland, Turkey, Serbia).
- **Workplace**: The primary office is in Palo Alto, CA, with an **OnSite Workspace** policy (employees work from the physical office).
- **Perks & Growth**: As a high-growth startup (312.5% YoY headcount growth), DeepInfra offers significant opportunities for ownership and rapid career advancement.

## Sources
1. [deepinfra.com](https://deepinfra.com/)
2. [deepinfra.com](https://deepinfra.com/about)
3. [linkedin.com](https://linkedin.com/company/deep-infra)
4. [builtin.com](https://builtin.com/company/deep-infra-inc)
5. [cbinsights.com](https://www.cbinsights.com/company/deepinfra)

## Other roles at Deep Infra Inc.

- [Software Engineer - Bulgaria, Early Career](https://feeny.ai/job/software-engineer-bulgaria-early-career-deep-infra-inc-sofia-mb9gs5fdqhs0) — Sofia, Bulgaria
- [Sales Development Representative](https://feeny.ai/job/sales-development-representative-deep-infra-inc-palo-alto-769zgtqfmkr4) — Palo Alto, CA
- [Customer Success Engineer](https://feeny.ai/job/customer-success-engineer-deep-infra-inc-sofia-8h4nj57n9k24) — Sofia, Bulgaria
- [Billing & Payments Manager](https://feeny.ai/job/billing-payments-manager-deep-infra-inc-palo-alto-7vh5478a6d10) — Palo Alto, CA
- [Corporate Controller](https://feeny.ai/job/corporate-controller-deep-infra-inc-palo-alto-ajhnkpeva2r1) — Palo Alto, CA
- [Director, FP&A](https://feeny.ai/job/director-fp-a-deep-infra-inc-palo-alto-2yapyr66sw47) — Palo Alto, CA
- [Software Engineer (Sofia, Bulgaria)](https://feeny.ai/job/software-engineer-sofia-bulgaria-deep-infra-inc-sofia-qjs3bg5aew8z) — Sofia, Bulgaria
- [Product Marketing Director](https://feeny.ai/job/product-marketing-director-deep-infra-inc-palo-alto-6czntr73bbw2) — Palo Alto, CA
- [Forward Deployed Engineer](https://feeny.ai/job/forward-deployed-engineer-deep-infra-inc-palo-alto-sjcnm980d78b) — Palo Alto, CA
- [Senior Account Executive](https://feeny.ai/job/senior-account-executive-deep-infra-inc-palo-alto-k9aysft4mave) — Palo Alto, CA