---
title: 'Forward Deployed Engineer at Deep Infra Inc.'
canonical: 'https://feeny.ai/job/forward-deployed-engineer-deep-infra-inc-palo-alto-sjcnm980d78b'
type: 'job'
last_seen: '2026-09-14'
---

# Forward Deployed Engineer at Deep Infra Inc.

- **Company:** Deep Infra Inc.
- **Location:** Palo Alto, CA
- **Compensation:** $150k–$195k
- **Employment:** full-time
- **Work type:** onsite
- **Posted:** 2026-08-14
- **Last confirmed live:** 2026-09-14
- **Apply:** https://jobs.gem.com/deep-infra/am9icG9zdDpqGXt9xT3SQ5Rqg4yXDKBF

## Job description

## About DeepInfra

DeepInfra is building the foundation for companies to use modern AI in production — simply, reliably, and at scale. Our team has deep experience building large systems that serve hundreds of millions of users, and we're bringing that same level of rigor to a rapidly evolving AI inference space. Our mission is to make advanced AI available to people and teams everywhere.

We're an early, tight-knit team where you can influence product direction, try bold ideas, and drive meaningful work forward quickly. If you want to join a fast-growing company at a defining moment, we'd love to talk.

DeepInfra is backed by leading investors including A.Capital, Felicis, 500 Global, Georges Harik, Samsung Next, Supermicro, Upper90, Peak6, SVAngel and Nvidia.

## Why this role matters

As DeepInfra's enterprise pipeline grows, our customers need a technical partner who can run rigorous evals, defend benchmarks, and speak fluently to both engineering and procurement — someone who can own the technical win from first call through production.

This is a pioneering role. You'll work closely with Sales, our co-founders, and the engineering team on the deals that matter most. You'll own the technical win end to end: running head-to-head bake-offs against leading AI providers, tuning deployments on the latest hardware, and turning what you learn into reusable assets that make every future deal faster to close. As our first FDE, you'll also define what the function looks like as GTM scales.

## What You'll Do

- Own the technical win and the POC timeline, working closely with Sales and Engineering, from call one.
- Design and run reproducible benchmark harnesses (TTFT, ITL, throughput/GPU, p95/p99) and quality-parity evals.
- Run head-to-head bake-offs against leading AI providers — and win them.
- Tune model-to-hardware deployments on B200/B300/GB300 NVL72.
- Build cost-per-token models and write migration plans.
- Handle enterprise security and compliance review, and get deployments to launch readiness.
- Own account health post-signature, driving usage reviews and expansion.
- Turn what you learn into reusable benchmark reports, reference architectures, and AE enablement material.

## What You Bring

- Customer-facing engineering with an owned technical outcome at an infrastructure or ML platform company.
- Strong Python skills.
- Dual-audience presence with commercial instinct — credible with a skeptical staff engineer, clear with a CFO, and able to tell a technical objection from a procurement one.

Bonus

- Hands-on experience with inference internals: vLLM, SGLang, or TRT-LLM, batching, KV cache math, quantization.
- Experience with agentic or coding-assistant workloads at scale.
- Prefix-cache-heavy long context workloads.
- Diffusion image/video, ASR/TTS, or multi-LoRA serving.
- Open-source contributions to vLLM or SGLang.
- Deep NVLink/InfiniBand topology knowledge.

## Why DeepInfra

- Define DeepInfra's Forward Deployed Engineering function from day one and have a direct impact on its direction.
- Work directly with co-founders and the inference team on the deals that matter most.
- Join a small, high-performing team where your work ships quickly and reaches customers around the world.
- Help shape how enterprises adopt some of the world's leading open-source AI models.

## How we work

Three traits define the people who thrive here, and this role leans on all three.

Initiative. We take ownership and step in where we can add value. Whether it’s starting something new, improving what exists, or helping move ideas forward, we aim to be proactive and thoughtful in how we contribute.

Drive. We’re energized by hard problems. Building AI infrastructure is complex, and we lean into that. We care about doing things well, moving fast, and continuously improving — because solving meaningful challenges is what motivates us.

Grit. Things don’t always work on the first try — and that’s expected. We stay persistent, adapt quickly, and learn as we go. We take setbacks seriously, but not personally, and use them to get better.

## About Deep Infra Inc.

## Company Overview
- **One-liner**: DeepInfra operates a purpose-built AI inference cloud that provides developer-friendly APIs for running open-source and proprietary machine learning models at scale.
- **Entity Type**: Private (Series B)
- **Headquarters**: Palo Alto, California, United States
- **Founded**: September 2022
- **Founders**: Nikola Borisov (CEO), Georgios Papoutsis, and Yessenzhar Kanapin

## Core Business
- **Primary industry/industries**: Artificial Intelligence / Machine Learning Infrastructure
- **Target customers**: B2B; startups, enterprises, and developers needing high-throughput, low-latency AI model inference.
- **Mission or purpose statement**: To provide a reliable, non-lock-in inference provider built on open-source models, giving companies full control over their AI stack with purpose-built, inference-optimized infrastructure from the GPU hardware layer up to the API.

## Products & Services
- **DeepInfra Inference API**: A developer-friendly, OpenAI-compatible API offering access to over 100 open-source and proprietary models (including GLM-5.3-Flash, Kimi K3). Features pay-as-you-go pricing with no long-term contracts.
- **Private GPU Clusters**: Dedicated NVIDIA B300 GPU clusters for enterprise customers, available on 5-year terms at significantly below-market rates (e.g., $1.98/GPU-hr vs. $6.50/GPU-hr on public cloud). Scales from 256 to 5,000 GPUs.
- **Custom Model Hosting**: A service allowing customers to deploy their own models on DeepInfra’s optimized infrastructure.

## Market Standing
- **Valuation/Market Cap**: Not publicly disclosed for the Series B round.
- **Key Metric (Funding)**: Total funding of approximately **$153.6M** across 5 rounds, according to LinkedIn. The most recent round was a **$107M Series B** co-led by 500 Global and Georges Harik, with participation from A.Capital Ventures, Crescent Cove, Felicis, NVIDIA, Peak6, Samsung Next, Supermicro, and Upper90.
- **Notable Investors/Partners**: NVIDIA, Felicis, 500 Global, Samsung Next, Supermicro, Peak6, A.Capital Ventures, Crescent Cove, Georges Harik.
- **Growth Signals**: 
    - Processes over **four trillion tokens per week**.
    - **25x token volume growth** since Series A.
    - Workforce grew **312.5% year-over-year** (to 27 employees).
    - LinkedIn follower count grew **160.7% Year-over-Year**.
    - Revenue estimated by LinkedIn at **$3.8M annually** (likely early-stage metric).

## Competitive Advantages
- **Vertically Integrated Infrastructure**: Unlike many competitors that run on top of public clouds, DeepInfra owns and operates its own GPU hardware in US-based data centers, giving it direct control over cost and performance.
- **Cost Leadership**: Advertising pricing up to 70% cheaper than public cloud alternatives for dedicated clusters (e.g., $1.98/GPU-hr for B300).
- **Enterprise Security & Compliance**: SOC 2 and ISO 27001 certified with a strict zero data retention policy, ensuring data privacy.
- **Open-Source Focus**: DeepInfra is built on the belief that open-source models are the future, offering a wide variety (100+ models) without vendor lock-in.

## Strategic Focus
- **Scale and Product Expansion**: The Series B funding is specifically earmarked for scaling the "inference cloud," likely meaning expanding GPU capacity and geographic footprint.
- **Supporting Agentic and Complex Workloads**: The platform is optimized for long-horizon agent tasks, coding, and complex multimodal workflows, indicating a focus on the most compute-intensive and emerging AI use cases.
- **Enterprise Deployments**: The offering of dedicated, long-term GPU clusters signals a push for larger, more stable enterprise contracts.

## Why Work Here
- **Culture & Impact**: DeepInfra operates at the core of the AI infrastructure boom. Employees get to work on hard performance engineering problems (every millisecond matters) that directly affect how AI products are built and scaled across the world.
- **Engineering DNA**: The leadership previously built the backend infrastructure for imo messenger, a platform with 1 billion+ downloads. The current team is engineering-heavy (45% of staff in technical roles) and is distributed across the US and Europe (Bulgaria, Poland, Turkey, Serbia).
- **Workplace**: The primary office is in Palo Alto, CA, with an **OnSite Workspace** policy (employees work from the physical office).
- **Perks & Growth**: As a high-growth startup (312.5% YoY headcount growth), DeepInfra offers significant opportunities for ownership and rapid career advancement.

## Sources
1. [deepinfra.com](https://deepinfra.com/)
2. [deepinfra.com](https://deepinfra.com/about)
3. [linkedin.com](https://linkedin.com/company/deep-infra)
4. [builtin.com](https://builtin.com/company/deep-infra-inc)
5. [cbinsights.com](https://www.cbinsights.com/company/deepinfra)

## Other roles at Deep Infra Inc.

- [Senior Account Executive](https://feeny.ai/job/senior-account-executive-deep-infra-inc-palo-alto-k9aysft4mave) — Palo Alto, CA
- [Software Engineer - Bulgaria, Early Career](https://feeny.ai/job/software-engineer-bulgaria-early-career-deep-infra-inc-sofia-8djq5yr8j0nt) — Sofia, Bulgaria
- [Software Engineer - Europe](https://feeny.ai/job/software-engineer-europe-deep-infra-inc-europe-93xwkwkg5qs3) — Europe
- [Software Engineer](https://feeny.ai/job/software-engineer-deep-infra-inc-palo-alto-gqbz109kbbs9) — Palo Alto, CA
- [Director of Marketing](https://feeny.ai/job/director-of-marketing-deep-infra-inc-palo-alto-knzrspg1kber) — Palo Alto, CA
- [Software Engineer - Europe, Early Career](https://feeny.ai/job/software-engineer-europe-early-career-deep-infra-inc-europe-90y77nwt3epx) — Europe
- [Software Engineer, Early Career](https://feeny.ai/job/software-engineer-early-career-deep-infra-inc-palo-alto-64q7yp6cea3d) — Palo Alto, CA
- [Software Engineer Intern (Europe)](https://feeny.ai/job/software-engineer-intern-europe-deep-infra-inc-europe-dkcrbbhn5zdh) — Europe
- [Software Engineer Intern (US)](https://feeny.ai/job/software-engineer-intern-us-deep-infra-inc-palo-alto-jrvjh1rz32dv) — Palo Alto, CA
- [Developer Relations](https://feeny.ai/job/developer-relations-deep-infra-inc-palo-alto-yxr1ap8fhr8f) — Palo Alto, CA