--- title: 'Software Engineer - Member of Technical Staff (Platform) at Mithril' canonical: 'https://feeny.ai/job/software-engineer-member-of-technical-staff-platform-mithril-palo-alto-cmara03nvrzv' type: 'job' last_seen: '2026-10-14' --- # Software Engineer - Member of Technical Staff (Platform) at Mithril - **Company:** Mithril - **Location:** Palo Alto, CA / San Francisco, CA - **Work type:** onsite - **Posted:** 2026-04-22 - **Last confirmed live:** 2026-10-14 - **Apply:** https://job-boards.greenhouse.io/mithril/jobs/5117511007 ## Job description ## About Mithril Mithril is an AI infrastructure platform built to make GPU compute more accessible and affordable for the world’s leading enterprises, AI startups, and the AI research community, including LG AI Research, Saronic, and the Broad Institute (among many others). Founded by a former Google DeepMind research scientist and Stanford CS PhD, Mithril has raised $80M across seed and Series A funding led by Sequoia Capital & Lightspeed Venture Partners. Platform revenue has grown >6x over the past year, and we were recently recognized by Fast Company as the 8th Most Innovative Company in Artificial Intelligence for 2026. We are at an inflection point: transitioning from bare-metal operations to a cloud-native, multi-provider platform with a differentiated auction and flexibility model. You would be joining at the moment the platform is being built, not inherited. ## About the Opportunity You will work across Mithril's three core engineering areas — Consumption (the developer-facing product, billing, and API surface), Platform (the orchestration and marketplace engine), and Supply (integrations with cloud providers and capacity management). You will own meaningful slices of each, shipping features end-to-end against a product that handles real revenue and business-critical customer workloads. This is not a single-domain role. You'll move between backend systems, marketplace logic, and customer-facing surfaces — with direct exposure to the architectural decisions shaping how Mithril scales. What Makes This Role Different Most early-stage engineering roles at infrastructure companies are either deep in systems (little product surface) or deep in product (little systems exposure). At Mithril, you'll work across both: the orchestration engine that manages GPU capacity across providers, and the developer-facing surfaces that customers use to reserve, bid, and consume that capacity. The systems you build will handle real money, real workloads, and real market dynamics — spot auctions, reservation pricing, and capacity allocation across a heterogeneous supply base. If you want to understand how GPU infrastructure markets actually work and build the systems that run them, this is that role. Core Responsibilities Backend & API - Build and maintain backend Python APIs powering Mithril's reservation, bidding, billing, and usage surfaces — including usage visualization and the billing platform. - Write and maintain database migrations, design relational schemas for complex multi-entity models (orders, allocations, grants, quotas), and optimize queries for performance. - Own features end-to-end: from design doc through backend API, database migration, feature flag rollout, and monitoring. Platform & Marketplace - Design and implement orchestration primitives for flexible reservations: pause/return credits, reservation extensions, capacity algorithm updates, and the auction model connecting spot and reserved capacity. - Contribute to operational maturity — quota systems, financial controls, fraud prevention, and inventory management automation — so Mithril can scale supply sources without scaling headcount linearly. Supply Integrations - Contribute to supply-side integrations, bringing GCP, Nebius, and OCI resources under Mithril management through the Mithril API. - Build tooling to give operators visibility into managed capacity and surface supply constraints early. Consumption & Developer Tooling - Build consumption tooling to help developers make better decisions: reservation calculators, bid modeling, cost dashboards, and CLI extensions. - Work across the client frontend to ship customer-facing features including usage graphs, billing views, and reservation management UIs. Operations - Participate in on-call rotations, triage production incidents, and contribute to operational runbooks and automation that reduce toil over time. ## Requirements The profile we're hiring for is a generalist with strong backend instincts — someone who has shipped and maintained production systems at real scale, and is comfortable owning features across the full stack when needed. - Strong Python backend skills — you've built and maintained production APIs at real scale, not just prototypes. - Proven experience with distributed systems; comfortable with messaging systems (RabbitMQ, Kafka) and RPC methods (gRPC, protobuf, tRPC). - Fluency with relational databases: schema design, query optimization, and migrations in production environments. - Ability to own a feature end-to-end — from design doc through backend API, database migration, feature flag rollout, and monitoring. - Strong debugging instincts: calm and systematic when triaging production incidents, with a bias toward durable fixes. - Comfortable in small teams where ownership is high and process is lightweight. ## Nice to Have - Experience with marketplace and billing systems — especially variable-usage, auction-based, or complex reservation models. - Familiarity with Kubernetes, AWS infrastructure, or cloud provider APIs (GCP, OCI, Nebius). - Familiarity with Linux containers and container orchestration (Docker Swarm, Nomad). - Comfort working across the stack — Python backend and TypeScript/React frontend. - Experience with developer tools or CLIs (bonus: SkyPilot or similar frameworks). - Proficiency with infrastructure-as-code (Terraform, Kustomize) or observability tooling (Grafana, Prometheus). - Background in real-time systems: SSE, WebSockets, or event-driven architectures. - Prior experience at a startup where you wore multiple hats and shipped across domains. ## Benefits - Health, dental, and vision coverage for you and your dependents - 401k Plan with company match - 14 company holidays; including 2 floating holidays Salary Range Information In consideration of market analysis and various pertinent factors, the remuneration bracket for this role is set between $170,000 and $230,000. Nevertheless, adjustments beyond this range could be warranted for candidates whose qualifications substantially deviate from those delineated in the job description. In-Office Requirement At Mithril, we take our work extremely seriously, though not always ourselves. We recognize that we are striving to achieve something substantial—an all-too-rare and elusive counterfactual contribution. Our work is not easy, so we seek out any lever that can accelerate our progress and increase the likelihood of realizing our full ambitions. Working collaboratively in person is one such lever. Our headquarters is in Palo Alto (very near the Caltrain station) and we recently opened a second office in the Jackson Square area of San Francisco. We expect team members to primarily work from their local office (Palo Alto or SF), with everyone gathering at HQ a minimum one day a week while our team remains small and cross-collaboration is critical. This approach is built on trust. We take our mission seriously and are committed to fostering an environment where you can make impactful decisions and drive success. We also understand that life can present challenges, and if extenuating circumstances arise, we’re here to support you. Ultimately, we believe this guidance helps us be as effective as possible while maintaining the spirit of teamwork and flexibility. ## Equal Opportunity Employer Mithril maintains a strict commitment to Equal Opportunity employment practices. All applicants are evaluated without regard to race, color, religion, creed, national origin, age, sex, gender, marital status, sexual orientation and identity, genetic information, veteran status, citizenship, or any other factors prohibited by local, state, or federal law. We emphasize that candidates need not fulfill every expectation listed to be eligible for this position. Our objective is to cultivate a diverse team encompassing a spectrum of backgrounds, experiences, and skill sets. ## About Mithril ## Company Overview - **One-liner**: Mithril is an AI infrastructure platform that provides transparent, multi-provider GPU compute access through a unified "omnicloud" with real-time pricing and spot bidding. - **Entity Type**: Private (startup, Series A) - **Headquarters**: Palo Alto, California, United States - **Founded**: 2022 - **Founders**: Jared Quincy Davis (CEO and Co-Founder), Liam (Co-Founder & CTO) ## Core Business - Primary industry: AI Infrastructure / Cloud Computing / GPU-as-a-Service - Target customers: AI research labs, AI startups, and enterprises running ML training, fine-tuning, inference, and batch processing workloads - Mission statement: "Make cloud compute more accessible, efficient, and powerful for AI developers" — orchestrating the world’s compute to render it universally accessible ## Products & Services - **Mithril Omnicloud Compute**: A single platform that aggregates and orchestrates multi-cloud GPUs (NVIDIA A100s, H100s, H200s), CPUs, and storage. Users can spin up GPU VMs via instant, hourly reservations or spot bids with transparent, real-time pricing. - **Mithril Batch Inference API**: Token-based API purpose-built for large-scale batch inference, capable of processing 500M+ tokens per day by default. - **Flow SDK**: A batch job SDK for launching general-purpose ML workloads asynchronously on spot instances, with pause/resume functionality. - **High-Performance Storage**: Co-located WEKA block and fileshare storage for maximum workload performance. - **InfiniBand Networking**: Pre-configured interconnect for distributed workloads. ## Market Standing - **Valuation/Market Cap**: Not disclosed - **Total Funding**: $100M across two rounds (Seed + Series A) - **Key Funding Rounds**: - Seed Round (2023-09-01): $20M led by 6 investors - Series A (2024-03-21): $80M led by **Sequoia Capital** and **Lightspeed Venture Partners**, with 6 investors total - **Key Metric**: Platform revenue grew **>6x over the past year** (as of mid-2025) - **Notable Investors/Advisors**: Sequoia Capital, Lightspeed Venture Partners, Pieter Abbeel (Reinforcement learning pioneer, advisor), Jure Leskovec (advisor), Ion Stoica (Executive Chairman) - **Notable Customers/Partners**: Arc Institute, Cursor, LG AI Research, Sar... (formerly), Broad Institute - **Recognition**: Fast Company's #8 Most Innovative Company in Artificial Intelligence for 2025 - **Growth Signals**: Company is at an inflection point, transitioning from bare-metal operations to a platform with real revenue and developer-friendly abstractions. ## Competitive Advantages - **Omnicloud Aggregation**: Aggregates supply from multiple cloud providers into a single fluid market, allowing users to benefit from dynamic pricing as supply increases — unlike single-provider clouds. - **Algorithmic, Transparent Pricing**: Compute prices are set algorithmically based on supply and demand, visible in real-time — no negotiation required, removing the friction of legacy procurement models. - **Auction & Flexibility Model**: Unique spot bidding system (pause/resume, time-limited bidding) combined with instant hourly reservations, giving users flexibility to burst compute or optimize costs. - **Deep AI/ML Pedigree**: Founded by alumni from Google DeepMind’s core Deep Learning team and Stanford’s CS PhD program — rare depth spanning ML theory, distributed systems, and financial modeling. - **Purpose-Built for AI Workloads**: Infrastructure specifically designed for training, fine-tuning, inference, and batch jobs, with NVIDIA GPUs and InfiniBand interconnect pre-configured. ## Strategic Focus - **Scaling the Omnicloud**: Aggregating more compute providers to increase supply and drive down costs for users, expanding the marketplace depth. - **Building Developer Abstractions**: Continuing to develop the Batch Inference API and Flow SDK to make omnicloud compute effortless to harness, moving beyond raw infrastructure. - **Expanding Enterprise & Research Reach**: Attracting more leading AI labs, enterprises, and startups — targeting teams building AI systems who shouldn’t have to spend time on capacity planning. - **Monetizing Platform Revenue**: Transitioning from bare-metal operations to a sustainable, revenue-generating platform business. ## Why Work Here - **Culture & Mission**: "We believe that infrastructure must be simple, powerful, and universally accessible." The team is described as a group of researchers, engineers, economic experts, and GTM leaders with a strong technical ethos. Core values emphasize a **"work environment being built, not inherited"** and a focus on solving the "root node problems" of AI infrastructure. - **Remote/Hybrid Policy**: Roles are listed as based in **Palo Alto / San Francisco Bay Area** (in-office), with remote presence in Brazil, Netherlands, and Canada. Most engineering roles appear to be Bay Area on-site. - **Headcount & Growth**: Currently **23 employees** (as of mid-2026), up ~2.8% YoY. Small, nimble team with high ownership. Active job postings (4 open roles) suggest hiring momentum in engineering and finance. - **Engineering Focus**: 38% of staff is technical. Open roles include Software Engineer (MTS) for Platform and Consumption teams, and Site Reliability Engineer (SRE). Engineers work on distributed systems, capacity orchestration, marketplace dynamics, and billing. - **Notable Perks**: Opportunity to join a well-funded (Sequoia, Lightspeed) startup at an inflection point, with direct impact on AI infrastructure that serves prominent research labs and enterprises. Access to deep expertise from Stanford/DL alumni and advisors. - **Talent Sources**: Prior employees come from Kalshi, Atlassian, Sequoia Capital, Stanford University, Exa, Waymo, AWS, insitro. Alumni go to Anthropic, Together AI, Google, Tesla, Andreessen Horowitz, Ramp. ## Sources 1. [mithril.ai](https://mithril.ai) 2. [Greenhouse Jobs at Mithril](http://job-boards.greenhouse.io/mithril) 3. [Mithril Company Page](https://mithril.ai/company) 4. [LinkedIn - Mithril](https://www.linkedin.com/company/mithrilcompute) 5. [Introducing Mithril Blog Post](https://mithril.ai/blog/foundry-is-now-mithril) ## Other roles at Mithril - [Software Engineer - Member of Technical Staff (Consumption Team)](https://feeny.ai/job/software-engineer-member-of-technical-staff-consumption-team-mithril-palo-alto-sv3h36g2fqh9) — Palo Alto, CA / San Francisco, CA - [Site Reliability Engineer (SRE)](https://feeny.ai/job/site-reliability-engineer-sre-mithril-palo-alto-ytw9jf98wej7) — Palo Alto, CA / San Francisco, CA