---
title: 'Software Engineer - Hosted Model Infrastructure at Palantir Technologies'
canonical: 'https://feeny.ai/job/software-engineer-hosted-model-infrastructure-palantir-technologies-washington-0abb78vcpewz'
type: 'job'
last_seen: '2026-09-07'
---

# Software Engineer - Hosted Model Infrastructure at Palantir Technologies

- **Company:** Palantir Technologies
- **Location:** Washington, DC
- **Employment:** full-time
- **Work type:** hybrid
- **Posted:** 2026-06-03
- **Last confirmed live:** 2026-09-07
- **Apply:** https://jobs.lever.co/palantir/7a9600be-cdcb-4311-bb5c-65b6939b5956

## Job description

A World-Changing Company

Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more.

## The Role

We are a software engineering team with expertise in enabling ML models in production. We deploy AI models to run in variety of environments: air-gapped government networks, forward-deployed defense environments, edge nodes, and enterprises with strict data sovereignty requirements. Our customers rely on us for frontier AI capabilities running on hardware they control, often with constrained GPU resources and limited direct access. Rising to that challenge and meeting those expectations is what Palantir's excels at.

We treat models like any other software: continuously tested, continually delivered, packaged for reproducible deployment, and built for long-term maintainability. You will own services end-to-end, and work across the full stack, from inference engines, GPU scheduling to deployment pipelines, observability, and integration with Palantir's platform. The goal is to deliver new models and capabilities quickly and continuously.

Join us if you want to solve problems at the intersection of infrastructure and machine learning that directly enable critical customers.

Technologies We Use

- Different backend languages, including Java, Rust, Python and Go
- Model serving engines for GPU-accelerated inference
- Docker and Kubernetes for containerization and orchestration
- Industry-standard build tooling, including Gradle and GitHub

Core Responsibilities

- Building high-performance model serving infrastructure that integrates with security models, hardware constraints, and different inference engines
- Designing intelligent request handling including authentication, rate limiting, concurrency control, and audit logging for multi-tenant model access
- Building and maintaining packaging and deployment pipelines enabling fast, secure, and reliable model rollouts across on-premises and air-gapped environments
- Developing observability for production AI systems to enable easy service monitoring and fast incident triage and resolution
- Debugging complex issues and performance problems throughout the stack, including open source inference engines, container runtimes, and GPU drivers, in environments you cannot always access directly
- Designing and running testing and benchmarking infrastructure that validates model deployments across varying GPU hardware before they reach production
- Working with product teams and customers to understand requirements, debug production issues, and deliver the models and capabilities they need
- Integrating hosted model infrastructure with Palantir's deployment, configuration, and identity systems

## What We Value

- Ownership mindset and bias toward quality. Our software runs in environments where direct access for debugging is limited or unavailable.
- High empathy for customer needs and drive to deliver reliable, easy-to-use models
- Ability to work effectively across multiple languages and layers of the stack, from backend services and ML tooling to container orchestration and deployment configuration
- Strong debugging skills and motivation to trace problems from application code through containers, orchestration, and hardware
- Curiosity about emerging AI capabilities and the ability to quickly evaluate and integrate new models and technologies as the landscape evolves
- Active US Security clearance, or eligibility and willingness to obtain a US Security clearance is beneficial, but not necessary

## What We Require

- 4+ years of professional software engineering experience building and operating production systems
- Engineering background in Computer Science, Mathematics, Software Engineering, Physics, or similar field
- Strong coding skills with demonstrated proficiency in programming languages, such as Java, C++, Python, Rust, or similar languages. Familiarity with the Python ML ecosystem is valuable.
- Experience with containers, Kubernetes, and deploying backend services in production environments
- Strong written and verbal communication skills and ability to iterate quickly with teammates, incorporating feedback and holding a high bar for quality

## About Palantir Technologies

## Company Overview
- **One-liner**: Palantir builds software platforms that empower organizations to integrate their data, decisions, and operations at scale.
- **Entity Type**: Public (NYSE: PLTR)
- **Headquarters**: Miami, Florida, United States
- **Founded**: 2003
- **Founders**: Not explicitly listed in provided sources (widely reported as Peter Thiel, Alex Karp, and Stephen Cohen)

## Core Business
- **Primary industries**: Data integration, artificial intelligence, defense & intelligence, commercial analytics
- **Target customers**: Government agencies (defense, intelligence, civil), large commercial enterprises, and regulated industries
- **Mission or purpose**: “Build foundational software for tomorrow” and design technology that helps institutions protect liberty while making human‑driven analysis of real‑world data possible [palantir.com/about]

## Products & Services
- **Palantir Gotham**: Platform for the intelligence and defense community, enabling counterterrorism investigations and operations.
- **Palantir Foundry**: Foundational data operations platform providing data management, logic authoring, ontology development, analytics, and workflow building.
- **Palantir Apollo**: Continuous delivery platform that orchestrates upgrades and manages the infrastructure hosting other Palantir platforms.
- **Artificial Intelligence Platform (AIP)**: Generative AI platform with secure connectivity to third‑party LLMs, development toolchain for AI agents, AI‑enabled end‑user applications, and evaluation frameworks for governing AI workflows.

## Market Standing
- **Valuation / Market Cap**: $100.6 B (as of the search date, approximate)
- **Key Metric**: Annual revenue of $4.5 B (latest fiscal year); IPO in 2020
- **Notable Investors / Partners**: Public market investors; major U.S. and allied government agencies, commercial clients across healthcare, finance, manufacturing, and logistics
- **Growth Signals**: 3,843 employees (+20.2% YoY, +998 people); operations in 12 countries; workforce distributed across 49 countries; continued expansion of AIP and commercial customer base

## Competitive Advantages
- **Engineer‑in‑the‑field model**: Palantir sends engineers directly to customers to deploy products, integrate data, and produce operational results in weeks, not years.
- **Privacy‑by‑design**: Built‑in privacy‑protective capabilities, governance tools, and a strong track record of working with advocacy groups on responsible data use.
- **Platform lock‑in**: Deep integration with customer data and workflows through Ontology and custom applications makes switching costs extremely high.
- **Long‑term government contracts**: Decades‑long relationships with U.S. and allied defense/intelligence agencies provide stable revenue and high barriers to entry.

## Strategic Focus
- **AI leadership**: Making AIP the standard for secure, governed generative AI deployment in regulated industries.
- **Commercial expansion**: Growing the commercial customer base beyond government, especially in supply chain, healthcare, and finance.
- **Continuous delivery**: Leveraging Apollo to ensure rapid, safe updates across all deployments, reducing maintenance overhead for customers.

## Why Work Here
- **Culture**: Mission‑driven engineering environment where engineers work directly on the hardest problems for critical institutions. “We’re engineers, not academics.”
- **Autonomy and impact**: New hires are trusted with responsibility from day one and are paired with a mentor. “Palantir trusts our early talent engineers to make an impact from day one.”
- **Flexibility**: Take‑what‑you‑need time‑off policy; offices closed for two weeks in December; flexible working arrangements including remote work when appropriate.
- **Benefits**: Generous paid parental leave, fertility services, adoption assistance, equity programs, mental health support (virtual therapy, meditation), and robust healthcare coverage.
- **Diversity & inclusion**: Equal Employment Opportunity employer; publishes UK Gender Pay Gap Report; strives for “many pathways to success” beyond traditional career ladders. [palantir.com/careers/life-at-palantir]

## Sources
1. [LinkedIn Company Page](https://linkedin.com/company/palantir-technologies)
2. [Palantir About Page](https://www.palantir.com/about/)
3. [Palantir Careers – Life at Palantir](https://www.palantir.com/careers/life-at-palantir/)
4. [Palantir Careers – Open Positions](https://www.palantir.com/careers/open-positions/)
5. [SEC Form 10‑K / Annual Report (FY2025)](https://www.sec.gov/Archives/edgar/data/1321655/000132165526000021/fy2025palantirars.pdf)

## Other roles at Palantir Technologies

- [Legal Operations Specialist](https://feeny.ai/job/legal-operations-specialist-palantir-technologies-denver-277zfvxr6krc) — Denver, CO
- [Legal Operations Specialist](https://feeny.ai/job/legal-operations-specialist-palantir-technologies-palo-alto-g95qh18wdyjj) — Palo Alto, CA
- [Deployment Strategist - US Government](https://feeny.ai/job/deployment-strategist-us-government-palantir-technologies-miami-ezp5zy4r6f4j) — Miami, FL
- [Forward Deployed Infrastructure Engineer, New Grad - US Government](https://feeny.ai/job/forward-deployed-infrastructure-engineer-new-grad-us-government-palantir-zeehkfhpbe2b) — Honolulu, HI
- [Forward Deployed Infrastructure Engineer, New Grad - UK Government](https://feeny.ai/job/forward-deployed-infrastructure-engineer-new-grad-uk-government-palantir-4km7jnmy04ta) — London, United Kingdom
- [U.S. Indirect Tax Manager](https://feeny.ai/job/u-s-indirect-tax-manager-palantir-technologies-palo-alto-npdbxr47k7m1) — Palo Alto, CA
- [Offensive Security Engineer](https://feeny.ai/job/offensive-security-engineer-palantir-technologies-washington-3a89j42a04vp) — Washington, DC
- [Technical Program Manager - US Government](https://feeny.ai/job/technical-program-manager-us-government-palantir-technologies-huntsville-pk9asqp4mry7) — Huntsville, AL
- [Technical Program Manager - US Government](https://feeny.ai/job/technical-program-manager-us-government-palantir-technologies-washington-rhfdfakgsqxb) — Washington, DC
- [Technical Program Manager - US Government](https://feeny.ai/job/technical-program-manager-us-government-palantir-technologies-new-york-42m8tr5ty5f3) — New York, NY