--- title: 'Staff Platform Engineer at webAI' canonical: 'https://feeny.ai/job/staff-platform-engineer-webai-austin-2gntk4qd27cr' type: 'job' last_seen: '2026-11-04' --- # Staff Platform Engineer at webAI - **Company:** webAI - **Location:** Austin, TX - **Employment:** full-time - **Posted:** 2026-10-21 - **Last confirmed live:** 2026-11-04 - **Apply:** https://jobs.ashbyhq.com/webai/318c579c-92b3-43b5-b59f-4d1d48dc0026 ## Job description About Us: webAI is pioneering the future of artificial intelligence by establishing the first distributed AI infrastructure dedicated to personalized AI. We recognize the evolving demands of a data-driven society for scalability and flexibility, and we firmly believe that the future of AI lies in distributed processing at the edge, bringing computation closer to the source of data generation. Our mission is to build a future where a company's valuable data and intellectual property remain entirely private, enabling the deployment of large-scale AI models directly on standard consumer hardware without compromising the information embedded within those models. We are developing an end-to-end platform that is secure, scalable, and fully under the control of our users, empowering enterprises with AI that understands their unique business. We are a team driven by truth, ownership, tenacity, and humility, and we seek individuals who resonate with these core values and are passionate about shaping the next generation of AI. About the Role: webAI runs private AI on the customer's own hardware: on-prem Apple-silicon fleets (some air-gapped), Linux servers, and the customer's own cloud. As Staff Platform/Infrastructure Engineer you'll own the substrate that makes this repeatable. That means how our kernel, services and local model inference get packaged, deployed, secured, observed and upgraded across bare metal and cloud. You'll inherit a production deployment serving a global enterprise customer, lead its move to a leaner next-generation architecture, and turn it into a deployment kit our forward-deployed engineers can use to install a new customer from the docs alone. This is a hands-on staff role: you'll make the architecture calls, write the code and carry the pager. What You'll Do: - Own deployment for the webAI kernel and B2B SDK. Deliver single-machine installs, multi-node clusters, and cloud (AWS, Azure/AKS) installs from one model, keeping the gap between cloud and bare metal small. - Choose and evolve our orchestration approach (Nomad, Kubernetes, or config-managed native services such as Ansible plus launchd) with simplicity as the goal. Cut custom infrastructure code where you can. - Run Apple-silicon fleets in production: launchd services, firewalling (pf), Lima/Docker VMs, GPU/unified-memory sizing for local LLM inference, and recovery after power loss or hardware failure. - Build the inference serving layer with the AI team: an OpenAI-compatible model gateway, conversation-pinned load balancing, routing per model and per persona, and performance/load testing (throughput, time to first token, concurrency). - Own the software supply chain: GitLab CI, container and OCI model artifacts, signing (cosign/minisign), pinned dependencies, mirrored registries for air-gapped sites, and the release process. - Secure the platform: secrets management (Vault, KMS, cloud secret stores), PKI and mTLS, enterprise identity integration (Entra ID/OIDC, SCIM), and network policy for on-prem sites. - Build observability and audit: metrics, logs and alerting (Prometheus, Loki, Grafana), plus export of audit and telemetry into customer monitoring tools. - Define what high availability means for us. Set reliability levels and SLOs we can commit to in customer contracts, then build them. - Write the runbooks, "recipes" and RCAs that let forward-deployed engineers and customers operate the stack without you. Lead incident response when they can't. - Work with kernel engineers on networking (QUIC/peer-to-peer connectivity, relays, NAT traversal) and on making the kernel easy to deploy. - Mentor engineers and raise the bar for infrastructure-as-code, testing and operations across the team. Requirements & Skills: - 8+ years building and operating production infrastructure. At least some of it on bare metal or on-prem, not only managed cloud. - Deep experience with at least one workload orchestrator (Nomad or Kubernetes), and the judgment to know when not to use one. - Strong Terraform and configuration management (Ansible or similar). Clean state and environment management across staging and production. - Production experience with AWS, Azure, or both (identity/IAM, KMS, container registries, managed Kubernetes). - Solid networking fundamentals: WireGuard/Tailscale or other VPN overlays, firewalls, NAT, load balancers and L4/L7 proxies (e.g. Envoy), DNS and TLS. - Secrets and identity: Vault or equivalent, PKI/mTLS, OIDC. - CI/CD and release engineering in GitLab: container builds, artifact signing, reproducible pinned builds. - Observability: Prometheus/Grafana/Loki or equivalent, alert design, running on-call. - Proficiency in at least one systems language (Rust or Go), plus scripting (Python/Bash). - Clear technical writing: runbooks, design docs and RCAs that others can act on. Nice to Have: - macOS fleet administration at scale (launchd, pf, MDM-managed or locked-down environments, FileVault constraints). - Running local LLM inference (llama.cpp, MLX, vLLM), GPU/unified-memory capacity planning, model packaging. - Air-gapped or disconnected delivery: mirrored registries, offline installers. - Peer-to-peer or QUIC networking (e.g. iroh, libp2p), relays and NAT traversal. - Writing Kubernetes operators/controllers or Nomad tooling (kube-rs, controller-runtime). - Customer-facing deployment experience: installing and supporting software at customer sites. We at webAI are committed to living out the core values we have put in place as the foundation on which we operate as a team. We seek individuals who exemplify the following: - Truth - Emphasizing transparency and honesty in every interaction and decision. - Ownership - Taking full responsibility for one's actions and decisions, demonstrating commitment to the success of our clients. - Tenacity - Persisting in the face of challenges and setbacks, continually striving for excellence and improvement. - Humility - Maintaining a respectful and learning-oriented mindset, acknowledging the strengths and contributions of others. Benefits: We strive to provide competitive benefits to all employees. The benefits listed in this posting generally apply to U.S.-based employees. For employees hired outside the United States, benefits may vary based on local law, country-specific requirements, and the employment platform or entity through which the employee is hired. - Competitive salary and performance-based incentives - Comprehensive health, dental, and vision benefits package - Including a high-deductible HSA option with company contribution - 401k match (US-based only) - Flexible PTO Policy - Parental leave for eligible employees - Continuing education support - Basic, company-paid life insurance - Supplemental life insurance - Company-paid short and long term disability - Free parking for in-office employees webAI is an Equal Opportunity Employer and does not discriminate against any employee or applicant on the basis of age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We adhere to these principles in all aspects of employment, including recruitment, hiring, training, compensation, promotion, benefits, social and recreational programs, and discipline. In addition, it is the policy of webAI to provide reasonable accommodation to qualified employees who have protected disabilities to the extent required by applicable laws, regulations and ordinances where a particular employee works. ## About webAI ## Company Overview - **One-liner**: webAI provides an end-to-end platform for building, deploying, and operating custom AI on local infrastructure, ensuring data sovereignty and low latency. - **Entity Type**: Private (Series A‑II, $60M total raised) - **Headquarters**: Austin, Texas, United States - **Founded**: 2019 (source: webai.com) / 2020 (source: CB Insights) - **Founders**: David Stout (CEO), Ethan Baird (Chief Research Officer), Tyler Mauer (Chief Product Officer) ## Core Business - Primary industry/industries: Enterprise AI infrastructure, sovereign AI, edge computing - Target customers: B2B – large enterprises and public‑sector organizations in healthcare, manufacturing, financial services, aviation, retail, and defense - Mission or purpose statement: “AI should be specialized, sovereign, efficient, and sustainable. It should solve real problems, not just burn more compute.” (source: [webai.com/about](https://www.webai.com/about)) ## Products & Services - **Navigator**: Build, train, and deploy custom AI models on local infrastructure with full transparency and control. (source: [webai.com](https://www.webai.com)) - **Companion**: An on‑device assistant that connects employees to private AI, tailored to industry workflows (e.g., aviation, manufacturing). (source: [webai.com](https://www.webai.com)) - **Runtime**: Orchestrates distributed AI workloads across heterogeneous hardware, scaling from a single device to entire clusters. (source: [webai.com](https://www.webai.com)) - **webFrame**: Delivers optimized inference and training with adaptive quantization (“Entropy‑Weighted Quantization”) achieving near 99.5% accuracy. (source: [webai.com](https://www.webai.com)) - **Network**: Connects every model, dataset, and device through a secure, local fabric for high‑speed collaboration without the cloud. (source: [webai.com](https://www.webai.com)) - **CLI**: Full command‑line control for developers to build, extend, and manage AI environments at scale. (source: [webai.com](https://www.webai.com)) ## Competitive Advantages - **Data sovereignty**: Full ownership of AI models and data; models run on local infrastructure, not in the cloud. - **Low latency & resilience**: Edge deployments enable real‑time inference without cloud dependency; works offline. - **Proprietary optimization**: Entropy‑Weighted Quantization compresses models while maintaining ~99.5% accuracy. - **Full‑stack platform**: Covers development (Navigator), deployment (Runtime/CLI), inference (webFrame), and collaboration (Network). ## Strategic Focus - Current priorities: Scaling custom, sovereign AI into regulated industries (healthcare, finance, defense); building the “operating system of the future” for edge intelligence; achieving 2030 vision of billions of specialized models embedded in everyday systems. (source: [webai.com/about](https://www.webai.com/about)) - Growth direction: Public sector partnerships (President of Public Sector Dr. Jason Rathje); vertical solutions for aviation, manufacturing, and retail. ## Why Work Here - **Culture**: Core beliefs include ownership, truth, tenacity, humility, and the conviction that AI must be local and accessible. - **Work model**: Flexible work environment with a strong bias toward work‑life balance; “Unlimited PTO.” - **Perks** (source: [webai.com/careers](https://www.webai.com/careers)): - Comprehensive health coverage for body and mind - Parental leave and fertility support - 401(k) with company contribution - Learning stipend for professional development - Equity options - **Engineering culture**: Developer‑first (CLI, Runtime) with focus on solving complex distributed‑systems and ML challenges; autonomy to shape the platform. ## Sources 1. [webai.com](https://www.webai.com) 2. [webai.com/about](https://www.webai.com/about) 3. [webai.com/careers](https://www.webai.com/careers) 4. [CB Insights](https://www.cbinsights.com/company/webai) 5. [LinkedIn](https://www.linkedin.com/company/webai-official) ## Other roles at webAI - [People Operations Generalist (6 month contract with possibility of contract-to-hire)](https://feeny.ai/job/people-operations-generalist-6-month-contract-with-possibility-of-contract-to-ckf484b03p1q) — Austin, TX - [Senior DevOps Engineer](https://feeny.ai/job/senior-devops-engineer-webai-austin-n82srgv33vf6) — Austin, TX - [Director of Applied AI](https://feeny.ai/job/director-of-applied-ai-webai-austin-nrzmmqk92xn4) — Austin, TX - [Technical Account Manager](https://feeny.ai/job/technical-account-manager-webai-remote-dk4pmmmshd9w) - [Forward Deployed Engineer - P2P Networking](https://feeny.ai/job/forward-deployed-engineer-p2p-networking-webai-remote-12feprhsd4ex) - [Senior Rust Platform Engineer](https://feeny.ai/job/senior-rust-platform-engineer-webai-austin-e30hvspg1kzk) — Austin, TX - [CRDT Software Engineer](https://feeny.ai/job/crdt-software-engineer-webai-remote-btmmdcckzbzm) - [Senior Technical Product Marketing Manager](https://feeny.ai/job/senior-technical-product-marketing-manager-webai-austin-5xa879nwf91h) — Austin, TX - [Peer to Peer Software Engineer](https://feeny.ai/job/peer-to-peer-software-engineer-webai-remote-xw3epwwdpc4f) - [Staff Machine Learning Engineer](https://feeny.ai/job/staff-machine-learning-engineer-webai-austin-tpbsc07s1ee0) — Austin, TX