---
title: 'Head of Inference, Perimeter Compute at Montauk Capital'
canonical: 'https://feeny.ai/job/head-of-inference-perimeter-compute-montauk-capital-new-york-7s52dp02ewwf'
type: 'job'
last_seen: '2026-09-09'
---

# Head of Inference, Perimeter Compute at Montauk Capital

- **Company:** Montauk Capital
- **Location:** New York, NY
- **Employment:** full-time
- **Work type:** hybrid
- **Posted:** 2026-05-06
- **Last confirmed live:** 2026-09-09
- **Apply:** https://jobs.ashbyhq.com/montauk-capital/041cc206-d3ef-46fd-b9cf-95eab0b26922

## Job description

Head of Inference

Full Time, Remote, NYC Preferred (US Based)

## About Montauk Capital

Montauk Capital https://montaukcap.com builds and backs companies at the forefront of the Electron Economy, the generational shift towards electrified, intelligent technologies reshaping industries and driving unprecedented demand for energy. Our team combines deep investing acumen with decades of operating experience to give founders the strategic clarity and hands-on support that accelerates the building of enduring companies of consequence.

## About Perimeter Compute

Co-founded by Montauk Capital, Perimeter Compute is a pre-seed venture specialized in modular, metro-edge AI capabilities. By leveraging existing infrastructure for inference deployment, Perimeter Compute provides low-latency, SLA-guaranteed performance across diverse GPU SKUs and colocation environments. Our technology intelligently routes traffic based on demand proximity and real-world network limitations, bypassing the heavy power and infrastructure requirements of traditional hyperscalers. Currently initiating operations with pilot nodes in NYC, we are executing a city-by-city expansion strategy with plans for a broader multi-metro rollout.

## About the Role

We are seeking a visionary and execution-oriented Head of Inference. You'll define the inference architecture, make foundational decisions, build the first POC, and own this domain end to end alongside the CEO. You will be a senior, hands-on technical leader and the technical authority on inference in the room. You’ll own the key technical decisions, and will be the internal and external expert on inference. You will own the core inference capability driving the platform and customer experience, and have a strong voice over the technical foundation of the company. You’ll evolve the vision into a viable proof of concept, building the practical system to then design and implement distributed inference systems. Alongside the CEO, you’ll represent the company with top-tier partners, early customers and investors, and will own this domain end to end. In addition to the CEO, you will have the support of a team of strong advisors, and the initial founding team.

## What You’ll Do

- Create the inference strategy and define the inference architecture for Edge AI
- Own the inference serving layer end-to-end: vLLM, TensorRT-LLM, Triton, or equivalent
- Build a credible POC fast — proves the platform works to NVIDIA, cloud providers, and customers
- Drive cost-per-token optimization
- Optimize GPU utilization, KV-cache management, and batching for production workloads
- Own observability and reliability SLAs
- Build distributed inference pipelines across multi-GPU, multi-node edge deployments
- Set performance baselines and SLAs for inference latency and throughput, plus observability and performance SLA’s
- Define quantization strategy
- Translate complex inference requirements for infrastructure designs
- Define the software access layer architecture and oversee integration efforts
- Engage credibly with investors, partners, and technical stakeholders, represent the company externally

## What You’ll Bring

You have a passion for inference and a background as a hands-on technical builder who has directly implemented inference systems before, ideally in production or near-production environments. Deep knowledge and are excited about model serving, and the practical engineering required to make an inference system work on real hardware. You can take a vision and initial concept and translate it into a viable POC quickly and are comfortable making foundational technical decisions quickly, in ambiguity, and building first of a kind.

If inference is your craft and you've built systems in production, we want to talk.

- Production inference serving — vLLM, TensorRT-LLM, Triton Inference Server, or equivalent distributed at scale
- Quantization, SGLang, containerization, cost-per-token
- Observability tooling:distributed tracing, latency profiling, alerting. Instrument and debug complex distributed systems with a focus on building world-class observability and debuggability tools
- C++/CUDA/Rust
- GPU utilization and CUDA kernel optimization — has pushed hardware to its limits
- Batching, KV-cache, speculative decoding expertise
- Scale systems using Kubernetes, Ray, custom load balancing, multi-GPU/multi-node inference
- Has built a serving system that NVIDIA and cloud providers respect
- Model deployment and serving
- Systems engineering
- Technical leadership experience, either over teams or outcomes
- Startup / 0→1 DNA: You ship fast and communicate clearly

## Why Join Us

- Category-Defining Opportunity: Solving the AI inference bottleneck without the burden of power and infrastructure constraints Own the metro edge inference across heterogeneous, disparate compute nodes
- Massive Market Opportunity: AI spending projected to exceed hundreds of billions annually, 54GW of AI Inference demand expected by 2030
- Studio Support: Leverage Montauk Capital's resources, network, and operational expertise during critical early stages
- Competitive compensation + equity: True ownership over what you build

## About Montauk Capital

## Company Overview
- **One-liner**: Montauk Capital is an investment platform combining a venture fund and venture studio that builds and backs technology companies powering the Electron Economy — the shift to electrified, intelligent infrastructure.
- **Entity Type**: Private (venture capital / venture studio; $8.5M in funding)
- **Headquarters**: New York City, New York, United States
- **Founded**: 2023
- **Founders**: Philip Krim (Co-Founder & CEO), Evan Caron (Co-Founder & CIO), Sharo Atmeh (Co-Founder & COO)

## Core Business
- **Primary industries**: Venture capital, venture studio, energy infrastructure, artificial intelligence, advanced computing, smart transportation, climate technology.
- **Target customers**: B2B – primarily early-stage founders building in energy, infrastructure, and industrial AI; portfolio companies serve enterprise and industrial clients.
- **Mission / purpose**: To build and back “companies of consequence” that power the Electron Economy — the electrified, intelligent systems transforming global industries.

## Products & Services
- **Venture Fund**: Invests in scalable Series A and early‑Series B software and AI‑focused businesses aligned with the Electron Economy.  
- **Venture Studio**: Launches new companies from scratch in high‑conviction white spaces (e.g., stealth companies in agentic CAD, edge AI, distributed water infrastructure).  
- **Portfolio companies** (examples):
  - **OneGC** – legal services for the energy transition.
  - **Mantis Space** – first space‑based power distribution network.
  - **Adaptive** – commercial/professional insurance enabled by AI.
  - **Raad** – drone‑based geospatial intelligence for environmental services.
  - **GridFree AI** – AI‑powered ERP for large industrials and data centers.

## Market Standing
- **Valuation / Market Cap**: Not publicly disclosed (private firm).
- **Key Financial Metric**: Total funding of **$8.5M** (venture round led by Amplo in March 2024).
- **Notable Investors / Partners**: Amplo (lead investor). Founders bring deep ties from Riverstone Private Equity, Alyeska Investment Group, and other energy/infrastructure institutions.
- **Growth Signals**:
  - Employees grew **+6.2% YoY** to 14 people (as of mid‑2025) with **10 active job postings** (+25% quarterly).
  - Actively seeking new investments and spinning up multiple stealth companies.
  - Strong annual LinkedIn follower growth **+213.5%** (4,496 followers).

## Competitive Advantages
- **Deep domain expertise**: Founders have 20+ years in energy investing, capital markets, and climate tech (Riverstone, Alyeska, ClearTrace, HGP Storage).
- **Integrated venture‑studio model**: Combines capital with hands‑on company‑building, reducing time‑to‑market for founders.
- **Focus on the Electron Economy**: Captures the generational shift to electrified, intelligent infrastructure — a thesis that spans energy, AI, and industry.
- **Strategic partnerships**: Co‑develops with notable names (e.g., Martha Stewart for AI home intelligence) and leverages capital‑markets experience for structuring innovative deals.

## Strategic Focus
- **Electron Economy as core thesis**: Investing across the full stack — from energy generation/storage to AI‑enabled industrial software.
- **Scaling the venture portfolio**: Targeting Series A and B software and AI companies; meanwhile the studio will continue launching ventures in high‑conviction white spaces.
- **Expanding team**: Hiring for critical leadership and technical roles across stealth portfolio companies (e.g., Head of Infrastructure, Head of Inference, Founding Engineers).
- **Sustainability & resilience**: Emphasis on energy abundance, adaptability, and resource efficiency.

## Why Work Here
- **Culture**: Hands‑on, founder‑focused environment where team members work directly with experienced operators and investors. Described as a “trustworthy springboard” for building durable companies.
- **Remote / hybrid / office**: Offers remote, hybrid, and in‑office roles; the HQ is in New York City (66 Hudson Boulevard).
- **Notable perks / engineering culture**: Opportunities to become a co‑founder or early executive at a stealth venture backed by deep industry expertise. Strong emphasis on technical depth (AI, infrastructure, energy systems) and ownership.
- **Growth trajectory**: Small, growing team (14 employees) with clear expansion plans — allows for outsized impact and career development.

## Sources
1. [montaukcap.com](https://montaukcap.com)
2. [montaukcap.com/about](https://montaukcap.com/about)
3. [linkedin.com/company/montauk-capital](https://www.linkedin.com/company/montauk-capital)
4. [builtin.com/company/montauk-capital](https://builtin.com/company/montauk-capital)
5. [pitchbook.com/profiles/investor/537552-55](https://pitchbook.com/profiles/investor/537552-55)

## Other roles at Montauk Capital

- [General Interest - Undergrad](https://feeny.ai/job/general-interest-undergrad-montauk-capital-remote-3952pdzd275q)
- [MBA Intern](https://feeny.ai/job/mba-intern-montauk-capital-remote-wzzdbfzkp1vf)
- [Head of Data Center Operations, Perimeter Compute](https://feeny.ai/job/head-of-data-center-operations-perimeter-compute-montauk-capital-new-york-sm05bckaqhag) — New York, NY
- [General Interest](https://feeny.ai/job/general-interest-montauk-capital-austin-q29510c5drzy) — Austin, TX
- [Co-Founder Zero Proof](https://feeny.ai/job/co-founder-zero-proof-montauk-capital-remote-e2d6727br0v1)
- [Director of Site Operations, Edge AI Stealth Co](https://feeny.ai/job/director-of-site-operations-edge-ai-stealth-co-montauk-capital-new-york-s02903tz6svk) — New York, NY
- [Head of Real Estate, Perimeter Compute](https://feeny.ai/job/head-of-real-estate-perimeter-compute-montauk-capital-new-york-rhbrj64ge4wr) — New York, NY
- [Infrastructure Engineer, Perimeter Compute](https://feeny.ai/job/infrastructure-engineer-perimeter-compute-montauk-capital-new-york-y2ga7qc12z9y) — New York, NY
- [CEO, AI Economics OS Stealth Co](https://feeny.ai/job/ceo-ai-economics-os-stealth-co-montauk-capital-remote-de3xf1t24gcw)
- [Agency Success Lead](https://feeny.ai/job/agency-success-lead-montauk-capital-austin-jjspxtb4ydwt) — Austin, TX