---
title: 'Staff+ Software Engineer, Backend and Infra at Haize Labs'
canonical: 'https://feeny.ai/job/staff-software-engineer-backend-and-infra-haize-labs-new-york-mkcz8feps16j'
type: 'job'
last_seen: '2026-09-08'
---

# Staff+ Software Engineer, Backend and Infra at Haize Labs

- **Company:** Haize Labs
- **Location:** New York, NY
- **Posted:** 2025-04-11
- **Last confirmed live:** 2026-09-08
- **Apply:** https://job-boards.greenhouse.io/haizelabs/jobs/4627852008

## Job description

Staff+ Software Engineer, Backend and Infra

Haize Labs takes AI-based applications from proof-of-concept to production. We eliminate risk and improve the reliability of LLM-based applications by haizing them – i.e. rigorously, proactively, and continuously fuzz-testing them.

We are looking for a talented and experienced backend + infrastructure engineer to help build out our AI reliability platform. You will play a foundational role in designing and driving forward the core technology that puts our cutting-edge AI research in the hands of customers, empowering them to build AI applications that are trustworthy, robust, and ready for production.

This is an opportunity to directly influence how AI applications are tested, verified, and deployed by everyone from frontier AI labs to massive enterprises across a wide range of industries.

In this role, you will:

- Design and build scalable infrastructure and systems to orchestrate tens of thousands of LLM calls per second, powering functionality like model evaluations, red team attacks, runtime guardrails, and more
- Collaborate closely with the research team and deploy innovative new models to build industry-leading AI reliability tooling
- Interface directly with customers to understand and address their pain points, design intuitive new user workflows that streamline their journey, and guide them on the evaluation methodology Haize has pioneered
- Act as a technical leader across the organization, mentoring top talent and helping set technical direction and vision for the company
- Develop and uphold processes and best practices that reinforce the operational excellence of our team

You may be a good fit if you:

- Have 7+ years of industry experience, including 3+ years leading large initiatives as an engineer or manager
- Have a proven track record of designing, building, and scaling complex distributed systems that solve critical business problems
- Have strong proficiency in one or more backend programming languages (e.g. Python, Go, Rust)
- Are deeply knowledgeable about modern cloud infrastructure, including technologies like Kubernetes and Terraform, and platforms like AWS, GCP, and Azure
- Have a strong understanding of relational and NoSQL databases (we use Postgres, MongoDB, and Redis, among others)
- Take a pragmatic, outcomes-focused approach to solving ambiguous technical and business problems
- Are passionate about building products and platforms that feel magical to use

Strong candidates may also:

- Have experience doing applied AI/ML
- Have strong familiarity with security and privacy best practices
- Have built and/or operated large scale, GPU-based model training and serving infrastructure
- Have experience working on multi-datacenter, cloud-agnostic systems

Logistics

- Education requirement: Bachelor’s degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
- Location policy: 6 days a week, in person, in NYC.
- US visa sponsorship: If you are exceptional, we will sponsor.

## Compensation

$200,000 – $300,000 annual salary + equity + benefits

## About us

At Haize, we're not here to write GPT wrappers or get rich quick off the AI bubble. We're here to solve the hardest problem in AI: making it safe, reliable, and production-ready.

Since our company's inception in 2024, we've amassed amazing customers including OpenAI, Anthropic, AI21, and more. We've developed best-in-class tooling for evaluation, dynamic testing, red-teaming, observability, and continuous “robustification” of AI applications. And we’re backed + advised by the founders of Cognition, Hugging Face, Weights and Biases, Nous, Etched, Okta, and Replit, as well as C-suite execs from Google, Stripe, Databricks, Robinhood, and more.

Our core team is exceptionally well-suited to accomplish our mission. We’ve turned down opportunities like Stanford PhD programs and Y Combinator in order to pursue this goal, and we have experience doing AI research and engineering at places like Harvard, MIT, Citadel, Datadog, and McKinsey QuantumBlack (to name a few).

We can only serve our mission with an incredibly talented and hard-working team, and we hope that includes you. Come to Haize to push yourself, learn fast, experience excellence, grow with each other, and pursue your life's work.

## About Haize Labs

## Company Overview

- **One-liner**: Haize Labs builds a reliability platform for AI agents, enabling safe, production‑ready autonomous systems through adversarial testing, guardrails, and continuous improvement.
- **Entity Type**: Private (Seed round of $12.5M led by General Catalyst; some sources label it Series A – conflicting reports) [cbinsights.com](https://www.cbinsights.com/company/haize-labs) [join.haizelabs.com](https://join.haizelabs.com/)
- **Headquarters**: 222 Broadway, New York, New York 10007, United States [cbinsights.com](https://www.cbinsights.com/company/haize-labs)
- **Founded**: 2023 [cbinsights.com](https://www.cbinsights.com/company/haize-labs)
- **Founders**: Leonard Tang (Co‑Founder, CEO) and Steve Li (Co‑Founder) [haizelabs.com/about](https://www.haizelabs.com/about)

## Core Business

- **Primary industries**: AI reliability / safety, AI agent development, enterprise AI infrastructure.
- **Target customers**: B2B, Enterprise, and Government – including frontier AI labs, Fortune 500 banks, insurers, gaming companies, and national governments.
- **Mission**: “Solve the hardest problem in AI: making it reliable in the real world.”

## Products & Services

- **Reliability Harness** – A platform for deploying AI agents with 99.9% reliability. Includes:
  - **Red‑Teaming**: Automated adversarial and fuzz testing to discover vulnerabilities.
  - **Simulation Testing**: Exhaustive scenario validation before deployment.
  - **Guardrails**: Runtime constraints to keep outputs within policy boundaries.
  - **Supervisors**: AI monitors trained to oversee other agents for consistent performance.
  - **Annotation Tooling**: Labeling and evaluation tools to capture human nuance.
  - **Ongoing Improvement**: Continuous enhancement based on production interactions.
- **Judge**: Model‑based evaluators trained via scaled inference‑time compute.
- **Monitor**: Real‑time tracing, monitoring, and observability.
- **Robustify**: Continual improvement against bugs uncovered by Haize testing.
- **Professional Services** (Engagement Design): Agent development, knowledge transfer, exploratory phase, and validation against human experts.

## Market Standing

- **Valuation / Market Cap**: Not publicly disclosed.
- **Key Metric**: Total funding of $12.5M (Seed round; some sources list as Series A – conflicting reports).
- **Notable Investors**: Lead – General Catalyst. Also AI Grant Batch 4, and angel investors including the founder of Okta, former CISO of Google, CEO of Weights & Biases, CEO of Cognition Labs, CEO of Pika Labs, CEO of Replit, CTO of CodeSignal, CSO of HuggingFace, CEO of Etched, and others.
- **Advisors**: CISO of Databricks / Robinhood / Capital One, NYU Alignment Research Group professor, inventor of t‑SNE / Head of Llama Team at Meta AI, former Head of Responsible AI at Twitter/Accenture.
- **Growth Signals**: Customers include Anthropic, OpenAI, AI21 Labs, a Fortune 500 bank, top‑3 North American insurer, Canadian airline, $30B gaming company, Government of Singapore, and European digital bank. Media coverage in Washington Post, Business Insider, Forbes, PitchBook, VentureBeat. Founder named to Forbes 30 Under 30 (2025).

## Competitive Advantages

- **Deep focus on reliability** as the core AI problem, not side‑channels or wrapper products.
- **Proprietary Reliability Harness** combining red‑teaming, simulation, guardrails, and supervisor models.
- **Top‑tier team**: members from Stanford (PhD dropout), Citadel, Hudson River Trading, Harvard PhD, Datadog LLM observability founding engineer, and nonprofit founders.
- **Early partnerships** with frontier labs and large enterprises, giving unique exposure to real‑world deployment challenges.

## Strategic Focus

- Rapidly move AI agents from “POC purgatory” to production with guaranteed reliability.
- Become the “alignment layer” powering every AI system, for every use case, in every industry.
- Continue expanding customer base across finance, insurance, gaming, government, and beyond.

## Why Work Here

- **Culture**: “High‑agency, low‑ego” team; solve the hardest technical problem in AI; intense learning environment with “unmatched excellence.”
- **Work style**: Hybrid presence in New York (222 Broadway) and San Francisco. Open roles include engineering (Product Slinger, Software Engineer Intern, Staff+ Backend & Infra, Vertical AI Lead) and research (Applied Researcher, Research Intern).
- **Notable perks**: Work directly with top researchers and engineers; impact on AI safety at scale; early‑stage equity and fast‑paced decision making.
- **Engineering culture**: Emphasis on deep technical work, push to production quickly, collaboration with frontier labs.

## Sources

1. [haizelabs.com](https://haizelabs.com/)
2. [job-boards.greenhouse.io/haizelabs](https://job-boards.greenhouse.io/haizelabs)
3. [haizelabs.com/about](https://www.haizelabs.com/about)
4. [cbinsights.com/company/haize-labs](https://www.cbinsights.com/company/haize-labs)
5. [join.haizelabs.com](https://join.haizelabs.com/)

## Other roles at Haize Labs

- [Vertical AI Lead](https://feeny.ai/job/vertical-ai-lead-haize-labs-new-york-2sj8y8kjm1c5) — New York, NY / San Francisco, CA
- [Software Engineer Intern](https://feeny.ai/job/software-engineer-intern-haize-labs-new-york-ate86k6c6yvz) — New York, NY
- [Product Slinger](https://feeny.ai/job/product-slinger-haize-labs-new-york-41d7ffvwj7kx) — New York, NY / San Francisco, CA
- [Research Intern](https://feeny.ai/job/research-intern-haize-labs-new-york-0cbyc3dcxr68) — New York, NY
- [Applied Researcher](https://feeny.ai/job/applied-researcher-haize-labs-new-york-qfd7rg4pkxsx) — New York, NY / San Francisco, CA