---
title: 'Senior / Staff AI Engineer — Evals & Model Quality at FurtherAI'
canonical: 'https://feeny.ai/job/senior-staff-ai-engineer-evals-model-quality-furtherai-san-francisco-mn1b4zy64rrg'
type: 'job'
last_seen: '2026-10-20'
---

# Senior / Staff AI Engineer — Evals & Model Quality at FurtherAI

- **Company:** FurtherAI
- **Location:** San Francisco, CA
- **Compensation:** $300k–$350k
- **Employment:** full-time
- **Work type:** onsite
- **Posted:** 2026-10-14
- **Last confirmed live:** 2026-10-20
- **Apply:** https://jobs.ashbyhq.com/furtherai/07bba6d4-a902-411d-afd4-a5a9abb59f4e

## Job description

## About Us

At FurtherAI, we’re building the AI agents that run insurance — a trillion-dollar industry still powered by manual work. By combining frontier agentic AI with deep domain expertise, we’re reshaping how the industry’s most critical work gets done.

We’ve raised more than $30M from top investors (Andreessen Horowitz, YC, Nexus, South Park Commons), grown more than XY00% in the last 12 months, and work with some of the largest names in insurance — top 10 carriers/brokers, Fortune 100 companies, and public companies.

We are a deeply technical company. Both founders are engineers, and engineers have an outsized say on product direction.

Now, we’re looking for an exceptional AI Engineer to own how we evaluate and continuously improve the quality of AI agents across our platform.

## Why Join Us

- Outsized ambition: We’re out to build the definitive AI company for insurance — and we’re moving faster than anyone in the space.
- Elite team: Founders and engineers from the best companies and schools in the world — ex-Apple AI Research, Brex, Coinbase, and Uber; 4 YC founders and 6 ex-founders; grads of Stanford, Berkeley, IITs, and Cornell.
- Massive market impact: Insurance is the backbone of global commerce. Our work reshapes how the industry operates.
- Founder’s mindset: Own big pieces of the product from day one — ideal if you want to start your own company one day.

## What You’ll Do

- Own evaluations across FurtherAI: Build the evaluation frameworks and infrastructure that measure the accuracy, quality, and reliability of our AI agents across workflows, Assistant, document processing, and computer use.
- Build high-quality datasets: Develop golden datasets, benchmarks, and regression suites, working closely with Forward Deployed Engineers and domain experts to capture real-world insurance tasks and edge cases.
- Evaluate complex agent behavior: Design evaluations for multi-step agent trajectories, tool use, reasoning, and end-to-end task completion — not just individual LLM responses.
- Build automated grading systems: Develop LLM-as-judge evaluations, deterministic graders, human evaluation workflows, and rubrics that accurately reflect real-world quality.
- Make development evaluation-driven: Integrate offline and online evaluations into development and release processes so engineers can measure improvements, catch regressions, and ship confidently.
- Drive model evaluation and selection: Continuously benchmark frontier and open-weight models across accuracy, latency, cost, and reliability. Use results to inform model selection, upgrades, and production releases.
- Build continuous improvement loops: Turn production failures, customer feedback, and agent traces into new evaluation cases and measurable improvements in agent quality.

Representative Projects

- Build an end-to-end evaluation framework for FurtherAI agents, measuring success across multi-step workflows, tool calls, and complex insurance tasks.
- Create a library of golden datasets and benchmarks for common insurance workflows, reusable across customer implementations and out-of-the-box AI skills.
- Build an automated benchmarking system that evaluates new frontier and open-weight model releases and identifies the best models for different tasks.
- Develop production evaluation pipelines that detect quality regressions, identify failure patterns, and turn them into actionable improvements.

## What We’re Looking For

- 5+ years of software engineering experience, with strong hands-on experience building production AI/ML systems.
- Experience building evaluation frameworks, LLM-based applications, model benchmarking systems, or applied AI infrastructure.
- Strong understanding of modern LLMs, agent architectures, evaluation methodologies, and model performance tradeoffs.
- Strong Python engineering skills and the ability to build reliable, production-grade systems.
- Ability to independently own ambiguous technical problems, from research and experimentation through production.
- Clear communicator — both in person and in writing.
- Bonus: Experience with LLM-as-judge, human evaluation systems, agent trajectory evaluations, or large-scale benchmarking.
- Bonus: Experience with open-weight models, fine-tuning, post-training, or model routing.
- Bonus: Background in B2B SaaS and 0-to-1 experience.
- Above all: drive, grit, and ownership. If you excel here, other requirements are secondary.

At FurtherAI, we set a high bar. We’re not looking for someone who just wants a job. We’re looking for someone who wants to build something transformative. If you thrive in environments where the pace is fast, expectations are high, and the rewards are outsized, you’ll love it here.

You can look forward to the following benefits:

- Fully covered, best-in-class health, dental, and vision benefits
- Competitive compensation, meaningful stock options, company 401(k)
- Unlimited PTO
- Outstanding in-office culture in the heart of San Francisco, 5x per week
- Lunch and dinner onsite
- Team events, such as happy hours and off-sites
- Pre-tax commuter benefits

## About FurtherAI

## Company Overview
- **One-liner**: FurtherAI builds a domain-specific AI workforce that automates complex insurance workflows like submission intake, policy comparisons, and underwriting audits.
- **Entity Type**: Private (Series A)
- **Headquarters**: San Francisco, California, United States
- **Founded**: 2023
- **Founders**: Aman Gour (CEO) and Sashank Gondala (CTO)

## Core Business
- **Primary industry**: Insurance Technology (InsurTech) / Artificial Intelligence
- **Target customers**: B2B — Commercial insurers, reinsurers, Managing General Agents (MGAs), and brokers
- **Mission or purpose statement**: "We build AI that works with people — it reads, reasons, and gets things done. We exist to free insurance teams from busywork so they can focus on judgment, relationships, and decisions that shape the future." [furtherai.com](https://www.furtherai.com/company)

## Products & Services
- **AI Assistant for Insurance Workflows**: A domain-specific AI that automates complex document processing and integrates disjointed systems. It handles submission intake, policy comparisons, underwriting audits, and claims processing. The AI extracts data from PDFs and SOVs, compares documents, automates workflows, and can make phone calls or send/receive messages. [furtherai.com](https://www.furtherai.com/)
- **Submissions Processing**: Automates the intake of submissions, extracting key details, running eligibility checks, and flagging inconsistencies to achieve 30x faster quote readiness. [furtherai.com](https://www.furtherai.com/)
- **Underwriting Audit**: Automates data extraction and policy reviews to cut audit time by 45% and boost compliance accuracy. [furtherai.com](https://www.furtherai.com/)
- **Policy Comparison**: AI-powered comparisons that instantly spot discrepancies and reduce manual effort, delivering up to 400% ROI within a few months. [furtherai.com](https://www.furtherai.com/)
- **Claims Processing**: Automates claims validation and compliance checks to reduce friction and accelerate operations. [furtherai.com](https://www.furtherai.com/)

## Market Standing
- **Valuation/Market Cap**: Not publicly disclosed
- **Key Metric**: Total Funding of $30.55M (Series A of $25M raised ~9 months ago, plus a prior $5M round) [cbinsights.com](https://www.cbinsights.com/company/further-ai)
- **Notable Investors/Partners**: Y Combinator (Winter 2024 batch), Andreessen Horowitz (led the $25M Series A), Nexus Venture Partners, South Park Commons, Converge. Primary YC Partner: Tom Blomfield. [ycombinator.com](https://www.ycombinator.com/companies/furtherai)
- **Growth Signals**: Supports customers writing over $15B in premiums across all 50 states. One customer (a specialty insurer) saw three consecutive years of >20% premium growth. A top-10 global carrier with over $20B GWP partnered with them. Team size of 36 employees. [ycombinator.com](https://www.ycombinator.com/companies/furtherai) [furtherai.com](https://www.furtherai.com/)

## Competitive Advantages
- **Domain-Specific AI**: Purpose-built for commercial insurance, not a general-purpose LLM. This allows it to handle complex, industry-specific documents (ACORD forms, loss runs, SOVs) with high accuracy (95% data accuracy reported). [furtherai.com](https://www.furtherai.com/)
- **Proven ROI**: Customers report 30x faster quote readiness, 646% ROI, and 45% reduction in audit time. [furtherai.com](https://www.furtherai.com/)
- **Enterprise-Grade Security**: Client prompts and data are never used for training; completely isolated firm-specific data storage; regularly audited and tested by third-party security specialists. [furtherai.com](https://www.furtherai.com/)
- **Deep Integrations**: Triggers flows based on email or messages, and can make phone calls, creating a seamless end-to-end automation layer.

## Strategic Focus
- **Current priorities**: Scaling the AI workforce across more insurance workflows (submissions, audits, claims, policy comparisons) and expanding the customer base among top-tier insurers, MGAs, and brokers. The company is focused on replacing manual, repetitive tasks with AI to help insurance professionals focus on higher-judgment work.
- **Direction for growth**: Deepening its foothold in the commercial insurance market, which faces increasing submission volumes, tighter margins, and a shrinking underwriting workforce. FurtherAI aims to be the standard AI layer for the entire insurance industry.

## Why Work Here
- **Culture highlights**: Mission-driven focus on freeing humans from busywork. The company emphasizes "human expertise and machine speed working together with trust and precision." [furtherai.com](https://www.furtherai.com/company)
- **Remote/hybrid/office policy**: The company is based in San Francisco, CA, but offers remote roles (e.g., Sales Development Representative is listed as remote). Engineering roles may be hybrid or in-office depending on location (e.g., a Backend/Fullstack role is listed for India). [ycombinator.com](https://www.ycombinator.com/companies/furtherai)
- **Notable perks or engineering culture**: Backed by top-tier VCs (Andreessen Horowitz, Y Combinator) with a strong founding team (ex-Apple AI scientist, ex-Microsoft PM, ex-YC founder). The engineering culture is likely strong given the technical pedigree of the founders (former language modeling scientist at Apple, former Microsoft PM). The company is at an early growth stage (Series A, 36 employees), offering significant ownership and impact.

## Sources
1. [furtherai.com](https://www.furtherai.com/)
2. [furtherai.com/company](https://www.furtherai.com/company)
3. [ycombinator.com](https://www.ycombinator.com/companies/furtherai)
4. [cbinsights.com](https://www.cbinsights.com/company/further-ai)
5. [linkedin.com](https://www.linkedin.com/company/furtherai)

## Other roles at FurtherAI

- [Sr Field Marketing Manager](https://feeny.ai/job/sr-field-marketing-manager-furtherai-new-york-qz5bqr04yzh9) — New York, NY
- [Director of Demand Generation](https://feeny.ai/job/director-of-demand-generation-furtherai-new-york-hsjqqyxk89qc) — New York, NY
- [Staff Product Engineer](https://feeny.ai/job/staff-product-engineer-furtherai-san-francisco-evm5qkjtdxr9) — San Francisco, CA
- [Founding Product Lead](https://feeny.ai/job/founding-product-lead-furtherai-san-francisco-armcagrg9z94) — San Francisco, CA
- [Senior Engineering Manager - AI Agents](https://feeny.ai/job/senior-engineering-manager-ai-agents-furtherai-san-francisco-4123rqdkg7k1) — San Francisco, CA
- [Forward Deployed Engineer](https://feeny.ai/job/forward-deployed-engineer-furtherai-san-francisco-rpx9d7nf06d6) — San Francisco &, NY
- [Agent Engagement Manager](https://feeny.ai/job/agent-engagement-manager-furtherai-san-francisco-byg1xmzwwn2h) — San Francisco, CA
- [Founding Social & Brand Director](https://feeny.ai/job/founding-social-brand-director-furtherai-san-francisco-qvpj06cr4rxs) — San Francisco, CA
- [Enterprise Sales Director](https://feeny.ai/job/enterprise-sales-director-furtherai-new-york-yz3ax237ta0d) — New York, NY