---
title: 'Head of Engineering at LlamaIndex'
canonical: 'https://feeny.ai/job/head-of-engineering-llamaindex-san-francisco-ced0p1v1dqm2'
type: 'job'
last_seen: '2026-10-15'
---

# Head of Engineering at LlamaIndex

- **Company:** LlamaIndex
- **Location:** San Francisco, CA
- **Compensation:** $200k–$300k
- **Employment:** full-time
- **Work type:** hybrid
- **Posted:** 2026-10-08
- **Last confirmed live:** 2026-10-15
- **Apply:** https://jobs.ashbyhq.com/llamaindex/0f8bdc04-5d1d-4db1-a888-3f367cb4469e

## Job description

Join us and help shape the future of AI by defining the narrative around document understanding.

## About the Role

LlamaIndex makes enterprise data useful for AI applications. You will own engineering execution, technical direction, hiring, and team development. You will work closely with company leadership and product teams to decide what we build, how we build it, and how we deliver it reliably to customers. This is a hands-on role. You should be comfortable reviewing code and architecture, debugging production issues, and writing code for critical systems. We are looking for someone who has shipped and operated B2B API products and understands both model serving and model training—from experimentation and evaluation to deployment and production operations.

## Responsibilities

- Lead and develop our engineering team, setting clear priorities, ownership, and accountability.
- Partner with company leadership to translate customer needs into a focused roadmap and deliver software predictably.
- Stay directly involved in architecture, code reviews, production debugging, and implementation of critical changes.
- Set technical direction across application services, APIs, data pipelines, and ML infrastructure, balancing immediate customer needs with long-term maintainability.
- Work with ML engineers and researchers on model training, fine-tuning, evaluation, and deployment, ensuring model improvements translate into better production outcomes.
- Guide model serving decisions across latency, throughput, GPU utilization, capacity, reliability, and inference cost.
- Improve engineering practices for testing, observability, security, incident response, and releases.
- Hire strong engineers, coach technical leaders and managers, and build a culture of direct communication, customer focus, and responsibility for results.

Required Qualifications

- Experience leading multiple engineering teams in B2B SaaS, at a scope comparable to a 20–30-person organization, with responsibility for delivering and operating customer-facing products.
- Strong, current hands-on engineering skills: you can read and write production code, review architecture, and diagnose complex technical problems.
- Practical familiarity with model serving and model training, including training or fine-tuning workflows, evaluation, deployment, and production operations.
- Understanding of the tradeoffs between model quality, latency, throughput, GPU resources, reliability, and cost.
- Strong background in backend systems, APIs, distributed systems, and cloud infrastructure.
- A track record of hiring and developing engineers, setting clear expectations, and giving constructive feedback.
- Good product judgment, including knowing when to move quickly and when to invest in correctness, reliability, and security.
- Clear written and verbal communication with technical teams, customers, and company leadership.

## Preferred Qualifications

- Experience scaling engineering at a Series A–C startup.
- Experience with document processing, OCR, extraction, retrieval, indexing, or other systems that work with enterprise data.
- Experience with LLMs or multimodal models, evaluation datasets, and model quality monitoring.
- Experience with GPU infrastructure, distributed training, inference optimization, or model serving frameworks.
- Experience building developer tools or API-first products.
- Experience with enterprise requirements such as multi-tenancy, access controls, auditability, and security reviews.
- Experience developing engineering managers while staying closely involved in technical execution.

Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

LlamaIndex does not accept unsolicited agency resumes. Please do not forward resumes to our jobs alias, employees, or any other organization location. LlamaIndex is not responsible for any fees related to unsolicited resumes.

## About LlamaIndex

## Company Overview
- **One-liner**: LlamaIndex provides an enterprise-grade agentic document processing platform that uses AI to parse, extract, index, and retrieve data from complex, multi-modal documents.
- **Entity Type**: Private (Series A)
- **Headquarters**: San Francisco, California, United States
- **Founded**: 2022
- **Founders**: Jerry Liu (Co-Founder)

## Core Business
- **Primary industry/industries**: AI Document Processing, Enterprise Infrastructure, Data Retrieval & RAG (Retrieval-Augmented Generation)
- **Target customers**: B2B; Enterprise (Fortune 50), SMB, and developers building production-grade AI workflows.
- **Mission or purpose statement**: "Our mission is to automate knowledge work, beginning with the hardest frontier: documents."

## Products & Services
- **LlamaParse**: Industry-leading document parser for 50+ unstructured file types (PDFs, Office docs, images, handwritten notes). Supports embedded images, complex layouts, and multi-page tables. Available as a cloud service or for local/on-premise deployment.
- **LiteParse**: Open-source, lightweight document parser for local processing. Parses text from PDFs, Office docs, and images without requiring cloud services or LLM tokens.
- **Extraction Agents**: LLM-powered, schema-based extraction agents that turn unstructured content into structured data without training.
- **Indexing & Retrieval Pipeline**: Enterprise-grade chunking and embedding pipeline for RAG, designed for precision and relevance.
- **LlamaAgents**: Enables developers to build reliable, production-ready workflows around documents, covering ingestion, extraction, reasoning, and automation.

## Market Standing
- **Valuation/Market Cap**: Not publicly disclosed.
- **Key Metric**: Total Funding of **$28.5M** across 4 rounds.
- **Notable Investors/Partners**: Greylock (lead Seed), Norwest (lead Series A), Databricks Ventures, KPMG Ventures, Amazon Web Services (AWS). Backed by world-class investors including Jack Altman (Alt Capital), Lenny Rachitsky, Mathilde Collin, Raquel Urtasun, and Joseph E. Gonzalez.
- **Growth Signals**:
    - 25M+ package downloads per month.
    - 300k+ LlamaParse users.
    - 1.5k+ open-source contributors and 20k+ community members.
    - One of the largest developer communities in GenAI.
    - Headcount grew **62.3% YoY** (from ~27 to 44 employees).
    - 1 billion+ documents processed.
    - Used by the fastest-growing AI companies and the Fortune 50.
    - Active job postings increased **100% year-over-year** (8 open roles).

## Competitive Advantages
- **Massive Developer Community & Open-Source Roots**: With 25M+ monthly downloads and 20k+ community members, LlamaIndex has deep adoption and mindshare among AI developers, creating a strong network effect.
- **Agentic Document OCR Leadership**: Positioned as the "world’s best agentic document OCR," combining VLM-powered understanding with natural language workflow building, making it uniquely suited for complex, messy documents.
- **Enterprise-Grade Security & Compliance**: HIPAA, GDPR, and SOC2 compliant out-of-the-box, with granular access controls, data encryption, and flexible deployment (cloud or fully in VPC).
- **99.9% Uptime SLA**: Infrastructure built for always-on document processing under real production load.
- **Dedicated Support & SLAs**: Tailored to mission-critical AI workloads, with fast response times.

## Strategic Focus
- **Product Expansion**: Continuing to build out the LlamaAgents platform for end-to-end document workflow automation, moving beyond just parsing and extraction.
- **Enterprise Sales**: Hiring dedicated Sales Leaders and Account Executives for Mid-Market and Enterprise segments in North America and EMEA.
- **Open-Source Community Growth**: Maintaining a strong open-source presence while building a commercial enterprise product around it.
- **Industry Verticals**: Targeting document-heavy industries like Manufacturing, Finance, Insurance, Healthcare, and Risk.

## Why Work Here
- **Impactful Mission**: Ground-floor opportunity at the center of the AI revolution, building tools used by millions worldwide to "automate knowledge work."
- **Culture**: Values include being goal-oriented, transparent about wins and mistakes, debating fast and committing fully, assuming best intent, and prioritizing the best idea over hierarchy. Described as a "small team driving far-reaching impact."
- **Work Policy**: Fully supported hybrid & remote work. Beautiful, easily accessible office in San Francisco.
- **Compensation & Benefits**:
    - Competitive base salary & equity compensation.
    - Generous equipment allowance.
    - Flexible PTO to recharge and rest.
    - Medical, dental, and vision for you & your family.
    - Daily catered lunches & snacks in the office.
    - Ongoing professional development opportunities.
- **Team & Culture Highlights**: Collaborative team of passionate individuals pushing boundaries. Emphasis on shipping quickly but thoughtfully, with a focus on reliability and scalability.

## Sources
1. [llamaindex.ai](https://www.llamaindex.ai/)
2. [llamaindex.ai/about](https://www.llamaindex.ai/about)
3. [llamaindex.ai/careers](https://www.llamaindex.ai/careers)
4. [linkedin.com/company/llamaindex](https://www.linkedin.com/company/llamaindex)

## Other roles at LlamaIndex

- [Don’t See Your Role?](https://feeny.ai/job/don-t-see-your-role-llamaindex-san-francisco-5bftn2c6v4he) — San Francisco, CA
- [Member of Technical Staff, Applied Research](https://feeny.ai/job/member-of-technical-staff-applied-research-llamaindex-san-francisco-c7ztpw83b1gd) — San Francisco, CA
- [Head of Engineering](https://feeny.ai/job/head-of-engineering-skelar-kyiv-tcb16716je2m) — Kyiv, Ukraine
- [Head of Engineering](https://feeny.ai/job/head-of-engineering-stigg-tel-aviv-8myzc9nnn1nn) — Tel Aviv, Israel
- [Head of Engineering](https://feeny.ai/job/head-of-engineering-gravitics-inc-greater-denver-area-zm7jwg3bgkpm) — Greater Denver Area
- [Head of Engineering](https://feeny.ai/job/head-of-engineering-foundational-london-dz6m9mtx17wr) — London, United Kingdom
- [Head of Engineering](https://feeny.ai/job/head-of-engineering-charge-robotics-san-leandro-d9dpz0586k05) — San Leandro, CA
- [Head of Engineering](https://feeny.ai/job/head-of-engineering-travertine-boulder-90hjf6p5kh4g) — Boulder, CO
- [Head of Engineering](https://feeny.ai/job/head-of-engineering-comstruct-ict-munich-hzn6d01k8vka) — Munich, Germany
- [Head of Engineering](https://feeny.ai/job/head-of-engineering-konvu-paris-qdbdq7fszmwb) — Paris, France