---
title: 'Senior Security Engineer at LiteLLM'
canonical: 'https://feeny.ai/job/senior-security-engineer-litellm-remote-6zecanywdraa'
type: 'job'
last_seen: '2026-11-05'
---

# Senior Security Engineer at LiteLLM

- **Company:** LiteLLM
- **Location:** Remote
- **Compensation:** $220k–$260k
- **Employment:** full-time
- **Work type:** remote
- **Posted:** 2026-10-31
- **Last confirmed live:** 2026-11-05
- **Apply:** https://jobs.ashbyhq.com/litellm/93705fde-0daa-49ce-94be-4551d3ac662d

## Job description

Senior Security Engineer LiteLLM is the world’s most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. Our platform gives developers secure, reliable access to LLMs and adjacent services. We’re looking for our first Security Engineer to help secure LiteLLM’s application, infrastructure, and software-delivery pipeline.

## About the role

This is a hands-on security generalist role with a strong emphasis on application security. You’ll spend most of your time reviewing and hardening LiteLLM’s Python codebase, identifying new attack surfaces, working directly with engineers to fix vulnerabilities, and making secure development practices part of how we build. You’ll also own security work across IT, CI/CD, cloud infrastructure, and the software supply chain. The ideal candidate has built application/product/infrastructure security programs from scratch and genuinely enjoys security outside of work—through CTFs, vulnerability research, open-source projects, or independent experimentation.

## Responsibilities

Application security

- Conduct deep security reviews of LiteLLM’s Python proxy, APIs, authentication systems, and enterprise features.
- Identify and remediate vulnerabilities involving authentication, authorization, secrets, tenant isolation, injection, and data exposure.
- Partner directly with engineers throughout design, implementation, code review, and release—not only after code is shipped.
- Build application-security tooling into the development lifecycle, including SAST, DAST, dependency scanning, and secrets detection.
- Perform internal red teaming and adversarial testing against LiteLLM’s APIs, proxy, and LLM-specific attack surfaces.
- Threat-model new products and architecture changes before they reach production.
- Create secure coding guidelines and train engineers on common vulnerabilities and defensive practices.

Infrastructure, CI/CD, and supply-chain security

- Harden LiteLLM’s Docker images, PyPI packages, GitHub Actions workflows, and release infrastructure.
- Detect dependency confusion, poisoned packages, compromised dependencies, exposed secrets, and unsafe build practices.
- Implement SBOMs, signed builds, provenance checks, and reproducible-build practices.
- Design secure-by-default configurations for cloud and self-hosted deployments, including authentication, IAM, secrets management, and key rotation.
- Review cloud infrastructure, network boundaries, access controls, and production deployment patterns.

IT security and incident response

- Strengthen employee identity, device, SaaS, and internal access controls.
- Build monitoring and anomaly detection for suspicious API, model, authentication, and routing activity.
- Lead security incident response, vulnerability assessment, remediation, post-mortems, and stakeholder communication.
- Establish formal vulnerability intake, CVE triage, disclosure, and remediation processes.
- Maintain threat models as LiteLLM’s product and architecture evolve.

## What we’re looking for

- A strong security generalist who can work across application security, IT, CI/CD, cloud infrastructure, and the software supply chain.
- Deep application-security expertise, including manually auditing production Python code and working with engineers to remediate vulnerabilities.
- Strong understanding of authentication, authorization, tenant isolation, SSRF, injection, deserialization, secrets management, and common web and API vulnerabilities.
- Experience using and configuring tools such as Semgrep, Bandit, CodeQL, Burp Suite, and other SAST or DAST tooling.
- Previous experience at an early-stage security startup during its 0→1 journey.
- Experience securing containers, GitHub Actions, build pipelines, packages, and software dependencies.
- Familiarity with SBOMs, Sigstore, Cosign, Snyk, Grype, Trivy, or equivalent tooling.
- Strong knowledge of OAuth2, JWT, mTLS, IAM, and high-throughput API authentication.
- Familiarity with prompt injection, LLM data exfiltration, tool abuse, and the OWASP Top 10 for LLM Applications.
- Experience with incident response, CVSS scoring, vulnerability management, CVE triage, and coordinated disclosure.
- Experience competing in CTFs during college or independently pursuing vulnerability research, reverse engineering, bug bounties, or security projects.
- A genuine interest in security outside your day job—you regularly explore new attack techniques, build security projects, or contribute to the security community.
- Bachelor’s or Master’s degree in Computer Science or a related field, or equivalent practical experience.

Why join LiteLLM?

- Work on application-security problems at the intersection of AI, APIs, and developer infrastructure.
- Secure an open-source product used by enterprises around the world.
- Work directly with engineers and influence how security is incorporated into product development.
- Take broad technical ownership in a fast-moving environment.
- Competitive salary and health, dental, and vision benefits.

## About LiteLLM

[LiteLLM](https://github.com/BerriAI/litellm) is a Python SDK and Proxy Server that enables seamless access to more than 100 LLM APIs through the OpenAI format. Ready to secure the infrastructure powering enterprise AI? Apply now.

## About LiteLLM

## Company Overview
- **One-liner**: LiteLLM provides an open-source AI gateway and Python SDK that unifies access to 100+ large language models (LLMs) with built-in cost tracking, guardrails, and load balancing.
- **Entity Type**: Private (Seed stage, Y Combinator W23)
- **Headquarters**: San Francisco, California, United States
- **Founded**: 2023
- **Founders**: Krrish Dholakia (CEO) and Ishaan Jaffer (CTO)

## Core Business
- **Primary industry**: AI infrastructure / LLM operations (LLMOps)
- **Target customers**: Platform engineering teams, ML platform teams, and developers building LLM-powered applications (B2B, mid-market to enterprise)
- **Mission or purpose**: To simplify model access, spend tracking, and fallbacks across 100+ LLMs, enabling organizations to manage and scale their entire AI program from a single governed platform.

## Products & Services
- **[AI Gateway (Proxy Server)](https://www.litellm.ai/)**: A centralized service that provides an OpenAI-compatible API, virtual keys, spend tracking, rate limiting, guardrails, load balancing, and an admin dashboard. Deployable on-premises or via Terraform modules on AWS/GCP.
- **[Python SDK](https://github.com/BerriAI/litellm)**: A lightweight library for direct integration, supporting Router with retry/fallback logic, application-level cost tracking, and observability callbacks (Langfuse, MLflow, etc.).
- **[MCP Gateway](https://github.com/BerriAI/litellm)**: Connect MCP (Model Context Protocol) servers to any LLM through the gateway.
- **[A2A Agent Gateway](https://github.com/BerriAI/litellm)**: Invoke A2A (Agent-to-Agent) agents from supported providers such as LangGraph, Vertex AI Agent Engine, and Azure AI Foundry.

## Market Standing
- **Valuation/Market Cap**: Not disclosed
- **Key Metric**: Total funding raised: **$625,000** across multiple seed rounds (last round June 2023); Annual revenue reported as **$1.6M** [linkedin.com](https://www.linkedin.com/company/litellm)
- **Notable Investors/Partners**: Y Combinator (backed, batch W23), with additional undisclosed seed investors [ycombinator.com](https://www.ycombinator.com/companies/litellm/jobs)
- **Growth Signals**:
  - 52,568 GitHub stars, 9,450 forks, 1,005+ contributors [github.com](https://github.com/BerriAI/litellm)
  - 240M+ Docker pulls, 1B+ requests served, 80% uptime (claimed on homepage)
  - 14 employees with **27.3% monthly headcount growth** [linkedin.com](https://www.linkedin.com/company/litellm)
  - Used by companies such as **Netflix, Adobe, Twilio, Siemens, Rocket Money** [github.com](https://github.com/BerriAI/litellm) [ycombinator.com](https://www.ycombinator.com/companies/litellm/jobs)

## Competitive Advantages
- **Unified API**: Single interface for 100+ LLM providers (OpenAI, Anthropic, Gemini, Bedrock, Azure, etc.) using the OpenAI format – drop-in replacement for existing OpenAI code.
- **Production-ready gateway**: Out-of-the-box virtual keys, spend tracking, guardrails, load balancing, and admin dashboard.
- **Performance**: 8ms P95 latency at 1k requests per second (benchmarked) [github.com](https://github.com/BerriAI/litellm)
- **Open source + enterprise**: Self-hosted, air-gapped, and air-gapped deployment options; commercial license for advanced features (SSO, audit logs, custom SLAs).
- **Active community**: 1,387 releases, frequent updates, strong contributor ecosystem.

## Strategic Focus
- **Rust migration**: LiteLLM is actively migrating core components to Rust for improved performance and reliability [litellm.ai](https://www.litellm.ai/).
- **Enterprise expansion**: Building out enterprise features (JWT auth, SSO, audit logs, custom SLAs) and dedicated support for large organizations [github.com](https://github.com/BerriAI/litellm).
- **Agent and MCP support**: Extending the gateway to support A2A agents and MCP servers, positioning LiteLLM as a hub for multi-model, multi-agent workflows.

## Why Work Here
- **Stage & impact**: Early-stage YC startup with high growth (10–14 people, rapidly expanding). Work directly with founders and shape the product from the ground up [ycombinator.com](https://www.ycombinator.com/companies/litellm/jobs).
- **Engineering culture**: Open-source first, with strong emphasis on code quality (Black, Ruff, MyPy, circular import checks). Contributors are active and valued [github.com](https://github.com/BerriAI/litellm).
- **Remote & hybrid options**: Some roles are San Francisco–based (office at 1730 Jones St), others offer remote within the US or Mexico. Equity packages range from 0.05% to 3% depending on role [ycombinator.com](https://www.ycombinator.com/companies/litellm/jobs).
- **Compensation**: Salary ranges vary by role (e.g., Founding Reliability Engineer: $200K–$270K + 0.25%–0.75% equity; Backend Engineer: $150K–$200K + 0.25%–0.75% equity; interns $80K–$100K) [ycombinator.com](https://www.ycombinator.com/companies/litellm/jobs).
- **Team composition**: 36% technical, 21% sales, 14% general management – small, cross-functional team with founders actively coding.

## Sources
1. [litellm.ai](https://www.litellm.ai/)
2. [linkedin.com](https://www.linkedin.com/company/litellm)
3. [ycombinator.com](https://www.ycombinator.com/companies/litellm/jobs)
4. [github.com](https://github.com/BerriAI/litellm)
5. [jobs.ashbyhq.com/litellm](https://jobs.ashbyhq.com/litellm) (careers page, but no additional detail beyond job listings)

## Other roles at LiteLLM

- [Account Executive](https://feeny.ai/job/account-executive-litellm-san-francisco-mv5knsvgbbc5) — San Francisco, CA
- [Forward Deployed Engineer (New Grad)](https://feeny.ai/job/forward-deployed-engineer-new-grad-litellm-united-states-e0c74w49szkf) — United States
- [Technical Account Manager](https://feeny.ai/job/technical-account-manager-litellm-united-states-63aqttbmc0f9) — United States
- [Forward Deployed Engineer](https://feeny.ai/job/forward-deployed-engineer-litellm-united-states-dxh3t099p93f) — United States
- [Founding Developer Relations](https://feeny.ai/job/founding-developer-relations-litellm-san-francisco-fe4fwf2gpysb) — San Francisco, CA
- [AI Engineer](https://feeny.ai/job/ai-engineer-litellm-san-francisco-v2eczyy9ah6c) — San Francisco, CA
- [Senior Support Engineer - India](https://feeny.ai/job/senior-support-engineer-india-litellm-india-wjm52a9f4vmf) — India
- [Product Engineer](https://feeny.ai/job/product-engineer-litellm-san-francisco-33g1q944rcqm) — San Francisco, CA
- [Senior Support Engineer](https://feeny.ai/job/senior-support-engineer-litellm-san-francisco-z0gy525hv7zc) — San Francisco, CA
- [Senior Security Engineer](https://feeny.ai/job/senior-security-engineer-menlo-security-apac-india-bwbsjm0ecsz4) — APAC / India