---
title: 'Senior Software Engineer, AI Evaluation Infrastructure at Turing'
canonical: 'https://feeny.ai/job/senior-software-engineer-ai-evaluation-infrastructure-turing-united-states-j258xrs9gccj'
type: 'job'
last_seen: '2026-10-21'
---

# Senior Software Engineer, AI Evaluation Infrastructure at Turing

- **Company:** Turing
- **Location:** United States
- **Work type:** remote
- **Posted:** 2026-10-19
- **Last confirmed live:** 2026-10-21
- **Apply:** https://job-boards.greenhouse.io/turing/jobs/6225409004

## Job description

## About Turing

Turing’s mission is to accelerate superintelligence to drive real economic progress. Headquartered in San Francisco, Turing works with frontier AI labs to generate high-quality datasets, reinforcement learning environments, and frontier research benchmarks that improve model capabilities in software engineering, enterprise knowledge work, and advanced STEM reasoning. In software engineering, Turing is the largest and longest-running data provider in the category. Turing also works with Fortune 500 enterprises across financial services, life sciences, healthcare, retail, automotive, and CPG to build and deploy end-to-end agentic AI systems inside mission-critical workflows. By operating on both sides, Turing closes the loop between frontier research and enterprise deployment, turning real-world deployment signals into better data, evaluations, and more capable models. Learn more at [www.turing.com](http://www.turing.com/).

Senior Software Engineer, AI Evaluation Infrastructure

We build the infrastructure that frontier AI labs use to evaluate coding agents and language models: benchmark datasets, agent evaluation runs at scale, and automated task quality checks. You would own features across the stack, from the data model and background jobs to the screens our users work in every day.

This is a role for an experienced engineer who works independently, makes sound tradeoffs, and turns a loosely defined request into something shipped, tested, and safe to leave alone.

## What you will do

- Design and ship features end to end: data model, API, background workers, and the UI when the change needs it.
- Build and improve how agents and models are evaluated: running trials in sandboxed environments, scoring results, and turning thousands of runs into results people can trust.
- Improve how benchmark tasks are quality-checked: verifiers, rubric-based and LLM-as-a-judge grading, and deciding whether a task is clear, solvable, and fair to score.
- Integrate new models, agents, and benchmarks in a way that generalizes, without a special case for each one.
- Keep the system fast and reliable as usage grows: efficient queries, safe migrations, and concurrency that holds up under load.
- Review teammates’ pull requests against our engineering guidelines and help keep the codebase consistent.

## What you bring

- Typically 5+ years building and operating production backend systems, with ownership of at least one service from design through on-call.
- Strong Python. Experience with Django (or a similar framework), PostgreSQL, and a task queue such as Celery. What matters most is having run a real system, not knowing a particular framework.
- Hands-on experience in LLM evaluation, beyond calling a model API. You understand how a benchmark task is built, how an agent trial is scored, and how results are aggregated and compared. Experience with Harbor, Terminal-Bench, SWE-bench, Inspect, or a similar harness is a strong plus.
- Judgment about task quality. You can spot ambiguous instructions, weak or gameable verifiers, leaked answers, and checks that pass for the wrong reason.
- Good tradeoffs. You reach for the smallest design that solves the problem, extend what already exists before adding something new, and can explain what you chose not to build.
- Ownership. You take a fuzzy request, find the relevant code, ask questions only when the answer changes the design, and finish the job, including migrations, tests, and edge cases users will hit.
- Quick adoption of team conventions. You read the written guidelines and your first pull requests already match them in naming, structure, tests, and error handling.
- Comfort with a TypeScript and React frontend when a change is visible there. You don’t need to be a frontend specialist.
- Clear writing. Your pull request descriptions and design notes explain why, not just what.

## Nice to have

- Experience running agents in sandboxed or containerized environments (Docker, Kubernetes, or cloud sandboxes such as Modal or Daytona).
- Experience with LLM-as-a-judge or rubric-based grading, and with reducing judge bias and noise.
- Familiarity with coding agents such as Claude Code, Codex, or OpenHands, and with MCP.
- Experience with distributed job scheduling, concurrency limits, or database locking at scale.
- Contributions to open-source evaluation or infrastructure projects.

## How we work

- Written engineering guidelines, applied consistently, with the same review bar for everyone.
- Business logic lives in services. Hot paths stay cheap. Lint and tests pass before a pull request is ready.
- The same vocabulary in the code, the API, and the UI.
- We prefer deleting code to adding it, and simple designs to clever ones.

A strong first month looks like several changes merged with light review, and one area of the system you can change confidently without a guide.

Interview process

- A short conversation about a system you built and the tradeoffs you made.
- A practical exercise: a focused change in an existing codebase.
- A discussion of a flawed benchmark task: what’s wrong with the instruction, the verifier, and the scoring.
- A conversation with the team.

Values

- We are client first: We put our clients at the center of everything we do, because their success is the ultimate measure of our value.
- We work at Start-Up Speed: We move fast, stay agile and favor action because momentum is the foundation of perfection
- We are AI forward: We help our clients build the future of Al and implement it in our own roles and workflow to amplify productivity.

Advantages of joining Turing

- Work at the frontier of AI, helping the world’s leading AI labs improve their most advanced models by building expert datasets, RL environments, and first-of-a-kind benchmarks.
- Contribute to leading-edge AI research and showcase your work at top conferences such as ICLR, ICML, and NeurIPS.
- Bring frontier AI innovation to the enterprise, applying lessons learned from leading AI labs to solve real-world business challenges.
- Collaborate with and learn from exceptional colleagues with deep AI experience from Google, Meta, Amazon, and other leading technology companies.
- Move at the pace of AI innovation, with the speed, ownership, and impact of a startup.

Turing is proud to be an equal opportunity employer. We do not discriminate on the basis of race, religion, color, national origin, gender, gender identity, sexual orientation, age, marital status, disability, protected veteran status, or any other legally protected characteristics. At Turing we are dedicated to building a diverse, inclusive and authentic workplace  and celebrate authenticity, so if you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we encourage you to apply anyways. You may be just the right candidate for this or other roles.

For applicants from the European Union, please review [Turing's GDPR notice here](https://www.turing.com/policy).

## About Turing

## Company Overview
- **One-liner**: Turing is an AI company that partners with leading AI labs and enterprises to advance frontier model capabilities and deploy end-to-end AI systems for mission-critical workflows.
- **Entity Type**: Private (raised $111M at a $2.2B valuation)
- **Headquarters**: San Francisco, California, United States (also offices in Palo Alto, CA)
- **Founded**: 2018
- **Founders**: Jonathan and Vijay (computer science alumni)

## Core Business
- Primary industry: Artificial Intelligence, Technology, Information and Internet
- Target customers: B2B, including Fortune 500 companies, frontier AI labs, and enterprises
- Mission: “Accelerate superintelligence to drive real economic progress”
- Operates across multiple areas: reasoning, coding, multimodality, multilinguality, STEM, agentic behavior, and frontier knowledge

## Products & Services
- **Frontier AI Lab Partnerships**: Collaborate with leading AI labs to build data, evaluations, and benchmarks that push the AI frontier forward (e.g., RL environments, data generation for pre-training/post-training).
- **Enterprise AI Systems**: Build and deploy end-to-end AI systems for mission-critical enterprise workflows.
- **Turing Talent Cloud**: AI-vetted pool of 4M+ software engineers, data scientists, and STEM experts used to train models and build AI applications.
- **ALAN Platform**: AI-powered platform for matching, managing talent, and generating high-quality human and synthetic data for model evals, fine-tuning, RLHF, and benchmarking.

## Market Standing
- **Valuation/Market Cap**: $2.2 billion (most recent funding round amount not explicitly dated, but cited on careers page)
- **Key Metric**: Total funding of $111M (from the $2.2B valuation round)
- **Notable Investors/Partners**: Adam D’Angelo (Facebook’s first CTO), Foundation Capital (backers of Netflix, Uber), executives from Microsoft, and others. Partners include Fortune 500 companies.
- **Growth Signals**: 48.1% YoY employee growth (reaching 3,896 employees), #1 on The Information’s “Top 50 Most Promising B2B Companies”, named one of Fast Company’s top 10 companies in the Workplace category, active job postings of 2,700 (+66.9% YoY).

## Competitive Advantages
- AI-vetted talent pool of over 4 million professionals, enabling rapid scaling of AI projects.
- Proprietary ALAN platform that orchestrates talent matching, data generation, and model evaluation.
- Deep partnerships with frontier AI labs, including work on large-scale RL environments and data generation.
- History of being built by engineering leaders from Facebook, Microsoft, and other top tech companies.
- Strong brand recognition and trust among enterprise clients (zero-risk trial for hiring).

## Strategic Focus
- Advancing artificial general intelligence (AGI) by improving model capabilities in reasoning, coding, agentic behavior, and multimodality.
- Expanding enterprise AI deployment across industries (e.g., financial services, robotics, STEM).
- Scaling the talent cloud and ALAN platform to support pre-training, post-training, and AI application development.
- Growing the workforce with a focus on research, engineering, and data science roles.

## Why Work Here
- **Culture**: Emphasizes “client first”, “startup speed”, “AI forward”, and “work with joy”. Described as a fast-paced, innovative environment.
- **Remote/Hybrid**: Many roles are remote-first globally, with offices in San Francisco and Palo Alto for in-person collaboration.
- **Perks**: Work on frontier AI technology with top labs; flexible, well-paid remote work; opportunities to contribute to superintelligence; strong career growth (48% YoY headcount increase).
- **Engineering Culture**: Heavy focus on R&D, research engineering, and data science; roles include Principal Research Engineer, Robotics Engineer, and Head of Applied AI Lab.
- **Workforce Diversity**: Operates in 100+ countries, with employees from India, US, Pakistan, Nigeria, Brazil, etc.

## Sources
1. [careers.turing.com](https://careers.turing.com/)
2. [job-boards.greenhouse.io/turing](http://job-boards.greenhouse.io/turing)
3. [linkedin.com/company/turingcom](https://www.linkedin.com/company/turingcom)
4. [welcome.turing.com/about/](https://welcome.turing.com/about/)
5. [turing.com/jobs](https://www.turing.com/jobs)

## Other roles at Turing

- [Compliance Analyst](https://feeny.ai/job/compliance-analyst-turing-brazil-18qpxhsay329) — Brazil
- [Head of Engineering, Enterprise AI](https://feeny.ai/job/head-of-engineering-enterprise-ai-turing-new-york-kmtp00q88k70) — New York, NY
- [Product Manager](https://feeny.ai/job/product-manager-turing-india-6w9tm1m6f9zh) — India
- [Compliance Analyst](https://feeny.ai/job/compliance-analyst-turing-india-cs0s607xcs9p) — India
- [Director, Investor Relations & Corporate Development](https://feeny.ai/job/director-investor-relations-corporate-development-turing-san-francisco-mpe9p2fjwdrp) — San Francisco, CA
- [Engagement Manager](https://feeny.ai/job/engagement-manager-turing-dallas-jeh8jdvtevjb) — Dallas, TX
- [Machine Learning / Data Engineer](https://feeny.ai/job/machine-learning-data-engineer-turing-colombia-huila-ckzp1y85mrj9) — Colombia Huila, Colombia / São Paulo, Brazil
- [Partner Manager, AI Ecosystem Partnerships](https://feeny.ai/job/partner-manager-ai-ecosystem-partnerships-turing-united-states-wbtt05s58nrp) — United States
- [Senior Engineering Manager](https://feeny.ai/job/senior-engineering-manager-turing-colombia-huila-vr1q8b6t97d5) — Colombia Huila, Colombia / São Paulo, Brazil
- [Senior Software Engineer](https://feeny.ai/job/senior-software-engineer-turing-sao-paulo-mt7mfcq704yz) — São Paulo, Brazil