---
title: 'Research Engineer, Latency & Throughput at Mistral'
canonical: 'https://feeny.ai/job/research-engineer-latency-throughput-mistral-paris-4ayajf52321w'
type: 'job'
last_seen: '2026-11-08'
---

# Research Engineer, Latency & Throughput at Mistral

- **Company:** [Mistral](https://feeny.ai/companies/mistral)
- **Location:** Paris, France
- **Employment:** full-time
- **Posted:** 2026-10-20
- **Last confirmed live:** 2026-11-08
- **Apply:** https://jobs.ashbyhq.com/mistral.ai/8d384b55-6341-40a7-ba37-6ab362e9b303

## Job description

## About Mistral

Mistral provides full-stack AI solutions: from frontier models to developer tools, applications, and compute. We partner with enterprises tackling the hardest problems across high-stakes industries like finance, manufacturing, defense, healthcare, and the public sector, co-creating customized AI systems that they can run on their terms. We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between Europe, North America, Asia and the Middle East. We are creative, low-ego and team-spirited.

## The Role

As a Research Engineer on the Latency & Throughput team, you will push the frontier of LLM inference by researching and prototyping techniques that reduce latency and increase throughput — from speculative decoding and quantization to KV compression and new attention variants. The team sits at the intersection of research and production: you will take ideas from recent literature, form hypotheses, run experiments, and ship the techniques that prove out into our serving stack. This role sits between our inference engineers, who own the production serving stack, and our research scientists, who focus on paper-level contributions. You will be more science-focused than a pure engineer: you are expected to generate new ideas, keep up with the state of the art, and implement proof-of-concepts that bridge the gap between academic results and production impact. Some techniques you explore will be lossy or require integration into training — retraining models, tuning architectures, or training auxiliary models to improve inference. You will work closely with the Inference Foundation and Kernels teams, who turn your validated techniques into production recipes, and with pretraining and RL teams when your work touches model training. Success is measured by demonstrated latency or throughput gains, first at small scale, then adopted in production.

## What You Will Do

- Research and prototype inference techniques — speculative decoding, quantization, KV compression, watermarking, and new model architectures — by reading recent literature and forming testable hypotheses.
- Design and run experiments to validate or refute ideas, iterating quickly on small-scale setups before proposing production integration. Demonstrate clear latency or throughput gains without unacceptable quality loss.
- Collaborate with the Inference Foundation team to integrate validated techniques into the vLLM-based serving stack.
- Partner with pretraining and RL teams when techniques require co-training, retraining, or training auxiliary models to improve inference.

Build the right tooling and validation platforms to facilitate AI-driven inference research.

## What We're Looking For

- A strong ML background with solid knowledge of LLM training techniques — architecture, tokenization, fine-tuning, and evaluation.
- Hands-on experience with Python and PyTorch; you write clean, experimental code and iterate fast. JAX is acceptable with strong Python proficiency. C++ and Rust are not required, CUDA and GPU knowledge is expected but hands-on experience is not required.
- Research experience of some form: a thesis, publications, a dedicated research project, or efficiency-oriented work in a lab or industry research setting. A PhD is not required, but we are looking for genuine research depth.
- A track record of conducting experiments: forming hypotheses, designing controlled comparisons, and drawing clear conclusions from results.
- Familiarity with the state of the art in LLM inference — you know what has been tried, what works, and where the open problems are.
- Self-starter, low-ego, and collaborative. You are comfortable with ambiguity, negative results, and are eager to take matters into your own hands.
- Inference or serving experience is a plus, not a requirement. Prior work with vLLM, production LLM deployments, or serving systems will help you ramp up faster.

Location and Remote This role is based in our Paris or London offices (hybrid). We will prioritize candidates who reside in the Paris area or are open to relocating. We strongly believe in the value of in-person collaboration to foster strong relationships and seamless communication within our team. For senior profiles, we will also consider remote candidates based in France. In that case, we ask all new hires to visit our Paris office:

- For the first week of their onboarding (accommodation and travel covered)
- Then at least 3 days per month

## What We Offer

We offer a comprehensive benefits package designed to support your well-being, growth, and work-life balance. Benefits vary by country and may include healthcare coverage, parental leave, retirement plans, relocation support, wellness programs, meal and transportation allowances, and other location-specific perks. For the most up-to-date details on benefits available in your location, please refer to our [Benefits page](https://app.notion.com/p/mistralai/Benefits-at-Mistral-36e6ba59a7fe836b93dd01737fcc27ef?source=copy_link).

Privacy Policy Your privacy matters to us. You can learn more about how we handle your personal data in our [Applicant Privacy Policy](https://legal.mistral.ai/terms/applicant-privacy-policy).

## About Mistral

## Company Overview
- **One-liner**: Mistral is a French AI company building open, frontier-grade large language models, developer platforms, and applied AI solutions for enterprises and governments.
- **Entity Type**: Private (Series C)
- **Headquarters**: Paris, France (15 rue des Halles)
- **Founded**: April 2023
- **Founders**: Arthur Mensch (CEO), Guillaume Lample (Chief Science Officer), Timothée Lacroix (CTO)

## Core Business
- **Primary industry/industries**: Artificial Intelligence, Large Language Models, Enterprise AI Software
- **Target customers**: B2B, Enterprise, Government, and Developers (B2D)
- **Mission or purpose statement**: "To make frontier AI open to all, and together solve the world's hardest problems."

## Products & Services
- **Mistral Large**: Frontier-grade large language model for complex reasoning and enterprise tasks.
- **Mistral Small 3**: Efficient, lightweight model for cost-sensitive deployments.
- **Mistral Code / Vibe**: AI agent for long-horizon, autonomous software development and task completion.
- **Le Chat**: Consumer-facing AI assistant and chatbot.
- **Mistral OCR 4**: State-of-the-art document intelligence model for extracting and understanding text from images and PDFs.
- **Mistral Forge**: Custom model development service for training, aligning, and evaluating proprietary AI models on private data.
- **Mistral Studio**: Platform for building, testing, and running AI agents and applications with full control.
- **Mistral Compute**: Infrastructure and orchestration platform for frontier-scale training and inference (edge to cloud).
- **Mistral Search Toolkit**: Tools for integrating search and retrieval into AI applications.
- **Voxtral**: Voice AI model for speech-based interactions.

## Market Standing
- **Valuation/Market Cap**: $4.016 billion (latest reported valuation, per CB Insights; date not specified but likely post-Series C)
- **Key Metric**: Total funding raised across Seed, Series A, Series B, and Series C rounds (specific amounts not disclosed in search results).
- **Notable Investors/Partners**: Not explicitly named in search results, but the company partners with organizations in finance, manufacturing, defense, energy, and the public sector.
- **Growth Signals**: 
  - Rapid scaling: 900+ employees across 30+ nationalities as of mid-2026.
  - 50% of leadership roles held by women.
  - Key product launches on a near-monthly cadence (e.g., Mistral OCR, Forge, Vibe, Compute, Search Toolkit, Voxtral).
  - Strong presence in high-stakes, regulated industries (defense, energy, public sector).

## Competitive Advantages
- **Open-source DNA**: Commitment to openness, transparency, and cost efficiency differentiates Mistral from closed, Big Tech AI labs.
- **Full-stack ownership**: Controls the entire stack from frontier models to developer tools, applications, and compute infrastructure, enabling deep customization and reliability.
- **European leadership**: Positioned as a sovereign, European AI champion, appealing to governments and enterprises seeking data control and regulatory compliance.
- **Speed and rigor**: Culture of rapid experimentation, iteration, and data-driven decision-making.

## Strategic Focus
- **Enterprise and government partnerships**: Co-creating tailored AI systems for mission-critical use cases in finance, manufacturing, defense, energy, and public sector.
- **Open platform ecosystem**: Expanding Mistral Studio and Forge to enable customers to build custom models and agents on their own data.
- **Infrastructure as a product**: Commercializing Mistral Compute to become a platform for others to train and run AI workloads.
- **Continuous model innovation**: Releasing new frontier models and capabilities (OCR, voice, code agents) at a rapid pace.

## Why Work Here
- **Culture**: Flat structure, high ownership, low ego, and a "builders, not order takers" mentality. The company values audacity, speed, rigor, and customer centricity.
- **Remote/Hybrid/Office**: Based in Paris (15 rue des Halles); relocation support and visa sponsorship offered. Specific remote/hybrid policy not detailed, but global team suggests flexibility.
- **Notable perks and benefits** (from careers page):
  - 20 weeks paid parental leave for all birthing parents.
  - 100% employer-sponsored medical, dental, and vision coverage for employees and dependents.
  - 6% 401k match (US) / 5% pension contribution (UK).
  - Childcare support (reserved daycare seats or financial assistance).
  - Meal allowances and transportation support.
  - Fitness and wellness subsidies.
  - Relocation and settling-in services.
  - Financial and career planning support.
- **Team composition**: 900+ employees from 30+ nationalities; 50% female leaders.
- **Interview process**: For science, product, and engineering roles: intro conversation → 2-5 technical exercises → 1-3 interviews (hiring manager + teammates) → values conversation → reference checks.

## Sources
1. [Mistral AI - About Page](https://mistral.ai/about/)
2. [Mistral AI - Careers Page](https://mistral.ai/careers/)
3. [Mistral AI - Homepage](https://mistral.ai/)
4. [CB Insights - Mistral AI Company Profile](https://www.cbinsights.com/company/mistral-ai)
5. [Mistral AI - LinkedIn](https://www.linkedin.com/company/mistralai)

## Other roles at Mistral

- [AI Scientist Intern - (Internship, Masters or Phd)](https://feeny.ai/job/ai-scientist-intern-internship-masters-or-phd-mistral-paris-43jzbe0kx4mv) — Paris, France
- [Engineering Manager, Serverless Containers](https://feeny.ai/job/engineering-manager-serverless-containers-mistral-paris-m06we4kkhq7s) — Paris, France
- [Engineering Manager, Fleet Delivery](https://feeny.ai/job/engineering-manager-fleet-delivery-mistral-paris-zsspnkk7y0k5) — Paris, France
- [Engineering Manager, Storage](https://feeny.ai/job/engineering-manager-storage-mistral-paris-ekf23bqg33ar) — Paris, France
- [Engineering Manager, Sandbox](https://feeny.ai/job/engineering-manager-sandbox-mistral-paris-5wx65405emb2) — Paris, France
- [Senior Engineering Manager, IaaS](https://feeny.ai/job/senior-engineering-manager-iaas-mistral-paris-n545rbk6r28j) — Paris, France
- [Forward Software Engineer](https://feeny.ai/job/forward-software-engineer-mistral-paris-gp4fe2vxk8pe) — Paris, France
- [Forward Software Engineer, Data](https://feeny.ai/job/forward-software-engineer-data-mistral-paris-5j7fnp825t2q) — Paris, France
- [Network Development Engineer, WAN & Edge](https://feeny.ai/job/network-development-engineer-wan-edge-mistral-paris-bb54t43jf8db) — Paris, France
- [Network Development Engineer, Data Center Fabrics](https://feeny.ai/job/network-development-engineer-data-center-fabrics-mistral-paris-3sgd968rfyhv) — Paris, France