--- title: 'Model Behavior Engineer, Reasoning and Decision Making at Elicit' canonical: 'https://feeny.ai/job/model-behavior-engineer-reasoning-and-decision-making-elicit-oakland-3se31vhweyxj' type: 'job' last_seen: '2026-11-05' --- # Model Behavior Engineer, Reasoning and Decision Making at Elicit - **Company:** Elicit - **Location:** Oakland, CA - **Employment:** full-time - **Work type:** remote - **Posted:** 2026-10-17 - **Last confirmed live:** 2026-11-05 - **Apply:** https://jobs.ashbyhq.com/elicit/55f74344-9dc8-437d-97d0-99c8f14661e7 ## Job description ## About Elicit Elicit helps research and business teams investigate hard questions and make high-stakes decisions grounded in evidence. Our ambition is to make high-quality reasoning under uncertainty available at a much greater scale in contexts where stakes are high and feedback is sparse. We're building AI systems whose work people can inspect, question, and improve, so that increasingly capable AI also makes us more wise. ## Why we're hiring for this role Some of the most valuable questions people face are also the hardest to answer well. Which research program should a team advance? What evidence would change its priorities? Which uncertainty is worth resolving before committing to a multi-year, $100 million dollar trial? Today's models can contribute to these decisions, but they often miss a crucial consideration, make an assumption they should have checked, or reverse a recommendation too readily when presented with new information. Further, because they can perform increasing amounts of work autonomously, their process and reasoning is often poorly legible, so decision makers are wary to trust their outputs. Helping with these problems requires a deep understanding of model behaviors, what matters for different types of decisions, the environments and cultures in which decisions are made, and how to evaluate complex, multiplayer systems with many human and agent interactions. We're looking for someone to own that work: understand where our systems fall short, develop ways to evaluate them, and build improvements that help users make better decisions. You'll start with concrete problems in scientific R&D and commercial strategy, and develop approaches that apply across different kinds of decisions. ## About the role You'll join our engineering team and report to an Engineering Manager. You'll work on a cross-functional engineering team, collaborating closely with other engineers, product, design, and domain experts, taking problems from investigation and experimental design through implementation and use in the product. The work combines careful reasoning, the ability to dive into domain specifics, and software design. You'll design agent environments and how agents represent problems, gather evidence, use tools, retain context, revise their conclusions, and coordinate with each other. You'll also make the engineering decisions that let us inspect those processes, test changes, and build on what works. Most of the initial work will involve systems built around existing frontier models. Training or finetuning may be useful for particular problems, but the direction of the work will follow what helps users reason better. ## What you'll own - Understand the decisions we're helping people make. Work through real cases with users and domain experts. Identify their objectives, constraints, available evidence, and important unknowns. Learn enough about an unfamiliar problem to recognize when an answer misses the point. - Define and measure good reasoning. Build evaluations for problems where success is initially underspecified. Combine close inspection of examples, expert judgment, and quantitative analysis. Investigate whether a better score reflects a meaningful improvement, and whether that improvement holds on new cases. - Improve the system's behavior. Turn observed failures into hypotheses you can test. Experiment with problem decomposition, context, tools, and ways for agents to seek information or check their work. Follow promising results through to changes users can benefit from. - Design the software that makes this work reliable. Choose useful abstractions, data structures, and component boundaries for reasoning workflows and evaluations. Make deliberate tradeoffs among simplicity, flexibility, reliability, latency, and cost. Build systems whose failures you and your teammates can diagnose. - Own the quality of what you ship. Write maintainable code, participate in design and code reviews, and test and monitor your changes. Work with other engineers to integrate your systems into the product and improve them as you learn from real use. Example projects - Build and evaluate a workflow that helps a research team compare potential protein targets they could nominate for drug development, works in light of their goals and decision frameworks, performs legible research against detailed and stress-tested theories of success, and stays up to date in light of new findings. - Investigate why an agent overreacts to newly introduced evidence when forecasting clinical trial readouts. Create an evaluation that distinguishes justified changes in judgment from inconsistent ones, then implement and test an improvement. - Design a representation of evidence, assumptions, and unresolved questions that an agent can update as a decision to acquire a new asset evolves, while preserving the information needed to inspect its work. - Improve an agent's ability to notice missing context and ask useful questions before making a recommendation. - Test whether an approach that improves R&D prioritization decisions transfers to business development strategy, and use the result to decide what belongs in a shared component. ## What you bring to the role - Rigorous thinking about ambiguous problems. You can make a vague question precise, identify hidden assumptions, weigh conflicting evidence, and explain what would change your mind. You can make progress while remaining clear about what you don't know. This might come from a range of backgrounds such as original research in economics or developing quantitative trading approaches under adversarial conditions. - Curiosity across domains and clear communication. You enjoy getting to grips with unfamiliar subjects, learning from specialists, and explaining your reasoning to people with different expertise. A good sign is having leveraged domain expertise across multiple scientific domains or business specialities. - Good experimental instincts. You can devise a useful test when there isn't an established benchmark, distinguish evidence from noise, and recognize when your evaluation is rewarding the wrong behavior. You're willing to inspect individual failures in detail. - The ability to implement your ideas. You can independently write and debug code, work with data and model APIs, and take an experiment into a maintained codebase. You're comfortable with Python or a comparable language and willing to work across the relevant parts of our stack. - Practical familiarity with language models. You've explored their capabilities and limitations enough to have informed ideas about how to improve them. You can choose an approach based on the problem and update it as models change. - Strong engineering and architectural judgment. You can design a coherent system, explain your choices, and recognize when an abstraction helps or adds unnecessary complexity. You've built software that others can understand, use, and extend. Experience may come from products, research systems, or other substantial technical projects; a full-stack engineering background is not required. - Effective use of coding assistants. You use AI tools to increase what you can build while taking responsibility for understanding the design and verifying the result. We care about evidence of these abilities. Substantial projects, thoughtful experiments, and clear explanations of technical decisions are useful ways to show us how you work. Am I a good fit? You might enjoy this role if you find yourself wanting to work through questions like these: - A model's recommendation sounds convincing to non-experts, but an expert thinks it is supported by slop. How would you investigate the disagreement and turn what you learn into a useful evaluation? - An agent has acquired new evidence. How should the agent identify which conclusions need revisiting, and how would you test that it does so correctly? How does this scale as the amount of evidence grows to tens of thousands of documents? - A workflow succeeds on a handful of simple examples. What would you need to learn before using it for customers, and which parts of the implementation would you change first? You don't need a rehearsed answer. We'd like to understand how you approach problems like these, what you would build, and how you would learn whether it worked. Location and travel We have a great office in Oakland, CA, and we'd love to see you there if you're local. That said, we're just as happy for you to work remotely. We do get the whole team together for a quarterly retreat somewhere fun, because in-person time matters to us. ## Benefits and perks In addition to working on important problems as part of a productive and positive team, we also offer great benefits (with some variation based on location): - Flexible work environment - work from our office in Oakland or remotely [as long as you can travel to work in-person for retreats and coworking events](https://www.notion.so/elicit-research/In-person-work-at-Elicit-How-we-combine-remote-flexibility-with-in-person-time-233cfae9876c80f8802ed08d4c2548a5?source=copy_link) - Fully covered health, dental, vision, and life insurance for you, generous coverage for the rest of your family (FSA/HSA, too) - Flexible vacation policy, with a recommendation of 20 days / year and plenty of company holidays - Every Elician receives a $200 monthly wellbeing stipend to spend on whatever supports your health and wellbeing. - 401K with a 6% employer match - A new Mac + $1,000 budget to set up your workstation or home office in your first year, then $500 every year thereafter - $1,000 quarterly AI Experimentation & Learning budget, so you can freely experiment with new AI tools to incorporate into your workflow, take courses, purchase educational resources, or attend AI-focused conferences and events - A team administrative assistant who can help you with personal and work tasks - You can find more reasons to work with us [in this thread](https://twitter.com/stuhlmueller/status/1694059800408269091)! ## Compensation For all roles at Elicit, we use a data-backed compensation framework to make sure our salaries are market-competitive, equitable, and simple. For this role, we're targeting starting ranges of: - Career (L3): $185-220K + equity - Senior (L4): $220-260K + equity - Expert/Staff (L5): $250-320K + significant equity We're optimizing for a hire who can contribute at a L4/senior-level or above. We'd love to meet staff/principal level contributors as well. We also offer above-market equity for all roles at Elicit, as well as employee-friendly equity terms. ## About Elicit ## Company Overview - **One-liner**: Elicit is an AI research assistant that automates time-consuming research tasks such as literature review, data extraction, and synthesis, helping scientists and researchers become more evidence‑based. - **Entity Type**: Private (Public Benefit Company; Series A stage with $31 M total funding) - **Headquarters**: Oakland, California, United States - **Founded**: 2023 (predecessor lab work began in 2018) - **Founders**: Andreas Stuhlmüller (CEO) and Jungwon Byun (COO) ## Core Business - **Primary industry/industries**: AI‑powered Research Services / Scientific Software - **Target customers**: B2B (pharmaceutical companies, academic institutions, enterprises) and B2C (individual researchers); primary users are experts in biomedicine, health economics, computer science, and other evidence‑driven fields. - **Mission or purpose statement**: “To scale up good reasoning for scientists and beyond” – the company is a Public Benefit Corporation that prioritises long‑term positive impact alongside profit. ## Products & Services - **[Elicit Platform](https://elicit.com/)**: Web‑based AI research assistant. Users ask research questions, and the platform searches over 138 M papers, extracts structured data, and generates research reports with sentence‑level citations. Supports systematic literature reviews compliant with PRISMA 2020. **Type**: SaaS (web app) - **[Elicit Systematic Review](https://elicit.com/)**: A specialised workflow for conducting reproducible, traceable, and auditable systematic reviews. Achieves 95% search recall, 97% abstract screening, and 96% data extraction accuracy. **Type**: SaaS (feature of the platform) - **[Elicit API](https://elicit.com/)**: Programmatic access to Elicit’s search and report generation capabilities, enabling integration into external workflows and custom tools. **Type**: API - **[Elicit Research Agent](https://elicit.com/)**: An autonomous agent that can explore broad topics, create competitive landscapes, and synthesise findings across multiple data sources. **Type**: SaaS (feature) - **[Elicit Alerts](https://elicit.com/)**: A notification system that helps researchers stay current with new publications without inbox overload. **Type**: SaaS (feature) ## Market Standing - **Valuation/Market Cap**: Not publicly disclosed - **Key Metric**: **Total Funding** – $31 M (Seed $9 M led by Fifty Years, Series A $22 M co‑led by Footwork and Spark Capital); the company has “millions of dollars of recurring revenue” and is growing revenue month over month [elicit.com](https://elicit.com/careers). - **Notable Investors/Partners**: Fifty Years, Basis Set, Illusian, Mythos, Julian Capital; angel investors include Tom Preston‑Werner (GitHub co‑founder), Arash Ferdowsi (Dropbox co‑founder), Thomas Ebeling (former Novartis CEO), and Jeff Dean (Google Chief Scientist) [elicit.com](https://elicit.com/careers). - **Growth Signals**: - Over 5 million researchers use Elicit, including staff at major universities and enterprises. - Employee headcount reached ~40 in mid‑2026, a 40.5% year‑over‑year increase [linkedin.com](https://www.linkedin.com/company/elicit-research). - 13 active job postings; subscription model launched 18 months earlier is driving fast recurring‑revenue growth. - Recent product releases: Research Agent, API, Systematic Review updates aligned with PRISMA 2020, and a more powerful “Strict Screening” mode. ## Competitive Advantages - **Accuracy & Trust**: Elicit supports every AI‑generated claim with sentence‑level citations from the underlying papers, and validates its accuracy against Cochrane reviews. It is the most accurate AI product for scientific research [elicit.com](https://elicit.com/). - **Systematic Review Capabilities**: Unlike general‑purpose AI chatbots, Elicit provides rich, interactive tables and multi‑step workflows that meet rigorous academic standards (e.g., PRISMA 2020). - **Early Mover & Alignment‑Focused**: Elicit began working with language models in 2018, well before the current AI boom, and is structured as a Public Benefit Company with a mission to advance AI safety through process‑supervised reasoning. - **Deep Researcher‑Niche Focus**: The product is built specifically for scientists, not general‑purpose use, creating strong retention and domain‑specific defensibility. ## Strategic Focus - **Product Expansion**: Continuously adding new features (Research Agents, API, Alerts) to cover the full research workflow from discovery to report generation. - **Enterprise & International Growth**: Hiring Enterprise Account Executives for both US and EMEA regions, indicating a push into large institutional contracts and global markets. - **Scaling Revenue**: The company is “growing fast” with millions in recurring revenue and aims to accelerate feature shipping to meet demand from paying subscribers [elicit.com](https://elicit.com/careers/aa99e2e9-5b15-4cd3-ac9d-9c9177ff61c8). - **AI Safety & Alignment**: Continues to advance methods for building scalable ML systems with human‑understandable task decompositions, contributing to long‑term safe AGI research. ## Why Work Here - **Culture**: High‑agency, low‑bureaucracy environment where “everyone takes ownership and avoids egos and status games.” The team values transparency, truth‑seeking, and continuous growth. Cross‑team collaboration is the norm [elicit.com](https://elicit.com/careers). - **Remote/Hybrid Policy**: Flexible – team members can work from the Oakland office or remotely within time zones between GMT and GMT‑8. Quarterly in‑person company offsites are expected (travel 4+ times per year). Minimal meetings and no micromanagement [elicit.com](https://elicit.com/careers). - **Compensation & Benefits**: - Competitive salaries (e.g., Senior Software Engineer $185‑270K + equity). - Full coverage health, dental, vision, and life insurance for employee and generous family coverage. - 20 weeks paid parental leave (12 weeks fully paid). - 401K with 6% employer match. - $1,000 quarterly AI experimentation & learning budget. - Flexible PTO with recommended minimum 20 days/year. - New Mac + $1,000 workstation budget in first year, $500 annually thereafter. - Team administrative assistant available for personal/work tasks [elicit.com](https://elicit.com/careers/aa99e2e9-5b15-4cd3-ac9d-9c9177ff61c8). - **Engineering Culture**: Engineers work directly with LLM experts; the company predates the AI bubble, offering deep learning opportunities. The stack is ML‑heavy, and engineers ship user‑facing features weekly. Roles include ML Engineer, Frontend Engineer, AI Engineer, and Evaluation Engineer. - **Potential Downsides**: High ambiguity as an early‑stage startup; projects shift frequently. Self‑direction is expected; close mentorship is limited. Limited management track (few direct reports) – the team is intentionally kept small. ## Sources 1. [elicit.com](https://elicit.com/) – Main product page 2. [elicit.com/careers](https://elicit.com/careers) – Careers page with culture, benefits, investor list 3. [elicit.com/team](https://elicit.com/team) – Team and leadership page 4. [linkedin.com/company/elicit-research](https://www.linkedin.com/company/elicit-research) – LinkedIn company profile (headcount, funding, locations) 5. [elicit.com/careers/aa99e2e9-5b15-4cd3-ac9d-9c9177ff61c8](https://elicit.com/careers/aa99e2e9-5b15-4cd3-ac9d-9c9177ff61c8) – Senior Software Engineer job posting (compensation, benefits, engineering culture) ## Other roles at Elicit - [Senior Software Engineer, Data and Integrations](https://feeny.ai/job/senior-software-engineer-data-and-integrations-elicit-oakland-jk378xnmxy9h) — Oakland, CA - [Infrastructure Engineer](https://feeny.ai/job/infrastructure-engineer-elicit-oakland-s1arcr5hndkw) — Oakland, CA - [Engineering Manager](https://feeny.ai/job/engineering-manager-elicit-oakland-426esgz1dm9r) — Oakland, CA - [Growth](https://feeny.ai/job/growth-elicit-oakland-zzw838hhezfq) — Oakland, CA - [Enterprise Account Executive - EMEA](https://feeny.ai/job/enterprise-account-executive-emea-elicit-remote-mfj7x8b2zkws) - [Enterprise Account Executive](https://feeny.ai/job/enterprise-account-executive-elicit-oakland-esdxnq1dv6ag) — Oakland, CA - [ML Research Resident](https://feeny.ai/job/ml-research-resident-elicit-oakland-fxt013nvwv6c) — Oakland, CA - [AI Engineer](https://feeny.ai/job/ai-engineer-elicit-oakland-nxjht42w98aq) — Oakland, CA - [General interest](https://feeny.ai/job/general-interest-elicit-oakland-wq080errqp66) — Oakland, CA - [Senior Software Engineer](https://feeny.ai/job/senior-software-engineer-elicit-oakland-fxdq7zz9cexa) — Oakland, CA