---
title: 'Research Engineer, Evals & RL Environments at Nolla Health'
canonical: 'https://feeny.ai/job/research-engineer-evals-rl-environments-nolla-health-new-york-xyt7kyzqj6zc'
type: 'job'
last_seen: '2026-10-31'
---

# Research Engineer, Evals & RL Environments at Nolla Health

- **Company:** Nolla Health
- **Location:** New York, NY
- **Compensation:** $180k–$240k
- **Employment:** full-time
- **Work type:** onsite
- **Posted:** 2026-09-26
- **Last confirmed live:** 2026-10-31
- **Apply:** https://jobs.ashbyhq.com/nollahealth/ca4faa24-beaa-46b6-b86e-042342c59434

## Job description

New York City · Full-time Build the environments that teach us what healthcare AI can do—and where it needs to improve. At Nolla Health, we’re building AI-powered healthcare. To improve the systems involved in delivering care, we need realistic ways to test them: cases that unfold over time, tools an agent can use, and clear criteria for judging what happens. We’re looking for a research engineer to build evaluation harnesses, simulated environments, and data pipelines that turn clinical knowledge and appropriately governed data into useful evaluation and training assets. You’ll work with engineers and clinicians to define tasks, build the systems that run them, and make the results trustworthy. The work will support our own agents and models, with the opportunity to develop benchmarks and environments for external AI teams.

## What you'll do

- Build harnesses that run agents through reproducible tasks, capture their actions, and make failures easy to investigate.
- Develop multi-step and multi-visit environments with patient state, clinical tools, and realistic consequences for an agent’s decisions.
- Work with clinicians to turn clinical workflows into well-defined tasks, rubrics, and success criteria.
- Build data pipelines for preparing, validating, versioning, and tracing evaluation and training datasets.
- Develop scoring and reward mechanisms, combining programmatic checks, model-based grading, and clinician review where appropriate.
- Test graders and environments for ambiguity, shortcuts, data leakage, and reward hacking.
- Run experiments, analyze trajectories, and identify whether changes improve performance across meaningful slices of cases.
- Work with our applied AI engineer to turn evaluation findings into product improvements.
- Build with privacy, access controls, and permitted data use in mind.

## What you bring

- Strong programming skills and experience building reliable software for experiments, data processing, or agent systems.
- Hands-on experience building an agent evaluation harness, an RL environment, or closely related infrastructure.
- The ability to translate an open-ended problem into a runnable task with measurable outcomes.
- Careful judgment about data quality, reproducibility, grading reliability, and what a benchmark result actually supports.
- Comfort debugging across datasets, environment state, agent behavior, and scoring code.
- The ability to work with clinicians and turn domain expertise into precise specifications and tests.
- Evidence of independent execution through shipped systems, research implementations, open-source work, or projects you’ve owned.

We expect many candidates to have roughly two to six years of relevant experience, but we’re flexible for someone with exceptional work. Research experience is valuable; you should also enjoy building and maintaining the systems behind the experiments. Bonus points

- RL environments, simulated tool use, or long-horizon agent benchmarks.
- Synthetic data generation, human review workflows, or dataset quality systems.
- Reward design, model-based graders, and validation against expert judgments.
- Building evaluation or training data products for AI labs.
- Healthcare data, clinical reasoning evaluations, or longitudinal patient workflows.

Healthcare experience is welcome, but it isn’t required. Curiosity about the domain and a willingness to work closely with clinicians matter. You’ll help define how we measure progress toward AI that can support care over time. Your work will make it possible to investigate failures, compare approaches, and build training signals grounded in realistic tasks. You’ll own both the experimental design and the engineering needed to make it useful, with room to shape a new area of work at Nolla. We’d ideally like you to be based in New York City.

## Role logistics, compensation & benefits

- Role Type: Engineering
- Salary: $180,000–$240,000, based on experience
- Job Type: Full-time
- Work Setup: New York City preferred
- Equity: Meaningful equity, commensurate with experience
- Health Insurance: Medical, dental, and vision
- HSA/FSA: Eligible
- Time Off: Flexible, unlimited vacation
- Additional Perks: Meal stipends, team retreats
- Work Hours: Flexible but demanding. We're building something that matters
- Growth: Founding team members step into expanded roles as we scale

## About Nolla Health

## Company Overview
- **One-liner**: Nolla Health is an AI-powered skin health platform that combines proprietary AI models with clinician oversight to provide personalized, asynchronous treatment plans for skin conditions.
- **Entity Type**: Private (Seed stage)
- **Headquarters**: New York, New York, United States
- **Founded**: 2024
- **Founders**: Luis Wenus (CEO) and Luis R. Soenksen (CTO)

## Core Business
- **Primary industry**: Healthtech / AI-powered dermatology and skincare
- **Target customers**: B2C – consumers seeking treatment for acne, redness, wrinkles, and other skin concerns
- **Mission statement**: “Care should be continuous and easy to navigate” – building a system that helps people understand what’s going on and what to do next [nollahealth.com](https://www.nollahealth.com/about)

## Products & Services
- **Nolla Skin (formerly Nolla Acne)**: A mobile app (iOS) that offers daily AI-powered face scans, clinician-reviewed treatment plans, and prescription medication delivery. Subscription-based model. Rated #1 Skin Treatment app on the App Store with 7,000+ reviews and a 4.9-star rating [linkedin.com](https://www.linkedin.com/company/nolla-health).
- **Nolla MD**: Asynchronous clinician chat service for general health concerns. A licensed U.S. provider reviews the case and responds via message for $39. Currently in development for broader specialty care [nollahealth.com](https://www.nollahealth.com/).
- **Medical Skincare (in development)**: A skincare app that adapts to the user’s changing needs, with personalized product recommendations [nollahealth.com](https://www.nollahealth.com/).

## Market Standing
- **Valuation/Market Cap**: Not disclosed
- **Key Metric**: Total funding of $4.5M (Seed round, October 2025) led by General Catalyst [linkedin.com](https://www.linkedin.com/company/nolla-health)
- **Notable Investors/Partners**: General Catalyst (lead), plus two other unnamed investors
- **Growth Signals**: 
  - Expanded from acne-only to full skincare (Nolla Skin) in May 2026 [linkedin.com](https://www.linkedin.com/company/nolla-health)
  - Monthly website traffic of ~17,800 visits, growing 1.7% month-over-month [linkedin.com](https://www.linkedin.com/company/nolla-health)
  - Strong App Store traction: #1 Skin Treatment app, 4.9 stars, 7,000+ reviews
  - Small but focused team (8 employees) with presence in the US, Philippines, and Poland [linkedin.com](https://www.linkedin.com/company/nolla-health)

## Competitive Advantages
- **AI + clinical oversight**: Every diagnosis and prescription is reviewed by a licensed U.S. medical provider, combining speed with trust [nollahealth.com](https://www.nollahealth.com/).
- **Continuous care model**: Daily AI skin scans and monthly treatment updates create a compounding clinical relationship that improves over time.
- **Data moat**: Proprietary AI trained on real clinical outcomes, with daily user scans generating a unique longitudinal dataset.
- **HIPAA compliant and privacy-focused**: Strong emphasis on data security and patient privacy [nollahealth.com](https://www.nollahealth.com/).

## Strategic Focus
- **Expand beyond acne**: Nolla Skin now addresses redness, wrinkles, and hyperpigmentation, with plans to add more specialty care services.
- **Build the “personal doctor” vision**: Integrating Nolla MD for general health and expanding the platform to cover end-to-end care.
- **Scale AI capabilities**: Hiring a Founding AI Engineer to advance the core predictive and diagnostic models [builtin.com](https://builtin.com/company/nolla-health).

## Why Work Here
- **Culture**: Founded by doctors, engineers, and researchers – a mission-driven team focused on making healthcare accessible and understandable.
- **Work environment**: In-office for engineering and product roles in New York City (with a second office in Norway). Some roles (e.g., Social Media Coordinator) are remote/contract [nollahealth.com](https://www.nollahealth.com/careers).
- **Engineering focus**: Early-stage startup with a small team (8 people) – opportunity to have significant impact on the product and technical direction. Current open roles include Founding AI Engineer and Product Designer [builtin.com](https://builtin.com/company/nolla-health).
- **Perks**: Not explicitly listed, but typical of a seed-stage healthtech startup: equity, direct work with founders, and the chance to shape a product that already has strong user traction.

## Sources
1. [nollahealth.com – Homepage](https://www.nollahealth.com/)
2. [nollahealth.com – About](https://www.nollahealth.com/about)
3. [nollahealth.com – Careers](https://www.nollahealth.com/careers)
4. [builtin.com – Nolla Health Profile](https://builtin.com/company/nolla-health)
5. [linkedin.com – Nolla Health Company Page](https://www.linkedin.com/company/nolla-health)

## Other roles at Nolla Health

- [Backend Engineer](https://feeny.ai/job/backend-engineer-nolla-health-new-york-b65wsr6v9vv9) — New York, NY
- [Clinical Operations Lead](https://feeny.ai/job/clinical-operations-lead-nolla-health-new-york-94ar27zvgxb4) — New York, NY
- [Product Designer](https://feeny.ai/job/product-designer-nolla-health-new-york-bp0zf49fq6d8) — New York, NY
- [Clinical Content Lead](https://feeny.ai/job/clinical-content-lead-nolla-health-new-york-nkk2d5ah0jf1) — New York, NY
- [Applied AI Engineer](https://feeny.ai/job/applied-ai-engineer-nolla-health-new-york-dtvx43b17smy) — New York, NY