---
title: 'Member of Technical Staff, Evals and Post-Training at Profound'
canonical: 'https://feeny.ai/job/member-of-technical-staff-evals-and-post-training-profound-new-york-9vbs0t0km12d'
type: 'job'
last_seen: '2026-11-03'
---

# Member of Technical Staff, Evals and Post-Training at Profound

- **Company:** [Profound](https://feeny.ai/companies/profound)
- **Location:** New York, NY
- **Employment:** full-time
- **Work type:** onsite
- **Posted:** 2026-10-29
- **Last confirmed live:** 2026-11-03
- **Apply:** https://jobs.ashbyhq.com/profound/8f2dc9c1-82c1-4f9b-93f0-ebeabf053cd8

## Job description

Profound is the fastest-growing AI marketing platform, used by 15% of the Fortune 500 including Comcast, Estée Lauder, and Walmart, and innovators like Ramp, MongoDB, and Figma. It is where marketing teams do the work: research, briefs, content, campaigns, reporting, all in one place, alongside agents that carry the load with them. Built on 2B+ real user prompts and growing, Profound’s data shows you what people ask AI and what the models say back. Profound's AI Marketer joins that data with deep context about our customers to find the opportunities worth acting on, and then puts agents to work: automating reporting, drafting content, auditing pages for readability, running competitive research. It measures what works and gets better every day. As a Member of Technical Staff in our Evals and Post-training team, you’ll build the evaluation and measurement systems that tell us how good AI (including Profound's harness, known as[Aim](https://www.tryprofound.com/features/aim)) is at marketing tasks. These evals guide what we ship, and they are the foundation for our post-training initiatives: the benchmarks, graders, and environments you build become the signal our models are trained against.

## What you’ll do

- Build Profound’s eval system: tasks, rubrics, LLM judges, programmatic verifiers, regression alerts, and self-improvement loops where we look at the traces when something is wrong and come up with the fix
- Define what a great AI Marketer run looks like, and analyze trajectories across multi-step tool use, analytical correctness, and content quality
- Work with marketing experts and data labeling companies to define tasks, metrics, rubrics, and other grading mechanisms
- Close the loop from usage: input use cases, cluster failure modes, and turn these into reliable evals
- Turn eval results and expert feedback into training signal: rewards, preference data, and training environments
- Build tooling for debugging model and agent behavior
- Make evals part of how we decide things: wired into CI, launch reviews, and model selection

## Who you are

- 2+ years building evaluation or measurement systems, whether AI evals, experimentation, ranking, or search quality
- Strong Python and data skills, with a track record of shipping production systems
- Deep familiarity with LLM evaluation: LLM-as-judge, benchmark design, agent harnesses, calibration, and understanding how to integrate them into professional settings
- Sound experimental design, and the instinct to separate signal from noise in non-deterministic systems
- Familiarity with modern post-training methods: SFT, preference optimization, and RL
- Strong opinions about how models and agents should behave, and keeping up with current research
- Comfortable operating in a fast-paced startup environment with rapid iteration cycles

Location This is an on-site role based in our NYC or SF office, designed for builders who thrive on speed, iteration, and meaningful impact. For this role, the expected base salary range is $230,000 to $325,000. Profound’s total compensation package is designed to be competitive and includes base salary, equity, and a full range of benefits and perks. Final compensation will depend on factors such as your skills, experience, qualifications, and location, and will be determined during the interview process. Our recruiting team will share more details about the full compensation package and benefits as you move through hiring.

## #LI-PRO

Note: All official communication from Profound will come from a @tryprofound.com email address. If you're contacted by anyone using a different domain, please disregard and report it as spam.

## About Profound

## Company Overview
- **One-liner**: Profound is the full-stack marketing platform that helps brands understand, analyze, and optimize their visibility across AI-driven answer engines like ChatGPT, Perplexity, and Gemini.
- **Entity Type**: Private (Series C, Unicorn)
- **Headquarters**: New York, New York, United States (also offices in San Francisco, London, and Buenos Aires)
- **Founded**: 2024
- **Founders**: James Cadwallader (CEO) and Dylan Babbs (CTO)

## Core Business
- **Primary industries**: AI marketing intelligence, Answer Engine Optimization (AEO), brand visibility analytics
- **Target customers**: B2B – enterprise marketing teams (e.g., Target, Walmart, Figma, MongoDB, Charlotte Tilbury, US Bank)
- **Mission**: “To build the best technology so businesses can understand and control how they appear in AI answers.”

## Products & Services
- **Answer Engine Insights**: Dashboard providing real-time visibility into how brands are mentioned and rated across ChatGPT, Gemini, Claude, Perplexity, and other AI platforms.
- **Agent Analytics**: Tracks how a brand’s website is crawled and interpreted by major AI models.
- **Prompt Volumes**: Shows what millions of people are asking AI, enabling demand alignment.
- **Profound Agents**: Autonomous AI workers that execute marketing functions (content creation, PR, brand sentiment, SEO/AEO) directly within the platform.
- **Profound Ecosystem**: Includes training, certification, an agency marketplace, and Profound University for marketers.
- **Integrations**: HubSpot, Google Workspace, Gamma, Parallel AI, Vercel (with more being added continuously).

## Market Standing
- **Valuation/Market Cap**: $1 billion (unicorn as of Series C, February 2026)
- **Key Metric**: Total funding raised $154.5 million across four rounds; $96M Series C led by Lightspeed Venture Partners (Feb 2026)
- **Notable Investors/Partners**: Lightspeed Venture Partners, Sequoia Capital, Kleiner Perkins, Evantic, Saga Ventures, South Park Commons
- **Growth Signals**: 
  - 1B+ prompts analyzed daily, 30B+ citations analyzed daily
  - 1800+ customers worldwide
  - 169 employees (monthly headcount growth of +15.1%)
  - 88 open positions
  - Global footprint in 6 countries (US, UK, Argentina, India, Canada, Brazil)

## Competitive Advantages
- **First-mover advantage** in the AI visibility / AEO category, with proprietary data on how AI models crawl and represent brands.
- **Integrated platform** that moves from insight (analytics) to execution (Agents) in one system, replacing fragmented toolchains.
- **Strong talent pool**: early hires from Yext, 6sense, Amazon, Attentive, and consulting firms.
- **Rapid scaling**: raised from Seed to Series C and reached unicorn status in 18 months.

## Strategic Focus
- **Platform expansion**: Building out the Profound Ecosystem (training, certification, agency marketplace) to create a new category of “Marketing Engineer.”
- **Global reach**: Growing engineering and go-to-market teams across NYC, SF, London, and Buenos Aires.
- **Product depth**: Enhancing Agents with deeper automation while keeping humans in control of strategy.
- **Partnerships & integrations**: Deepening ties with major marketing and productivity tools.

## Why Work Here
- **Compensation**: Strong base salary plus significant equity in a well-funded unicorn.
- **Culture**: High-context, direct communication with a bias for action; “merit-driven, not tenure-driven” career acceleration.
- **Work model**: In-office presence required in NYC, SF, London, or Buenos Aires; daily catered meals, late-night Uber reimbursement, fitness stipend, and flexible time off.
- **Engineering focus**: Key roles include Agent Engineer, AI/ML Engineer, Design Engineer, Forward Deployed Engineer – competing for AI talent against companies like OpenAI and Anthropic.
- **Growth**: Rapid scaling environment with visible impact; opportunity to define a new category.

## Sources
1. [tryprofound.com](https://www.tryprofound.com/)
2. [tryprofound.com/careers](https://www.tryprofound.com/careers)
3. [LinkedIn / Profound](https://www.linkedin.com/company/tryprofound)
4. [Fortune – Exclusive: Profound raises $96M](https://fortune.com/2026/02/24/exclusive-as-ai-threatens-search-profound-raises-96-million-to-help-brands-stay-visible/)
5. [tryprofound.com/blog – Series C announcement](https://www.tryprofound.com/blog/profound-raises-96m-series-c)

## Other roles at Profound

- [Strategic Partnerships Associate](https://feeny.ai/job/strategic-partnerships-associate-profound-new-york-mbchy5kbs94x) — New York, NY
- [Marketing Engineer, Discoverability](https://feeny.ai/job/marketing-engineer-discoverability-profound-new-york-qvjbgz7rk7fh) — New York, NY
- [Data Acquisition Lead](https://feeny.ai/job/data-acquisition-lead-profound-new-york-42rar352cty1) — New York, NY
- [Member of Technical Staff, Engineering Manager](https://feeny.ai/job/member-of-technical-staff-engineering-manager-profound-new-york-ekevm23z3t9x) — New York, NY
- [Manager, Recruiting Operations](https://feeny.ai/job/manager-recruiting-operations-profound-new-york-za4sfg37r2qn) — New York, NY
- [G&A Recruiter](https://feeny.ai/job/g-a-recruiter-profound-new-york-b3da8brjc24m) — New York, NY
- [Office Operations Manager](https://feeny.ai/job/office-operations-manager-profound-london-psgjhmp9f2fh) — London, United Kingdom
- [Head of Design](https://feeny.ai/job/head-of-design-profound-new-york-st0vbetehe8w) — New York, NY
- [GTM Enablement Program Manager](https://feeny.ai/job/gtm-enablement-program-manager-profound-new-york-b49k9ctd6jgq) — New York, NY
- [Manager, Forward Deployed Marketing Engineers](https://feeny.ai/job/manager-forward-deployed-marketing-engineers-profound-new-york-s3kp56tmky1m) — New York, NY