---
title: 'Senior Product Manager, Model APIs & Developer Experience at Together AI'
canonical: 'https://feeny.ai/job/senior-product-manager-model-apis-developer-experience-together-ai-san-francisco-9k7297rxmar1'
type: 'job'
last_seen: '2026-09-04'
---

# Senior Product Manager, Model APIs & Developer Experience at Together AI

- **Company:** Together AI
- **Location:** San Francisco, CA
- **Posted:** 2026-08-17
- **Last confirmed live:** 2026-09-04
- **Apply:** https://job-boards.greenhouse.io/togetherai/jobs/5210951007

## Job description

## About the Role

Together serves a broad portfolio of open-weight models, backed by infrastructure designed to run them quickly and efficiently. The interfaces around those models shape the entire customer experience: how easily a developer can migrate an application, how reliably an agent can use a model, and how a team runs large asynchronous workloads.

As Senior Product Manager for Model APIs and Developer Experience, you will own those interfaces. Your scope will extend beyond chat to include the APIs and developer experience for image, video, voice, and passthrough models. You will also own compatibility with the wider developer and agent ecosystem, the voice consumption experience and associated model partnerships, and the evolution of our batch inference product.

These areas are connected by a single goal: make Together's models easy to adopt and reliable to build on for developers and autonomous agents.

This is a hands-on product role. You will read API specifications, test integrations, inspect code when useful, and build prototypes or demo applications to sharpen your thinking. You will work closely with engineering and research, own the product direction, make thoughtful tradeoffs, ship, and learn from how customers use what we build.

## Responsibilities

- Set the product direction and roadmap across chat and multimodal APIs, ecosystem compatibility, voice, and batch inference.
- Close the API and behavioral gaps that make it harder for customers to move workloads from proprietary model providers to Together.
- Develop a grounded view of how Together's APIs perform in the developer and agent ecosystem, and turn the most important gaps into clear product priorities.
- Define an intuitive API and consumption experience for real-time and agentic voice applications.
- Build productive relationships with voice model partners and align internal and external teams around a strong joint product experience.
- Reimagine batch inference across the job lifecycle, developer experience, completion guarantees, pricing, and packaging.
- Build lightweight prototypes and demo applications to test product ideas and reduce uncertainty before committing significant engineering resources.
- Work closely with engineering and research to understand technical constraints, make product tradeoffs, and deliver reliable customer experiences.
- Talk with customers and study product usage to separate isolated requests from patterns that should shape the platform.
- Create a clear, active roadmap and communicate why we are making specific investments and what we expect them to change.

## Requirements

- Meaningful experience with APIs and developer tools, whether you designed them, built them, or owned them as a product manager.
- Strong product judgment and the ability to make clear decisions in an evolving market.
- A willingness to get close to the work by reading specifications and code, testing integrations directly, and building working prototypes with AI development tools.
- A track record of earning trust with engineering and external partners through preparation, sound technical judgment, clear communication, and follow-through.
- A bias toward experimentation and iteration. You know how to gather enough evidence to make a decision, ship, and adjust based on what you learn.
- Strong communication and relationship-building skills, including the ability to align teams and move work forward across company boundaries..

## About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

## Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $200 - 280k + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

## Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy athttps://www.together.ai/privacy.

## About Together AI

## Company Overview
- **One-liner**: Together AI is the AI Native Cloud, a full-stack platform for production AI that provides inference, fine-tuning, and GPU compute powered by cutting-edge systems research.
- **Entity Type**: Private (Series C)
- **Headquarters**: San Francisco, California, United States
- **Founded**: 2022
- **Founders**: Vipul Ved Prakash (CEO), Ce Zhang (CTO), Tri Dao (Chief Scientist), Chris Ré, Percy Liang

## Core Business
- **Primary industry**: AI Infrastructure / Cloud Computing
- **Target customers**: B2B – AI-native startups (e.g., Cursor, Decagon, Eleven Labs), enterprise SaaS (Salesforce, Zoom, Zomato), and AI researchers.
- **Mission**: “Significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models” — with a commitment to open and transparent AI development.

## Products & Services
- **Serverless Inference**: Fast on-demand inference for open-source models with no infrastructure management.
- **Batch Inference**: Asynchronous processing of massive workloads (up to 30B tokens per model) at reduced cost.
- **Dedicated Model Inference**: Deploy models on dedicated GPU infrastructure for speed and control.
- **Dedicated Container Inference**: GPU infrastructure optimized for generative media (video, audio, image).
- **Fine-Tuning**: Fine-tune open-source models using latest research techniques (improves accuracy, reduces hallucinations).
- **Accelerated Compute**: Self-serve instant clusters to thousands of GPUs, optimized with Together Kernel Collection.
- **Model Shaping**: Tools to accelerate inference, model shaping, and pre-training.
- **Managed Storage**: High-performance object storage and parallel filesystems with zero egress fees.
- **Sandbox**: Fast, secure code sandboxes for AI app/agent development environments.

## Market Standing
- **Valuation/Market Cap**: Not publicly disclosed; recent Series C reportedly doubled valuation (amount undisclosed) [cbinsights.com](https://www.cbinsights.com/company/together-4)
- **Key Metric**: **Total Funding** – $1.334B (including $800M Series C announced in mid-2026) [cbinsights.com](https://www.cbinsights.com/company/together-4)
- **Notable Investors/Partners**: Kleiner Perkins, NVIDIA, Salesforce Ventures, Prosperity7 Ventures (Aramco), and 29+ others across rounds.
- **Growth Signals**: 
  - Headcount grew 91% YoY to ~280 employees [linkedin.com](https://www.linkedin.com/company/togethercomputer)
  - Acquired CodeSandbox (Dec 2024) and Refuel.AI (May 2025)
  - Customers include Cursor, Decagon, Eleven Labs, AI21, Hedra, Cartesia, Salesforce, Zoom, Zomato
  - Published nine papers at ICML 2026; open-sourced ParallelKernelBench

## Competitive Advantages
- **Full-stack AI platform** covering inference, fine-tuning, compute, storage, and sandboxes — all integrated.
- **World-class research team** co-designing algorithms, kernels, and hardware (e.g., Tri Dao, co-inventor of FlashAttention).
- **Open-source commitment** and contributions (models, datasets, research) build developer trust and ecosystem lock-in.
- **Cost performance**: Claims 2x faster inference and 60% lower cost vs. alternatives through research-driven optimizations.

## Strategic Focus
- Accelerate the shift to open-source AI by making it economically viable at scale.
- Continue investing in systems research (GPU programming, kernel optimization, model shaping) to improve performance and cost.
- Expand enterprise adoption through dedicated deployments and partnerships.
- Grow the platform’s capabilities (e.g., managed storage, sandboxes) to reduce friction for AI-native builders.

## Why Work Here
- **Culture**: Values include “Do more with less,” “Open and responsible development,” “Empower innovation,” and “Optimizers” — a research-driven, mission-oriented environment.
- **Remote/Hybrid/Office**: Primarily office-based in San Francisco (251 Rhode Island Street) with employees across 16 countries. Office perks include lunch, dinner, snacks, parking/transit stipends, and relocation support.
- **Benefits**: Competitive salary and equity, 401K matching, health/dental/vision insurance, flexible PTO, generous parental leave, life and disability protection.
- **Engineering Culture**: Deep focus on systems research and open-source; engineers work alongside leading AI researchers (e.g., Tri Dao, Ce Zhang). Talent sourced from Apple, Google, Amazon, NVIDIA, Stanford AI Lab.
- **Career Growth**: 53 active job postings (as of mid-2026); roles span ML engineering, platform engineering, research, and go-to-market. High growth trajectory offers rapid advancement.

## Sources
1. [together.ai/about-us](https://www.together.ai/about-us)
2. [together.ai/](https://www.together.ai/)
3. [together.ai/careers](https://www.together.ai/careers)
4. [linkedin.com/company/togethercomputer](https://www.linkedin.com/company/togethercomputer)
5. [cbinsights.com/company/together-4](https://www.cbinsights.com/company/together-4)

## Other roles at Together AI

- [Senior Software Engineer — Infra Agent Systems UK](https://feeny.ai/job/senior-software-engineer-infra-agent-systems-uk-together-ai-london-bxf797ge7pxk) — London, United Kingdom
- [Senior Software Engineer — Infra Agent Systems Remote India](https://feeny.ai/job/senior-software-engineer-infra-agent-systems-remote-india-together-ai-india-4y1jwwt42nqs) — India
- [HR Coordinator- Amsterdam](https://feeny.ai/job/hr-coordinator-amsterdam-together-ai-amsterdam-e41wg9k2gakq) — Amsterdam, Netherlands
- [Staff Software Engineer, Inference / Compute Infrastructure Engineering](https://feeny.ai/job/staff-software-engineer-inference-compute-infrastructure-engineering-together-5j8djmf3gdbk) — London, United Kingdom
- [Junior/Senior or Staff Software Engineer, Inference / Compute Infrastructure Engineering](https://feeny.ai/job/junior-senior-or-staff-software-engineer-inference-compute-infrastructure-r7v2vs22snvc) — India
- [Junior/Senior/Staff Software Engineer, Inference / Compute Infrastructure Engineering](https://feeny.ai/job/junior-senior-staff-software-engineer-inference-compute-infrastructure-8c2tjkm8p078) — Amsterdam, Netherlands
- [Manager, International Cloud Sourcing](https://feeny.ai/job/manager-international-cloud-sourcing-together-ai-san-francisco-csr7txam979a) — San Francisco, CA
- [Strategic Finance Senior Associate - Compute](https://feeny.ai/job/strategic-finance-senior-associate-compute-together-ai-san-francisco-wj1kj7w3vds8) — San Francisco, CA
- [Senior University Recruiting Program Manager](https://feeny.ai/job/senior-university-recruiting-program-manager-together-ai-san-francisco-9mybqeaaqng0) — San Francisco, CA
- [Director of Technical Accounting](https://feeny.ai/job/director-of-technical-accounting-together-ai-san-francisco-grrpxv1xy2bj) — San Francisco, CA