--- title: 'Senior QA Engineer, Forward Deployed at Ellipsis Health' canonical: 'https://feeny.ai/job/senior-qa-engineer-forward-deployed-ellipsis-health-san-francisco-f38237rrjb4c' type: 'job' last_seen: '2026-10-19' --- # Senior QA Engineer, Forward Deployed at Ellipsis Health - **Company:** Ellipsis Health - **Location:** San Francisco, CA - **Employment:** full-time - **Work type:** hybrid - **Posted:** 2026-06-04 - **Last confirmed live:** 2026-10-19 - **Apply:** https://jobs.ashbyhq.com/ellipsis-health/cabc2cd8-881b-4081-9e33-0fc71ca841c3 ## Job description ## About the Team The Forward Deployed Team is our primary customer-facing unit, acting as the crucial bridge between our core product and our enterprise clients. This fast-moving team manages the end-to-end lifecycle of enterprise conversational AI deployments, from pre-sales Statements of Work (SOWs) through go-live. We maintain daily, high-touch interactions with customers to communicate workflow progress, manage User Acceptance Testing (UAT) deadlines, integrate client feedback, and ensure that deployments are executed rapidly while maintaining rigorous quality standards. Ellipsis Health is located in the San Francisco Bay Area, but we are open to remote candidates within the United States. ## About the Role As a Forward Deployed QA Engineer, you will occupy a critical, high-impact role dedicated to ensuring the reliability, stability, and quality of our core conversational AI product, Sage, across diverse client workflows. This role bridges the gap between Quality Assurance, AI Engineering, and Production Operations. You will focus heavily on automated testing, prompt engineering validation, and rapid root cause analysis (RCA) of Large Language Model (LLM)-driven behaviors in fast-paced, real-world deployments. Responsibilities: - Workflow Mapping & Test Case Generation: Deeply analyze assigned client workflows to design robust, comprehensive positive and negative test cases that safeguard system stability. - AI-Driven Test Automation: Build and execute automated test scenarios by configuring shadow agents. - Prompt Evaluation & Optimization: Apply a strong understanding of prompt awareness to draft, refine, and evaluate prompts used within the testing framework to accurately simulate user behaviors and edge cases. - End-to-End Testing Execution: Strategically deploy specific testing methodologies including Sanity, Smoke, Regression, and Functional testing - determining the exact environment (staging, pre-production, production) and timing for each execution. - Deployment Cadence & Cross-Functional Collaboration: Partner closely with engineering teams during release cycles to proactively identify, triage, and unblock technical roadblocks, ensuring the product is continuously deployment-ready. - Daily LLM Defect RCA: Perform rigorous, daily root cause analysis on LLM-specific failures inherent to generative AI, including hallucinations, high latency, and logic deviations. - Live Production Call Debugging: Investigate live customer calls and production incidents in real time to unblock critical production use cases. - Audio & Transcription Validation: Query and analyze historical call transcripts, system behaviors, and audio data pipelines to pinpoint where a conversational workflow broke down.Speech-to-Speech (S2S) Pipeline Monitoring: Monitor and evaluate the end-to-end voice AI pipeline. This involves analyzing Automatic Speech Recognition (ASR) accuracy, managing audio-to-text latency issues, and understanding general Speech-to-Speech mechanics alongside the stability of the core Knowledge Base feeding the AI. - Advanced Evaluation Frameworks: Maintain a strong conceptual understanding of advanced LLM evaluation paradigms and tools such as LLM-as-a-judge - to remain aware of how AI response quality and accuracy are programmatically graded at scale. - Telephony & Call Flow Awareness: Possess a foundational understanding of real-world call management and telephony routing concepts, including how the system is expected to navigate warm transfers, blind transfers, and voicemail detection workflows. Qualifications: - Experience in QA Engineering: Strong background in software quality assurance, with a proven track record of designing, executing, and managing end-to-end test strategies (Smoke, Sanity, Regression, Functional). - LLM & Generative AI Expertise: Hands-on experience or deep technical familiarity with troubleshooting LLM behaviors, diagnosing hallucinations, managing latency, and using LLM call-tracing tools. - Technical & Logging Proficiency: Ability to comfortably write SQL queries (specifically PostgreSQL) to pull data logs and navigate cloud infrastructure logs (such as GCP) to perform rapid root-cause analysis. - Voice & Conversational AI Domain Knowledge: Foundational understanding of Speech-to-Speech pipelines, including Automatic Speech Recognition (ASR), audio-to-text workflows, and core knowledge base integrations. - Telephony Foundations: Basic familiarity with enterprise telephony routing, call management mechanics (warm/blind transfers), and voicemail detection systems. - Client-Facing Capability: Strong communication skills and the professional agility required to manage UAT timelines, coordinate with client stakeholders, and support rapid production deployments. Salary and Benefits We offer competitive salary and benefits, including 401(k) matching, health, vision, and dental insurance, and very flexible paid time off. The typical salary range for this role is $120,000 to $140,000 USD, depending on skills, qualifications, and relevant experience. Background Checks As a health technology company, we reserve the right to run background checks on candidates to whom we extend offers, in compliance with applicable laws. We evaluate candidates holistically and comply with all “ban the box” regulations. Assistance If you have a disability or require accommodations during the application or recruitment process, please contact careers@ellipsishealth.com. ## About Ellipsis Health ## Company Overview - **One-liner**: Ellipsis Health provides an emotionally intelligent AI care manager, Sage, that automates patient engagement, clinical assessments, and care coordination for health plans, health systems, specialty care, and pharmaceutical companies. - **Entity Type**: Private (Series A-II; total funding $75.39M) - **Headquarters**: San Francisco, California, United States - **Founded**: 2017 - **Founders**: Not publicly available ## Core Business - Primary industry: Healthcare AI / Healthcare IT - Target customers: B2B – health plans, health systems, specialty care providers, and pharmaceutical companies - Mission/purpose: To deliver empathetic, autonomous virtual care management that reduces administrative burden, improves patient outcomes, and enables care teams to work at the top of their licenses. ## Products & Services - **[Sage – AI Care Manager](https://ellipsishealth.com/product/)**: An agentic AI platform that conducts fully autonomous, natural-language calls with patients. Use cases include program enrollment & engagement, clinical assessments (HRAs, HOS, HCAHPS), care coordination, medication adherence, discharge check-ins, and preventive care outreach. Sage is multilingual, HIPAA and SOC2 Type 2 compliant, and designed with clinical oversight. ## Market Standing - **Valuation**: Not disclosed - **Key Metric**: Annual revenue ~$8.1M (LinkedIn estimate) – not independently verified; total disclosed funding $75.39M (CB Insights) / $79.1M (LinkedIn) - **Notable Investors/Partners**: Khosla Ventures (lead Series A), Salesforce, Mitsui & Co. Global Investment, AME Cloud Ventures, Colliers, and 30+ other investors. Strategic partnerships with Salesforce (Sage integrated into Salesforce Health Cloud) and NVIDIA (to enhance NLP capabilities). - **Growth Signals**: Headcount grew 60% YoY to 60 employees; LinkedIn followers +80% YoY. Raised $45M Series A-II in July 2025. Filed 14 patents around psychiatric diagnosis, computational linguistics, and mood disorders. ## Competitive Advantages - **Emotionally intelligent, conversational AI** that adapts to patient tone and responses, driving higher engagement than rigid IVR systems. - **Healthcare-native security and compliance**: HIPAA, SOC2 Type 2, end-to-end encryption, and continuous third-party audits. - **Clinical oversight** built into AI operations, preserving trust and safety. - **Proprietary acoustic and NLP models** for voice-based screening and monitoring of behavioral health conditions. - **Pre-built integrations** with EHRs and Salesforce Health Cloud, reducing deployment friction. ## Strategic Focus - Deepen integration with major health IT ecosystems (Salesforce, EHRs). - Expand use cases into medication adherence and preventive care. - Scale the platform through partnerships (Clearstep, NVIDIA) to reach more health plans and systems. - Continue patenting voice-AI innovations for broader clinical applications. ## Why Work Here - Opportunity to build cutting-edge AI in a regulated, high-impact industry (healthcare). - Cross-functional team with backgrounds from top tech and healthcare companies. - Remote-friendly culture with employees across the US, Canada, India, and Brazil. - Current open roles (via [Ashby](https://jobs.ashbyhq.com/ellipsis-health)): Frontend Engineer, Backend Engineer, Senior Full-Stack Engineer, Technical Recruiter – Healthcare AI. - Engineering-led environment with strong emphasis on AI safety, ethical AI, and clinical rigor. ## Sources 1. [ellipsishealth.com](https://ellipsishealth.com/) 2. [cbinsights.com](https://www.cbinsights.com/company/ellipsis-health) 3. [linkedin.com](https://www.linkedin.com/company/ellipsis-health) 4. [ellipsishealth.com/product](https://ellipsishealth.com/product/) 5. [ellipsishealth.com/careers](https://ellipsishealth.com/careers/) ## Other roles at Ellipsis Health - [Senior Director of Marketing](https://feeny.ai/job/senior-director-of-marketing-ellipsis-health-san-francisco-b8pb15drdwry) — San Francisco, CA - [Senior Backend Engineer, Core Services](https://feeny.ai/job/senior-backend-engineer-core-services-ellipsis-health-san-francisco-s29qrpgwbm29) — San Francisco, CA - [Senior Data Scientist](https://feeny.ai/job/senior-data-scientist-ellipsis-health-san-francisco-nvrrg0sesgcw) — San Francisco, CA - [Product Manager, Analytics & Reporting](https://feeny.ai/job/product-manager-analytics-reporting-ellipsis-health-san-francisco-v6m6tvdz8wvw) — San Francisco, CA - [Senior DevSecOps Engineer](https://feeny.ai/job/senior-devsecops-engineer-ellipsis-health-san-francisco-qe9mckc2zw75) — San Francisco, CA - [Director of Customer Success](https://feeny.ai/job/director-of-customer-success-ellipsis-health-san-francisco-zrfs215v1wfk) — San Francisco, CA - [Senior Software Development Engineer in Test (SDET) - Applications](https://feeny.ai/job/senior-software-development-engineer-in-test-sdet-applications-ellipsis-health-zseas0xqfshp) — San Francisco, CA - [VP Provider Sales](https://feeny.ai/job/vp-provider-sales-ellipsis-health-san-francisco-vf5z5zaxjgnz) — San Francisco, CA - [VP Payer Sales](https://feeny.ai/job/vp-payer-sales-ellipsis-health-san-francisco-azsrb3xdz1ac) — San Francisco, CA - [Senior ML Engineer, Agentic AI](https://feeny.ai/job/senior-ml-engineer-agentic-ai-ellipsis-health-san-francisco-h4qx93460sb2) — San Francisco, CA