--- title: 'Senior Manager, Engineering - AI Validation at Sonatus' canonical: 'https://feeny.ai/job/senior-manager-engineering-ai-validation-sonatus-sunnyvale-16f78f7ay03m' type: 'job' last_seen: '2026-10-16' --- # Senior Manager, Engineering - AI Validation at Sonatus - **Company:** Sonatus - **Location:** Sunnyvale, CA - **Compensation:** $240k–$290k - **Posted:** 2026-07-17 - **Last confirmed live:** 2026-10-16 - **Apply:** https://job-boards.greenhouse.io/sonatus/jobs/5189819007 ## Job description At Sonatus, we’re driving the transformation to AI-enabled software-defined vehicles. Traditional automotive software methods can’t keep pace with consumer expectations shaped by the mobile industry—where features evolve rapidly, update seamlessly, and improve continuously. That’s why leading OEMs trust Sonatus to accelerate this shift. Our technology is already in production across more than 9 million vehicles on the road today and rapidly expanding. Headquartered in Sunnyvale, CA, with 250+ employees worldwide, Sonatus combines the agility of a fast-growing company with the scale and impact of an established partner. Backed by strong funding and proven by global deployment, we’re solving some of the most interesting and complex challenges in the industry. Join us and help redefine what’s possible as we shape the future of mobility. The Opportunity: Sonatus is looking for an experienced Senior Engineering Manager to build and lead our AI Validation function — the team responsible for how we test, evaluate, and govern the AI models and agentic capabilities embedded in our software-defined vehicle and cloud platforms, as well as our cloud-only AI and LLM-based products. You will deeply understand how AI is developed and deployed across Sonatus’s embedded, cloud, and LLM/RAG-driven environments, identify gaps and friction in current validation practices, and turn those insights into scalable test strategy, evaluation frameworks, and governance mechanisms that let Sonatus ship trustworthy AI-driven features at automotive scale. You will lead and grow a high-performing AI validation team and partner closely with engineering, product, and safety stakeholders to make AI quality and safety a competitive advantage. Role and Responsibility: - Define and drive Sonatus's AI validation strategy across embedded, in-vehicle, cloud-connected, and cloud-native AI systems, identifying gaps in model development, testing, deployment, and governance. - Lead, hire, mentor, and grow a high-performing AI Validation organization, establishing scalable engineering processes, technical direction, and execution excellence. - Own the end-to-end validation strategy for AI/ML models, LLMs, RAG pipelines, and agentic AI workflows—from data pipelines and model training through cloud services and in-vehicle deployment. - Architect and operationalize scalable evaluation frameworks and benchmarking platforms for AI systems, including multi-step agentic workflows, using deterministic metrics, LLM-as-a-Judge methodologies, automated regression testing, and production feedback loops. - Design and maintain evaluation harnesses for RAG and agentic systems that measure retrieval quality, grounding, citation accuracy, factual consistency, context relevance, safety, latency, reliability, and execution correctness. - Evaluate, integrate, and optimize open-source and commercial AI validation technologies, driving build-versus-buy decisions for Sonatus's AI quality platform. - Establish AI governance, Responsible AI practices, model lineage, safety guardrails, and compliance processes appropriate for automotive safety-critical systems and enterprise AI products. - Act as the quality gatekeeper for AI-enabled releases, partnering with engineering, product, safety, and OEM stakeholders to identify risks, define release criteria, and ensure production readiness. - Collaborate across engineering teams to define validation strategies for emerging AI capabilities, rapidly prototype new evaluation approaches, and standardize successful practices into reusable frameworks. - Drive continuous improvement by tracking industry advances in AI evaluation, agentic AI, LLM validation, and RAG systems, translating them into scalable validation capabilities across Sonatus. Qualifications: - Bachelor's degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field required (MS preferred). - 10+ years of experience in software or systems engineering—including embedded, cloud, networking, security, or automotive domains—with 3+ years leading high-performing engineering or QA organizations. - Hands-on experience developing, deploying, testing, or operating AI/ML systems, with strong expertise in modern ML workflows, neural networks, and MLOps. - Deep understanding of LLMs, RAG architectures, vector databases, embeddings, retrieval optimization, and agentic AI frameworks such as LangGraph or equivalent orchestration platforms. - Proven experience designing and implementing scalable evaluation frameworks for AI systems, including multi-step agentic workflows, regression testing, benchmarking, and automated quality scoring. - Strong expertise with hybrid evaluation methodologies combining deterministic validation (citation grounding, structural validation, exact matching) and probabilistic LLM-as-a-Judge techniques (faithfulness, answer relevance, context precision, task completion). - Practical experience with RAG evaluation frameworks such as RAGAS, including evaluation tuning, embedding optimization, retrieval quality improvement, and production-scale LLM evaluation pipelines. - Experience validating hallucination, grounding, citation accuracy, bias, fairness, toxicity, and factual consistency in production LLM applications. - Experience designing systems that verify external knowledge claims and ensure responses are grounded in traceable citations and trusted data sources. - Strong experience testing cloud-native platforms and cloud-managed embedded products, including end-to-end system validation. - Experience establishing AI governance, safety, compliance, and Responsible AI practices for enterprise or safety-critical systems. - Proficiency in Python, Linux, shell scripting, modern test frameworks (PyTest, Playwright, Behave), and engineering productivity tools such as Jenkins and JIRA. Ways to Stand Out: - Experience validating AI or agentic systems in safety-critical or regulated industries (automotive, aerospace, medical). - Track record building and scaling an AI test/evaluation platform or developer experience used by multiple teams (frameworks, reusable components, reference implementations). - Demonstrated wins moving AI testing practices from ad hoc to standardized, organization-wide adoption, with measurable impact on cycle time, quality, or reliability. - Experience implementing enterprise-grade AI governance (auditability, monitoring, policy enforcement) in production systems. - Deep experience evaluating LLM and RAG systems at scale, including agentic workflows, RAGAS-based evaluation, citation verification, hallucination detection, groundedness, faithfulness, answer relevance, tool/task correctness, and automated regression testing across offline and online feedback loops. Sunnyvale HQ Benefits & Perks Offered: - Health care plan (Medical, Dental & Vision) - Flexible and Dependent Care Expense program - Retirement plan (401k) - Life Insurance (Basic, Voluntary & AD&D) - Unlimited paid time off per year, 14+ paid holidays - Hybrid office work arrangement - Complimentary lunches, snacks, and beverages during on-site working days - Wellness benefit allowance - Phone & Internet reimbursement - Computer Accessory Allowance The posted salary range is a general guideline and represents a good faith estimate of what Sonatus ("Company") could reasonably expect to pay for a base salary for this position. The pay offered to a selected candidate will be determined based on factors such as (but not limited to) the scope and responsibilities of the position, the qualifications of the selected candidate, departmental budget availability, geographic location and external market pay for comparable jobs. The Company reserves the right to modify this range in the future, as needed, as market conditions change. Base Salary Pay Range $240,000—$290,000 USD ## About Sonatus ## Company Overview - **One-liner**: Sonatus delivers an AI-powered software platform for software-defined vehicles, enabling OEMs and suppliers to reduce costs, accelerate time-to-market, and continuously improve vehicles across their lifecycle. - **Entity Type**: Private (venture-backed) - **Headquarters**: Sunnyvale, California, USA - **Founded**: 2018 - **Founders**: Jeff Chou (CEO) and Yu Fang (CTO) ## Core Business - **Primary industry/industries**: Automotive software, artificial intelligence, software-defined vehicles (SDVs) - **Target customers**: Global automakers (OEMs) and Tier 1 suppliers (B2B, Enterprise) - **Mission or purpose statement**: To simplify and accelerate the digital transformation of the automobile by building AI-native software that spans the full vehicle lifecycle. ## Products & Services - **Sonatus Foundation**: A flexible vehicle software architecture that provides the foundational platform for building and evolving software-defined vehicles. - **Sonatus Collector AI**: Enables dynamic, intelligent data collection from vehicles to drive continuous improvements and insights. - **Sonatus AI Director**: An end-to-end toolchain for developing, deploying, and monitoring in-vehicle edge AI models. - **Sonatus AI Technician**: AI-powered diagnostic assistants that support pre-production testing through post-sales services. - **Sonatus Updater**: Secure, predictable management of vehicle software updates with end-to-end traceability. - **Sonatus Automator AI**: A no-code solution for accelerating time-to-market and enabling rapid innovation. *All products are software/SaaS or platform-based, delivered as a combination of in-vehicle software and cloud services.* ## Market Standing - **Valuation/Market Cap**: Not publicly disclosed (private company) - **Key Metric**: Technology deployed in **over 8 million vehicles** globally (as of 2025/2026) – [sonatus.com](https://www.sonatus.com/) - **Notable Investors/Partners**: Backed by investors in the automotive, semiconductor, and venture capital sectors (specific names not publicly named on the website); partners with leading global automakers and Tier 1 suppliers. - **Growth Signals**: Rapid expansion with offices in 12+ countries (USA, Canada, Ireland, France, Germany, Poland, India, China, Taiwan, South Korea, Japan, Philippines); ~300 employees (Built In); actively hiring across engineering, AI, and customer success roles. ## Competitive Advantages - **AI-native from the ground up**: Unlike legacy automotive software providers, Sonatus built its platform specifically for AI-defined vehicles, enabling deeper integration and better performance. - **Proven scale and trust**: Already deployed in millions of production vehicles from top global OEMs, demonstrating reliability and safety in real-world conditions. - **Full lifecycle coverage**: Spans pre-production testing, production, and post-sales services – a rare end-to-end offering. - **Agile integration**: Collaborates closely with OEMs and Tier 1s, using agile methods that complement traditional automotive development processes. ## Strategic Focus - **Expand AI capabilities**: Continuing to develop agentic AI, data analytics, and automation tools for the vehicle edge and cloud. - **New revenue streams**: Helping automakers unlock value-added services and business models based on vehicle data. - **Global scaling**: Deepening presence in key automotive markets (Europe, Asia, North America) while hiring top AI and engineering talent worldwide. ## Why Work Here - **Mission-driven challenges**: Employees work on cutting-edge AI and automotive problems that directly impact the future of mobility. - **Hybrid work model**: Offices in Sunnyvale, Dublin, Paris, Seoul, and more; hybrid policy typically requires 3 days in-office per week, with some roles fully remote. - **Collaborative culture**: Described as "talented and diverse" with specialists from automotive, data centers, semiconductors, and enterprise software. - **Growth opportunity**: Well-funded and rapidly growing company with a proven product in production, offering the stability of a mature startup with the excitement of scaling. - **Global presence**: Multiple office hubs and remote-friendly roles across North America, Europe, and Asia provide flexibility. ## Sources 1. [Sonatus Official Website – About](https://www.sonatus.com/company/) 2. [Sonatus Official Website – Products](https://www.sonatus.com/) 3. [Sonatus Careers Page (Greenhouse)](http://job-boards.greenhouse.io/sonatus) 4. [Sonatus Careers Page – Locations](https://www.sonatus.com/company/careers/) 5. [Built In Profile – Sonatus](https://builtin.com/company/sonatus) ## Other roles at Sonatus - [Senior Embedded AI Engineer](https://feeny.ai/job/senior-embedded-ai-engineer-sonatus-seoul-5h64tmwwe16q) — Seoul, South Korea - [Staff Cloud Backend Engineer](https://feeny.ai/job/staff-cloud-backend-engineer-sonatus-pune-p3100dj1krxy) — Pune, India - [Senior Technical Recruiter](https://feeny.ai/job/senior-technical-recruiter-sonatus-sunnyvale-36af432ac39a) — Sunnyvale, CA - [Senior Software Developer, Vehicle Applications Software](https://feeny.ai/job/senior-software-developer-vehicle-applications-software-sonatus-dublin-ka9a1rtm2jtx) — Dublin, Ireland - [Senior Staff Technical Program Manager](https://feeny.ai/job/senior-staff-technical-program-manager-sonatus-sunnyvale-3yq3k8p80rmq) — Sunnyvale, CA - [Senior Compliance Engineer](https://feeny.ai/job/senior-compliance-engineer-sonatus-seoul-fcnjsc3wy7rc) — Seoul, South Korea - [Staff Machine Learning Engineer](https://feeny.ai/job/staff-machine-learning-engineer-sonatus-dublin-x5darq0g8hs2) — Dublin, Ireland - [Senior Engineering Manager](https://feeny.ai/job/senior-engineering-manager-sonatus-dublin-hvhhwy3bfr9t) — Dublin, Ireland - [Software Engineer - Customer Integration](https://feeny.ai/job/software-engineer-customer-integration-sonatus-pangyo-south-ws996fsvxbrk) — Pangyo South, South Korea - [Staff Machine Learning Engineer](https://feeny.ai/job/staff-machine-learning-engineer-sonatus-sunnyvale-a4g10w0yca9j) — Sunnyvale, CA