--- title: 'Senior AI Quality Engineer at Novara' canonical: 'https://feeny.ai/job/senior-ai-quality-engineer-novara-ontario-86469j6e2xw2' type: 'job' last_seen: '2026-10-13' --- # Senior AI Quality Engineer at Novara - **Company:** Novara - **Location:** Ontario, Canada - **Employment:** full-time - **Work type:** remote - **Posted:** 2026-09-28 - **Last confirmed live:** 2026-10-13 - **Apply:** https://jobs.lever.co/novara/257b459a-be69-4e8a-9296-2117dc6a8516 ## Job description Novara provides safety, operational risk management, and sustainability software that empowers organizations to identify and resolve issues before they become incidents. Through the Flex and Risk Management Center platforms, Novara helps organizations manage operational risk proactively with a system they can configure to fit their operations, data that unifies risk and safety intelligence, and tools that increase workforce participation. Novara’s combination of software, training, and AI-powered tools put people and safety first while protecting critical operations. Position Description: AI is core to where our product is heading, and the quality bar for it has to be as high as anything else we ship. This role owns that bar. You will define what "working" means for non-deterministic systems, build the tooling to prove it, and give our teams the confidence to move faster on AI-powered features and agent-based products. You will partner closely with product, engineering, and the broader QA team to bring rigor to how we test LLM-driven and agentic workflows, while also contributing to traditional automation coverage where it matters. This is a hands-on IC role reporting into the QA Manager, with high visibility into AI initiatives across the company. Responsibilities: - Design and maintain evaluation frameworks for LLM outputs and agentic workflows, including regression suites, golden datasets, and scoring rubrics - Build test harnesses that catch hallucinations, tool-calling failures, prompt regressions, and unsafe or off-policy behavior before they reach production - Define measurable quality criteria for agent reliability: task completion, factual grounding, latency, cost, and reasoning quality - Integrate evaluation runs into CI/CD so model, prompt, and agent changes are gated the same way code changes are - Partner with engineers on observability and tracing for agent runs, so failures are diagnosable rather than mysterious - Contribute to conventional API and end-to-end automation where AI features sit inside larger product flows - Help shape the team's shared playbook for testing AI features, and coach other QA engineers as agentic work spreads across scrum teams Knowledge, Experience, Requirements: - 6+ years in QA, SDET, or test automation, with real production automation shipping - Hands-on experience testing LLM-based or agentic systems: building evals, working with LLM-as-judge patterns, prompt regression testing, or agent trajectory analysis - Prior experience in a shift-left, embedded QA model - Comfort with at least one modern automation stack (Playwright, Cypress, or similar) and a typed language, TypeScript preferred, Python fine - Deep experience with test frameworks such as vitest, jest, or pytest, and comfort building custom test harnesses rather than only running off-the-shelf suites - API-first testing mindset, including REST and Postman or equivalent - Fluency in HTTP-level API testing, including recording proxies and observing service-to-service traffic - Working knowledge of CI/CD pipelines, GitHub Actions a plus, and how to plug evals into them - Familiarity with cloud secret managers and disciplined handling of sensitive test data in restore-from-prod environments - Ability to reason clearly about probabilistic systems: variance, sample sizes, confidence, and when a flaky result is signal rather than noise Preferred Qualifications: Not required, but they will stand out: - Experience with eval tooling such as Langfuse, Braintrust, LangSmith, Ragas, or DeepEval - Familiarity with RAG systems, vector stores, or tool-calling frameworks - Background in test data strategy for AI, including synthetic data generation - Exposure to Datadog or a similar observability platform Tech Stack: TypeScript, Playwright, vitest, Postman, GitHub Actions, Jira/Xray, Datadog, AWS, plus emerging AI evaluation tooling. Compensation: Annual Base Salary Range of 100k-130k CAD Annual Bonus Opportunity of 10% As a growing company, Novara values its employees by supporting them with a full benefits package including Medical, Dental, Vision, Flexible Spending Accounts, PTO, Paid and Floating Holidays, 401k with Company match and immediate vesting, Company-funded Life Insurance, Employee Assistance Programs, and No-cost Mental Health Benefits. ## About Novara Novara provides safety and operational risk management software that empowers organizations to identify and resolve issues before they become incidents. Through the Flex and Risk Management Center platforms, Novara helps organizations address operational risk proactively by unifying data, increasing workforce engagement, and proactively managing risk. Novara’s combination of training, software, and tools puts people and safety first while protecting critical operations. Novara, a Providence Equity portfolio company, provides safety and operational risk management software that empowers organizations to identify and resolve issues before they become incidents. Through the Flex and Risk Management Center platforms, Novara helps organizations address operational risk proactively by unifying data, increasing workforce engagement, and proactively managing risk. Novara’s combination of training, software, and tools puts people and safety first while protecting critical operations. Novara launched January 1 2026, as an independent company, a spin-off of the Flex and RMC software businesses formerly part of KPA. Don’t meet every job requirement? At Novara, we are dedicated to building a diverse, inclusive, and authentic workplace. Studies have shown that women and people of color are less likely to apply unless they meet every requirement. If you’re excited about the role but your past experience doesn’t align perfectly with every qualification, we still encourage you to apply! You might just be the right candidate for this or other roles. Please note that we may use AI tools to assist in the initial screening of resumes to help identify qualified candidates more efficiently. All decisions are reviewed by a human recruiter, and no hiring determination is made solely by automated means. Novara is committed to providing equal opportunity in all of our employment practices, including selection, hiring, promotion, transfer, and compensation, to all qualified applicants and employees without regard to race, religion, religious dress/grooming, color, ethnicity, sex (including sex stereotyping), sexual orientation, gender identity or gender expression, national origin, ancestry, citizenship status, creed, uniform service member status, military or veteran status, marital status, pregnancy, breast-feeding and/or pregnancy-related conditions, age, protected medical condition, leave status, physical or mental disability, genetic characteristics, or any other legally-protected status in accordance with the requirements of all federal, state and local laws. In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification document form upon hire. If you need assistance or an accommodation due to a disability, you may contact us at hr@novara.com. Please see our Candidate Privacy Notice Included Here ## About Novara ## Company Overview - **One-liner**: Novara provides configurable EHS software, award-winning training, and risk management services to help companies keep their workforce safe. - **Entity Type**: Private (Privately Held) - **Headquarters**: United States (specific city not publicly disclosed) - **Founded**: Not publicly available - **Founders**: Not publicly available ## Core Business - **Primary industry**: Environmental, Health, and Safety (EHS) software and services; operational risk management. - **Target customers**: B2B, enterprise, and organizations in high‑risk industries (manufacturing, construction, energy, chemicals, etc.). - **Mission**: “To help companies keep their workforce safe” – success is measured by clients sending employees home without workplace incidents or injuries. ## Products & Services - **Flex EHS Software**: A configurable platform for incident management, asset management, SDS management, contractor management, and real‑time dashboards – all in a single source of truth. Mobile‑first, offline‑capable, and available in 100+ languages. - **Online Training**: Award‑winning library of over 1,500 courses tailored to industry and learning needs, powered by an integrated Learning Management System. - **Mobile App**: Designed for easy reporting and training in the field, providing real‑time access to key components of a safety program. - **Consulting & Services**: Deep industry expertise to help organizations identify and mitigate operational risks. ## Market Standing - **Valuation/Market Cap**: Not disclosed - **Key Metrics**: Over 1,900 leading organizations served; more than 695,000 workers protected. - **Notable Investors/Partners**: Not publicly available - **Growth Signals**: Headcount of approximately 130 employees (LinkedIn); actively hiring for roles including Senior Applied AI Engineer, Sustainability Solutions Engineer, and Customer Success Manager – indicating expansion into AI and sustainability. ## Competitive Advantages - **Configurability**: The Flex platform adapts to how teams actually work without code changes or professional service fees – “your program, built your way.” - **Field‑First Design**: Mobile‑first, offline‑capable, and multilingual (100+ languages) ensures high adoption among field workers. - **Integrated Ecosystem**: Combines safety data, training records, contractor compliance, and sustainability reporting in one system, eliminating silos. - **Proactive Risk Management**: Focus on identifying and resolving issues before they become incidents, with real‑time data and control‑of‑work compliance. ## Strategic Focus - **AI & Automation**: Hiring a Senior Applied AI Engineer signals investment in AI‑driven risk insights and automation. - **Sustainability Expansion**: Adding a Sustainability Solutions Engineer to support environmental compliance and reporting. - **Continued Product Development**: Emphasis on configurable dashboards, customizable forms, and real‑time data to improve EHS program efficiency. ## Why Work Here - **Learning & Development**: Tuition reimbursement, funding for certifications, and opportunities to build skills. - **Work/Life Balance**: PTO, paid holidays, paid parental leave, and 401k with company match. - **Community Engagement**: Paid volunteer days and internally‑organized events. - **Hybrid/Remote Workplace**: Most positions are primarily remote with occasional in‑office meetings; office is open for those who prefer in‑person work. - **Inclusive Culture**: Commitment to inclusion and belonging, acknowledging both physical and psychological safety. - **Meaningful Mission**: Work that directly contributes to worker safety and incident prevention. ## Sources 1. [novara.com/careers](https://novara.com/careers/) 2. [novara.com](https://novara.com/) 3. [jobs.lever.co/novara](https://jobs.lever.co/novara) 4. [linkedin.com/company/novara-software](https://linkedin.com/company/novara-software) 5. [novara.com/our-story](https://novara.com/our-story/) ## Other roles at Novara - [Senior Corporate Counsel](https://feeny.ai/job/senior-corporate-counsel-novara-remote-wnc9k38w5x1q) - [Account Executive](https://feeny.ai/job/account-executive-novara-ontario-kjh26gn9j4fy) — Ontario, Canada - [IT Support Specialist](https://feeny.ai/job/it-support-specialist-novara-westminster-8mbcf60mb88v) — Westminster, CO - [Sales Manager](https://feeny.ai/job/sales-manager-novara-remote-mejq02rasqqt)