---
title: 'QA Developer, AI Assistant at Poka EN'
canonical: 'https://feeny.ai/job/qa-developer-ai-assistant-poka-en-quebec-city-v1rzgav7v0pk'
type: 'job'
last_seen: '2026-10-17'
---

# QA Developer, AI Assistant at Poka EN

- **Company:** Poka EN
- **Location:** Quebec City, Canada / Montreal, Canada
- **Posted:** 2026-10-16
- **Last confirmed live:** 2026-10-17
- **Apply:** https://job-boards.greenhouse.io/poka/jobs/6223568004

## Job description

At Poka, we're changing how the world's industrial teams work — capturing the knowledge of their best people and putting it in every operator's hands.

Our connected worker platform is purpose-built for manufacturing and the wider industrial world, with industrial AI inside the shift, not on top of it. The result: frontline performance that becomes compounding knowledge and measurable impact — every shift, every site, every region.

We're proud to support global leaders like Nestlé, Bosch, Mars, and Danone across 3,000+ sites in 70+ countries. And as a fast-growing part of the IFS family, you'll join a team whose daily work directly shapes the platform behind how modern manufacturing gets done.

## Role overview

Our team develops the AI assistant built into Poka. Workers and supervisors use it every day on manufacturing floors. We build it with prompts, tools, information retrieval and agents.

As a quality assurance (QA) specialist on this team, you make sure what we ship works: the assistant's answers and the features around it. You do it with automation, AI and tools you build, not with manual testing. You work with the devs, the product team and the design team to define what "good" means, then you build the evals, automated tests and tools that check it.

How this is different from traditional QA

- No manual test passes. If something needs to be checked more than once, you automate it, with code, AI or whatever tool fits.
- A large part of what you test has no single answer. The same question can get 50 good answers phrased differently, and the assistant can answer differently from one run to the next. You help define what "good" means and measure it.
- You write Python every week.

If you're looking for a role focused on test plans and manual regression testing, this isn't it.

## What you'll be responsible for

- Automating QA for the team's features and building the tools that make it easier, including ways for non-developers to add evals and analyze the results.
- Building and maintaining eval suites based on real usage: actual user questions, expected behavior and the edge cases that show up in production.
- Defining with the team what a good answer looks like for our users, writing scoring rubrics and using LLM-as-judge where it makes sense, calibrated against human-labeled samples.
- Running regression checks in CI every time we change a prompt, a tool, retrieval or the Claude model version, covering answer quality, cost and speed. You build the guardrails, evals and tests that tell us whether a release gets the green light or not.
- Reviewing real conversations and grouping failures into patterns: made-up answers, wrong tool calls, missed context, inappropriate tone. Then working with developers to turn them into fixes.
- Contributing to adversarial testing: prompt injection, data leaking between customers, getting the assistant to do things it shouldn't.
- Doing timeboxed exploratory testing on features that change what the assistant can decide or do, like new agents, tools or actions, including checking that actions stay safe when something fails or gets retried.
- Joining feature kickoffs to help define acceptance criteria, including AI-specific ones.

## What you bring

- AEC, DEC or BAC in a field related to the position, or equivalent experience
- 2 to 4 years of relevant experience
- A background in test automation or as an SDET
- You're comfortable with several programming languages, including Python and TypeScript
- Real curiosity about how LLMs behave and why they fail
- You're comfortable judging quality when there's no single answer, and explaining your reasoning
- Curiosity about our users' world. You can't judge an answer without understanding what a supervisor on a manufacturing floor actually needs.

Assets

- You've helped set up an eval harness, even in a personal project
- Experience using AI tools to speed up testing
- Basic statistics: pass rates, variance, sample size
- Experience in security or adversarial testing
- Knowledge of the test pyramid and the shift-left approach
- B2B experience or experience on industrial platforms
- Knowledge of Jira

The technologies you'll use

- Python
- TypeScript
- Claude Code
- Eval framework (promptfoo)
- AWS
- Docker
- And many others

We strongly believe that a passion for new technologies, a positive attitude and real team spirit are key to succeeding at Poka.

Above all, we're looking for someone curious and resourceful. You care about the success of the product and your team. You like complex problems, especially the ones without an obvious solution. You want to write clean, high-quality code and keep learning.

If that sounds like you, you're probably the person we're looking for!

What we offer:

- Scale-up energy with huge backing and a global yet close-knit team.
- Generous vacation policy, additional paid days, and charity day.
- Hybrid work policy - Employees who live within a 40 km radius of our Québec City office or a 15 km radius of our Montréal office are required to work in-office two days per week.
- 100% remote work if you do not live within the radiuses mentioned above.
- A truly flexible schedule that allows you to adapt your work hours.
- Group insurance from day one (dental, medication, disability, travel, etc.) with employer contributions, including access to telemedicine and an Employee Assistance Program (EAP).
- A retirement savings plan with employer contributions.
- A MacBook Pro and a $500 home office allowance upon hiring.
- A generous annual learning and development budget to support your growth, plus the tools and opportunities you need to keep progressing in your career.
- A rewarding employee referral program for successful hires.
- Tasty snacks available at all times in our offices (fresh fruits, snacks, pastries, coffee, tea, etc.)

*Certain benefits are exclusively accessible to employees in Canada.

Want to learn more about our culture? Click [HERE](https://2394300.fs1.hubspotusercontent-na1.net/hubfs/2394300/HR%20files/CultureBook-En-screen.pdf).

Please note: An understanding of English is essential at Poka, as it is the language used during company-wide meetings and many internal communications, ensuring effective collaboration and decision-making. In addition, as Poka operates in an international environment, English is the primary language for communicating with our clients and partners, enabling us to better serve them and represent Poka in a professional manner.

## About Poka EN

## Company Overview
- **One-liner**: Poka provides a connected worker platform for manufacturers, using Industrial AI to empower frontline factory workers with knowledge, digital tools, and expert support to drive productivity, quality, and continuous improvement.
- **Entity Type**: Private (Acquired by IFS in 2023; previously funded with $42.4M total funding)
- **Headquarters**: Quebec, Canada
- **Founded**: 2014
- **Founders**: Not publicly listed (co-founders are referenced in hiring process materials)

## Core Business
- Primary industry/industries: Manufacturing technology, Industrial software, Connected worker platforms
- Target customers: Enterprise manufacturing organizations (B2B), specifically factory workers, plant managers, and operational excellence teams at large global manufacturers
- Mission or purpose statement: To empower workers to learn, solve problems, and share knowledge in real-time on the factory floor, and to bridge the skills gap, reduce downtime, and drive safety, performance, and quality to new heights.

## Products & Services
- **Connected Worker Platform**: An integrated platform uniting people, processes, and AI-driven operational insights. Features include digital work instructions, skills management, daily management (forms, checklists, issues management), learning & development, communication tools, and analytics.
- **Poka Industrial AI**: AI-augmented capabilities embedded in the platform to strengthen frontline capability, standardize execution, and drive sustained high-performance across every site.
- **Enterprise Solutions**: Best-in-class features in a single integrated platform designed for global scale, governance, and support, with deep domain knowledge in manufacturing and digital transformation.

## Market Standing
- **Valuation/Market Cap**: Not disclosed (acquired by IFS in 2023)
- **Key Metric**: Annual Revenue of $8.0M (estimated) | Total Funding of $42.4M prior to acquisition
- **Notable Investors/Partners**: Parent company is IFS AB (enterprise software leader in EAM, FSM, and ERP). Over 2,300+ global rollout success stories, including Bosch Automotive (reported 8% direct productivity gain).
- **Growth Signals**: Headcount of 161 employees (+18.3% YoY, +32 people). Active job postings up +330% yearly. Massive LinkedIn follower growth (+49.5% yearly). Operates in 10 countries including US, Germany, UK, Sri Lanka, and France.

## Competitive Advantages
- **Manufacturing DNA**: Deep domain knowledge in manufacturing and digital transformation, with proven experience deploying connected worker solutions at scale in enterprise environments.
- **Industrial AI Integration**: Combines AI with operational knowledge to amplify human performance at the point of work, not replace workers.
- **Enterprise-Ready Platform**: Best-in-class features in a single integrated platform, built for global scale, governance, and support.
- **Backing of IFS**: Post-acquisition, Poka benefits from the resources, customer base, and credibility of a major enterprise software leader while maintaining its own brand and culture.

## Strategic Focus
- Current priorities include expanding Industrial AI capabilities, supporting global rollouts for enterprise manufacturing clients, and strengthening frontline capability through connected worker solutions. Growth is focused on sales (Enterprise and Commercial Account Executives), engineering (Backend, Frontend, Mobile), and customer success.

## Why Work Here
- **Culture**: Values-driven culture with emphasis on simplicity, happiness, unity, passion, and quality. Described as "no micromanaging" with "clear goals, shared accountability, and the space to thrive." Culture book is public and considered a "manifesto."
- **Remote/Hybrid**: Flexible hybrid work mode; embrace of "flex time" (no punch clock). Teams distributed across North America, Europe, and Sri Lanka. For office-close employees: snacks, retro games, monthly lunches & activities.
- **Perks**: Generous vacation policy, retirement contributions (matching varies by country), group insurance (dental, medical, disability, life, travel), virtual health care (Dialogue program in Canada), 4 personal days per year.
- **Engineering Culture**: Emphasis on "always adapting, always learning" and embracing new tech including AI. Interview process transparent about AI usage (candidates may use AI to prepare, interviewers may use AI for note-taking but hiring decisions are always human).
- **DEI**: Active commitment to diversity, equity, and inclusion with a global team spanning multiple cultures. Focus on different perspectives and accessible opportunities for growth and leadership.

## Sources
1. [poka.io Careers](https://www.poka.io/en/careers)
2. [Greenhouse Job Board](http://job-boards.greenhouse.io/poka)
3. [poka.io Main Site](https://www.poka.io/en)
4. [poka.io About](https://www.poka.io/en/about-poka)
5. [LinkedIn Company Page](https://ca.linkedin.com/company/poka-inc-)

## Other roles at Poka EN

- [Customer Success Manager](https://feeny.ai/job/customer-success-manager-poka-en-atlanta-0mse132bcmx1) — Atlanta, GA
- [Account Executive, Commercial](https://feeny.ai/job/account-executive-commercial-poka-en-united-states-yqe9sx4102yd) — United States
- [Web SEO & AEO Strategist](https://feeny.ai/job/web-seo-aeo-strategist-poka-en-canada-jezqynefm7ne) — Canada
- [Sales Development Representative](https://feeny.ai/job/sales-development-representative-poka-en-montreal-da50catw4yfn) — Montreal, Canada / Toronto, Canada