--- title: 'Proctor Quality and Learning Manager, Scaling Operations at Duolingo' canonical: 'https://feeny.ai/job/proctor-quality-and-learning-manager-scaling-operations-duolingo-new-york-4vwd0jc06qcb' type: 'job' last_seen: '2026-10-13' --- # Proctor Quality and Learning Manager, Scaling Operations at Duolingo - **Company:** Duolingo - **Location:** New York, NY / Pittsburgh, PA - **Compensation:** $143k–$193k - **Posted:** 2026-09-30 - **Last confirmed live:** 2026-10-13 - **Apply:** https://careers.duolingo.com/jobs/8858331002?gh_jid=8858331002 ## Job description Our mission at Duolingo is to develop the best education in the world and make it universally available. It’s a big mission, and that’s where you come in! At Duolingo, you’ll join a team that cares about educating our users, experimenting with big ideas, making fact-based decisions, and finding innovative solutions to complex problems. You’ll have limitless learning opportunities and daily collaborations with world-class minds — while doing work that’s both meaningful and fun. Join our life-changing mission to develop education for our half a billion (and growing!) learners around the world. Read [our blog](https://blog.duolingo.com/?utm_source=greenhouse.com&utm_medium=referral&utm_campaign=generalblog_gh_091224) to learn more. About the role... The Duolingo English Test (DET) is a high-stakes assessment used by institutions around the world. Its integrity depends on proctors making accurate, consistent, and defensible decisions — even when sessions present ambiguous evidence or new forms of cheating. As the Proctor Quality and Learning Manager (L3) in Scaling Operations, you will own the end-to-end quality standard and learning system that keep our global proctor network aligned and effective as security threats, technology, and workflows evolve. You’ll define what “correct” looks like, run our calibration and adjudication program, and build ongoing training that measurably improves decision quality. You will partner with Psychometrics, Security, Operations, Product, and Engineering to ensure our human and AI-assisted workflows meet rigorous accuracy standards before and after deployment. This is an individual-contributor role within DET Proctoring Operations, with functional leadership over Training Specialists and adjudicators executing the program. 🧠  You will... - Own the DET proctoring quality standard — maintain rubrics, decision rules, examples, and guidance that define accurate decisions across routine and difficult edge cases. - Lead calibration and adjudication — operate recurring Proctor Certification Test cycles, resolve disputed decisions, identify patterns of disagreement, and ensure outcomes are consistent and auditable. - Build and run an ongoing learning program — publish a forward-looking training calendar, deliver monthly interventions, and launch targeted training in response to quality signals, threats, or workflow changes. - Measure effectiveness — use calibration results, audits, and performance trends to identify learning needs, evaluate training impact, and decide when to clarify standards, retrain, or update guidance. - Guide specialist execution — set expectations for Training Specialists and adjudicators, assign deliverables, review outputs, and operate onboarding and certification that ramp new specialists quickly. - Maintain durable sources of truth — keep calibration, adjudication, and training runbooks current so critical processes are documented and auditable. - Evolve quality alongside proctoring — translate new threats and workflow changes into clear standards, training, and quality controls in partnership with Psychometrics, Security, Operations, Product, and Engineering. - Represent the proctoring craft — bring frontline proctor evidence into product experiments and workflow decisions; assess whether launched changes preserve decision quality. - Connect human and technology-assisted quality — establish benchmarks for AI-assisted workflows and validate automated capabilities against real sessions before deployment. ✅  You have... - 5+ years in assessment development, scoring/rater quality, certification, quality assurance, or a field involving complex, consequential judgments; experience aligning reviewers to a shared standard through calibration programs. - Adult-learning program experience spanning onboarding, certification, ongoing training, remediation, and effectiveness measurement (beyond one-off materials). - Exceptional attention to detail and strong judgment in ambiguous cases; ability to produce clear, defensible decisions and guidance. - Analytical fluency to interpret quality data, disagreement patterns, and performance trends and translate them into practical interventions. - Clear written and verbal communication; ability to turn complex standards into precise, usable guidance and explain difficult calls. - Cross-functional leadership without formal authority; experience directing contractors or partners toward clear accountability and outcomes. - Demonstrated skill in quality standards and rubric design, building living systems with decision logs, change histories, and controls for auditability. - Experience defining quality benchmarks and validation methods for human–technology workflows, including AI-assisted processes. - Adaptability — comfort revising standards and programs as risks, products, and technology change. ⭐  Exceptional candidates will have... - Experience in language assessment, test security, remote proctoring, trust and safety, or fraud prevention in high-integrity environments. - Experience maintaining quality across large, distributed examiner/rater/reviewer/contractor populations. - Familiarity with assessment concepts such as inter-rater agreement, reliability, standardization, and performance monitoring. - Experience designing quality systems that span human judgment and technology-assisted workflows. - Familiarity with learning-management systems, assessment platforms, quality-audit tools, or operational analytics. The offered salary is dependent upon several factors, including work experience, skills, and internal peer comparisons. The posted range is subject to change in the future. For this role, base salary is supplemented by equity compensation. We encourage you to talk with your recruiter for more information related to compensation for this role! Salary Range: $142,800—$193,200 USD Benefits: Take a peek at how we care for our employees' holistic well-being with our benefits [here](https://careers.duolingo.com/#benefits). Job Alerts: Sign up for job alerts [here](http://my.greenhouse.io/users/sign_in?job_board=duolingo). Accommodations: We will do everything we can within reason to make sure that your interview takes place in an environment that fairly and accurately assesses your skills. If you need assistance or accommodation, please contact accommodations@duolingo.com. Equal Employment Opportunity: Duolingo is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. Fraud Warning: Unfortunately, there is a rise in scammers pretending to be real Duolingo employees. Duolingo and our employees will never ask for your Social Security number, bank details, or passport info, and we’ll never ask you to deposit a check, purchase equipment, or exchange money during the interview process. Real Duolingo employees always use an email that ends in @duolingo.com or @recruiting.duolingo.com. Stay alert and double-check these details before sharing any information. By applying for this position your data will be processed as per the[Duolingo Applicant Privacy Notice](https://docs.google.com/document/d/e/2PACX-1vTX9GKeRMOMA9Vtm0vfGibrYPYz8ysl0Dg8KSXgj_PxeT5ChsdnNZZWtpxu4t7xillTPGnngnKCjIbV/pub). ## About Duolingo ## Company Overview - **One-liner**: Duolingo is a gamified language-learning platform that makes education free, fun, and accessible to everyone, and is the most downloaded education app in history. - **Entity Type**: Public (NASDAQ: DUOL) - **Headquarters**: Pittsburgh, Pennsylvania, USA (with offices in New York, NY and Seattle, WA) - **Founded**: 2011 - **Founders**: Luis von Ahn and Severin Hacker ## Core Business - **Primary Industry/Industries**: Education technology (EdTech), language learning, digital assessment - **Target Customers**: B2C (individual learners of all ages, globally), B2B/B2G (institutions through the Duolingo English Test) - **Mission**: “To develop the best education in the world and make it universally available.” [investors.duolingo.com](https://investors.duolingo.com/company-strategy-overview-0) ## Products & Services - **Duolingo (main app)**: The core language-learning app offering 98 courses across nearly 40 languages. Freemium model (free with ads/limited hearts; paid Super Duolingo removes ads and adds unlimited hearts). Uses bite-sized, game-like lessons. - **Duolingo English Test (DET)**: A web-based, high-stakes English proficiency exam accepted by 6,100+ institutions, including 98 of the top 100 U.S. universities. Provides a certified Duolingo Score. - **Duolingo Math**: An app for elementary math and brain training (mental math). - **Duolingo ABC**: An app teaching reading fundamentals to preschool through second-grade children. - **Duolingo Score**: An in-app proficiency estimate (0–129) that aims to become the universal standard for language ability. ## Market Standing - **Valuation/Market Cap**: Approximately $16 B as of early 2025. [blog.duolingo.com](https://blog.duolingo.com/handbook/) - **Key Metrics (as of Q4 2025)**: - 52.7 million daily active users (DAUs) - 133.1 million monthly active users (MAUs) - 12.2 million paid subscribers - 90%+ annual employee retention rate [investors.duolingo.com](https://investors.duolingo.com/company-strategy-overview-0) - **Notable Investors/Partners**: Publicly traded; major institutional shareholders. Key partners include universities and institutions that accept the Duolingo English Test. - **Growth Signals**: - Headcount grew to 850+ employees (up from ~800 in early 2025). - Massive AI investment: published 20,500 skills in language courses in Q1 2026 alone (up from 7,100/quarter in 2025). - Launched Video Call feature for real-time AI conversation practice with character Lily. - Expanding beyond language into Math and ABC apps. - DET acceptance grew to 6,100+ institutions. ## Competitive Advantages - **Freemium model at massive scale**: Free product drives 500 M+ learners, generating unmatched data for efficacy improvements, while paid subscriptions fund the mission. - **Gamification & design mastery**: “Make It Fun” principle turns learning into an addictive game, driving daily habit formation. - **AI & data flywheel**: Runs 1,000+ A/B tests per quarter; uses learner data to continuously improve content, personalization, and outcomes. - **Long-term thinking**: Culture of “Take the Long View” prioritizes retention and product quality over short-term tricks. - **The Green Machine**: A proven, experiment-driven approach to building products that has produced consistent innovation. - **Strong brand & quirky culture**: Wholesome but unhinged brand identity creates viral moments and deep user loyalty. ## Strategic Focus - **Current priorities**: Growing users (reducing friction in free experience) and teaching better (AI-driven features, new subjects). - **Becoming the proficiency standard**: Push the Duolingo Score as the universal metric for language ability, supported by the DET. - **Expanding subjects**: Math, reading (ABC), and future courses beyond language. - **AI investments**: Continue using AI/automation to rapidly create and improve course content (skills, Video Call, etc.). - **Long-term**: Build a “100‑year company” that transforms global education. ## Why Work Here - **Culture**: Unique, quirky, and not copied from a tech playbook – built “from scratch by a few dozen nerds in an office above a sports bar.” Core principles: Take the Long View, Raise the Bar, Ship It, Show Don’t Tell, Make It Fun. [handbook.duolingo.com](https://handbook.duolingo.com/) - **Work environment**: Hybrid – in-office Tuesday–Thursday (Pittsburgh, New York, Seattle), remote optional Monday and Friday. Offices designed to be “quirky and welcoming.” [builtin.com](https://builtin.com/company/duolingo) - **Engineering excellence**: Lean, scrappy teams with high autonomy. Emphasis on rapid experimentation and “The Green Machine.” High bar for hiring but also “genuinely kind” people. 90%+ annual retention indicates strong employee satisfaction. - **Impact**: Work on a product that reaches over half a billion learners worldwide, with a mission-driven focus on global education. - **Perks**: Not fully detailed in provided sources, but the culture emphasizes long-term growth, continuous learning, and a supportive environment for generalists. ## Sources 1. [handbook.duolingo.com](https://handbook.duolingo.com/) – The Duolingo Handbook (company values, culture, Green Machine) 2. [careers.duolingo.com](https://careers.duolingo.com/) – Official careers page (mission, principles) 3. [builtin.com](https://builtin.com/company/duolingo) – Duolingo profile on Built In (offices, hybrid policy, tech stack, employee count) 4. [investors.duolingo.com](https://investors.duolingo.com/company-strategy-overview-0) – Company Strategy Overview (mission, pillars, key metrics, growth signals) 5. [blog.duolingo.com](https://blog.duolingo.com/handbook/) – Inside the Duolingo Handbook (valuation ~$16B, principles, culture details) ## Other roles at Duolingo - [General Manager, India](https://feeny.ai/job/general-manager-india-duolingo-bengaluru-hqmk6q413rc6) — Bengaluru, India - [AI Research Engineer, New PhD Graduate](https://feeny.ai/job/ai-research-engineer-new-phd-graduate-duolingo-new-york-pz5zwfgse33n) — New York, NY / Pittsburgh, PA - [Staff Technical Program Manager](https://feeny.ai/job/staff-technical-program-manager-duolingo-new-york-q5dakapaqwrm) — New York, NY - [Illustrator, Intern](https://feeny.ai/job/illustrator-intern-duolingo-detroit-zc5qv10mka9h) — Detroit, MI - [Proctor Quality and Learning Manager, Scaling Operations](https://feeny.ai/job/proctor-quality-and-learning-manager-scaling-operations-duolingo-london-c6yexd9a0bhn) — London, United Kingdom - [Ad Sales Lead, Programmatic](https://feeny.ai/job/ad-sales-lead-programmatic-duolingo-new-york-hbj73r8q0t8d) — New York, NY - [Senior Creative, Social](https://feeny.ai/job/senior-creative-social-duolingo-new-york-t39wefw132wc) — New York, NY / Pittsburgh, PA - [Senior Product Manager, Learning](https://feeny.ai/job/senior-product-manager-learning-duolingo-new-york-xpkskctaksep) — New York, NY / Pittsburgh, PA - [Senior Site Reliability Engineer](https://feeny.ai/job/senior-site-reliability-engineer-duolingo-new-york-8nvfwjjdkbxm) — New York, NY / Pittsburgh, PA - [Senior Engineering Manager, AI Platform](https://feeny.ai/job/senior-engineering-manager-ai-platform-duolingo-new-york-5085b5znwcr1) — New York, NY / Pittsburgh, PA