--- title: 'Staff Software Engineer – Testing & Evals Frameworks at ID.me' canonical: 'https://feeny.ai/job/staff-software-engineer-testing-evals-frameworks-id-me-mclean-cg769rxj9xmr' type: 'job' last_seen: '2026-11-04' --- # Staff Software Engineer – Testing & Evals Frameworks at ID.me - **Company:** ID.me - **Location:** Mclean, VA / Mountain View, CA - **Compensation:** $174k–$253k - **Posted:** 2026-10-28 - **Last confirmed live:** 2026-11-04 - **Apply:** https://job-boards.greenhouse.io/idme/jobs/8047263003 ## Job description Company Overview IDMe is the next-generation digital identity wallet that simplifies how individuals securely prove their identity online. Consumers can verify their identity with IDMe once and seamlessly login across websites without having to create a new login and verify their identity again. Over 175 million users experience streamlined login and identity verification with IDMe at 22 federal agencies, 50 state government agencies, and more than 100 healthcare organizations. Over 600 consumer brands use IDMe to verify communities and user segments to honor service and build more authentic relationships. IDMe’s technology meets the federal standards for consumer authentication set by the Commerce Department and is approved as a NIST 800-63-3 IAL2 / AAL2 credential service provider by the Kantara Initiative. IDMe is committed to “No Identity Left Behind” to enable all people to have a secure digital identity. To learn more, visit https://network.id.me/. IDMe is a full-time, in-office culture. Unless a specific job description explicitly states otherwise, all roles are on-site five days per week at one of our offices in McLean, VA; Mountain View, CA; New York City, NY; or Tampa, FL. Certain roles — such as field-based sales or other remote-by-design positions — may have different work arrangements as noted in their individual postings. At IDMe, we embrace the thoughtful use of AI tools in our daily work and there are even occasions where we leverage AI in our hiring process. However, during the interview process, we want to understand your individual skills and experiences. Therefore, we have guidelines on how AI can be appropriately used during your application and interviews which can be found [here](https://insider.id.me/candidate-ai-use-in-interviewing/). Position Overview This Staff Engineer role sits at the intersection of engineering, testing, AI evals, and developer experience. You will own the architecture and strategy for the evaluation frameworks, automation tools, and testing infrastructure that give ID.me engineering teams the confidence to ship quickly and safely across functional, end-to-end, LLM/eval, and security-focused testing practices, as well as the CI/CD quality gates the org depends on. It requires deep engineering rigor, the judgment to set testing strategy for complex, asynchronous, event-driven systems, and the ability to build tooling and standards that other teams adopt widely. You will raise the quality bar across the engineering org, mentor senior and mid-level engineers, champion AI-assisted testing practices, and partner directly with engineering, product, and security teams to embed quality into every stage of development for a platform that verifies the identity of millions of users. ## Key Responsibilities - Own Test Architecture & Strategy: Set the architecture and long-term strategy for automation frameworks and testing infrastructure (Playwright, Python, Jest, API automation) across ID.me's services, and ensure comprehensive, reliable coverage org-wide. - Lead Testing Strategy for Distributed Systems: Define end-to-end and integration testing strategy for complex, asynchronous, event-driven, and eventually-consistent systems, including workflow orchestration platforms such as Temporal. - Drive Testing-in-Production as an Org Standard: Build and champion canary deployments, progressive/phased rollouts, synthetic monitoring, and automated rollback triggers to validate real-world behavior safely before full release. - Own Security-Focused Test Automation: Set the standard for testing authentication/authorization flows (OAuth 2.0, OIDC), RBAC/ReBAC, secrets management, and tenant isolation. - CI/CD Quality Gates: Integrate automated testing into CI/CD pipelines (e.g., GitHub Actions) org-wide to give every team fast, reliable feedback. - Drive AI & Evals Culture: Build robust evaluation pipelines for AI-assisted features and LLM agents, while applying AI tools to accelerate test authoring, test plan generation, and code review across the org. - Cross-Team Collaboration: Partner with Security, Platform, and Product teams as a testing strategist, advising on testable code structure, coverage gaps, and quality checks throughout the development lifecycle. - Mentorship: Guide senior and mid-level engineers on test architecture, testing strategy, and quality practices. - Debug & Root Cause: Debug and root-cause issues across frontend, backend, APIs, and distributed services, and drive fixes to closure. - Reliability & Eval Metrics: Define and track reliability, quality, and eval accuracy metrics (e.g., time to detect, time to remediate, output quality scores) for the systems you evaluate and test. ## Minimum Qualifications - 10+ years of experience (or equivalent: 10+ years with a Master's degree, or a PhD with 5+ years) as a software engineer in modern web applications and distributed systems. - Proficiency in Python/TypeScript/JavaScript/Java. - Hands-on experience with Playwright, Jest, API automation, or evaluation frameworks for software/AI systems. - Experience integrating automated tests into CI/CD pipelines (e.g., GitHub Actions, ArgoCD). - Proven ability to lead cross-team technical initiatives and influence engineering standards. - Track record of mentoring senior engineers and raising the quality bar across teams. - Strong written and verbal communication across engineering, product, and leadership. ## Preferred Qualifications - API & Systems Testing: REST APIs, microservices, distributed and event-driven architectures; workflow orchestration (e.g., Temporal). - Identity & Access Management: OAuth 2.0, OIDC, SAML 2.0, SCIM 2.0; enterprise IdPs (Okta, Entra ID, Auth0, Ping); RBAC/ReBAC (Zanzibar, SpiceDB) and multi-tenant authorization. - Security & Compliance: AuthN/authZ testing, secrets management, tenant isolation, least-privilege access; IDV/KYC and PII/compliance validation. - Testing Strategy & Ops: Canary/phased rollouts, automated rollback, contract testing (Pact), performance/load testing (Locust, k6, Gatling). - Engineering & Platform: Java/Spring Boot or Ruby on Rails; GCP, Docker, Kubernetes; observability and chaos engineering. - AI-Augmented Testing: Using/building agentic tools for test generation, code review, and test planning. - AI Agent Evals: Experience building eval frameworks for LLM agents (e.g., correctness graders, LLM-as-judge, human-in-the-loop evals, benchmark dataset curation); familiarity with agentic frameworks (Claude API/Anthropic SDK, BrainTrust, LangChain, LangGraph, CrewAI, or similar); production monitoring for AI systems (behavioral drift detection, output sampling, shadow scoring); red-teaming or adversarial testing experience for AI models or agents; experience with RAG pipelines, including data chunking and pre-retrieval data quality gates. - Background in identity verification, fraud detection, or regulated industries. - Experience with observability tooling (Datadog, OpenTelemetry). The annual base salary listed does not include a company bonus, incentive for sales roles, equity and benefits which will be determined based on experience, skills, education, relevant training, geographic location and role. IDMe offers comprehensive medical, dental, vision, health savings account, flexible spending accounts (medical, limited purpose, dependent care, commuter benefit accounts), basic and voluntary life and AD&D insurance, 401(k) with company match, parental leave, ability to participate in unlimited paid time off subject to the terms and conditions of the PTO policy, including 8 company wide holidays, short and long-term disability insurance, accident and critical illness insurance, referral bonus policy, employee assistance program, pet insurance, travel assistant program, wellbeing and childcare discounts, benefit advocates, and a learning and development benefit. Final offers may vary from the amount listed based on qualifications, professional experiences, skills, education, relevant training, geographic location, and other job related factors. U.S. Pay Range $174,000—$229,000 USD Mountain View, CA Pay Range $194,000—$253,000 USD IDMe maintains a work environment free from discrimination, where employees are treated with dignity and respect. All IDMe employees share in the responsibility for fulfilling our commitment to equal employment opportunity. IDMe does not discriminate against any employee or applicant on the basis of age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. IDMe adheres to these principles in all aspects of employment, including recruitment, hiring, training, compensation, promotion, benefits, social and recreational programs, and discipline. In addition, IDMe's policy is to provide reasonable accommodation to qualified employees who have protected disabilities to the extent required by applicable laws, regulations and ordinances where a particular employee works. Upon request we will provide you with more information about such accommodations. Please review our Privacy Policy, including our CCPA policy, at[id.me/privacy](https://insider.id.me/privacy/). If you provide IDMe with any personally identifiable information you confirm that you have read and agree to be bound by the terms and conditions set out in our Privacy Policy. IDMe participates in E-Verify. ## About ID.me ## Company Overview - **One-liner**: ID.me provides a next-generation digital identity wallet that simplifies how individuals securely prove their identity online across government, healthcare, and commercial sectors. - **Entity Type**: Private - **Headquarters**: McLean, Virginia, USA (with offices in Mountain View, California, USA and Tampa, Florida, USA) - **Founded**: 2010 - **Founders**: Blake Hall (CEO, co-founder, and decorated U.S. Army Ranger) ## Core Business - **Primary industry/industries**: Digital Identity, Cybersecurity, Identity Verification, Government Technology, Healthcare Technology - **Target customers**: B2B, B2G (Business-to-Government), Enterprise (21 federal agencies, 50 state government agencies, 70+ healthcare organizations, 600+ consumer brands) - **Mission or purpose statement**: “To make the world a more trusted place by delivering the highest level of security with the least amount of friction at the lowest possible cost.” The company is also committed to “No Identity Left Behind” to enable all people to have a secure digital identity. ## Products & Services - **ID.me Digital Identity Wallet**: A single sign-on and identity verification platform allowing users to verify their identity once and seamlessly sign-in across websites without re-verifying. Over 156 million users are on the network. - **Group Affiliation Verification**: Enables organizations to verify community affiliations (military, students, teachers, nurses, first responders, government employees) for discounts and benefits. - **Identity Proofing (IAL2/AAL2)**: A NIST 800-63-3 IAL2 / AAL2 conformant credential service provider, approved by the Kantara Initiative. The only provider offering video chat and in-person verification to increase access and equity. - **Workforce Identity**: Identity solutions for workforce management, including employee credentialing and access. ## Market Standing - **Valuation/Market Cap**: Not publicly disclosed - **Key Metric**: Annual revenue estimated at $90.0M (LinkedIn estimate); served over 156 million users - **Notable Investors/Partners**: Partners include 21 federal agencies, 50 state government agencies, and 70+ healthcare organizations. Prior funding rounds include 8 rounds from investors (specific lead investors not listed in search results). - **Growth Signals**: 615 total employees (Built In estimate); 51 active job postings across engineering, fraud, security, sales, marketing, and product; expanding into AI agent evaluations and data platform roles; strong presence in both public sector and commercial retail. ## Competitive Advantages - **NIST Certification**: Only identity provider approved as a NIST 800-63-3 IAL2/AAL2 credential service provider by the Kantara Initiative, meeting federal standards for consumer authentication. - **Multi-Channel Verification**: Offers online, call center, and in-person verification (including video chat), increasing access and equity for users who lack traditional digital footprints. - **Network Effects**: Over 156 million users and broad acceptance across government, healthcare, and retail creates a powerful network moat—users can verify once and use everywhere. - **Special Forces Culture**: CEO Blake Hall, a former Army Ranger, has built a culture modeled on elite military units, emphasizing “Trustworthy Teammates” and “Elite Performance.” ## Strategic Focus - **Current priorities and direction for growth**: Expanding the digital identity network into more sectors (financial services, healthcare); investing heavily in AI (AI agent evaluations, AI enablement); building out data platform and authentication infrastructure; scaling the workforce identity product line; and maintaining federal compliance and security standards. ## Why Work Here - **Culture highlights**: The company explicitly describes its culture as “not a set of beliefs, but what you do,” modeled on Special Forces principles of trust and elite performance. Emphasis on “Trustworthy Teammates” and solving the most difficult missions where others have failed. - **Remote/hybrid/office policy**: Employees work from physical offices (onsite). Typical time on-site is full-time, with offices in McLean, VA, Mountain View, CA, and Tampa, FL. - **Notable perks**: Company-sponsored medical, dental, and vision plans for employee and family; paid parental leave; generous paid time off; 401(k) with employer matching; company-sponsored life insurance; employee equity incentive plan; multiple lounge areas and game room; numerous mental health resources. - **Engineering culture**: Uses modern tech stack including Ruby, React, Docker, Kubernetes, Terraform; roles span authentication platform, data platform, identity proofing, SRE, and AI agent evaluations. Strong emphasis on merit and high performance. ## Sources 1. [id.me - About](https://www.id.me/about) 2. [id.me - Careers](https://www.id.me/careers) 3. [Greenhouse - ID.me Jobs](http://job-boards.greenhouse.io/idme) 4. [LinkedIn - ID.me](https://www.linkedin.com/company/id.me) 5. [Built In - ID.me](https://builtin.com/company/idme) ## Other roles at ID.me - [Account Manager, SLED (Southeast)](https://feeny.ai/job/account-manager-sled-southeast-id-me-united-states-9m584akn4dqk) — United States, United States - [Director of Sales - Healthcare](https://feeny.ai/job/director-of-sales-healthcare-id-me-united-states-55r8nt4zhaem) — United States, United States - [Senior Solution Consultant, Workforce West](https://feeny.ai/job/senior-solution-consultant-workforce-west-id-me-mountain-view-669y9q6z021g) — Mountain View, CA - [Senior Solution Consultant, SLED (Texas)](https://feeny.ai/job/senior-solution-consultant-sled-texas-id-me-united-states-5q6gf58zgphw) — United States, United States - [Senior Solution Consultant, Commerce & Loyalty West](https://feeny.ai/job/senior-solution-consultant-commerce-loyalty-west-id-me-mountain-view-p0k6khwc5j90) — Mountain View, CA - [Principal Software Engineer, Data](https://feeny.ai/job/principal-software-engineer-data-id-me-mclean-gnmv3e49w0ec) — Mclean, VA / Mountain View, CA - [Staff Software Development Engineer – Wallet - Authentication](https://feeny.ai/job/staff-software-development-engineer-wallet-authentication-id-me-mountain-view-xybmvzq9fppw) — Mountain View, CA - [Account Executive, Healthcare (DC/NY/Chicago)](https://feeny.ai/job/account-executive-healthcare-dc-ny-chicago-id-me-united-states-hnd16d91xgjg) — United States, United States - [Account Executive, Healthcare (Phoenix/Denver/Bay Area)](https://feeny.ai/job/account-executive-healthcare-phoenix-denver-bay-area-id-me-united-states-hrj8c90qvbg3) — United States, United States - [Principal Security Governance & Audit Specialist](https://feeny.ai/job/principal-security-governance-audit-specialist-id-me-mountain-view-2tx1zm3yjse5) — Mountain View, CA