--- title: 'ML Annotation QA Engineer at Gather AI' canonical: 'https://feeny.ai/job/ml-annotation-qa-engineer-gather-ai-open-to-fz96nnrq0f5c' type: 'job' last_seen: '2026-09-10' --- # ML Annotation QA Engineer at Gather AI - **Company:** Gather AI - **Location:** Open To, India - **Work type:** remote - **Posted:** 2026-09-04 - **Last confirmed live:** 2026-09-10 - **Apply:** https://job-boards.greenhouse.io/gatherai/jobs/5228038007 ## Job description Job Title: ML Annotation QA Engineer ## About Us Are you ready to build the future of supply chain? At Gather AI, we’re not just creating software, we’re pioneering a new era of warehouse intelligence. We’ve developed a groundbreaking, vision-powered platform that uses autonomous drones and existing equipment to capture real-time data, completely digitizing workflows that have historically been manual and error-prone. This means facilities operate smarter, safer, and more efficiently, ultimately redefining "on-time, in full" delivery. If you’re looking for an opportunity to contribute to truly transformative technology and make a significant impact in a vital industry, Gather AI is the place for you. We’re leading the charge in the rapidly evolving robotics industry, and we invite you to join us in reshaping the global supply chain, one intelligent warehouse at a time. ## About the Team Our engineering organization spans autonomy, computer vision and machine learning, embedded and hardware systems, full-stack, and cloud, all working in parallel across multiple active product lines tied to live customer deployments. It’s a technically deep, fast-moving team where individual contributors carry real accountability and the work shows up directly in customer operations. Ground truth quality sits at the centre of that — the annotated data this role owns is what our models are trained and measured against. ## About the Role We are looking for an ML Annotation QA Engineer to own the quality of annotated data across our computer vision and machine learning programs. This role is responsible for the judgment-heavy analysis that cannot be reliably outsourced, for the decision rules behind it, and for turning annotation output into an ongoing read on how our systems are actually performing in the field. We work with an external annotation partner at production volume, and that continues. What we need in house is someone who can analyse the annotated data, make and defend the calls the vendor cannot make consistently, and build the aggregate view that shows which facilities and equipment are degrading and why. Annotation drift, a model regression, a tool bug, and genuine field degradation all look similar in a chart and require completely different responses — telling them apart is the core of the job. You will work closely with Machine Learning Engineers, QA, and Engineering, and the first assignment is our warehouse forklift vision program, where barcode readability and localisation analysis are the immediate need. From there the remit grows with us: drone imagery annotation today, and new task types as customer-driven capabilities come online. Success in this role requires a combination of analytical rigor, sound judgment under ambiguity, and clear written communication. ## What You’ll Do - Own the judgment-heavy quality analysis on annotated data that cannot be reliably outsourced — working the daily review queue and producing verdicts and root cause in house. - Own, version, and refine the verdict taxonomy, decision rules, and quality guidelines for the categories you cover. - Build and maintain performance trackers over annotated data — error rates by facility, site, equipment, and data format over time, against an agreed baseline. - Detect anomalies against that baseline and flag them the day they appear rather than weeks later. - Run root cause analysis on flagged anomalies, distinguishing annotation error from model or system error from genuine degradation in the field. - Report findings to engineering and ML with reproducible evidence and stated confidence, fast enough that the issue is still observable. - Identify systematic failure patterns rather than one-off misses, and maintain a documented pattern library others can use. - Query and analyse annotation data directly with Python and SQL to test hypotheses, without waiting on extracts from anyone. - Feed annotation-quality findings back as concrete SOP and instruction changes when the root cause is labeling rather than system behaviour. - Specify annotation tool improvements — what the tool should surface so analysis stops requiring manual work — and validate the fixes. - Stand up quality analysis and reporting for new annotation programs as they come online. - Track work across Jira and contribute to pre-release validation for the behaviours you cover. First 90 Days Within your first three months, you will be expected to: Own the Quality Analysis - Take over barcode and location root cause analysis from the annotation vendor. - Move from supervised review to owning the daily queue at the agreed review threshold, inside the expected time budget. - Become the primary owner of verdicts and root cause for the categories you cover. Become Fluent in the Annotation Pipeline Develop working expertise in the data and the domain behind it: - What is captured, at what grain, and where the known quality limits are - Racks, locations, levels, bins and bin types; LPN, SKU, AWB and other code formats; exceptions and exception types; OCR versus barcode and the failure modes of each Build the Performance Tracker - Stand up a facility performance tracker with an agreed baseline, thresholds, and reporting cadence. - Establish anomaly detection against it, and get the team to the point of trusting and using it. - Investigate flagged anomalies independently, with a root cause hypothesis and stated confidence. Own Documentation Take ownership of: - Barcode and location verdict taxonomy and decision rules - The pattern library of known failure modes Responsibilities include: - Version control - Closing documentation gaps - Adding edge-case guidance - Feeding changes back to the annotation vendor’s SOPs where the root cause is labeling Required Technical Skills - BS in Computer Science/Engineering, Electrical Engineering, or equivalent experience - Experience working with annotated datasets for CV/ML, including assessing label quality - Strong understanding of statistics, and able to work with data - Root cause analysis — generating competing hypotheses and naming the evidence that separates them - Familiarity with Python and SQL, or equivalent, for querying and analysing data independently - Writing quality guidelines, decision rules, and labeling taxonomies - Excellent documentation, communication, and collaboration skills Nice-to-Have Skills - 2+ years in quality assurance, data quality, or product support - 1+ years experience with enterprise-grade ticketing systems (e.g. Jira) - Computer vision annotation experience as a reviewer or auditor — video event labeling, bounding boxes, polygon segmentation, counting, or classification - Annotation quality methodology — gold-set validation, inter-annotator agreement, sampling design - Strong spatial and geometric reasoning — relevant wherever labels describe position in physical space - Experience in warehouse automation, robotics, or computer vision applications - Dashboarding or BI tooling for recurring reports - Small team experience ## Qualifications Required - BS in Computer Science/Engineering, Electrical Engineering, or equivalent experience - 2–5 years of experience in ML QA, annotation quality, data quality, or analytics at an AI/ML company - Hands-on experience with annotated ML datasets, including assessing label quality - Demonstrated experience finding, diagnosing, and reporting data anomalies to a technical audience - Able to get to a defensible answer from unfamiliar data without someone preparing it first - Understanding of data privacy and confidentiality requirements when working with customer operational data ## Preferred - Experience in warehouse automation, robotics, or computer vision applications - Experience with annotation platforms and quality tooling - Experience authoring annotation guidelines or standard operating procedures Required Technologies - Python - SQL, or an equivalent query language - Jira Success Traits We’re looking for someone who is: - Analytical, able to tell a real pattern from noise and to say honestly when the data will not settle a question - Detail-oriented — a verdict or a tracker that is subtly wrong is worse than none at all - Comfortable with ambiguity, and willing to present competing hypotheses rather than forcing a single answer - Persistent in chasing a cause across sites, programs, and builds - Resourceful and comfortable building processes and reports where they don’t yet exist - A strong written communicator — the output of this role is reports other people act on - Collaborative, respectful, and an excellent cross-functional partner What Success Looks Like By the end of your first six months, you will have: - Established yourself as the primary owner of annotation quality analysis and root cause - A performance tracker the team relies on, running on a regular cadence - Closed the reporting cycle to same day, so issues are raised while still observable - Standardized the verdict taxonomy and decision rules for the categories you cover - Built a documented pattern library of known failure modes that others can use - Improved the annotation tool in at least one way that measurably reduces manual effort - Given ML and engineering a clearer picture of what error patterns mean for model accuracy and field performance - Created a repeatable method for standing up annotation quality on the next program ## About Gather AI ## Company Overview - **One-liner**: Gather AI builds the Physical AI platform for logistics, using AI-powered vision on drones and material handling equipment to digitize warehouse operations in real time. - **Entity Type**: Private – Series B ($74M total funding) - **Headquarters**: Pittsburgh, United States - **Founded**: 2017 - **Founders**: Sankalp Arora (CEO), Geetesh Dubey (Chief Systems Officer), Daniel Maturana (Chief ML Scientist) ## Core Business - Primary industry: Logistics and warehouse management (Physical AI) - Target customers: B2B, enterprise-scale logistics, manufacturing, retail, aerospace, automotive, and government – customers include GEODIS, NFI Industries, Barrett Distribution Centers, Axon, and dnata - Mission: To give every facility in a network the same continuous picture of the floor, the intelligence to understand it, and the workflows to act on it – bringing the same intelligence to the physical world that exists in the digital one. ## Products & Services - **Gather AI Prana Platform**: An end-to-end Physical AI platform with three layers: - **SEE**: AI-powered vision on forklift-mounted cameras (for moving items) and drones (for static inventory) that captures ten-plus structured data points per frame, achieving 99.9%+ inventory accuracy. - **THINK**: AI reasoning that investigates root cause across inventory, labor, and fulfillment, surfacing ranked, reasoned priorities before each shift. - **ACT**: Workflows that route decisions to the right person or system with pre-drafted tasks, closing the loop from capture to action. ## Market Standing - **Valuation**: Not publicly disclosed (private company) - **Key Metric**: 2.5x year-over-year bookings growth (250% growth); total funding of $74M (including a $40M Series B raised in 2026); average time to ROI is 6 months. - **Notable Investors/Partners**: Backed by Tribeca Venture (noted on LinkedIn); deployed with GEODIS, NFI Industries, Barrett Distribution Centers, Axon, dnata, and the U.S. Department of Classified Antiquities. - **Growth Signals**: Doubled operational footprint in 2026; named to Fast Company’s World’s Most Innovative Companies list for 2026; employee headcount grew ~68% year over year to 80+ employees; expanded into government sector; active job postings increased 333% YoY. ## Competitive Advantages - **Closed-loop Physical AI**: Combines vision (SEE), reasoning (THINK), and action (ACT) in one platform – a unique integration that turns real-time visual data into prioritized tasks and automated workflows. - **Deep domain expertise**: Founded by Carnegie Mellon robotics PhDs; CTO Andrew Hoffman was a founding engineer at Kiva Systems (now Amazon Robotics); team has decades of warehouse automation experience. - **Network-wide consistency**: The platform enforces the same standard across every facility, enabling fixes from one building to become playbooks for the whole network. - **99.9%+ accuracy** down to the case level, maintained continuously, not just during audits. ## Strategic Focus - Scale platform across multi-facility enterprise networks and new verticals (government, aerospace, automotive). - Continue investing in AI/ML autonomy and computer vision to expand the “THINK” layer’s root-cause analysis and predictive capabilities. - Enhance network-wide outcomes by replicating operational playbooks across customer sites. ## Why Work Here - **Culture**: Radical transparency, candor, accountability, speed, and a people-first approach. Decisions are made openly; everyone has a voice in shaping the company’s future. - **Work model**: Fully remote or remote-flexible options available. - **Benefits**: Competitive salary and equity, comprehensive medical/dental/vision, 401K, unlimited PTO, monthly wellness benefit, continuing education/tuition support, voluntary life insurance. - **Engineering culture**: Opportunities to work on cutting-edge AI, ML, autonomy, computer vision, and robotics alongside former Amazon Robotics and CMU experts. Real customer impact at scale. ## Sources 1. [gather.ai](https://gather.ai) 2. [gather.ai/company](https://gather.ai/company) 3. [gather.ai/careers](https://gather.ai/careers) 4. [gather.ai/about](https://www.gather.ai/about) 5. [linkedin.com/company/gather-ai](https://www.linkedin.com/company/gather-ai) ## Other roles at Gather AI - [Staff Autonomy Engineer (MHE Vision)](https://feeny.ai/job/staff-autonomy-engineer-mhe-vision-gather-ai-open-to-xwrzam65zcy5) — Open To, United States / Pittsburgh, PA - [Staff Autonomy Engineer (Drone)](https://feeny.ai/job/staff-autonomy-engineer-drone-gather-ai-open-to-9q1w90fjkesc) — Open To, United States / Pittsburgh, PA - [Senior Robotics Platform Engineer (Robotics/Infra)](https://feeny.ai/job/senior-robotics-platform-engineer-robotics-infra-gather-ai-open-to-24kmb5w32ev7) — Open To, United States / Pittsburgh, PA - [Staff Full Stack Engineer (Hybrid)](https://feeny.ai/job/staff-full-stack-engineer-hybrid-gather-ai-pittsburgh-fxc39zh48y3e) — Pittsburgh, PA - [Principal Data Engineer](https://feeny.ai/job/principal-data-engineer-gather-ai-india-gb7hgwbveemp) — India - [Senior Manager, Hardware](https://feeny.ai/job/senior-manager-hardware-gather-ai-pittsburgh-g0g1fht8vhym) — Pittsburgh, PA - [UX Designer](https://feeny.ai/job/ux-designer-gather-ai-open-to-6zhb7g3cbtkw) — Open To, United States / Pittsburgh, PA - [Senior QA Engineer](https://feeny.ai/job/senior-qa-engineer-gather-ai-hyderabad-tme00py0w0t3) — Hyderabad, India - [Principal Machine Learning Scientist](https://feeny.ai/job/principal-machine-learning-scientist-gather-ai-open-to-00wtke9aacqh) — Open To, United States / Pittsburgh, PA - [Director of Machine Learning](https://feeny.ai/job/director-of-machine-learning-gather-ai-pittsburgh-rhtp64m9hkez) — Pittsburgh, PA / Open To, United States