---
title: 'Research Intern - AI Evaluations at Karya'
canonical: 'https://feeny.ai/job/research-intern-ai-evaluations-karya-bengaluru-vhhwvkayktkt'
type: 'job'
last_seen: '2026-09-08'
---

# Research Intern - AI Evaluations at Karya

- **Company:** Karya
- **Location:** Bengaluru, India
- **Posted:** 2026-09-04
- **Last confirmed live:** 2026-09-08
- **Apply:** https://job-boards.greenhouse.io/karya/jobs/5416262008

## Job description

About Karya:

Why was Karya on the [cover of the Time Magazine](https://time.com/6297403/the-workers-behind-ai-rarely-see-its-rewards-this-indian-startup-wants-to-fix-that/) , [highlighted by Satya Nadella](https://www.youtube.com/watch?v=dY2CpA05IWI&t=3015s) , and [chosen by Google as its partner for Project Vaani](https://economictimes.indiatimes.com/tech/technology/under-bhashini-iisc-to-open-source-16000-hours-of-speech-data/articleshow/111639325.cms?from=mdr)?

In part, because Karya is on a mission to provide AI enabled earning and learning opportunities to economically underserved communities, thereby building a pathway out of poverty for them. Karya achieves this while also delivering high quality, timely, and price competitive data to its clients.

Karya's workers make at least 20 times the Indian minimum wage and through our one-of-a-kind digital work platform, we have delivered over 40 million digital tasks and are poised to positively impact over 100 thousand workers by the end of the year. In the coming years, our goal is to rapidly scale our impact by bringing economic opportunities to millions of underserved users in India.

## The Role

At Karya, we're building AI evaluation systems that measure and understand whether these systems actually work for the communities they're meant to serve. We're looking for a research intern who can bring a social science lens into this work, specifically around evaluating language technologies (speech, text, and translation systems) built for and with Indian communities.

You'll be embedded with the Evaluations team within Karya's tech team, which means you'll get a front-row seat to the full arc of AI work happening in India today from how models are built, to how they're tested, to how they land in the hands of rural and economically underprivileged communities. You'll be expected to stay current on AI evaluation science itself, and use your disciplinary training to ask sharper questions about what these systems are actually doing, and to whom.

Concretely, this means:

- Applying social science research methods (qualitative and/or quantitative) to the evaluation of AI/ML systems, particularly language technologies
- Contribute to developing AI evaluation and testing methodologies
- Investigating how these technologies interact with and affect the communities they're deployed among, especially in rural and low-resource contexts in India
- Working closely with the Evaluations team to understand both the "build" and "evaluate" sides of AI systems

This role is well suited to someone who's curious about tech and wants to put their social science training into practice. You'll be working alongside engineers, bringing a rigorous footing and a social science researcher's lens into a technical space. If you're a social science student or researcher who's been eyeing the AI/tech space and wondering how to get in, this is that entry point. You'll work on live evaluation pipelines, with communities across India, on low- and high-resource language technologies, alongside a team that treats social science expertise as core to the work.

## Qualifications

Education

- Currently pursuing or recently completed an undergraduate or master's degree in a social science discipline (Sociology, Anthropology, Development Studies, Gender Studies, Political Science, Economics, or Science and Technology Studies (STS)
- No technical degree required, but demonstrated interest in and conceptual understanding of AI/ML systems is expected. E.g., through self-directed learning, coursework, or prior projects at the intersection of technology and society

## Skills and Competencies

- Strong grounding in social science research methods qualitative, quantitative, or mixed (not a hard requirement, but research training expected)
- Comfort conducting or supporting focus group discussions (FGDs) and field visits
- Conceptual understanding of AI/ML systems - applied AI/ML literacy - enough to engage meaningfully with concepts like model evaluation, human-in-the-loop systems, and language technologies (you don't need to code, but you should be comfortable with how these systems are built and tested)
- Familiarity with socio-technical systems thinking (i.e., understanding technology and society as mutually shaping, not separate concerns)
- Multilingual proficiency in Indian languages is a strong plus
- Background in computational social science is a plus, not a requirement
- Strong written and verbal communication skills
- Comfort working in ambiguous, early-stage research settings

People matter at Karya and these are some of the perks and benefits we created for our team:

- Flexible vacation and leave policy
- Flexible work options
- Insurance as per industry standards
- Access to industry stalwarts and networking opportunities

Karya is an equal opportunity and affirmative action employer.

Qualified applicants will receive consideration without regard to their race, colour, religion, sex, sexual orientation, gender identity and disability.

Karya invites all qualified interested applicants to apply for career opportunities. If you are a person with a disability and need a reasonable accommodation to use our search to apply for a career opportunity, reach out at hr@karya.in.

## About Karya

## Core Business
- **Primary industry/industries**: AI Data Services, Language Technology, Ethical Data Collection, Impact Tech
- **Target customers**: B2B – AI labs (e.g., Google DeepMind, Microsoft), enterprises building multilingual AI systems, government and public-sector AI initiatives
- **Mission**: “Create dignified digital work that improves livelihoods while shaping AI systems that reflect the people who build them.” [karya.in](https://www.karya.in/about/mission/)

## Products & Services
- **Conversational Speech Datasets**: Large-scale datasets across 22 official Indian languages for speech recognition and conversational AI. [karya.in](https://www.karya.in/)
- **Evaluation Benchmarks (Samiksha)**: National-scale evaluation frameworks covering 6 Indian languages, 17 models, and 4 key domains (healthcare, agriculture, finance, law, education, public services). [karya.in](https://www.karya.in/)
- **Data Collection & Annotation Services**: Domain-specific transcription, localized translation, and multimodal dataset creation (including egocentric datasets for physical/embodied AI). [karya.in](https://www.karya.in/)
- **Karya Platform (PaaS)**: A digital work platform that distributes AI-data microtasks to rural workers, enabling human-in-the-loop evaluation and bias mitigation. [karya.in](https://www.karya.in/) and [linkedin.com](https://in.linkedin.com/company/karya-inc)

## Market Standing
- **Valuation/Market Cap**: Not disclosed (private company)
- **Total Funding**: USD $1,000,000 (grant from Google.org, led by Google.org, November 2024) [linkedin.com](https://in.linkedin.com/company/karya-inc)
- **Key Metric**: Over 130,000 workers have completed 65+ million paid digital tasks; 99 employees (45.8% YoY growth) [linkedin.com](https://in.linkedin.com/company/karya-inc)
- **Notable Investors/Partners**: Google.org (grant), Google DeepMind, Microsoft, partnerships with leading AI labs; expanded to Kenya and Ethiopia [karya.in](https://www.karya.in/about/mission/)
- **Growth Signals**: Launched Karya Institute (2025) to explore the future of work in AI; published research at CHI 2019 and LREC 2020; spun out of Microsoft Research; presented to Satya Nadella and Sundar Pichai [karya.in](https://www.karya.in/about/mission/)

## Competitive Advantages
- **Ethical & Inclusive Data Sourcing**: Karya’s platform directly benefits low-income rural workers by paying fair wages, differentiating itself from exploitative data labeling models.
- **Deep Focus on Underrepresented Languages**: Specializes in 22 Indian languages and underserved communities globally, creating datasets that major AI companies cannot easily replicate.
- **End-to-End Pipeline**: Offers data collection, annotation, evaluation, and deployment – a vertically integrated stack for multilingual AI.
- **Research-Backed Origin**: Born from Microsoft Research, giving it credibility and technical depth in crowdsourced work and language technology.

## Strategic Focus
- **Geographic Expansion**: Pilots in Kenya and Ethiopia to replicate the model for African languages and communities.
- **“Earn & Learn” Strategy**: Developing pathways for workers to gain skills and move out of poverty, combining earning with upskilling.
- **Karya Institute**: Research arm exploring the future of digital work and AI’s impact on low-income communities.
- **Product Diversification**: Moving beyond data collection into evaluation benchmarks and platform-as-a-service for enterprise clients.

## Why Work Here
- **Mission-Driven Culture**: Join a team committed to using AI for social impact – creating dignified work and inclusive AI systems.
- **Growth Trajectory**: Rapidly scaling (45% headcount growth YoY) with opportunities to shape operations, technology, and impact in India and Africa.
- **Work Policy**: Mix of office (Bangalore) and remote roles (e.g., Visual & Motion Designer Remote, Health Program Lead Remote) as seen on the careers page. [greenhouse.io](http://job-boards.greenhouse.io/karya)
- **Engineering & Research Focus**: Strong technical team (29% in technical roles) with backgrounds from Microsoft, Wadhwani AI, and top Indian institutes. Work on cutting-edge NLP, speech, and multimodal AI.
- **Notable Perks**: The chance to work directly with global AI labs (Google DeepMind, Microsoft) and present to top tech leaders. Limited employer reviews (2.0/5.0 from 1 review on LinkedIn) – candidate should research culture further.

## Sources
1. [karya.in – Homepage](https://www.karya.in/)
2. [karya.in – About/Mission](https://www.karya.in/about/mission/)
3. [LinkedIn – Karya Company Page](https://in.linkedin.com/company/karya-inc)
4. [Greenhouse – Karya Careers Page](http://job-boards.greenhouse.io/karya)

## Other roles at Karya

- [Strategy & Operations Analyst](https://feeny.ai/job/strategy-operations-analyst-karya-bengaluru-gxfb4pddyzek) — Bengaluru, India
- [Technical Support & Solutions Associate - Platform-as-a-Service (PaaS)](https://feeny.ai/job/technical-support-solutions-associate-platform-as-a-service-paas-karya-bengaluru-4yrfyjr0ffxz) — Bengaluru, India
- [Lead - Public Policy](https://feeny.ai/job/lead-public-policy-karya-delhi-m0xke4tbwmpv) — Delhi, India
- [Community Coordinator - Work Management](https://feeny.ai/job/community-coordinator-work-management-karya-bengaluru-karnataka-india-delhi-x93npdqsjye0) — Bengaluru Karnataka India Delhi, India
- [Associate - Impact Program](https://feeny.ai/job/associate-impact-program-karya-bengaluru-karnataka-india-delhi-pm5qfxt5607p) — Bengaluru Karnataka India Delhi, India
- [Analytics Lead - Data, Measurement & Impact](https://feeny.ai/job/analytics-lead-data-measurement-impact-karya-bengaluru-xxx04k3v7x20) — Bengaluru, India
- [Lead Product Designer](https://feeny.ai/job/lead-product-designer-karya-bengaluru-cy2cs3ndzbza) — Bengaluru, India
- [Associate Product Manager](https://feeny.ai/job/associate-product-manager-karya-bengaluru-20aem90f6trf) — Bengaluru, India
- [Entrepreneur in Residence - Karya X](https://feeny.ai/job/entrepreneur-in-residence-karya-x-karya-bengaluru-fqxh6e87pxds) — Bengaluru, India
- [Customer Success Lead](https://feeny.ai/job/customer-success-lead-karya-bengaluru-xzqk6x171nbs) — Bengaluru, India