Member of Technical Staff (Search Quality Analyst) at Perplexity (Belgrade, Serbia)
Perplexity· Belgrade, Serbia·
Role details
Perplexity at a glance
AI-powered answer engine that returns real-time, cited answers, now expanding into an agentic browser and on-device agents.
Perplexity runs an AI answer engine that searches the live web and returns direct, cited answers instead of a page of links. It has extended that core into an AI browser (Comet), an on-device agent (Computer), a developer API, and vertical tools like patent search.
$1.7B raised · latest: Series E extension · $200M · 2025 (reported $20B valuation) · backed by Accel, IVP, NEA, SoftBank Vision Fund 2
Job description
Perplexity is looking for an experienced analyst to help us build and improve our core search technologies. You'll work at the intersection of data analysis and engineering - designing metrics, building data pipelines, and improving the quality of our search and answer systems.
This role is hybrid in Belgrade, London or Berlin.
Responsibilities
- Find and diagnose quality issues in our search pipeline
- Design metrics from scratch to track and measure search quality
- Build datasets for model training, including LLM-as-a-judge labeling pipelines
- Improve search snippet quality and page selection algorithms for indexing
- Design and analyze A/B experiments to validate improvements
Qualifications
- 4+ years of experience as a data analyst or in a related role
- Strong coding skills — expected to write production-grade code at a mid-level backend engineer level
- Proficiency with SQL and Python
- Demonstrated hands-on experience with at least one of the following:
- Designing metrics from scratch (not just analyzing existing A/B experiments)
- Building labeling pipelines using LLM-as-a-judge
- Training ML models that shipped to production with measurable metric improvements
- Designing evals with known ground truth (e.g. SimpleQA, BrowseComp) or driving meaningful improvements on such evals
Nice to have
- Experience working on search-related products
- Knowledge of statistics and A/B experiment design
- Experience with Apache Spark or Databricks
Why work at Perplexity
- Culture & Environment: “Thoughtful support” culture with emphasis on craftsmanship, ownership, entrepreneurship, scholarship, and partnership. Hybrid schedule (4 days in-office) based on location.
- Perks: Daily catered meals (breakfast, lunch, dinner in office), office snacks, ride home program, commuter benefits, home office reimbursement, fitness classes, gym memberships.
- Compensation & Benefits: Competitive salary and equity packages; retirement plans with company match; flexible PTO; holiday shutdown between Christmas and New Year; 12 weeks paid bonding leave; comprehensive health, dental, and vision insurance.
- Relocation & Visa Support: Relocation assistance and visa/green card sponsorship for eligible roles. Partners with immigration firm to support the process.
- Engineering Excellence: “Technical assessment for relevant roles”; values hands-on contribution, broad skill sets, and merit-based evaluation. Frequent Tech Talks and exposure to greenfield AI research problems.