LOG IN
SIGN UP
Tech Job Finder - Find Software, Technology Sales and Product Manager Jobs.
Sign In
OR continue with e-mail and password
E-mail address
Password
Don't have an account?
Reset password
Join Tech Job Finder
OR continue with e-mail and password
E-mail address
First name
Last name
Username
Password
Confirm Password
How did you hear about us?
By signing up, you agree to our Terms & Conditions and Privacy Policy.

Search Quality Analyst

at Perplexity AI

Back to all Data Engineering jobs
Perplexity AI logo
Industry not specified

Search Quality Analyst

at Perplexity AI

Mid LevelNo visa sponsorshipData Engineering

Posted 12 hours ago

No clicks

Compensation
Not specified

Currency: Not specified

City
London, Berlin
Country
United Kingdom, Germany

Perplexity is looking for an experienced Search Quality Analyst to help design metrics, build data pipelines, and improve the quality of our search and answer systems. You will diagnose quality issues in the search pipeline, create metrics from scratch, and design and analyze A/B experiments to validate improvements. You will also build datasets for model training (including LLM-as-a-judge labeling pipelines) and work on snippet quality and page selection for indexing. This hybrid role is based in London or Berlin (with Belgrade mentioned in the posting).

Perplexity is looking for an experienced analyst to help us build and improve our core search technologies. You'll work at the intersection of data analysis and engineering — designing metrics, building data pipelines, and improving the quality of our search and answer systems.

This role is hybrid in Belgrade, London or Berlin.

Responsibilities

  • Find and diagnose quality issues in our search pipeline

  • Design metrics from scratch to track and measure search quality

  • Build datasets for model training, including LLM-as-a-judge labeling pipelines

  • Improve search snippet quality and page selection algorithms for indexing

  • Design and analyze A/B experiments to validate improvements

Qualifications

  • 4+ years of experience as a data analyst or in a related role

  • Strong coding skills — expected to write production-grade code at a mid-level backend engineer level

  • Proficiency with SQL and Python

  • Demonstrated hands-on experience with at least one of the following:

  • Designing metrics from scratch (not just analyzing existing A/B experiments)

  • Building labeling pipelines using LLM-as-a-judge

  • Training ML models that shipped to production with measurable metric improvements

  • Designing evals with known ground truth (e.g. SimpleQA, BrowseComp) or driving meaningful improvements on such evals

Preferred Qualifications

  • Experience working on search-related products

  • Knowledge of statistics and A/B experiment design

  • Experience with Apache Spark or Databricks



Search Quality Analyst

at Perplexity AI

Back to all Data Engineering jobs
Perplexity AI logo
Industry not specified

Search Quality Analyst

at Perplexity AI

Mid LevelNo visa sponsorshipData Engineering

Posted 12 hours ago

No clicks

Compensation
Not specified

Currency: Not specified

City
London, Berlin
Country
United Kingdom, Germany

Perplexity is looking for an experienced Search Quality Analyst to help design metrics, build data pipelines, and improve the quality of our search and answer systems. You will diagnose quality issues in the search pipeline, create metrics from scratch, and design and analyze A/B experiments to validate improvements. You will also build datasets for model training (including LLM-as-a-judge labeling pipelines) and work on snippet quality and page selection for indexing. This hybrid role is based in London or Berlin (with Belgrade mentioned in the posting).

Perplexity is looking for an experienced analyst to help us build and improve our core search technologies. You'll work at the intersection of data analysis and engineering — designing metrics, building data pipelines, and improving the quality of our search and answer systems.

This role is hybrid in Belgrade, London or Berlin.

Responsibilities

  • Find and diagnose quality issues in our search pipeline

  • Design metrics from scratch to track and measure search quality

  • Build datasets for model training, including LLM-as-a-judge labeling pipelines

  • Improve search snippet quality and page selection algorithms for indexing

  • Design and analyze A/B experiments to validate improvements

Qualifications

  • 4+ years of experience as a data analyst or in a related role

  • Strong coding skills — expected to write production-grade code at a mid-level backend engineer level

  • Proficiency with SQL and Python

  • Demonstrated hands-on experience with at least one of the following:

  • Designing metrics from scratch (not just analyzing existing A/B experiments)

  • Building labeling pipelines using LLM-as-a-judge

  • Training ML models that shipped to production with measurable metric improvements

  • Designing evals with known ground truth (e.g. SimpleQA, BrowseComp) or driving meaningful improvements on such evals

Preferred Qualifications

  • Experience working on search-related products

  • Knowledge of statistics and A/B experiment design

  • Experience with Apache Spark or Databricks



SIMILAR OPPORTUNITIES

No similar jobs available at the moment.