Search Quality Analyst
Role Overview
This senior-level role involves analyzing user behavior and A/B test data to improve search technologies at Perplexity. The analyst will design metrics, build dashboards, and develop data pipelines, working closely with product and engineering teams to enhance ranking quality and accelerate product adoption.
Perks & Benefits
The job is fully remote, likely with flexible hours, though some collaboration across time zones may be expected. It offers opportunities for career growth in data analysis and search technology, with a focus on innovation using LLMs and advanced tools in a tech-driven environment.
Full Job Description
Perplexity is looking for an experienced data analyst to accelerate the development of advanced search technologies. You will identify robust and sensitive signals from user behavior to help us gather insights from A/B experiment data more efficiently.
Responsibilities
Develop data-driven insights from user behavior to inform our product roadmap and accelerate adoption
Formulate hypotheses and validate them by designing, running, and analyzing A/B tests
Determine appropriate metrics and visualizations for tracking, and implement them in dashboards
Design new pipelines that will help to deliver better ranking quality. From discovering new signals, producing metrics and construct data labeling pipelines with human and LLM feedback.
Qualifications
4+ years of experience working as a data analyst or in a related role
Experience working on search-related products, with emphasis on designing online metrics and analyzing A/B experiments
Strong Python skills (expected to write production-grade code)
Proficiency with SQL
Experience with Business Intelligence (BI) tools
Deep knowledge of statistics
Preferred Qualifications
Proficiency with Apache Spark
Experience with Databricks
Experience with development of LLM-as-a-judge systems
Similar jobs
Found 6 similar jobs