Staff Software Engineer, Search Measurement

About the Role

Uber is seeking a tech lead for the Delivery Search Measurement Platform team.

This team owns result quality and relevance measurement for Delivery Search, across the online food delivery, grocery, and retail business verticals. Search Measurement is the most direct, scalable way we have to evaluate the impact of our efforts to improve search result quality and the understand trajectory of search quality over time. It is critical path for all Search development across query understanding, retrieval, and ranking.

---- What the Candidate Will Do ----

As tech lead, you will drive the overall roadmap and evolution of the Search Measurement Platform. This will include:

1. 10x to 100x scaling of end-to-end Measurement throughput to support pervasive use of measurement throughout the development lifecycle. This includes scaling LLM calls for relevance assessment, scaling query result collection from the Search system, and integrating log-based measurement techniques.
2. Designing and implementing integrated result debugging features to scalably trace quality improvements and regressions to representative queries and responsible system components.
3. Aligning and driving "measurability" features throughout the Search stack, e.g., to better isolate Measurement requests from live user requests, and to better support Measurement control over how search queries are processed.
4. Aligning and streamlining our shared development lifecycle with partner teams, including Machine Learning Engineers.
5. Taking platform stability, observability, and Measurement result accuracy to the next level.

1. BS, MS, or Ph.D in Computer Science or a related technical discipline (or equivalent experience).
2. 7+ years of experience designing and building distributed systems, including experience working with data-intensive systems and pipelines.
3. Track record of driving a team's roadmap against product and business objectives. Strong experience with cross-team collaboration.
4. Track record of growing your teammates' capabilities through project assignment and mentorship.

1. Experience building Search systems and/or Search Measurement systems.
2. Specific data pipeline, statistical, and/or ML experience.
3. Previous success managing cross-timezone collaboration effectively.