Ruchi Juneja
Ruchi works as a Sr. Data Scientist at MediaMarktSaturn in the Search ML team. For over a decade, she has immersed herself in the world of data science working on various business problems. The last eight years have truly defined her path to the fascinating realm of search. Her passion for search technologies has led her on a journey across various industries, from education to music and e-commerce, delving deep into the intricacies of search algorithms, specialising in vector search, search ranking and query understanding.
Sessions
Beyond LLM Judges: Deep Evaluation for Conversational Search
Talk
15. September 2026, 10:00 - 10:45
Main Stage
This talk presents a practical evaluation framework for an e-commerce conversational search assistant. In addition to a lightweight LLM-as-a-judge, we track additional metrics such as search term accuracy, filter precision and no-results rate. Learn how these signals surfaced concrete failure modes, guided our iterations and improved relevance.