Every information retrieval practitioner has struggled with the task of evaluating how well a search engine is satisfying the user’s information needs.
Improving the correctness and effectiveness of a search system requires a set of tools that help to measure such aspects. Back in 2018, Rated Ranking Evaluator(RRE) came to the rescue.
RRE is an open-source search quality evaluation tool that can be used to produce a set of reports about the quality of a system, iteration after iteration, and that can be integrated within a continuous integration infrastructure to monitor quality metrics after each release.
Many aspects remained problematic though:
– how to directly evaluate a middle layer search-API that communicates with Apache Solr or Elasticsearch?
– how to easily generate explicit and implicit ratings without spending hours on tedious json files?
– how to better explore the evaluation results? with nice widgets and interesting insights?
Rated Ranking Evaluator Enterprise solves these problems and much more.