Search
CASE STUDY

Optimising Complex Statistical Data Discovery with AI-Powered Search

The Client

The Bank for International Settlements (BIS) is the oldest international financial institution, established in 1930.
Its mission is to support central banks’ pursuit of monetary and financial stability through international cooperation, and to act as a bank for central banks.

BIS maintains a search engine called BIS Data Portal that makes available statistics, compiled in cooperation with central banks and other national authorities, designed to inform analysis of financial stability, international monetary spillovers, and global liquidity.

The Problem

Some users of the BIS Data Portal have reported that certain specific queries return zero results. BIS therefore intends to address this issue by improving the search engine’s understanding of queries, making them more specific and targeted. Within this scope, they also recognise in the current proliferation of Large Language Models an opportunity to expand the current data portal capabilities.

The Solution

In response to the BIS requirements, Sease adopted a multi-phase approach to address the issue, beginning with an Exploration & Discovery to assess the current state of their Solr search engine and identify potential improvements, followed by an in-depth study of the requirements and the subsequent design of a Proof of Concept solution that included both development and evaluation.

Exploration & Discovery

Over the years, we have refined how to face these scenarios, and the formula we have designed is a set of online and offline activities with the scope of understanding the client search system and giving immediate value through a systematic audit.

The main focus of the Exploration & Discovery phase is to give immediate value to the client, highlighting what they are doing well and what can be done better in terms of processes, architecture, configuration, and usage.

Once team dynamics, communication protocols, and software engineering practices are clarified, it’s time to get technical, so we reviewed the system architecture, Apache Solr schema and solrconfig configurations.
Analysing these aspects is strictly tied to the client’s requirements and how they expect their users to interact with the search engine.
In the specific case of BIS, we focused particularly on analyzing the structure of their queries, explaining how they currently work and how it was possible to resolve the problem they were facing—namely, their inability to obtain the desired results.

We studied the data and the queries, identifying and recommending any best practices in data modelling and building the best Solr query for each of their task. For this specific Exploration & Discovery, we also reviewed BIS’s repository content. This included additional configuration files, scripts, and Python code that interacts with Solr.

The outcome of this first package was a report structured with the following paragraphs:

  • Architecture and Deployment
  • Configurations (solrconfig.xml)
  • Data Model (schema.xml)
  • Queries
  • Search Quality Evaluation
  • Future Roadmap
  • Current Query Issues/Challenges
  • Repository Content

Each chapter has a short summary with the main takeaways and a list of paragraphs; each paragraph has an additional summary with the key takeaways and a long explanation.

It’s important to make the report readable. Along with the Exploration & Discovery, we carry out various calls to communicate the most important takeaways, but it’s vital to put them down in a clear and usable presentation that is nice for both the business and the technical reader.

Support for Natural Language Search Proof Of Concept

The purpose of this Proof of Concept was to demonstrate the feasibility of enhancing the user experience by supporting natural language queries to explore BIS statistical data.

Sease designed and developed the search API, the component that handled search requests from the user interface, interacted with the LLM, and constructed the Solr queries to get results. We implemented it using Python and Flask to develop a RESTful API.

Specifically, we implemented:

  1. Offline Dictionary generation to create a knowledge base to use with the LLM after, at query time (point 2).
  2. Requests management. User requests are taken from the UI through the search API, and the LLM has been called for two different purposes: to extract any filter related to the natural language query, and to generate alternative queries.
  3. Solr query. We designed a dedicated Solr query that exploits the metadata extracted from point 2 to get the best results.

The outcome of the POC was both the code and a report highlighting the promising aspects and the weaknesses of the proposed approach and implementation. We also described all the necessary steps to go to production.

We never run a Proof of Concept with the sole scope of convincing a client to go in that direction or chasing the mainstream: we genuinely design and implement the best solution in budget and evaluate thepromising aspects and weaknesses, offering a detailed plan of what it takes to bring it to production, if interesting enough.

AI Filtering Assistant for Production

In this project, Sease developed a service that suggests filter selections in the BIS data portal UI, starting from the user’s natural language query, exploiting Large Language Models.

The design and implementation consisted of:

  1. API definition and design: Explore the BIS search system to identify the best technologies to use to implement the service.
  2. Choice of the LLM: Explore the current state of the art of the Large Language Model landscape and select a model considering costs, model technical capabilities, and query time performance.
  3. Choice of the client library: Decide which library to use to interact with the LLM.
  4. Retrieval of filters: Design and implement the best way of extracting, retrieving, and caching filters in near real-time.
  5. Large Language Model Service: Design and implement a service that offers the capabilities of inference of an LLM.
  6. Prompt finalization and service implementation: Design and implement the internals of the Filter Assistant service, including prompt finalization and validations.
  7. Integration test cases: Design and implement a set of integration tests that present edge cases and filtering scenarios.

The final service flow consisted of:

  1. Building the dictionaries to use as a knowledge base to give as input to the Large Language Model.
  2. Exploiting the LLM to obtain the topics related to the user’s natural language query through a proper prompt.
  3. Exploiting the LLM to obtain the filters related to the user’s natural language query through a proper prompt.
  4. Optimizing the Solr query relying on the information obtained in the previous steps.
  5. Developing a test framework to evaluate the process. We did both a manual and an automatic evaluation through some pytests.

Also, in this case, a detailed report has been given as a deliverable. Containing for each point an in-depth explanation of what the requirement was, what was done, and why those decisions were made. This is very important also for the future, so that, even after some time has passed, the company can justify the decisions made, verify whether they still make sense and are valid, and, if necessary, consider new optimizations and additions.

The Workflow

Throughout the project lifecycle, Sease maintained a structured workflow, characterized by clear communication channels (web-call and e-mail) and iterative refinement. Regular updates and consultations ensured seamless collaboration between Sease and BIS, fostering alignment with project objectives and milestones.

Conclusions

Through this collaboration, Sease successfully transformed a critical user pain point—zero-result queries—into an opportunity for cutting-edge innovation. By combining a meticulous architectural audit with state-of-the-art AI integration, we didn’t just patch a search engine; we completely elevated how users interact with complex financial data.

The value delivered to the client spans three critical pillars:

  1. Immediate Search Optimization: Our technical audit and redesigned Solr architecture provided actionable data modeling strategies that instantly improved query precision and relevance.
  2. Production-Ready AI Innovation: By designing and implementing a production-grade AI Filtering Assistant and Natural Language Search API, we successfully brought Large Language Models out of the research phase and into a practical, high-performance architecture.
  3. A Future-Proof Roadmap: Instead of offering a black-box solution, we delivered comprehensive, transparent documentation and automated testing frameworks. This ensures the client retains full ownership of their system, with a clear, justifiable blueprint to scale and optimize their AI capabilities for years to come.

Ultimately, Sease equipped the client with a modernized, intelligent search ecosystem that eliminates user friction, unlocks the power of natural language discovery, and secures their position as a forward-thinking leader in data dissemination.

Modernize Your Search Experience

Every successful AI-powered search project starts with understanding the search system behind it. From search assessments and solution design to Proofs of Concept and production deployments, Sease helps organizations build intelligent search experiences that deliver measurable value.