Event News

Sease at Melbourne Search and Recommendation

Melbourne Search
and Recommendation

The group’s aim is to make the Meetup more welcoming to all search and recommendation developers, data scientists and researchers in Melbourne who are facing similar challenges — while maintaining a high level of technical depth.

Location: Melbourne (online)
Date: 29th June 2022 

// our talk

Dense Retrieval with
Apache Solr Neural Search

Neural Search is an industry derivation from the academic field of Neural information Retrieval. More and more frequently, we hear about how Artificial Intelligence (AI) permeates every aspect of our lives and this includes also software engineering and Information Retrieval.

In particular, the advent of Deep Learning introduced the use of deep neural networks to solve complex problems that could not be solved simply by an algorithm. Deep Learning can be used to produce a vector representation of both the query and the documents in a corpus of information. Search, in general, comprises of performing four primary steps:
– generate a representation of the query that describes the information need – generate a representation of the document that captures the information contained in it
– match the query and the document representations from the corpus of information
– assign a score to each matched document in order to establish a meaningful document ranking by relevance in the results.

With the Neural Search module, Apache Solr is introducing support for neural network based techniques that can improve these four aspects of search.

This talk explores the first official contribution of Neural Search capabilities available from Apache Solr 9.0(may 2022): Approximate K-Nearest Neighbor Vector Search for matching and ranking.

You will learn:
– how Approximate Nearest Neighbor (ANN) approaches work, with a focus on Hierarchical Navigable Small World Graph (HNSW)
– how the Apache Lucene implementation works
– how the Apache Solr implementation works, with the new field type and query parser introduced
– how to run KNN queries and how to use it to rerank a first stage pass Join us as we explore this new Apache Solr feature!

// slides
// our speaker

Alessandro Benedetti

Founder @ Sease
APACHE LUCENE/SOLR COMMITTER
APACHE SOLR PMC MEMBER
// video

Author

Lisa Biella

Lisa Biella is a creative digital marketer, geek at heart who is enthusiastic about technology and how it affects people’s lives.

Leave a comment

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.