// our training

Artificial Intelligence in Search Training

In this training you will learn how to design and implement intelligent natural language search leveraging Open Source software.
You will learn about language modelling, vector based search and how to integrate it with Apache Lucene/Solr and Elasticsearch.

Would you like to schedule a training for your Team?

Our trainings are meant for different targets ( business, developer and everything in between), and are individual/small groups/classroom-based.
We offer different levels of flexibility to make sure the training course will be a perfect fit for your requirements 

ON SITE OR REMOTE

LIVE OR RECORDED

FROM BEGINNER TO EXPERT

Skills You Will Gain

• How to integrate natural language processing techniques with your search engine
• How to use pre-trained language models and fine tune them for your specific use case
• The pros/cons of vector based search
• How to do that with Apache Lucene/Solr and Elasticsearch

Prerequisites

Basic understanding of Search Engines and Machine Learning

Intended Audience

Software Engineers, Data Scientists, Machine Learning passionates.

// Artificial Intelligence in Search Training

Our Trainers

Alessandro Benedetti

APACHE LUCENE/SOLR COMMITTER

Alessandro has been involved in designing and developing search-relevant solutions from 2010.
Over the years he has worked on various projects, with various open source technologies aiming to build search solutions able to satisfy the user information needs, often integrating such solutions with machine learning and artificial intelligence technologies.

// Artificial Intelligence in Search Training

Full Programme

Natural Language Processing

  • Introduction

  • NLP tasks useful for Search

  • Open Source Libraries Overview

  • Text and Speech Processing(Optical Character Recognition, Speech Recognition, Text to Speech, Tokenization)

  • Morphological Analysis(Stemming/Lemmatization, Part Of Speech Tagging)

  • Syntactic Analysis(Sentence Breaking)

  • Lexical Semantics(Named Entity Recognition and Linking, Sentiment Analysis, Word Sense Disambiguation)

  • Discourse(Coreference Resolution)

  • Implicit Semantic(Topic Segmentation and Recognition)

  • Higher Level Application(Automatic Summarization, Grammatical Error Correction, Machine Translation, Natural Language Understanding)

  • Hands on Exercises

Deep Learning for Search

  • A bit of history (challenges with exact matching, Deep Learning, semantic search)
  • Word Embeddings
  • Hands on Exercises: let’s start generating and using word embeddings
  • BERT and transformers
  • Hands on Exercises: let’s use BERT
  • Model fine-tuning (pairwise learning, Margin-MSE aka DistilBERT)
  • Hands on Exercises: Fine-tuning with pairwise learning
  • Similarity search of dense vectors
  • Hands on Exercises: Perform ANN search
  • Augmenting the inverted index (document expansion and emphasize important terms)
  • Hands on Exercises: performing document expansion

Vector Based Search

 

  • How Open Source Search Engines cover the functionality (Apache Lucene/Solr, Elasticsearch and Vespa)
  • Hands on Exercises: let’s run Vector-based search in Open Source search engines
Query Level
  • Query Intent Classification
  • Hands on Exercises: recognise the user intent with Open Source
  • Zero result queries
  • Hands on Exercises: improvement for zero result queries with Open Source backed techniques
Evaluation & Explainability
  • Measure your progress
  • Explainable artificial intelligence

    Feel free to contact us

    Your email address will not be published. Required fields are marked *

    "The course has certainly generated many interesting ideas, but first we have to fill some gaps.
    The positive feedback I had about your professionalism and skills in the areas of information retrieval and AI makes me think that you can definitely be an important partner for the growth and development of our products."
    Dario Rigolin
    Founder
    // artificial intelligence in search

    Where to start

    If you wish to be introduced to Artificial Intelligence applied to Search, we have written a series of blog posts about it, that may be a good start to this subject.