Overview
Learn how to train sentence transformers using the GenQ technique for improved dense retrieval in semantic search. Explore the challenges of fine-tuning bi-encoders and discover how GenQ leverages text generation to create synthetic training data. Dive into the process of augmenting passages with synthetic queries, understand asymmetric semantic search, and master T5 query generation. Follow along with a comprehensive code walkthrough for implementing GenQ and fine-tuning bi-encoders. Gain insights into overcoming data scarcity and enhancing retriever performance in this informative video tutorial.
Syllabus
Intro
Why GenQ?
GenQ Overview
Training Data
Asymmetric Semantic Search
T5 Query Generation
Finetuning Bi-encoders
GenQ Code Walkthrough
Finetuning Bi-encoder Walkthrough
Final Points
Taught by
James Briggs