All-in-SQL Hybrid Search in DuckDB: Integrating Full Text and Embedding Methods

This post explores integrating Full Text Search (FTS) and Embedding Search to create a Hybrid Search system in DuckDB. It details the methods and SQL implementations used to combine these search techniques, focusing on the need for exact keyword matching and semantic understanding. The post also covers how to rank documents using Reciprocal Ranked Fusion and Convex Combination metrics, providing examples using the Kaggle Movies dataset.