6 Hard Problems Scaling Vector Search
rockset.com
6 Hard Problems Scaling Vector Search
How would you build a modern Search Engine using Embeddings and Transformer models? Here is an article on how @wilsonzlin build a web search engine in two months, capable of indexing 280 million pages with 3 billion embeddings.
The Ingest process (simplified):
1. Crawl raw HTML page and normalize to extr... See more