How Levels.fyi Built Scalable Search with PostgreSQL
levels.fyi
How Levels.fyi Built Scalable Search with PostgreSQL
How to build a great search experience using hybrid search.
A combination of:
◇ fts, tsvector, pg_trgm
◇ Structured output to narrow down (filters, date-range etc) https://t.co/y8YoDdTn6G
This snippet from the Lex Fridman interview with Aravind Srinivas makes me bullish about Perplexity.
This is great (and technical) insight from a CEO.
There’s insane amount of domain knowledge you need to work on this and it takes a lot of time to build up towards a highly really good... See more
This is, by far, one of the best uses of modern AI.
If you don't use embeddings when querying your database, you are definitely leaving a lot on the table.
In this video, I'll show you how to run semantic searches using OpenAI and PostgreSQL. It's all thanks to Pgai, an open-source... See more
Santiagox.com
Hybrid search: combine embeddings + FTS for solid matching
◇ Drizzle ORM
◇ PgVector
◇ gemini-embedding-001 https://t.co/rMvsAZt0mm
- ClickHouse: It's a high performance columnar database that's great for real time queries. It enables querying and storing large amounts of data on commodity hardware. Some of my customers have millions of page views and I don't have an unlimited budget, so it's been very handy.
- PostgreSQL: My favorite database. Sane defaults, battle-tested, and well