GitHub - vi3k6i5/flashtext: Extract Keywords from sentence or Replace keywords in sentences.
A simple technique makes RAG ~32x memory efficient!
- Perplexity uses it in its search index
- Azure uses it in its search pipeline
- HubSpot uses it in its AI assistant
Let's understand how to use it in RAG systems (with code):
Avi Chawlax.comMade myself a research tool
Claude makes flash cards from passages I highlight
Reduces the friction of using spaced repetition. Sharing in case helpful to you!
generateflash dot cards https://t.co/s15SvEeTv5
Dwarkesh Patelx.comAlthough there are already many methods available for keyword generation (e.g., Rake, YAKE!, TF-IDF, etc.) I wanted to create a very basic, but powerful method for extracting keywords and keyphrases. This is where KeyBERT comes in! Which uses BERT-embeddings and simple cosine similarity to find the sub-phrases in a document that are the most... See more
MaartenGr • GitHub - MaartenGr/KeyBERT: Minimal keyword extraction with BERT
Text is the most ubiquitous and the least user-friendly interface to information that we have. We have plots, we have graphs, we have tables. All of these are great. They are optimized for various different kinds of things for different uses.
Text is not optimized for anything at all. It's just a thing that we inherited from 3,000 years ago, and we
... See more