Semantic Search and RAG - a Powerful Combination by Seth Carney — EQengineered

Sounds fancy. Why do we care? GAR involves taking the source documents and having an LLM enrich them, prior to indexing. For example, the LLM might... * Generate titles for documents that are missing them * Standardize author names/formats* Extract dates, URLs, citations and other elements that might be valuable to search as separate fields* Create... See more

RAG, which stands for "Retrieval Augmented Generation," is a strategy in artificial intelligence where a large language model (LLM) retrieves relevant information from an external knowledge base (like a database or document collection) before generating a response to a user query, ensuring the response is more accurate and contextually relevant by ... See more

• Query the RAG anyway and let the LLM itself chose whether to use the the RAG context or its built in knowledge


• Query the RAG but only provide the result to the LLM if it meets some level of relevancy (ie embedding distance) to the question


• Run the LLM both on it's own and with the RAG response, use a heuristic (or another LLM) to pick the best answer

... See more