If you are pursuing a fully local RAG setup, you will want to make sure there's no performance gap vs. using API-gated models like OpenAI. And a good way to improve performance here is to add a reranker.
This repo by @MountainMicky shows you how to build a fully local RAG setup with reranking, and also highlights qualit... See more