Sublime
An inspiration engine for ideas
Design
Pritesh • 4 cards
Diagrams
Cyrus Chen • 11 cards
design

Building long context RAG from scratch with RAPTOR + Claude3 (Video)
The rise of long context LLMs + embeddings will change RAG design. Instead of splitting docs + indexing doc chunks, it's feasible to index full docs.
But, there is a challenge to flexibly answer lower-level questions from... See more
Structure
Johannes Herseni • 1 card
References
Erika • 2 cards
🔟 Traditional RAG vs HyDE
Questions are not semantically similar to answers, so the system may retrieve irrelevant context.
In HyDE, first generate a hypothetical answer (H) to query. Then, use (H) to retrieve relevant context (C).
I wrote a detailed thread about... See more
Avi Chawlax.com1: Architect products; evolve from projects to products. Architecting products is more efficient than just designing point solutions to projects and focuses the team on its customers. Principle 2: Focus on quality attributes, not on functional requirements. Quality attribute requirements drive the architecture. Principle 3: Delay design decisions
... See more