When Guessing Isn’t Good Enough

Anything that requires exact recall is likely to result in a hallucination, though giving AI the ability to use outside resources, like web searches, might change this equation.

And so too will many questions we wouldn’t dream of asking now: A screenwriter could ask some future search engine, “Find a short story involving the leader of one country being an agent of another, for screen adaptation.” An amateur astronomer could ask, “When’s the next time that Jupiter’s Great Red Spot will be visible?,”

Retrieval can be improved by contextual compression, a technique where retrieved documents are compressed, and irrelevant information is filtered out.

By integrating tools together with explicit reasoning steps instead of pure pattern completion, our agent can tackle problems requiring abstraction and imagination, and can arrive at a complex understanding of the world enabling them to hold more meaningful conversations about complex concepts.