prompt caching is the most bang for buck optimisation you can do for your LLM based workflows and agents. in this post, i cover tips to hit the prompt cache more consistently and how it works under the hood (probably the first such resource)
https://t.co/0zi6sBCvU2 https://t.co/woCzOn02at