GitHub - Portkey-AI/gateway: A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API.

Portkey's AI Gateway is the interface between your app and hosted LLMs. It streamlines API requests to OpenAI, Anthropic, Mistral, LLama2, Anyscale, Google Gemini and more with a unified API.

✅ Blazing fast (9.9x faster) with a tiny footprint (~45kb installed)

✅ Load balance across multiple models, providers, and keys

✅ Fallbacks make sure your app ... See more