LLM-Stack

dstackai GitHub - dstackai/dstack: dstack is an open-source toolkit for running GPU workloads on any cloud. It works seamlessly with any cloud GPU providers. Discord: https://discord.gg/u8SmfwPpMd

Portkey-AI GitHub - Portkey-AI/gateway: A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API.

lastmile-ai GitHub - lastmile-ai/aiconfig: aiconfig -- config-driven, source control friendly AI application development

Oxen-AI GitHub - Oxen-AI/oxen-release: Official repository for docs and releases of the Oxen CLI

GitHub - confident-ai/deepeval: The LLM Evaluation Framework

VikParuchuri GitHub - VikParuchuri/marker: Convert PDF to markdown quickly with high accuracy

LanceDB - LanceDB

Monitoring

GitHub - run-llama/llama-hub: A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain