LLMs, RAG, & the missing storage layer for AI

LanceDB

LanceDB is an open-source vector database for AI that's designed to store, manage, query and retrieve embeddings on large-scale multi-modal data. The core of LanceDB is written in Rust 🦀 and is built on top of Lance, an open-source columnar data format designed for performant ML workloads and fast random access.

Both the database and the un... See more

📦 Service Deployment - Ray Serve (https://lnkd.in/eAV-Y6RN)

🧰 Data Transformation - Ray Data (https://lnkd.in/e7wYmenc)

🔌 LLM Integration - AIConfig (https://lnkd.in/esvH5NQa)

🗄 Vector Database - Weaviate (https://weaviate.io/)

📚 Supervised LLM Fine-Tuning - HuggingFace TLR (https://lnkd.in/e8_QYF-P)

📈 LLM Observability - Weights & Biases Tra... See more

VectorDB-recipes

Dive into building GenAI applications! This repository contains examples, applications, starter code, & tutorials to help you kickstart your GenAI projects.

• These are built using LanceDB, a free, open-source, serverless vectorDB that requires no setup .


• It integrates into python data ecosystem so you can simply start using these

... See more