GitHub - cloudflare/pingora: A library for building fast, reliable and evolvable network services.

orch

orch is a library for building language model powered applications and agents for the Rust programming language. It was primarily built for usage in magic-cli, but can be used in other contexts as well.

Note

If the project gains traction, this can be compiled as an addon to other languages such as Python or a standalone WebAssembly module.

Instal... See more

Serverless Postgres (experimental)

Serverless Postgres using Oriole, Fly Machines, and Tigris for S3 Storage.

Overview

This is a MVP for Serverless Postgres.

1/ It uses Fly.io, which can automatically pause your database after all connections are released (and start it again when new connections join).

2/ It uses Oriole, a Postgres extension with expe... See more

Burrow

Burrow is a serverless and globally-distributed HTTP proxy for Go built on AWS Lambda.

It is designed to be completely compatible with the standard Go *http.Client which means it can be transparently added to many existing applications. Burrow provides an implementation of the http.RoundTripper interface that proxies requests through one or m... See more

The language is always only as good as its community. Let’s look at some of the existing open-source tools and frameworks built in and around Rust:

• DataFusion based on Apache Arrow: Apache Arrow DataFusion SQL Query Engine similar to Spark


• Polars: It’s a faster Pandas. Probably going to compete with DuckDB (?)


• Delta Lake Rust: A native Rust library fo

... See more

LoRAX (LoRA eXchange) is a framework that allows users to serve thousands of fine-tuned models on a single GPU, dramatically reducing the cost of serving without compromising on throughput or latency.

📖 Table of contents

• 📖 Table of contents


• 🌳 Features


• 🏠 Models


• 🏃‍♂️ Getting started with Docker
  
  
  • Launch LoRAX Server
  
  
  • Prompt via REST API
  
  
  • Prompt via Python

... See more

Infrastructure to exchange resources with unknown people and businesses.