Overview — Apache Arrow Ballista documentation
The language is always only as good as its community. Let’s look at some of the existing open-source tools and frameworks built in and around Rust:
- DataFusion based on Apache Arrow: Apache Arrow DataFusion SQL Query Engine similar to Spark
- Polars: It’s a faster Pandas. Probably going to compete with DuckDB (?)
- Delta Lake Rust: A native Rust library
Data Engineering • Rust for Data Engineering

Cloudflare Containers just dropped with a lot of interesting tech – including a novel routing technique & leveraging Durable Objects.
I put together a deep dive comparing them with Rivet Containers and Fly Machines, give it a read ⬇️ https://t.co/eXyGz2VQGo
Expose Delta Tables via REST APIs
Git repo to test 3 architectures to expose delta tables via REST APIs. See also my blogpost here. Architectures can be described as follows:
Git repo to test 3 architectures to expose delta tables via REST APIs. See also my blogpost here. Architectures can be described as follows:
- Architecture A: Direct, Web App with DuckDB. In this architecture, APIs are directly connecting to the delta table and there is no layer in between. This implies that all data
GitHub - rebremer/expose-deltatable-via-restapi

How to process billions of rows in seconds?
ArcticDB.
• DataFrame database
• Proven petabyte-scale
• Used by hedge funds and Bloomberg
And it's free: https://t.co/8qPLIxZyFo
