Polars — Processing hundreds of GBs of textual data on a daily basis at MDPI
pola.rs
Polars — Processing hundreds of GBs of textual data on a daily basis at MDPI
Polars
pola.rs
Century-Scale Storage
lil.law.harvard.edu
The language is always only as good as its community. Let’s look at some of the existing open-source tools and frameworks built in and around Rust:
- DataFusion based on Apache Arrow: Apache Arrow DataFusion SQL Query Engine similar to Spark
- Polars: It’s a faster Pandas. Probably going to compete with DuckDB (?)
- Delta Lake Rust: A native Rust library
Data Engineering • Rust for Data Engineering
On a Modern Dun & Bradstreet