Sublime
An inspiration engine for ideas
a thread w/ 16 fully-tested Zod codecs to copy/paste into your app
✅ stringTo(Number|Int|BigInt)
✅ numberToBigInt
✅ isoDatetimeToDate
✅ epoch{Seconds|Millis}ToDate
✅ utf8ToBytes
✅ bytesToUtf8
✅... See more
colinhacks/zodx.comPDFs are satan’s file format.
Almost everyone that builds RAG needs to deal with them - and it sucks.
Solutions on the market are either too slow, too expensive or not OSS.
It should be easier. Which is why we’re open sourcing https://t.co/0gCZxzbkWu
Ishaan Kapoorx.comSwift (Vapor)
The main problem with Solana development is the inherent asymmetry between programming the write and read layers. My hot take is that in the ideal world, no blockchain application team needs to host any backend servers.
Writing Solana programs is quite expressive. You are provided with an unopinionated canvas to define... See more
Jarry Xiaox.comFor low throughput data, Grab uses Parquet with Copy on Write (CoW) .
Here's the main operations for Copy on Write:
Here's the main operations for Copy on Write:
- Write Operations - Whenever there's a write, you create a new version of the file that includes the latest change. You can also keep the previous version for consistency and rollback purposes. This helps prevent data corruption,
The Architecture of Grab's Data Lake
Just finished the Billion Row Challenge in Go. Had to process a billion temperature readings and honestly the whole thing was a pain in the arse but whatever
So the problem is you've got this 14GB file with a billion lines and you need to calculate min/max/average temps for each weather station. Most people probably... See more
What I Learned This Week...
- File systems lie! OS write buffers improve performance but risk data loss on crashes. Explicitly flushing write buffers ensures durability at a cost.
- Rust's compiler uses static analysis to ensure exclusive write access to each element in a data structure,... See more