Nicolay Gerold

The Mac Studio is an absolute monster for inferencing; but there are a couple of caveats.

• Its slower, pound for pound, than a 4090 when dealing with models the 4090 can fit in its VRAM. So a 13b model on the 4090 is almost twice as fast as it running on the M2.


• The M1 Ultra Mac Studio with 128GB costs far less ($3700 or so) and the inference speed is

... See more

Fast-csv

Fast-csv is library for parsing and formatting CSVs or any other delimited value file in node.

Features

• CSV Formatting


• CSV Parsing


• Built using typescript.


• Flexible formatting and parsing options, to fit almost any scenario.


• Built with streams first to avoid creating large memory footprint when parsing large files.


• Battle tested in production,

... See more

Denormalization

Another way Reddit minimizes joins is by using denormalization.

They took all the metadata fields required for displaying an image post and put them together into a single JSONB field. Instead of fetching different fields and combining them, they can just fetch that single JSONB field.

This made it much more efficient to fetch all the... See more

When it comes to adding drag and drop to your application, you almost certainly need a third-party library. The most popular choice in the past has been React Beautiful DnD. As of 2024, it is no longer receiving regular updates.

Going forward, a solid replacement for drag and drop is to use DnD Kit . It’s lightweight, very flexible, and the... See more

My basic view is that inference will not get that much more expensive. The basic logic of the scaling laws is that if you increase compute by a factor of n, you need to increase data by a factor of the square root of n and the size of the model by a factor of square root of n. That square root basically means that the model itself does not get that... See more

For low throughput data, Grab uses Parquet with Copy on Write (CoW) .

Here's the main operations for Copy on Write:

• Write Operations - Whenever there's a write, you create a new version of the file that includes the latest change. You can also keep the previous version for consistency and rollback purposes. This helps prevent data corruption,

... See more

The vagus is one connection between brain and body and helps regulate our emotional states. It is connected to most organs and to its sensory receptors and to the brain. It also allows the brain to send motor communications. It acts through a two-way communication. It analyzes many features of the body and tells the brain how to feel about them and... See more

Great Tables

Absolutely Delightful Table-making in Python

With Great Tables anyone can make wonderful-looking tables in Python. The philosophy here is that we can construct a wide variety of useful tables by working with a cohesive set of table components. You can mix and match things like a header and footer , attach a stub (which contains row... See more