GitHub - NVIDIA/NeMo-Curator: Scalable toolkit for data curation

Many of these projects are saving time by training on small, highly curated datasets. This suggests there is some flexibility in data scaling laws. The existence of such datasets follows from the line of thinking in Data Doesn't Do What You Think, and they are rapidly becoming the standard way to do training outside Google

Nomic Atlas Python Client

Explore, label, search and share massive datasets in your web browser.

This repository contains Python bindings for working with Nomic Atlas, the world’s most powerful unstructured data interaction platform. Atlas supports datasets from hundreds to tens of millions of points, and supports data modalities ranging from text ... See more

Curation is where data context (e.g. who the creator is, type of media, or who has engaged with an NFT) meets social context (read: how culture engages with the NFT and its surroundings).