Building software

Cloudflare serves around 20% of the web with 46 million requests a second. Surely they must have a lot of data. Where do they store it? Plain old PostgreSQL. 🐘 Around 15-20 clusters of them. Each cluster... See more

1. The number of partitions is fixed at the time of the index creation. Each partition is an indivisible chunk of data which can grow in size but not be split into smaller chunks. As the data grows, more nodes may be added to the cluster, but the number of partitions which eventually move to the newer nodes are limited (Fig 3)


2. In some sense, as the

... See more