Metadata
- Author: Jordan Tigani
- Full Title:: The Simple Joys of Scaling Up
- Category:: 🗞️Articles
- URL:: https://motherduck.com/blog/the-simple-joys-of-scaling-up/
- Finished date:: 2023-05-19
Highlights
Google published a series of three papers in rapid succession that changed the way people build and scale software systems. These papers were GFS (2003) which tackled storage, MapReduce (2004) which handled computation, and BigTable (2006) which had the rudiments of a database (View Highlight)
their scale-out query engine Dremel, which became BigQuery (View Highlight)
The Dremel paper, written in 2008, included some benchmarks running a 3,000 node Dremel system against an 87 TB dataset. Today you can get equivalent performance on a single machine (View Highlight)