Storm in the stratosphere: how the cloud will be reshuffled
> There was one major architectural difference of Snowflake vs Redshift. A very underappreciated tech shift is how much faster networks got around that time. Up until that point, the wisdom was “move compute to data”, but Snowflake bet early on a full decoupling.
This has been something that's hugely interested me I think ever since I heard the Jeff Rothschild episode of On The Metal. It was that podcast's host, Bryan Cantrill, whose 'Manta' storage system was one of these "move compute to data" systems.
In software, new systems/frameworks/vendors need to be around 10x better for big corps to switch, and I think the lower level hardware & systems layers are where big gains are made that go unnoticed by many developers who operate way up high in web dev land.
In that On The Metal episode, Rothschild suggests that non-volatile RAM could be a hardware-level evolution that causes a lot of re-building up the DB & application stack.