Here are some of the posts on that blog
Powerset could have gone the way most dot-com companies have gone, but instead they decided to try out AmazonÃ¢â‚¬â„¢s EC2 (Elastic Cloud Computing) and S3(Simple Storage Service) to augment their computational needs.
Youtube is said to be pushing about 25 petabytes per month which is about 77 Gbps sustained data rate on an average. The bandwidth usage at the peaks would be even higher. Thanks to Limelight networks, Youtube doesnÃ¢â‚¬â„¢t really need to scale or provision for that kind of bandwidth and based on the some reports from 2006 it had cost them close to 4 million a month back then. Youtube and services like that have to invest a lot in their infrastructure before they can really launch their service and though using shared Content delivery networks is not ideal, its probably not a bad deal. In YoutubeÃ¢â‚¬â„¢s case, it helped them survive until Google bought it out.
Theo Schlossnagle, the author of Ã¢â‚¬Å“Scalable internet architecutresÃ¢â‚¬Â argues that federation is form of partitioning, and that sharding is nothing but a form of partitioning and federation. Infact, according to him, Sharding has already been in use use for a long time.
Eins.de site serves about 1.2 million dynamic pages a day. He wrote a series of articles describing how they redesigned the site to scale for growth. I found these articles very informative with a extreemly mature discussion of the colorful world of scalability.
If I could only give one recommendation to anyone building a brand new web application, IÃ¢â‚¬â„¢d say Ã¢â‚¬Å“go statelessÃ¢â‚¬Å“. But going stateless is not the same as going session-less. One could implement a perfectly stateless web architecture which still uses sessions to authenticate, authorize and track user activity. And to complicate matters further, when I say stateless, I really mean that the server should be stateless, not the client.
Loadbalancers, by definition, are supposed to solve performance bottlenecks by distributing or balancing load between different components its managing. Though you would normally find loadbalancers in front of a webserver, a lot of different individuals have found other interesting ways of using it.