Library

This is a collection of Slides, presentations and videos on topics related to designing of high throughput, scalable, highly available websites I’ve been collecting for a while.

8/28/2007 Blog   Inside Myspace
8/28/2007 FAQ   Good Memcached FAQ
8/28/2007 Blog   Measuring scalability
8/28/2007 Blog   Distributed caching with memcached
8/28/2007 Blog   Mailinator stats (all on a single server)
8/28/2007 Blog   Architecture of Mailinator
8/25/2007 Slides 74 Building Scalable web architectures
8/25/2007 Slides 42 Typepad Architecture change: Change Your Car’s Tires at 100 mph
8/25/2007 Slides   Skype protocol (also talks about p2p connections which is critical for its scalability)
8/20/2007 slides   Slashdot’s History of scaling Mysql
8/19/2007 Slides 20 Big Bad Postgres SQL
8/19/2007 Slides 90 Scalable internet architectures
8/19/2007 Slides 59 Production troubleshooting (not related to scalability… but shit happens everywhere)
8/19/2007 Slides 31 Clustered Logging with mod_log_spread
8/19/2007 Slides 86 Understanding and Building HA/LB clusters
8/12/2007 Blog   Multi-Master Mysql Replication
8/12/2007 Blog   Large-Scale Methodologies for the World Wide Web
8/12/2007 Blog   Scaling gracefully
8/12/2007 Blog   Implementing Tag cloud – The nasty way
8/12/2007 Blog   Normalized Data is for sissies
8/12/2007 Slides   APC at facebook
8/6/2007 Video   Plenty Of fish interview with its CEO
8/6/2007 Slides   PHP scalability myth
8/6/2007 Slides 79 High performance PHP
8/6/2007 Blog   Digg: PHP’s scalability and Performance
8/2/2007 Blog   Getting Started with Drupal
8/2/2007 Blog   4 Problems with Drupal
8/2/2007 Video 55m Seattle Conference on Scalability: MapReduce Used on Large Data Sets
8/2/2007 Video 60m Seattle Conference on Scalability: Scaling Google for Every User
8/2/2007 Video 53m Seattle Conference on Scalability: VeriSign’s Global DNS Infrastucture
8/2/2007 Video 53m Seattle Conference on Scalability: YouTube Scalability
8/2/2007 Video 59m Seattle Conference on Scalability: Abstractions for Handling Large Datasets
8/2/2007 Video 55m Seattle Conference on Scalability: Building a Scalable Resource Management
8/2/2007 Video 44m Seattle Conference on Scalability: SCTPs Reliability and Fault Tolerance
8/2/2007 Video 27m Seattle Conference on Scalability: Lessons In Building Scalable Systems
8/2/2007 Video 41m Seattle Conference on Scalability: Scalable Test Selection Using Source Code
8/2/2007 Video 53m Seattle Conference on Scalability: Lustre File System
8/2/2007 Slides 16 Technology at Digg.com
8/2/2007 Blog   Extreme Makeover: Database or MySQL@YouTube
8/2/2007 Slides 60 “Real Time
8/2/2007 Blog   Mysql at Google
8/2/2007 Slides 56 Scaling Twitter
8/2/2007 Slides 53 How we build Vox
8/2/2007 Slides 97 High Performance websites
8/2/2007 Slides 101 Beyond the file system design
8/2/2007 Slides 145 Scalable web architectures
8/2/2007 Blog   “Build Scalable Web 2.0 Sites with Ubuntu
8/2/2007 Slides 34 Scalability set Amazon’s servers on fire not yours
8/2/2007 Slides 41 Hardware layouts for LAMP installations
8/2/2007 Video 91m Mysql scaling and high availability architectures
8/2/2007 Audio 137 Lessons from Building world’s largest social music platform
8/2/2007 PDF 137 Lessons from Building world’s largest social music platform
8/2/2007 Slides 137 Lessons from Building world’s largest social music platform
8/2/2007 PDF 80 Livejournal’s backend: history of scaling
8/2/2007 Slides 80 Livejournal’s backend: history of scaling
8/2/2007 Slides 26 Scalable Web Architectures (w/ Ruby and Amazon S3)
8/2/2007 Blog   Yahoo! bookmarks uses symfony
8/2/2007 Slides   Getting Rich with PHP 5
8/2/2007 Audio   Getting Rich with PHP 5
8/2/2007 Blog   Scaling Fast and Cheap – How We Built Flickr
8/2/2007 News   Open source helps Flickr share photos
8/2/2007 Slides 41 Flickr and PHP
8/2/2007 Slides 30 Wikipedia: Cheap and explosive scaling with LAMP
8/2/2007 Blog   YouTube Scalability Talk
8/2/2007     High Order Bit: Architecture for Humanity
8/2/2007 PDF   Mysql and Web2.0 companies
8/3/2007   36 Building Highly Scalable Web Applications
8/3/2007     Introduction to hadoop
8/3/2007 webpage   The Hadoop Distributed File System: Architecture and Design
8/3/2007     Interpreting the Data: Parallel Analysis with Sawzall
8/3/2007 PDF   ODISSEA: A Peer-to-Peer Architecture for Scalable Web Search and Information Retrieval
8/3/2007 PDF   SEDA: An Architecture for well conditioned scalable internet services
8/3/2007 PDF   A scalable architecuture for Global web service hosting service
8/3/2007     Meed Hadoop
8/3/2007 Blog   Yahoo’s Hadoop Support
8/3/2007 Blog   Running Hadoop MapReduce on Amazon EC2 and Amazon S3
8/3/2007   53m LH*RSP2P : A Scalable Distributed Data Structure for P2P Environment
8/3/2007   90m Scaling the Internet routing table with Locator/ID Separation Protocol (LISP)
8/3/2007     Hadoop Map/Reduce
8/3/2007 Slides   Hadoop distributed file system
8/3/2007 Video 45m Brad Fitzpatrick – Behind the Scenes at LiveJournal: Scaling Storytime
8/3/2007 Slides   Inside LiveJournal’s Backend (April 2004)
8/3/2007 Slides 25 How to scale
8/3/2007   36m Testing Oracle 10g RAC Scalability
8/3/2007 Slides 107 PHP & Performance
8/3/2007 Blog   1217
8/3/2007   45m SQL Performance Optimization
8/3/2007   80m Building_a_Scalable_Software_Security_Practice
8/3/2007   59m Building Large Systems at Google
8/3/2007     Scalable computing with Hadoop
8/3/2007 Slides 37 The Ebay architecture
8/3/2007 PDF   Bigtable: A Distributed Storage System for Structured Data
8/3/2007 PDF   Fault-Tolerant and scalable TCP splice and web server architecture
8/3/2007 Video   BigTable: A Distributed Structured Storage System
8/3/2007 PDF   MapReduce: Simplified Data Processing on Large Clusters
8/3/2007 PDF   Google Cluster architecture
8/3/2007 PDF   Google File System
8/3/2007 Doc   Implementing a Scalable Architecture
8/3/2007 News   How linux saved Millions for Amazon
8/3/2007     Yahoo experience with hadoop
8/3/2007 Slides   Scalable web application using Mysql and Java
8/3/2007 Slides   Friendster: scalaing for 1 Billion Queries per day
8/3/2007 Blog   Lightweight web servers
8/3/2007 PDF   Mysql Scale out by application partitioning
8/3/2007 PDF   Replication under scalable hashing: A family of algorithms for Scalable decentralized data distribution
8/3/2007 Product   Clustered storage revolution
8/3/2007 Blog   Early Amazon Series
8/3/2007 Web   Wikimedia Server info
8/3/2007 Slides 32 Wikimedia Architecture
8/3/2007 Slides 21 MySpace presentation
8/3/2007 PDF   A scalable and fault-tolerant architecture for distributed web resource discovery
8/4/2007 PDF   The Chubby Lock Service for Loosely-Coupled Distributed Systems
8/5/2007 Slides 47 Real world Mysql tuning
8/5/2007 Slides 100 Real world Mysql performance tuning
8/5/2007 Slides 63 Learning MogileFS: Buliding scalable storage system
8/5/2007 Slides   Reverse Proxy and Webserver
8/5/2007 PDF   Case for Shared Nothing
8/5/2007 Slides 27 A scalable stateless proxy for DBI
8/5/2007 Slides 91 Real world scalability web builder 2006
8/5/2007 Slides 52 Real world web scalability