Talks and slides from various web architects

For latest set of links go here.

This is a collection of various slides, pdfs and videos about designing scalable websites I collected time. If you have something interesting which might go in here, please let me know.


















































































































































































































































































































































































































































































DateTypeTitle
6/23/2007BlogGetting Started with Drupal
6/23/2007Blog4 Problems with Drupal
6/23/2007VideoSeattle Conference on Scalability: MapReduce Used on Large Data Sets
6/23/2007VideoSeattle Conference on Scalability: Scaling Google for Every User
6/23/2007VideoSeattle Conference on Scalability: VeriSign's Global DNS Infrastucture
6/23/2007VideoSeattle Conference on Scalability: YouTube Scalability
6/23/2007VideoSeattle Conference on Scalability: Abstractions for Handling Large Datasets
6/23/2007VideoSeattle Conference on Scalability: Building a Scalable Resource Management
6/23/2007VideoSeattle Conference on Scalability: SCTPs Reliability and Fault Tolerance
6/23/2007VideoSeattle Conference on Scalability: Lessons In Building Scalable Systems
6/23/2007VideoSeattle Conference on Scalability: Scalable Test Selection Using Source Code
6/23/2007VideoSeattle Conference on Scalability: Lustre File System
6/9/2007SlidesTechnology at Digg.com
6/9/2007BlogExtreme Makeover: Database or MySQL@YouTube
4/26/2007BlogMysql at Google
4/1/2007SlidesScaling Twitter
4/1/2007SlidesHow we build Vox
4/1/2007SlidesHigh Performance websites
4/1/2007SlidesBeyond the file system design
4/1/2007SlidesScalable web architectures
3/1/2007SlidesScalability set Amazon's servers on fire not yours
3/1/2007SlidesHardware layouts for LAMP installations
3/1/2007VideoMysql scaling and high availability architectures
3/1/2007AudioLessons from Building world's largest social music platform
3/1/2007PDFLessons from Building world's largest social music platform
3/1/2007SlidesLessons from Building world's largest social music platform
11/1/2006PDFLivejournal's backend: history of scaling
11/1/2006SlidesLivejournal's backend: history of scaling
11/1/2006SlidesScalable Web Architectures (w/ Ruby and Amazon S3)
10/26/2006BlogYahoo! bookmarks uses symfony
7/26/2006SlidesGetting Rich with PHP 5
7/26/2006AudioGetting Rich with PHP 5
3/7/2006BlogScaling Fast and Cheap - How We Built Flickr
3/1/2005NewsOpen source helps Flickr share photos
 SlidesFlickr and PHP
 SlidesWikipedia: Cheap and explosive scaling with LAMP
 BlogYouTube Scalability Talk
  High Order Bit: Architecture for Humanity
 PDFMysql and Web2.0 companies
8/3/2007 Building Highly Scalable Web Applications
8/3/2007 Introduction to hadoop
8/3/2007webpageThe Hadoop Distributed File System: Architecture and Design
8/3/2007 Interpreting the Data: Parallel Analysis with Sawzall
8/3/2007PDFODISSEA: A Peer-to-Peer Architecture for Scalable Web Search and Information Retrieval
8/3/2007PDFSEDA: An Architecture for well conditioned scalable internet services
8/3/2007PDFA scalable architecuture for Global web service hosting service
7/25/2007 Meed Hadoop
7/25/2007BlogYahoo's Hadoop Support
7/18/2007BlogRunning Hadoop MapReduce on Amazon EC2 and Amazon S3
6/22/2007 LH*RSP2P : A Scalable Distributed Data Structure for P2P Environment
6/12/2007 Scaling the Internet routing table with Locator/ID Separation Protocol (LISP)
6/3/2007 Hadoop Map/Reduce
6/1/2007SlidesHadoop distributed file system
4/20/2007VideoBrad Fitzpatrick - Behind the Scenes at LiveJournal: Scaling Storytime
2/1/2007SlidesInside LiveJournal's Backend (April 2004)
2/1/2007SlidesHow to scale
1/23/2007 Testing Oracle 10g RAC Scalability
1/1/2007SlidesPHP & Performance
12/22/2006 SQL Performance Optimization
10/13/2006 Building_a_Scalable_Software_Security_Practice
5/31/2006 Building Large Systems at Google
5/4/2006 Scalable computing with Hadoop
1/1/2006SlidesThe Ebay architecture
1/1/2006PDFBigtable: A Distributed Storage System for Structured Data
1/1/2006PDFFault-Tolerant and scalable TCP splice and web server architecture
10/18/2005VideoBigTable: A Distributed Structured Storage System
1/1/2004PDFMapReduce: Simplified Data Processing on Large Clusters
8/3/2003PDFGoogle Cluster architecture
1/1/2003PDFGoogle File System
11/1/2002DocImplementing a Scalable Architecture
10/30/2001NewsHow linux saved Millions for Amazon
  Yahoo experience with hadoop
 SlidesScalable web application using Mysql and Java
 SlidesFriendster: scalaing for 1 Billion Queries per day
 BlogLightweight web servers
 PDFMysql Scale out by application partitioning
 PDFReplication under scalable hashing: A family of algorithms for Scalable decentralized data distribution
 ProductClustered storage revolution
 BlogEarly Amazon Series
 WebWikimedia Server info
 SlidesWikimedia Architecture
 SlidesMySpace presentation
 PDFA scalable and fault-tolerant architecture for distributed web resource discovery
8/4/2007PDFThe Chubby Lock Service for Loosely-Coupled Distributed Systems
8/5/2007SlidesReal world Mysql tuning
8/5/2007SlidesReal world Mysql performance tuning
8/5/2007SlidesLearning MogileFS: Buliding scalable storage system
8/5/2007SlidesReverse Proxy and Webserver
8/5/2007PDFCase for Shared Nothing
7/1/2007SlidesA scalable stateless proxy for DBI
1/1/2006SlidesReal world scalability web builder 2006
8/5/2005SlidesReal world web scalability

Comments

Scalable web architectures » Blog Archive » New Talks and Slides links from Aug 5 2007 said…
[...] you haven’t seen these links before.. you should check this page first “Talks and slides from web architects“. But if you have already seen that page… here are the updates from last [...]
8:55 AM
Jonathan Boutelle said…
What a great list!
Thanks for posting this.
11:13 AM
Post a Comment

Popular posts from this blog

Creating your first chrome app on a Chromebook

Image
Doing development on Chromebook usually means developing online. There are a lot of sites around for that. But with the APIs getting more mature, its just a matter of time before someone builds a kick-ass IDE which runs natively on Chromebooks without network connectivity. One such tool which I've been exploring for a last few weeks is from Google and called " Chrome Dev Editor " If you have never built and run a chrome app or extension, I'll show you how to do this in 3 easy steps.     Step 1 Launch the app and click on the "+" button to add a new project. Pick a project name and select "JavaScript Chrome App" in the drop down menu.       Step 2 Notice how it automatically adds the minimum code required for it to run. This will be the template you are going to work with. You are almost done, but lets review the files in there to understand why they are there.   manifest.json - This is the most important file. Modify the app name, version number
Read more

Brewers CAP Theorem on distributed systems

Image
Large distributed systems run into a problem which smaller systems don’t usually have to worry about. “ Brewers CAP Theorem ” [ Ref 1 ] [ Ref 2 ] [ Ref 3 ]  defines this problem in a very simple way. It states, that though its desirable to have Consistency, High-Availability and Partition-tolerance in every system, unfortunately no system can achieve all three at the same time . C onsistent : A fully Consistent system is one where the system can guarantee that once you store a state (lets say “x=y”) in the system, it will report the same state in every subsequent operation until the state is explicitly changed by something outside the system. [ Example 1 ] A single MySQL database instance is automatically fully consistent since there is only one node keeping the state. [ Example 2 ] If two MySQL servers are involved, and if the system is designed in such a way that all keys starting “a” to “m” is kept on server 1, and keys “n” to “z” are kept on server
Read more

The pain of Load balancing applications

Introduction Loadbalancing may mean many different things to different people but its all about distributing load. For me its an architecture of how some network services can be scaled by adding multiple servers performing the same tasks. If you had a popular website with static content, and if your server couldn't keep up with the request, all you had to do was setup multiple web servers and use round-robin DNS entries to divide the load into multiple servers. For dynamic web applications like search engines this plays a significant role because the number of users per node can support is much lower. Over time, as applications grew more complex and as web companies found customers outside US they found out the hardware that the only way to optimize network performance was by going local. Loadbalancing POP (points of presence) around the world provide a snappy user experience which has been important and drawing more customers. While, static content on web servers can easily be rep
Read more