Posted in March 18, 2010 ¬ 10:09 pmh.Royans
MapReduce, Bigtable and Pregel have their origins in Google and they all deal with “large systems”. But all of them may be dwarfed in size and complexity by a new project Google is working on, which was mentioned briefly (may be un-intentionally) at an event last year. Instead of caching data closer to user, it [...]
Read the rest of this entry »
datastore, eventually consistent, framework, google, mapreduce, replication, scalabilitydatastore, eventually consistent, google, mapreduce, replication, scalability
Posted in March 17, 2010 ¬ 11:16 pmh.Royans
Inside Google, MapReduce is used for 80% of all the data processing needs. That includes indexing web content, running the clustering engine for Google News, generating reports for popular queries (Google Trends), processing satellite imagery , language model processing for statistical machine translation and even mundane tasks like data backup and restore. The other 20% [...]
Read the rest of this entry »
