Scaling Facebook via Open Source

Category: 
Audience: 

It's not possible to scale a site like Facebook simply by sharding your databases, learn why we developed or contributed to a series of open source infrastructure technologies such as Cassandra, Hive, Haystack, memcached, MySQL, PHP, Scribe, and Thrift.

From the day that Mark Zuckerberg started building Facebook in his Harvard dorm room in 2004 until today, the site has been built on common open source software such as Linux, Apache, MySQL, and PHP. Now Facebook reaches over 350 million people per month, is the largest PHP site in the world, and has released major pieces of their infrastructure as open source.

It's not possible to scale a site like Facebook simply by sharding your databases; rather we've developed and contributed to a series of open source infrastructure technologies. Some of these projects include Cassandra, Hive, Haystack, memcached, and Scribe, where each focuses on solving a specific problem with thrift allowing them to communicate across languages. This talk will give you a better idea of what it takes to scale Facebook, a look into the infrastructure we use to do so, and dive into performance work we're focused on in order to scale PHP to over 350 billion page views per month.

Speaker: David Recordon
Downloads

Copyright 2002-2010 Linux Expo of Southern California. All Rights Reserved.