High Performance at Massive Scale - Lessons Learned at Facebook

Operations
Location: Regency 2 Level: Intermediate
Average rating: ****.
(4.42, 19 ratings)

Data at facebook is growing at an incredible rate. More than half a million people sign up every day, and the 150 million existing users continue to add new data at an ever increasing rate. The rate of reads against the data is also increasing, with more than 50 million low latency random accesses a second. Building a system to handle these requirements is quite a challenge, and I’ll be sharing some of the lessons we’ve learned from it.

One of the critical components of the system is the memcached cluster. I’ll be discussing the ways we’ve maintained performance and reliability as the cluster has grown, and the techniques we’ve used to deal with the massive amounts of network traffic required. Some of these techniques are at the application layer such as clustering of data and analysis of access patterns. Others are at the system level such as dynamic throttling of network traffic and modifications to the kernel’s network stack.

I’ll also be discussing optimizations we’ve made to the PHP interpreter such as changes to reduce initialization cost with a large codebase, and lessons learned scaling MySql to tens of terabytes.

I’ll be sharing data on all of these topics, and discussing the impact that various optimizations have had on both scaling and performance.

Photo of Robert Johnson

Robert Johnson

Facebook

Robert is Director of Engineering at Facebook, where he leads software development for scaling and performance. He has overseen more than a tenfold expansion of the site to over 150 million users and billions of page views a day and the development of a scalable architecture for Facebook’s fast paced development environment. He received a B.S. in Engineering and Applied Science from Caltech, and has spent the last ten years working in a variety of engineering and management roles at startups in Silicon Valley.

  • Keynote Systems
  • Google
  • Shopzilla
  • Aptimize
  • Facebook
  • NeuStar
  • Rackspace Cloud
  • Schooner Information Technology
  • SoftLayer
  • SpringSource
  • Sun Microsystems

Sponsorship Opportunities

For information on exhibition and sponsorship opportunities at the conference, contact Sharon Cordesse at scordesse@oreilly.com

Download the Velocity Sponsor/Exhibitor Prospectus

Media Partner Opportunities

Download the Media & Promotional Partner Brochure (PDF) for information on trade opportunities with O'Reilly conferences or contact mediapartners@ oreilly.com

Press and Media

For media-related inquiries, contact Maureen Jennings at maureen@oreilly.com

Velocity Newsletter

To stay abreast of conference news and to receive email notification when registration opens, please sign up for the Velocity Conference newsletter (login required)

Contact Us

View a complete list of Velocity contacts