Presented By O'Reilly and Cloudera
Make Data Work
Feb 17–20, 2015 • San Jose, CA

Big Data at Netflix: Faster and Easier

Kurt Brown (Netflix)
10:40am–11:20am Friday, 02/20/2015
Hadoop & Beyond
Location: 210 A/E
Average rating: ****.
(4.83, 18 ratings)
Slides:   external link

The Netflix Data Platform is a constantly evolving, large scale infrastructure running in the (AWS) cloud. This talk will dive into what we’re up to and why. We are especially focused on performance and ease of use. We’ve recently upgraded to Hadoop 2, have partnered with the community developing Pig on Tez, have adopted the Parquet file format, and fully integrated Presto into our stack. We are exploring Spark for streaming, machine learning, and analytic use cases. We continue to add to our big data, open source suite, with our latest contribution Inviso (which provides easy searching and visibility into Hadoop execution and performance). We are also heads down developing a cohesive framework for easy platform interaction (via our Big Data API and Big Data Portal). We’ll talk through these technologies and how they are benefiting the Netflix business. We’ll also dive into how we do things differently at Netflix (vs. most other companies), notably the motivations behind our architecture / approach and the benefits that we (and hopefully you can) achieve.

Photo of Kurt Brown

Kurt Brown

Netflix

Kurt leads the Data Platform team at Netflix. His group architects and manages the technical infrastructure underpinning the company’s analytics. The Netflix data infrastructure includes various Big Data technologies (e.g. Hadoop, Hive, and Pig), Netflix open sourced applications and services (e.g. Lipstick and Genie), and traditional BI tools (e.g. Teradata and MicroStrategy).

Comments on this page are now closed.

Comments

Anoop Johnson
02/26/2015 9:04am PST

Thanks Kurt for uploading the slides.

Picture of Kurt Brown
Kurt Brown
02/24/2015 7:45am PST

Here is a link to the slides:
https://dl.dropboxusercontent.com/u/58977236/Strata%202015%20-%20Official.pdf

Anoop Johnson
02/21/2015 2:09am PST

Kurt – I found the talk to be very useful. Thanks!

BTW the slides don’t seem to be available yet at the link you posted earlier. It would be great if you could upload it somewhere (Slideshare/Google docs) and link it from this page.

Picture of Kurt Brown
Kurt Brown
02/21/2015 1:14am PST

Yes, the slides should be available on the Strata Conference site soon. I believe they will be at: http://strataconf.com/big-data-conference-ca-2015/public/schedule/proceedings

Best,

Kurt

Vu Ha
02/20/2015 6:27am PST

Will the slides be available? Thanks!