John Rauser (Pinterest)

Decisions in the Face of Uncertainty or Just Enough Statistics to be Dangerous Presentation 1 [PDF],

Decisions in the Face of Uncertainty or Just Enough Statistics to be Dangerous Presentation 2 [PDF],

Decisions in the Face of Uncertainty or Just Enough Statistics to be Dangerous Presentation 3 [FILE]

Average rating:

(4.04, 47 ratings)

How many machines will we need for Q4? How big should our next datacenter build be? What are the odds this project will be completed on time? What does a network packet loss rate of 1% mean for my application?

Do you feel like you ought to have a working knowledge of statistics, but don’t know where to begin? If you took a statistics class in college, but have forgotten most of it, or you’ve never had any formal training in statistics, this class is for you. My goal is to give you a basic toolset to begin reasoning statistically through a series of interactive examples.

We’ll do an exercise in estimation, where you’ll learn how well calibrated you are as an estimator. We’ll use the data we get from the estimation exercise to explore one of the most useful ideas in statistics: the binomial distribution. We’ll conduct a key statistical test, the chi-square test, which use can to tell if the data you’re observing match what you’d expect or if the pattern is different. And last, we’ll solve a problem in decision theory and along the way learn about the normal distribution.

Though I’ll use a little bit of scary looking math, you should still attend if you’ve forgotten all the math you learned in school. I show how to use software like excel and sage to do all the mathematical heavy lifting.

John has been extracting value from large datasets for over 20 years at hedge funds, small data-driven startups, Amazon, and now Pinterest. He has deep experience in machine learning, data visualization, on-line experimentation, website performance and real-time fault analysis. An empiricist at heart, “Just do the experiment!” is his favorite call to arms.

Comments on this page are now closed.

Premier Diamond Sponsor

Diamond Sponsors

Platinum Sponsors

Gold Sponsors

Silver Sponsors

Lanyard Sponsor

For information on exhibition and sponsorship opportunities at the conference, contact Yvonne Romaine at yromaine@oreilly.com

Download the Velocity Sponsor/Exhibitor Prospectus

View a complete list of Velocity contacts

## Comments

Hi Nicolas, the video will be available to All Access and Online Access pass holders very soon.

Wow, this must have been a great presentation, will there be video? from the slides alone it hard to get all the info.

I liked John’s presentation, but I think people could not really get anything practical and useful from it. The formulas were overwhelming. I think John is an awesome speaker and he should be on stage every year, but this was a bit too much ‘theory’

The slides and handouts are all posted now – please leave a comment if you can’t see them for any reason.

-Sophia

I found this talk highly entertaining, and an excellent intro to Statistics. While I didn’t get as much from this talk as I would have liked, there were some key takeaways (such as that Average is seldom actually useful and to attempt to give a range rather than a single answer). Regardless, the entertainment value was high.

Fantastic talk. Initially I wondered why I was in a statistics lecture, but actually (being an ex-mathematician anyway) realised that maybe I should dust off the old text books and apply this in my own work! Thank you for this wonderful exposition of a complex subject

It was great! I liked the way you presented!!!

@Ernest: Good feedback. When I’ve given the talk to smaller audiences with a bit more time there’s more breathing room to work with the audience to address specific problems they have, but in 90 minutes and a giant room, that didn’t happen. Perhaps I’ll prepare another talk that more strongly favors application specific depth.

@Tim: I’ve given the presentation materials to the folks at O’Reilly; I’ll ask to have them posted.

John is an excellent presenter. This session gave me much to think about.

Will you be posting the slides and video of this session? I noticed that it was not in the Video and Slides section of the site… :(

John did an excellent job of clearly showing how to apply sophisticated statistical analyses to better diagnose complex situations. I wish my college statistics classes as clear cut… Thanks John

I enjoyed this session; my colleagues and I wished there had been more examples relevant to WebOps/Perf to drive it home how/when you might apply these principles on the job.

John was one of the highest rated speakers at Velocity 2010. He’s a data mining magician full time at Amazon. Metrics are critical for web performance – without them you’re flying blind. We all know some basics, but John will help everyone step up to the next level at this workshop. This is a must attend.