Presented By O’Reilly and Intel Nervana
Put AI to work
September 17-18, 2017: Training
September 18-20, 2017: Tutorials & Conference
San Francisco, CA

Probabilistic programming

9:00am–12:30pm Monday, September 18, 2017
Implementing AI
Location: Yosemite A
Secondary topics:  Data science and AI
Average rating: ****.
(4.75, 4 ratings)

Prerequisite Knowledge

  • A working knowledge of probabilistic data analysis and Python

What you'll learn

  • Understand probabilistic programming, an emerging field that brings together key ideas from probability theory, programming languages, and Turing-universal computation to build AI systems with new capabilities in domains such as computer vision and data science
  • Explore mature or rapidly maturing domain-specific languages for Bayesian statistics and deep learning


Probabilistic inference, a widely used, mathematically rigorous approach for interpreting ambiguous information using models that are uncertain or incomplete, has become central to everything from big data analytics to robotics and AI to computational modeling of the mind and brain. Unfortunately, it currently requires deep technical expertise. Models and inference algorithms are difficult to communicate, design, implement, validate, and optimize, and inference often appears to be fundamentally intractable.

Probabilistic programming aims to solve these problems by making modeling and inference broadly accessible to nonexperts by facilitating data analysis, enabling experts to tackle problems that are currently infeasible, especially in machine intelligence. Probabilistic programming is based on new formalizations of modeling and inference that bring together key ideas from probability theory, programming languages, and Turing-universal computation.

Vikash Mansinghka surveys the emerging field of probabilistic programming, which aims to make modeling and inference broadly accessible to nonexperts, emphasizing four languages: Stan, for hierarchical Bayesian statistics, applied to data from education and ecology; Edward, for deep learning, applied to handwritten digit recognition; Venture, for structure learning, applied to reimplementing the Automatic Statistician; and BayesDB, for probabilistic data analysis, applied to databases from public health, cognitive development, and neuroinformatics.

Photo of Vikash Mansinghka

Vikash Mansinghka


Vikash Mansinghka is a research scientist at MIT, where he leads the Probabilistic Computing Project, and a cofounder of Empirical Systems, a new venture-backed AI startup aimed at improving the credibility and transparency of statistical inference. Previously, Vikash cofounded a venture-backed startup based on his research that was acquired by Salesforce, was an advisor to Google DeepMind, and held graduate fellowships at the National Science Foundation and MIT’s Lincoln Laboratory. He served on DARPA’s Information Science and Technology advisory board from 2010 to 2012 and currently serves on the editorial boards for the Journal of Machine Learning Research and Statistics and Computation. Vikash holds a PhD in computation, an MEng in computer science, and BS degrees in mathematics and computer science, all from MIT. His PhD dissertation on natively probabilistic computation won the MIT George M. Sprowls dissertation award in computer science, and his research on the Picture probabilistic programming language won an award at CVPR.

Comments on this page are now closed.


09/23/2017 10:35am PDT

Please would you re-circulate the links for the hands-on training?

09/22/2017 8:31am PDT

Good presentation but the link for the hands-on training is not longer working anymore. It did not work in the class due to bad connectivity. How do i download the notebooks ? Thanks

09/18/2017 8:36am PDT

Good presentation but the link for the hands on is on working anymore. Also it did not work in the class. How do i download the notebooks ?