Making Open Work
May 8–9, 2017: Training & Tutorials
May 10–11, 2017: Conference
Austin, TX

Developer on the rise: Blurring the line between developer and data scientist with PixieDust

va barbosa (IBM)
4:15pm4:55pm Wednesday, May 10, 2017
Sponsored
Location: Meeting Room 14 (Sponsored)

What you'll learn

  • Explore PixieDust, a new open source library that helps data scientists and developers working in the Jupyter Notebook and Apache Spark be more efficient

Description

Ready to dip your toe into data science? Va Barbosa explains why you should start with notebooks and PixieDust, a new open source library that helps data scientists and developers working in the Jupyter Notebook and Apache Spark be more efficient.

PixieDust speeds data manipulation and display with features like auto-visualization of Spark DataFrames, real-time Spark job progress monitoring directly from the notebook, seamless integration to cloud services, and automated local install of Python and Scala kernels running with Spark. And if you prefer working with a Scala notebook, no problem. PixieDust can also run on a Scala Kernel. Imagine being able to visualize your favorite Python chart engines from a Scala notebook.

Join Va to learn how to use PixieDust in your own projects to visualize and explore data effortlessly with no coding. Va also shares a demo combining Twitter, Watson Tone Analyzer, Spark Streaming, and some fun real-time visualizations—all running within a notebook.

This session is sponsored by IBM.

Photo of va barbosa

va barbosa

IBM

va barbosa is a developer advocate for the Center for Open-Source Data & AI Technologies where he is assisting developers discover and make use of data and machine learning technologies. this is fueled by his passion to help others and guided by his enthusiasm for open source technology.

always looking to embrace new challenges and fulfill his appetite for learning, va immerses himself in a wide range of technologies and activities. when not focusing on the developer experience, va enjoys dabbling in photography. if you can’t find him in front of a computer try looking behind a camera.