Presented By O'Reilly and Cloudera
Make Data Work
Feb 17–20, 2015 • San Jose, CA

Bringing OLAP Fully Online: Analyze Changing Datasets in MemSQL and Spark with Pinterest Demo

Eric Frenkiel (MemSQL)
10:40am–11:20am Thursday, 02/19/2015
Location: LL20 D
Average rating: ***..
(3.67, 3 ratings)
Slides:   1-PPTX 

As the world moves from batch to online data processing, real-time data pipelines will supercede siloed data warehouse and transaction processing systems as core infrastructure.

While many analytics solutions tout query execution speed, this is only half of the equation.

For real time workloads, stale data renders query speed irrelevant when results and insights are out of date.

Beyond just “online queries,” real-time enterprises need “online datasets” that continuously update and make data accessible across the organization.

This session will cover approaches to building real-time pipelines with MemSQL, Hadoop, and Spark. Topics will include:

Key industry trends and the move to real-time data pipelines
How MemSQL customer Novus built the premier financial portfolio management platform using MemSQL as a real-time data store and query engine.

Operationalizing Spark for Advanced Analytics
Demonstration of how Pinterest is using the MemSQL Spark Connector to derive real-time insights on interesting and meaningful user activity with MemSQL and Spark.

Introduction to the MemSQL Spark Connector
Strategies for integrating Spark and Hadoop with real-time systems for transaction processing and operational analytics.

Presenters include MemSQL CEO Eric Frenkiel, Novus CTO Robert Stepeck, and Pinterest Software Engineer Yu Yang.

In a world of web portals and push notifications, users have developed demanding expectations for a real-time experience. Continuous updates, a responsive interface, and short loading times have become the norm. Most business analysts and data scientists, whose workflows remain bound by legacy tools and complex data pipelines, lack this fast, simple user experience.

From a business perspective, latency and complexity impede revenue by preventing access to the right data at the right time. Businesses that recognize the value of access to real-time data now have options to meet stringent objectives. They understand that serving “always up to date” data for analysis requires converging transactions and analytics in a real-time system. This session will highlight these architectures and customer achievements.

Photo of Eric Frenkiel

Eric Frenkiel


Eric Frenkiel co-founded MemSQL and has served as CEO since inception. Before MemSQL, Eric worked at Facebook on partnership development. He has worked in various engineering and sales engineering capacities at both consumer and enterprise startups. Eric is a graduate of Stanford University’s School of Engineering. In 2011 and 2012, Eric was named to Forbes’ 30 under 30 list of technology innovators.