Presented By O'Reilly and Cloudera
Make Data Work
September 25–26, 2017: Training
September 26–28, 2017: Tutorials & Conference
New York, NY

Building a real-time feedback loop for education (sponsored by MemSQL)

David Mellor (Curriculum Associates)
11:20am12:00pm Wednesday, September 27, 2017
Location: 1A 04/05

What you'll learn

  • Explore Curriculum Associates's real-time data pipeline, which empowers teachers to provide immediate and accurate student feedback


Curriculum Associates has a mission to make classrooms better places for teachers and students. To achieve this, the company introduces innovative and exciting new products that give every student the chance to succeed. To meet the expectations of both teachers and students and enable the best teacher feedback available, leading educators are moving to real-time feedback.

David Mellor explains how Curriculum Associates developed a real-time data pipeline with MemSQL, which empowered teachers to provide immediate and accurate student feedback. Incorporating Apache Kafka as a high-speed event technology in conjunction with a real-time data warehouse like MemSQL allows Curriculum Associates to do on-the-fly aggregations of event data to enable timely access to data and removes the need for costly precomputation workflows.

David details how he and his team architected a combination of data workflows. One, for actively updating data such as student activity through an online lesson and diagnostics, relies on in-memory processing to serve responses in under 200 milliseconds. The other focuses on data that can be processed on scheduled intervals. Using database functions like CREATE VIEW, Curriculum Associates enables analytics across both real-time and historical data, a critical capability for contextual insights. Ultimately teachers and students benefit from the real-time feedback: students see how they are progressing, and teachers can track progress as it happens and react in a timely fashion.

This session is sponsored by MemSQL.

David Mellor

Curriculum Associates

David Mellor is the vice president and chief architect at Curriculum Associates and an adjunct professor at Boston University’s Graduate School of Computer Science. Previously, David was the chief architect of the Next Generation Application Platform at Oracle. He is the author of multiple books, including The Common Warehouse Metamodel Developer’s Guide. David also holds two patents in the area of extension mechanisms for web content.