One Billion Rows per Second: Analytics for the Digital Media Markets

Michael Driscoll (Metamarkets)
Order of Magnitude Shifts
Location: Westside Ballroom Level:

Digital media publishers sit astride torrents of data about their content, audiences and advertisers. Every day, the world’s two billion internet users visit millions of pages, and are exposed to more than one hundred billion online advertising impressions. Publishers of digital content need to crunch this data to predict who will visit tomorrow, and how to price the ads those visitors see.

In the past year, Metamarkets has developed a Big Data stack for the media markets, comprised of three pieces:

  1. a stream-based aggregation and processing service, built on top of the Kafka messaging system
  2. a distributed, in-memory OLAP store, hosted on Amazon’s web services, that can scan and aggregate over one billion rows per second
  3. a real-time web console, served by node.js, with dynamic data visualizations powered by D3, the successor to Protovis.
Our platform is in currently in production with three of the largest media publishers in Europe and United States.
Photo of Michael Driscoll

Michael Driscoll

Metamarkets

Michael Driscoll has a decade of experience developing large-scale databases and predictive algorithms for digital media, financial, and life sciences firms. He is the CEO and co-founder at Metamarkets, and Chairman of Dataspora LLC, a big data & analytics consultancy he founded in 2007. Previously, he founded the online retailer, CustomInk.com, and worked as a software engineer for the Human Genome Project. Michael holds a Ph.D. in Bioinformatics from Boston University and an A.B. from Harvard College.

Michael tweets at medriscoll and blogs at Data Utopian .

Sponsors

  • Aster Data
  • EMC Greenplum
  • GE
  • Lexis Nexis
  • MarkLogic
  • Tableau Software
  • Cloudera
  • DataStax
  • Informatica
  • DataSift
  • Splunk
  • 1010data
  • Amazon Web Services
  • Connotate
  • Media-Science
  • Microsoft SQL Server

Sponsorship Opportunities

For information on sponsorship opportunities at the conference, contact Susan Stewart at sstewart@oreilly.com

Press & Media

For media-related inquiries, contact Maureen Jennings at maureen@oreilly.com

Contact Us

View a complete list of Strata Summit Contacts