Presented By
O’Reilly + Cloudera
Make Data Work
29 April–2 May 2019
London, UK
David Josephsen

David Josephsen
Senior SRE, Sparkpost

Website

Dave Josephsen runs the telemetry engineering team at Sparkpost. He thinks you’re pretty great.

Sessions

12:05–12:45 Thursday, 2 May 2019
Schema on read and the new logging way
Data Engineering and Architecture
 Location: S11 A
Secondary topics:  AI and Data technologies in the cloud, Data Integration and Data Pipelines, Data Platforms, Streaming and realtime analytics
David Josephsen (Sparkpost)
Average rating: ***..
(3.50, 2 ratings)
David Josephsen tells the story of how Sparkpost's reliability engineering team abandoned ELK for a DIY schema-on-read logging infrastructure. Join in to learn the architectural details, trials, and tribulations from the company's Internal Event Hose data ingestion pipeline project, which uses Fluentd, Kinesis, Parquet, and AWS Athena to make logging sane. Read more.