Presented By
O’Reilly + Cloudera
Make Data Work
29 April–2 May 2019
London, UK
Please log in

Simplicity at scale: How Cloudflare’s analyses some of the world’s largest DDoS attacks

Tom Walwyn (Cloudflare)
14:05–14:45 Thursday, 2 May 2019
Data Engineering and Architecture
 Location: Capital Suite 10/11
Secondary topics:  Security and Privacy, Streaming and realtime analytics
Average rating: ****.
(4.00, 1 rating)

Who is this presentation for?

Engineers and Engineering Managers

Level

Beginner

Prerequisite knowledge

A basic understanding of streaming data pipelines and SQL

What you'll learn

* Understand the challenges of managing complex event processing systems * Learn how Cloudflare built its data platform using ClickHouse on a global scale * Explore how SQL unlocked enormous value for Cloudflare

Description

Learn how Cloudflare’s network captures and processes information from some of the world’s largest DDoS attacks. We will discuss how Cloudflare uses ClickHouse and SQL to gather real time analytics even whilst experiencing the attacks that come with supporting nearly 10 percent of all Internet requests worldwide and over 10 million events per second. Cloudflare’s robust infrastructure brings us simplicity and ease of operations, even while allowing maximum debuggability when things go wrong.

In this talk, we will elaborate on how Cloudflare made the switch from a complex event processing system, to a simple architecture that now scales with the company’s massive network.

Photo of Tom Walwyn

Tom Walwyn

Cloudflare

Tom Walwyn is an Engineering Manager for Data at Cloudflare. Here helps teams move data from the Cloudflare edge to its core at global scale. He enjoys environments where the data to people ratio is large. When he’s not wrangling data, he enjoys running through London and surrounds.