Engineer for the future of Cloud
June 10-13, 2019
San Jose, CA

Extracting signal: Fast traffic analysis and smart aggregation in global edge networks

4:45pm5:25pm Wednesday, June 12, 2019



Prerequisite knowledge

  • Internet infrastructure, transmission control protocol (TCP)/internet protocol (IP), Linux systems, and programming knowledge (helpful)


In most edge networks, especially those with global presence, observability is key. While application-level metrics are a minimum bar, the addition of smart traffic analysis can often provide additional telemetry, resulting in critical insight, improving operations, and even prompting new product features. Gaining such insight, of course, comes with an array of associated challenges.

Shannon Weyrick and Clare Gollnick discuss the types of interesting data available through traffic analysis, along with strategies and technologies for a fully distributed collection and analysis framework, including fast network analysis at the edge; policy-based filtering, allowing for granular control over collection; centralized control plane; centralized collection, storage, and searching; useful aggregations such as top k and HyperLogLog; and recent advances in the Linux networking stack. All discussion is grounded in real-world use cases and examples.

Photo of Shannon Weyrick

Shannon Weyrick


Shannon Weyrick is vice president of architecture at NS1. A 20-year veteran of internet infrastructure, Shannon is an accomplished technical architect, developer, and leader whose experience encompasses both development and operations of globally distributed platforms. Previously, Shannon worked at INAP and F5. A regular open source contributor, he has led and worked on a wide range of infrastructure projects from high-performance servers to novel programming languages and runtimes, and he enjoys writing and speaking at industry conferences.

Photo of Clare Gollnick

Clare Gollnick


Clare Gollnick is the director of data science at NS1 based out of New York City.

Leave a Comment or Question

Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?

Join the conversation here (requires login)