Engineering the Future of Software
Feb 25–26, 2018: Training
Feb 26–28, 2018: Tutorials & Conference
New York, NY

Evolving a modern end-to-end data infrastructure at Comcast

4:50pm–5:40pm Wednesday, February 28, 2018
Application architecture, Cloud native
Location: Mercury Ballroom Level: Intermediate
Secondary topics:  Best Practice, Case Study

Who is this presentation for?

  • Architects and managers

Prerequisite knowledge

  • Familiarity with cloud computing and the big data ecosystem

What you'll learn

  • Understand the key architectural components of an end-to-end, elastically scaleable cloud-based big data platform

Description

Once upon a time, a company’s analytic infrastructure was stored in a relational database that took an ETL tool to get data into it. Then, the Cambrian explosion of big data technologies came: the cloud, with its expectation of elastic scalability; fast data technologies, which brought an expectation that all data was in near real time; and the machine learning renaissance, with its advanced data-processing techniques. As a result, stakeholders now expect to be able to get the data they need in near real time, along with the tools and capabilities they need to work with it with minimal friction.

Michael Bevilacqua-linn shares an architecture for a cloud-based end-to-end data infrastructure that handles everything from classic analytic use cases to real-time operational analysis to modern machine learning techniques in an elastically scaleable and secure manner. Michael explains how Comcast is continuing to evolve this architecture within the company, where it collects millions of events per second, storing petabytes of data per day and making it all accessible through a variety of tools for a large set of stakeholders.

Photo of Michael Bevilacqua-linn

Michael Bevilacqua-linn

Comcast

Michael Bevilacqua-Linn is a senior software architect at Comcast, where he builds distributed systems that power infrastructure for its next-generation services. Michael has been programming computers ever since he dragged an Apple IIGS that his parents got for opening a bank account into his fifth grade class to explain loops and variables to a bunch of preteenagers. In his spare time, he likes rock climbing and good beer, though not at the same time.

Leave a Comment or Question

Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?

Join the conversation here (requires login)