Presented By O’Reilly and Cloudera
Make Data Work
21–22 May 2018: Training
22–24 May 2018: Tutorials & Conference
London, UK

How BT delivers better Broadband & TV using Spark & Kafka

12:0512:45 Wednesday, 23 May 2018
Data engineering and architecture
Location: Capital Suite 8/9 Level: Beginner

Who is this presentation for?

Architects, Designers, IT Operations in Telcos or Financial Services

Prerequisite knowledge

Familiarity with Hadoop, Spark, Kafka

What you'll learn

How to add streaming analytics to an existing batch processing cluster. How to make a cluster fit for mission critical operations.


BT launched it’s production big data platform in 2014 and for 2 years it was mainly used for batch processing, ETL and sandpits.

Recently the platform has been upgraded and Kafka and Spark added to the stack to deliver a streaming analytics capability .
The presentation shows how this is used to improve the Broadband & TV services of millions of BT customers.

The presentation explains how the solution is architected and operated and the work required to refresh a big data platform so that it can deliver mission critical streaming analytics.

Key features covered

  • Kafka front end
  • Configured YARN to give consistent Spark throughput on a multi-tenant platform
  • Dual Site working to deliver high availability
  • HDFS Encryption
Photo of Phillip Radley

Phillip Radley


Phillip Radley is chief data architect on BT’s core Enterprise Architecture team, where he is responsible for data architecture across BT Group Plc. Based at BT’s Adastral Park campus in the UK, Phill currently leads BT’s MDM and big data initiatives, driving associated strategic architecture and investment roadmaps for the business. Phill has worked in IT and the communications industry for 30 years, mostly with British Telecommunications Plc., and his previous roles in BT include nine years as chief architect for infrastructure performance-management solutions from UK consumer broadband to outsourced Fortune 500 networks and high-performance trading networks. He has broad global experience, including with BT’s Concert global venture in the US and five years as an Asia Pacific BSS/OSS architect based in Sydney. Phill is a physics graduate with an MBA.

Leave a Comment or Question

Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?

Join the conversation here (requires login)