Presented By O'Reilly and Cloudera
Make Data Work
22–23 May 2017: Training
23–25 May 2017: Tutorials & Conference
London, UK

Hadoop as a service: How to build and operate an enterprise data lake supporting operational and streaming analytics

11:1511:55 Wednesday, 24 May 2017
Level: Intermediate
Average rating: ***..
(3.20, 5 ratings)

Who is this presentation for?

  • CIOs, CDOs, CAOs, data engineers and architects, analysts, BI specialists, and data center managers

Prerequisite knowledge

  • Knowledge of IT and enterprise architecture in a large enterprise (e.g., a tier 1 telco)
  • General knowledge of Hadoop architecture (e.g., HDFS, YARN, and Spark)

What you'll learn

  • Learn how to run Hadoop as a shared service and see how it has been done at BT


If you have Hadoop clusters in research or an early-stage data lake and are considering strategic vision and goals, this session is for you. Drawing on examples from BT HaaS, Phillip Radley explains how to run Hadoop as a shared service, providing an enterprise-wide data platform hosting hundreds of projects securely and predictably. Phillip also covers nontechnical aspects of how Hadoop fits into a large, mature enterprise.

Topics include:

  • Migrating from MapReduce to YARN, Spark, and Impala
  • Migrating a live cluster to a new hardware stack
  • Adding HDFS encryption
  • Adding in second site for disaster recovery (adopting Airbnb’s gold/silver cluster approach)
  • Evolving the architecture to support streaming applications (using Kafka, Spark, and Flink)
Photo of Phillip Radley

Phillip Radley


Phillip Radley is chief data architect on the core enterprise architecture team at BT, where he’s responsible for data architecture across the company. Based at BT’s Adastral Park campus in the UK, Phill leads BT’s MDM and big data initiatives, driving associated strategic architecture and investment road maps for the business. He’s worked in IT and communications for 30 years. Previously, Phill was been chief architect for infrastructure performance-management solutions from UK consumer broadband to outsourced Fortune 500 networks and high-performance trading networks. He has broad global experience, including with BT’s concert global venture in the US and five years as an Asia Pacific BSS/OSS architect based in Sydney. Phill is a physics graduate with an MBA.

Comments on this page are now closed.


Picture of Phillip Radley
25/05/2017 13:17 BST

I’ve tried uploading the slides to the portal a couple of times and not sure why they are not showing. If you’d like a copy of the slides email me at

25/05/2017 12:21 BST

Hi, Where can I get the presentation of this session?

Thank you, Ricardo