Presented By O'Reilly and Cloudera
Make Data Work
22–23 May 2017: Training
23–25 May 2017: Tutorials & Conference
London, UK

Hadoop as a service: How to build and operate an enterprise data lake supporting operational and streaming analytics

11:1511:55 Wednesday, 24 May 2017
Level: Intermediate
Average rating: ***..
(3.20, 5 ratings)

Who is this presentation for?

  • CIOs, CDOs, CAOs, data engineers and architects, analysts, BI specialists, and data center managers

Prerequisite knowledge

  • Knowledge of IT and enterprise architecture in a large enterprise (e.g., a tier 1 telco)
  • General knowledge of Hadoop architecture (e.g., HDFS, YARN, and Spark)

What you'll learn

  • Learn how to run Hadoop as a shared service and see how it has been done at BT

Description

If you have Hadoop clusters in research or an early-stage data lake and are considering strategic vision and goals, this session is for you. Drawing on examples from BT HaaS, Phillip Radley explains how to run Hadoop as a shared service, providing an enterprise-wide data platform hosting hundreds of projects securely and predictably. Phillip also covers nontechnical aspects of how Hadoop fits into a large, mature enterprise.

Topics include:

  • Migrating from MapReduce to YARN, Spark, and Impala
  • Migrating a live cluster to a new hardware stack
  • Adding HDFS encryption
  • Adding in second site for disaster recovery (adopting Airbnb’s gold/silver cluster approach)
  • Evolving the architecture to support streaming applications (using Kafka, Spark, and Flink)
Photo of Phillip Radley

Phillip Radley

BT

Phillip Radley is chief data architect on BT’s core Enterprise Architecture team, where he is responsible for data architecture across BT Group Plc. Based at BT’s Adastral Park campus in the UK, Phill currently leads BT’s MDM and big data initiatives, driving associated strategic architecture and investment roadmaps for the business. Phill has worked in IT and the communications industry for 30 years, mostly with British Telecommunications Plc., and his previous roles in BT include nine years as chief architect for infrastructure performance-management solutions from UK consumer broadband to outsourced Fortune 500 networks and high-performance trading networks. He has broad global experience, including with BT’s Concert global venture in the US and five years as an Asia Pacific BSS/OSS architect based in Sydney. Phill is a physics graduate with an MBA.

Leave a Comment or Question

Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?

Join the conversation here (requires login)

Comments

Picture of Phillip Radley
Phillip Radley | CHIEF DATA ARCHITECT
25/05/2017 13:17 BST

I’ve tried uploading the slides to the portal a couple of times and not sure why they are not showing. If you’d like a copy of the slides email me at phillip.radley@bt.com

Ricardo Fernandes | HEAD OF BUSINESS ANALYTICS AND BIG DATA
25/05/2017 12:21 BST

Hi, Where can I get the presentation of this session?

Thank you, Ricardo