Presented By O’Reilly and Cloudera
Make Data Work
September 11, 2018: Training & Tutorials
September 12–13, 2018: Keynotes & Sessions
New York, NY

Self-service modern analytics on the GovCloud

Ramesh Krishnan (lmco), Steve Morgan (Lockheed Martin)
3:30pm–4:10pm Thursday, 09/13/2018
Average rating: ****.
(4.00, 1 rating)

Who is this presentation for?

  • Technical managers and those in BI

Prerequisite knowledge

  • Familiarity with AWS and cloud concepts (useful but not required)

What you'll learn

  • Explore Lockheed Martin's self-service data lake architecture

Description

Information management at Lockheed Martin, the world’s largest government contractor, comes with a variety of challenges. The company is in a highly regulated industry, it has a very rigorous security process, and it has a massive variety and volume of data. To extract the most value from its information assets, the company is constantly exploring ways to enable effective self-service scenarios. Ramesh Krishnan and Steve Morgan discuss Lockheed Martin’s journey into modern analytics and explore its analytics platform focused on leveraging AWS GovCloud.

Building and deploying a data lake to AWS GovCloud has allowed Lockheed Martin to rapidly prototype and realize value in several cases. However, it has brought with it a few challenges. Internal customers range from operations analysts and human resources managers to seasoned data scientists. Each user comes with their own set of goals, but they all share a common need: to have an analytics environment that accelerates their time to value without needing to involve multiple layers of the IT organization.

Ramesh and Steve explain how the enterprise data lake team is working to enable as many self-service scenarios as possible and are continuing to develop best practices for ingesting data in to the lake and automatically creating schemas to be queried in Presto. The goal is to have seamless integration between the company’s various analytics tools so that the end user has no need to understand the magic happening on the backend. Ramesh and Steve cover the benefits the company has seen, like faster query times and the ability to analyze multiple datasets in ways that were not previously possible, as well as some challenges the team has faced, such as the need for automating cleanup of user-created AWS resources and creating the appropriate safeguards to protect users from themselves.

Photo of Ramesh Krishnan

Ramesh Krishnan

lmco

Ramesh Krishnan is a software engineer at Imco. Ramesh has 15 years experience in the IT industry, with extensive experience in architecting and implementing IT solutions. He’s handled major telecom, banking, sales, finance, and HCM projects and has a decade of MIS and business information reporting experience. He’s also led onsite and offshore projects. His drive and determination to succeed have proved him a valuable addition to many projects.

Photo of Steve Morgan

Steve Morgan

Lockheed Martin

Steve Morgan is a software engineer and lead architect at Lockheed Martin.