Sep 23–26, 2019

Where's my lookup table? Modeling relational data in a denormalized world

Rick Houlihan (Amazon Web Services)
11:20am12:00pm Thursday, September 26, 2019
Location: 1E 09

Who is this presentation for?

VP Engineering, CIO, CTO, Principal Engineer, Software Developer




When Amazon decided to migrate thousands of application services to NoSQL many of those services required complex relational models that could not be reduced to simple key-value access patterns. The most commonly documented use cases for NoSQL are simplistic, and there is a large amount of irrelevant and even outright false information published regarding design patterns and best practices for NoSQL applications. For this migration to succeed, Amazon needed to redefine how NoSQL is applied to modern OLTP apps.

NoSQL applications work best when access patterns are well defined, which means the sweet spot for a NoSQL database is OLTP applications. This is good because 90% of the apps that get written support a common business process which for all practical purposes is the definition of OLTP. One of the common steps in building an OLTP app is designing the Entity Relationship Model (ERM) which essentially defines how the application uses and stores data. With an RDBMS backed application the ERM was essentially mapped directly into the database schema by creating tables for the top level entities and defining relationships between them as defined in the ERM. With NoSQL the data is still relational, it just gets managed differently.

This session breaks down complex applications and effectively denormalize the ERM based on workflows and access patterns. The discussion will demonstrate how to apply the design patterns and best practices defined by the Amazon team responsible for migrating thousands of RDBMS based applications to NoSQL, and when it makes sense to use them.

Prerequisite knowledge

Attendees should have a basic understanding of RDBMS and some knowledge of SQL. Knowing how to recognize a normalized schema is a prerequisite. Some knowledge of NoSQL technology would be beneficial, but is not required.

What you'll learn

NoSQL databases still have to manage relational data Denormalization drives efficiency by tuning the data model to the access pattern When using NoSQL makes sense and when it doesn't How to start modeling relational data in a denormalized schema
Photo of Rick Houlihan

Rick Houlihan

Amazon Web Services

Rick leads the NoSQL Blackbelt team at AWS and has designed hundreds of NoSQL database schemas for some of the largest and most highly scaled applications in the world. Many of Rick’s designs are deployed at the foundation of core Amazon and AWS services such as Cloudtrail, IAM, Cloudwatch, EC2, Alexa, and a variety of retail Internet and fulfillment center services. Rick brings over 25 years of technology expertise and has authored 9 patents across a diverse set of technologies including Complex Event Processing, Neural Network Analysis, Microprocessor Design, Cloud Virtualization, and NoSQL Technologies.

As an innovator in the NoSQL space, Rick has over the years developed a repeatable process for building real world applications that delivers highly efficient denormalized data models for workloads of any scale, and he regularly delivers highly rated sessions at re:Invent and other AWS conferences on this specific topic.

Leave a Comment or Question

Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?

Join the conversation here (requires login)

Contact us

For conference registration information and customer service

For more information on community discounts and trade opportunities with O’Reilly conferences

For information on exhibiting or sponsoring a conference

Contact list

View a complete list of Strata Data Conference contacts