Engineering the Future of Software
16–18 October 2017: Conference & Tutorials
18–19 October 2017: Training
London, UK

Building next-gen edge architecture at Expedia

Rick Fast (Expedia)
15:5016:40 Monday, 16 October 2017
Distributed systems
Location: Buckingham Room - Palace Suite Level: Intermediate
Secondary topics:  Case Study
Average rating: ****.
(4.33, 12 ratings)

Prerequisite Knowledge

  • An intermediate understanding of web architecture

What you'll learn

  • Explore Styx, Expedia's in-house open source reverse proxy, which helps create a highly configurable routing and bot detection system

Description

As production system backends become more fine grained through decomposition into microservices, microfrontends have become more popular to introduce independent deployability to the UI layer. Routing between an ever-growing and -changing number of frontend applications becomes a significant challenge. Hordes of good and bad bots that regularly pummel your website represent another challenge. Rick Fast details how Expedia leverages an in-house open source reverse proxy called Styx to create a highly configurable routing and bot detection system. (This system proxies traffic across all of the brands hosted on the Expedia platform.)

Rick offers an overview of Styx—built on Netty and RxJava with a plugin architecture that makes it extremely extensible—which leverages nonblocking I/O alongside the concurrency of the JVM to provide high throughput and scalability. Rick also discusses the set of plugins Expedia built on top of Styx to allow for instant remote configuration (using Consul) of a fleet of proxies across the globe and the flexible routing engine built on top of Styx that allows for very complex routing rules between applications. These routing rules need to be able to act on any dimension of a web request, such as the user’s authentication state, cookies, or even the result of an A/B test. Rick shares Expedia’s approaches to making complex rules configurable in real time using self-service tools and for isolating each microfrontend from other applications at the front door, in order to avoid allowing a single misbehaving application to impact the overall performance of the site.

Rick concludes by explaining how Expedia leverages the routing rules engine and proxy architecture to identify and treat bot traffic in near real time, how the company identifies and applies treatments to bot traffic from within its proxies, and how it leverages streaming request data with Kinesis to identify bot sessions and define new patterns of detecting bots.

Photo of Rick Fast

Rick Fast

Expedia

Rick Fast is a distinguished software engineer at Expedia. Previously, Rick was an engineer at CDK Global/Cobalt in Portland, an industry leader in automotive retail software, and served as lead engineer at Nokia HERE (formerly Navteq), a provider of digital map data.

Leave a Comment or Question

Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?

Join the conversation here (requires login)