Presented By O’Reilly and Cloudera
Make Data Work
21–22 May 2018: Training
22–24 May 2018: Tutorials & Conference
London, UK

Mixing causal consistency and asynchronous replication for large Neo4j clusters

Jim Webber (Neo4j)
14:5515:35 Thursday, 24 May 2018
Data engineering and architecture
Location: S11A Level: Intermediate
Secondary topics:  Time Series and Graphs
Average rating: *****
(5.00, 3 ratings)

Who is this presentation for?

  • Developers, architects, and researchers

What you'll learn

  • Explore Neo4j's new causal clustering architecture

Description

Jim Webber explores the new causal clustering architecture for Neo4j, detailing how Neo4j uses the Raft protocol for a robust underlay for intensive write operations and how the asynchronous new scale-out mechanism provides enormous capacity for very demanding graph workloads. Jim focuses on the cluster architecture’s new causal consistency model—a big leap forward compared to the commonplace eventual consistency—which makes it convenient to write applications that use the full capacity of the cluster. In particular, he demonstrates that despite the mixture of consensus protocols and asynchronous replication, Neo4j allows users to read their own writes straightforwardly. (He also explains why this is such a difficult achievement in distributed systems.) You’ll also learn how Neo4j’s causal clustering optimized drivers make it easy to write applications that scale smoothly from a single server to a large distributed cluster.

Photo of Jim Webber

Jim Webber

Neo4j

Jim Webber is chief scientist at Neo Technology, where he works on next-generation solutions for massively scaling graph data. Previously, Jim was a professional services director with ThoughtWorks, where he worked on large-scale computing systems in finance and telecoms. Jim holds a PhD in computing science from Newcastle University in the UK.