Presented by O'Reilly and Cloudera
Make Data Work
July 12-13, 2017: Training
July 13-15, 2017: Tutorials & Conference
Beijing, China

使用Apache DistributedLog支持交易性的流计算 (Transactional streaming with Apache DistributedLog)

此演讲使用中文 (This will be presented in Chinese)

Sijie Guo (StreamNative)
13:10–13:50 Saturday, 2017-07-15
物联网&实时计算 (IoT & real-time)
Location: 多功能厅2(Function Room 2) 观众水平 (Level): 中级 (Intermediate)

必要预备知识 (Prerequisite Knowledge)

Basic knowledge of distributed systems and messaging and streaming systems

您将学到什么 (What you'll learn)

Understand the technical challenges of exactly once delivery and transaction and learn solutions for achieving it

描述 (Description)


从批处理向流计算架构的演进是企业如何使用数据的一次革命。越来越多的流计算引擎提供了有状态的处理机制和计算运行时的有且仅有一次的语义支持。然而,消息和存储系统里缺乏对于有且仅有一次发送和交易的支持,这使得很难完全使用有状态处理机制。



在本演讲里,Sijie Guo会介绍:



- 消息/流存储系统里实现支持有且仅有一次传输和交易所面临的技术挑战是什么?

- 现有的解决方案是什么?

- Apache DistributedLog是如何帮助实现交易性的流计算的?


The move to streaming architectures from batch processing is a revolution in how companies use data. More and more stream computing engines provide stateful processing and exactly once semantic in computing runtime. However, the lack of exactly once delivery and transaction support in messaging and storage systems makes it difficult to fully utilize the power of stateful processing.

Sijie Guo explores the technical challenges of exactly once delivery and transaction support in messaging and streaming storage systems and explains how Apache DistributedLog helps achieve transactional streaming.

Photo of Sijie Guo

Sijie Guo

StreamNative

Sijie Guo is the tech lead of Twitter’s Messaging group. Sijie is the cocreator of Apache DistributedLog and the PMC chair of Apache BookKeeper.

Connect with O'ReillyData

Use the QR Code to follow OReillyData and get the latest conference information and browse data articles.

WeChat QRcode

 

Stay Connected Image 1
Stay Connected Image 3
Stay Connected Image 2

Read the latest ideas on big data.

ORB Data Site