O'Reilly、Cloudera 主办
Make Data Work
2017年7月12-13日:培训
2017年7月13-15日:会议
北京,中国

使用Apache DistributedLog支持交易性的流计算 (Transactional streaming with Apache DistributedLog)

此演讲使用中文 (This will be presented in Chinese)

Sijie Guo (StreamNative)
13:10–13:50 Saturday, 2017-07-15
物联网&实时计算 (IoT & real-time)
地点: 多功能厅2(Function Room 2) 观众水平 (Level): 中级 (Intermediate)

必要预备知识 (Prerequisite Knowledge)

Basic knowledge of distributed systems and messaging and streaming systems

您将学到什么 (What you'll learn)

Understand the technical challenges of exactly once delivery and transaction and learn solutions for achieving it

描述 (Description)


从批处理向流计算架构的演进是企业如何使用数据的一次革命。越来越多的流计算引擎提供了有状态的处理机制和计算运行时的有且仅有一次的语义支持。然而,消息和存储系统里缺乏对于有且仅有一次发送和交易的支持,这使得很难完全使用有状态处理机制。



在本演讲里,Sijie Guo会介绍:



- 消息/流存储系统里实现支持有且仅有一次传输和交易所面临的技术挑战是什么?

- 现有的解决方案是什么?

- Apache DistributedLog是如何帮助实现交易性的流计算的?


The move to streaming architectures from batch processing is a revolution in how companies use data. More and more stream computing engines provide stateful processing and exactly once semantic in computing runtime. However, the lack of exactly once delivery and transaction support in messaging and storage systems makes it difficult to fully utilize the power of stateful processing.

Sijie Guo explores the technical challenges of exactly once delivery and transaction support in messaging and streaming storage systems and explains how Apache DistributedLog helps achieve transactional streaming.

Photo of Sijie Guo

Sijie Guo

StreamNative

Sijie Guo is the tech lead of Twitter’s Messaging group. Sijie is the cocreator of Apache DistributedLog and the PMC chair of Apache BookKeeper.

联系OReillyData

关注OReillyData微信号获取最新会议信息并浏览前沿数据文章。

WeChat QRcode

 

Stay Connected Image 1
Stay Connected Image 3
Stay Connected Image 2

阅读关于大数据的最新理念。

ORB Data Site