Presented By
O’Reilly + Cloudera
Make Data Work
March 25-28, 2019
San Francisco, CA
Please log in

How Zhaopin.com built its enterprise event bus using Apache Pulsar

Sijie Guo (StreamNative), Penghui Li (Zhaopin)
11:00am–11:40am Thursday, March 28, 2019
Data Engineering & Architecture, Streaming and IoT
 Location: 2006
Secondary topics:  Data Platforms, Media, Marketing, Advertising, Streaming, realtime analytics, and IoT
Average rating: ****.
(4.00, 1 rating)
Download slides (PDF)

Who is this presentation for?

  • Managers and data engineers

Level

Beginner

Prerequisite knowledge

  • A basic understanding of streaming systems, messaging systems, and storage systems (useful but not required)

What you'll learn

  • Gain a deep understanding of event bus architecture and how it's being used in production settings with Apache Pulsar

Description

Zhaopin.com is a Chinese online recruitment services provider. As a bilingual job board, Zhaopin.com has one of the largest selections of job vacancies in China, including both prominent local and foreign companies. It has over 2.2 million clients, and its average daily page views are over 68M.

Zhaopin.com has used RabbitMQ for years as its enterprise event bus. As the company grew, the amount of data grew, and the use cases varied widely. Because of this, the original RabbitMQ-based architecture was hard to scale, maintain, and operate. Ultimately, Zhaopin.com chose Apache Pulsar to replace RabbitMQ based architecture in 2018.

Sijie Guo and Penghui Li describe the advantages of Pulsar over RabbitMQ and explain how Pulsar meets the requirements of high durability, high throughput, and low latency. Finally, they detail how Pulsar was put into production at Zhaopin.com and share use cases and their experience operating Pulsar at scale.

Photo of Sijie Guo

Sijie Guo

StreamNative

Sijie Guo is the founder and CEO of StreamNative, a data infrastructure startup offering a cloud native event streaming platform based on Apache Pulsar for enterprises. He’s also the vice president of Apache BookKeeper and a PMC member of Apache Pulsar. Previously, he was the tech lead for the Messaging Group at Twitter and worked on push notification infrastructure at Yahoo.

Photo of Penghui Li

Penghui Li

Zhaopin

Tech lead of messaging system in zhaopin.com, Apache Pulsar Committer.