Presented By
O’Reilly + Cloudera
Make Data Work
March 25-28, 2019
San Francisco, CA

How Zhaopin.com built its enterprise event bus using Apache Pulsar

Sijie Guo (ASF), Penghui Li (Zhaopin)
11:00am11:40am Thursday, March 28, 2019
Secondary topics:  Data Platforms, Media, Marketing, Advertising, Streaming, realtime analytics, and IoT
Average rating: ****.
(4.00, 1 rating)

Who is this presentation for?

  • Managers and data engineers

Level

Beginner

Prerequisite knowledge

  • A basic understanding of streaming systems, messaging systems, and storage systems (useful but not required)

What you'll learn

  • Gain a deep understanding of event bus architecture and how it's being used in production settings with Apache Pulsar

Description

Zhaopin.com is a Chinese online recruitment services provider. As a bilingual job board, Zhaopin.com has one of the largest selections of job vacancies in China, including both prominent local and foreign companies. It has over 2.2 million clients, and its average daily page views are over 68M.

Zhaopin.com has used RabbitMQ for years as its enterprise event bus. As the company grew, the amount of data grew, and the use cases varied widely. Because of this, the original RabbitMQ-based architecture was hard to scale, maintain, and operate. Ultimately, Zhaopin.com chose Apache Pulsar to replace RabbitMQ based architecture in 2018.

Sijie Guo and Penghui Li describe the advantages of Pulsar over RabbitMQ and explain how Pulsar meets the requirements of high durability, high throughput, and low latency. Finally, they detail how Pulsar was put into production at Zhaopin.com and share use cases and their experience operating Pulsar at scale.

Photo of Sijie Guo

Sijie Guo

ASF

Sijie Guo is the PMC chair of Apache BookKeeper and the PMC member of Apache Pulsar. He worked at Twitter before and led the messaging team. Prior to Twitter, he worked on Yahoo! push notification infrastructure.

Photo of Penghui Li

Penghui Li

Zhaopin

Penghui Li is a backend engineer at Zhaopin.com, where he leads Apache Pulsa and contributes heavily to Pulsar open source. Penghui has 5+ years of experience developing message queues and microservices.

Leave a Comment or Question

Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?

Join the conversation here (requires login)