Mar 15–18, 2020

Life beyond pub/sub: How Zhaopin simplifies stream processing using Pulsar Functions and SQL

Penghui Li (Zhaopin), Jia Zhai (StreamNative)
4:15pm4:55pm Wednesday, March 18, 2020
Location: LL21 C

Who is this presentation for?

Data engineers, data architects, developers

Level

Beginner

Description

With a user base of 100+ million users and a database of 200+ million resumes, Zhaopin is one of the largest online recruiting and career platforms in China. In a previous Strata conference, Penghui Li and Jia Zhai presented their story of using Apache Pulsar to unify multiple isolated messaging technologies into one unified enterprise event bus. Now a year later, the company has evolved its Pulsar use beyond pub/sub messaging. It built its event streaming platform based on Apache Pulsar by leveraging Pulsar Functions and Pulsar SQL and combining existing BI analysis tools. The new event streaming platform simplifies the company’s stream data processing pipeline and powers its recommendation and search services.

You’ll learn from Zhaopin’s experiences of building an event streaming platform based on Apache Pulsar, and how it leverages Pulsar Functions, Pulsar Schema, and Pulsar SQL to simplify its stream processing pipeline.

Prerequisite knowledge

  • A basic understanding of streaming systems, messaging systems, and storage systems (useful but not required)

What you'll learn

  • Understand streaming data integration and processing using Apache Pulsar
Photo of Penghui Li

Penghui Li

Zhaopin

Penghui is a software engineer at Zhaopin and an Apache Pulsar Committer.

Photo of Jia Zhai

Jia Zhai

StreamNative

Jia Zhai is a founding engineer of StreamNative, as well as PMC member of both Apache Pulsar and Apache BookKeeper, and contributes to these two projects continually.

Leave a Comment or Question

Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?

Join the conversation here (requires login)

Contact us

confreg@oreilly.com

For conference registration information and customer service

partners@oreilly.com

For more information on community discounts and trade opportunities with O’Reilly conferences

Become a sponsor

For information on exhibiting or sponsoring a conference

pr@oreilly.com

For media/analyst press inquires