Life beyond pub/sub: How Zhaopin simplifies stream processing using Pulsar Functions and SQL
Who is this presentation for?Data engineers, data architects, developers
With a user base of 100+ million users and a database of 200+ million resumes, Zhaopin is one of the largest online recruiting and career platforms in China. In a previous Strata conference, Penghui Li and Jia Zhai presented their story of using Apache Pulsar to unify multiple isolated messaging technologies into one unified enterprise event bus. Now a year later, the company has evolved its Pulsar use beyond pub/sub messaging. It built its event streaming platform based on Apache Pulsar by leveraging Pulsar Functions and Pulsar SQL and combining existing BI analysis tools. The new event streaming platform simplifies the company’s stream data processing pipeline and powers its recommendation and search services.
You’ll learn from Zhaopin’s experiences of building an event streaming platform based on Apache Pulsar, and how it leverages Pulsar Functions, Pulsar Schema, and Pulsar SQL to simplify its stream processing pipeline.
- A basic understanding of streaming systems, messaging systems, and storage systems (useful but not required)
What you'll learn
- Understand streaming data integration and processing using Apache Pulsar
Penghui is a software engineer at Zhaopin and an Apache Pulsar Committer.
Jia Zhai is a founding engineer of StreamNative, as well as PMC member of both Apache Pulsar and Apache BookKeeper, and contributes to these two projects continually.
Leave a Comment or Question
Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?
Join the conversation here (requires login)
Premier Diamond Sponsors
Premier Exhibitor Plus
For conference registration information and customer service
For more information on community discounts and trade opportunities with O’Reilly conferences
For information on exhibiting or sponsoring a conference
For media/analyst press inquires