Presented By O'Reilly and Cloudera
Make Data Work
Dec 4–5, 2017: Training
Dec 5–7, 2017: Tutorials & Conference
Singapore

LINE's log analysis platform

Wataru Yukawa (LINE)
11:15am11:55am Thursday, December 7, 2017
Average rating: ****.
(4.00, 3 ratings)

Who is this presentation for?

  • Data engineers

Prerequisite knowledge

  • A basic understanding of Hadoop and Hive

What you'll learn

  • Explore LINE's data architecture and tool set

Description

Data is a very important asset to LINE, one of the most popular messaging applications in Asia. Wataru Yukawa explains how LINE gets the most out of its data using a Hadoop data lake and an in-house log analysis platform based on HDP (Hadoop, Hive), Presto, and Azkaban. Wataru offers an overview of the platform along with some useful tools created at LINE, including yanagishima, which helps analysts check data to create reports or find incorrect data.

Photo of Wataru Yukawa

Wataru Yukawa

LINE

Wataru Yukawa is a data engineer at LINE, where he is creating and maintaining a log analysis platform based on Hadoop, Hive, Fluentd, Presto, and Azkaban and working on aggregating log and RDBMS data with Hive and reporting using BI tools.

Comments on this page are now closed.

Comments

Picture of Wataru Yukawa
Wataru Yukawa | DATA ENGINEER
12/07/2017 4:47am +08

You can preview presentation file https://www.slideshare.net/wyukawa/strata2017-sg