Apache Kylin is an extreme distributed OLAP engine on Hadoop. The basic idea of Apache Kylin is replacing online calculation with offline precalculation, and its most important concept is cube. Apache Kylin provides a theory of cube designing with multiple optimization rules. Well-tuned cubes bring about the best performance with the least cost but require a comprehensive understanding of tuning principles to use. Tuning is the key to keep performance no matter how business requirements change, and leveraging AI into big data tuning can save lots of workforce and learning costs. The solution for Kylin is KyBot.
Dong Li and Luke Han explain advanced tuning and introduce KyBot, an online tuning service for Apache Kylin that provides self-service functionalities for system diagnostics and tuning. Based on AI algorithms over historical logs analysis and knowledge base built by Apache Kylin core developers, KyBot provides rich lifecycle tracking dashboards for queries and building jobs profiling, which help to find bottlenecks in seconds. More to the point, KyBot also provides suggestions about tuning and optimization to download, with which users can simply done tuning by directly importing what’s downloaded.
Dong Li is Technical Partner and Director of Partner Engineering at Kyligence, focus on big data technology and Apache Kylin Eco-system development. Dong is also an Apache Kylin committer and PMC member. Previously, Dong was a senior software engineer at eBay and a software development engineer at Microsoft.
Luke (Qing) Han is the coounder and CEO of Kyligence, which provides a leading intelligent data platform powered by Apache Kylin to simplify big data analytics from on-premises to the cloud. Luke is the cocreator and PMC chair of Apache Kylin, where he contributes his passion to driving the project’s strategy, roadmap, and product design. For the past few years, Luke has been working on growing Apache Kylin’s community, building its ecosystem, and extending its adoption globally. Previously, he was big data product lead at eBay, where he managed Apache Kylin, engaged customers, and coordinated various teams from different geographical locations, and chief consultant at Actuate China.
©2017, O'Reilly Media, Inc. • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • email@example.com