Presented By
O’Reilly + Cloudera
Make Data Work
March 25-28, 2019
San Francisco, CA

Goodbye, data lake: Why continuous analytics yield higher ROI

Yaron Haviv (iguazio)
2:40pm3:20pm Wednesday, March 27, 2019
Average rating: ****.
(4.00, 2 ratings)

Who is this presentation for?

  • Data engineers, data architects, and software developers

Level

Intermediate

Prerequisite knowledge

  • A general understanding of big data and AI

What you'll learn

  • Understand continuous analytics and its advantages, including concurrent ingestion, enrichment, and analytics (for real-time insights), the ability to run machine learning models in real time during production, and the ability to use serverless architectures to achieve even higher performance

Description

Faced with the need to handle increasing volumes of data, alternative datasets (“alt data”), and AI, many enterprises are working to design or redesign their big data architectures. One traditional approach is to store everything in a data lake, process it via ETL, and analyze it in batch or interactive modes. However, this decade-old approach often fails to generate sufficient ROI.

Yaron Haviv argues for a different approach, in which information is ingested, enriched, and analyzed in context as it arrives, including via machine learning or deep learning, and is then immediately made available to users or to drive automated actions. He explains why it’s possible to take full advantage of modern hardware, microservices, and serverless functions to achieve much higher performance while still benefitting from CI/CD, autoscaling, and fast software rollouts. The resulting “continuous analytics” solutions yield faster answers for the business while remaining simpler and less expensive for IT.

Photo of Yaron Haviv

Yaron Haviv

iguazio

Yaron Haviv is CTO at iguazio. Yaron is a serial entrepreneur with deep technological experience in the fields of big data, cloud, storage and networking. Previously, he was the vice president of data center solutions at Mellanox, where he led technology innovation, software development, and solution integrations, and the CTO and vice president of R&D at Voltaire, a high-performance computing, I/O, and networking company. Yaron is a CNCF member and one of the authors in the CNCF working group.