Presented By
O’Reilly + Cloudera
Make Data Work
March 25-28, 2019
San Francisco, CA

User-based real-time product recommendations leveraging deep learning using Analytics Zoo on Apache Spark and BigDL

Luyang Wang (Office Depot), Jing (Nicole) Kong (Office Depot), Guoqiong Song (Intel), Maneesha Bhalla (Office Depot)
4:20pm5:00pm Wednesday, March 27, 2019
Secondary topics:  Deep Learning, Retail and e-commerce
Average rating: ****.
(4.00, 2 ratings)

Who is this presentation for?

  • Machine and deep learning practitioners and big data professionals

Level

Intermediate

Prerequisite knowledge

  • A basic understanding of Apache Spark, machine learning, and deep learning

What you'll learn

  • Explore a runtime recommendation system built with neural networks using BigDL on Apache Spark
  • Gain insight into the process for developing a full end-to-end deep learning workflow, including elements of big data and machine learning in the cloud

Description

User-based recommendation systems have become an important topic in ecommerce. Traditional approaches like rule-based systems can’t consider user-specific characters and the implicit relationship between users and products to provide customized recommendation solutions. The newly developed deep neural networks have shed light on a path to success by chaptering nonlinear relationships in the user-item dataset, leveraging user, product attributes, and user-item interaction history. With the huge dataset a big ecommerce company commands, a training model in the cloud is a more achievable and efficient solution.

BigDL, a new distributed deep learning framework on Apache Spark, provides easy and seamlessly integrated big data and deep learning capabilities for big data users and data scientists. Analytics Zoo is an analytics and AI platform for Spark and BigDL; it helps users build and productionize deep learning apps for big data at scale. The deep learning algorithms in BigDL result in much better results compared to traditional recommendation algorithms. Lu Wang, Nicole Kong, Guoqiong Song, and Maneesha Bhalla explain how to build a user-based recommendation system with neural collaborative filtering and wide and deep models using Analytics Zoo with BigDL on Apache Spark in the cloud. They then demonstrate how to deploy the model and serve the real-time user-based recommendation on a website.

Photo of Luyang Wang

Luyang Wang

Office Depot

Lu Wang is a data scientist and big data engineer at Office Depot, where he works on machine learning and big data analytics. He’s engaged in developing distributed machine learning applications and real-time web services for Office Depot’s digital business platform.

Office Depot数据科学家/大数据工程师,负责机器学习和大数据分析。他致力于为Office Depot数字业务平台开发分布式机器学习应用和实时Web服务。

Photo of Jing (Nicole) Kong

Jing (Nicole) Kong

Office Depot

Jing (Nicole) Kong is a data scientist at Office Depot, where she deals with big data and transforms data and models into products and service that drive business. She’s experienced with a number of different machine learning and deep learning models.

Jing(Nicole)是一位数据科学家,拥有构建不同的机器学习/深度学习模型、处理大数据以及将数据/模型转换为推动业务发展的产品和服务的经验。

Photo of Guoqiong Song

Guoqiong Song

Intel

Guoqiong Song is a senior deep learning software engineer on the big data technology team at Intel. She’s interested in developing and optimizing distributed deep learning algorithms on Spark. She holds a PhD in atmospheric and oceanic sciences with a focus on numerical modeling and optimization from UCLA.

Guoqiong Song是英特尔大数据技术团队的高级深度学习软件工程师。 她拥有加州大学洛杉矶分校的大气和海洋科学博士学位,专业方向是数值建模和优化。 她现在的研究兴趣是开发和优化分布式深度学习算法。

Photo of Maneesha Bhalla

Maneesha Bhalla

Office Depot

Maneesha Bhalla is director of advanced analytics at Office Depot. A thought leader with 16+ years of experience in data analytics and data science specifically in customer analytics, Maneesha is passionate about data-driven approaches to turn data into insights and has a proven ability to build and lead highly efficient teams to enable the organization’s strategic priorities. Maneesha holds a certificate from the Executive Management Program in Global Business Management at IIM Calcutta and a bachelor’s degree in chemical engineering from Pune University.