Recently, deep neural networks (DNNs) have been used with great success to solve time series forecasting problems such as web traffic forecasts, product sales forecasts, and financial time series forecasts. The ability to capture long-range and nonlinear data dependencies is the key reason why deep learning methods can achieve better forecast accuracy than traditional machine learning approaches. However, DNNs need more time and data to train.
Chenhui Hu offers an overview of dilated neural networks—a class of DNNs in the frontier of deep learning research that tackle the above challenges—and demonstrates their advantages with real use cases. This class of networks includes both dilated convolutional neural networks (dilated CNNs) and dilated recurrent neural networks (dilated RNNs). Based on dilated connections, dilated neural networks can capture data dependencies in a large spatial or temporal range while only requiring that the number of parameters grow logarithmically. As a result, they are more efficient to train when compared with the current state-of-the-art DNN models such as long short-term memory (LSTM) models.
Chenhui demonstrates the advantages of dilated neural networks in terms of training efficiency and forecast accuracy by applying them to solve sales forecasting and financial time series forecasting problems and shows that they can obtain at least as good or better accuracy on such nonlinear, noisy forecasting tasks.
Source code for the implementations will be available in GitHub.
Chenhui Hu is a data scientist in the Cloud and AI Division at Microsoft. He works on developing machine learning and big data solutions for internal and external customers. His current interests include time series forecasting, natural language processing, large-scale machine learning, and deep learning. He received his PhD degree from Harvard University with a focus on imaging data mining and signal processing. He has presented his work in many international conferences including O’Reilly AI Conference 2019 and O’Reilly Strata 2019.
©2019, O'Reilly Media, Inc. • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • firstname.lastname@example.org