Deep learning offers a powerful suite of techniques for building predictive models and creating value from large stores of digital data that are increasingly common in domains as diverse as manufacturing, finance, advertising, and healthcare. Deep learning models have achieved near or better than human performance in machine translation, speech recognition, and image classification and recently beat the world’s best human Go players, a feat that was believed to be decades away.
The rise of deep learning has several implications for data mining and analytics. First, building successful predictive models depends less on designing good features than it does upon matching architectures to problems and tuning hyperparameters. These in turn require a new set of skills and intuitions among practitioners. Second, deep learning models are computationally expensive to train and validate. Training even simple models on modestly sized datasets can require specialized hardware like GPUs while state-of-the-art performance featured in popular press often involves training large models with massive datasets on complex distributed compute platforms.
Dave Kale, Susan Eraly, and Josh Patterson provide a practical introduction to training neural networks using Deeplearning4j (DL4J), the open source, Java-based deep learning framework. Through both presented material and hands-on exercises, you’ll learn how to meet the challenges that arise when you apply deep learning to your business problems as Dave, Melanie, Susan, and Josh walk you through using DL4J to build and train several canonical neural net architectures, including a convolutional network for image classification and a recurrent neural net for sequence modeling.
David Kale is a deep learning engineer at Skymind and a PhD candidate in computer science at the University of Southern California, where he is advised by Greg Ver Steeg of the USC Information Sciences Institute. His research uses machine learning to extract insights from digital data in high-impact domains, such as healthcare, and he collaborates with researchers from Stanford Center for Biomedical Informatics Research and the YerevaNN Research Lab. Recently, David pioneered the application of deep learning to modern electronic health records data. At Skymind, he works with clients and partners to develop and deploy deep learning solutions for real world problems. David co-organizes the Machine Learning for Healthcare Conference (MLHC) and has served as a judge in several XPRIZE competitions, including the upcoming IBM Watson AI XPRIZE. He is the recipient of the Alfred E. Mann Innovation in Engineering Fellowship.
Susan Eraly is a software engineer at Skymind, where she contributes to Deeplearning4j. Previously, Susan worked as a senior ASIC engineer at NVIDIA and as a data scientist in residence at Galvanize.
Josh Patterson is the director of field engineering for Skymind. Previously, Josh ran a big data consultancy, worked as a principal solutions architect at Cloudera, and was an engineer at the Tennessee Valley Authority, where he was responsible for bringing Hadoop into the smart grid during his involvement in the openPDC project. Josh is a cofounder of the DL4J open source deep learning project and is a coauthor on the upcoming O’Reilly title Deep Learning: A Practitioner’s Approach. Josh has over 15 years’ experience in software development and continues to contribute to projects such as DL4J, Canova, Apache Mahout, Metronome, IterativeReduce, openPDC, and JMotif. Josh holds a master’s degree in computer science from the University of Tennessee at Chattanooga, where he did research in mesh networks and social insect swarm algorithms.
Comments on this page are now closed.
©2017, O'Reilly Media, Inc. • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • firstname.lastname@example.org
Apache Hadoop, Hadoop, Apache Spark, Spark, and Apache are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries, and are used with permission. The Apache Software Foundation has no affiliation with and does not endorse, or review the materials provided at this event, which is managed by O'Reilly Media and/or Cloudera.