Garrett Hoffman walks you through deep learning methods for natural language processing and natural language understanding tasks, using a live example in Python and TensorFlow with StockTwits data. Methods include word2vec, recurrent neural networks and variants (LSTM, GRU), and convolutional neural networks. You’ll explore use cases and motivations for using these methods, gain a conceptual intuition about how these models work, and briefly review the mathematics that underly each methodology.
Outline:
Representation learning for text with word2vec word embeddings: The CBOW and skip gram models; how to train custom word embeddings; how to use pretrained word embeddings, such as those trained on Google News
Traditional recurrent neural networks (RNNs): Why these types of models often perform better than traditional alternatives; variants to traditional RNNs, such as long short-term memory (LSTM) cells and gated recurrent units (GRUs); why these models provide improvements in accuracy
Convolutional neural networks (CNNs): Why CNNs that are traditionally applied to computer vision are now being applied to language models; advantages that these have over RNNs; how RNNs can be used to learn generative models for text synthesis and the applications of this method
Garrett Hoffman is a director of data science at StockTwits, where he leads efforts to use data science and machine learning to understand social dynamics and develop research and discovery tools that are used by a network of over one million investors. Garrett has a technical background in math and computer science but gets most excited about approaching data problems from a people-first perspective—using what we know or can learn about complex systems to drive optimal decisions, experiences, and outcomes.
Comments on this page are now closed.
For exhibition and sponsorship opportunities, email aisponsorships@oreilly.com
For information on trade opportunities with O'Reilly conferences, email partners@oreilly.com
View a complete list of AI contacts
©2019, O'Reilly Media, Inc. • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • confreg@oreilly.com
Comments
Fantastic session. Great primer on NLP and Deep Learning. I learned a lot – thank you!