Natural language processing (NLP) involves the application of machine learning and other statistical techniques to derive insights from human language. With large volumes of data exchanged as text (in the form of documents, tweets, email, chat, and so on), NLP techniques are indispensable to modern intelligent applications. The applications range from enterprise to pedestrian.
Delip Rao and Brian McMahan explore natural language processing with deep learning, walking you through neural network architectures and NLP tasks and teaching you how to apply these architectures for those tasks.
Day 1
Environment setup and data download
Fundamentals
Representations for words: Word embeddings
Deep learning frameworks
Feed-forward networks for NLP
Modeling subword units with convolutional networks
Day 2
Sequence modeling
Recurrent neural networks (RNNs) to model sequences
Structured prediction methods
Attention
From sequence models to sequence-to-sequence models
Advanced topics
DL modeling for common NLP tasks
Choose your own adventure
DL for NLP: Best practices
Wrap-up and Q&A
Delip Rao is the vice president of research at the AI Foundation, where he leads speech, language, and vision research efforts for generating and detecting artificial content. Previously, he founded the AI research consulting company Joostware and the Fake News Challenge, an initiative to bring AI researchers across the world together to work on fact checking-related problems, and he was at Google and Twitter. Delip is the author of a recent book on deep learning and natural language processing. His attitude toward production NLP research is shaped by the time he spent at Joostware working for enterprise clients, as the first machine learning researcher on the Twitter antispam team, and as an early researcher at Amazon Alexa.
Brian McMahan is a data scientist at Wells Fargo, working on projects that apply natural language processing (NLP) to solve real world needs. Recently, he published a book with Delip Rao on PyTorch and NLP. Previously, he was a research engineer at Joostware, a San Francisco-based company specializing in consulting and building intellectual property in NLP and Deep Learning. Brian is wrapping up his PhD in computer science from Rutgers University, where his research focuses on Bayesian and deep learning models for grounding perceptual language in the visual domain. Brian has also conducted research in reinforcement learning and various aspects of dialogue systems.
Get the Platinum pass or the Training pass to add this course to your package.
Comments on this page are now closed.
For exhibition and sponsorship opportunities, email aisponsorships@oreilly.com
For information on trade opportunities with O'Reilly conferences, email partners@oreilly.com
View a complete list of AI contacts
©2019, O'Reilly Media, Inc. • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • confreg@oreilly.com
Comments
Hello Delip/Brian,
When should we expect to receive the course materials (slides, Jupyter notebooks)?
Thank you
P.S. I signed up already on the Google form using the link given in the course.
Hi, I am for another training and cannot attend NLP :( Will be you support materials available somehow for conference participants?
Thanks
I think windows compatibility might be working now. If you are able to get it working, that is great! Just as long as you are aware that there is a potential risk involved (if, for example, some features of the library don’t work with Windows), then it should be fine. O’Reilly will be providing a Jupyter instance for each attendee as well, so that is always there as backup.
The environment setup instructions indicate that we cannot use Windows directly. However, after some tweaking (0-dim tensor indexing; specifying utf8 encoding when reading in data files) I was able to get all the joosthub/pytorch-nlp-tutorial-nyc2017 notebooks working on my Windows 10 laptop. Or at least I think it’s all working—I’m a beginner. Anything in particular I should double-check, or is there other material that definitely won’t work? I typically prefer my macbook (and its GPU is CUDA compatible) but this windows laptop is light! :-)
Looks like this course is sold out. Is there any way the number of spots could be increased?
Thank you!
what background do I need? I am a software engineering manager. Do I only need basics of Python? I don’t have much background in ML