Named entity recognition at scale with deep learning
Who is this presentation for?
- Software engineers, data scientists, and ML engineers
Twitter is what’s happening in the world right now, and operating at such a global scale brings massive engineering challenges. To connect users with the best content, Twitter needs to build up a deep understanding of its text content. Such understanding needs to be scalable to annotate more than 500 million tweets per day, real time to accommodate the live nature of Twitter, and multilingual due to the number of languages Twitter supports.
Sijun He offers insights into how Twitter Cortex built and productionized a deep learning-based NER system to address those challenges. He highlights Twitter’s experimentations with state-of-the-art models (i.e., BERT) and learning methods (i.e., semisupervised learning and active learning), as well as how Twitter has balanced such efforts to keep in sync with recent developments in natural language processing (NLP) with engineering needs.
- A basic understanding of ML, NLP, and deep learning
What you'll learn
- Learn how Twitter developed its NER system from data sampling to labeling and from model development to serving infrastructure
- Understand the models for NER and serving infrastructure needed to put those models into production
Ali Mollahosseini is a Senior ML Engineer and Tech Lead of Content Understanding and Applied Deep-learning (CUAD) team at Twitter Cortex. His research focuses on NLP and developing neural network architectures to improve Twitter’s understanding of content on the platform using the latest advances in deep learning. He received his Ph.D. degree in Computer Engineering from University of Denver in 2017. He has published 15 papers in prestigious journals and conferences, and two patents with more than 500 citations.
Leave a Comment or Question
Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?
Join the conversation here (requires login)
Diversity and Inclusion Sponsor
Premier Exhibitor Plus
R & D and Innovation Track Sponsor
For conference registration information and customer service
For more information on community discounts and trade opportunities with O’Reilly conferences
For information on exhibiting or sponsoring a conference
View a complete list of O'Reilly AI contacts