Presented By
O’Reilly + Intel AI
Put AI to Work
April 15-18, 2019
New York, NY

Building Intelligent Conversational Agents with Transfer Learning and Cognitive Automation

Sumeet Vij (Booz Allen Hamilton), Matt Speck (Booz Allen Hamilton)
2:40pm3:20pm Wednesday, April 17, 2019
Implementing AI
Location: Mercury Rotunda
Secondary topics:  AI in the Enterprise, Models and Methods, Text, Language, and Speech

Who is this presentation for?

AI Iimplementors, Data Scientists, Conversational AI



Prerequisite knowledge

Basic understanding of NLP techniques Background on basic Deep Learning techniques

What you'll learn

•Learn practical examples of applying state of the art Transfer Learning for NLU/NLP techniques to overcome the limitations of current utterance-intent classification models •Learn how a Machine Learning based Process Engine can enable adaptive response, advancing RPA from being just “Robotic” to Cognitive


Current conversational agents/chatbot are limited in their functionality as they have to be explicitly trained via sample user sentences (utterances) that are mapped to customer defined actions (intents). Given the variations on how humans might ask a given question, it is not feasible to provide all possible utterances, limiting the conversational agent’s ability to understand/interpret user inputs. For example, if I ask Alexa, “Is it cold tomorrow?”, it correctly understands the utterance and maps it to the “Weather” intent and tells me the weather, however if I ask “Do I need to wear my sweater tomorrow”, it can’t correctly interpret the utterance.
Recent advances in Deep Learning frameworks for NLP, including ULMFiT, ELMo and Open AI transformer, allow models to go beyond the shallow representations provided by word vectors to provide deep hierarchical representations of language, allowing the capture of high-level semantic concepts. Just like the ImageNet challenge allowed the emergence of generalizable model features for image classification across different categories, we will demonstrate with a fully functional demo how these frameworks enable the creation of models that learn the higher-level nuances of language, vastly improving Natural Language Understanding (NLU). This advance in NLU allows a conversational agent to leverage pre-trained models to understand that “wearing a sweater” is associated with cold weather and ask a clarifying question, “Do you want to check the weather for tomorrow”?
While Robotic Process Agents (RPA) are great for pre-defined rule-based tasks, actual interactions with a user does not always follow a script.
Leveraging Machine Learning algorithms that learn from users and provide adaptive next best action based on previous actions and current context, we will show how RPA automation to become more Cognitive. The session will showcase how a Machine Learning process engine that continuously learns can enable more intelligent RPA.

Photo of Sumeet Vij

Sumeet Vij

Booz Allen Hamilton

Sumeet Vij is a Director in the Strategic Innovation Group (SIG) at Booz Allen Hamilton, where he leads multiple client engagements, research, and strategic partnerships in the field of AI, digital personalization, recommendation systems, chatbots, digital assistants, and conversational commerce. Sumeet is also the practice lead for next-generation digital experiences powered by AI and data science, helping with the large-scale analysis of data and its use to quickly provide deeper insights, create new capabilities, and drive down costs.

Matt Speck

Booz Allen Hamilton

Matt Speck is a data engineer and senior consultant in the Strategic Innovation Group (SIG) at Booz Allen Hamilton, where he works on cognitive solutions projects, building intelligent search and chat applications. Before joining Booz Allen, he taught data science and Python at General Assembly, a coding boot camp with locations across the globe.

Leave a Comment or Question

Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?

Join the conversation here (requires login)


jagesh maharjan | STUDENT
12/19/2018 12:36am EST

I am very excited to attend this conference. Almost all topics are related to my field of research especially NLP/NLU.

In this section “Building Intelligent Conversational Agents with Transfer Learning and Cognitive Automation”, I have a quick question, does this topic covers handling multi-language in single sentence of user response. If so, how is sentence embedding created. And, what will be the Bot/Agent response (in terms of language). Also, currently, I am working with BERT published by Google NLU.