Put AI to work
June 26-27, 2017: Training
June 27-29, 2017: Tutorials & Conference
New York, NY

Conversational AI at large scale

Yishay Carmiel (IntelligentWire)
2:35pm3:15pm Wednesday, June 28, 2017
Interacting with AI
Location: Sutton South/Regent Parlor Level: Beginner
Secondary topics:  Deep Learning, Natural Language, Speech and Voice, User interface and experience

Prerequisite Knowledge

  • Basic knowledge of deep learning (particularly notations and proofs of concept)

What you'll learn

  • Understand the challenges of and techniques for scaling up speech recognition, natural languages processing, and cutting-edge deep learning algorithms at large scale for conversational AI
  • Learn how to move forward from a proof of concept to a full-scale end-to-end product


There has been a quantum leap in the performance of conversational AI. From speech recognition to machine translation and language understanding, deep learning made its mark. However, scaling and productizing these breakthroughs remains a big challenge—while implementing a cutting-edge algorithm using an open source deep learning framework is certainly doable, creating a scalable product that encapsulates these amazing algorithms and runs them at large scale is difficult.

Yishay Carmiel shares techniques and tips on how to take advantage of large datasets, accelerate training, and create an end-to-end product.

Topics include:

  • Recent deep learning breakthroughs for conversational AI
  • Challenges and lessons learned for scaling up deep learning for a full-scale product
  • Open issues and challenges for the near and far future
  • A real-world example of a system that can analyze 1,000,000 hours per day of conversational data
  • How to take advantage the usage of ultra-large-scale data and recent breakthroughs in neural-based speech representation to create a speaker identification system that beats the state-of-the-art results by more then 30%
Photo of Yishay Carmiel

Yishay Carmiel


Yishay Carmiel is the founder of IntelligentWire, a company that develops and implements industry-leading deep learning and AI technologies for automatic speech recognition (ASR), natural language processing (NLP), and advanced voice data extraction, and is the head of Spoken Labs, the strategic artificial intelligence and machine learning research arm of Spoken Communications. Yishay and his teams are currently working on bleeding-edge innovations that make the real-time customer experience a reality—at scale. Yishay has nearly 20 years’ experience as an algorithm scientist and technology leader building large-scale machine learning algorithms and serving as a deep learning expert.