Design the Future
January 19–20, 2016: Training
January 20–22, 2016: Conference
San Francisco, CA

I hear voices: Explorations of multidevice experiences with conversational assistants

3:45pm Friday, 01/22/2016
The new fundamentals
Location: Generals Residence Ballroom
Average rating: ****.
(4.50, 4 ratings)
Slides:   external link

Multiscreen experiences are powerful. Starting a task on one device and finishing on another or having devices work together to create a unique experience are just some of the ways we divide our time between different devices based on context. (Apple’s Handoff and Amazon’s Whispersync are two notable examples.)

Conversational assistants, such as Siri, Alexa, and Cortana, have evolved over the past few years. Their ability to have natural conversations with users and provide real value is increasing. But what happens when one of these conversational agents exists on your phone, in your watch, in your car, and in your living room? When you say “Hi Siri,” do all your devices answer?

Karen Kaushansky reviews the different approaches to designing conversational agents and explains why design matters. After looking at the shortcomings of the experience with today’s assistants, Karen explores new paradigms for using speech recognition across devices and starts to define multidevice experiences with conversational assistants.

Photo of karen kaushansky

karen kaushansky

Zoox

Karen Kaushansky is director of experience for Zoox, helping build an autonomous vehicle for the future. Named one of the “75 Best Designers in Technology” from Business Insider, Karen creates meaningful and connected experiences in the physical world spanning hardware and software. She worked for Jawbone, designing interactive and audio experiences on devices including Big Jambox, Mini Jambox Icon, and UP, and has worked on other smart connected products, such as the Cinder Sensing Cooker and Sensilk smart clothing. Karen worked for many years as a voice user-interface designer for Tellme/Microsoft, designing complex speech recognition systems, such as Ford Sync and Tellme for Windows Mobile.