Multimodal design is an approach that reflects how we use our senses together in the physical world. People don’t use the complete capacity of all of their senses all of the time—that would be overwhelming and exhausting. Instead, we use subsets of our senses in specific combinations during different experiences. By focusing on the subset of senses used, interfaces can deliver more meaningful, intuitive experiences that better suit their context and use. Understanding multimodal design can help teams build products that engage people more intuitively and integrate into real-life situations in a more focused, relevant, and understandable way.
Christine Park and John Alderman outline the framework of multimodal design and explain how to apply it to connected-device experiences. Christine and John review new products that utilize a multimodal-design approach, discuss the benefits of this approach to users, and summarize the key technologies and design practices that enable multimodal interactions. Two key concepts of this approach are modalities—specific subsets of senses used to perceive different kinds of experiences—and cues—the individual units of perception or communication within these modalities.
Christine Park works on wearables at Basis, an Intel company. As a designer, director, and strategist, she has won a Cannes CyberLion for her work on Touchwall, a public interactive installation, and has two patents for her work designing Vudu’s SmartTV and Playstation 4 applications. She has worked on a broad range of natural interfaces, including touch, gesture, and speech, for companies like Xbox, HP, and Panasonic. Christine’s background in industrial and fashion design has informed her approach to experience design, particularly around natural interfaces and context-specific design in the physical world.
John Alderman is a writer, creative director, and strategist. He has written two books about technology and culture, Sonic Boom (a New York Times notable book) and Core Memory (a Design Observer book of the year), and contributed to Domus, Etapes, Rhizome, Wired, and the Guardian. John is a regular speaker on technology, design, and culture and has been interviewed by the BBC, NPR, CNN, and many others.
©2016, O'Reilly Media, Inc. • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • firstname.lastname@example.org