Presented By O’Reilly and Intel AI
Put AI to Work
April 29-30, 2018: Training
April 30-May 2, 2018: Tutorials & Conference
New York, NY

The cognitive IoT and eldercare

David C Martin (IBM Watson)
4:50pm–5:30pm Tuesday, May 1, 2018
Interacting with AI
Location: Grand Ballroom West

Who is this presentation for?

  • CTOs, CEOs, COOs, and line of business VPs

Prerequisite knowledge

  • A basic understanding of the experimental method (i.e., hypothesis, criteria, experimentation, and results)

What you'll learn

  • Explore a cognitive solution for eldercare that uses HomeAssistant, the Intu open source project, and IBM's Watson cognitive services


David Martin explores cognitive function in conjunction with edge computing and IoT sensors and actuators for eldercare scenarios—specifically the identification of individuals, daily activity monitoring, and aberration detection performed on-premises using HomeAssistant, the Intu open source project, and IBM’s Watson cognitive services.

The Intu open source project, initiated at IBM, provides a set of service gateways to IBM Watson’s portfolio of AAS cognitive offerings, including conversation and visual recognition. David demonstrates Watson integration with home automation platform HomeAssistant using Intu, detailing the required architecture for HomeAssistant and Intu to interoperate and bring Watson services into the HomeAssistant ecosystem.

Sensing and responding at the edge requires a full stack of capabilities, both in the cloud and at the edge, as well as a full lifecycle for methods and apparatus used to take actions in response to signals detected. This full stack leverages the HomeAssistant open source project for integration with various IoT sensors and actuators, as well as open standard interapplication communications (e.g., REST and MQTT). High-availability capabilities include integration with commercial applications (e.g., Apple, Amazon, and Google) and other open source and DIY projects.

With HomeAssistant as a foundation for the embodiment of a cognitive agent, the capabilities of cognitive applications (e.g., AgeAtHome) could be generalized for broader consumption. Notably, this includes abstraction of the visual recognition capabilities of Watson as a “cognitive camera” and expresses the requisite input and output in the context of HomeAssistant. Leveraging the packaging of HomeAssistant as Linux containers with orchestration through a supervisor,, the cognitive camera is packaged as an add-on that exposes new capabilities for HomeAssistant configuration and use in presence detection and activity monitoring.

Photo of David C Martin

David C Martin

IBM Watson

David Martin works at IBM Watson, where he is currently investigating the full stack and full lifecycle of cognitive agents using the scenario of eldercare assistance. A pioneer and early adopter in the web, the cloud, ecommerce, and data sciences, David holds a number of patents.