Skip to main content

Fl.UIs: Liquid Mediated Vision-Based Touch Surface

Company: University of California - Berkeley



Fl.UIs (Fluid User Interfaces) are scalable liquid-mediated surfaces that makes touch detection tractable for vision-based systems. Fl.UIs create color changes around a user’s points-of-contact, which is recovered by an overhead camera for touch and gesture input.

While most touch input devices require a distinct or instrumented input device (such as a pen or finger), UC Berkeley’s system is input-agnostic. It uses object-extraction techniques to decouple a computer vision system from the input device, allowing hardware to be unpowered and providing a novel phenomenological input experience. The system also integrates visual feedback cues from the tile to track input-agnostic multi-touch and pressure in realtime.