Presenting using Two-Handed Interaction in Open Space
Based on Johnny Lee's original idea of finger tracking with a Wii Remote, we created a finger tracking system that uses the Wii Remote and gloves fitted with retro-reflective markers. The hardware setup consists of the Wii Remote, an array of infrared LEDs, and a bluetooth dongle, in addition to a laptop and projector presentation setup. The project aimed at enabling free-handed multi-touch interaction, where problems arise such as having to identify the fingers of each hand and to recognize pinching for interaction. The final system allows dual-»touch« interaction with videos, images, and slide decks, and is designed to be used for presentations.
Paper download: (1.4 MB)
(:neo_flv-player (http:../personal/videos/)Vlaming_2008_PTI(.flv) width=320 height=240 startimage="../personal/videos/Vlaming_2008_PTI.jpg" -link:)
Download the video as AVI-MPEG4 (15.9MB) or watch it on YouTube.
Download a demo of the Two-Handed Interaction in Open Space (Win32, 28.3 MB) using the presentation we showed at Tabletop 2008 and try it out yourself. The source code of a rewritten C# version based on WPF (Win32, 126 kB) that contains only the recognition, pairing, and pinching part can also be downloaded. To be functional, however, both demos require some hardware (Wiimote, Bluetooth dongle, LED array, gloves with retro-reflective markers).
|Luc Vlaming (2008) Human Interfaces – Finger Tracking Applications. Bachelor thesis, Department of Mathematics and Computing Science, University of Groningen, The Netherlands, 2008.|
This work was done at the University of Groningen, the Netherlands.