Presenting using Two-Handed Interaction in Open Space

Description:

Based on Johnny Lee's original idea of finger tracking with a Wii Remote, we created a finger tracking system that uses the Wii Remote and gloves fitted with retro-reflective markers. The hardware setup consists of the Wii Remote, an array of infrared LEDs, and a bluetooth dongle, in addition to a laptop and projector presentation setup. The project aimed at enabling free-handed multi-touch interaction, where problems arise such as having to identify the fingers of each hand and to recognize pinching for interaction. The final system allows dual-»touch« interaction with videos, images, and slide decks, and is designed to be used for presentations.

Paper download: (1.4 MB)

Video:

Download the video as AVI-MPEG4 (15.9MB) or watch it on YouTube.

Demo:

Download a demo of the Two-Handed Interaction in Open Space (Win32, 28.3 MB) using the presentation we showed at Tabletop 2008 and try it out yourself. The source code of a rewritten C# version based on WPF (Win32, 126 kB) that contains only the recognition, pairing, and pinching part can also be downloaded. To be functional, however, both demos require some hardware (Wiimote, Bluetooth dongle, LED array, gloves with retro-reflective markers).

Additional material:

slide deck of the Tabletop 2008 talk (PDF, 1.8MB)

Cross-Reference:

Johhny Lee's page on follow-ups of of his own project

Main Reference:

Luc Vlaming, Jasper Smit, and Tobias Isenberg (2008) Presenting using Two-Handed Interaction in Open Space. In Sriram Subramaniam and Shahram Izadi, eds., Proceedings of the 3^rd Annual IEEE Workshop on Horizontal Interactive Human-Computer Systems (Tabletop, October 1–3, Amsterdam, The Netherlands). IEEE Computer Society, Los Alamitos, pages 31–34, 2008.

BibTeX entry:



@INPROCEEDINGS{Vlaming:2008:PTI,
  author      = {Luc Vlaming and Jasper Smit and Tobias Isenberg},
  title       = {Presenting using Two-Handed Interaction in Open Space},
  booktitle   = {Proceedings of the 3\textsuperscript{rd} Annual IEEE Workshop on Horizontal Interactive Human-Computer Systems (Tabletop, October 1--3, Amsterdam, The Netherlands)},
  OPTeditor   = {Sriram Subramaniam and Shahram Izadi},
  year        = {2008},
  pages       = {31--34},
  publisher   = {IEEE Computer Society},
  address     = {Los Alamitos},
  doi         = {10.1109/TABLETOP.2008.4660180},
  doi_url     = {https://doi.org/10.1109/TABLETOP.2008.4660180},
  shortdoi    = {10/cpqvdc},
  url         = {https://tobias.isenberg.cc/p/Vlaming2008PTI},
  url2        = {https://doi.org/10.1109/TABLETOP.2008.4660180},
  pdf         = {https://tobias.isenberg.cc/personal/papers/Vlaming_2008_PTI.pdf},
}

Other Reference:

Luc Vlaming (2008) Human Interfaces – Finger Tracking Applications. Bachelor thesis, Department of Mathematics and Computing Science, University of Groningen, The Netherlands, 2008.

BibTeX entry:



@MASTERSTHESIS{Vlaming:2008:HIF,
  author      = {Luc Vlaming},
  title       = {Human Interfaces -- Finger Tracking Applications},
  type        = {Bachelor thesis},
  year        = {2008},
  school      = {Department of Mathematics and Computing Science, University of Groningen},
  address     = {The Netherlands},
  url         = {https://fse.studenttheses.ub.rug.nl/8472/},
  url2        = {https://tobias.isenberg.cc/VideosAndDemos/Vlaming2008PTI},
  pdf         = {https://tobias.isenberg.cc/personal/papers_students/Vlaming_2008_HIF.pdf},
}

This work was done at the University of Groningen, the Netherlands.