Mouse, Tactile, and Tangible Input for 3D Manipulation

Description:

We evaluate the performance and usability of mouse-based, touch-based, and tangible interaction for manipulating objects in a 3D virtual environment. This comparison is a step toward a better understanding of the limitations and benefits of these existing interaction techniques, with the ultimate goal of facilitating an easy transition between the different 3D data exploration environments. For this purpose we analyze participants' performance in 3D manipulation using a docking task. We measured completion times, docking accuracy, as well as subjective criteria such as fatigue, workload, and preference. Our results show that the three input modalities provide similar levels of precision but require different completion times. We also discuss our qualitative observations as well as people's preferences and put our findings into context of the application domain of 3D data analysis environments.

Paper download: (5.2 MB)

Software:

Parts of the code are available on GitHub. But note that the tangible tracking will likely be difficult to port to other devices. We used two cameras from the tablets and it would only work with those tablets which are not sold anymore and the OS is not available anymore. In essence, any phone today can track better than what we did back then so the recommendation today would be to reimplement the tracking.

Video:

Get the video:

watch the conference preview video on YouTube.

Main Reference:

Lonni Besançon, Paul Issartel, Mehdi Ammi, and Tobias Isenberg (2017) Mouse, Tactile, and Tangible Input for 3D Manipulation. In Juan Pablo Hourcade, Daniel Wigdor, and Caroline Appert, eds., Proceedings of the Annual Conference on Human Factors in Computing Systems (CHI, May 6–11, Denver, CO, USA). ACM, New York, pages 4727–4740, 2017. A preliminary version was published on arXiv.

BibTeX entry:



@INPROCEEDINGS{Besancon:2017:MTT,
  author      = {Lonni Besan{\c{c}}on and Paul Issartel and Mehdi Ammi and Tobias Isenberg},
  title       = {Mouse, Tactile, and Tangible Input for {3D} Manipulation},
  booktitle   = {Proceedings of the Annual Conference on Human Factors in Computing Systems (CHI, May 6--11, Denver, CO, USA)},
  OPTeditor   = {Juan Pablo Hourcade and Daniel Wigdor and Caroline Appert},
  year        = {2017},
  pages       = {4727--4740},
  publisher   = {ACM},
  address     = {New York},
  doi         = {10.1145/3025453.3025863},
  doi_url     = {https://doi.org/10.1145/3025453.3025863},
  oa_hal_url  = {https://hal.science/hal-01436206},
  preprint    = {https://doi.org/10.48550/arXiv.1603.08735},
  github_url  = {https://github.com/lonnibesancon/Exp3D},
  url         = {https://tobias.isenberg.cc/p/Besancon2017MTT},
  pdf         = {https://tobias.isenberg.cc/personal/papers/Besancon_2017_MTT.pdf},
}

Other References:

Lonni Besançon, Paul Issartel, Mehdi Ammi, and Tobias Isenberg (2016) Usability Comparison of Mouse, Touch and Tangible Inputs for 3D Data Manipulation. arXiv preprint 1603.08735, arXiv.org, March 2016. Also see the paper at CHI 2017.

BibTeX entry:



@TECHREPORT{Besancon:2016:UCM,
  author      = {Lonni Besan{\c{c}}on and Paul Issartel and Mehdi Ammi and Tobias Isenberg},
  title       = {Usability Comparison of Mouse, Touch and Tangible Inputs for {3D} Data Manipulation},
  type        = {arXiv preprint},
  year        = {2016},
  institution = {arXiv.org},
  number      = {1603.08735},
  month       = mar,
  doi         = {10.48550/arXiv.1603.08735},
  doi_url     = {https://doi.org/10.48550/arXiv.1603.08735},
  oa_hal_url  = {https://hal.science/hal-01305726},
  preprint    = {https://doi.org/10.48550/arXiv.1603.08735},
  github_url  = {https://github.com/lonnibesancon/Exp3D},
  url         = {https://tobias.isenberg.cc/p/Besancon2017MTT},
  pdf         = {https://tobias.isenberg.cc/personal/papers/Besancon_2016_UCM.pdf},
}

Lonni Besançon (2017) An Interaction Continuum for 3D Data Visualization. PhD thesis, Université Paris-Saclay, France, December 2017.

BibTeX entry:



@PHDTHESIS{Besancon:2017:IC3,
  author      = {Lonni Besan{\c{c}}on},
  title       = {An Interaction Continuum for {3D} Data Visualization},
  year        = {2017},
  school      = {Universit{\'e} Paris-Saclay},
  month       = dec,
  address     = {France},
  oa_hal_url  = {https://hal.science/tel-01684210},
  url2        = {https://tobias.isenberg.cc/VideosAndDemos/Besancon2017MTT},
  pdf         = {https://tobias.isenberg.cc/personal/papers_students/Besancon_2017_IC3.pdf},
}

This work was done at the AVIZ project group of Inria, France, in collaboration with the LIMSI lab at CNRS, France.