Augmenting Tactile 3D Data Navigation With Pressure Sensing

Description:

We present a pressure-augmented tactile 3D data navigation technique, specifically designed for small devices, motivated by the need to support the interactive visualization beyond traditional workstations. While touch input has been studied extensively on large screens, current techniques do not scale to small and portable devices. We use phone-based pressure sensing with a binary mapping to separate interaction degrees of freedom (DOF) and thus allow users to easily select different manipulation schemes (e.g., users first perform only rotation and then with a simple pressure input to switch to translation). We compare our technique to traditional 3D-RST (rotation, scaling, translation) using a docking task in a controlled experiment. The results show that our technique increases the accuracy of interaction, with limited impact on speed. We discuss the implications for 3D interaction design and verify that our results extend to older devices with pseudo pressure and are valid in realistic phone usage scenarios.

Paper download: (2.8 MB)

Demo/Software:

A demo of the prototypical implementation is available on Github.

Video:

Fast-forward at EuroVis 2019:

Poster video at IEEE 2017:

Get the videos:

Pictures/visualizations:

Poster presented at IEEE 2017:

Main Reference:

Xiyao Wang, Lonni Besançon, Mehdi Ammi, and Tobias Isenberg (2019) Augmenting Tactile 3D Data Navigation With Pressure Sensing. Computer Graphics Forum, 38(3):635–647, June 2019.

BibTeX entry:



@ARTICLE{Wang:2019:AT3,
  author      = {Xiyao Wang and Lonni Besan{\c{c}}on and Mehdi Ammi and Tobias Isenberg},
  title       = {Augmenting Tactile {3D} Data Navigation With Pressure Sensing},
  journal     = {Computer Graphics Forum},
  year        = {2019},
  volume      = {38},
  number      = {3},
  month       = jun,
  pages       = {635--647},
  doi         = {10.1111/cgf.13716},
  doi_url     = {https://doi.org/10.1111/cgf.13716},
  oa_hal_url  = {https://hal.science/hal-02091999},
  github_url  = {https://github.com/xiyaowang/Pressure3DOnMobile},
  url         = {https://tobias.isenberg.cc/p/Wang2019AT3},
  pdf         = {https://tobias.isenberg.cc/personal/papers/Wang_2019_AT3.pdf},
}

Other References:

Xiyao Wang, Lonni Besançon, Mehdi Ammi, and Tobias Isenberg (2017) Augmenting Tactile 3D Data Exploration With Pressure Sensing. In Natalia Andrienko, Wenwen Dou, Christoph Garth, Petra Isenberg, Miriah Meyer, and Gunther Weber, eds., Posters at the IEEE Conference on Visualization (IEEE VIS, October 1–6, Phoenix, Arizona, USA). 2017. Extended abstract and poster, also see the paper at EuroVis 2019/article in Computer Graphics Forum.

BibTeX entry:



@INPROCEEDINGS{Wang:2017:AT3,
  author      = {Xiyao Wang and Lonni Besan{\c{c}}on and Mehdi Ammi and Tobias Isenberg},
  title       = {Augmenting Tactile {3D} Data Exploration With Pressure Sensing},
  booktitle   = {Posters at the IEEE Conference on Visualization (IEEE VIS, October 1--6, Phoenix, Arizona, USA)},
  OPTeditor   = {Natalia Andrienko and Wenwen Dou and Christoph Garth and Petra Isenberg and Miriah Meyer and Gunther Weber},
  year        = {2017},
  oa_hal_url  = {https://hal.science/hal-01570442},
  url         = {https://tobias.isenberg.cc/p/Wang2019AT3},
  pdf         = {https://tobias.isenberg.cc/personal/papers/Wang_2017_AT3.pdf},
}

Xiyao Wang (2020) Augmented Reality Environments for the Interactive Exploration of 3D Data. PhD thesis, Université Paris-Saclay, France, December 2020.

BibTeX entry:



@PHDTHESIS{Wang:2020:ARE,
  author      = {Xiyao Wang},
  title       = {Augmented Reality Environments for the Interactive Exploration of {3D} Data},
  year        = {2020},
  school      = {Universit{\'e} Paris-Saclay},
  month       = dec,
  address     = {France},
  oa_hal_url  = {https://hal.science/tel-03170289},
  url2        = {https://tobias.isenberg.cc/VideosAndDemos/Wang2020TUA},
  pdf         = {https://tobias.isenberg.cc/personal/papers_students/Wang_2020_ARE.pdf},
}

This work was done at the AVIZ project group of Inria, France.