Hybrid Touch/Tangible Spatial 3D Data Selection

Description:

We discuss spatial selection techniques for three-dimensional datasets. Such 3D spatial selection is fundamental to exploratory data analysis. While 2D selection is efficient for datasets with explicit shapes and structures, it is less efficient for data without such properties. We first propose a new taxonomy of 3D selection techniques, focusing on the amount of control the user has to define the selection volume. We then describe the 3D spatial selection technique Tangible Brush, which gives manual control over the final selection volume. It combines 2D touch with 6-DOF 3D tangible input to allow users to perform 3D selections in volumetric data. We use touch input to draw a 2D lasso, extruding it to a 3D selection volume based on the motion of a tangible, spatially-aware tablet. We describe our approach and present its quantitative and qualitative comparison to state-of-the-art structure-dependent selection. Our results show that, in addition to being dataset-independent, Tangible Brush is more accurate than existing dataset-dependent techniques, thus providing a trade-off between precision and effort.

Paper download: (2.8 MB)

Software:

The code for the Unix PC and for the Android tablet is available on GitHub.

Videos:

Final paper video:

Tangible Brush poster video:

30 second preview for the poster:

Get the videos:

Poster presented at IEEE 2016:

Main Reference:

Lonni Besançon, Mickael Sereno, Lingyun Yu, Mehdi Ammi, and Tobias Isenberg (2019) Hybrid Touch/Tangible Spatial 3D Data Selection. Computer Graphics Forum, 38(3):553–567, June 2019.

BibTeX entry:



@ARTICLE{Besancon:2019:HTT,
  author      = {Lonni Besan{\c{c}}on and Mickael Sereno and Lingyun Yu and Mehdi Ammi and Tobias Isenberg},
  title       = {Hybrid Touch/Tangible Spatial {3D} Data Selection},
  journal     = {Computer Graphics Forum},
  year        = {2019},
  volume      = {38},
  number      = {3},
  month       = jun,
  pages       = {553--567},
  doi         = {10.1111/cgf.13710},
  doi_url     = {https://doi.org/10.1111/cgf.13710},
  oa_hal_url  = {https://hal.science/hal-02079308},
  github_url  = {https://github.com/lonnibesancon/TangibleBrushUnix},
  github_url2 = {https://github.com/lonnibesancon/TangibleBrushAndroid},
  url         = {https://tobias.isenberg.cc/p/Besancon2019HTT},
  pdf         = {https://tobias.isenberg.cc/personal/papers/Besancon_2019_HTT.pdf},
}

Other References:

Mickael Sereno, Mehdi Ammi, Tobias Isenberg, and Lonni Besançon (2016) Tangible Brush: Performing 3D Selection with Portable and Position-aware Devices. In Tim Dwyer, Petra Isenberg, Tobias Schreck, Gunther H. Weber, Jing Yang, and Xiaoru Yuan, eds., Posters at the IEEE Conference on Visualization (IEEE VIS, October 23–28, Baltimore, Maryland, USA). 2016. Extended abstract and poster; see the full paper at Computer Graphics Forum/EuroVis 2019.

BibTeX entry:



@INPROCEEDINGS{Sereno:2016:TBP,
  author      = {Mickael Sereno and Mehdi Ammi and Tobias Isenberg and Lonni Besan{\c{c}}on},
  title       = {Tangible Brush: Performing {3D} Selection with Portable and Position-aware Devices},
  booktitle   = {Posters at the IEEE Conference on Visualization (IEEE VIS, October 23--28, Baltimore, Maryland, USA)},
  OPTeditor   = {Tim Dwyer and Petra Isenberg and Tobias Schreck and Gunther H. Weber and Jing Yang and Xiaoru Yuan},
  year        = {2016},
  oa_hal_url  = {https://hal.science/hal-01372925},
  github_url  = {https://github.com/lonnibesancon/TangibleBrushUnix},
  github_url2 = {https://github.com/lonnibesancon/TangibleBrushAndroid},
  url         = {https://tobias.isenberg.cc/p/Besancon2019HTT},
  pdf         = {https://tobias.isenberg.cc/personal/papers/Sereno_2016_TBP.pdf},
}

Mickael Sereno, Mehdi Ammi, Tobias Isenberg, and Lonni Besançon (2017) Interaction Hybride Tactile/Tangible pour la Sélection 3D [Combining Tactile and Tangible Input for 3D Selection]. In Travaux en Cours/Posters of IHM (August 29–September 1, Poitier, France). ACM, New York, pages 207–212, 2017. Extended abstract and poster, in French; see the full paper at Computer Graphics Forum/EuroVis 2019.

BibTeX entry:



@INPROCEEDINGS{Sereno:2017:IHT,
  author      = {Mickael Sereno and Mehdi Ammi and Tobias Isenberg and Lonni Besan{\c{c}}on},
  title       = {Interaction Hybride Tactile/Tangible pour la S{\'e}lection {3D} [Combining Tactile and Tangible Input for {3D} Selection]},
  booktitle   = {Travaux en Cours/Posters of IHM (August 29--September 1, Poitier, France)},
  year        = {2017},
  pages       = {207--212},
  publisher   = {ACM},
  address     = {New York},
  doi         = {10.1145/3132129.3132150},
  doi_url     = {https://doi.org/10.1145/3132129.3132150},
  oa_hal_url  = {https://hal.science/hal-01577940},
  github_url  = {https://github.com/lonnibesancon/TangibleBrushUnix},
  github_url2 = {https://github.com/lonnibesancon/TangibleBrushAndroid},
  url         = {https://tobias.isenberg.cc/p/Besancon2019HTT},
  pdf         = {https://tobias.isenberg.cc/personal/papers/Sereno_2017_IHT.pdf},
}

Lonni Besançon (2017) An Interaction Continuum for 3D Data Visualization. PhD thesis, Université Paris-Saclay, France, December 2017.

BibTeX entry:



@PHDTHESIS{Besancon:2017:IC3,
  author      = {Lonni Besan{\c{c}}on},
  title       = {An Interaction Continuum for {3D} Data Visualization},
  year        = {2017},
  school      = {Universit{\'e} Paris-Saclay},
  month       = dec,
  address     = {France},
  oa_hal_url  = {https://hal.science/tel-01684210},
  url2        = {https://tobias.isenberg.cc/VideosAndDemos/Besancon2017MTT},
  pdf         = {https://tobias.isenberg.cc/personal/papers_students/Besancon_2017_IC3.pdf},
}

This work was done at the AVIZ project group of Inria, France.