Illustrative Rendering, Visualization, and Human-Computer Interaction > AVIZ > Inria Saclay / Université Paris Saclay > Inria

Hybrid Tactile/Tangible Interaction for 3D Data Exploration

Description:

 

We present the design and evaluation of an interface that combines tactile and tangible paradigms for 3D visualization. While studies have demonstrated that both tactile and tangible input can be efficient for a subset of 3D manipulation tasks, we reflect here on the possibility to combine the two complementary input types. Based on a field study and follow-up interviews, we present a conceptual framework of the use of these different interaction modalities for visualization both separately and combined---focusing on free exploration as well as precise control. We present a prototypical application of a subset of these combined mappings for fluid dynamics data visualization using a portable, position-aware device which offers both tactile input and tangible sensing. We evaluate our approach with domain experts and report on their qualitative feedback.

Paper download:  (3.2 MB)

Demo/Source Code:

We have implemented the prototype in two parts: the application running on a separate Unix machine for rendering-only options and the app handling all the interaction on the tablet. You can get the code on Github for both the PC program (Unix) and the tablet app (Android, requires Google Tango tablet).

Videos:

30 second preview:

Tangible Brush poster video:

30 second preview for the poster:

Get the videos:

Pictures:

Poster presented at IEEE VIS 2016:

Additional material:

Cross-Reference:

Main Reference:

Lonni Besançon, Paul Issartel, Mehdi Ammi, and Tobias Isenberg (2017) Hybrid Tactile/Tangible Interaction for 3D Data Exploration. IEEE Transactions on Visualization and Computer Graphics, 23(1):881–890, January 2017.   doi
pdf
video
url
url
bibtex
×

BibTeX entry:


@ARTICLE{Besancon:2017:HTT, author = {Lonni Besan{\c{c}}on and Paul Issartel and Mehdi Ammi and Tobias Isenberg}, title = {Hybrid Tactile/Tangible Interaction for {3D} Data Exploration}, journal = {IEEE Transactions on Visualization and Computer Graphics}, year = {2017}, volume = {23}, number = {1}, month = jan, pages = {881--890}, doi = {10.1109/TVCG.2016.2599217}, doi_url = {https://doi.org/10.1109/TVCG.2016.2599217}, url = {https://tobias.isenberg.cc/VideosAndDemos/Besancon2017HTT}, url2 = {http://tiny.cc/hybridinteraction}, pdf = {https://tobias.isenberg.cc/personal/papers/Besancon_2017_HTT.pdf}, }

Other Reference:

Lonni Besançon, Paul Issartel, Mehdi Ammi, and Tobias Isenberg (2017) Interactive 3D Data Exploration Using Hybrid Tactile/Tangible Input. In Proceedings of the Journées Visu (June 7–8, Rueil-Malmaison, France). 2017.   pdf
url
bibtex
×

BibTeX entry:


@INPROCEEDINGS{Besancon:2017:I3D, author = {Lonni Besan{\c{c}}on and Paul Issartel and Mehdi Ammi and Tobias Isenberg}, title = {Interactive {3D} Data Exploration Using Hybrid Tactile/Tangible Input}, booktitle = {Proceedings of the Journ{\'e}es Visu (June 7--8, Rueil-Malmaison, France)}, year = {2017}, url = {https://tobias.isenberg.cc/VideosAndDemos/Besancon2017HTT}, pdf = {https://tobias.isenberg.cc/personal/papers/Besancon_2017_I3D.pdf}, }
Mickael Sereno, Mehdi Ammi, Tobias Isenberg, and Lonni Besançon (2016) Tangible Brush: Performing 3D Selection with Portable and Position-aware Devices. In Tim Dwyer, Petra Isenberg, Tobias Schreck, Gunther H. Weber, Jing Yang, and Xiaoru Yuan, eds., Posters at the IEEE Conference on Visualization (IEEE VIS, October 23–28, Baltimore, Maryland, USA). 2016. Extended abstract and poster.   pdf
video
url
bibtex
×

BibTeX entry:


@INPROCEEDINGS{Sereno:2016:TBP, author = {Mickael Sereno and Mehdi Ammi and Tobias Isenberg and Lonni Besan{\c{c}}on}, title = {Tangible Brush: Performing {3D} Selection with Portable and Position-aware Devices}, booktitle = {Posters at the IEEE Conference on Visualization (IEEE VIS, October 23--28, Baltimore, Maryland, USA)}, editor = {Tim Dwyer and Petra Isenberg and Tobias Schreck and Gunther H. Weber and Jing Yang and Xiaoru Yuan}, year = {2016}, url = {https://tobias.isenberg.cc/VideosAndDemos/Besancon2017HTT}, pdf = {https://tobias.isenberg.cc/personal/papers/Sereno_2016_TBP.pdf}, }

This work was done at the AVIZ project group of Inria, France, in collaboration with the LIMSI lab at CNRS, France.