A Design Study of Direct-Touch Interaction for Exploratory 3D Scientific Visualization



We present an interaction design study of several non-overlapping direct-touch interaction widgets, postures, and bi-manual techniques to support the needs of scientists who are exploring a dataset. The final interaction design supports navigation/zoom, cutting plane interaction, a drilling exploration, the placement of seed particles in 3D space, and the exploration of temporal data evolution. To ground our design, we conducted a requirements analysis and used a participatory design approach throughout development. We chose simulations in the field of fluid mechanics as our example domain and, in the paper, discuss our choice of techniques, their adaptation to our target domain, and discuss how they facilitate the necessary combination of visualization control and data exploration. We evaluated our resulting interactive data exploration system with seven fluid mechanics experts and report on their qualitative feedback. While we use flow visualization as our application domain, the developed techniques were designed with generalizability in mind and we discuss several implications of our work on further development of direct-touch data exploration techniques for scientific visualization in general.

Paper download:  (4.7 MB)


You can download a demo of the touch-based fluid flow visualization tool (for Win32, including an example dataset, 186MB) to try it out for yourself. To be fully functional, however, the demo requires a TUIO-based touch surface.


Get the video:


Additional Material:

Main Reference:

Tijmen Klein, Florimond Guéniat, Luc Pastur, Frédéric Vernier, and Tobias Isenberg (2012) A Design Study of Direct-Touch Interaction for Exploratory 3D Scientific Visualization. Computer Graphics Forum, 31(3):1225–1234, June 2012.

BibTeX entry:

@ARTICLE{Klein:2012:DSD, author = {Tijmen Klein and Florimond Gu{\'e}niat and Luc Pastur and Fr{\'e}d{\'e}ric Vernier and Tobias Isenberg}, title = {A Design Study of Direct-Touch Interaction for Exploratory {3D} Scientific Visualization}, journal = {Computer Graphics Forum}, year = {2012}, volume = {31}, number = {3}, month = jun, pages = {1225--1234}, doi = {10.1111/j.1467-8659.2012.03115.x}, doi_url = {https://doi.org/10.1111/j.1467-8659.2012.03115.x}, oa_hal_url = {https://hal.science/hal-00781293}, url = {https://tobias.isenberg.cc/p/Klein2012DSD}, pdf = {https://tobias.isenberg.cc/personal/papers/Klein_2012_DSD.pdf}, }

Other Reference:

Tijmen Klein (2012) Direct-Touch Interaction for 3D Flow Visualization. Term project report, University of Groningen, The Netherlands, 2012.

BibTeX entry:

@MASTERSTHESIS{Klein:2012:DTI, author = {Tijmen Klein}, title = {Direct-Touch Interaction for {3D} Flow Visualization}, type = {Term project report}, year = {2012}, school = {University of Groningen}, address = {The Netherlands}, url2 = {https://tobias.isenberg.cc/VideosAndDemos/Klein2012DSD}, pdf = {https://tobias.isenberg.cc/personal/papers_students/Klein_2012_DTI.pdf}, }

This work was done at the LIMSI lab at CNRS, France, in collaboration with the Université Paris-Sud, France, the Scientific Visualization and Computer Graphics Lab of the University of Groningen, the Netherlands, and the AVIZ project group of INRIA, France.