Understanding Differences between Combinations of 2D and 3D Input and Output Devices for 3D Data Visualization

Description:

 

Focusing on interaction needs for scientific data exploration, we evaluated people's performance using a 2D mouse, 3D SpaceMouse, or 3D-tangible tablet as input devices to interact with visualizations on 2D screens or stereoscopic augmented reality (AR) head-mounted displays. The increasing availability and power of immersive displays drives us to try to understand how to choose input devices, interaction techniques and output displays for the visualization of scientific data, thus to finally help us guide the interaction design for hybrid AR and PC visualization systems. With a docking task and a clipping plane placement/orientation task, we measure our participants’ performance (completion time and accuracy) with each of the different combinations of input and output. We also report on their perceived workload, their preference, and on other qualitative feedback. Results show that the mouse remains good with any display, especially for tasks that require a high accuracy. Our results highlight the potential to retain the mouse as a primary input device, and to complement it with other 3D interaction devices for specific uses.

Paper download:  (11.1 MB)

 

Software:

The software is available at https://github.com/xiyaowang/2D3DInOutputFor3DVis.

 

Study materials and data:

Our study materials and data can be found on the following OSF repository: osf.io/7gsk8.

Video:

Get the video:

Main Reference:

Xiyao Wang, Lonni Besançon, Mehdi Ammi, and Tobias Isenberg (2022) Understanding Differences between Combinations of 2D and 3D Input and Output Devices for 3D Data Visualization. International Journal of Human-Computer Studies, 163, article no. 102820, 16 pages, July 2022.
×

BibTeX entry:



@ARTICLE{Wang:2022:UDC,
  author      = {Xiyao Wang and Lonni Besan{\c{c}}on and Mehdi Ammi and Tobias Isenberg},
  title       = {Understanding Differences between Combinations of {2D} and {3D} Input and Output Devices for {3D} Data Visualization},
  journal     = {International Journal of Human-Computer Studies},
  year        = {2022},
  volume      = {163},
  month       = jul,
  pages       = {102820:1--102820:16},
  articleno   = {102820},
  numpages    = {16},
  doi         = {10.1016/j.ijhcs.2022.102820},
  doi_url     = {https://doi.org/10.1016/j.ijhcs.2022.102820},
  oa_hal_url  = {https://hal.science/hal-03639831},
  osf_url     = {https://osf.io/7gsk8},
  github_url  = {https://github.com/xiyaowang/2D3DInOutputFor3DVis},
  url         = {https://tobias.isenberg.cc/p/Wang2022UDC},
  pdf         = {https://tobias.isenberg.cc/personal/papers/Wang_2022_UDC.pdf},
}

Other Reference:

Xiyao Wang (2020) Augmented Reality Environments for the Interactive Exploration of 3D Data. PhD thesis, Université Paris-Saclay, France, December 2020.
×

BibTeX entry:



@PHDTHESIS{Wang:2020:ARE,
  author      = {Xiyao Wang},
  title       = {Augmented Reality Environments for the Interactive Exploration of {3D} Data},
  year        = {2020},
  school      = {Universit{\'e} Paris-Saclay},
  month       = dec,
  address     = {France},
  oa_hal_url  = {https://hal.science/tel-03170289},
  url2        = {https://tobias.isenberg.cc/VideosAndDemos/Wang2020TUA},
  pdf         = {https://tobias.isenberg.cc/personal/papers_students/Wang_2020_ARE.pdf},
}

This work was done at the AVIZ project group of Inria, France.