Hybrid Touch/Tangible Spatial Selection in Augmented Reality
We study tangible touch tablets combined with Augmented Reality Head-Mounted Displays (AR-HMDs) to perform spatial 3D selections. We are primarily interested in the exploration of 3D unstructured datasets such as cloud points or volumetric datasets. AR-HMDs immerse users by showing datasets stereoscopically, and tablets provide a set of 2D exploration tools. Because AR-HMDs merge the visualization, interaction, and the users’ physical spaces, users can also use the tablets as tangible objects in their 3D space. Nonetheless, the tablets' touch displays provide their own visualization and interaction spaces, separated from those of the AR-HMD. This raises several research questions compared to traditional setups. In this paper, we theorize, discuss, and study different available mappings for manual spatial selections using a tangible tablet within an AR-HMD space. We then study the use of this tablet within a 3D AR environment, compared to its use with a 2D external screen.
The software is available at https://github.com/MickaelSereno/SciVis_Server/tree/CHI2020.
Study materials and data:
Get the videos:
|Mickael Sereno, Stéphane Gosset, Lonni Besançon, and Tobias Isenberg (2022) Hybrid Touch/Tangible Spatial Selection in Augmented Reality. Computer Graphics Forum, 41(3):403–415, June 2022.|
|Mickaël Sereno (2021) Collaborative Data Exploration and Discussion with Augmented Reality Support. PhD thesis, Université Paris-Saclay, France, December 2021.|