A Buffer Framework for Supporting Responsive Interaction in Information Visualization Interfaces

Description:

 

We present a framework that we are developing to better solve several critical issues that arise when interactive systems are extended to large displays. These issues include slow reaction times, difficulties with high numbers of concurrent interactions or user inputs, and problems that occur when combining several aspects of visualizations. In part, these issues arise from a number of complexities that are present in current approaches. This makes it important to tackle this problem directly rather simply waiting until the computing power has increased sufficiently and calls for a fundamentally new approach to computer interface foundations. Our framework combines ideas from information visualization, large displays, collaborative work, and non-photorealistic rendering (NPR). Specifically, we are employing four concepts/techniques: layered buffers, local coherence, emergent complexity, and force fields.

Paper download:  (4.7 MB)

Demo:

You can download a demo of the Table Interface Application (Win32, 47 MB) and try it out for yourself. The demo works best with Smart DViT hardware.

Videos:

Table interface before the use of our buffer framework, on a tabletop display with about two megapixels, showing the significant slow-down as more and more objects need to be animated:

(:neo_flv-player (http:../personal/videos/)Isenberg_2006_BFS1(.flv) width=320 height=240 startimage="../personal/videos/Isenberg_2006_BFS1.jpg" -link:)

Initial tests with the new buffer framework, on a larger tabletop display with about three times the resolution:

(:neo_flv-player (http:../personal/videos/)Isenberg_2006_BFS(.flv) width=320 height=240 startimage="../personal/videos/Isenberg_2006_BFS.jpg" -link:)

Another initial test and proof-of-concept:

(:neo_flv-player (http:../personal/videos/)Isenberg_2006_BFS3(.flv) width=320 height=240 startimage="../personal/videos/Isenberg_2006_BFS3.jpg" -link:)

Re-implemented table interface using the new buffer framework, also on the larger tabletop display, showing a variety of interaction techniques and widgets and the simultaneous use of a high number of images and other objects:

(:neo_flv-player (http:../personal/videos/)Isenberg_2006_BFS2(.flv) width=320 height=240 startimage="../personal/videos/Isenberg_2006_BFS2.jpg" -link:)

Watch this video on YouTube.

Poster (for demo at CSCW 2006):

Additional material:

Cross-References:

This technique was later used in several projects, including mobile spatial tools for fluid interaction, NPR stroke-based rendering interaction, mobile spatial tools for fluid interaction, hand-posture controlled stroke-based rendering, and the exploration of 3D vector and flow fields.

Main Reference:

Tobias Isenberg, André Miede, and Sheelagh Carpendale (2006) A Buffer Framework for Supporting Responsive Interaction in Information Visualization Interfaces. In Hajime Kita, Kim Rose, Benay Dara-Abrams, Rieko Kadobayashi, Rick McGeer, and Hideyuki Takada, eds., Proceedings of the Fourth International Conference on Creating, Connecting and Collaborating through Computing (C5, January 26–27, Berkeley, California, USA). IEEE Computer Society, Los Alamitos, CA, pages 262–269, 2006.
×

BibTeX entry:


@INPROCEEDINGS{Isenberg:2006:BFS, author = {Tobias Isenberg and Andr{\'e} Miede and Sheelagh Carpendale}, title = {A Buffer Framework for Supporting Responsive Interaction in Information Visualization Interfaces}, booktitle = {Proceedings of the Fourth International Conference on Creating, Connecting and Collaborating through Computing (C\textsuperscript{5}, January 26--27, Berkeley, California, USA)}, OPTeditor = {Hajime Kita and Kim Rose and Benay Dara-Abrams and Rieko Kadobayashi and Rick McGeer and Hideyuki Takada}, year = {2006}, pages = {262--269}, publisher = {IEEE Computer Society}, address = {Los Alamitos, CA}, doi = {10.1109/C5.2006.4}, doi_url = {https://doi.org/10.1109/C5.2006.4}, url = {https://tobias.isenberg.cc/p/Isenberg2006BFS}, url2 = {http://innovis.cpsc.ucalgary.ca/Research/DisplayFramework}, pdf = {https://tobias.isenberg.cc/personal/papers/Isenberg_2006_BFS.pdf}, }

Other References:

Sheelagh Carpendale, Tobias Isenberg, Stacey D. Scott, Uta Hinrichs, André Miede, Russel Kruger, Stefan Habelski, and Kori Inkpen (2006) Collaborative Interaction on Large Tabletop Displays. In Amy Voida, eds., Conference Supplement of the ACM Conference on Computer Supported Collaborative Work (CSCW, November 4–8, Banff, Alberta, Canada). ACM, New York, pages 57–58, 2006. Extended abstract and interactive demo.
×

BibTeX entry:


@INPROCEEDINGS{Carpendale:2006:CIL, author = {Sheelagh Carpendale and Tobias Isenberg and Stacey D. Scott and Uta Hinrichs and Andr{\'e} Miede and Russel Kruger and Stefan Habelski and Kori Inkpen}, title = {Collaborative Interaction on Large Tabletop Displays}, booktitle = {Conference Supplement of the ACM Conference on Computer Supported Collaborative Work (CSCW, November 4--8, Banff, Alberta, Canada)}, OPTeditor = {Amy Voida}, year = {2006}, pages = {57--58}, publisher = {ACM}, address = {New York}, url = {https://tobias.isenberg.cc/p/Isenberg2006BFS}, url2 = {http://innovis.cpsc.ucalgary.ca/Research/DisplayFramework}, pdf = {https://tobias.isenberg.cc/personal/papers/Carpendale_2006_CIL.pdf}, }
Tobias Isenberg, Petra Neumann, Sheelagh Carpendale, Simon Nix, and Saul Greenberg (2006) Interactive Annotations on Large, High-Resolution Information Displays. In Conference Compendium of IEEE VIS, IEEE InfoVis, and IEEE VAST (October 29–November 3, Baltimore, Maryland, USA). IEEE Computer Society, Los Alamitos, CA, pages 124–125, 2006. Extended abstract and poster.
×

BibTeX entry:


@INPROCEEDINGS{Isenberg:2006:IAL, author = {Tobias Isenberg and Petra Neumann and Sheelagh Carpendale and Simon Nix and Saul Greenberg}, title = {Interactive Annotations on Large, High-Resolution Information Displays}, booktitle = {Conference Compendium of IEEE VIS, IEEE InfoVis, and IEEE VAST (October 29--November 3, Baltimore, Maryland, USA)}, year = {2006}, pages = {124--125}, publisher = {IEEE Computer Society}, address = {Los Alamitos, CA}, url = {https://tobias.isenberg.cc/p/Isenberg2006IAL}, url2 = {http://innovis.cpsc.ucalgary.ca/Research/DisplayFramework}, pdf = {https://tobias.isenberg.cc/personal/papers/Isenberg_2006_IAL.pdf}, }
André Miede (2006) Realizing Responsive Interaction for Tabletop Interaction Metaphors. Master's thesis, Otto-von-Guericke-University of Magdeburg, Germany, 2006.
×

BibTeX entry:


@MASTERSTHESIS{Miede:2006:RRI, author = {Andr{\'e} Miede}, title = {Realizing Responsive Interaction for Tabletop Interaction Metaphors}, year = {2006}, school = {Otto-von-Guericke-University of Magdeburg}, address = {Germany}, url = {http://innovis.cpsc.ucalgary.ca/Publications/Publications?action=bibentry&bibfile=BibTex.BibTex&bibref=Miede:2006:RRI}, url2 = {https://tobias.isenberg.cc/VideosAndDemos/Isenberg2006BFS}, pdf = {https://tobias.isenberg.cc/personal/papers_students/Miede_2006_RRI.pdf}, }

This work was done at the Innovis group at the Interactions Lab of the University of Calgary, Canada.