Illustrative Rendering, Visualization, and Human-Computer Interaction > AVIZ > Inria Saclay / Université Paris-Saclay > Inria

Research Overview

Please also see my projects page and my publications page for recent papers, projects, videos, and demos. Below is a list of my main topics of interest in research.

Main Themes

  Interaction with Scientific Visualizations

Touch-sensitive displays make it possible to explore alternative ways of presenting and interacting with scientific visualizations. In particular, they can be advantageous with respect to immersion, feeling in control, somesthetic feedback, collaboration, and speed of input. We explore touch interfaces that allow people to benefit from these advantages, in particular, for scientific visualization and exploration of data.

  Illustrative Visualization

Non-photorealistic rendering is inspired by a long tradition of illustration. We applied NPR techniques to illustration and visualization problems in medical, technical, and other domains. We also worked on combining NPR methods with other rendering techniques to create hybrid rendering styles for illustration and visualization.

  Evaluation of Illustrative Rendering and Visualization

Many traditional artistic and illustrative depiction techniques have now been simulated withing the context of non-photorealistic rendering. However, many of these techniques can still be visually distinguished from their originals by people looking at such images. We work on identifying the differences between the two groups of images and to understand what this means for a viewer.

Funded Projects

  ILLUSTRARE: Integrative Visual Abstraction of Molecular Data

The essential building block of visualization is the phenomenon of visual abstraction. While visual abstraction is intuitively understood, there is no scientific theory associated with it that would be useful in the visualization synthesis process. Our central aim of this project is thus to gain better understanding of the visual abstraction characteristics. We lay down a hypothetical initial basis of theoretical foundations of visual abstractions in the proposal. We hypothesize that visual abstraction is a multidimensional phenomenon that can be spanned by axes of abstraction. Besides abstractions associated with a static structure we take a closer look at abstractions related to dynamics, procedures, and emergence of the structure. We also study abstraction characteristics related to multi-scale phenomena defined both in space and in time. This hypothetical basis is either supported or rejected by means of exemplary evidence from specific application domain of structural biology. Structural biology data is very complex, it includes the aspect of emergence and it is defined over multiple scales. Furthermore, abstraction has led to key discoveries in biology, such as the organization of the DNA. We study the multiscale visual abstraction characteristics on the visualization of long nucleic strands and the abstractions that convey emerging phenomena on visualization of molecular machinery use cases. From these two fields we work toward a theory of visual abstraction in a bottom-up manner, investigating the validity of the theory in other application domains as well.

Other Aspects

  Touch Interaction with 3D Environments

Touch interaction is increasingly becoming an important means of human-computer interaction. However, often we have to deal with 3D data, visualizations, or scenes for which regular 2D input as derived from touch surfaces is not sufficient. Here we have to develop means of mapping the 2D input to interactions in 3D space, such that the touch exploration of the 3D environments remains intuitive.

  Interaction on and with Large Displays

With the growing resolution on today's interactive displays it becomes increasingly difficult to maintain responsiveness of the system. We work on applying techniques from computer graphics to address the complexity issues on such interfaces. In addition, large displays require completely new interaction techniques, including the need to accommodate multiple people, multiple interaction points per person or in general, dealing with orientations and awareness.

  Interaction with Non-Photorealistic and Illustrative Rendering

Many NPR techniques are encapsulated algorithms that allow little influence on the final product other than global parameter changes. In addition, interfaces for NPR are often cluttered with an enormous number of parameters whose influence is difficult to understand. We work on giving people understandable and direct local control over the rendering process.

  Silhouette and Pen-and-Ink Rendering

Hand-drawn pen-and-ink drawings have fascinated me for a long time. Using non-photorealistic rendering we have worked on generating such drawings consisting of silhouette lines and other strokes with the computer.

  High Quality Rendering

When doing research on line rendering and pen-and-ink NPR, in particular if print is the medium that one aims for, one needs to produce high quality images. Therefore, we attempt to produce vector images of my NPR techniques wherever possible.