Illustrative Rendering, Visualization, and Human-Computer Interaction > AVIZ > Inria Saclay / Université Paris Saclay > Inria

Interactive Example-based Hatching

Description:

 

We present an approach for interactively generating pen-and-ink hatching renderings based on hand-drawn examples. We aim to overcome the regular and synthetic appearance of the results of existing methods by incorporating human virtuosity and illustration skills in the computer generation of such imagery. To achieve this goal, we propose to integrate an automatic style transfer with user interactions. This approach leverages the potential of example-based hatching while giving users the control and creative freedom to enhance the aesthetic appearance of the results. Using a scanned-in hatching illustration as input, we use image processing and machine learning methods to learn a model of the drawing style in the example illustration. We then apply this model to semi-automatically synthesize hatching illustrations of 3D meshes in the learned drawing style. In the learning stage, we first establish an analytical description of the hand-drawn example illustration using image processing. A 3D scene registered with the example drawing allows us to infer object-space information related to the 2D drawing elements. We employ a hierarchical style transfer model that captures drawing characteristics on four levels of abstraction, which are global, patch, stroke, and pixel levels. In the synthesis stage, an explicit representation of hatching strokes and hatching patches enables us to synthesize the learned hierarchical drawing characteristics. Our representation makes it possible to directly and intuitively interact with the hatching illustration. Amongst other interactions, users of our system can brush with patches of hatching strokes onto a 3D mesh. This interaction capability allows illustrators who are working with our system to make use of their artistic skills. Furthermore, the proposed interactions allow people without a background in hatching to interactively generate visually appealing hatching illustrations.

Paper download:  (18.0 MB)

Video:

Get the video:

download a smaller version of the video (AVI-MPEG4, 21.4MB)

Pictures:

Additional Material:

Main Reference:

Moritz Gerl and Tobias Isenberg (2013) Interactive Example-based Hatching. Computers & Graphics, 37(1–2):65–80, February–April 2013.   doi
pdf
slides
video
url
bibtex
×

BibTeX entry:


@ARTICLE{Gerl:2013:IEH, author = {Moritz Gerl and Tobias Isenberg}, title = {Interactive Example-based Hatching}, journal = {Computers \& Graphics}, year = {2013}, volume = {37}, number = {1--2}, month = feb #{--}# apr, pages = {65--80}, doi = {10.1016/j.cag.2012.11.003}, doi_url = {https://doi.org/10.1016/j.cag.2012.11.003}, url = {https://tobias.isenberg.cc/VideosAndDemos/Gerl2013IEH}, pdf = {https://tobias.isenberg.cc/personal/papers/Gerl_2013_IEH.pdf}, }

Other References:

Moritz Gerl (2013) Explorations in Interactive Illustrative Rendering. PhD thesis, University of Groningen, March 2013.   pdf
url
bibtex
×

BibTeX entry:


@PHDTHESIS{Gerl:2013:EII, author = {Gerl, Moritz}, title = {Explorations in Interactive Illustrative Rendering}, year = {2013}, school = {University of Groningen}, month = mar, address = {The Netherlands}, url = {http://irs.ub.rug.nl/ppn/355047551}, pdf = {https://tobias.isenberg.cc/personal/papers_students/Gerl.2013.EII.pdf}, }
Moritz Gerl and Tobias Isenberg (2013) Visual Showcase: Interactive Example-based Hatching. In Visual Showcase at the Joint ACM/EG Symposium on Computational Aesthetics, Sketch-Based Interfaces and Modeling, and Non-Photorealistic Animation and Rendering (Expressive, July 19–20, Anaheim, CA, USA). 2013. Extended abstract and exhibition piece.   pdf
video
url
bibtex
×

BibTeX entry:


@INPROCEEDINGS{Gerl:2013:VSI, author = {Moritz Gerl and Tobias Isenberg}, title = {Visual Showcase: Interactive Example-based Hatching}, booktitle = {Visual Showcase at the Joint ACM/EG Symposium on Computational Aesthetics, Sketch-Based Interfaces and Modeling, and Non-Photorealistic Animation and Rendering (Expressive, July 19--20, Anaheim, CA, USA)}, year = {2013}, url = {https://tobias.isenberg.cc/VideosAndDemos/Gerl2013IEH}, pdf = {https://tobias.isenberg.cc/personal/papers/Gerl_2013_VSI.pdf}, }
Moritz Gerl and Tobias Isenberg (2009) Image Analysis on Hatching Drawings. In SIREN: Scientific ICT Research Event Netherlands (November 5, University of Twente, The Netherlands). 2009. Poster.   pdf
url
bibtex
×

BibTeX entry:


@INPROCEEDINGS{Gerl:2009:IAH, author = {Moritz Gerl and Tobias Isenberg}, title = {Image Analysis on Hatching Drawings}, booktitle = {SIREN: Scientific ICT Research Event Netherlands (November 5, University of Twente, The Netherlands)}, year = {2009}, url = {https://tobias.isenberg.cc/VideosAndDemos/Gerl2013IEH}, pdf = {https://tobias.isenberg.cc/personal/papers/Gerl_2009_IAH.pdf}, }

This work was done at the Scientific Visualization and Computer Graphics Lab of the University of Groningen, the Netherlands.