D01 | Perception-Guided Adaptive Modeling of 3D Virtual Cities Based on Probabilistic Grammars

Prof. Dieter Fritsch, University of Stuttgart
Email | Website

Dieter Fritsch

Prof. Oliver Deussen, University of Konstanz
Email | Website

Oliver Deussen

Patrick Tutzauer, University of Stuttgart

The goal of the project is to create quantitative methods for the perception-aware representation of 3D virtual cities. We will develop a grammar-based system for the effective visual communication of building-related information via geometric 3D building representations that induce a defined degree of perceptual insight in the observer’s mind. The system will allow us to quantify the perceptual insight and predict the effects of modified system parameters. Moreover, it will be possible to enhance the perceptual insight by specifically changing the geometric representation.

Research Questions

Which geometric 3D representation is, given a context, best suited to enable a maximum understanding of the information that is intended to be transmitted?

Which aspects or properties of geometric 3D building representations are relevant for the perception of building-related semantic information?

How can we formalize and use this knowledge to develop a perception-aware modeling concept?

How can we quantify the quality of 3D building representations in a way that fits the viewer’s perception?

Fig. 1: Grammar-based 3D city model of Stuttgart.


  1. D. Laupheimer, P. Tutzauer, N. Haala, and M. Spicker, “Neural Networks for the Classification of Building Use from Street-view Imagery,” ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. IV–2, pp. 177–184, 2018, doi: 10.5194/isprs-annals-IV-2-177-2018.
  2. P. Tutzauer and N. Haala, “Processing of Crawled Urban Imagery for Building Use Classification,” ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XLII-1/W1, pp. 143–149, 2017, doi: 10.5194/isprs-archives-XLII-1-W1-143-2017.
  3. D. Fritsch, “Photogrammetrische Auswertung digitaler Bilder – Neue Methoden der Kamerakalibration, dichten Bildzuordnung und Interpretation von Punktwolken,” in Photogrammetrie und Fernerkundung, C. Heipke, Ed. Springer Spektrum, 2017, pp. 157–196. doi: 10.1007/978-3-662-47094-7_41.
  4. D. Fritsch and M. Klein, “3D and 4D Modeling for AR and VR App Developments,” in Proceedings of the International Conference on Virtual System & Multimedia (VSMM), 2017, pp. 1–8. doi: 10.1109/VSMM.2017.8346270.
  5. P. Tutzauer, S. Becker, and N. Haala, “Perceptual Rules for Building Enhancements in 3d Virtual Worlds,” i-com, vol. 16, no. 3, Art. no. 3, 2017, doi: 10.1515/icom-2017-0022.
  6. P. Tutzauer, S. Becker, T. Niese, O. Deussen, and D. Fritsch, “Understanding Human Perception of Building Categories in Virtual 3d Cities - a User Study,” The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences (ISPRS), vol. XLI-B2, pp. 683–687, 2016, doi: http://dx.doi.org/10.5194/isprs-archives-XLI-B2-683-2016.
  7. P. Tutzauer, S. Becker, D. Fritsch, T. Niese, and O. Deussen, “A Study of the Human Comprehension of Building Categories Based on Different 3D Building Representations,” Photogrammetrie - Fernerkundung - Geoinformation, vol. 2016, no. 5–6, Art. no. 5–6, 2016, doi: 10.1127/pfg/2016/0302.