C01 | Quantifying Interaction

Prof. Harald Reiterer, University of Konstanz
Email | Website

Harald Reiterer

Prof. Albrecht Schmidt, LMU
Email | Website

Albrecht Schmidt

Johannes Zagermann, University of Konstanz – Website | Email

Daniel Immanuel Fink, University of Konstanz – Website | Email

The main goal of this project is the definition and validation of new quantitative measurements to evaluate the interaction with visual computing systems. This includes the development of new quantitative models, metrics, and tasks to unify usability test settings as well as the integration of the theoretical and methodological findings into a framework to evaluate interaction. To this end, we will collect and develop a set of tools to ease planning, conduction, analysis, and comparison of replicable quantitative experiments in visual computing systems.

Research Questions

What kind of atomic and compound tasks, models, and metrics are suitable for evaluating the interaction with visual computing systems?

How can we find a good trade-off between their predictive power for specialized application tasks and their general applicability (e.g. their relation to atomic tasks and metrics)?

What kind of heuristics would be appropriate to tightly couple the compound tasks and metrics with specific characteristics of interaction devices and techniques?

What are appropriate software architectures for an evaluation environment?

What tools are necessary to support the integration for tasks and metrics designed within the project?

What tools support the ad-hoc evaluation as well as the integration of heuristics in (semi-) automated evaluations?

Fig. 1: Interacting with physical tokens.

Fig. 2: Model of the theoretical evaluation framework and Toolbox.

Publications

  1. J. Zagermann, U. Pfeil, P. von Bauer, D. Fink, and H. Reiterer, “‘It’s in my other hand!’: Studying the Interplay of Interaction Techniques and Multi-Tablet Activities,” in Proceedings of the CHI Conference on Human Factors in Computing Systems, 2020, pp. 413:1-413:13, doi: 10.1145/3313831.3376540.
  2. F. Bishop, J. Zagermann, U. Pfeil, G. Sanderson, H. Reiterer, and U. Hinrichs, “Construct-A-Vis: Exploring the Free-Form Visualization Processes of Children,” IEEE Transactions on Visualization and Computer Graphics, vol. 26, no. 1, Art. no. 1, 2020, doi: 10.1109/TVCG.2019.2934804.
  3. M. Borowski, J. Zagermann, C. N. Klokmose, H. Reiterer, and R. Rädle, “Exploring the Benefits and Barriers of Using Computational Notebooks for Collaborative Programming Assignments,” in Proceedings of the ACM Technical Symposium on Computer Science Education (SIGCSE), 2020, pp. 468–474, doi: 10.1145/3328778.3366887.
  4. J. Müller, J. Zagermann, J. Wieland, U. Pfeil, and H. Reiterer, “A Qualitative Comparison Between Augmented and Virtual Reality Collaboration with Handheld Devices,” in Mensch und Computer 2019 – Tagungsband (MuC), 2019, pp. 399–410, doi: 10.1145/3340764.3340773.
  5. L. L. Chuang and U. Pfeil, “Transparency and Openness Promotion Guidelines for HCI,” in Proceedings of the CHI Conference on Human Factors in Computing Systems-Extended Abstracts (CHI-EA), 2018, p. SIG04:1-SIG04:4, doi: 10.1145/3170427.3185377.
  6. S. Hubenschmid, J. Zagermann, S. Butscher, and H. Reiterer, “Employing Tangible Visualisations in Augmented Reality with Mobile Devices,” in Proceedings of the Working Conference on Advanced Visual Interfaces (AVI), 2018, pp. 1–4, [Online]. Available: http://nbn-resolving.de/urn:nbn:de:bsz:352-2-1iooenfo4fofm8.
  7. J. Zagermann, U. Pfeil, and H. Reiterer, “Studying Eye Movements as a Basis for Measuring Cognitive Load,” Proceedings of the CHI Conference on Human Factors in Computing Systems-Extended Abstracts (CHI-EA), p. LBW095:1-LBW095:6, 2018, doi: 10.1145/3170427.3188628.
  8. M. Blumenschein et al., “SMARTexplore: Simplifying High-Dimensional Data Analysis through a Table-Based Visual Analytics Approach,” in Proceedings of the IEEE Conference on Visual Analytics Science and Technology (VAST), 2018, pp. 36–47, doi: 10.1109/VAST.2018.8802486.
  9. J. Zagermann, U. Pfeil, D. Fink, P. von Bauer, and H. Reiterer, “Memory in Motion: The Influence of Gesture- and Touch-based Input Modalities on Spatial Memory,” in Proceedings of the CHI Conference on Human Factors in Computing Systems, 2017, pp. 1899–1910, doi: 10.1145/3025453.3026001.
  10. J. Zagermann, U. Pfeil, C. Acevedo, and H. Reiterer, “Studying the Benefits and Challenges of Spatial Distribution and Physical Affordances in a Multi-device Workspace,” in Proceedings of the International Conference on Mobile and Ubiquitous Multimedia (MUM), 2017, pp. 249–259, doi: https://doi.org/10.1145/3152832.3152855.
  11. D. Jäckle, F. Stoffel, S. Mittelstädt, D. A. Keim, and H. Reiterer, “Interpretation of Dimensionally-Reduced Crime Data: A Study with Untrained Domain Experts,” in Proceedings of the Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP), 2017, vol. 3, pp. 164–175, doi: http://dx.doi.org/10.5220/0006265101640175.
  12. S. Butscher and H. Reiterer, “Applying Guidelines for the Design of Distortions on Focus+Context Interfaces,” in Proceedings of the Working Conference on Advanced Visual Interfaces (AVI), 2016, pp. 244–247, doi: 10.1145/2909132.2909284.
  13. J. Zagermann, U. Pfeil, R. Rädle, H.-C. Jetter, C. N. Klokmose, and H. Reiterer, “When Tablets meet Tabletops: The Effect of Tabletop Size on Around-the-Table Collaboration with Personal Tablets,” in Proceedings of the CHI Conference on Human Factors in Computing Systems, 2016, pp. 5470–5481, doi: 10.1145/2858036.2858224.
  14. J. Zagermann, U. Pfeil, and H. Reiterer, “Measuring Cognitive Load using Eye Tracking Technology in Visual Computing,” in Proceedings of the Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization (BELIV), 2016, pp. 78–85, doi: 10.1145/2993901.2993908.
  15. J. Müller, R. Rädle, and H. Reiterer, “Virtual Objects as Spatial Cues in Collaborative Mixed Reality Environments: How They Shape Communication Behavior and User Task Load,” in Proceedings of the CHI Conference on Human Factors in Computing Systems, 2016, pp. 1245–1249, doi: 10.1145/2858036.2858043.
  16. L. Lischke, S. Mayer, K. Wolf, N. Henze, H. Reiterer, and A. Schmidt, “Screen Arrangements and Interaction Areas for Large Display Work Places.,” in Proceedings of the ACM International Symposium on Pervasive Displays (PerDis), 2016, pp. 228–234, doi: 10.1145/2914920.2915027.
  17. L. Lischke et al., “Using Space: Effect of Display Size on Users’ Search Performance,” in Proceedings of the CHI Conference on Human Factors in Computing Systems-Extended Abstracts (CHI-EA), 2015, pp. 1845–1850, doi: 10.1145/2702613.2732845.