C01 | Quantifying Interaction

Prof. Dr. Harald Reiterer, University of Konstanz
Email | Website

Harald Reiterer

Prof. Dr. Albrecht Schmidt, LMU
Email | Website

Albrecht Schmidt

Johannes Zagermann, University of Konstanz – Email | Website

Sebastian Hubenschmid, University of Konstanz – Email | Website

Jonathan Wieland, University of Konstanz – Email | Website

The main goal of this project is to understand and measure interaction in visual computing systems. While the first funding period (2015-2019) focussed on evaluation of 2D environments (e.g., cross-device interaction), we extended our scope for the current second funding period (2019-2023) to also include evaluation in 3D environments (e.g., mixed reality or hybrid user interfaces). We place particular emphasis on establishing holistic evaluation standards for user studies in the lab and in the wild by 1) combining quantitative and qualitative methods, 2) including collaborative interaction scenarios, and 3) embedding interaction in immersive environments.

Fig. 1: Mixed-immersion evaluation framework ReLive.

Research Questions

How can we find good trade-offs between quantitative and qualitative measurements?

To what extend can lab-based metrics be applied to in the wild experiments?

What kind of metrics and tasks are more suitable for domain-experts than for novices?

What kind of metrics and tasks can help us to describe collaborative activities (e.g., coupling styles)?

How can we measure awareness about group partner’s activities across space and time?

How can immersive environments bridge the gaps between co-located and remote collaboration?

Publications

  1. D. I. Fink, J. Zagermann, H. Reiterer, and H.-C. Jetter, “Re-Locations: Augmenting Personal and Shared Workspaces to Support Remote Collaboration in Incongruent Spaces,” Proc. ACM Hum.-Comput. Interact., vol. 6, no. ISS, Art. no. ISS, Nov. 2022, doi: 10.1145/3567709.
  2. S. Hubenschmid et al., “ReLive: Bridging In-Situ and Ex-Situ Visual Analytics for Analyzing Mixed Reality User Studies,” in CHI Conference on Human Factors in Computing Systems (CHI ’22), New York, NY, 2022, pp. 1–20. doi: 10.1145/3491102.3517550.
  3. F. Chiossi et al., “Adapting visualizations and interfaces to the user,” it - Information Technology, vol. 64, no. 4–5, Art. no. 4–5, 2022, doi: 10.1515/itit-2022-0035.
  4. J. Zagermann et al., “Complementary Interfaces for Visual Computing,” it - Information Technology, vol. 64, no. 4–5, Art. no. 4–5, 2022, doi: doi:10.1515/itit-2022-0031.
  5. P. Fleck, A. Sousa Calepso, S. Hubenschmid, M. Sedlmair, and D. Schmalstieg, “RagRug: A Toolkit for Situated Analytics,” IEEE Transactions on Visualization and Computer Graphics, 2022, doi: 10.1109/TVCG.2022.3157058.
  6. S. Hubenschmid, J. Zagermann, D. Fink, J. Wieland, T. Feuchtner, and H. Reiterer, “Towards Asynchronous Hybrid User Interfaces for Cross-Reality Interaction,” in ISS’21 Workshop Proceedings: “Transitional Interfaces in Mixed and Cross-Reality: A new frontier?,” 2021. doi: 10.18148/kops/352-2-84mm0sggczq02.
  7. S. Hubenschmid, J. Zagermann, S. Butscher, and H. Reiterer, “STREAM: Exploring the Combination of Spatially-Aware Tablets with Augmented Reality Head-Mounted Displays for Immersive Analytics,” in Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, New York, NY, USA: Association for Computing Machinery, 2021. doi: 10.1145/3411764.3445298.
  8. K. Vock, S. Hubenschmid, J. Zagermann, S. Butscher, and H. Reiterer, “IDIAR : Augmented Reality Dashboards to Supervise Mobile Intervention Studies,” New York, NY, 2021. doi: 10.1145/3473856.3473876.
  9. J. Wieland, J. Zagermann, J. Müller, and H. Reiterer, “Separation, Composition, or Hybrid? : Comparing Collaborative 3D Object Manipulation Techniques for Handheld Augmented Reality,” in 2021 IEEE International Symposium on Mixed and Augmented Reality, Piscataway, NJ, 2021, pp. 403--412. doi: 10.1109/ISMAR52148.2021.00057.
  10. J. Zagermann, U. Pfeil, P. von Bauer, D. Fink, and H. Reiterer, “‘It’s in my other hand!’: Studying the Interplay of Interaction Techniques and Multi-Tablet Activities,” in Proceedings of the CHI Conference on Human Factors in Computing Systems, 2020, pp. 413:1-413:13. doi: 10.1145/3313831.3376540.
  11. M. Borowski, J. Zagermann, C. N. Klokmose, H. Reiterer, and R. Rädle, “Exploring the Benefits and Barriers of Using Computational Notebooks for Collaborative Programming Assignments,” in Proceedings of the ACM Technical Symposium on Computer Science Education (SIGCSE), 2020, pp. 468–474. doi: 10.1145/3328778.3366887.
  12. F. Bishop, J. Zagermann, U. Pfeil, G. Sanderson, H. Reiterer, and U. Hinrichs, “Construct-A-Vis: Exploring the Free-Form Visualization Processes of Children,” IEEE Transactions on Visualization and Computer Graphics, vol. 26, no. 1, Art. no. 1, 2020, doi: 10.1109/TVCG.2019.2934804.
  13. J. Müller, J. Zagermann, J. Wieland, U. Pfeil, and H. Reiterer, “A Qualitative Comparison Between Augmented and Virtual Reality Collaboration with Handheld Devices,” in Mensch und Computer 2019 – Tagungsband (MuC), 2019, pp. 399–410. doi: 10.1145/3340764.3340773.
  14. S. Hubenschmid, J. Zagermann, S. Butscher, and H. Reiterer, “Employing Tangible Visualisations in Augmented Reality with Mobile Devices,” in Proceedings of the Working Conference on Advanced Visual Interfaces (AVI), 2018, pp. 1–4. [Online]. Available: http://nbn-resolving.de/urn:nbn:de:bsz:352-2-1iooenfo4fofm8
  15. M. Blumenschein et al., “SMARTexplore: Simplifying High-Dimensional Data Analysis through a Table-Based Visual Analytics Approach,” in Proceedings of the IEEE Conference on Visual Analytics Science and Technology (VAST), 2018, pp. 36–47. doi: 10.1109/VAST.2018.8802486.
  16. J. Zagermann, U. Pfeil, and H. Reiterer, “Studying Eye Movements as a Basis for Measuring Cognitive Load,” Proceedings of the CHI Conference on Human Factors in Computing Systems-Extended Abstracts (CHI-EA), p. LBW095:1-LBW095:6, 2018, doi: 10.1145/3170427.3188628.
  17. L. L. Chuang and U. Pfeil, “Transparency and Openness Promotion Guidelines for HCI,” in Proceedings of the CHI Conference on Human Factors in Computing Systems-Extended Abstracts (CHI-EA), 2018, p. SIG04:1-SIG04:4. doi: 10.1145/3170427.3185377.
  18. D. Jäckle, F. Stoffel, S. Mittelstädt, D. A. Keim, and H. Reiterer, “Interpretation of Dimensionally-Reduced Crime Data: A Study with Untrained Domain Experts,” in Proceedings of the Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP), 2017, vol. 3, pp. 164–175. doi: http://dx.doi.org/10.5220/0006265101640175.
  19. J. Zagermann, U. Pfeil, C. Acevedo, and H. Reiterer, “Studying the Benefits and Challenges of Spatial Distribution and Physical Affordances in a Multi-device Workspace,” in Proceedings of the International Conference on Mobile and Ubiquitous Multimedia (MUM), 2017, pp. 249–259. doi: https://doi.org/10.1145/3152832.3152855.
  20. J. Zagermann, U. Pfeil, D. Fink, P. von Bauer, and H. Reiterer, “Memory in Motion: The Influence of Gesture- and Touch-based Input Modalities on Spatial Memory,” in Proceedings of the CHI Conference on Human Factors in Computing Systems, 2017, pp. 1899–1910. doi: 10.1145/3025453.3026001.
  21. L. Lischke, S. Mayer, K. Wolf, N. Henze, H. Reiterer, and A. Schmidt, “Screen Arrangements and Interaction Areas for Large Display Work Places.,” in Proceedings of the ACM International Symposium on Pervasive Displays (PerDis), 2016, pp. 228–234. doi: 10.1145/2914920.2915027.
  22. J. Zagermann, U. Pfeil, R. Rädle, H.-C. Jetter, C. N. Klokmose, and H. Reiterer, “When Tablets meet Tabletops: The Effect of Tabletop Size on Around-the-Table Collaboration with Personal Tablets,” in Proceedings of the CHI Conference on Human Factors in Computing Systems, 2016, pp. 5470–5481. doi: 10.1145/2858036.2858224.
  23. J. Zagermann, U. Pfeil, and H. Reiterer, “Measuring Cognitive Load using Eye Tracking Technology in Visual Computing,” in Proceedings of the Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization (BELIV), 2016, pp. 78–85. doi: 10.1145/2993901.2993908.
  24. J. Müller, R. Rädle, and H. Reiterer, “Virtual Objects as Spatial Cues in Collaborative Mixed Reality Environments: How They Shape Communication Behavior and User Task Load,” in Proceedings of the CHI Conference on Human Factors in Computing Systems, 2016, pp. 1245–1249. doi: 10.1145/2858036.2858043.
  25. S. Butscher and H. Reiterer, “Applying Guidelines for the Design of Distortions on Focus+Context Interfaces,” in Proceedings of the Working Conference on Advanced Visual Interfaces (AVI), 2016, pp. 244–247. doi: 10.1145/2909132.2909284.
  26. L. Lischke et al., “Using Space: Effect of Display Size on Users’ Search Performance,” in Proceedings of the CHI Conference on Human Factors in Computing Systems-Extended Abstracts (CHI-EA), 2015, pp. 1845–1850. doi: 10.1145/2702613.2732845.