A05 | Image/Video Quality Assessment: From Test Databases to Similarity-Aware and Perceptual Dynamic Metrics
The project addresses methods for automated visual quality assessment and their validation beyond mean opinion scores. We propose to enhance the methods by including similarity awareness and predicted eye movement sequences, quantifying the perceptual viewing experience, and to apply the metrics for quality-aware media processing. Moreover, we will set up and apply media databases that are diverse in content and authentic in the distortions, in contrast to current scientific data sets.
Research Questions
How can crowdsourcing be applied to help generating very large video media data bases for research applications in quality of multimedia?
What is the performance of state-of-the-art video quality assessment methods that were designed based on small training sets for such large and diversified media databases?
Quality assessment in such extremely large empirical studies requires crowdsourcing. How should that be organized to achieve sufficient reliability and efficiency?
Are machine learning techniques suitable to identify the best performing video quality assessment metrics for given media content?
What statistical/perceptual features should be extracted to express similarity for this task?
How can one design new or hybrid strategies for video quality assessment based on the above?
Can we improve methods for image/video quality assessment by studying patterns of human visual attention and other perceptual aspects?
How can knowledge on human visual attention derived from eyetracking studies be incorporated into perceptual image/video quality assessment methods?
How can the quality assessment methods be applied in quality-aware media processing such as perceptual coding?
Fig. 1: Training Better Algorithms to Predict Subjective Quality Opinions.
Fig. 2: Saliency Driven Compression.
Visual Quality Databases
KoNVid-1k | Video benchmark database
KonIQ-10k | Ecologically valid image benchmark database
IQA-Experts-300 | Expert annotated image benchmark database
Our massive multimedia databases are suitable for training generic and accurate VQA models. More Information on database.mmsp-kn.de
Publications
- O. Wiedemann, V. Hosu, H. Lin, and D. Saupe, “Disregarding the big picture: towards local image quality assessment,” 2018.
- D. Varga, T. Szirányi, and D. Saupe, ““DeepRN: a content preserving deep architecture for blind image quality assessment,” 2018.
- H. Men, H. Lin, and D. Saupe, “Spatiotemporal feature combination model for no-reference video quality assessment,” 2018.
- M. Jenadeleh, M. Pedersen, and D. Saupe, “‘Realtime quality assessment of iris biometrics under visible light,’” IEEE Comp. Soc. Workshop on Biometrics, pp. 556–565, 2018.
- V. Hosu, H. Lin, and D. Saupe, “‘Expertise screening in crowdsourcing image quality,’” 2018.
- S. Egger-Lampl et al., “Dagstuhl Seminar 15481, Dagstuhl Castle, Germany, November 22 – 27, 2015, Revised Contributions,” in Evaluation in the Crowd. Crowdsourcing and Human-Centered Experiments, vol. Information Systems and Applications, incl. Internet/Web, and HCI, no. 10264, D. Archambault, H. Purchase, and T. Hossfeld, Eds. Springer International Publishing, 2017, pp. 173–212.
- U. Gadiraju et al., “Crowdsourcing versus the laboratory: Towards human-centered experiments using the crowd,” in Information Systems and Applications, incl. Internet/Web, and HCI, vol. Evaluation in the Crowd. Crowdsourcing and Human-Centered Experiments, no. 10264, D. Archambault, H. Purchase, and T. Hossfeld, Eds. Springer International Publishing, 2017, pp. 7–30.
- M. Spicker, F. Hahn, T. Lindemeier, D. Saupe, and O. Deussen, “Quantifying Visual Abstraction Quality for Stipple Drawings,” in Proceedings of NPAR’17, 2017.
- V. Hosu et al., “The Konstanz natural video database (KoNViD-1k),” in 9th International Conference on Quality of Multimedia Experience (QoMEX), 2017.
- V. Hosu, F. Hahn, O. Wiedemann, S.-H. Jung, and D. Saupe, “Saliency-driven image coding improves overall perceived JPEG quality,” in Picture Coding Symposium (PCS), 2016.
- I. Zingman, D. Saupe, O. Penatti, and K. Lambers, “Detection of Fragmented Rectangular Enclosures in Very High Resolution Remote Sensing Images,” 2016.
- D. Saupe, F. Hahn, V. Hosu, I. Zingman, M. Rana, and S. Li, “Crowd workers proven useful: A comparative study of subjective video quality assessment,” 8th International Conference on Quality of Multimedia Experience (QoMEX 2016), Lisbon, Portugal, 2016.
- V. Hosu, F. Hahn, I. Zingman, and D. Saupe, “Reported Attention as a Promising Alternative to Gaze in IQA Tasks,” 5th International Workshop on Perceptual Quality of Systems 2016 (PQS 2016), Berlin, 2016.
Project Group A
Models and Measures
Completed
Project Group B
Adaptive Algorithms
Completed
Project Group C
Interaction
Completed
Project Group D
Applications
Completed
FOR SCIENTISTS
FOR PUPILS
PRESS AND MEDIA
SOCIAL MEDIA
© SFB-TRR 161 | Quantitative Methods for Visual Computing | 2019.