Perceptual Image Quality

2 minute read

Published:

Introduction

  1. What is Image quality assessment?
  2. Are technical image quality and aesthetic image quality different?
  3. What are the popular types of image quality assessment? Full Reference vs No Reference
  4. What are the popular benchmarks?
  5. How do people collect ground truth for perceptual image quality measurement?
    • How do we convert subjective ratings into objective metrics?
    • What are the computational challenges involved?
    • Is personalization required?
  6. What are the important applications of perceptual image quality assessment?

Important Datasets

*Under construction

DatasetNumber of ImagesRatings MetadataNumber of AnnotatorsAnnotator InstructionsLicense InformationDescription and Creation Process
LIVE29 reference,
982 distorted
MOS from multiple observers;
Mean and standard deviation
101Conducted Mean Opinion Score (MOS) tests with paired comparisonsNot specifiedContains distorted images generated from reference images. Collected human-rated Mean Opinion Scores (MOS).
TID201325 reference,
3000 distorted
MOS for various distortion types;
Std. dev. and skewness
8 - 25Gave explicit instructions for scoring distortionsNot specifiedReference and distorted images with various distortions. Collected MOS for each distortion type from observers.
CSIQ30 reference,
866 distorted
MOS for different distortion types; Mean, median, and range6 - 25Performed ACR-based subjective quality evaluationsNot specifiedReference and distorted images from different sources. MOS collected for various distortion types.
MCL-JCI150 reference,
1650 distorted
MOS from multiple observers; Std. dev. and skewness6 - 15Conducted absolute categorical judgment experimentsNot specifiedIncludes reference and distorted images with diverse distortions. Collected in a controlled lab environment.
TID200825 reference,
1700 distorted
MOS for various distortion types; Std. dev. and skewness25Provided detailed guidelines and protocols for subjective testsNot specifiedContains reference and distorted images with multiple distortion types. Subjective scores gathered from observers.
KADID-10kimagesMOS from diverse observers; Std. dev. and skewness229Performed paired comparison testsCreative Commons BY-NC-SA 4.0Large-scale database with diverse distortions. MOS collected from a variety of observers.
KONVID-1kvideosMOS for video sequences; Std. dev. and skewness120 - 180Collected MOS using Single Stimulus Continuous Quality EvaluationNot specifiedFocuses on video quality. Contains video sequences with distortion types. Provides MOS for each sequence.
KOSMO-1k1350 videosMOS for video sequences; Std. dev. and skewness120 - 180Collected MOS using Single Stimulus Continuous Quality EvaluationNot specifiedFocuses on video quality. Contains video sequences with distortion types. Provides MOS for each sequence.
EVA MOS for video sequences; Std. dev. and skewness120 - 180Collected MOS using Single Stimulus Continuous Quality EvaluationNot specifiedExplainable Visual Aesthetics
RPCD MOS for video sequences; Std. dev. and skewness120 - 180Collected MOS using Single Stimulus Continuous Quality EvaluationNot specifiedExplainable Visual Aesthetics

References

  1. https://github.com/chaofengc/Awesome-Image-Quality-Assessment
  2. https://towardsdatascience.com/deep-image-quality-assessment-30ad71641fac
  3. https://github.com/idealo/image-quality-assessment
  4. https://github.com/weizhou-geek/Image-Quality-Assessment-Benchmark
  5. https://en.wikipedia.org/wiki/Image_quality