Papers
Topics
Authors
Recent
Search
2000 character limit reached

Localization of Just Noticeable Difference for Image Compression

Published 13 Jun 2023 in cs.CV, cs.MM, and eess.IV | (2306.07678v1)

Abstract: The just noticeable difference (JND) is the minimal difference between stimuli that can be detected by a person. The picture-wise just noticeable difference (PJND) for a given reference image and a compression algorithm represents the minimal level of compression that causes noticeable differences in the reconstruction. These differences can only be observed in some specific regions within the image, dubbed as JND-critical regions. Identifying these regions can improve the development of image compression algorithms. Due to the fact that visual perception varies among individuals, determining the PJND values and JND-critical regions for a target population of consumers requires subjective assessment experiments involving a sufficiently large number of observers. In this paper, we propose a novel framework for conducting such experiments using crowdsourcing. By applying this framework, we created a novel PJND dataset, KonJND++, consisting of 300 source images, compressed versions thereof under JPEG or BPG compression, and an average of 43 ratings of PJND and 129 self-reported locations of JND-critical regions for each source image. Our experiments demonstrate the effectiveness and reliability of our proposed framework, which is easy to be adapted for collecting a large-scale dataset. The source code and dataset are available at https://github.com/angchen-dev/LocJND.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (26)
  1. S. Stevens, “On the psychophysical law,” in Stevens’ Handbook of Experimental Psychology, vol. 2.   John Wiley & Sons, 1957, pp. 742–787.
  2. P. Manocha, A. Finkelstein, R. Zhang, N. J. Bryan, G. J. Mysore, and Z. Jin, “A differentiable perceptual audio metric learned from just noticeable differences,” arXiv preprint arXiv:2001.04460, 2020.
  3. H. Quené, “On the just noticeable difference for tempo in speech,” Journal of Phonetics, vol. 35, no. 3, pp. 353–362, 2007.
  4. J. S. Bradley, R. Reich, and S. Norcross, “A just noticeable difference in c50 for speech,” Applied Acoustics, vol. 58, no. 2, pp. 99–108, 1999.
  5. P. B. Nguyen, A. Beghdadi, and M. Luong, “Perceptual watermarking using a new Just-Noticeable-Difference model,” Signal Processing: Image Communication, vol. 28, no. 10, pp. 1506–1525, 2013.
  6. L. Jin, J. Y. Lin, S. Hu, H. Wang, P. Wang, I. Katsavounidis, A. Aaron, and C.-C. J. Kuo, “Statistical study on perceived JPEG image quality via MCL-JCI dataset construction and analysis,” Electronic Imaging, vol. 2016, no. 13, pp. 1–9, 2016.
  7. H. Lin, G. Chen, M. Jenadeleh, V. Hosu, U.-D. Reips, R. Hamzaoui, and D. Saupe, “Large-scale crowdsourced subjective assessment of picturewise just noticeable difference,” IEEE transactions on circuits and systems for video technology, 2022.
  8. H. Wang, I. Katsavounidis, J. Zhou, J. Park, S. Lei, X. Zhou, M.-O. Pun, X. Jin, R. Wang, X. Wang et al., “VideoSet: A large-scale compressed video quality dataset based on JND measurement,” Journal of Visual Communication and Image Representation, vol. 46, pp. 292–302, 2017.
  9. X. Liu, Z. Chen, X. Wang, J. Jiang, and S. Kowng, “JND-Pano: Database for just noticeable difference of JPEG compressed panoramic images,” in Pacific Rim Conference on Multimedia.   Springer, 2018, pp. 458–468.
  10. C. Fan, Y. Zhang, H. Zhang, R. Hamzaoui, and Q. Jiang, “Picture-level just noticeable difference for symmetrically and asymmetrically compressed stereoscopic images: Subjective quality assessment study and datasets,” Journal of Visual Communication and Image Representation, vol. 62, pp. 140–151, 2019.
  11. X. Shen, Z. Ni, W. Yang, X. Zhang, S. Wang, and S. Kwong, “Just Noticeable Distortion Profile Inference: A Patch-Level Structural Visibility Learning Approach,” IEEE Transactions on Image Processing, vol. 30, pp. 26–38, 2020.
  12. H. Wang, W. Gan, S. Hu, J. Y. Lin, L. Jin, L. Song, P. Wang, I. Katsavounidis, A. Aaron, and C.-C. J. Kuo, “MCL-JCV: a JND-based H. 264/AVC video quality assessment dataset,” in 2016 IEEE International Conference on Image Processing (ICIP).   IEEE, 2016, pp. 1509–1513.
  13. ISO/IEC, “Information technology – Advanced image coding and evaluation – Part 2: Evaluation procedure for visually lossless coding,” 2015, number ISO/IEC 29170-2:2015.
  14. H. Lin, M. Jenadeleh, G. Chen, U.-D. Reips, R. Hamzaoui, and D. Saupe, “Subjective assessment of global picture-wise just noticeable difference,” in 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).   IEEE, 2020, pp. 1–6.
  15. V. Hosu, F. Hahn, I. Zingman, and D. Saupe, “Reported attention as a promising alternative to gaze in IQA tasks,” in PQS 2016: 5th ISCA/DEGA Workshop on Perceptual Quality of Systems, 2016, pp. 117–121.
  16. J. Y. Lin, L. Jin, S. Hu, I. Katsavounidis, Z. Li, A. Aaron, and C.-C. J. Kuo, “Experimental design and analysis of JND test on coded image/video,” in Applications of digital image processing XXXVIII, vol. 9599.   International Society for Optics and Photonics, 2015, p. 95990Z.
  17. M. Jiang, S. Huang, J. Duan, and Q. Zhao, “SALICON: Saliency in Context,” in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015.
  18. E. Pergament, P. Tandon, K. Tatwawadi, O. Rippel, L. Bourdev, B. Olshausen, T. Weissman, S. Katti, and A. G. Anderson, “An Interactive Annotation Tool for Perceptual Video Compression,” arXiv preprint arXiv:2205.03969, 2022.
  19. ISO 7810 ID-1, “Identification cards — Physical characteristics – Part 3.5: ID-1,” 2019.
  20. Q. Li, S. J. Joo, J. D. Yeatman, and K. Reinecke, “Controlling for participants’ Viewing Distance in Large-Scale, psychophysical online experiments Using a Virtual chinrest,” Scientific Reports, vol. 10, no. 1, pp. 1–11, 2020.
  21. J. Le, A. Edmonds, V. Hester, and L. Biewald, “Ensuring quality in crowdsourced search relevance evaluation: The effects of training question distribution,” in SIGIR 2010 workshop on crowdsourcing for search evaluation, vol. 2126, 2010, pp. 22–32.
  22. Y. Cheng, “Mean shift, mode seeking, and clustering,” IEEE transactions on pattern analysis and machine intelligence, vol. 17, no. 8, pp. 790–799, 1995.
  23. Y. Patel, S. Appalaraju, and R. Manmatha, “Saliency driven perceptual image compression,” in Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2021, pp. 227–236.
  24. O. Wiedemann, V. Hosu, H. Lin, and D. Saupe, “Disregarding the big picture: Towards local image quality assessment,” in 2018 Tenth International Conference on Quality of Multimedia Experience (QoMEX).   IEEE, 2018, pp. 1–6.
  25. V. Hosu, F. Hahn, O. Wiedemann, S.-H. Jung, and D. Saupe, “Saliency-driven image coding improves overall perceived JPEG quality,” in 2016 Picture Coding Symposium (PCS).   IEEE, 2016, pp. 1–5.
  26. O. Wiedemann, V. Hosu, H. Lin, and D. Saupe, “Foveated video coding for real-time streaming applications,” in 2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX).   IEEE, 2020, pp. 1–6.
Citations (1)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up