Papers
Topics
Authors
Recent
Search
2000 character limit reached

VisQuiz: Exploring Feedback Mechanisms to Improve Graphical Perception

Published 19 Jul 2022 in cs.HC | (2207.09534v3)

Abstract: Graphical perception studies are a key element of visualization research, forming the basis of design recommendations and contributing to our understanding of how people make sense of visualizations. However, graphical perception studies typically include only brief training sessions, and the impact of longer and more in-depth feedback remains unclear. In this paper, we explore the design and evaluation of feedback for graphical perception tasks, called VisQuiz. Using a quiz-like metaphor, we design feedback for a typical visualization comparison experiment, showing participants their answer alongside the correct answer in an animated sequence in each trial. We extend this quiz metaphor to include summary feedback after each stage of the experiment, providing additional moments for participants to reflect on their performance. To evaluate VisQuiz, we conduct a between-subjects experiment, including three stages of 40 trials each with a control condition that included only summary feedback. Results from n = 80 participants show that once participants started receiving trial feedback (Stage 2) they performed significantly better with bubble charts than those in the control condition. This effect carried over when feedback was removed (Stage 3). Results also suggest an overall trend of improved performance due to feedback. We discuss these findings in the context of other visualization literacy efforts, and possible future work at the intersection of visualization, feedback, and learning. Experiment data and analysis scripts are available at the following repository https://osf.io/jys5d/

Definition Search Book Streamline Icon: https://streamlinehq.com
References (27)
  1. Guess the Correlation. http://guessthecorrelation.com/. Online; accessed: 2022-04-20.
  2. Visualization literacy at elementary school. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, CHI ’17, p. 5485–5497. Association for Computing Machinery, New York, NY, USA, 2017.
  3. Useful junk? the effects of visual embellishment on comprehension and memorability of charts. In Proceedings of the SIGCHI conference on human factors in computing systems, pp. 2573–2582, 2010.
  4. A principled way of assessing visualization literacy. IEEE transactions on visualization and computer graphics, 20(12):1963–1972, 2014.
  5. W. S. Cleveland and R. McGill. Graphical perception: Theory, experimentation, and application to the development of graphical methods. Journal of the American statistical association, 79(387):531–554, 1984.
  6. Treemap literacy: A classroom-based investigation. In Eurographics Proceedings, 2020.
  7. Uncertainty displays using quantile dotplots or CDFs improve transit decision-making. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1–12, 2018.
  8. Interactive visualization literacy: The state-of-the-art. Information Visualization, p. 14738716221081831, 2021.
  9. The science of visual data communication: What works. Psychological Science in the Public Interest, 22(3):110–161, 2021.
  10. J. Heer and M. Bostock. Crowdsourcing graphical perception: Using mechanical turk to assess visualization design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’10, p. 203–212. Association for Computing Machinery, New York, NY, USA, 2010. doi: 10 . 1145/1753326 . 1753357
  11. The impact of social information on visual judgments. In Proceedings of the SIGCHI conference on human factors in computing systems, pp. 1461–1470, 2011.
  12. M. Kay and J. Heer. Beyond weber’s law: A second look at ranking visualizations of correlation. IEEE Transactions on Visualization and Computer Graphics, 22(1):469–478, 2016.
  13. Toward a model of learning data representations. In Proceedings of the Twenty-Third Annual Conference of the Cognitive Science Society, Mahwah, NJ: Erlbaum, pp. 45–50, 2001.
  14. Perceptual guidelines for creating rectangular treemaps. IEEE transactions on visualization and computer graphics, 16(6):990–998, 2010.
  15. R. Kosara. Evidence for area as the primary visual cue in pie charts. In 2019 IEEE Visualization Conference (VIS), pp. 101–105. IEEE, 2019.
  16. Vlat: Development of a visualization literacy assessment test. IEEE transactions on visualization and computer graphics, 23(1):551–560, 2016.
  17. Rethinking the ranks of visual channels. IEEE Transactions on Visualization and Computer Graphics, 28(1):707–717, 2021.
  18. Assessing the effect of visualizations on bayesian reasoning through crowdsourcing. IEEE transactions on visualization and computer graphics, 18(12):2536–2545, 2012.
  19. D. R. Montello. Cognitive map-design research in the twentieth century: Theoretical and empirical approaches. Cartography and Geographic Information Science, 29(3):283–304, 2002.
  20. Evaluating multivariate network visualization techniques using a validated design and crowdsourcing approach. In Proceedings of the 2020 CHI conference on human factors in computing systems, pp. 1–12, 2020.
  21. Improving bayesian reasoning: The effects of phrasing, visualization, and spatial ability. IEEE transactions on visualization and computer graphics, 22(1):529–538, 2015.
  22. Juvenile graphical perception: A comparison between children and adults. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, pp. 1–17, 2022.
  23. K. Reinecke and K. Z. Gajos. Quantifying visual preferences around the world. In Proceedings of the SIGCHI conference on human factors in computing systems, pp. 11–20, 2014.
  24. Design and comparative evaluation of visualization onboarding methods. In The 14th International Symposium on Visual Information Communication and Interaction, pp. 1–5, 2021.
  25. Four experiments on the perception of bar charts. IEEE Transactions on Visualization and Computer Graphics, 20(12):2152–2160, 2014.
  26. Biased average position estimates in line and bar graphs: Underestimation, overestimation, and perceptual pull. IEEE Transactions on Visualization and Computer Graphics, 26(1):301–310, 2020.
  27. Correlation judgment and visualization features: A comparative study. IEEE transactions on visualization and computer graphics, 25(3):1474–1488, 2018.
Citations (2)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up