Papers
Topics
Authors
Recent
Search
2000 character limit reached

Exploring Users' Pointing Performance on Virtual and Physical Large Curved Displays

Published 10 Oct 2023 in cs.HC | (2310.06307v1)

Abstract: Large curved displays have emerged as a powerful platform for collaboration, data visualization, and entertainment. These displays provide highly immersive experiences, a wider field of view, and higher satisfaction levels. Yet, large curved displays are not commonly available due to their high costs. With the recent advancement of Head Mounted Displays (HMDs), large curved displays can be simulated in Virtual Reality (VR) with minimal cost and space requirements. However, to consider the virtual display as an alternative to the physical display, it is necessary to uncover user performance differences (e.g., pointing speed and accuracy) between these two platforms. In this paper, we explored users' pointing performance on both physical and virtual large curved displays. Specifically, with two studies, we investigate users' performance between the two platforms for standard pointing factors such as target width, target amplitude as well as users' position relative to the screen. Results from user studies reveal no significant difference in pointing performance between the two platforms when users are located at the same position relative to the screen. In addition, we observe users' pointing performance improves when they are located at the center of a semi-circular display compared to off-centered positions. We conclude by outlining design implications for pointing on large curved virtual displays. These findings show that large curved virtual displays are a viable alternative to physical displays for pointing tasks.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (71)
  1. A research on curved display comparing to flat display regarding posture, tilt angle, focusing area and satisfaction. Journal of the Ergonomics Society of Korea 33, 3 (2014), 191–202.
  2. TLX @ NASA Ames. 2023. Home. Retrieved January 15, 2023 from https://humansystems.arc.nasa.gov/groups/tlx/.
  3. Information visualization on large, high-resolution displays: Issues, challenges, and opportunities. Information Visualization 10, 4 (2011), 341–355. https://doi.org/10.1177/1473871611415997 arXiv:https://doi.org/10.1177/1473871611415997
  4. Interaction with Large Displays: A Survey. ACM Comput. Surv. 47, 3, Article 46 (feb 2015), 38 pages. https://doi.org/10.1145/2682623
  5. Pocket6: A 6DoF Controller Based On A Simple Smartphone Application. In Proceedings of the 2018 ACM Symposium on Spatial User Interaction (Berlin, Germany) (SUI ’18). Association for Computing Machinery, New York, NY, USA, 2–10. https://doi.org/10.1145/3267782.3267785
  6. Effect of Stereo Deficiencies on Virtual Distal Pointing. In Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (Tsukuba, Japan) (VRST ’22). Association for Computing Machinery, New York, NY, USA, Article 12, 8 pages. https://doi.org/10.1145/3562939.3565621
  7. Do Head-Mounted Display Stereo Deficiencies Affect 3D Pointing Tasks in AR and VR?. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 585–592. https://doi.org/10.1109/VR.2019.8797975
  8. Focus plus Context Screens: Combining Display Technology with Visualization Techniques. In Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology (Orlando, Florida) (UIST ’01). Association for Computing Machinery, New York, NY, USA, 31–40. https://doi.org/10.1145/502348.502354
  9. An Exploratory Study of Input Configuration and Group Process in a Negotiation Task Using a Large Display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’07). Association for Computing Machinery, New York, NY, USA, 91–100. https://doi.org/10.1145/1240624.1240638
  10. A Large Curved Display System in Virtual Reality for Immersive Data Interaction. In 2019 IEEE Games, Entertainment, Media Conference (GEM). 1–4. https://doi.org/10.1109/GEM.2019.8811550
  11. Information Visualization. Readings in Information Visualization.
  12. Evaluation of Mouse, Rate-Controlled Isometric Joystick, Step Keys, and Text Keys for Text Selection on a CRT. Ergonomics 21, 8 (1978), 601–613. https://doi.org/10.1080/00140137808931762 arXiv:https://doi.org/10.1080/00140137808931762
  13. Dataspace: A Reconfigurable Hybrid Reality Environment for Collaborative Information Analysis. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 145–153. https://doi.org/10.1109/VR.2019.8797733
  14. Wriarm: Leveraging wrist movement to design wrist+ arm based teleportation in vr. In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 317–325.
  15. A Review of Overview+detail, Zooming, and Focus+context Interfaces. ACM Comput. Surv. 41, 1, Article 2 (jan 2009), 31 pages. https://doi.org/10.1145/1456650.1456652
  16. Edward RFW Crossman. 1956. The measurement of perceptual load in manual operations. Ph. D. Dissertation. University of Birmingham.
  17. The Effect of Different Viewing Devices for the Sense of Presence of Immersion in Virtual Environments: A Comparison of Stereoprojections Based on Monitors, HMDs and Screens. In HCI (2). 881–884.
  18. Moving Ahead with Peephole Pointing: Modelling Object Selection with Head-Worn Display Field of View Limitations. In Proceedings of the 2016 Symposium on Spatial User Interaction (Tokyo, Japan) (SUI ’16). Association for Computing Machinery, New York, NY, USA, 107–110. https://doi.org/10.1145/2983310.2985756
  19. Paul M Fitts. 1954. The information capacity of the human motor system in controlling the amplitude of movement. Journal of experimental psychology 47, 6 (1954), 381. https://doi.org/10.1037/h0055392
  20. Paul M Fitts. 1992. The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology: General 121, 3 (1992), 262. https://doi.org/10.1037/0096-3445.121.3.262
  21. Google. 2023. Firebase realtime database: store and SYNC data in Real time. Retrieved January 15, 2023 from https://firebase.google.com/products/realtime-database.
  22. Tovi Grossman and Ravin Balakrishnan. 2004. Pointing at Trivariate Targets in 3D Environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vienna, Austria) (CHI ’04). Association for Computing Machinery, New York, NY, USA, 447–454. https://doi.org/10.1145/985692.985749
  23. A Fitts’ Law Study of Click and Dwell Interaction by Gaze, Head and Mouse with a Head-Mounted Display. In Proceedings of the Workshop on Communication by Gaze Interaction (Warsaw, Poland) (COGAIN ’18). Association for Computing Machinery, New York, NY, USA, Article 7, 5 pages. https://doi.org/10.1145/3206343.3206344
  24. Myopoint: Pointing and Clicking Using Forearm Mounted Electromyography and Inertial Motion Sensors. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 3653–3656. https://doi.org/10.1145/2702123.2702133
  25. Investigating Pointing Tasks across Angularly Coupled Display Areas. In Human-Computer Interaction – INTERACT 2013, Paula Kotzé, Gary Marsden, Gitte Lindgaard, Janet Wesson, and Marco Winckler (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 720–727.
  26. ERROL R. HOFFMANN. 1995. Effective target tolerance in an inverted Fitts task. Ergonomics 38, 4 (1995), 828–836. https://doi.org/10.1080/00140139508925153 arXiv:https://doi.org/10.1080/00140139508925153
  27. Performance in one-, two- and three-dimensional terminal aiming tasks. Ergonomics 54, 12 (2011), 1175–1185. https://doi.org/10.1080/00140139.2011.614356 arXiv:https://doi.org/10.1080/00140139.2011.614356 PMID: 22103725.
  28. Errol R Hoffmann and Ilyas H Sheikh. 1994. Effect of varying target height in a Fitts’ movement task. Ergonomics 37, 6 (1994), 1071–1088.
  29. Juan Pablo Hourcade and Natasha Bullock-Rest. 2012. How Small Can You Go? Analyzing the Effect of Visual Angle in Pointing Tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI ’12). Association for Computing Machinery, New York, NY, USA, 213–216. https://doi.org/10.1145/2207676.2207706
  30. ISO ISO. 2000. 9241-9 Ergonomic requirements for office work with visual display terminals (VDTs)-Part 9: Requirements for non-keyboard input devices (FDIS-Final Draft International Standard), 2000. International Organization for Standardization (2000).
  31. Modeling the Impact of Depth on Pointing Performance. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 188–199. https://doi.org/10.1145/2858036.2858244
  32. The Effects of Virtual Reality, Augmented Reality, and Motion Parallax on Egocentric Depth Perception. In Proceedings of the 5th Symposium on Applied Perception in Graphics and Visualization (Los Angeles, California) (APGV ’08). Association for Computing Machinery, New York, NY, USA, 9–14. https://doi.org/10.1145/1394281.1394283
  33. A Comparison of Ray Pointing Techniques for Very Large Displays. In Proceedings of Graphics Interface 2010 (Ottawa, Ontario, Canada) (GI ’10). Canadian Information Processing Society, CAN, 269–276. https://doi.org/10.5555/1839214.1839261
  34. Designing physical and social intergenerational family entertainment. Interacting with Computers 21, 1-2 (11 2008), 76–87. https://doi.org/10.1016/j.intcom.2008.10.009 arXiv:https://academic.oup.com/iwc/article-pdf/21/1-2/76/2164289/iwc21-0076.pdf
  35. G.V. Kondraske. 1994. An angular motion Fitt’s Law for human performance modeling and prediction. In Proceedings of 16th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Vol. 1. 307–308 vol.1. https://doi.org/10.1109/IEMBS.1994.412031
  36. A human motor behavior model for distal pointing tasks. International Journal of Human-Computer Studies 68, 10 (2010), 603–615. https://doi.org/10.1016/j.ijhcs.2010.05.001
  37. Régis Augusto Poli Kopper. 2011. Understanding and improving distal pointing interaction. Ph. D. Dissertation. Virginia Tech. http://hdl.handle.net/10919/28183
  38. Perceptual influences on Fitts’ law. Experimental Brain Research 190, 1 (2008), 99–103. https://doi.org/10.1007/s00221-008-1497-3
  39. On Motor Performance in Virtual 3D Object Manipulation. IEEE Transactions on Visualization and Computer Graphics 26, 5 (2020), 2041–2050. https://doi.org/10.1109/TVCG.2020.2973034
  40. Gyouhyung Kyung and Sungryul Park. 2021. Curved versus flat monitors: Interactive effects of display curvature radius and display size on visual search performance and visual fatigue. Human Factors 63, 7 (2021), 1182–1195. https://doi.org/10.1177/0018720820922717
  41. Jan Leusmann and Sven Mayer Katrin Angerbauer. 2021. A literature review on distant object selection methods. (2021). https://doi.org/10.18419/opus-12060
  42. MAGIC-Pointing on Large High-Resolution Displays. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (San Jose, California, USA) (CHI EA ’16). Association for Computing Machinery, New York, NY, USA, 1706–1712. https://doi.org/10.1145/2851581.2892479
  43. Design and Evaluation of Interactive Small Multiples Data Visualisation in Immersive Spaces. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 588–597. https://doi.org/10.1109/VR46266.2020.00081
  44. Effects of Display Layout on Spatial Memory for Immersive Environments. Proceedings of the ACM on Human-Computer Interaction 6, ISS (2022), 468–488.
  45. Gunslinger: Subtle Arms-down Mid-Air Interaction. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (Charlotte, NC, USA) (UIST ’15). Association for Computing Machinery, New York, NY, USA, 63–71. https://doi.org/10.1145/2807442.2807489
  46. I. Scott MacKenzie. 1992. Fitts’ Law as a Research and Design Tool in Human-Computer Interaction. Hum.-Comput. Interact. 7, 1 (mar 1992), 91–139. https://doi.org/10.1207/s15327051hci0701_3
  47. I. Scott MacKenzie and William Buxton. 1992. Extending Fitts’ Law to Two-Dimensional Tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Monterey, California, USA) (CHI ’92). Association for Computing Machinery, New York, NY, USA, 219–226. https://doi.org/10.1145/142750.142794
  48. Mechdyne. 2023. Mechdyne Corporation. Retrieved June 15, 2023 from https://www.mechdyne.com/.
  49. Meta. 2023. Meta quest 2: Advanced all-in-one VR headset. Retrieved January 15, 2023 from https://www.meta.com/gb/en/quest/products/quest-2.
  50. Depth perception within virtual environments: comparison between two display technologies. International Journ. on Advances in Intelligent Systems 3 (2010).
  51. High-Precision Pointing on Large Wall Displays Using Small Handheld Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). Association for Computing Machinery, New York, NY, USA, 831–840. https://doi.org/10.1145/2470654.2470773
  52. Designing Large-Display Workspaces for Cooperative Travel Consultancy. In CHI ’08 Extended Abstracts on Human Factors in Computing Systems (Florence, Italy) (CHI EA ’08). Association for Computing Machinery, New York, NY, USA, 2877–2882. https://doi.org/10.1145/1358628.1358777
  53. OptiTrack. 2023. OptiTrack - Motion Capture Systems. Retrieved June 15, 2023 from https://optitrack.com/.
  54. Effects of display curvature, display zone, and task duration on legibility and visual fatigue during visual search task. Applied Ergonomics 60 (2017), 183–193. https://doi.org/10.1016/j.apergo.2016.11.012
  55. Effects of display curvature and task duration on proofreading performance, visual discomfort, visual fatigue, mental workload, and user satisfaction. Applied Ergonomics 78 (2019), 26–36. https://doi.org/10.1016/j.apergo.2019.01.014
  56. A Method for Evaluating Head-Controlled Computer Input Devices Using Fitts’ Law. Human Factors 32, 4 (1990), 423–438. https://doi.org/10.1177/001872089003200405 arXiv:https://doi.org/10.1177/001872089003200405 PMID: 2150065.
  57. The CHI 2013 Interactive Schedule. In CHI ’13 Extended Abstracts on Human Factors in Computing Systems (Paris, France) (CHI EA ’13). Association for Computing Machinery, New York, NY, USA, 2987–2990. https://doi.org/10.1145/2468356.2479591
  58. Jürgen Scheible and Timo Ojala. 2005. MobiLenin Combining a Multi-Track Music Video, Personal Mobile Phones and a Public Display into Multi-User Interactive Entertainment. In Proceedings of the 13th Annual ACM International Conference on Multimedia (Hilton, Singapore) (MULTIMEDIA ’05). Association for Computing Machinery, New York, NY, USA, 199–208. https://doi.org/10.1145/1101149.1101178
  59. Virtual reality induced symptoms and effects (VRISE): Comparison of head mounted display (HMD), desktop and projection display systems. Displays 29, 2 (2008), 58–69. https://doi.org/10.1016/j.displa.2007.09.005 Health and Safety Aspects of Visual Displays.
  60. Pointing Cursor Interaction in Virtual Reality from the Perspective of Distance Perception. Traitement du Signal 39, 2 (2022). https://doi.org/10.18280/ts.390209
  61. Two-Part Models Capture the Impact of Gain on Pointing Performance. ACM Trans. Comput.-Hum. Interact. 19, 4, Article 28 (dec 2012), 34 pages. https://doi.org/10.1145/2395131.2395135
  62. Shaping the display of the future: The effects of display size and curvature on user performance and insights. Human–Computer Interaction 24, 1-2 (2009), 230–272. https://doi.org/10.1080/07370020902739429
  63. Pointing at a Distance with Everyday Smart Devices. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3173574.3173747
  64. R. William Soukoreff and I. Scott MacKenzie. 2004. Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts’ law research in HCI. International Journal of Human-Computer Studies 61, 6 (2004), 751–789. https://doi.org/10.1016/j.ijhcs.2004.09.001 Fitts’ law 50 years later: applications and contributions from human-computer interaction.
  65. Evaluation of Curved Raycasting-based Interactive Surfaces in Virtual Environments. In 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 534–535. https://doi.org/10.1109/VRW52623.2021.00149
  66. Freehand interaction with large displays: Effects of body posture, interaction distance and target size on task performance, perceived usability and workload. Applied Ergonomics 93 (2021), 103370. https://doi.org/10.1016/j.apergo.2021.103370
  67. Unity technologies. 2023. Unity Real-Time Development Platform — 2D, 3D, VR & AR Engine. Retrieved January 15, 2023 from https://unity.com/.
  68. Eleftherios Triantafyllidis and Zhibin Li. 2021. The Challenges in Modeling Human Performance in 3D Space with Fitts’ Law. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI EA ’21). Association for Computing Machinery, New York, NY, USA, Article 56, 9 pages. https://doi.org/10.1145/3411763.3443442
  69. Exploring Users Pointing Performance on Large Displays with Different Curvatures in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics (2023).
  70. Comparing immersiveness and perceptibility of spherical and curved displays. Applied Ergonomics 90 (2021), 103271.
  71. Extending Fitts’ Law to Account for the Effects of Movement Direction on 2d Pointing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI ’12). Association for Computing Machinery, New York, NY, USA, 3185–3194. https://doi.org/10.1145/2207676.2208737
Citations (4)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up