Beyond Hiding and Revealing: Exploring Effects of Visibility and Form of Interaction on the Witness Experience
Abstract: Our interactions with technology do not just shape our individual experiences. They also affect people around us. Although previous research has addressed such "witness" experiences, the actual effect of interaction design on the witness experience remains largely unknown. In an online study (n = 407), we explored how witnesses perceive mid-air gesture-based interactions with a hearing aid, using four video vignettes. We studied witnesses' subjective visibility of manipulations and effects (following Reeves and colleagues' taxonomy), perceived form of interaction, subjective experience, and relationships between these measures. Although visibility patterns matched the intended form, they did not lead to the supposed experience (i.e., "suspenseful" gestures did not lead to suspenseful experiences). The paper illustrates gaps in current research about witness experiences, demonstrates the need to overcome basic hiding/revealing profiles, and indicates a path forward by focusing on aesthetic forms and experiences.
- Are You Comfortable Doing That?: Acceptance Studies of Around-device Gestures In And For Public Settings. In Proceedings of the 16th International Conference on Human-Computer Interaction with Mobile Devices & Services - MobileHCI’14. ACM, New York, NY, USA, 193–202. https://doi.org/10.1145/2628363.2628381
- Performer vs. Observer: Whose Comfort Level Should We Consider When Examining the Social Acceptability of Input Modalities for Head-worn Display?. In Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology. ACM, New York, NY, USA, 1–9. https://doi.org/10.1145/3281505.3281541
- Eric P.S. Baumer and Jed R. Brubaker. 2017. Post-userism. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 6291–6303. https://doi.org/10.1145/3025453.3025740
- Susanne Bødker. 2006. When Second Wave HCI Meets Third Wave Challenges. In Proceedings of the 4th Nordic Conference on Human-Computer Interaction - NordiCHI’06. ACM, New York, NY, USA, 1–8. https://doi.org/10.1145/1182475.1182476
- Design Framework for Social Wearables. In Proceedings of the 2019 on Designing Interactive Systems Conference - DIS’19. ACM, New York, NY, USA, 1001–1015. https://doi.org/10.1145/3322276.3322291
- Pieter Desmet and Marc Hassenzahl. 2012. Towards Happiness: Possibility-Driven Design. In Human-Computer Interaction: The Agency Perspective, Marielba Zacarias and José Valente de Oliveira (Eds.). Vol. 396. Springer Berlin Heidelberg, Berlin, Heidelberg, 3–27. https://doi.org/10.1007/978-3-642-25691-2_1
- Designing for Well-being: A Case Study of Keeping Small Secrets. Journal of Positive Psychology 12, 2 (2017), 151–158. https://doi.org/10.1080/17439760.2016.1163405
- An Interaction Vocabulary. Describing the How Of Interaction. In CHI ’13 Extended Abstracts - CHI EA ’13. ACM, New York, NY, USA, 607–612. https://doi.org/10.1145/2468356.2468463
- Judith Dörrenbächer and Marc Hassenzahl. 2019. Changing Perspective: A Co-Design Approach to Explore Future Possibilities of Divergent Hearing. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI’19. ACM, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300259
- Paul Dourish. 2004. What We Talk About When We Talk About Context. Personal and Ubiquitous Computing 8, 1 (2004), 19–30. https://doi.org/10.1007/s00779-003-0253-8
- Candid Interaction: Revealing Hidden Mobile and Wearable Computing Activities. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology - UIST’15. ACM, New York, NY, USA, 467–476. https://doi.org/10.1145/2807442.2807449
- Felix A. Epp. 2019. Expressive Wearables: Practices-oriented Codesign for New Forms of Social Mobile Technology. International Journal of Mobile Human Computer Interaction 11, 4 (2019), 1–15. https://doi.org/10.4018/IJMHCI.2019100101
- Erving Goffman. 1959. The Presentation of Self in Everyday Life. Anchor Books, New York, NY, USA. https://www.penguinrandomhouse.com/books/61106/the-presentation-of-self-in-everyday-life-by-erving-goffman/
- Design Probes Study on User Perceptions of a Smart Glasses Concept. In Proceedings of the 14th International Conference on Mobile and Ubiquitous Multimedia - MUM’15. ACM, New York, NY, USA, 223–233. https://doi.org/10.1145/2836041.2836064
- Needs, Affect, and Interactive Products – Facets of User Experience. Interacting with Computers 22, 5 (2010), 353–362. https://doi.org/10.1016/j.intcom.2010.04.002
- On the Stories Activity Trackers Tell. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct. ACM, New York, NY, USA, 582–587. https://doi.org/10.1145/2968219.2968325
- Marc Hassenzahl and Noam Tractinsky. 2006. User Experience - A Research Agenda. Behaviour & Information Technology 25, 2 (2006), 91–97. https://doi.org/10.1080/01449290500330331
- Towards a Consensus Gesture Set: A Survey of Mid-Air Gestures in HCI for Maximized Agreement Across Domains. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–24. https://doi.org/10.1145/3544548.3581420
- Wellbeing in the Making: Peoples’ Experiences with Wearable Activity Trackers. Psychology of Well-Being 6, 1 (2016), 17 pages. https://doi.org/10.1186/s13612-016-0042-6
- Norene Kelly and Stephen Gilbert. 2016. The WEAR Scale: Developing a Measure of the Social Acceptability of a Wearable Device. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA’16. ACM, New York, NY, USA, 2864–2871. https://doi.org/10.1145/2851581.2892331
- All About Acceptability?: Identifying Factors for the Adoption of Data Glasses. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 295–300. https://doi.org/10.1145/3025453.3025749
- Social Acceptability in HCI: A Survey of Methods, Measures, and Design Strategies. In Proceedings of the ACM 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–19. https://doi.org/10.1145/3313831.3376162
- Your Smart Glasses’ Camera Bothers Me!: Exploring Opt-in and Opt-out Gestures for Privacy Mediation. In Proceedings of the 10th Nordic Conference on Human-Computer Interaction - NordiCHI’18. ACM, New York, NY, USA, 473–481. https://doi.org/10.1145/3240167.3240174
- Don’t look at me that way! - Understanding User Attitudes Towards Data Glasses Usage. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services - MobileHCI’15. ACM, New York, NY, USA, 362–372. https://doi.org/10.1145/2785830.2785842
- Kari Kuutti and Liam J. Bannon. 2014. The Turn to Practice in HCI: Towards a Research Agenda. In Proceedings of the 2014 Annual ACM Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 3543–3552. https://doi.org/10.1145/2556288.2557111
- Exploring Relationships Between Interaction Attributes and Experience. In Proceedings of the 6th International Conference on Designing Pleasurable Products and Interfaces - DPPI’13. ACM, New York, NY, USA, 126–135. https://doi.org/10.1145/2513506.2513520
- Aesthetic Interaction as Fit Between Interaction Attributes and Experiential Qualities. New Ideas in Psychology 47 (2017), 80–90. https://doi.org/10.1016/j.newideapsych.2017.03.010
- TongueBoard: An Oral Interface for Subtle Input. In Proceedings of the 10th Augmented Human International Conference. ACM, New York, NY, USA, 1–9. https://doi.org/10.1145/3311823.3311831
- Steve Love and Mark Perry. 2004. Dealing With Mobile Conversations in Public Places: Some Implications for the Design of Socially Intrusive Technologies. In Extended Abstracts of the 2004 Conference on Human Factors and Computing Systems - CHI’04. ACM, New York, NY, USA, 1195–1198. https://doi.org/10.1145/985921.986022
- Deception and Magic in Collaborative Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI’10. ACM, New York, NY, USA, 567–576. https://doi.org/10.1145/1753326.1753410
- Robb Mitchell and Thomas Olsson. 2017. Barriers for Bridging Interpersonal Gaps: Three Inspirational Design Patterns for Increasing Collocated Social Interaction. In Proceedings of the 8th International Conference on Communities and Technologies. ACM, New York, NY, USA, 2–11. https://doi.org/10.1145/3083671.3083697
- Robb Mitchell and Thomas Olsson. 2019. Facilitating the First Move: Exploring Inspirational Design Patterns for Aiding Initiation of Social Encounters. In Proceedings of the 9th International Conference on Communities and Technologies. ACM, New York, NY, USA, 283–294. https://doi.org/10.1145/3328320.3328396
- Why are Mobile Phones Annoying? Behaviour & Information Technology 23, 1 (2004), 33–41. https://doi.org/10.1080/01449290310001638496
- Hearing Only One Side of Normal and Mobile Phone Conversations. Behaviour & Information Technology 23, 5 (2004), 301–305. https://doi.org/10.1080/01449290410001712744
- Would You Do That?: Understanding Social Acceptance of Gestural Interfaces. In Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services - MobileHCI’10. ACM, New York, NY, USA, 275–278. https://doi.org/10.1145/1851600.1851647
- Feather Hair: Interacting with Sensorized Hair in Public Settings. In Proceedings of the ACM Conference on Designing Interactive Systems - DIS’22. ACM, New York, NY, USA, 1228–1242. https://doi.org/10.1145/3532106.3533527
- Daisuke Okabe and Mizuko Itō. 2005. Keitai in Public Transportation. In Personal, Portable, Pedestrian: Mobile Phones in Japanese Life. MIT Press, Cambridge, MA, USA, 205–217. https://doi.org/10.7551/mitpress/5309.003.0013
- Technologies for Enhancing Collocated Social Interaction: Review of Design Solutions and Approaches. Computer Supported Cooperative Work (CSCW) 29, 1–2 (2020), 29–83. https://doi.org/10.1007/s10606-019-09345-0
- Understanding Contexts by Being There: Case Studies in Bodystorming. Personal and Ubiquitous Computing 7, 2 (2003), 125–134. https://doi.org/10.1007/s00779-003-0238-7
- Charting Subtle Interaction in the HCI Literature. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 15 pages. https://doi.org/10.1145/3290605.3300648
- Don’t Mind Me Touching My Wrist: A Case Study of Interacting with On-Body Technology in Public. In Proceedings of the 17th Annual International Symposium on International Symposium on Wearable Computers - ISWC’13. ACM, New York, NY, USA, 89–96. https://doi.org/10.1145/2493988.2494331
- Designing the Spectator Experience. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI’05. ACM, New York, NY, USA, 741–750. https://doi.org/10.1145/1054972.1055074
- Jun Rekimoto. 2001. GestureWrist and GesturePad: Unobtrusive Wearable Interaction Devices. In Proceedings of the Fifth International Symposium on Wearable Computers. IEEE, Piscataway, NJ, USA, 21––27. https://doi.org/10.1109/ISWC.2001.962092
- Julie Rico and Stephen Brewster. 2010. Usable Gestures for Mobile Interfaces: Evaluating Social Acceptability. In Proceedings of the ACM 2010 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 887–896. https://doi.org/10.1145/1753326.1753458
- The Dynamics of Social Practice: Everyday Life and How it Changes. SAGE Publications Ltd., Los Angeles, CA, USA. https://doi.org/10.4135/9781446250655
- Understanding Emotions Experienced When Using a Mobile Phone in Public: The Social Usability of Mobile (Cellular) Telephones. Telematics and Informatics 25, 3 (2008), 201–215. https://doi.org/10.1016/j.tele.2007.03.001
- Alarith Uhde and Marc Hassenzahl. 2021. Towards a Better Understanding of Social Acceptability. In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems Extended Abstracts. ACM, New York, NY, USA, 6 pages. https://doi.org/10.1145/3411763.3451649
- Obtrusive Subtleness and Why We Should Focus on Meaning, not Form, in Social Acceptability Studies. In Proceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia (MUM 2022). ACM, New York, NY, USA, 11. https://doi.org/10.1145/3568444.3568457
- Pia von Terzi and Sarah Diefenbach. 2023. The Attendant Perspective: Present Others in Public Technology Interactions. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–18. https://doi.org/10.1145/3544548.3581231
- Technology-Mediated Experiences and Social Context: Relevant Needs in Private Vs. Public Interaction and the Importance of Others for Positive Affect. Frontiers in Psychology 12 (2021), 18 pages. https://doi.org/10.3389/fpsyg.2021.718315
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.