Surface-Based Text Entry in Virtual Reality

Develop and validate a reliable method for text entry on physical surfaces while using virtual reality head-mounted displays, addressing the persistent difficulties observed in current surface-based approaches.

Background

Within the design considerations for XR typing, the authors emphasize that headset-mounted, egocentric cameras often fail exactly at the moment of surface touch due to self-occlusions of the fingertips, undermining robust detection required for surface-based text entry.

Despite multiple proposed techniques and hardware augmentations (e.g., rings, wrist-mounted illuminants), the paper states that the problem of enabling dependable surface-based text entry in VR remains unresolved, highlighting a critical technical barrier to practical adoption.