Vsens Reality: Blending the Virtual Sensors into XR

Abstract: In recent years, virtual sensing techniques have been extensively studied as a method of data collection in simulated virtual spaces for the development of human activity recognition (HAR) systems. To date, this technique has enabled the transformation between different modalities, significantly expanding datasets that are typically difficult to collect. However, there is limited research on how to make virtual sensors more easy-to-use or effective as tools for making sense of the sensor data. The context-awareness and intuitiveness of XR make it an ideal platform for virtual sensors. In this work, we demonstrate, Vsens Reality, the use of virtual sensors under the XR context as an augmentation tool for the design of interactive systems.