Mid-Air Haptic Bio-Holograms in Mixed Reality

Abstract: We present a prototype demonstrator that integrates three technologies, mixed reality head-mounted displays, wearable bio-sensors, and mid-air haptic projectors to deliver an interactive tactile experience with a bio-hologram. Users of this prototype are able to see, touch and feel a hologram of a heart that is beating at the same rhythm as their own. The demo uses an Ultrahaptics device, a Magic Leap One Mixed Reality headset, and an Apple Watch that measures the wearer's heart rate, all synchronized and networked together such that updates from the wristband dynamically change the haptic feedback and the animation speed of the beating heart thus creating a more personalised experience.