Read My Mind: A Multi-Modal Dataset for Human Belief Prediction

Abstract: Understanding human intentions is key to enabling effective and efficient human-robot interaction (HRI) in collaborative settings. To enable developments and evaluation of the ability of AI systems to infer human beliefs, we introduce a large-scale multi-modal video dataset for intent prediction based on object-context relations.