Trajectory Prediction for Robot Navigation using Flow-Guided Markov Neural Operator
Abstract: Predicting pedestrian movements remains a complex and persistent challenge in robot navigation research. We must evaluate several factors to achieve accurate predictions, such as pedestrian interactions, the environment, crowd density, and social and cultural norms. Accurate prediction of pedestrian paths is vital for ensuring safe human-robot interaction, especially in robot navigation. Furthermore, this research has potential applications in autonomous vehicles, pedestrian tracking, and human-robot collaboration. Therefore, in this paper, we introduce FlowMNO, an Optical Flow-Integrated Markov Neural Operator designed to capture pedestrian behavior across diverse scenarios. Our paper models trajectory prediction as a Markovian process, where future pedestrian coordinates depend solely on the current state. This problem formulation eliminates the need to store previous states. We conducted experiments using standard benchmark datasets like ETH, HOTEL, ZARA1, ZARA2, UCY, and RGB-D pedestrian datasets. Our study demonstrates that FlowMNO outperforms some of the state-of-the-art deep learning methods like LSTM, GAN, and CNN-based approaches, by approximately 86.46% when predicting pedestrian trajectories. Thus, we show that FlowMNO can seamlessly integrate into robot navigation systems, enhancing their ability to navigate crowded areas smoothly.
- A. Gupta, J. Johnson, L. Fei-Fei, S. Savarese, and A. Alahi, “Social GAN: Socially acceptable trajectories with generative adversarial networks,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 2255–2264.
- T. Fernando, S. Denman, S. Sridharan, and C. Fookes, “GD-GAN: Generative adversarial networks for trajectory prediction and group detection in crowds,” in Asian conference on computer vision. Springer, 2018, pp. 314–330.
- A. Sadeghian, V. Kosaraju, A. Sadeghian, N. Hirose, H. Rezatofighi, and S. Savarese, “SoPhie: An attentive GAN for predicting paths compliant to social and physical constraints,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019, pp. 1349–1358.
- J. Amirian, J.-B. Hayet, and J. Pettré, “Social ways: Learning multi-modal distributions of pedestrian trajectories with GANs,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2019, pp. 2964–2972.
- V. Kosaraju, A. Sadeghian, R. Martín-Martín, I. Reid, S. H. Rezatofighi, and S. Savarese, “Social-BiGAT: Multimodal trajectory forecasting using bicycle-gan and graph attention networks,” arXiv preprint arXiv:1907.03395, 2019.
- W.-C. Lai, Z.-X. Xia, H.-S. Lin, L.-F. Hsu, H.-H. Shuai, I.-H. Jhuo, and W.-H. Cheng, “Trajectory prediction in heterogeneous environment via attended ecology embedding,” in Proceedings of the 28th ACM International Conference on Multimedia, 2020, pp. 202–210.
- L. Huang, J. Zhuang, X. Cheng, R. Xu, and H. Ma, “STI-GAN: Multimodal pedestrian trajectory prediction using spatiotemporal interactions and a generative adversarial network,” IEEE Access, vol. 9, pp. 50846–50856, 2021.
- Yanliang Zhu, Deheng Qian, Dongchun Ren, and Huaxia Xia, “Starnet: Pedestrian trajectory prediction using deep neural network in star topology,” in 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 8075–8080, IEEE, 2019.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.