Spiking-DD: Neuromorphic Event Camera based Driver Distraction Detection with Spiking Neural Network
Abstract: Event camera-based driver monitoring is emerging as a pivotal area of research, driven by its significant advantages such as rapid response, low latency, power efficiency, enhanced privacy, and prevention of undersampling. Effective detection of driver distraction is crucial in driver monitoring systems to enhance road safety and reduce accident rates. The integration of an optimized sensor such as Event Camera with an optimized network is essential for maximizing these benefits. This paper introduces the innovative concept of sensing without seeing to detect driver distraction, leveraging computationally efficient spiking neural networks (SNN). To the best of our knowledge, this study is the first to utilize event camera data with spiking neural networks for driver distraction. The proposed Spiking-DD network not only achieve state of the art performance but also exhibit fewer parameters and provides greater accuracy than current event-based methodologies.
- Detection of distraction-related actions on dmd: An image and a video-based approach comparison. In VISIGRAPP (5: VISAPP), pages 458–465.
- Commission, E. (2020). New eu vehicle safety standards. Accessed: 2024-05-29.
- Event-based vision: A survey. IEEE transactions on pattern analysis and machine intelligence, 44(1):154–180.
- v2e: From video frames to realistic dvs events. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1312–1321.
- Lakhani, S. (2022). Applying spatiotemporal attention to identify distracted and drowsy driving with vision transformers. arXiv preprint arXiv:2207.12148.
- Lava-NC (2024). Lava-dl: Deep learning library for lava. https://github.com/lava-nc/lava-dl/tree/main.
- Drive&act: A multi-modal dataset for fine-grained driver behavior recognition in autonomous vehicles. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 2801–2810.
- Dmd: A large-scale multi-modal driver monitoring dataset for attention and alertness analysis. In Computer Vision–ECCV 2020 Workshops: Glasgow, UK, August 23–28, 2020, Proceedings, Part IV 16, pages 387–405. Springer.
- Neuromorphic driver monitoring systems: A computationally efficient proof-of-concept for driver distraction detection. IEEE Open Journal of Vehicular Technology.
- Event cameras in automotive sensing: A review. IEEE Access.
- Spiking neural networks and their applications: A review. Brain Sciences, 12(7):863.
- Event-based driver distraction detection and action recognition. In 2022 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI), pages 1–7.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.