Road Disease Detection based on Latent Domain Background Feature Separation and Suppression
Abstract: Road disease detection is challenging due to the the small proportion of road damage in target region and the diverse background,which introduce lots of domain information.Besides, disease categories have high similarity,makes the detection more difficult. In this paper, we propose a new LDBFSS(Latent Domain Background Feature Separation and Suppression) network which could perform background information separation and suppression without domain supervision and contrastive enhancement of object features.We combine our LDBFSS network with YOLOv5 model to enhance disease features for better road disease detection. As the components of LDBFSS network, we first design a latent domain discovery module and a domain adversarial learning module to obtain pseudo domain labels through unsupervised method, guiding domain discriminator and model to train adversarially to suppress background information. In addition, we introduce a contrastive learning module and design k-instance contrastive loss, optimize the disease feature representation by increasing the inter-class distance and reducing the intra-class distance for object features. We conducted experiments on two road disease detection datasets, GRDDC and CNRDD, and compared with other models,which show an increase of nearly 4% on GRDDC dataset compared with optimal model, and an increase of 4.6% on CNRDD dataset. Experimental results prove the effectiveness and superiority of our model.
- National Highway Traffic Safety Administration, “National Motor Vehicle Crash Causation Survey: Report to Congress,” [Online],Available: https://trid.trb.org/view/880434,Jul. 2008.
- M. Hnewa and H. Radha, “Object detection under rainy conditions for autonomous vehicles: A review of state-of-the-art and emerging techniques,” IEEE Signal Process. Mag., vol. 38, no. 1, pp. 53–67, Jan. 2020.
- A. Bell, T. Mantecon, C. Diaz, C. R. Del-Blanco, F. Jaureguizar, and N. Garcia, “A novel system for nighttime vehicle detection based on foveal classifiers with real-time performance,” IEEE Trans. Intell.Transp. Syst., vol. 23, no. 6, pp. 5421–5433, Jun. 2022.
- F. Cao ,S. Chen,J. Zhong and Y. Gao, “Traffic Condition Classification Model Based on Traffic-Net,” Computational Intelligence and Neuroscience Volume 2023, 13 pages,2023.
- Zheng, Chuanpan, et al, “Gman: A graph multi-attention network for traffic prediction,” In Proceedings of the AAAI conference on artificial intelligence, Vol. 34. No. 01,2020.
- A. Farman,A. Amjad,I. Muhammad ,et al, “Traffic accident detection and condition analysis based on social networking data,” Accident Analysis & Prevention, Volume 151, March 2021.
- Z. Zhou, X. Dong, Z. Li, K. Yu, C. Ding and Y. Yang, “Spatio-Temporal Feature Encoding for Traffic Accident Detection in VANET Environment,” In IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 10, pp. 19772-19781, Oct. 2022, doi: 10.1109/TITS.2022.3147826.
- R. Medina, J. Llamas, E. Zalama, and J. Gomez-Garcia-Bermejo, “Enhanced automatic detection of road surface cracks by combining 2D/3D image processing techniques,” In Proc. IEEE Int. Conf. Image Process(ICIP), pp. 778–782,Oct. 2014.
- M. Quintana, J. Torres, and J. M. Menéndez, “A simplified computer vision system for road surface inspection and maintenance,” IEEE Trans. Intell. Transp. Syst., . vol. 17, no. 3, pp. 608–619, Mar. 2016.
- X. Liu, F. Xue, and L. Teng, “Surface defect detection based on gradient LBP,” In Proc. IEEE 3rd Int. Conf. Image, Vis. Comput. (ICIVC), pp. 133–137, Jun. 2018.
- S. Naddaf-Sh,M.M. Naddaf-Sh ,A.R. Kashani, and H. Zargarzadeh, “An Efficient and Scalable Deep Learning Approach for Road Damage Detection,” In 2020 IEEE International Conference on Big Data (Big Data), pp. 5602-5608, 2020.
- V. Mandal ,AR. Mussah ,Y. Adu-Gyamfi , “Deep Learning Frameworks for Pavement Distress Classification: A Comparative Analysis,” In 2020 IEEE International Conference on Big Data (Big Data), pp. 5577-5583 , 2020.
- K. Hacıefendioğlu ,H.B Başağa, “Concrete road crack detection using deep learning-based faster R-CNN method,” Iran J Sci Technol Trans Civ Eng, pp.1621–1633,2022.
- G. Gege , Z. Zhenyu , “Road damage detection algorithm for improved YOLOv5,” Scientific Reports, 2022.
- C. Lin, D. Tian, X. Duan, J. Zhou, D. Zhao and D. Cao, “DA-RDD: Toward Domain Adaptive Road Damage Detection Across Different Countries,” In IEEE Transactions on Intelligent Transportation Systems, vol. 24, no. 3, pp. 3091-3103, March 2023, doi: 10.1109/TITS.2022.3221067.
- H. Zhang ,Z. Wu 3,Y. Qiu , “A New Road Damage Detection Baseline with Attention Learning,” applied science, 12(15), 7594,June 2022.
- R. Hadsell, S. Chopra and Y. LeCun, “Dimensionality Reduction by Learning an Invariant Mapping,” In 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’06), pp. 1735-1742,2006, doi: 10.1109/CVPR.2006.100.
- T. Chen , S. Kornblith , M. Norouzi , “A Simple Framework for Contrastive Learning of Visual Representations,” In InInternational conference on machine learning 2020, PMLR pp. 1597-1607,Nov. 2020.
- J. Li ,P. Zhou , C. Xiong, SC. Hoi , “Prototypical Contrastive Learning of Unsupervised Representations,” arXiv preprint arXiv:2005.04966, May 2020.
- J. David Robinson,C. Chuang , S. Sra and S. Jegelka, “Contrastive Learning with Hard Negative Samples,” In International Conference on Learning Representations(ICLR), 2021.
- C. Yeh, C. Hong, Y. Hsu, “Decoupled Contrastive Learning,” In Conference on Neural Information Processing Systems 2021, 2021.
- H. Wang , X. Guo , ZH. Deng , Y. Lu , “Rethinking Minimal Sufficient Representation in Contrastive Learning,” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2022, pp. 16041-16050,2022.
- CY. Chuang ,RD. Hjelm , X. Wang , “Robust Contrastive Learning against Noisy Views,” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2022, pp. 16670-16681,2022.
- K. Prannay , T. Piotr , W. Chen , “Supervised Contrastive Learning,” Neural Information Processing Systems 33 (NeurIPS 2020), 2020.
- F. Graf , C .Hofer , M. Niethammer , R. Kwitt , “Dissecting Supervised Contrastive Learning,” In International Conference on Machine Learning, PMLR,pp. 3821-3830,Jul 2021.
- M. Tan , R. Pang ,Q.V. Le , “Efficientdet: Scalable and efficient object detection,” In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 10781-10790,2020.
- A.V. Oord , Y. Li , O. Vinyals , “Representation Learning with Contrastive Predictive Coding,” arXiv preprint arXiv:1807.03748. 2018 Jul 10, 2018.
- R. Hadsell, S. Chopra and Y. LeCun, “Dimensionality reduction by learning an invariant mapping,” In EEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’06), pp. 1735-1742,2006, doi: 10.1109/CVPR.2006.100.
- Y. Luo, P. Liu, L. Zheng, T. Guan, J. Yu and Y. Yang, “Category-Level Adversarial Adaptation for Semantic Segmentation Using Purified Features,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 44, no. 8, pp. 3940-3956, 1 Aug. 2022, doi: 10.1109/TPAMI.2021.3064379.
- W. Zhang, D. Xu, J. Zhang and W. Ouyang, , “Progressive Modality Cooperation for Multi-Modality Domain Adaptation,” IEEE Transactions on Image Processing, vol. 30, pp. 3293-3306, 2021, doi: 10.1109/TIP.2021.3052083..
- D. Jeong, “Road Damage Detection Using YOLO with Smartphone Images,” In IEEE International Conference on Big Data (Big Data), pp. 5559-5562 , 2020, doi: 10.1109/BigData50022.2020.9377847.
- K. Doshi and Y. Yilmaz, “Road Damage Detection using Deep Ensemble Learning,” In IEEE International Conference on Big Data (Big Data), pp. 5540-5544, 2020, doi: 10.1109/BigData50022.2020.9377774.
- V. Hegde, D. Trivedi, A. Alfarrarjeh and et al, “Yet Another Deep Learning Approach for Road Damage Detection using Ensemble Learning,” In IEEE International Conference on Big Data (Big Data), pp. 5553-5558, 2020 , doi: 10.1109/BigData50022.2020.9377833.
- V. Pham, C. Pham and T. Dang, “Road Damage Detection and Classification with Detectron2 and Faster R-CNN,” In IEEE International Conference on Big Data (Big Data), pp. 5592-5601, 2020 , doi: 10.1109/BigData50022.2020.9378027..
- R. Vishwakarma , R. Vennelakanti , “CNN Model & Tuning for Global Road Damage Detection,” In IEEE International Conference on Big Data (Big Data), pp. 5609-5615,2020.
- V. Mandal, A. R. Mussah and Y. Adu-Gyamfi , “Deep Learning Frameworks for Pavement Distress Classification: A Comparative Analysis,” In IEEE International Conference on Big Data (Big Data), pp. 5577-5583, 2020 , doi: 10.1109/BigData50022.2020.9378047.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.