Papers
Topics
Authors
Recent
Search
2000 character limit reached

Accurate Leukocyte Detection Based on Deformable-DETR and Multi-Level Feature Fusion for Aiding Diagnosis of Blood Diseases

Published 1 Jan 2024 in cs.CV and cs.AI | (2401.00926v4)

Abstract: In standard hospital blood tests, the traditional process requires doctors to manually isolate leukocytes from microscopic images of patients' blood using microscopes. These isolated leukocytes are then categorized via automatic leukocyte classifiers to determine the proportion and volume of different types of leukocytes present in the blood samples, aiding disease diagnosis. This methodology is not only time-consuming and labor-intensive, but it also has a high propensity for errors due to factors such as image quality and environmental conditions, which could potentially lead to incorrect subsequent classifications and misdiagnosis. To address these issues, this paper proposes an innovative method of leukocyte detection: the Multi-level Feature Fusion and Deformable Self-attention DETR (MFDS-DETR). To tackle the issue of leukocyte scale disparity, we designed the High-level Screening-feature Fusion Pyramid (HS-FPN), enabling multi-level fusion. This model uses high-level features as weights to filter low-level feature information via a channel attention module and then merges the screened information with the high-level features, thus enhancing the model's feature expression capability. Further, we address the issue of leukocyte feature scarcity by incorporating a multi-scale deformable self-attention module in the encoder and using the self-attention and cross-deformable attention mechanisms in the decoder, which aids in the extraction of the global features of the leukocyte feature maps. The effectiveness, superiority, and generalizability of the proposed MFDS-DETR method are confirmed through comparisons with other cutting-edge leukocyte detection models using the private WBCDD, public LISC and BCCD datasets. Our source code and private WBCCD dataset are available at https://github.com/JustlfC03/MFDS-DETR.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (32)
  1. S. M. Abas, A. M. Abdulazeez, and D. Q. Zeebaree, “A yolo and convolutional neural network for the detection and classification of leukocytes in leukemia,” Indones. J. Electr. Eng. Comput. Sci, vol. 25, no. 1, pp. 200–213, 2022.
  2. N. Carion, F. Massa, G. Synnaeve, N. Usunier, A. Kirillov, and S. Zagoruyko, “End-to-end object detection with transformers,” in Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part I 16.   Springer, 2020, pp. 213–229.
  3. C.-F. Chen, Q. Fan, N. Mallinar, T. Sercu, and R. Feris, “Big-little net: An efficient multi-scale feature representation for visual and speech recognition,” arXiv preprint arXiv:1807.03848, 2018.
  4. L.-C. Chen, Y. Zhu, G. Papandreou, F. Schroff, and H. Adam, “Encoder-decoder with atrous separable convolution for semantic image segmentation,” in Proceedings of the European conference on computer vision (ECCV), 2018, pp. 801–818.
  5. L. Geng, M. Yang, Z. Xiao, F. Zhang, Y. Liu, J. Wu, and W. Wang, “White blood cell detection and segmentation combined with the channel space weighted feature pyramid networks,” Journal of Computer-Aided Design & Computer Graphics, 2021.
  6. Y. Guo and M. Zhang, “Blood cell detection method based on improved yolov5,” IEEE Access, 2023.
  7. Z. Han, H. Huang, D. Lu, Q. Fan, C. Ma, X. Chen, Q. Gu, and Q. Chen, “One-stage and lightweight cnn detection approach with attention: Application to wbc detection of microscopic images,” Computers in Biology and Medicine, vol. 154, p. 106606, 2023.
  8. K. He, X. Zhang, S. Ren, and J. Sun, “Spatial pyramid pooling in deep convolutional networks for visual recognition,” IEEE transactions on pattern analysis and machine intelligence, vol. 37, no. 9, pp. 1904–1916, 2015.
  9. S. Huang, Z. Lu, R. Cheng, and C. He, “Fapn: Feature-aligned pyramid network for dense image prediction,” in Proceedings of the IEEE/CVF international conference on computer vision, 2021, pp. 864–873.
  10. R. Khandekar, P. Shastry, S. Jaishankar, O. Faust, and N. Sampathila, “Automated blast cell detection for acute lymphoblastic leukemia diagnosis,” Biomedical Signal Processing and Control, vol. 68, p. 102690, 2021. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S1746809421002871
  11. H. Kutlu, E. Avci, and F. Özyurt, “White blood cells detection and classification based on regional convolutional neural networks,” Medical hypotheses, vol. 135, p. 109472, 2020.
  12. Y. Li, Y. Chen, N. Wang, and Z. Zhang, “Scale-aware trident networks for object detection,” in Proceedings of the IEEE/CVF international conference on computer vision, 2019, pp. 6054–6063.
  13. T.-Y. Lin, P. Dollár, R. Girshick, K. He, B. Hariharan, and S. Belongie, “Feature pyramid networks for object detection,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 2117–2125.
  14. T.-Y. Lin, P. Goyal, R. Girshick, K. He, and P. Dollár, “Focal loss for dense object detection,” in Proceedings of the IEEE international conference on computer vision, 2017, pp. 2980–2988.
  15. H. Liu, L.-H. Wu, L. Zhang, L. Chen, B.-W. Zhou, and H.-J. Zhang, “Leukocyte detection method based on twice-fusion-feature centernet,” Journal of Computer Applications, 2023.
  16. S. Liu, L. Qi, H. Qin, J. Shi, and J. Jia, “Path aggregation network for instance segmentation,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 8759–8768.
  17. W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C.-Y. Fu, and A. C. Berg, “Ssd: Single shot multibox detector,” in Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part I 14.   Springer, 2016, pp. 21–37.
  18. Y. Luo, X. Cao, J. Zhang, J. Guo, H. Shen, T. Wang, and Q. Feng, “Ce-fpn: Enhancing channel information for object detection,” Multimedia Tools and Applications, vol. 81, no. 21, pp. 30 685–30 704, 2022.
  19. S. J. A. Nugraha and B. Erfianto, “White blood cell detection using yolov8 integration with detr to improve accuracy,” Sinkron: jurnal dan penelitian teknik informatika, vol. 8, no. 3, pp. 1908–1916, 2023.
  20. J. Pang, K. Chen, J. Shi, H. Feng, W. Ouyang, and D. Lin, “Libra r-cnn: Towards balanced learning for object detection,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019, pp. 821–830.
  21. A. Polejowska, M. Sobotka, M. Kalinowski, M. Kordowski, and T. Neumann, “Impact of visual image quality on lymphocyte detection using yolov5 and retinanet algorithms,” in Polish Conference on Biocybernetics and Biomedical Engineering.   Springer, 2023, pp. 41–53.
  22. S. Ren, K. He, R. Girshick, and J. Sun, “Faster r-cnn: Towards real-time object detection with region proposal networks,” Advances in neural information processing systems, vol. 28, 2015.
  23. S. H. Rezatofighi and H. Soltanian-Zadeh, “Automatic recognition of five types of white blood cells in peripheral blood,” Computerized Medical Imaging and Graphics, vol. 35, no. 4, pp. 333–343, 2011.
  24. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, “Going deeper with convolutions,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2015, pp. 1–9.
  25. M. Tan, R. Pang, and Q. V. Le, “Efficientdet: Scalable and efficient object detection,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 10 781–10 790.
  26. S. Vatathanavaro, S. Tungjitnob, and K. Pasupa, “White blood cell classification : A comparison between vgg-16 and resnet-50 models,” 2018.
  27. J. Wang, Z. Sun, P. Guo, and L. Zhang, “Improved leukocyte detection algorithm of yolov5,” Computer Engineering and Applications, vol. 58, no. 4, pp. 134–142, 2022.
  28. Q. Wang, S. Bi, M. Sun, Y. Wang, D. Wang, and S. Yang, “Deep learning approach to peripheral leukocyte recognition,” PloS one, vol. 14, no. 6, p. e0218808, 2019.
  29. X. Wang, T. Xu, J. Zhang, S. Chen, and Y. Zhang, “So-yolo based wbc detection with fourier ptychographic microscopy,” Ieee Access, vol. 6, pp. 51 566–51 576, 2018.
  30. T. Xia, Y. Q. Fu, N. Jin, P. Chazot, P. Angelov, and R. Jiang, “Ai-enabled microscopic blood analysis for microfluidic covid-19 hematology,” in 2020 5th International Conference on Computational Intelligence and Applications (ICCIA).   IEEE, 2020, pp. 98–102.
  31. F. Xu, X. Li, H. Yang, Y. Wang, and W. Xiang, “Te-yolof: Tiny and efficient yolof for blood cell detection,” Biomedical Signal Processing and Control, vol. 73, p. 103416, 2022.
  32. X. Zhu, W. Su, L. Lu, B. Li, X. Wang, and J. Dai, “Deformable detr: Deformable transformers for end-to-end object detection,” arXiv preprint arXiv:2010.04159, 2020.
Citations (41)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.

Sign Up for Free