Papers
Topics
Authors
Recent
Search
2000 character limit reached

Domain Generalization for Crop Segmentation with Standardized Ensemble Knowledge Distillation

Published 3 Apr 2023 in cs.CV and cs.LG | (2304.01029v3)

Abstract: In recent years, precision agriculture has gradually oriented farming closer to automation processes to support all the activities related to field management. Service robotics plays a predominant role in this evolution by deploying autonomous agents that can navigate fields while performing tasks such as monitoring, spraying, and harvesting without human intervention. To execute these precise actions, mobile robots need a real-time perception system that understands their surroundings and identifies their targets in the wild. Existing methods, however, often fall short in generalizing to new crops and environmental conditions. This limit is critical for practical applications where labeled samples are rarely available. In this paper, we investigate the problem of crop segmentation and propose a novel approach to enhance domain generalization using knowledge distillation. In the proposed framework, we transfer knowledge from a standardized ensemble of models individually trained on source domains to a student model that can adapt to unseen realistic scenarios. To support the proposed method, we present a synthetic multi-domain dataset for crop segmentation containing plants of variegate species and covering different terrain styles, weather conditions, and light scenarios for more than 70,000 samples. We demonstrate significant improvements in performance over state-of-the-art methods and superior sim-to-real generalization. Our approach provides a promising solution for domain generalization in crop segmentation and has the potential to enhance a wide variety of agriculture applications.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (41)
  1. Decision support systems for agriculture 4.0: Survey and challenges. Computers and Electronics in Agriculture, 170:105256, 2020.
  2. A survey of deep learning in agriculture: techniques and their applications. Journal of Information Processing Systems, 16(5):1015–1033, 2020.
  3. Harvesting robots for high-value crops: State-of-the-art review and challenges ahead. Journal of Field Robotics, 31(6):888–911, 2014.
  4. Design and development of intelligent pesticide spraying system for agricultural robot. In Hybrid Intelligent Systems: 20th International Conference on Hybrid Intelligent Systems (HIS 2020), December 14-16, 2020, pages 157–170. Springer, 2021.
  5. Yield estimation in cotton using uav-based multi-sensor imagery. Biosystems Engineering, 193:101–114, 2020.
  6. Semantic segmentation of agricultural images: A survey. Information Processing in Agriculture, 2023.
  7. Tea leaf disease detection using multi-objective image segmentation. Multimedia Tools and Applications, 80:753–771, 2021.
  8. Semantic segmentation of litchi branches using deeplabv3+ model. IEEE Access, 8:164546–164555, 2020.
  9. Deep semantic segmentation at the edge for autonomous navigation in vineyard rows. In 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 3421–3428. IEEE, 2021.
  10. A deep learning image segmentation model for agricultural irrigation system classification. Computers and Electronics in Agriculture, 198:106977, 2022.
  11. Waypoint generation in row-based crops with deep learning and contrastive clustering. In Machine Learning and Knowledge Discovery in Databases: European Conference, ECML PKDD 2022, Grenoble, France, September 19–23, 2022, Proceedings, Part VI, pages 203–218. Springer, 2023.
  12. Position-agnostic autonomous navigation in vineyards with deep reinforcement learning. In 2022 IEEE 18th International Conference on Automation Science and Engineering (CASE), pages 477–484. IEEE, 2022.
  13. Gabriela Csurka. Domain adaptation in computer vision applications. Springer, 2017.
  14. Domain generalization: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022.
  15. Robustnet: Improving domain generalization in urban-scene segmentation via instance selective whitening. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 11580–11590, 2021.
  16. Wildnet: Learning domain generalized semantic segmentation from the wild. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 9936–9946, 2022a.
  17. Domain-adversarial training of self-attention-based networks for land cover classification using multi-temporal sentinel-2 satellite imagery. Remote Sensing, 13(13):2564, 2021.
  18. Ood-bench: Quantifying and understanding two dimensions of out-of-distribution generalization. In CVPR, 2022.
  19. Data synthesis methods for semantic segmentation in agriculture: A capsicum annuum dataset. Computers and electronics in agriculture, 144:284–296, 2018.
  20. Shortcut learning in deep neural networks. Nature Machine Intelligence, 2(11):665–673, 2020.
  21. Towards understanding ensemble, knowledge distillation and self-distillation in deep learning. In The Eleventh International Conference on Learning Representations, 2022.
  22. In search of lost domain generalization. arXiv preprint arXiv:2007.01434, 2020.
  23. Back-to-bones: Rediscovering the role of backbones in domain generalization. arXiv preprint arXiv:2209.01121, 2022.
  24. Segment anything. arXiv:2304.02643, 2023.
  25. Two at once: Enhancing learning and generalization capacities via ibn-net. In Proceedings of the European Conference on Computer Vision (ECCV), pages 464–479, 2018.
  26. Permuted adain: Reducing the bias towards global statistics in image classification. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 9482–9491, 2021.
  27. Embracing the dark knowledge: Domain generalization using regularized knowledge distillation. In Proceedings of the 29th ACM International Conference on Multimedia, pages 2595–2604, 2021.
  28. Cross-domain ensemble distillation for domain generalization. In Computer Vision–ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23–27, 2022, Proceedings, Part XXV, pages 1–20. Springer, 2022b.
  29. The PASCAL Visual Object Classes Challenge 2012 (VOC2012) Results. http://www.pascal-network.org/challenges/VOC/voc2012/workshop/index.html, 2012.
  30. The cityscapes dataset for semantic urban scene understanding. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 3213–3223, 2016.
  31. Towards domain generalization in crop and weed segmentation for precision farming robots. IEEE robotics and automation letters, 8(6):3310–3317, 2023.
  32. Agronav: Autonomous navigation framework for agricultural robots and vehicles using semantic segmentation and semantic line detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, pages 6271–6280, June 2023.
  33. Vladimir N Vapnik. An overview of statistical learning theory. IEEE transactions on neural networks, 10(5):988–999, 1999.
  34. Model compression. In Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 535–541, 2006.
  35. Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531, 2015.
  36. Logit standardization in knowledge distillation. arXiv preprint arXiv:2403.01427, 2024.
  37. Vegann, vegetation annotation of multi-crop rgb images acquired under diverse conditions for segmentation. Scientific Data, 10(1):302, 2023.
  38. Channel-wise knowledge distillation for dense prediction. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 5311–5320, 2021.
  39. Imagenet: A large-scale hierarchical image database. In 2009 IEEE Conference on Computer Vision and Pattern Recognition, pages 248–255, 2009.
  40. Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101, 2017.
  41. Searching for mobilenetv3. In Proceedings of the IEEE/CVF international conference on computer vision, pages 1314–1324, 2019.
Citations (2)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.