Papers
Topics
Authors
Recent
Search
2000 character limit reached

Free Lunch for Federated Remote Sensing Target Fine-Grained Classification: A Parameter-Efficient Framework

Published 3 Jan 2024 in cs.LG, cs.AI, and cs.CR | (2401.01493v1)

Abstract: Remote Sensing Target Fine-grained Classification (TFGC) is of great significance in both military and civilian fields. Due to location differences, growth in data size, and centralized server storage constraints, these data are usually stored under different databases across regions/countries. However, privacy laws and national security concerns constrain researchers from accessing these sensitive remote sensing images for further analysis. Additionally, low-resource remote sensing devices encounter challenges in terms of communication overhead and efficiency when dealing with the ever-increasing data and model scales. To solve the above challenges, this paper proposes a novel Privacy-Reserving TFGC Framework based on Federated Learning, dubbed PRFL. The proposed framework allows each client to learn global and local knowledge to enhance the local representation of private data in environments with extreme statistical heterogeneity (non. Independent and Identically Distributed, IID). Thus, it provides highly customized models to clients with differentiated data distributions. Moreover, the framework minimizes communication overhead and improves efficiency while ensuring satisfactory performance, thereby enhancing robustness and practical applicability under resource-scarce conditions. We demonstrate the effectiveness of the proposed PRFL on the classical TFGC task by leveraging four public datasets.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (53)
  1. Hirotugu Akaike. Akaike’s information criterion. International encyclopedia of statistical science, pp.  25–25, 2011.
  2. Learning across decentralized multi-modal remote sensing archives with federated learning. arXiv preprint arXiv:2306.00792, 2023.
  3. Fedbe: Making bayesian model ensemble applicable to federated learning, 2021.
  4. Dynamic multiscale fusion generative adversarial network for radar image extrapolation. IEEE Transactions on Geoscience and Remote Sensing, 60:1–11, 2022.
  5. Prompt federated learning for weather forecasting: Toward foundation models on meteorological data. arXiv preprint arXiv:2301.09152, 2023a.
  6. Spatial-temporal prompt learning for federated weather forecasting. arXiv preprint arXiv:2305.14244, 2023b.
  7. Interpretable cnn-multilevel attention transformer for rapid recognition of pneumonia from chest x-ray images. IEEE Journal of Biomedical and Health Informatics, 2023c.
  8. Tempee: Temporal-spatial parallel transformer for radar echo extrapolation beyond auto-regression. arXiv preprint arXiv:2304.14131, 2023d.
  9. Collaborative photonic crystal fiber property optimization: A new paradigm for reverse design. IEEE Photonics Technology Letters, 2023e.
  10. A comprehensive survey on federated learning techniques for healthcare informatics. Computational Intelligence and Neuroscience, 2023, 2023.
  11. Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition, pp.  248–255. Ieee, 2009.
  12. Remote sensing. In Remote Sensing Big Data, pp.  17–43. Springer, 2023.
  13. A public dataset for fine-grained ship classification in optical remote sensing images. Remote Sensing, 13(4):747, 2021.
  14. Cynthia Dwork. Differential privacy. In International colloquium on automata, languages, and programming, pp.  1–12. Springer, 2006.
  15. Personalized federated learning with theoretical guarantees: A model-agnostic meta-learning approach. Advances in Neural Information Processing Systems, 33:3557–3568, 2020.
  16. Multicam: Multiple class activation mapping for aircraft recognition in remote sensing images. Remote sensing, 11(5):544, 2019.
  17. Fine-grained ship detection in high-resolution satellite images with shape-aware feature learning. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 16:1914–1926, 2023.
  18. Knowledge distillation in vision transformers: A critical review. arXiv preprint arXiv:2302.02108, 2023.
  19. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.  770–778, 2016.
  20. A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the academy of marketing science, 43:115–135, 2015.
  21. Lora: Low-rank adaptation of large language models. arXiv preprint arXiv:2106.09685, 2021.
  22. Refrs: Resource-efficient federated recommender system for dynamic and diversified user preferences. ACM Transactions on Information Systems, 41(3):1–30, 2023.
  23. Scaffold: Stochastic controlled averaging for federated learning. In International conference on machine learning, pp.  5132–5143. PMLR, 2020.
  24. Ultralightweight spatial–spectral feature cooperation network for change detection in remote sensing images. IEEE Transactions on Geoscience and Remote Sensing, 61:1–14, 2023.
  25. Review on security of federated learning and its application in healthcare. Future Generation Computer Systems, 144:271–290, 2023.
  26. Federated optimization in heterogeneous networks. Proceedings of Machine learning and systems, 2:429–450, 2020.
  27. Fedbn: Federated learning on non-iid features via local batch normalization. arXiv preprint arXiv:2102.07623, 2021.
  28. Fgatr-net: Automatic network architecture design for fine-grained aircraft type recognition in remote sensing images. Remote Sensing, 12(24):4187, 2020.
  29. Communication-efficient learning of deep networks from decentralized data. In Artificial intelligence and statistics, pp.  1273–1282. PMLR, 2017.
  30. A privacy preserving system for movie recommendations using federated learning. ACM Transactions on Recommender Systems, 2023.
  31. Adap-emd: Adaptive emd for aircraft fine-grained classification in remote sensing. IEEE Geoscience and Remote Sensing Letters, 19:1–5, 2022.
  32. Fine-grained object recognition using a combination model of navigator–teacher–scrutinizer and spinal networks. Pattern Recognition and Image Analysis, 33(1):47–53, 2023.
  33. Federated learning for medical applications: A taxonomy, current trends, challenges, and future research directions. IEEE Internet of Things Journal, 2023.
  34. Sebastian Ruder. An overview of gradient descent optimization algorithms. arXiv preprint arXiv:1609.04747, 2016.
  35. Rotation equivariant feature image pyramid network for object detection in optical remote sensing imagery. IEEE Transactions on Geoscience and Remote Sensing, 60:1–14, 2021.
  36. Personalized federated learning with moreau envelopes. Advances in Neural Information Processing Systems, 33:21394–21405, 2020.
  37. Communication-efficient federated learning via knowledge distillation. Nature communications, 13(1):2032, 2022.
  38. Bold but cautious: Unlocking the potential of personalized federated learning through cautiously aggressive collaboration. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp.  19375–19384, 2023.
  39. An explainable attention network for fine-grained ship classification using remote-sensing images. IEEE Transactions on Geoscience and Remote Sensing, 60:1–14, 2022.
  40. Dcsau-net: A deeper and more compact split-attention u-net for medical image segmentation. Computers in Biology and Medicine, 154:106626, 2023.
  41. Henc: Hierarchical embedding network with center calibration for few-shot fine-grained sar target classification. IEEE Transactions on Image Processing, 2023.
  42. Mha-cnn: Aircraft fine-grained recognition of remote sensing image based on multiple hierarchies attention. In IGARSS 2022-2022 IEEE International Geoscience and Remote Sensing Symposium, pp.  3051–3054. IEEE, 2022.
  43. Efm-net: An essential feature mining network for target fine-grained classification in optical remote sensing images. IEEE Transactions on Geoscience and Remote Sensing, 2023.
  44. Estimation of magnitude and epicentral distance from seismic waves using deeper crnn. IEEE Geoscience and Remote Sensing Letters, 20:1–5, 2023.
  45. Fedleo: An offloading-assisted decentralized federated learning framework for low earth orbit satellite networks. IEEE Transactions on Mobile Computing, 2023.
  46. Transformer and cnn hybrid deep neural network for semantic segmentation of very-high-resolution remote sensing imagery. IEEE Transactions on Geoscience and Remote Sensing, 60:1–20, 2022.
  47. Lightfr: Lightweight federated recommendation with privacy-preserving matrix factorization. ACM Transactions on Information Systems, 41(4):1–28, 2023a.
  48. Scoring aided federated learning on long-tailed data for wireless iomt based healthcare system. IEEE Journal of Biomedical and Health Informatics, 2023b.
  49. Comprehensive privacy analysis on federated recommender system against attribute inference attacks. IEEE Transactions on Knowledge and Data Engineering, 2023c.
  50. Laplacian feature pyramid network for object detection in vhr optical remote sensing images. IEEE Transactions on Geoscience and Remote Sensing, 60:1–14, 2021.
  51. Federated deep learning with prototype matching for object extraction from very-high-resolution remote sensing images. IEEE Transactions on Geoscience and Remote Sensing, 61:1–16, 2023d.
  52. Classification matters more: Global instance contrast for fine-grained sar aircraft detection. IEEE Transactions on Geoscience and Remote Sensing, 61:1–15, 2023.
  53. Privacy-preserving federated learning of remote sensing image classification with dishonest-majority. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2023.
Citations (4)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up