AD-Aligning: Emulating Human-like Generalization for Cognitive Domain Adaptation in Deep Learning
Abstract: Domain adaptation is pivotal for enabling deep learning models to generalize across diverse domains, a task complicated by variations in presentation and cognitive nuances. In this paper, we introduce AD-Aligning, a novel approach that combines adversarial training with source-target domain alignment to enhance generalization capabilities. By pretraining with Coral loss and standard loss, AD-Aligning aligns target domain statistics with those of the pretrained encoder, preserving robustness while accommodating domain shifts. Through extensive experiments on diverse datasets and domain shift scenarios, including noise-induced shifts and cognitive domain adaptation tasks, we demonstrate AD-Aligning's superior performance compared to existing methods such as Deep Coral and ADDA. Our findings highlight AD-Aligning's ability to emulate the nuanced cognitive processes inherent in human perception, making it a promising solution for real-world applications requiring adaptable and robust domain adaptation strategies.
- E. Tzeng, J. Hoffman, K. Saenko, and T. Darrell, “Adversarial discriminative domain adaptation,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 7167–7176.
- E. Tzeng, J. Hoffman, N. Zhang, K. Saenko, and T. Darrell, “Deep domain confusion: Maximizing for domain invariance,” arXiv preprint arXiv:1412.3474, 2014.
- P. Oza, V. A. Sindagi, V. V. Sharmini, and V. M. Patel, “Unsupervised domain adaptation of object detectors: A survey,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023.
- B. Sun, J. Feng, and K. Saenko, “Return of frustratingly easy domain adaptation,” in Proceedings of the AAAI conference on artificial intelligence, vol. 30, no. 1, 2016.
- J. Hoffman, D. Wang, F. Yu, and T. Darrell, “Fcns in the wild: Pixel-level adversarial and constraint-based adaptation,” arXiv preprint arXiv:1612.02649, 2016.
- K. Li, C. Wigington, C. Tensmeyer, V. I. Morariu, H. Zhao, V. Manjunatha, N. Barmpalios, and Y. Fu, “Improving cross-domain detection with self-supervised learning,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 4746–4755.
- H. Liu, J. Z. HaoChen, A. Gaidon, and T. Ma, “Self-supervised learning is more robust to dataset imbalance,” arXiv preprint arXiv:2110.05025, 2021.
- H. Li, R. Wan, S. Wang, and A. C. Kot, “Unsupervised domain adaptation in the wild via disentangling representation learning,” International Journal of Computer Vision, vol. 129, pp. 267–283, 2021.
- X. Liu, R. Wang, D. Sun, J. Li, C. Youn, Y. Lyu, J. Zhan, D. Wu, X. Xu, M. Liu, X. Lei, Z. Xu, Y. Zhang, Z. Li, Q. Yang, and T. Abdelzaher, “Influence pathway discovery on social media,” in 2023 IEEE 9th International Conference on Collaboration and Internet Computing (CIC), 2023, pp. 105–109.
- P. Li, Y. Lin, and E. Schultz-Fellenz, “Contextual hourglass network for semantic segmentation of high resolution aerial imagery,” CoRR, 2019.
- P. Li, M. Abouelenien, and R. Mihalcea, “Deception detection from linguistic and physiological data streams using bimodal convolutional neural networks,” CoRR, 2023.
- A. Gretton, K. M. Borgwardt, M. J. Rasch, B. Schölkopf, and A. Smola, “A kernel two-sample test,” The Journal of Machine Learning Research, vol. 13, no. 1, pp. 723–773, 2012.
- K. Jiang, T. Zhang, Y. Zhang, F. Wu, and Y. Rui, “Self-supervised agent learning for unsupervised cross-domain person re-identification,” IEEE Transactions on Image Processing, vol. 29, pp. 8549–8560, 2020.
- C. Finn, P. Abbeel, and S. Levine, “Model-agnostic meta-learning for fast adaptation of deep networks,” in International conference on machine learning. PMLR, 2017, pp. 1126–1135.
- Y. Jia, J. Zhang, S. Shan, and X. Chen, “Unified unsupervised and semi-supervised domain adaptation network for cross-scenario face anti-spoofing,” Pattern Recognition, vol. 115, p. 107888, 2021.
- S. Wang, Y. Chen, Z. He, X. Yang, M. Wang, Q. You, and X. Zhang, “Disentangled representation learning with causality for unsupervised domain adaptation,” in Proceedings of the 31st ACM International Conference on Multimedia, 2023, pp. 2918–2926.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.