Papers
Topics
Authors
Recent
Search
2000 character limit reached

Label Learning Method Based on Tensor Projection

Published 26 Feb 2024 in cs.LG | (2402.16544v1)

Abstract: Multi-view clustering method based on anchor graph has been widely concerned due to its high efficiency and effectiveness. In order to avoid post-processing, most of the existing anchor graph-based methods learn bipartite graphs with connected components. However, such methods have high requirements on parameters, and in some cases it may not be possible to obtain bipartite graphs with clear connected components. To end this, we propose a label learning method based on tensor projection (LLMTP). Specifically, we project anchor graph into the label space through an orthogonal projection matrix to obtain cluster labels directly. Considering that the spatial structure information of multi-view data may be ignored to a certain extent when projected in different views separately, we extend the matrix projection transformation to tensor projection, so that the spatial structure information between views can be fully utilized. In addition, we introduce the tensor Schatten $p$-norm regularization to make the clustering label matrices of different views as consistent as possible. Extensive experiments have proved the effectiveness of the proposed method.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (36)
  1. Y. Yun, J. Li, Q. Gao, M. Yang, and X. Gao, “Low-rank discrete multi-view spectral clustering,” Neural Networks, vol. 166, pp. 137–147, 2023. [Online]. Available: https://doi.org/10.1016/j.neunet.2023.06.038
  2. Z. Zhang, Q. Wang, Z. Tao, Q. Gao, and W. Feng, “Dropping pathways towards deep multi-view graph subspace clustering networks,” in Proceedings of the 31st ACM International Conference on Multimedia.   ACM, 2023, pp. 3259–3267.
  3. W. Zhao, Q. Gao, S. Mei, and M. Yang, “Contrastive self-representation learning for data clustering,” Neural Networks, vol. 167, pp. 648–655, 2023. [Online]. Available: https://doi.org/10.1016/j.neunet.2023.08.050
  4. H. Lu, H. Xu, Q. Wang, Q. Gao, M. Yang, and X. Gao, “Efficient multi-view -means for image clustering,” IEEE Trans. Image Process., vol. 33, pp. 273–284, 2024. [Online]. Available: https://doi.org/10.1109/TIP.2023.3340609
  5. Z. Hao, Z. Lu, G. Li, F. Nie, R. Wang, and X. Li, “Ensemble clustering with attentional representation,” IEEE Trans. Knowl. Data Eng., vol. 36, no. 2, pp. 581–593, 2024. [Online]. Available: https://doi.org/10.1109/TKDE.2023.3292573
  6. B. Yang, J. Wu, X. Zhang, X. Zheng, F. Nie, and B. Chen, “Discrete correntropy-based multi-view anchor-graph clustering,” Inf. Fusion, vol. 103, p. 102097, 2024. [Online]. Available: https://doi.org/10.1016/j.inffus.2023.102097
  7. Z. Wang, L. Li, X. Ning, W. Tan, Y. Liu, and H. Song, “Incomplete multi-view clustering via structure exploration and missing-view inference,” Inf. Fusion, vol. 103, p. 102123, 2024. [Online]. Available: https://doi.org/10.1016/j.inffus.2023.102123
  8. C. Tang, K. Sun, C. Tang, X. Zheng, X. Liu, J. Huang, and W. Zhang, “Multi-view subspace clustering via adaptive graph learning and late fusion alignment,” Neural Networks, vol. 165, pp. 333–343, 2023. [Online]. Available: https://doi.org/10.1016/j.neunet.2023.05.019
  9. M. Zhao, W. Yang, and F. Nie, “Auto-weighted orthogonal and nonnegative graph reconstruction for multi-view clustering,” Inf. Sci., vol. 632, pp. 324–339, 2023. [Online]. Available: https://doi.org/10.1016/j.ins.2023.03.016
  10. Q. Xiao, S. Du, K. Zhang, J. Song, and Y. Huang, “Adaptive sparse graph learning for multi-view spectral clustering,” Appl. Intell., vol. 53, no. 12, pp. 14 855–14 875, 2023. [Online]. Available: https://doi.org/10.1007/s10489-022-04267-9
  11. Y. He and U. K. Yusof, “Self-weighted graph-based framework for multi-view clustering,” IEEE Access, vol. 11, pp. 30 197–30 207, 2023. [Online]. Available: https://doi.org/10.1109/ACCESS.2023.3260971
  12. S. Mei, W. Zhao, Q. Gao, M. Yang, and X. Gao, “Joint feature selection and optimal bipartite graph learning for subspace clustering,” Neural Networks, vol. 164, pp. 408–418, 2023. [Online]. Available: https://doi.org/10.1016/j.neunet.2023.04.044
  13. H. Wang, Q. Wang, Q. Miao, and X. Ma, “Joint learning of data recovering and graph contrastive denoising for incomplete multi-view clustering,” Inf. Fusion, vol. 104, p. 102155, 2024. [Online]. Available: https://doi.org/10.1016/j.inffus.2023.102155
  14. K. Zhan, C. Zhang, J. Guan, and J. Wang, “Graph learning for multiview clustering,” IEEE Trans. Cybern., vol. 48, no. 10, pp. 2887–2895, 2018.
  15. X. Li, H. Zhang, R. Wang, and F. Nie, “Multiview clustering: A scalable and parameter-free bipartite graph fusion method,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 44, no. 1, pp. 330–344, 2022.
  16. Q. Zhou, H. Yang, and Q. Gao, “Low-rank constraint bipartite graph learning,” Neurocomputing, vol. 511, pp. 426–436, 2022.
  17. H. Yang, Q. Gao, W. Xia, M. Yang, and X. Gao, “Multiview spectral clustering with bipartite graph,” IEEE Trans. Image Process., vol. 31, pp. 3591–3605, 2022.
  18. W. Xia, Q. Gao, Q. Wang, X. Gao, C. Ding, and D. Tao, “Tensorized bipartite graph learning for multi-view clustering,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 45, no. 4, pp. 5187–5202, 2023.
  19. Q. Gao, Z. Wan, Y. Liang, Q. Wang, Y. Liu, and L. Shao, “Multi-view projected clustering with graph learning,” Neural Networks, vol. 126, pp. 335–346, 2020.
  20. B. Wang, Y. Xiao, Z. Li, X. Wang, X. Chen, and D. Fang, “Robust self-weighted multi-view projection clustering,” in The Thirty-Fourth AAAI Conference on Artificial Intelligence, 2020.   AAAI Press, 2020, pp. 6110–6117. [Online]. Available: https://doi.org/10.1609/aaai.v34i04.6075
  21. X. Sang, J. Lu, and H. Lu, “Consensus graph learning for auto-weighted multi-view projection clustering,” Inf. Sci., vol. 609, pp. 816–837, 2022.
  22. H. Wang, W. Zhang, and X. Ma, “Clustering of noised and heterogeneous multi-view data with graph learning and projection decomposition,” Knowl. Based Syst., vol. 255, p. 109736, 2022. [Online]. Available: https://doi.org/10.1016/j.knosys.2022.109736
  23. J. Li, X. Zhang, J. Wang, X. Wang, Z. Tan, and H. Sun, “Projection-based coupled tensor learning for robust multi-view clustering,” Inf. Sci., vol. 632, pp. 664–677, 2023.
  24. S. Wang, X. Liu, S. Liu, J. Jin, W. Tu, X. Zhu, and E. Zhu, “Align then fusion: Generalized large-scale multi-view clustering with anchor matching correspondences,” in Advances in Neural Information Processing Systems 35, S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh, Eds., 2022.
  25. M. E. Kilmer and C. D. Martin, “Factorization strategies for third-order tensors,” Linear Algebra and its Applications, vol. 435, no. 3, pp. 641–658, 2011.
  26. Q. Gao, P. Zhang, W. Xia, D. Xie, X. Gao, and D. Tao, “Enhanced tensor rpca and its application,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 43, no. 6, pp. 2133–2140, 2021.
  27. Z. Zha, X. Yuan, B. Wen, J. Zhou, J. Zhang, and C. Zhu, “A benchmark for sparse coding: When group sparsity meets rank minimization,” IEEE Transactions on Image Processing, vol. 29, pp. 5094–5109, 2020.
  28. Y. Xie, S. Gu, Y. Liu, W. Zuo, W. Zhang, and L. Zhang, “Weighted schatten p𝑝pitalic_p-norm minimization for image denoising and background subtraction,” IEEE Trans. Image Process., vol. 25, no. 10, pp. 4842–4857, 2016.
  29. J. Li, Q. Gao, Q. WANG, M. Yang, and W. Xia, “Orthogonal non-negative tensor factorization based multi-view clustering,” in Thirty-seventh Conference on Neural Information Processing Systems, 2023.
  30. H. Xu, X. Zhang, W. Xia, Q. Gao, and X. Gao, “Low-rank tensor constrained co-regularized multi-view spectral clustering,” Neural Networks, vol. 132, pp. 245–252, 2020.
  31. B. Yang, X. Zhang, F. Nie, F. Wang, W. Yu, and R. Wang, “Fast multi-view clustering via nonnegative and orthogonal factorization,” IEEE Transactions on Image Processing, vol. 30, pp. 2575–2586, 2021.
  32. S. Luo, C. Zhang, W. Zhang, and X. Cao, “Consistent and specific multi-view subspace clustering,” in Thirty-second AAAI conference on artificial intelligence, 2018.
  33. H. Wang, Y. Yang, and B. Liu, “Gmc: Graph-based multi-view clustering,” IEEE Transactions on Knowledge and Data Engineering, vol. 32, no. 6, pp. 1116–1129, 2019.
  34. J. Wu, Z. Lin, and H. Zha, “Essential tensor learning for multi-view spectral clustering,” IEEE Transactions on Image Processing, vol. 28, no. 12, pp. 5910–5922, 2019.
  35. Z. Kang, W. Zhou, Z. Zhao, J. Shao, M. Han, and Z. Xu, “Large-scale multi-view subspace clustering in linear time,” in Proceedings of the AAAI conference on Artificial Intelligence, 2020, pp. 4412–4419.
  36. S. Wang, X. Liu, X. Zhu, P. Zhang, Y. Zhang, F. Gao, and E. Zhu, “Fast parameter-free multi-view subspace clustering with consensus anchor guidance,” IEEE Transactions on Image Processing, vol. 31, pp. 556–568, 2021.

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up