Papers
Topics
Authors
Recent
Search
2000 character limit reached

The Survey on Multi-Source Data Fusion in Cyber-Physical-Social Systems:Foundational Infrastructure for Industrial Metaverses and Industries 5.0

Published 11 Apr 2024 in cs.CY | (2404.07476v1)

Abstract: As the concept of Industries 5.0 develops, industrial metaverses are expected to operate in parallel with the actual industrial processes to offer Human-Centric" Safe, Secure, Sustainable, Sensitive, Service, and Smartness6S" manufacturing solutions. Industrial metaverses not only visualize the process of productivity in a dynamic and evolutional way, but also provide an immersive laboratory experimental environment for optimizing and remodeling the process. Besides, the customized user needs that are hidden in social media data can be discovered by social computing technologies, which introduces an input channel for building the whole social manufacturing process including industrial metaverses. This makes the fusion of multi-source data cross Cyber-Physical-Social Systems (CPSS) the foundational and key challenge. This work firstly proposes a multi-source-data-fusion-driven operational architecture for industrial metaverses on the basis of conducting a comprehensive literature review on the state-of-the-art multi-source data fusion methods. The advantages and disadvantages of each type of method are analyzed by considering the fusion mechanisms and application scenarios. Especially, we combine the strengths of deep learning and knowledge graphs in scalability and parallel computation to enable our proposed framework the ability of prescriptive optimization and evolution. This integration can address the shortcomings of deep learning in terms of explainability and fact fabrication, as well as overcoming the incompleteness and the challenges of construction and maintenance inherent in knowledge graphs. The effectiveness of the proposed architecture is validated through a parallel weaving case study. In the end, we discuss the challenges and future directions of multi-source data fusion cross CPSS for industrial metaverses and social manufacturing in Industries 5.0.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (186)
  1. F.-Y. Wang, Y. Tang, and P. J. Werbos, “Guest editorial: cyber–physical–social intelligence: toward metaverse-based smart societies of 6I and 6S,” IEEE Trans. Syst. Man Cybern. Syst., vol. 53, no. 4, pp. 2018–2024, 2023.
  2. P.-K. Chen, Y. Ye, and X. Huang, “The metaverse in supply chain knowledge sharing and resilience contexts: An empirical investigation of factors affecting adoption and acceptance,” J. Innov. Knowl., vol. 8, no. 4, p. 100446, 2023.
  3. J. Lee and P. Kundu, “Integrated cyber-physical systems and industrial metaverse for remote manufacturing,” Manuf. Lett., vol. 34, pp. 12–15, 2022.
  4. F.-Y. Wang, “The emergence of intelligent enterprises: From CPS to CPSS,” IEEE Intell. Syst., vol. 25, no. 4, pp. 85–88, 2010.
  5. B. A. Yilma, H. Panetto, and Y. Naudet, “Systemic formalisation of cyber-physical-social system (cpss): A systematic literature review,” Comput. Ind., vol. 129, p. 103458, 2021.
  6. F. Tao, H. Zhang, A. Liu, and A. Y. Nee, “Digital twin in industry: State-of-the-art,” IEEE Trans. Industr. Inform., vol. 15, no. 4, pp. 2405–2415, 2018.
  7. M. Liu, S. Fang, H. Dong, and C. Xu, “Review of digital twin about concepts, technologies, and industrial applications,” J. Manuf. Syst., vol. 58, pp. 346–361, 2021.
  8. X. Yao, N. Ma, J. Zhang, K. Wang, E. Yang, and M. Faccio, “Enhancing wisdom manufacturing as industrial metaverse for industry and society 5.0,” J. Intell. Manuf., pp. 1–21, 2022.
  9. X. Wang, J. Yang, Y. Wang, Q. Miao, F.-Y. Wang, A. Zhao, J.-L. Deng, L. Li, X. Na, and L. Vlacic, “Steps toward industry 5.0: Building “6S” parallel industries with cyber-physical-social intelligence,” IEEE/CAA J. of Autom. Sin., vol. 10, no. 8, pp. 1692–1703, 2023.
  10. F.-Y. Wang, Y. Yuan, X. Wang, and R. Qin, “Societies 5.0: A new paradigm for computational social systems research,” IEEE Trans. Comput. Soc. Syst., vol. 5, no. 1, pp. 2–8, 2018.
  11. P. Wang, L. T. Yang, J. Li, J. Chen, and S. Hu, “Data fusion in cyber-physical-social systems: State-of-the-art and perspectives,” Inf. Fusion, vol. 51, pp. 42–57, 2019.
  12. T. Meng, X. Jing, Z. Yan, and W. Pedrycz, “A survey on machine learning for data fusion,” Inf. Fusion, vol. 57, pp. 115–129, 2020.
  13. S. Zhang, L. T. Yang, J. Feng, W. Wei, Z. Cui, X. Xie, and P. Yan, “A tensor-network-based big data fusion framework for cyber-physical-social systems (CPSS),” Inf. Fusion, vol. 76, pp. 337–354, 2021.
  14. J. Yang, L. T. Yang, H. Wang, Y. Gao, Y. Zhao, X. Xie, and Y. Lu, “Representation learning for knowledge fusion and reasoning in cyber-physical-social systems: Survey and perspectives,” Inf. Fusion, vol. 90, pp. 59–73, 2023.
  15. P. Zhang, T. Li, G. Wang, C. Luo, H. Chen, J. Zhang, D. Wang, and Z. Yu, “Multi-source information fusion based on rough set theory: A review,” Inf. Fusion, vol. 68, pp. 85–117, 2021.
  16. B. Khaleghi, A. Khamis, F. O. Karray et al., “Multisensor data fusion: A review of the state-of-the-art,” Inf. Fusion, vol. 14, no. 1, pp. 28–44, 2013.
  17. L. Chai, W. Yi, R. Hoseinnezhad, and L. Kong, “Heterogeneous multi-sensor fusion for PHD filter in decentralized sensor networks,” Inf. Fusion, vol. 100, p. 101956, 2023.
  18. Z. Qu, Y. Li, and P. Tiwari, “QNMF: A quantum neural network based multimodal fusion system for intelligent diagnosis,” Inf. Fusion, vol. 100, p. 101913, 2023.
  19. R. Nie, J. Cao, D. Zhou, and W. Qian, “Multi-source information exchange encoding with pcnn for medical image fusion,” IEEE Trans. Circuits Syst. Video Technol., vol. 31, no. 3, pp. 986–1000, 2020.
  20. X. Tao and J. D. Velasquez, “Multi-source information fusion for smart health with artificial intelligence,” pp. 93–95, 2022.
  21. P. Zhang, T. Li, G. Wang, D. Wang, P. Lai, and F. Zhang, “A multi-source information fusion model for outlier detection,” Inf. Fusion, vol. 93, pp. 192–208, 2023.
  22. B. Cai, Y. Liu, Q. Fan, Y. Zhang, Z. Liu, S. Yu, and R. Ji, “Multi-source information fusion based fault diagnosis of ground-source heat pump using bayesian network,” Appl. Energy, vol. 114, pp. 1–9, 2014.
  23. H. Li, H.-Z. Huang, Y.-F. Li, J. Zhou, and J. Mi, “Physics of failure-based reliability prediction of turbine blades using multi-source information fusion,” Appl. Soft Comput., vol. 72, pp. 624–635, 2018.
  24. Y. Guo, C. Yin, M. Li, X. Ren, and P. Liu, “Mobile e-commerce recommendation system based on multi-source information fusion for sustainable e-business,” Sustainability, vol. 10, no. 1, p. 147, 2018.
  25. S. Cheng, B. Zhang, G. Zou, M. Huang, and Z. Zhang, “Friend recommendation in social networks based on multi-source information fusion,” Int. J. Mach. Learn. Cybern., vol. 10, pp. 1003–1024, 2019.
  26. A. Smirnov and T. Levashova, “Knowledge fusion patterns: A survey,” Inf. Fusion, vol. 52, pp. 31–40, 2019.
  27. X. Zhao, Y. Jia, A. Li, R. Jiang, and Y. Song, “Multi-source knowledge fusion: A survey,” World Wide Web, vol. 23, pp. 2567–2592, 2020.
  28. P. Xu, X. Zhu, and D. A. Clifton, “Multimodal learning with Transformers: A survey,” IEEE Trans. Pattern Anal. Mach. Intell., pp. 1–20, 2023.
  29. X. Han, Y.-T. Wang, J.-L. Feng, C. Deng, Z.-H. Chen, Y.-A. Huang, H. Su, L. Hu, and P.-W. Hu, “A survey of Transformer-based multimodal pre-trained modals,” Neurocomputing, vol. 515, pp. 89–106, 2023.
  30. W. Guo, J. Wang, and S. Wang, “Deep multimodal representation learning: A survey,” IEEE Access, vol. 7, pp. 63 373–63 394, 2019.
  31. B. Wang, H. Zhou, X. Li, G. Yang, P. Zheng, C. Song, Y. Yuan, T. Wuest, H. Yang, and L. Wang, “Human digital twin in the context of industry 5.0,” Robot. Comput. Integr. Manuf., vol. 85, p. 102626, 2024.
  32. C. Zhang, Z. Wang, G. Zhou, F. Chang, D. Ma, Y. Jing, W. Cheng, K. Ding, and D. Zhao, “Towards new-generation human-centric smart manufacturing in industry 5.0: A systematic review,” Adv. Eng. Inform., vol. 57, p. 102121, 2023.
  33. F.-Y. Wang, “The metaverse of mind: Perspectives on DeSci for DeEco and DeSoc,” IEEE/CAA J. of Autom. Sin., vol. 9, no. 12, pp. 2043–2046, 2022.
  34. T. R. Gadekallu, W. Wang, G. Yenduri, P. Ranaweera, Q.-V. Pham, D. B. da Costa, M. Liyanage et al., “Blockchain for the metaverse: A review,” Future Gener. Comput. Syst., vol. 143, pp. 401–419, 2023.
  35. F.-Y. Wang, “The DAO to metacontrol for metasystems in metaverses: The system of parallel control systems for knowledge automation and control intelligence in CPSS,” IEEE/CAA J. of Autom. Sin., vol. 9, no. 11, pp. 1899–1908, 2022.
  36. J. Wang, Y. Tian, Y. Wang, J. Yang, X. Wang, S. Wang, and O. Kwan, “A framework and operational procedures for metaverses-based industrial foundation models,” IEEE Trans. Syst. Man Cybern. Syst., vol. 53, no. 4, pp. 2037–2046, 2022.
  37. F.-Y. Wang, “New control paradigm for industry 5.0: From big models to foundation control and management,” IEEE/CAA J. of Autom. Sin., vol. 10, no. 8, pp. 1643–1646, 2023.
  38. F.-Y. Wang, J. Yang, X. Wang, J. Li, and Q.-L. Han, “Chat with ChatGPT on industry 5.0: Learning and decision-making for intelligent industries,” IEEE/CAA J. of Autom. Sin., vol. 10, no. 4, pp. 831–834, 2023.
  39. Q. Qi and F. Tao, “A smart manufacturing service system based on edge computing, fog computing, and cloud computing,” IEEE Access, vol. 7, pp. 86 769–86 777, 2019.
  40. B. Wang, F. Tao, X. Fang, C. Liu, Y. Liu, and T. Freiheit, “Smart manufacturing and intelligent manufacturing: A comparative review,” Engineering, vol. 7, no. 6, pp. 738–757, 2021.
  41. Á. García, A. Bregon, and M. A. Martínez-Prieto, “Towards a connected digital twin learning ecosystem in manufacturing: Enablers and challenges,” Comput. Industr. Eng., vol. 171, p. 108463, 2022.
  42. M. Andronie, G. Lăzăroiu, R. Ștefănescu, C. Uță, and I. Dijmărescu, “Sustainable, smart, and sensing technologies for cyber-physical manufacturing systems: A systematic literature review,” Sustainability, vol. 13, no. 10, p. 5495, 2021.
  43. Y. Jiang, S. Yin, J. Dong, and O. Kaynak, “A review on soft sensors for monitoring, control, and optimization of industrial processes,” IEEE Sens. J., vol. 21, no. 11, pp. 12 868–12 881, 2020.
  44. M. Majid, S. Habib, A. R. Javed, M. Rizwan, G. Srivastava, T. R. Gadekallu, and J. C.-W. Lin, “Applications of wireless sensor networks and internet of things frameworks in the industry revolution 4.0: A systematic literature review,” Sensors, vol. 22, no. 6, p. 2087, 2022.
  45. G. Aceto, V. Persico, and A. Pescapé, “A survey on information and communication technologies for industry 4.0: State-of-the-art, taxonomies, perspectives, and challenges,” IEEE Commun. Surv. Tutor., vol. 21, no. 4, pp. 3467–3501, 2019.
  46. A. W. Colombo, S. Karnouskos, X. Yu, O. Kaynak, R. C. Luo, Y. Shi, P. Leitao, L. Ribeiro, and J. Haase, “A 70-year industrial electronics society evolution through industrial revolutions: The rise and flourishing of information and communication technologies,” IEEE Ind. Electron. Mag., vol. 15, no. 1, pp. 115–126, 2021.
  47. J. Yang, X. Wang, Y. Tian, and F.-Y. Wang, “Parallel intelligence in CPSSs: Being, becoming, and believing,” IEEE Intell. Syst., vol. 38, no. 06, pp. 75–80, 2023.
  48. J. Yang, X. Wang, Y. Wang et al., “Parallel intelligence and CPSS in 30 years: An ACP approach,” Acta Automa. Sin., vol. 49, no. 3, pp. 614–634, 2023.
  49. X. Wang, J. Yang, J. Han, W. Wang, and F.-Y. Wang, “Metaverses and DeMetaverses: From digital twins in CPS to parallel intelligence in CPSS,” IEEE Intell. Syst., vol. 37, no. 4, pp. 97–102, 2022.
  50. Y. Wang, “Survey on deep multi-modal data analytics: Collaboration, rivalry, and fusion,” ACM Trans. Multimedia Comput. Commun. Appl., vol. 17, no. 1s, pp. 1–25, 2021.
  51. L. Wu, Y. Long, C. Gao, Z. Wang, and Y. Zhang, “MFIR: Multimodal fusion and inconsistency reasoning for explainable fake news detection,” Inf. Fusion, vol. 100, p. 101944, 2023.
  52. Z. Huang, S. Sun, J. Zhao, and L. Mao, “Multi-modal policy fusion for end-to-end autonomous driving,” Inf. Fusion, vol. 98, p. 101834, 2023.
  53. Y. Tian, X. Zhang, X. Wang, J. Xu, J. Wang, R. Ai, W. Gu, and W. Ding, “ACF-Net: Asymmetric cascade fusion for 3D detection with lidar point clouds and images,” IEEE Trans. Intell. Veh., 2023.
  54. F.-Y. Wang, X. Wang, Y. Yuan, T. Wang, Y. Lin, “Social computing and computational societies: The foundation and consequence of smart societies,” Chinese Science Bulletin, vol. 60, pp. 460–469, 2015.
  55. W. Adams, G. Iyengar, C.-Y. Lin, M. R. Naphade, C. Neti, H. J. Nock, and J. R. Smith, “Semantic indexing of multimedia content using visual, audio, and text cues,” EURASIP J. Adv. Signal Process., vol. 2003, pp. 1–16, 2003.
  56. H. Bourlard and S. Dupont, “A new ASR approach based on independent processing and recombination of partial frequency bands,” in Int. Conf. Spoken Lang. Process. ICSLP Proc., vol. 1, 1996, pp. 426–429.
  57. A. Dogan and D. Birant, “Machine learning and data mining in manufacturing,” Expert Syst. Appl., vol. 166, p. 114060, 2021.
  58. Z. Qu, Y. Meng, G. Muhammad, and P. Tiwari, “QMFND: A quantum multimodal fusion-based fake news detection model for social media,” Inf. Fusion, p. 102172, 2023.
  59. J. Summaira, X. Li, A. M. Shoib, S. Li, and J. Abdul, “Recent advances and trends in multimodal deep learning: A review,” arXiv preprint arXiv:2105.11087, 2021.
  60. S. Antol, A. Agrawal, J. Lu, M. Mitchell, D. Batra, C. L. Zitnick, and D. Parikh, “VQA: Visual question answering,” in Proc. IEEE Int. Conf. Comput. Vision, 2015, pp. 2425–2433.
  61. B. A. Plummer, L. Wang, C. M. Cervantes, J. C. Caicedo, J. Hockenmaier, and S. Lazebnik, “Flickr30k entities: Collecting region-to-phrase correspondences for richer image-to-sentence models,” in Proc. IEEE Int. Conf. Comput. Vision, 2015, pp. 2641–2649.
  62. Y. Cai, X. Sui, and G. Gu, “Multi-modal multi-task feature fusion for rgbt tracking,” Inf. Fusion, vol. 97, p. 101816, 2023.
  63. A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,” Adv. Neural Inf. Process. Syst., vol. 30, 2017.
  64. J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of deep bidirectional Transformers for language understanding,” in Conf. N. Am. Chapter Assoc. Comput. Linguistics: Hum. Lang. Technol., 2019, pp. 4171–4186.
  65. T. Brown, B. Mann, N. Ryder, M. Subbiah, J. D. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell et al., “Language models are few-shot learners,” Adv. Neural Inf. Process. Syst., vol. 33, pp. 1877–1901, 2020.
  66. A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly et al., “An image is worth 16x16 words: Transformers for image recognition at scale,” in Int. Conf. Learn. Represent., 2020.
  67. N. Carion, F. Massa, G. Synnaeve, N. Usunier, A. Kirillov, and S. Zagoruyko, “End-to-end object detection with Transformers,” in Lect. Notes Comput. Sci.   Springer, 2020, pp. 213–229.
  68. R. Hu and A. Singh, “UniT: Multimodal multitask learning with a unified Transformer,” in Proc. IEEE Int. Conf. Comput. Vision, 2021, pp. 1439–1449.
  69. V.-A. Nguyen and S. G. Kong, “Multimodal feature fusion for illumination-invariant recognition of abnormal human behaviors,” Inf. Fusion, vol. 100, p. 101949, 2023.
  70. C. Raffel, N. Shazeer, A. Roberts, K. Lee, S. Narang, M. Matena, Y. Zhou, W. Li, and P. J. Liu, “Exploring the limits of transfer learning with a unified text-to-text Transformer,” J. Mach. Learn. Res., vol. 21, no. 1, pp. 5485–5551, 2020.
  71. J. Lu, V. Goswami, M. Rohrbach, D. Parikh, and S. Lee, “12-in-1: Multi-task vision and language representation learning,” in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit., 2020, pp. 10 437–10 446.
  72. J. Yoon, G. Choi, and C. Choi, “Multimedia analysis of robustly optimized multimodal transformer based on vision and language co-learning,” Inf. Fusion, vol. 100, p. 101922, 2023.
  73. Z.-Y. Dou, A. Kamath, Z. Gan, P. Zhang, J. Wang, L. Li, Z. Liu, C. Liu, Y. LeCun, N. Peng et al., “Coarse-to-fine vision-language pre-training with fusion in the backbone,” Adv. Neural Inf. Process. Syst., vol. 35, pp. 32 942–32 956, 2022.
  74. A. Singh, R. Hu, V. Goswami, G. Couairon, W. Galuba, M. Rohrbach, and D. Kiela, “FLAVA: A foundational language and vision alignment model,” in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit., 2022, pp. 15 638–15 650.
  75. P. Wang, S. Wang, J. Lin, S. Bai, X. Zhou, J. Zhou, X. Wang, and C. Zhou, “ONE-PEACE: Exploring one general representation model toward unlimited modalities,” arXiv preprint arXiv:2305.11172, 2023.
  76. J.-B. Alayrac, J. Donahue, P. Luc, A. Miech, I. Barr, Y. Hasson, K. Lenc, A. Mensch, K. Millican, M. Reynolds et al., “Flamingo: A visual language model for few-shot learning,” Adv. Neural Inf. Process. Syst., vol. 35, pp. 23 716–23 736, 2022.
  77. A. Awadalla, I. Gao, J. Gardner, J. Hessel, Y. Hanafy, W. Zhu, K. Marathe, Y. Bitton, S. Gadre, S. Sagawa et al., “OpenFlamingo: An open-source framework for training large autoregressive vision-language models,” arXiv preprint arXiv:2308.01390, 2023.
  78. P. Gao, J. Han, R. Zhang, Z. Lin, S. Geng, A. Zhou, W. Zhang, P. Lu, C. He, X. Yue et al., “LLaMA-Adapter V2: Parameter-efficient visual instruction model,” arXiv preprint arXiv:2304.15010, 2023.
  79. R. Bommasani, D. A. Hudson, E. Adeli, R. Altman, S. Arora, S. von Arx, M. S. Bernstein, J. Bohg, A. Bosselut, E. Brunskill et al., “On the opportunities and risks of foundation models,” arXiv preprint arXiv:2108.07258, 2021.
  80. C. Li, Z. Gan, Z. Yang, J. Yang, L. Li, L. Wang, and J. Gao, “Multimodal foundation models: From specialists to general-purpose assistants,” arXiv preprint arXiv:2309.10020, vol. 1, no. 2, 2023.
  81. P. Xu, X. Zhu, and D. A. Clifton, “Multimodal learning with transformers: A survey,” IEEE Trans. Pattern Anal. Mach. Intell., 2023.
  82. X. Wang, G. Chen, G. Qian, P. Gao, X.-Y. Wei, Y. Wang, Y. Tian, and W. Gao, “Large-scale multi-modal pre-trained models: A comprehensive survey,” Mach. Intell. Res., pp. 1–36, 2023.
  83. L. Kuang, F. Hao, L. T. Yang, M. Lin, C. Luo, and G. Min, “A tensor-based approach for big data representation and dimensionality reduction,” IEEE Trans. Emerg. Topics Comput., vol. 2, no. 3, pp. 280–291, 2014.
  84. L. Kuang, L. T. Yang, and K. Qiu, “Tensor-based software-defined internet of things,” IEEE Wirel. Commun., vol. 23, no. 5, pp. 84–89, 2016.
  85. L. Kuang, L. T. Yang, J. Chen, F. Hao, and C. Luo, “A holistic approach for distributed dimensionality reduction of big data,” IEEE Trans. on Cloud Comput., vol. 6, no. 2, pp. 506–518, 2018.
  86. L. Kuang, L. T. Yang, and Y. Liao, “An integration framework on cloud for cyber-physical-social systems big data,” IEEE Trans. on Cloud Comput., vol. 8, no. 2, pp. 363–374, 2020.
  87. K. Abed-Meraim, N. L. Trung, A. Hafiane et al., “A contemporary and comprehensive survey on streaming tensor decomposition,” IEEE Trans. Knowl. Data Eng., 2022.
  88. T. G. Kolda and B. W. Bader, “Tensor decompositions and applications,” SIAM Rev., vol. 51, no. 3, pp. 455–500, 2009.
  89. P. Wang, L. T. Yang, G. Qian, J. Li, and Z. Yan, “HO-OTSVD: A novel tensor decomposition and its incremental decomposition for cyber-physical-social networks (CPSN),” IEEE Trans. Netw. Sci. Eng., vol. 7, no. 2, pp. 713–725, 2019.
  90. J. Feng, L. T. Yang, Q. Zhu, and K.-K. R. Choo, “Privacy-preserving tensor decomposition over encrypted data in a federated cloud environment,” IEEE Trans. Dependable Secure Comput., vol. 17, no. 4, pp. 857–868, 2018.
  91. J. Feng, L. T. Yang, and R. Zhang, “Practical privacy-preserving high-order bi-lanczos in integrated edge-fog-cloud architecture for cyber-physical-social systems,” ACM Trans. Internet Technol., vol. 19, no. 2, pp. 1–18, 2019.
  92. P. Wang, L. T. Yang, G. Qian, and F. Lu, “The cyber-physical-social transition tensor service framework,” IEEE Trans. Sustain. Comput., vol. 6, no. 3, pp. 481–492, 2018.
  93. P. Wang, L. T. Yang, Y. Peng, J. Li, and X. Xie, “M2⁢T2superscript𝑀2superscript𝑇2{M^{2}}{T^{2}}italic_M start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_T start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT: The multivariate multistep transition tensor for user mobility pattern prediction,” IEEE Trans. Netw. Sci. Eng., vol. 7, no. 2, pp. 907–917, 2020.
  94. P. Wang, L. T. Yang, and J. Li, “An edge cloud-assisted CPSS framework for smart city,” IEEE Cloud Comput., vol. 5, no. 5, pp. 37–46, 2018.
  95. H. Liu, L. T. Yang, T. Yao, J. Ding, and A. Deng, “Tensor-train-based higher order dominant Z-eigen decomposition for multi-modal prediction and its cloud/edge implementation,” IEEE Trans. Netw. Sci. Eng., vol. 8, no. 2, pp. 1353–1366, 2021.
  96. H. Liu, L. T. Yang, Y. Guo, X. Xie, and J. Ma, “An incremental tensor-train decomposition for cyber-physical-social big data,” IEEE Trans. Big Data, vol. 7, no. 2, pp. 341–354, 2021.
  97. H. Liu, J. Wang, X. Yin, J. Ding, L. T. Yang, T. Yao, J. Yang, and Y. Gao, “Tensor-train-based multiuser multivariate multiorder physical markov process informed multimodal prediction for industrial trajectory applications,” IEEE Trans. Industr. Inform., 2022.
  98. L. Yu, Z. Guo, G. Chen, and Y. Xi, “Summary of knowledge graph construction oriented knowledge extraction technology,” J. Inf. Eng. Univ., vol. 21, no. 2, pp. 227–235, 2020.
  99. L. Zhuang, H. Fei, and P. Hu, “Knowledge-enhanced event relation extraction via event ontology prompt,” Inf. Fusion, vol. 100, p. 101919, 2023.
  100. I. Segura-Bedmar, P. Martínez, and C. de Pablo-Sánchez, “A linguistic rule-based approach to extract drug-drug interactions from pharmacological documents,” in BMC Bioinform., vol. 12, no. 2, 2011, pp. 1–11.
  101. S. Pawar, P. Bhattacharyya, and G. K. Palshikar, “Extracting N-ary cross-sentence relations using constrained subsequence kernel,” arXiv preprint arXiv:2006.08185, 2020.
  102. Y. Xu, L. Han, T. Zhu, L. Sun, B. Du, and W. Lv, “Generic dynamic graph convolutional network for traffic flow forecasting,” Inf. Fusion, vol. 100, p. 101946, 2023.
  103. T.-J. Fu, P.-H. Li, and W.-Y. Ma, “GraphRel: Modeling text as relational graphs for joint entity and relation extraction,” in Annu. Meet. Assoc. Comput. Linguist., Proc. Conf., 2019, pp. 1409–1418.
  104. C. Li, A. Li, Y. Wang, H. Tu, and Y. Song, “A survey on approaches and applications of knowledge representation learning,” IEEE Int. Conf. Data Sci. Cyberspace, DSC, pp. 312–319, 2020.
  105. A. Bordes, N. Usunier, A. Garcia-Duran, J. Weston, and O. Yakhnenko, “Translating embeddings for modeling multi-relational data,” Adv. Neural Inf. Process. Syst., vol. 26, 2013.
  106. Z. Wang, J. Zhang, J. Feng, and Z. Chen, “Knowledge graph embedding by translating on hyperplanes,” in Proc. Natl. Conf. Artif. Intell., vol. 28, no. 1, 2014.
  107. G. Ji, S. He, L. Xu, K. Liu, and J. Zhao, “Knowledge graph embedding via dynamic mapping matrix,” in Annu. Meet. Assoc. Comput. Linguist. Int. Jt. Conf. Nat. Lang. Process. Asian Fed. Nat. Lang. Process., Proc. Conf., 2015, pp. 687–696.
  108. M. Nickel, V. Tresp, H.-P. Kriegel et al., “A three-way model for collective learning on multi-relational data,” in Proc. Int. Conf. Mach. Learn., ICML, vol. 11, no. 10.5555, 2011, pp. 3 104 482–3 104 584.
  109. B. Yang, W.-t. Yih, X. He, J. Gao, and L. Deng, “Embedding entities and relations for learning and inference in knowledge bases,” in Int. Conf. Learn. Represent., ICLR, 2015.
  110. S. M. Kazemi and D. Poole, “Simple embedding for link prediction in knowledge graphs,” Adv. Neural Inf. Process. Syst., vol. 31, 2018.
  111. T. Trouillon, J. Welbl, S. Riedel, É. Gaussier, and G. Bouchard, “Complex embeddings for simple link prediction,” in Int. Conf. Mach. Learn., ICML, 2016, pp. 2071–2080.
  112. M. Nickel, L. Rosasco, and T. Poggio, “Holographic embeddings of knowledge graphs,” in AAAI Conf. Artif. Intell., AAAI, vol. 30, no. 1, 2016.
  113. A. Bordes, X. Glorot, J. Weston, and Y. Bengio, “A semantic matching energy function for learning with multi-relational data: Application to word-sense disambiguation,” Mach. Learn., vol. 94, pp. 233–259, 2014.
  114. T. Dettmers, P. Minervini, P. Stenetorp, and S. Riedel, “Convolutional 2D knowledge graph embeddings,” in AAAI Conf. Artif. Intell., AAAI, vol. 32, no. 1, 2018.
  115. D. Q. Nguyen, T. D. Nguyen, D. Q. Nguyen, and D. Phung, “A novel embedding model for knowledge base completion based on convolutional neural network,” in Conf. N. Am. Chapter Assoc. Comput. Linguistics: Hum. Lang. Technol., vol. 2, 2018.
  116. M. Schlichtkrull, T. N. Kipf, P. Bloem, R. Van Den Berg, I. Titov, and M. Welling, “Modeling relational data with graph convolutional networks,” in Lect. Notes Comput. Sci., vol. 10843, 2018, pp. 593–607.
  117. Z. Wang, Z. Ren, C. He, P. Zhang, and Y. Hu, “Robust embedding with multi-level structures for link prediction,” in IJCAI Int. Joint Conf. Artif. Intell., 2019, pp. 5240–5246.
  118. D. Nathani, J. Chauhan, C. Sharma, and M. Kaul, “Learning attention-based embeddings for relation prediction in knowledge graphs,” in Annu. Meet. Assoc. Comput. Linguist., Proc. Conf., 2020.
  119. P. Wang, J. Han, C. Li, and R. Pan, “Logic attention based neighborhood aggregation for inductive knowledge graph embedding,” in AAAI Conf. Artif. Intell., AAAI, vol. 33, no. 01, 2019, pp. 7152–7159.
  120. L. Chang, M. Zhu, T. Gu, C. Bin, J. Qian, and J. Zhang, “Knowledge graph embedding by dynamic translation,” IEEE Access, vol. 5, pp. 20 898–20 907, 2017.
  121. T. Yue, R. Mao, H. Wang, Z. Hu, and E. Cambria, “KnowleNet: Knowledge fusion network for multimodal sarcasm detection,” Inf. Fusion, vol. 100, p. 101921, 2023.
  122. Z. Wang, X. He, H. Shen, S. Fan, and Y. Zeng, “Multi-source information fusion to identify water supply pipe leakage based on SVM and VMD,” Inf. Process. Manag., vol. 59, no. 2, p. 102819, 2022.
  123. J. Lehmann, R. Isele, M. Jakob, A. Jentzsch, D. Kontokostas, P. N. Mendes, S. Hellmann, M. Morsey, P. Van Kleef, S. Auer et al., “DBpedia–a large-scale, multilingual knowledge base extracted from Wikipedia,” Semant. Web, vol. 6, no. 2, pp. 167–195, 2015.
  124. F. M. Suchanek, S. Abiteboul, and P. Senellart, “PARIS: Probabilistic alignment of relations, instances, and schema,” Proc. VLDB Endow., vol. 5, no. 3, pp. 157–168, 2011.
  125. C. Shao, L.-M. Hu, J.-Z. Li, Z.-C. Wang, T. Chung, and J.-B. Xia, “RiMOM-IM: A novel iterative framework for instance matching,” J. Comput. Sci. Technol., vol. 31, pp. 185–197, 2016.
  126. F. Zhang, L. Yang, J. Li, and J.-W. Cheng, “An overview of entity alignment methods,” Chinese J. Comput., vol. 45, no. 6, pp. 1195–1225, 2020.
  127. M. Chen, Y. Tian, M. Yang, and C. Zaniolo, “Multilingual knowledge graph embeddings for cross-lingual knowledge alignment,” in IJCAI Int. Joint Conf. Artif. Intell., 2016.
  128. H. Zhu, R. Xie, Z. Liu, and M. Sun, “Iterative entity alignment via joint knowledge embeddings,” in IJCAI Int. Joint Conf. Artif. Intell., vol. 17, 2017, pp. 4258–4264.
  129. Z. Sun, W. Hu, Q. Zhang, and Y. Qu, “Bootstrapping entity alignment with knowledge graph embedding,” in IJCAI Int. Joint Conf. Artif. Intell., vol. 18, no. 2018, 2018.
  130. Q. Zhu, X. Zhou, J. Wu, J. Tan, and L. Guo, “Neighborhood-aware attentional representation for multilingual knowledge graphs,” in IJCAI Int. Joint Conf. Artif. Intell., 2019, pp. 1943–1949.
  131. Z. Sun, J. Huang, W. Hu, M. Chen, L. Guo, and Y. Qu, “TransEdge: Translating relation-contextualized embeddings for knowledge graphs,” in Lect. Notes Comput. Sci., vol. 11778, 2019, pp. 612–629.
  132. X. Lin, H. Yang, J. Wu, C. Zhou, and B. Wang, “Guiding cross-lingual entity alignment via adversarial knowledge embedding,” in Proc. IEEE Int. Conf. Data Min. ICDM, 2019, pp. 429–438.
  133. M. Chen, Y. Tian, K.-W. Chang, S. Skiena, and C. Zaniolo, “Co-training embeddings of knowledge graphs and entity descriptions for cross-lingual entity alignment,” in IJCAI Int. Joint Conf. Artif. Intell., 2018, pp. 3998–4004.
  134. Z. Wang, Q. Lv, X. Lan, and Y. Zhang, “Cross-lingual knowledge graph alignment via graph convolutional networks,” in Proc. Conf. Empir. Methods Nat. Lang. Process., EMNLP, 2018, pp. 349–357.
  135. Y. Wu, X. Liu, Y. Feng, Z. Wang, and D. Zhao, “Jointly learning entity and relation representations for entity alignment,” in Conf. Empir. Methods Nat. Lang. Process. Int. Jt. Conf. Nat. Lang. Process., 2019, pp. 240–249.
  136. C. Li, Y. Cao, L. Hou, J. Shi, J.-Z. Li, and T.-S. Chua, “Semi-supervised entity alignment via joint knowledge embedding model and cross-graph model,” in Conf. Empir. Methods Nat. Lang. Process. Int. Jt. Conf. Nat. Lang. Process., 2019, pp. 2723–2732.
  137. Z. Sun, C. Wang, W. Hu, M. Chen, J. Dai, W. Zhang, and Y. Qu, “Knowledge graph alignment network with gated multi-hop neighborhood aggregation,” in AAAI Conf. Artif. Intell., vol. 34, no. 01, 2020, pp. 222–229.
  138. R. Xie, Z. Liu, H. Luan, and M. Sun, “Image-embodied knowledge representation learning,” in IJCAI Int. Joint Conf. Artif. Intell., 2016, pp. 3140–3146.
  139. W. Dong, S. Sun, J. Zhao, and N. Zhang, “Knowledge graph relation reasoning with variational reinforcement network,” Inf. Fusion, vol. 100, p. 101900, 2023.
  140. M. Gardner, P. P. Talukdar, J. Krishnamurthy, and T. M. Mitchell, “Incorporating vector space similarity in random walk inference over knowledge bases,” in Conf. Empir. Methods Nat. Lang. Process., 2014, pp. 397–406.
  141. A. Neelakantan, B. Roth, and A. McCallum, “Compositional vector space models for knowledge base completion,” in Annu. Meet. Assoc. Comput. Linguist. Int. Jt. Conf. Nat. Lang. Process. Asian Fed. Nat. Lang. Process., 2015, pp. 156–166.
  142. W. Xiong, T.-L.-G. Hoang, and W. Y. Wang, “DeepPath: A reinforcement learning method for knowledge graph reasoning,” in Conf. Empir. Methods Nat. Lang. Process., 2017, pp. 564–573.
  143. L. A. Galárraga, C. Teflioudi, K. Hose, and F. Suchanek, “AMIE: Association rule mining under incomplete evidence in ontological knowledge bases,” in Proc. Int. Conf. World Wide Web, 2013, pp. 413–422.
  144. S. Guo, Q. Wang, L. Wang, B. Wang, and L. Guo, “Jointly embedding knowledge graphs and logical rules,” in Conf. Empir. Methods Nat. Lang. Process., 2016, pp. 192–202.
  145. S. Guo, Q. Wang, L. Wang, B. Wang, and L. Guo, “Knowledge graph embedding with iterative guidance from soft rules,” in AAAI Conf. Artif. Intell., vol. 32, no. 1, 2018.
  146. R. S. Trivedi, H. Dai, Y. Wang, and L. Song, “Know-Evolve: Deep temporal reasoning for dynamic knowledge graphs,” in Int. Conf. Mach. Learn., ICML, vol. 7, 2017, pp. 3462–3471.
  147. A. García-Durán, S. Dumancic, and M. Niepert, “Learning sequence encoders for temporal knowledge graph completion,” in Proc. Conf. Empir. Methods Nat. Lang. Process., 2018, pp. 4816–4821.
  148. J. Wu, M. Cao, J. C. K. Cheung, and W. L. Hamilton, “TeMP: Temporal message passing for temporal knowledge graph completion,” in Conf. Empir. Methods Nat. Lang. Process., 2020, pp. 5730–5746.
  149. C. Zhu, M. Chen, C. Fan, G. Cheng, and Y. Zhan, “Learning from history: Modeling temporal knowledge graphs with sequential copy-generation networks,” in AAAI Conf. Artif. Intell., vol. 35, no. 5, 2021, pp. 4732–4740.
  150. K. Liu, F. Zhao, H. Chen, Y. Li, G. Xu, and H. Jin, “DA-Net: Distributed attention network for temporal knowledge graph reasoning,” in Int. Conf. Inf. Knowledge Manage., 2022, pp. 1289–1298.
  151. F. Zhang, N. J. Yuan, D. Lian, X. Xie, and W.-Y. Ma, “Collaborative knowledge base embedding for recommender systems,” in Proc. ACM SIGKDD Int. Conf. Knowl. Discov. Data Min., 2016, pp. 353–362.
  152. R. Xie, Z. Liu, J. Jia, H. Luan, and M. Sun, “Representation learning of knowledge graphs with entity descriptions,” in AAAI Conf. Artif. Intell., vol. 30, no. 1, 2016, pp. 2659–2665.
  153. S. Pan, L. Luo, Y. Wang, C. Chen, J. Wang, and X. Wu, “Unifying large language models and knowledge graphs: A roadmap,” arXiv preprint arXiv:2306.08302, 2023.
  154. X. Wang, T. Gao, Z. Zhu, Z. Zhang, Z. Liu, J. Li, and J. Tang, “KEPLER: A unified model for knowledge embedding and pre-trained language representation,” Trans. Assoc. Comput. Linguist., vol. 9, pp. 176–194, 2021.
  155. P. Ke, H. Ji, Y. Ran, X. Cui, L. Wang, L. Song, X. Zhu, and M. Huang, “JointGT: Graph-text joint representation learning for text generation from knowledge graphs,” in Find. Assoc. Comput. Linguist.: ACL-IJCNLP, 2021, pp. 2526–2538.
  156. M. Yasunaga, A. Bosselut, H. Ren, X. Zhang, C. D. Manning, P. S. Liang, and J. Leskovec, “Deep bidirectional language-knowledge graph pretraining,” Adv. Neural Inf. Process. Syst., vol. 35, pp. 37 309–37 323, 2022.
  157. F.-Y. Wang, “Parallel system methods for management and control of complex systems,” Control Decis., vol. 19, pp. 485–489, 2004.
  158. F.-Y. Wang, X. Wang, L. Li, and L. Li, “Steps toward parallel intelligence,” IEEE/CAA J. of Autom. Sin., vol. 3, no. 4, pp. 345–348, 2016.
  159. Y. Cao, Y. Wang, J. Wang, Y. Tian, X. Wang, and F.-Y. Wang, “Parameter identification and refinement for parallel PCB inspection in cyber–physical–social systems,” IEEE Trans. Comput. Soc. Syst., 2023.
  160. F.-Y. Wang, Y. Gao, X. Shang et al., “Parallel manufacturing and industries 5.0: From virtual manufacturing to intelligent manufacturing,” Sci.Technol. Rev., vol. 36, no. 21, pp. 10–22, 2018.
  161. L. Li, X. Wang, and X. Shang, “Parallel manufacturing for textile, footwear and garment industries,” Sci. Technol. Rev., vol. 36, no. 21, pp. 48–55, 2018.
  162. L. Li, P. Sun, and J. Lu, “Distributed manufacturing in knitting industry,” in Proc. IEEE Int. Conf. Digit. Twins Parallel Intell.   IEEE, 2021, pp. 74–77.
  163. J. Yang, X. Wang, and Y. Zhao, “Parallel manufacturing for industrial metaverses: A new paradigm in smart manufacturing,” IEEE/CAA J. of Autom. Sin., vol. 9, no. 12, pp. 2063–2070, 2022.
  164. J. Yang, S. Li, X. Wang, J. Lu, H. Wu, and X. Wang, “Defact in manuverse for parallel manufacturing: Foundation models and parallel workers in smart factories,” IEEE Trans. Syst. Man Cybern. Syst., vol. 53, no. 4, pp. 2188–2199, 2022.
  165. M. Jogin, M. Madhulika, G. Divya, R. Meghana, S. Apoorva et al., “Feature extraction using convolution neural networks (cnn) and deep learning,” in IEEE Int. Conf. Recent Trends Electron., Inf. Commun. Technol.,.   IEEE, 2018, pp. 2319–2323.
  166. A. Tabassum and R. R. Patil, “A survey on text pre-processing & feature extraction techniques in natural language processing,” Int. Res. J. Eng. Technol., vol. 7, no. 06, pp. 4864–4867, 2020.
  167. A. Jaegle, F. Gimeno, A. Brock, O. Vinyals, A. Zisserman, and J. Carreira, “Perceiver: General perception with iterative attention,” in Proc. Mach. Learn. Res., 2021, pp. 4651–4664.
  168. H. Yinglei, Q. Dexin, and Z. Shengyuan, “Smart transportation travel model based on multiple data sources fusion for defense systems,” Soft Comput., vol. 26, no. 7, pp. 3247–3259, 2022.
  169. Q. Liu, M. Liu, H. Zhou, F. Yan, Y. Ma, and W. Shen, “Intelligent manufacturing system with human-cyber-physical fusion and collaboration for process fine control,” J. Manuf. Syst., vol. 64, pp. 149–169, 2022.
  170. Y. Li, H. Jia, J. Qi, H. Sun, X. Tian, H. Liu, and X. Fan, “An acquisition method of agricultural equipment roll angle based on multi-source information fusion,” Sensors, vol. 20, no. 7, p. 2082, 2020.
  171. T. Choudhary, V. Mishra, A. Goswami, and J. Sarangapani, “A comprehensive survey on model compression and acceleration,” Artif. Intell. Rev., vol. 53, pp. 5113–5155, 2020.
  172. J. Feng, L. T. Yang, N. J. Gati, X. Xie, and B. S. Gavuna, “Privacy-preserving computation in cyber-physical-social systems: A survey of the state-of-the-art and perspectives,” Inf. Sci., vol. 527, pp. 341–355, 2020.
  173. M. Al-Hawawreh and M. S. Hossain, “A privacy-aware framework for detecting cyber attacks on internet of medical things systems using data fusion and quantum deep learning,” Inf. Fusion, p. 101889, 2023.
  174. J. Feng, L. T. Yang, B. Ren, D. Zou, M. Dong, and S. Zhang, “Tensor recurrent neural network with differential privacy,” IEEE Trans. Comput., 2023.
  175. P. Zhang, X. Cheng, S. Su, and N. Wang, “Task allocation under geo-indistinguishability via group-based noise addition,” IEEE Trans. Big Data, vol. 9, no. 3, pp. 860–877, 2022.
  176. ——, “Effective truth discovery under local differential privacy by leveraging noise-aware probabilistic estimation and fusion,” Knowl. Based Syst., vol. 261, p. 110213, 2023.
  177. X. Zhou, Q. Yang, Q. Liu, W. Liang, K. Wang, Z. Liu, J. Ma, and Q. Jin, “Spatial-temporal federated transfer learning with multi-sensor data fusion for cooperative positioning,” Inf. Fusion, p. 102182, 2023.
  178. N. Díaz-Rodríguez, J. Del Ser, M. Coeckelbergh, M. L. de Prado, E. Herrera-Viedma, and F. Herrera, “Connecting the dots in trustworthy artificial intelligence: From AI principles, ethics, and key requirements to responsible AI systems and regulation,” Inf. Fusion, p. 101896, 2023.
  179. P. Qi, D. Chiaro, and F. Piccialli, “FL-FD: Federated learning-based fall detection with multimodal data fusion,” Inf. Fusion, p. 101890, 2023.
  180. L. T. Yang, R. Zhao, D. Liu, W. Lu, and X. Deng, “Tensor-empowered federated learning for cyber-physical-social computing and communication systems,” IEEE Commun. Surv. Tutor., vol. 25, no. 3, pp. 1909–1940, 2023.
  181. Y. Yuan and F.-Y. Wang, “Blockchain and cryptocurrencies: Model, techniques, and applications,” IEEE Trans. Syst. Man Cybern. Syst., vol. 48, no. 9, pp. 1421–1428, 2018.
  182. C. Xu, H. Wu, H. Liu, W. Gu, Y. Li, and D. Cao, “Blockchain-oriented privacy protection of sensitive data in the internet of vehicles,” IEEE Trans. Intell. Veh., vol. 8, no. 2, pp. 1057–1067, 2023.
  183. J. Li, J. Li et al., “Multi-blockchain based data trading markets with novel pricing mechanisms,” IEEE/CAA J. of Autom. Sin., vol. 10, no. 12, pp. 2222––2232, 2023.
  184. S. Wang, L. Ouyang et al., “Blockchain-enabled smart contracts: architecture, applications, and future trends,” IEEE Trans. Syst. Man Cybern. Syst., vol. 49, no. 11, pp. 2266–2277, 2019.
  185. J. Leng, X. Zhu et al., “Manuchain ii: Blockchained smart contract system as the digital twin of decentralized autonomous manufacturing toward resilience in industry 5.0,” IEEE Trans. Syst. Man Cybern. Syst., vol. 53, no. 8, pp. 4715–4728, 2023.
  186. S. Wang, Y. Yuan et al., “An overview of smart contract: Architecture, applications, and future trends,” in IEEE Intell. Veh. Symp. Proc.   IEEE, 2018, pp. 108–113.
Citations (8)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up

Tweets

Sign up for free to view the 2 tweets with 0 likes about this paper.

Sign Up for Free