A Polarization and Radiomics Feature Fusion Network for the Classification of Hepatocellular Carcinoma and Intrahepatic Cholangiocarcinoma
Abstract: Classifying hepatocellular carcinoma (HCC) and intrahepatic cholangiocarcinoma (ICC) is a critical step in treatment selection and prognosis evaluation for patients with liver diseases. Traditional histopathological diagnosis poses challenges in this context. In this study, we introduce a novel polarization and radiomics feature fusion network, which combines polarization features obtained from Mueller matrix images of liver pathological samples with radiomics features derived from corresponding pathological images to classify HCC and ICC. Our fusion network integrates a two-tier fusion approach, comprising early feature-level fusion and late classification-level fusion. By harnessing the strengths of polarization imaging techniques and image feature-based machine learning, our proposed fusion network significantly enhances classification accuracy. Notably, even at reduced imaging resolutions, the fusion network maintains robust performance due to the additional information provided by polarization features, which may not align with human visual perception. Our experimental results underscore the potential of this fusion network as a powerful tool for computer-aided diagnosis of HCC and ICC, showcasing the benefits and prospects of integrating polarization imaging techniques into the current image-intensive digital pathological diagnosis. We aim to contribute this innovative approach to top-tier journals, offering fresh insights and valuable tools in the fields of medical imaging and cancer diagnosis. By introducing polarization imaging into liver cancer classification, we demonstrate its interdisciplinary potential in addressing challenges in medical image analysis, promising advancements in medical imaging and cancer diagnosis.
- B. S. Chhikara and K. Parang, “Global cancer statistics 2022: the trends projection analysis,” Chemical Biology Letters, vol. 10, no. 1, pp. 451–451, 2023.
- X.-D. Zhou, Z.-Y. Tang, J. Fan, J. Zhou, Z.-Q. Wu, L.-X. Qin, Z.-C. Ma, H.-C. Sun, S.-J. Qiu, Y. Yu et al., “Intrahepatic cholangiocarcinoma: report of 272 patients compared with 5,829 patients with hepatocellular carcinoma,” Journal of cancer research and clinical oncology, vol. 135, pp. 1073–1080, 2009.
- S. M. Weber, D. Ribero, E. M. O’Reilly, N. Kokudo, M. Miyazaki, and T. M. Pawlik, “Intrahepatic cholangiocarcinoma: expert consensus statement,” Hpb, vol. 17, no. 8, pp. 669–680, 2015.
- M. Komuta, “Histological heterogeneity of primary liver cancers: clinical relevance, diagnostic pitfalls and the pathologist’s role,” Cancers, vol. 13, no. 12, p. 2871, 2021.
- T. El Jabbour, S. M. Lagana, and H. Lee, “Update on hepatocellular carcinoma: Pathologists’ review,” World journal of gastroenterology, vol. 25, no. 14, p. 1653, 2019.
- D. T. Timek, J. Shi, H. Liu, and F. Lin, “Arginase-1, heppar-1, and glypican-3 are the most effective panel of markers in distinguishing hepatocellular carcinoma from metastatic tumor on fine-needle aspiration specimens,” American journal of clinical pathology, vol. 138, no. 2, pp. 203–210, 2012.
- J. Hu, R. Yuan, C. Huang, J. Shao, S. Zou, and K. Wang, “Double primary hepatic cancer (hepatocellular carcinoma and intrahepatic cholangiocarcinoma) originating from hepatic progenitor cell: a case report and review of the literature,” World Journal of Surgical Oncology, vol. 14, pp. 1–7, 2016.
- X.-Y. Lu, T. Xi, W.-Y. Lau, H. Dong, Z. Zhu, F. Shen, M.-C. Wu, and W.-M. Cong, “Hepatocellular carcinoma expressing cholangiocyte phenotype is a novel subtype with highly aggressive behavior,” Annals of surgical oncology, vol. 18, pp. 2210–2217, 2011.
- S. Tsunematsu, M. Chuma, T. Kamiyama, N. Miyamoto, S. Yabusaki, K. Hatanaka, T. Mitsuhashi, H. Kamachi, H. Yokoo, T. Kakisaka et al., “Intratumoral artery on contrast-enhanced computed tomography imaging: differentiating intrahepatic cholangiocarcinoma from poorly differentiated hepatocellular carcinoma,” Abdominal imaging, vol. 40, pp. 1492–1499, 2015.
- A. Midya, J. Chakraborty, L. M. Pak, J. Zheng, W. R. Jarnagin, R. K. Do, and A. L. Simpson, “Deep convolutional neural network for the classification of hepatocellular carcinoma and intrahepatic cholangiocarcinoma,” vol. 10575, pp. 501–506, 2018.
- Q. Wang, Z. Wang, Y. Sun, X. Zhang, W. Li, Y. Ge, X. Huang, Y. Liu, and Y. Chen, “Sccnn: a diagnosis method for hepatocellular carcinoma and intrahepatic cholangiocarcinoma based on siamese cross contrast neural network,” IEEE Access, vol. 8, pp. 85 271–85 283, 2020.
- P. Wan, H. Xue, C. Liu, F. Chen, W. Shao, J. Qin, W. Kong, and D. Zhang, “Transport-based anatomical-functional metric learning for liver tumor recognition using dual-view dynamic ceus imaging,” IEEE Transactions on Biomedical Engineering, vol. 70, no. 3, pp. 1012–1023, 2022.
- Y. Wei, F. Gao, D. Zheng, Z. Huang, M. Wang, F. Hu, C. Chen, T. Duan, J. Chen, L. Cao et al., “Intrahepatic cholangiocarcinoma in the setting of hbv-related cirrhosis: Differentiation with hepatocellular carcinoma by using intravoxel incoherent motion diffusion-weighted mr imaging,” Oncotarget, vol. 9, no. 8, p. 7975, 2018.
- M. D. Zarella, D. Bowman, F. Aeffner, N. Farahani, A. Xthona, S. F. Absar, A. Parwani, M. Bui, and D. J. Hartman, “A practical guide to whole slide imaging: a white paper from the digital pathology association,” Archives of pathology & laboratory medicine, vol. 143, no. 2, pp. 222–234, 2019.
- B. Acs, M. Rantalainen, and J. Hartman, “Artificial intelligence as the next step towards precision pathology,” Journal of internal medicine, vol. 288, no. 1, pp. 62–81, 2020.
- K. Bera, K. A. Schalper, D. L. Rimm, V. Velcheti, and A. Madabhushi, “Artificial intelligence in digital pathology—new tools for diagnosis and precision oncology,” Nature reviews Clinical oncology, vol. 16, no. 11, pp. 703–715, 2019.
- A. S. Panayides, A. Amini, N. D. Filipovic, A. Sharma, S. A. Tsaftaris, A. Young, D. Foran, N. Do, S. Golemati, T. Kurc et al., “Ai in medical imaging informatics: current challenges and future directions,” IEEE journal of biomedical and health informatics, vol. 24, no. 7, pp. 1837–1857, 2020.
- Y. Rivenson, H. Wang, Z. Wei, K. de Haan, Y. Zhang, Y. Wu, H. Günaydın, J. E. Zuckerman, T. Chong, A. E. Sisk et al., “Virtual histological staining of unlabelled tissue-autofluorescence images via deep learning,” Nature biomedical engineering, vol. 3, no. 6, pp. 466–477, 2019.
- Y. Zhao, M. Reda, K. Feng, P. Zhang, G. Cheng, Z. Ren, S. G. Kong, S. Su, H. Huang, and J. Zang, “Detecting giant cell tumor of bone lesions using mueller matrix polarization microscopic imaging and multi-parameters fusion network,” IEEE Sensors Journal, vol. 20, no. 13, pp. 7208–7215, 2020.
- Y. Dong, J. Wan, X. Wang, J.-H. Xue, J. Zou, H. He, P. Li, A. Hou, and H. Ma, “A polarization-imaging-based machine learning framework for quantitative pathological diagnosis of cervical precancerous lesions,” IEEE Transactions on Medical Imaging, vol. 40, no. 12, pp. 3728–3738, 2021.
- E. Du, H. He, N. Zeng, M. Sun, Y. Guo, J. Wu, S. Liu, and H. Ma, “Mueller matrix polarimetry for differentiating characteristic features of cancerous tissues,” Journal of biomedical optics, vol. 19, no. 7, pp. 076 013–076 013, 2014.
- Y. Dong, H. He, C. He, J. Zhou, N. Zeng, and H. Ma, “Characterizing the effects of washing by different detergents on the wavelength-scale microstructures of silk samples using mueller matrix polarimetry,” International journal of molecular sciences, vol. 17, no. 8, p. 1301, 2016.
- Y. Shen, R. Huang, H. He, S. Liu, Y. Dong, J. Wu, and H. Ma, “Comparative study of the influence of imaging resolution on linear retardance parameters derived from the mueller matrix,” Biomedical Optics Express, vol. 12, no. 1, pp. 211–225, 2021.
- C. He, H. He, J. Chang, B. Chen, H. Ma, and M. J. Booth, “Polarisation optics for biomedical and clinical applications: a review,” Light: Science & Applications, vol. 10, no. 1, p. 194, 2021.
- N. Ghosh and I. A. Vitkin, “Tissue polarimetry: concepts, challenges, applications, and outlook,” Journal of biomedical optics, vol. 16, no. 11, pp. 110 801–110 801, 2011.
- S.-Y. Lu and R. A. Chipman, “Interpretation of mueller matrices based on polar decomposition,” JOSA A, vol. 13, no. 5, pp. 1106–1113, 1996.
- H. He, N. Zeng, E. Du, Y. Guo, D. Li, R. Liao, and H. Ma, “A possible quantitative mueller matrix transformation technique for anisotropic scattering media/eine mögliche quantitative müller-matrix-transformations-technik für anisotrope streuende medien,” Photonics & Lasers in Medicine, vol. 2, no. 2, pp. 129–137, 2013.
- H. He, R. Liao, N. Zeng, P. Li, Z. Chen, X. Liu, and H. Ma, “Mueller matrix polarimetry—an emerging new tool for characterizing the microstructural feature of complex biological specimen,” Journal of Lightwave Technology, vol. 37, no. 11, pp. 2534–2548, 2018.
- P. Li, D. Lv, H. He, and H. Ma, “Separating azimuthal orientation dependence in polarization measurements of anisotropic media,” Optics express, vol. 26, no. 4, pp. 3791–3800, 2018.
- Y. Wang, H. He, J. Chang, N. Zeng, S. Liu, M. Li, and H. Ma, “Differentiating characteristic microstructural features of cancerous tissues using mueller matrix microscope,” Micron, vol. 79, pp. 8–15, 2015.
- Y. Wang, H. He, J. Chang, C. He, S. Liu, M. Li, N. Zeng, J. Wu, and H. Ma, “Mueller matrix microscope: a quantitative tool to facilitate detections and fibrosis scorings of liver cirrhosis and cancer tissues,” Journal of biomedical optics, vol. 21, no. 7, pp. 071 112–071 112, 2016.
- Y. Dong, J. Qi, H. He, C. He, S. Liu, J. Wu, D. S. Elson, and H. Ma, “Quantitatively characterizing the microstructural features of breast ductal carcinoma tissues in different progression stages by mueller matrix microscope,” Biomedical optics express, vol. 8, no. 8, pp. 3643–3655, 2017.
- A. Pierangelo, A. Benali, M.-R. Antonelli, T. Novikova, P. Validire, B. Gayet, and A. De Martino, “Ex-vivo characterization of human colon cancer by mueller polarimetric imaging,” Optics express, vol. 19, no. 2, pp. 1582–1593, 2011.
- Y. Dong, J. Wan, L. Si, Y. Meng, Y. Dong, S. Liu, H. He, and H. Ma, “Deriving polarimetry feature parameters to characterize microstructural features in histological sections of breast tissues,” IEEE Transactions on Biomedical Engineering, vol. 68, no. 3, pp. 881–892, 2020.
- Y. Liu, Y. Dong, L. Si, R. Meng, Y. Dong, and H. Ma, “Comparison between image texture and polarization features in histopathology,” Biomedical Optics Express, vol. 12, no. 3, pp. 1593–1608, 2021.
- P. Lambin, E. Rios-Velazquez, R. Leijenaar, S. Carvalho, R. G. Van Stiphout, P. Granton, C. M. Zegers, R. Gillies, R. Boellard, A. Dekker et al., “Radiomics: extracting more information from medical images using advanced feature analysis,” European journal of cancer, vol. 48, no. 4, pp. 441–446, 2012.
- R. J. Gillies, P. E. Kinahan, and H. Hricak, “Radiomics: images are more than pictures, they are data,” Radiology, vol. 278, no. 2, pp. 563–577, 2016.
- H. J. Aerts, E. R. Velazquez, R. T. Leijenaar, C. Parmar, P. Grossmann, S. Carvalho, J. Bussink, R. Monshouwer, B. Haibe-Kains, D. Rietveld et al., “Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach,” Nature communications, vol. 5, no. 1, p. 4006, 2014.
- C. Parmar, P. Grossmann, J. Bussink, P. Lambin, and H. J. Aerts, “Machine learning methods for quantitative radiomic biomarkers,” Scientific reports, vol. 5, no. 1, p. 13087, 2015.
- T. Huang, R. Meng, J. Qi, Y. Liu, X. Wang, Y. Chen, R. Liao, and H. Ma, “Fast mueller matrix microscope based on dual dofp polarimeters,” Optics letters, vol. 46, no. 7, pp. 1676–1679, 2021.
- E. Garcia-Caurel, R. Ossikovski, M. Foldyna, A. Pierangelo, B. Drévillon, and A. De Martino, “Advanced mueller ellipsometry instrumentation and data analysis,” Ellipsometry at the Nanoscale, pp. 31–143, 2013.
- R. Shekhar and V. Zagrodsky, “Mutual information-based rigid and nonrigid registration of ultrasound volumes,” IEEE transactions on medical imaging, vol. 21, no. 1, pp. 9–22, 2002.
- B. Zitova and J. Flusser, “Image registration methods: a survey,” Image and vision computing, vol. 21, no. 11, pp. 977–1000, 2003.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.