volume | PIER Journals

Abstract

Alzheimer's disease (AD) is a brain degenerative disease, so the Magnetic Resonance Imaging (MRI) and Positron Emission Tomography (PET) of cerebral images are effective data in detecting the onset of the disease. In this work, a framework consisting of a cross attention multimodal fusion deep neural network and a patches weight optimization strategy is proposed. First, multiple points are randomly selected from the region of interest (ROI), and multiple 3-axial-plane patches are extracted centered on these points. Then, the patches from MRI and PET are fused using a fusion neural network to output diagnostic information for each patch. Finally, a weight is set for each patch; a particle swarm optimization algorithm is used to find the optimal weights for multiple patches; the diagnostic information from multiple patches is merged using these weights; and the final diagnostic results are output. The experiments on ADNI dataset show that this method has an accuracy of 94.03% in diagnosing AD and outperforms other methods of fusing MRI and PET data, which demonstrates the promising performance of this method.

1. Mank, Arenda, Judith J. M. Rijnhart, Ingrid S. van Maurik, Linus Jönsson, Ron Handels, Els D. Bakker, Charlotte E. Teunissen, Bart N. M. van Berckel, Argonde C. van Harten, Johannes Berkhof, and Wiesje M. van der Flier, "A longitudinal study on quality of life along the spectrum of Alzheimer's disease," Alzheimer's Research & Therapy, Vol. 14, No. 1, 132, Sep. 2022. Google Scholar

2. Rao, Y. Lakshmisha, B. Ganaraja, B. V. Murlimanju, Teresa Joy, Ashwin Krishnamurthy, and Amit Agrawal, "Hippocampus and its involvement in Alzheimer’s disease: A review," 3 Biotech, Vol. 12, No. 2, 55, Feb. 2022. Google Scholar

3. Chandra, Avinash, George Dervenoulas, and Marios Politis, "Magnetic resonance imaging in Alzheimer's disease and mild cognitive impairment," Journal of Neurology, Vol. 266, 1293-1302, Jun. 2019. Google Scholar

4. Moradi, Elaheh, Antonietta Pepe, Christian Gaser, Heikki Huttunen, and Jussi Tohka, "Machine learning framework for early MRI-based Alzheimer's conversion prediction in MCI subjects," Neuroimage, Vol. 104, 398-412, Jan. 2015. Google Scholar

5. Zheng, Xiaoming, "Detection of Alzheimer’s disease using hybrid meta-ROI of MRI structural images," Diagnostics, Vol. 14, No. 19, 2203, Oct. 2024. Google Scholar

6. Al Shehri, Waleed, "Alzheimer’s disease diagnosis and classification using deep learning techniques," PeerJ Computer Science, Vol. 8, e1177, Dec. 2022. Google Scholar

7. Ghosh, Tapotosh, Md. Istakiak Adnan Palash, Mohammad Abu Yousuf, Md. Abdul Hamid, Muhammad Mostafa Monowar, and Madini O. Alassafi, "A robust distributed deep learning approach to detect Alzheimer's Disease from MRI images," Mathematics, Vol. 11, No. 12, 2633, Jun. 2023. Google Scholar

8. Liu, Yuyang, Suvodeep Mazumdar, and Peter A. Bath, "An unsupervised learning approach to diagnosing Alzheimer's disease using brain magnetic resonance imaging scans," International Journal of Medical Informatics, Vol. 173, 105027, May 2023. Google Scholar

9. Chételat, Gaël, Javier Arbizu, Henryk Barthel, Valentina Garibotto, Ian Law, Silvia Morbelli, Elsmarieke van de Giessen, Federica Agosta, Frederik Barkhof, David J. Brooks, et al. "Amyloid-PET and 18F-FDG-PET in the diagnostic investigation of Alzheimer's disease and other dementias," The Lancet Neurology, Vol. 19, No. 11, 951-962, Nov. 2020. Google Scholar

10. De Santi, Lisa Anita, Elena Pasini, Maria Filomena Santarelli, Dario Genovesi, and Vincenzo Positano, "An explainable convolutional neural network for the early diagnosis of Alzheimer's disease from 18F-FDG PET," Journal of Digital Imaging, Vol. 36, No. 1, 189-203, Nov. 2023. Google Scholar

11. Bi, Sheng, Shaozhen Yan, Zhigeng Chen, Bixiao Cui, Yi Shan, Hongwei Yang, Zhigang Qi, Zhilian Zhao, Ying Han, and Jie Lu, "Comparison of 18F-FDG PET and arterial spin labeling MRI in evaluating Alzheimer's disease and amnestic mild cognitive impairment using integrated PET/MR," EJNMMI Research, Vol. 14, No. 1, 9, Jan. 2024. Google Scholar

12. Frings, Lars, Ganna Blazhenets, Joachim Brumberg, Alexander Rau, Horst Urbach, and Philipp T. Meyer, "Deformation-based morphometry applied to FDG PET data reveals hippocampal atrophy in Alzheimer's disease," Scientific Reports, Vol. 14, No. 1, 20030, Aug. 2024. Google Scholar

13. Beheshti, Iman, Natasha Geddert, Jarrad Perron, Vinay Gupta, Benedict C. Albensi, and Ji Hyun Ko, "Monitoring alzheimer's disease progression in mild cognitive impairment stage using machine learning-based FDG-PET classification methods," Journal of Alzheimer’s Disease, Vol. 89, No. 4, 1493-1502, 2022. Google Scholar

14. Hojjati, Seyed Hani and Abbas Babajani-Feremi, "Prediction and modeling of neuropsychological scores in Alzheimer's disease using multimodal neuroimaging data and artificial neural networks," Frontiers in Computational Neuroscience, Vol. 15, 769982, Jan. 2022. Google Scholar

15. Zhang, Jin, Xiaohai He, Yan Liu, Qingyan Cai, Honggang Chen, and Linbo Qing, "Multi-modal cross-attention network for Alzheimer's disease diagnosis with multi-modality data," Computers in Biology and Medicine, Vol. 162, 107050, Aug. 2023. Google Scholar

16. Salahuddin, Zohaib, Henry C. Woodruff, Avishek Chatterjee, and Philippe Lambin, "Transparency of deep neural networks for medical image analysis: A review of interpretability methods," Computers in Biology and Medicine, Vol. 140, 105111, Jan. 2022. Google Scholar

17. Litjens, Geert, Thijs Kooi, Babak Ehteshami Bejnordi, Arnaud Arindra Adiyoso Setio, Francesco Ciompi, Mohsen Ghafoorian, Jeroen A. W. M. van der Laak, Bram Van Ginneken, and Clara I. Sánchez, "A survey on deep learning in medical image analysis," Medical Image Analysis, Vol. 42, 60-88, Dec. 2017. Google Scholar

18. Xu, Wanni, You-Lei Fu, and Dongmei Zhu, "ResNet and its application to medical image processing: Research progress and challenges," Computer Methods and Programs in Biomedicine, Vol. 240, 107660, Oct. 2023. Google Scholar

19. Chen, Zixuan, Zewei He, and Zhe-Ming Lu, "DEA-Net: Single image dehazing based on detail-enhanced convolution and content-guided attention," IEEE Transactions on Image Processing, Vol. 33, 1002-1015, 2024. Google Scholar

20. Piotrowski, Adam P., Jaroslaw J. Napiorkowski, and Agnieszka E. Piotrowska, "Particle swarm optimization or differential evolution --- A comparison," Engineering Applications of Artificial Intelligence, Vol. 121, 106008, May 2023. Google Scholar

21. Pan, Yongsheng, Mingxia Liu, Chunfeng Lian, Yong Xia, and Dinggang Shen, "Spatially-constrained fisher representation for brain disease identification with incomplete multi-modal neuroimages," IEEE Transactions on Medical Imaging, Vol. 39, No. 9, 2965-2975, Sep. 2020. Google Scholar

22. Li, Jiaye, Hang Xu, Hao Yu, Zhihao Jiang, and Lei Zhu, "Multi-modal feature selection with anchor graph for Alzheimer's disease," Frontiers in Neuroscience, Vol. 16, 1036244, Nov. 2022. Google Scholar

23. Papaliagkas, Vasileios, Kallirhoe Kalinderi, Patroklos Vareltzis, Despoina Moraitou, Theodora Papamitsou, and Maria Chatzidimitriou, "CSF biomarkers in the early diagnosis of mild cognitive impairment and Alzheimer's disease," International Journal of Molecular Sciences, Vol. 24, No. 10, 8976, May 2023. Google Scholar

24. Sun, Yu-Ying, Zhun Wang, and Han-Chang Huang, "Roles of apoE4 on the pathogenesis in Alzheimer's disease and the potential therapeutic approaches," Cellular and Molecular Neurobiology, Vol. 43, No. 7, 3115-3136, May 2023. Google Scholar

Dr. Weiming Lin

Dr. Shumin Feng

Dr. Hongfeng Wu

Dr. Jinlin Ma