volume | PIER Journals

Abstract

Aspiration pneumonia is a type of lung infection caused by the accidental inhalation of foreign substances into the respiratory tract. It is commonly seen in the elderly, young children, and individuals who are unconscious or have difficulty swallowing. Early detection and diagnosis of aspiration pneumonia are beneficial for improving patient outcomes and reducing the medical burden. In this study, we collected bronchoscopic video data from 25 patients in two hospitals. After image preprocessing and expert annotation, we obtained 2830 images from some patients for training and 1215 images from the other patients for validation. We selected three deep learning methods for training. The experimental test results for the identification of aspiration pneumonia showed that ResNet-50, which is based on convolutional operations, gave the best performance in the automatic identification of aspiration pneumonia, with a precision of 97.82%, a recall of 91.82%, an F1 score of 94.73%, and an overall accuracy of 95.88%. The experiments demonstrated that deep learning methods can be used for the automatic identification and diagnosis of aspiration pneumonia from bronchoscope images and deep learning is reported here for the first time for diagnosing aspiration pneumonia from bronchoscope images.

1. Son, Young Gon, Jungho Shin, and Ho Geol Ryu, "Pneumonitis and pneumonia after aspiration," Journal of Dental Anesthesia and Pain Medicine, Vol. 17, No. 1, 1, 2017.
doi:10.17245/jdapm.2017.17.1.1

2. Yoshimatsu, Yuki, Dorte Melgaard, Albert Westergren, Conni Skrubbeltrang, and David G. Smithard, "The diagnosis of aspiration pneumonia in older persons: A systematic review," European Geriatric Medicine, Vol. 13, No. 5, 1071-1080, 2022.

3. Torres, Antoni, Juan Serra-Batlles, Antoni Ferrer, Patricio Jiménez, Rosa Celis, Erik Cobo, and Robert Rodriguez-Roisin, "Severe community-acquired pneumonia," American Review of Respiratory Disease, Vol. 144, No. 2, 312, 1991.
doi:10.1164/ajrccm/144.2.312

4. Moine, Pierre, Jean-Baptiste Vercken, Sylvie Chevret, Claude Chastang, and Philippe Gajdos, "Severe community-acquired pneumonia: Etiology, epidemiology, and prognosis factors," Chest, Vol. 105, No. 5, 1487-1495, 1994.

5. Marrie, Thomas J., Heather Durant, and Linda Yates, "Community-acquired pneumonia requiring hospitalization: 5-year prospective study," Reviews of Infectious Diseases, Vol. 11, No. 4, 586-599, 1989.

6. Wang, Xiaohua, Yanfei Gao, Qiuyan Wang, et al., "Analysis and countermeasures of related factors for aspiration pneumonia in elderly patients," Chinese Journal of Nosocomiology, Vol. 24, No. 5, 1161-1162, 2014.

7. Mandell, Lionel A. and Michael S. Niederman, "Aspiration pneumonia," New England Journal of Medicine, Vol. 380, No. 7, 651-663, 2019.

8. Marik, Paul E., "Aspiration pneumonitis and aspiration pneumonia," New England Journal of Medicine, Vol. 344, No. 9, 665-671, 2001.

9. Miyashita, Naoyuki, Yasuhiro Kawai, Takaaki Tanaka, Hiroto Akaike, Hideto Teranishi, Tokio Wakabayashi, Takashi Nakano, Kazunobu Ouchi, and Niro Okimoto, "Detection failure rate of chest radiography for the identification of nursing and healthcare-associated pneumonia," Journal of Infection and Chemotherapy, Vol. 21, No. 7, 492-496, 2015.

10. Komiya, Kosaku, Hiroshi Ishii, Kenji Umeki, Tadao Kawamura, Fumito Okada, Eiji Okabe, Junji Murakami, Yukio Kato, Bunroku Matsumoto, Shinji Teramoto, et al., "Computed tomography findings of aspiration pneumonia in 53 patients," Geriatrics & Gerontology International, Vol. 13, No. 3, 580-585, 2013.

11. Shan, Kai, Dongmei Jia, and Wei Guo, "Diagnosis of stroke-associated pneumonia: Expert consensus of the stroke-associated pneumonia study group," Chinese Journal of Emergency Medicine, Vol. 24, No. 12, 1346-1348, 2015.

12. Darie, Andrei M. and Daiana Stolz, "Is there a role for bronchoscopy in aspiration pneumonia?," Seminars in Respiratory and Critical Care Medicine, Vol. 45, No. 6, 650-658, 2024.

13. Van der Maarel-Wierink, C. D., J. N. O. Vanobbergen, E. M. Bronkhorst, J. M. G. A. Schols, and C. de Baat, "Meta-analysis of dysphagia and aspiration pneumonia in frail elders," Journal of Dental Research, Vol. 90, No. 12, 1398-1404, 2011.

14. DiBardino, David M. and Richard G. Wunderink, "Aspiration pneumonia: A review of modern trends," Journal of Critical Care, Vol. 30, No. 1, 40-48, 2015.

15. Woodhead, M., F. Blasi, S. Ewig, J. Garau, G. Huchon, M. Ieven, A. Ortqvist, T. Schaberg, A. Torres, G. Van Der Heijden, et al., "Guidelines for the management of adult lower respiratory tract infections --- Full version," Clinical Microbiology and Infection, Vol. 17, No. Suppl. 6, E1-E59, 2011.

16. Faverio, Paola, Stefano Aliberti, Giuseppe Bellelli, Giulia Suigo, Sara Lonni, Alberto Pesci, and Marcos I. Restrepo, "The management of community-acquired pneumonia in the elderly," European Journal of Internal Medicine, Vol. 25, No. 4, 312-319, 2014.

17. Pace, Cherin C. and Gary H. McCullough, "The association between oral microorgansims and aspiration pneumonia in the institutionalized elderly: Review and recommendations," Dysphagia, Vol. 25, 307-322, 2010.

18. She, Jun, Jianwen Ding, and Jie Shen, "Expert recommendations on the diagnosis and treatment of aspiration pneumonia in adults," International Journal of Respiratory, Vol. 42, No. 2, 86-96, 2022.

19. Almirall, Jordi, Ramon Boixeda, Mari C. de la Torre, and Antoni Torres, "Aspiration pneumonia: A renewed perspective and practical approach," Respiratory Medicine, Vol. 185, 106485, 2021.

20. El-Solh, Ali A., Hardik Vora, Paul R. Knight III, and Jahan Porhomayon, "Diagnostic use of serum procalcitonin levels in pulmonary aspiration syndromes," Critical Care Medicine, Vol. 39, No. 6, 1251-1256, 2011.

21. Suzuki, T., M. Saitou, Y. Utano, K. Utano, and K. Niitsuma, "Bronchoalveolar lavage (BAL) amylase and pepsin levels as potential biomarkers of aspiration pneumonia," Pulmonology, Vol. 29, No. 5, 392-398, 2023.

22. Metlay, Joshua P., Grant W. Waterer, Ann C. Long, Antonio Anzueto, Jan Brozek, Kristina Crothers, Laura A. Cooley, Nathan C. Dean, Michael J. Fine, Scott A. Flanders, et al., "Diagnosis and treatment of adults with community-acquired pneumonia. An official clinical practice guideline of the American Thoracic Society and Infectious Diseases Society of America," American Journal of Respiratory and Critical Care Medicine, Vol. 200, No. 7, e45-e67, 2019.

23. Simpson, A. John, Jamie-Leigh Allen, Michelle Chatwin, Hannah Crawford, Joanna Elverson, Victoria Ewan, Julian Forton, Ronan McMullan, John Plevris, Kate Renton, et al., "BTS clinical statement on aspiration pneumonia," Thorax, Vol. 78, S3-S21, 2023.

24. Delforge, Quentin, Alexandre Gaudet, Pauline Boddaert, Frédéric Wallet, Benoit Voisin, and Saad Nseir, "Accuracy of the Infectious Diseases Society of America and British Thoracic Society criteria for acute pneumonia in differentiating chemical and bacterial complications of aspiration in comatose ventilated patients following drug poisoning," Antibiotics, Vol. 13, No. 6, 495, 2024.

25. Zhu, He, Jing Luo, Jiaqi Liao, and Sailing He, "High-accuracy rapid identification and classification of mixed bacteria using hyperspectral transmission microscopic imaging and machine learning," Progress In Electromagnetics Research, Vol. 178, 49-62, 2023.
doi:10.2528/PIER23082303

26. Weng, Donglei, Shuliang Dou, Haozhe Wang, Dawei Gong, Qun Wang, and Sailing He, "Infrared image segmentation method based on DeepLabV3+ for identifying key components of power transmission line," Progress In Electromagnetics Research C, Vol. 138, 191-203, 2023.
doi:10.2528/PIERC23081905

27. Xu, Zhanpeng, Yiming Jiang, Jiali Ji, Erik Forsberg, Yuanpeng Li, and Sailing He, "Classification, identification, and growth stage estimation of microalgae based on transmission hyperspectral microscopic imaging and machine learning," Optics Express, Vol. 28, No. 21, 30686-30700, 2020.

28. Zeng, Zhenjia, Qiangsheng Huang, and Sailing He, "Ai-based fast design for general fiber-to-waveguide grating couplers," Progress In Electromagnetics Research M, Vol. 119, 143-160, 2023.
doi:10.2528/PIERM23072703

29. Almirall, Jordi, Laia Rofes, Mateu Serra-Prat, Roser Icart, Elisabet Palomera, Viridiana Arreola, and Pere Clavé, "Oropharyngeal dysphagia is a risk factor for community-acquired pneumonia in the elderly," European Respiratory Journal, Vol. 41, No. 4, 923-928, 2013.
doi:10.1183/09031936.00019012

30. Zhuang, Biyu, Weishan Zheng, and Meng Zhang, "Construction of a prediction model for aspiration pneumonia in head and neck cancer patients receiving radiotherapy based on machine learning," China Modern Medicine, Vol. 26, No. 9, 56-61, 2024.

31. Sejdić, Ervin, Catriona M. Steele, and Tom Chau, "Classification of penetration-aspiration versus healthy swallows using dual-axis swallowing accelerometry signals in dysphagic subjects," IEEE Transactions on Biomedical Engineering, Vol. 60, No. 7, 1859-1866, 2013.

32. Weng, Weihao, Mitsuyoshi Imaizumi, Shigeyuki Murono, and Xin Zhu, "Expert-level aspiration and penetration detection during flexible endoscopic evaluation of swallowing with artificial intelligence-assisted diagnosis," Scientific Reports, Vol. 12, No. 1, 21689, 2022.

33. Imaizumi, Mitsuyoshi, Weihao Weng, Xin Zhu, and Shigeyuki Murono, "Effectiveness of FEES with artificial intelligence-assisted computer-aided diagnosis," Auris Nasus Larynx, Vol. 51, No. 2, 251-258, 2024.

34. Miura, Yuka, Gojiro Nakagami, K. Yabunaka, Haruka Tohara, Ryoko Murayama, Hiroshi Noguchi, Taketoshi Mori, and Hiromi Sanada, "Method for detecting aspiration based on image processing-assisted B-mode video ultrasonography," J. Nurs. Sci. Eng., Vol. 1, 2-20, 2014.

35. Sarraf Shirazi, Samaneh, Caitlin Buchel, Reesa Daun, Laura Lenton, and Zahra Moussavi, "Detection of swallows with silent aspiration using swallowing and breath sound analysis," Medical & Biological Engineering & Computing, Vol. 50, 1261-1268, 2012.

36. Sarraf Shirazi, Samaneh, Amir Hossein Birjandi, and Zahra Moussavi, "Noninvasive and automatic diagnosis of patients at high risk of swallowing aspiration," Medical & Biological Engineering & Computing, Vol. 52, 459-465, 2014.

37. Lee, Jong Taek and Eunhee Park, "Detection of the pharyngeal phase in the videofluoroscopic swallowing study using inflated 3D convolutional networks," 9th International Workshop on Machine Learning in Medical Imaging, MLMI 2018, 328-336, Granada, Spain, Sep. 2018.

38. He, Kaiming, Xiangyu Zhang, Shaoqing Ren, and Jian Sun, "Deep residual learning for image recognition," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 770-778, Las Vegas, NV, USA, 2016.

39. Tan, Mingxing and Quoc Le, "EfficientNet: Rethinking model scaling for convolutional neural networks," Proceedings of the 36th International Conference on Machine Learning, ICML 2019, 6105-6114, Long Beach, USA, Jun. 2019.

40. Touvron, Hugo, Matthieu Cord, Matthijs Douze, Francisco Massa, Alexandre Sablayrolles, and Herve Jégou, "Training data-efficient image transformers & distillation through attention," Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 10347-10357, online, Jul. 2021.

41. Farooq, Sajid and Denise Maria Zezell, "Diabetes monitoring through urine analysis using ATR-FTIR spectroscopy and machine learning," Chemosensors, Vol. 11, No. 11, 565, 2023.

42. MMPreTrain Contributors, "OpenMMLab's pre-training toolbox and benchmark," https://github.com/open-mmlab/mmpretrain, 2023.

Dr. Dawei Gong

Dr. Ke Cui

Dr. Weidong Wang

Dr. Xiaobo Chen

Dr. Chao Zhang

Dr. Haifei Xiang

Dr. Shaohua Zhang

Prof. Sailing He