Chinese Medical Sciences Journal ›› 2022, Vol. 37 ›› Issue (3): 171-180.doi: 10.24920/004135

• Scientific Data Sharing and Reuse:Original Article •     Next Articles

Semi-supervised Long-tail Endoscopic Image Classification

Runnan Cao1, 2, Mengjie Fang1, 2, Hailing Li3, Jie Tian2, 3, 4, Di Dong1, 2, *()   

  1. 1School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China
    2CAS Key Laboratory of Molecular Imaging, Beijing Key Laboratory of Molecular Imaging, the State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
    3Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, School of Engineering Medicine, Beihang University, Beijing 100191, China
    4Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, School of Life Science and Technology, Xidian University, Xi’an 710126, China
  • Received:2022-06-30 Accepted:2022-09-09 Published:2022-09-30 Online:2022-09-27
  • Contact: Di Dong E-mail:di.dong@ia.ac.cn
Semi-supervised learning is more suitable for real-world applications and has become a hot new direction in the field of deep learning in recent years. The authors explored semi-supervised long-tail endoscopic image classification in HyperKvasir and found that semi-supervised learning algorithms can improve the classification performance for semi-supervised long-tail endoscopic image classification, especially when the labeled data is extremely limited, which may benefit the building of assisted diagnosis systems for low-volume hospitals.

Objective To explore the semi-supervised learning (SSL) algorithm for long-tail endoscopic image classification with limited annotations.
Method We explored semi-supervised long-tail endoscopic image classification in HyperKvasir, the largest gastrointestinal public dataset with 23 diverse classes. Semi-supervised learning algorithm FixMatch was applied based on consistency regularization and pseudo-labeling. After splitting the training dataset and the test dataset at a ratio of 4:1, we sampled 20%, 50%, and 100% labeled training data to test the classification with limited annotations.
Results The classification performance was evaluated by micro-average and macro-average evaluation metrics, with the Mathews correlation coefficient (MCC) as the overall evaluation. SSL algorithm improved the classification performance, with MCC increasing from 0.8761 to 0.8850, from 0.8983 to 0.8994, and from 0.9075 to 0.9095 with 20%, 50%, and 100% ratio of labeled training data, respectively. With a 20% ratio of labeled training data, SSL improved both the micro-average and macro-average classification performance; while for the ratio of 50% and 100%, SSL improved the micro-average performance but hurt macro-average performance. Through analyzing the confusion matrix and labeling bias in each class, we found that the pseudo-based SSL algorithm exacerbated the classifier’s preference for the head class, resulting in improved performance in the head class and degenerated performance in the tail class.
Conclusion SSL can improve the classification performance for semi-supervised long-tail endoscopic image classification, especially when the labeled data is extremely limited, which may benefit the building of assisted diagnosis systems for low-volume hospitals. However, the pseudo-labeling strategy may amplify the effect of class imbalance, which hurts the classification performance for the tail class.

Key words: endoscopic image, artificial intelligence, semi-supervised learning, long-tail distribution, image classification

Funding:

Copyright © 2021 Chinese Academy of Medical Sciences.  京公安备110402430088  京ICP备06002729号-1  Powered by Magtech.

Supervised by National Health Commission of the People's Republic of China

9 Dongdan Santiao, Dongcheng district, Beijing, 100730 China

Tel: 86-10-65105897  Fax:86-10-65133074 

E-mail: cmsj@cams.cn  www.cmsj.cams.cn

Copyright © 2018 Chinese Academy of Medical Sciences

All right reserved.

京公安备110402430088  京ICP备06002729号-1