Mid-level Feature Extraction Method Based Transfer Learning to Small-Scale Dataset of Medical Images with Visualizing Analysis


Dong-Ho Lee, Yan Li, and Byeong-Seok Shin, Journal of Information Processing Systems Vol. 16, No. 6, pp. 1293-1308, Dec. 2020  

10.3745/JIPS.04.0194
Keywords: feature extraction, Medical Imaging, Transfer Learning
Fulltext:

Abstract

In fine-tuning-based transfer learning, the size of the dataset may affect learning accuracy. When a dataset scale is small, fine-tuning-based transfer-learning methods use high computing costs, similar to a large-scale dataset. We propose a mid-level feature extractor that retrains only the mid-level convolutional layers, resulting in increased efficiency and reduced computing costs. This mid-level feature extractor is likely to provide an effective alternative in training a small-scale medical image dataset. The performance of the mid-level feature extractor is compared with the performance of low- and high-level feature extractors, as well as the fine-tuning method. First, the mid-level feature extractor takes a shorter time to converge than other methods do. Second, it shows good accuracy in validation loss evaluation. Third, it obtains an area under the ROC curve (AUC) of 0.87 in an untrained test dataset that is very different from the training dataset. Fourth, it extracts more clear feature maps about shape and part of the chest in the X-ray than fine-tuning method.


Statistics
Show / Hide Statistics

Statistics (Cumulative Counts from November 1st, 2017)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.




Cite this article
[APA Style]
Dong-Ho Lee, Yan Li, & and Byeong-Seok Shin (2020). Mid-level Feature Extraction Method Based Transfer Learning to Small-Scale Dataset of Medical Images with Visualizing Analysis. Journal of Information Processing Systems, 16(6), 1293-1308. DOI: 10.3745/JIPS.04.0194.

[IEEE Style]
D. Lee, Y. Li and a. B. Shin, "Mid-level Feature Extraction Method Based Transfer Learning to Small-Scale Dataset of Medical Images with Visualizing Analysis," Journal of Information Processing Systems, vol. 16, no. 6, pp. 1293-1308, 2020. DOI: 10.3745/JIPS.04.0194.

[ACM Style]
Dong-Ho Lee, Yan Li, and and Byeong-Seok Shin. 2020. Mid-level Feature Extraction Method Based Transfer Learning to Small-Scale Dataset of Medical Images with Visualizing Analysis. Journal of Information Processing Systems, 16, 6, (2020), 1293-1308. DOI: 10.3745/JIPS.04.0194.