Current Issue Cover

丁思静,孙中阳,孙延奎,王永革(清华大学计算机科学与技术系, 北京 100084;北京航空航天大学数学与系统科学学院, 北京 100191;清华大学计算机科学与技术系, 北京 100084;广东省大数据分析与处理重点实验室, 广州 510006)

摘 要
目的 主成分分析网络(PCANet)能提取图像的纹理特征,线性判别分析(LDA)提取的特征有类别区分性。本文结合这两种方法的优点,提出一种带线性判别分析的主成分分析网络(PCANet-LDA),用于视网膜光学相干断层扫描(OCT)图像中的老年性黄斑变性(AMD)、糖尿病性黄斑水肿(DME)及正常(NOR)这3类的全自动分类。方法 PCANet-LDA算法是在PCANet的基础上添加了LDA监督层,该层加入了类标签对特征进行监督投影。首先,对OCT视网膜图像进行去噪、二值化及对齐裁剪等一系列预处理,获得感兴趣的视网膜区域;然后,将预处理图像送入一个两层的PCA卷积层,训练PCA滤波器组并提取图像的PCA特征;接着,将PCA特征送入一个非线性输出层,通过二值散列和块直方图等处理,得到图像的特征;之后,将带有类标签的图像特征送入一个LDA监督层,学习LDA矩阵并用其对图像特征进行投影,使特征具有类别区分性;最后,将投影的特征送入线性支持向量机(SVM)中对分类器进行训练和分类。结果 实验分别在医院临床数据集和杜克数据集上进行,先对OCT图像预处理进行前后对比实验,然后对PCANet特征提取的有效性进行分析,最后对PCANet算法、ScSPM算法以及提出的PCANet-LDA3种分类算法的分类效果进行对比实验。在临床数据集上,PCANet-LDA算法的总体分类正确率为97.20%,高出PCANet算法3.77%,且略优于ScSPM算法;在杜克数据集上,PCANet-LDA算法的总体分类正确率为99.52%,高出PCANet算法1.64%,略优于ScSPM算法。结论 PCANet-LDA算法的分类正确率明显高于PCANet,且优于目前用于2D视网膜OCT图像分类的先进的ScSPM算法。因此,提出的PCANet-LDA算法在视网膜OCT图像的分类上是有效且先进的,可作为视网膜OCT图像分类的基准算法。
Combining principal component analysis network with linear discriminant analysis for the classification of retinal optical coherence tomography images

Ding Sijing,Sun Zhongyang,Sun Yankui,Wang Yongge(Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China;School of Mathematics and Systems Science, Beihang University, Beijing 100191, China;Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China;Guangdong Key Laboratory of Big Data Analysis and Processing, Guangzhou 510006, China)

Objective Optical coherence tomography (OCT) is a 3D scanning imaging technology that has been widely used in ophthalmology as a clinical auxiliary to identify various eye lesions. Therefore, the classification technique of retinal OCT images is greatly important for the detection and treatment of retinopathy. Many effective OCT classification algorithms have been recently developed, and almost all these have artificial design features; however, retinal OCT images acquired from clinic usually contains a complex pathological structure. Therefore, the features from OCT images must be directly learned. Principal component analysis network (PCANet) is a simple version of convolutional neural network, which can directly extract the texture features of images, whereas features extracted by linear discriminant analysis (LDA) are more distinguishable for image classification. Combining the advantages of these two methods, this paper presents a PCANet with LDA (PCANet-LDA) for the automatic classification of three types of retinal OCT images, including age-related macular degeneration (AMD), diabetic macular edema (DME), and normal (NOR). Method The proposed PCANet-LDA algorithm adds an LDA supervisory layer based on the PCANet to allow the supervision of extracted image features by class labels. This algorithm can be implemented in three steps. The first step is the OCT image preprocessing, which involves a series of preprocessing including perceiving, fitting, and normalizing stages on retinal OCT images to obtain an interested retinal region for image classification. The second step is the PCANet feature extraction, where the preprocessed OCT images are sent into a PCA convolution layer with two stages and a nonlinear output layer. In the PCA convolution layer, PCA filter banks are learned, and the PCA features of retinal OCT images can be extracted. In the nonlinear output layer, the extracted PCA features are translated to PCANet features of the input images by some basic data-processing components, including binary hashing and blockwise histograms. The third step is the LDA supervisory layer, which uses the LDA idea to learn an LDA matrix from the PCANet features with class labels of AMD, DME, and NOR. Then, the LDA matrix is used to project PCANet features into a low-dimensional space to make the projected features more distinguishable for classification. Finally, the projected features are used to train a linear support vector machine and classify the retinal OCT images. Result Both experiments are done on two retinal OCT dataset, including the clinic dataset obtained from a hospital and Duke dataset. First, the comparative examples of AMD, DME and NOR retinal OCT images before and after preprocessing shows that the image preprocessing cuts out the non-retinal regions in the OCT image, leaving the meaningful retinal areas. Moreover, the remaining retina is rotated to a unified horizontal state to reduce the impact of inconsistent direction of retina on classification. Then, the sample PCANet feature maps extracted from AMD and DME retinal OCT images show that the PCA filter trained by PCANet tends to capture meaningful pathological structure information, which contributes to the classification of retinal OCT images. Finally, the correct classification rates of the PCANet algorithm, the ScSPM algorithm, and the PCANet-LDA algorithm proposed in this paper are compared. On the clinic dataset, the overall correct classification rate of the PCANet-LDA algorithm is 97.20%, which is 3.77% higher than that of the PCANet algorithm and slightly higher than that of the ScSPM algorithm. On the Duke dataset, the overall correct classification rate of the PCANet-LDA algorithm is 99.52%, which is 1.64% higher than that of the PCANet algorithm and a slightly higher than that of the ScSPM algorithm. Conclusion The PCANet algorithm can extract effective features. Accordingly, the PCANet-LDA algorithm obtains more distinguishing features by LDA method, to yield a higher correct classification rate than that of the PCANet and ScSPM algorithms; the latter is a state-of-the-art two-dimensional OCT image classification of the retina. Therefore, the proposed PCANet-LDA algorithm is effective, advanced in the classification of retinal OCT images, and can be a baseline algorithm for retinal OCT image classification.