Current Issue Cover
基于多尺度密集残差网络的单幅图像超分辨率重建

应自炉,龙祥(五邑大学信息工程学院)

摘 要
目的 近几年应用在单幅图像超分辨率重建上的深度学习算法都是使用单种尺度的卷积核提取低分辨率图像的特征信息,这样很容易造成细节信息的遗漏。而且为了获得更好的图像超分辨率重建效果,网络模型也在不断的被加深,伴随而来的梯度消失问题会使得训练时间延长,难度加大。针对当前存在的这些超分辨率重建问题,本文结合GoogleNet思想、残差网络思想和密集型卷积网络思想,提出一种多尺度密集残差网络模型。方法 本文使用三种不同尺度卷积核对输入的低分辨率图像进行卷积处理,采集不同卷积核下的底层特征,这样可以较多的提取低分辨率图像上的细节信息,有利于图像的恢复。再将采集的特征信息输入残差块中。每个残差块都包含了多个由卷积层和激活层构成的特征提取单元。另外,每个特征提取单元的输出都会通过短路径连接到下一个特征提取单元。短路径连接可以有效的缓解梯度消失现象,加强特征传播,促进特征再利用。接下来,融合三种卷积核提取的特征信息,经过降维处理后与3x3的卷积核提取的特征信息相加形成全局残差学习。最后经过重建层,得到清晰的高分辨率图像。整个训练过程,一张输入的低分辨率图像对应着一张高分辨率图像标签,这种端到端的学习方法使得训练更加迅速。结果 本文使用两个客观评价标准PSNR(peak signal-to-noise ratio)和SSIM(structural similarity index)对实验的效果图进行测试,并与其他主流的方法进行对比。最终的结果显示,本文算法在Set5等多个测试数据集中的表现均高于插值法和SRCNN(Learning a deep convolutional network for image super-resolution)算法。结论 实验数据以及效果图证明本文算法能够较好的恢复低分辨率图像的边缘和纹理信息。
关键词
Single Image Super-resolution Construction based on Multi-scale Dense Residual Network

Zilu Ying,Long Xiang(School of Information Engineering,Wuyi University,Jiangmen)

Abstract
Objective Single image Super-Resolution aims to generate a visually pleasing high-resolution image from its degraded low-resolution measurement.Single image Super-Resolution is used in various computer vision tasks,such as security and surveillance imaging ,medical imaging,and image generation.While image Super-Resolution is ill posed inverse problem,since there exits a multitude of solutions for any low-resolution input.In recent years, a series of convolution neural networks model has been proposed for single image Super-Resolution.The deep learning algorithms applied to single image super-resolution reconstructions have used single-scale convolutional kernels to extract feature information of low-resolution images, which can easily cause omissions of detailed information. Moreover, in order to obtain better image super-resolution reconstruction effects, the network model is constantly being deepened, and the accompanying problems of gradients vanished will make the training time longer and more difficulty. Aiming at these existing super-resolution reconstruction problems, this paper proposes a multi-scale dense residual network model based on GoogleNet idea, residual network idea and intensive convolution network idea. Method Unlike the traditional single scale feature extraction convolutional kernel. The paper uses three different scales of convolution kernels 3x3,5x5,7x7 to perform convolution processing on the input low-resolution images, and collects the underlying features of different convolution kernels. This can extract more detailed information on low-resolution images, which is beneficial to the image. restore. Then the collected feature information is input into the residual block. Each residual block contains a number of feature extraction units consisting of a convolutional layer and an active layer. In addition, the output of each feature extraction unit is connected to the next feature extraction unit through a short path. Short-path connections can effectively alleviate the disappearance of gradients, enhance the propagation of features, and promote the reuse of features. Next, the feature information extracted by the three convolution kernels is merged, and the feature information extracted by the 3×3 convolution kernel is added after dimensionality reduction processing to form a global residual learning. After a final reconstruction, a clear, high-resolution image is obtained. Throughout the training process, an input low-resolution image corresponds to a high-resolution image tag. This end-to-end learning method makes training faster.We use mean squared error as the loss function.The loss is minimized using stochastic gradient descent with the standard backpropagation.We use a training data of 800 images from DIV2k,and the flipped and rotated versions of the training images are considered.We rotate the original images by 90° and 270°.Results This paper uses two objective evaluation criteria PSNR(peak signal-to-noise ratio) and SSIM(structural similarity index) to test the effect map of the experiment and compare it with other mainstream methods. The final results show that the performance of this algorithm in multiple test datasets such as Set5 is higher than that of interpolation and SRCNN(Learning a deep convolutional network for image super-resolution) algorithm. Conclusion We proposed a multi scale dense residual network for single image Super-Resolution.According to the experimental data and the effect graph, it proved that the proposed algorithm can better recover the edge and texture information of low-resolution images.However ,because of our algorithm use three channels to recover image details,so there are too many parameters in our networks.This results our algorithm need to more convergence time.We will reduce the number of weight parameters by decomposing the convolution kernel.
Keywords
QQ在线


订阅号|日报