CN115131226B - Image restoration method based on wavelet tensor low-rank regularization - Google Patents
Image restoration method based on wavelet tensor low-rank regularization Download PDFInfo
- Publication number
- CN115131226B CN115131226B CN202210339100.1A CN202210339100A CN115131226B CN 115131226 B CN115131226 B CN 115131226B CN 202210339100 A CN202210339100 A CN 202210339100A CN 115131226 B CN115131226 B CN 115131226B
- Authority
- CN
- China
- Prior art keywords
- image
- tensor
- wavelet
- matrix
- low
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/52—Scale-space analysis, e.g. wavelet analysis
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Image Processing (AREA)
Abstract
Description
技术领域Technical Field
本发明属于数字图像处理技术领域,它特别涉及构建三阶小波系数张量并利用张量核范数进行低秩约束的图像复原方法,用于对退化图像的高质量复原。The present invention belongs to the technical field of digital image processing, and particularly relates to an image restoration method that constructs a third-order wavelet coefficient tensor and uses the tensor nuclear norm to perform low-rank constraint, for high-quality restoration of degraded images.
背景技术Background technique
图像复原技术用于解决图像在获取、保存过程中发生的损坏、模糊等质量退化的问题,使得复原后的图像尽可能清晰,该技术已被广泛用于航天、医疗、数字通信等领域。图像复原的一般过程是对图像退化进行合理的数学建模,再结合退化图像自身的先验信息对其进行逆处理,从而恢复出高质量的复原图像。由于图像复原问题属于求解逆问题的范畴,该问题通常是病态的,难以获得唯一解,因此有效利用图像先验信息改进复原方法是该技术的研究热点。Image restoration technology is used to solve the quality degradation problems such as damage and blur that occur during the acquisition and storage of images, so that the restored image is as clear as possible. This technology has been widely used in aerospace, medical, digital communications and other fields. The general process of image restoration is to make a reasonable mathematical model of image degradation, and then perform inverse processing on the degraded image itself in combination with its own prior information, so as to restore a high-quality restored image. Since the image restoration problem belongs to the category of solving inverse problems, the problem is usually ill-posed and it is difficult to obtain a unique solution. Therefore, the effective use of image prior information to improve the restoration method is a research hotspot of this technology.
早期的基于全变分的图像复原模型,可保持图像良好的边缘特性同时有效抑制噪声,并且得到了广泛研究和应用。近年来,图像的非局部特性逐渐受到重视,也被应用到图像去噪等领域,并极大地提升了复原图像质量。考虑到图像的二维小波分解能通过不同子带系数捕捉图像的平滑、边缘、细节等多种特性,因此设计合适的正则项准确有效地利用图像各小波子带系数内与子带系数间的相关性,是改善图像复原质量的关键。Early image restoration models based on total variation can maintain good edge characteristics of images while effectively suppressing noise, and have been widely studied and applied. In recent years, the non-local characteristics of images have gradually received attention and have been applied to fields such as image denoising, greatly improving the quality of restored images. Considering that the two-dimensional wavelet decomposition of an image can capture the smoothness, edges, details and other characteristics of an image through different sub-band coefficients, designing appropriate regularization terms to accurately and effectively utilize the correlation between the coefficients of each wavelet sub-band and between the sub-band coefficients of the image is the key to improving the quality of image restoration.
发明内容Summary of the invention
本发明的目的在于针对基于正则化方法的图像复原模型存在的难点,提出一种基于小波张量低秩正则化的图像复原方法。该方法充分考虑小波系数内部的结构性与彼此间的相关性,将二维小波子带系数堆叠成一个三阶张量,并利用张量核范数对小波系数张量进行低秩约束,提高了对小波系数的估计精度。The purpose of the present invention is to propose an image restoration method based on low-rank regularization of wavelet tensors to address the difficulties of image restoration models based on regularization methods. The method fully considers the internal structure of wavelet coefficients and the correlation between each other, stacks the two-dimensional wavelet subband coefficients into a third-order tensor, and uses the tensor nuclear norm to perform low-rank constraints on the wavelet coefficient tensor, thereby improving the estimation accuracy of the wavelet coefficients.
具体包括以下步骤:The specific steps include:
(1)输入一幅大小的待复原的图像x,对x实施一层二维冗余小波分解,得到四个二维小波子带系数;(1) Input a The image x to be restored is subjected to a one-layer two-dimensional redundant wavelet decomposition to obtain four two-dimensional wavelet subband coefficients;
(2)将(1)中得到的四个二维小波子带系数以矩阵形式依次堆叠构成一个三阶张量 (2) The four two-dimensional wavelet subband coefficients obtained in (1) are stacked in matrix form to form a third-order tensor
(3)利用不同小波子带系数间较强的相关性,采用张量核范数对小波系数三阶张量进行低秩约束,并结合三阶张量的高阶奇异值分解,可表示为:(3) Taking advantage of the strong correlation between different wavelet subband coefficients, the tensor nuclear norm is used to constrain the third-order tensor of wavelet coefficients to a low rank. The high-order singular value decomposition of can be expressed as:
其中表示核心张量,U、V和W表示三个正交的奇异向量矩阵,×1、×2和×3分别表示Tucker模式-1积、Tucker模式-2积和Tucker模式-3积;基于此,三阶张量/>的核范数/>定义为其核心张量/>的一范数/>可表示为:in represents the core tensor, U, V and W represent three orthogonal singular vector matrices, × 1 , × 2 and × 3 represent Tucker mode-1 product, Tucker mode-2 product and Tucker mode-3 product respectively; based on this, the third-order tensor/> The nuclear norm of Defined as its core tensor/> The one-norm of It can be expressed as:
(4)在构建小波系数张量与定义张量核范数约束的基础上,建立起小波张量低秩约束下的图像复原模型:(4) Based on constructing the wavelet coefficient tensor and defining the tensor nuclear norm constraint, an image restoration model under the low-rank constraint of the wavelet tensor is established:
其中y表示退化图像,H表示退化矩阵,表示向量的二范数的平方,x表示待复原的图像,λ为正则化参数;为求解该复原模型,首先通过引入辅助变量/>将该复原模型改写成多元最小化问题:Where y represents the degraded image, H represents the degradation matrix, represents the square of the vector's bi-norm, x represents the image to be restored, and λ is the regularization parameter. To solve the restoration model, we first introduce auxiliary variables. Rewrite the restoration model as a multivariate minimization problem:
其中β为惩罚参数,为归一化的拉格朗日乘子,/>表示张量的Frobenius范数的平方;利用交替方向迭代算法对其求解,可将该多元最小化问题分解为关于待复原的图像x和小波系数张量/>的两个子问题,并进行交替迭代求解:Where β is the penalty parameter, is the normalized Lagrange multiplier,/> represents the square of the Frobenius norm of the tensor; using the alternating direction iterative algorithm to solve it, the multivariate minimization problem can be decomposed into the image x to be restored and the wavelet coefficient tensor/> Two sub-problems of , and solve them alternately and iteratively:
(4a)对于模型中的变量x,给定则复原模型变为求解关于待复原的图像x的子问题:(4a) For the variable x in the model, given Then the restoration model becomes a sub-problem of solving the image x to be restored:
其中表示第i个二维小波子带系数切片,/>表示/>对应的辅助变量,/>表示/>对应的归一化的拉格朗日乘子,该子问题是一个最小二乘问题,可直接通过矩阵求逆得到其闭合解;in represents the i-th two-dimensional wavelet subband coefficient slice,/> Indicates/> The corresponding auxiliary variables, /> Indicates/> The corresponding normalized Lagrange multiplier, this subproblem is a least squares problem, and its closed solution can be obtained directly by matrix inversion;
(4b)在得到待复原的图像x后,关于的子问题可表示为:(4b) After obtaining the image x to be restored, The sub-problem can be expressed as:
根据的高阶奇异值分解/>可将该子问题改写为关于/>U、V和W的多元最小化问题:according to Higher-order singular value decomposition of This sub-problem can be rewritten as about/> Multivariate minimization problem of U, V and W:
其中(·)T表示矩阵的转置,表示/>大小的单位矩阵,I4表示4×4大小的单位矩阵;该多元最小化问题可分解为关于各变量的子问题并进行交替求解;where (·) T represents the transpose of the matrix, Indicates/> The size of the identity matrix, I 4 represents the size of the identity matrix of 4×4; the multivariate minimization problem can be decomposed into sub-problems about each variable and solved alternately;
(5)重复步骤(4),直至相邻两次重构结果间变分小于迭代终止门限或满足最大迭代次数。(5) Repeat step (4) until the variation between two adjacent reconstruction results is less than the iteration termination threshold or the maximum number of iterations is met.
本发明的创新点是构建二维小波子带系数的三阶张量;利用张量核范数对小波系数张量进行低秩约束,提高对图像小波系数的估计精度;利用交替方向迭代算法求解小波张量低秩重构模型,并将该方法应用于退化图像的复原。The innovation of the present invention is to construct a third-order tensor of two-dimensional wavelet subband coefficients; to use the tensor nuclear norm to perform low-rank constraints on the wavelet coefficient tensor to improve the estimation accuracy of the image wavelet coefficients; to use the alternating direction iterative algorithm to solve the wavelet tensor low-rank reconstruction model, and to apply this method to the restoration of degraded images.
本发明的有益效果:利用一层冗余小波分解,充分挖掘了图像的平滑特征和细节信息;采用三阶张量表示二维小波子带系数,很好地保留了尺度内的结构性和尺度间的相关性,并采用张量核范数对三阶张量施加低秩约束,提高了对图像小波系数的估计精度,因此最终复原的结果图不仅具有良好的整体视觉效果,还保留了图像内部的大量轮廓、边缘、纹理等细节信息,使整个估计结果更接近于真实值。The beneficial effects of the present invention are as follows: a layer of redundant wavelet decomposition is utilized to fully exploit the smooth features and detail information of the image; a third-order tensor is used to represent the two-dimensional wavelet subband coefficients, which well preserves the intra-scale structure and the inter-scale correlation, and a tensor nuclear norm is used to impose a low-rank constraint on the third-order tensor, thereby improving the estimation accuracy of the image wavelet coefficients. Therefore, the final restored result image not only has a good overall visual effect, but also retains a large amount of detail information such as contours, edges, textures, etc. inside the image, making the entire estimation result closer to the true value.
本发明主要采用仿真实验的方法进行验证,所有步骤、结论都在MATLAB9.5上验证正确。The present invention is mainly verified by simulation experiment method, and all steps and conclusions are verified to be correct on MATLAB9.5.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1是本发明的工作流程框图;Fig. 1 is a flowchart of the workflow of the present invention;
图2是在图像修补场景下本发明仿真中使用的Lena原图;FIG2 is an original Lena image used in the simulation of the present invention in an image repair scenario;
图3是在图像修补场景下对Lena原图覆盖文本后的测试图;Figure 3 is a test image after the Lena original image is covered with text in the image repair scenario;
图4是在图像修补场景下用SALSA方法对图3的重构结果;FIG4 is the reconstruction result of FIG3 using the SALSA method in the image repair scenario;
图5是在图像修补场景下用SKR方法对图3的重构结果;FIG5 is the reconstruction result of FIG3 using the SKR method in the image repair scenario;
图6是在图像修补场景下用BPFA方法对图3的重构结果;FIG6 is a reconstruction result of FIG3 using the BPFA method in an image repair scenario;
图7是在图像修补场景下用IRCNN方法对图3的重构结果;FIG7 is the reconstruction result of FIG3 using the IRCNN method in the image inpainting scenario;
图8是在图像修补场景下用IDBP方法对图3的重构结果;FIG8 is a reconstruction result of FIG3 using the IDBP method in an image repair scenario;
图9是在图像修补场景下用本发明方法对图3的重构结果;FIG9 is a reconstruction result of FIG3 using the method of the present invention in an image repair scenario;
图10是在图像去模糊场景下本发明仿真中使用的House原图;FIG10 is an original image of House used in the simulation of the present invention in the image deblurring scenario;
图11是在图像去模糊场景下House原图被高斯模糊核破坏的测试图;Figure 11 is a test image of the original House image destroyed by the Gaussian blur kernel in the image deblurring scenario;
图12是在图像去模糊场景下用SALSA方法对图11的重构结果;FIG12 is the reconstruction result of FIG11 using the SALSA method in the image deblurring scenario;
图13是在图像去模糊场景下用SA-DCT方法对图11的重构结果;FIG13 is a reconstruction result of FIG11 using the SA-DCT method in an image deblurring scenario;
图14是在图像去模糊场景下用IDD-BM3D方法对图11的重构结果;FIG14 is a reconstruction result of FIG11 using the IDD-BM3D method in an image deblurring scenario;
图15是在图像去模糊场景下用IRCNN方法对图11的重构结果;FIG15 is the reconstruction result of FIG11 using the IRCNN method in the image deblurring scenario;
图16是在图像去模糊场景下用IDBP方法对图11的重构结果;FIG16 is the reconstruction result of FIG11 using the IDBP method in the image deblurring scenario;
图17是在图像去模糊场景下用本发明方法对图11的重构结果;FIG17 is a reconstruction result of FIG11 using the method of the present invention in an image deblurring scenario;
图18是在图像去噪场景下本发明仿真中使用的C.man原图;FIG18 is an original image of C.man used in the simulation of the present invention in the image denoising scenario;
图19是在图像去噪场景下对C.man原图施加噪声后的测试图;FIG19 is a test image after adding noise to the original image of C.man in the image denoising scenario;
图20是在图像去噪场景下用NLM方法对图19的重构结果;FIG20 is the reconstruction result of FIG19 using the NLM method in the image denoising scenario;
图21是在图像去噪场景下用SA-DCT方法对图19的重构结果;FIG21 is a reconstruction result of FIG19 using the SA-DCT method in an image denoising scenario;
图22是在图像去噪场景下用OWT-SURE-LET方法对图19的重构结果;FIG22 is the reconstruction result of FIG19 using the OWT-SURE-LET method in the image denoising scenario;
图23是在图像去噪场景下用IRCNN方法对图19的重构结果;FIG23 is the reconstruction result of FIG19 using the IRCNN method in the image denoising scenario;
图24是在图像去噪场景下用本发明方法对图19的重构结果。FIG. 24 is a reconstruction result of FIG. 19 using the method of the present invention in an image denoising scenario.
具体实施方式Detailed ways
参照图1,本发明是基于小波张量低秩正则化的图像复原方法,具体步骤包括如下:1 , the present invention is an image restoration method based on wavelet tensor low-rank regularization, and the specific steps include the following:
步骤1,对图像进行一层二维冗余小波分解,获取小波子带系数。Step 1: Perform a two-dimensional redundant wavelet decomposition on the image to obtain wavelet subband coefficients.
(1a)将输入的原始空域图像x分别通过上采样的低通和高通滤波器,得到两张和原图尺寸相同的图像;(1a) The input original spatial domain image x is passed through the upsampled low-pass and high-pass filters respectively to obtain two images with the same size as the original image;
(1b)将步骤(1a)中得到的两张图像再分别通过上采样的低通和高通滤波器,最终得到四张与原图尺寸相同的子带图像,可表示为:(1b) The two images obtained in step (1a) are respectively passed through the up-sampled low-pass and high-pass filters, and finally four sub-band images with the same size as the original image are obtained, which can be expressed as:
αi(x)=Φix(i=1,2,3,4)α i (x) = Φ i x (i = 1, 2, 3, 4)
其中Φi表示滤波器矩阵,当i=1,2,3,4时,αi(x)分别表示低频二维小波子带系数αL,L和高频二维小波子带系数αL,H、αH,L和αH,H,其中低频二维小波子带系数反映了图像整体的平滑特征,和原图最为相似,因此又被称为近似系数或逼近系数,高频二维小波子带系数则保留了图像的轮廓、边缘、纹理等局部特征,又被称为细节系数;Where Φ i represents the filter matrix. When i = 1, 2, 3, 4, α i (x) represents the low-frequency two-dimensional wavelet subband coefficient α L,L and the high-frequency two-dimensional wavelet subband coefficient α L,H , α H,L and α H,H , respectively. The low-frequency two-dimensional wavelet subband coefficient reflects the overall smoothness of the image and is most similar to the original image. Therefore, it is also called the approximate coefficient or approximation coefficient. The high-frequency two-dimensional wavelet subband coefficient retains the local features of the image such as contour, edge, texture, etc., and is also called the detail coefficient.
步骤2,构建小波子带系数张量并用张量核范数对其进行低秩约束。Step 2: construct the wavelet subband coefficient tensor and use the tensor nuclear norm to constrain its low rank.
(2a)获取小波子带系数之后,为了保留各小波子带系数内部的结构性与彼此间的相关性,借助张量能够保留多维数据潜在结构的优势,将四个二维小波子带系数以矩阵形式依次堆叠构成一个三阶张量结合αi(x)=Φix(i=1,2,3,4)可表示为:(2a) After obtaining the wavelet subband coefficients, in order to preserve the internal structure and correlation of each wavelet subband coefficient, the four two-dimensional wavelet subband coefficients are stacked in matrix form to form a third-order tensor by taking advantage of the tensor's ability to preserve the potential structure of multidimensional data. Combining α i (x) = Φ i x (i = 1, 2, 3, 4) can be expressed as:
其中vec(·)表示矩阵向量化的算符,表示第i个二维小波子带系数切片;where vec(·) represents the matrix vectorization operator, Represents the i-th two-dimensional wavelet subband coefficient slice;
(2b)从视觉效果上来看,尽管各小波子带系数像素灰度值不同,但它们的纹理和轮廓结构高度相似,因此认为小波系数张量具有明显的低秩特性;与矩阵核范数用于约束矩阵的低秩特性类似,张量核范数是张量奇异值的总和,是张量秩函数的凸近似,同样地可采用张量核范数对三阶小波系数张量施加低秩约束;此外,高阶奇异值分解作为Tucker分解的一种特殊情况,对分解后得到的各成分矩阵进一步施加了正交约束,也被认为矩阵奇异值分解的多线性推广,因此根据可知,三阶张量/>的核范数/>又可定义为/> (2b) From a visual perspective, although the pixel grayscale values of each wavelet subband coefficient are different, their texture and contour structures are highly similar, so it is believed that the wavelet coefficient tensor has an obvious low-rank characteristic; similar to the low-rank characteristic of the matrix nuclear norm used to constrain the matrix, the tensor nuclear norm is the sum of the tensor singular values and is a convex approximation of the tensor rank function. Similarly, the tensor nuclear norm can be used to impose low-rank constraints on the third-order wavelet coefficient tensor; in addition, high-order singular value decomposition, as a special case of Tucker decomposition, further imposes orthogonal constraints on the component matrices obtained after the decomposition, and is also considered to be a multilinear generalization of the matrix singular value decomposition. Therefore, according to It can be seen that the third-order tensor/> The nuclear norm of It can also be defined as/>
步骤3,建立小波张量低秩约束下的图像复原模型并进行求解。Step 3: Establish an image restoration model under the low-rank constraint of wavelet tensor and solve it.
(3a)小波张量低秩约束下的图像复原模型:(3a) Image restoration model under low-rank constraint of wavelet tensor:
其中y表示退化图像,H表示退化矩阵,表示向量的二范数的平方,x表示待复原的图像,λ为正则化参数;为求解(3a)中的复原模型,引入辅助变量/>将该复原模型改写成多元最小化问题:Where y represents the degraded image, H represents the degradation matrix, represents the square of the vector's bi-norm, x represents the image to be restored, and λ is the regularization parameter; in order to solve the restoration model in (3a), an auxiliary variable is introduced/> Rewrite the restoration model as a multivariate minimization problem:
其中β为惩罚参数,为归一化的拉格朗日乘子,/>表示张量的Frobenius范数的平方;利用交替方向迭代算法对其求解,可将该多元最小化问题分解为关于待复原的图像x和小波系数张量/>的两个子问题,并进行交替迭代求解:Where β is the penalty parameter, is the normalized Lagrange multiplier,/> represents the square of the Frobenius norm of the tensor; using the alternating direction iterative algorithm to solve it, the multivariate minimization problem can be decomposed into the image x to be restored and the wavelet coefficient tensor/> Two sub-problems of , and solve them alternately and iteratively:
(3b)对于(3a)中的变量x,给定则复原模型变为求解关于待复原的图像x的子问题:(3b) For the variable x in (3a), given Then the restoration model becomes a sub-problem of solving the image x to be restored:
其中表示第i个二维小波子带系数切片,/>表示/>对应的辅助变量,/>表示/>对应的归一化的拉格朗日乘子,该子问题是一个最小二乘问题,可直接通过矩阵求逆得到其闭合解:in represents the i-th two-dimensional wavelet subband coefficient slice,/> Indicates/> The corresponding auxiliary variables, /> Indicates/> The corresponding normalized Lagrange multiplier, this subproblem is a least squares problem, and its closed solution can be obtained directly by matrix inversion:
(3c)在得到待复原的图像x后,关于的子问题可表示为:(3c) After obtaining the image x to be restored, The sub-problem can be expressed as:
根据的高阶奇异值分解/>可将该子问题改写为关于/>U、V和W的多元最小化问题:according to Higher-order singular value decomposition of This sub-problem can be rewritten as about/> Multivariate minimization problem of U, V and W:
其中(·)T表示矩阵的转置,表示/>大小的单位矩阵,I4表示4×4大小的单位矩阵;该多元最小化问题可分解为关于各变量的四个子问题并进行交替求解:where (·) T represents the transpose of the matrix, Indicates/> The size of the identity matrix, I 4 represents the size of the identity matrix of 4×4; the multivariate minimization problem can be decomposed into four sub-problems about each variable and solved alternately:
3c1)关于的子问题可通过软阈值算法求解得到:3c1) About The sub-problem of can be solved by the soft threshold algorithm:
其中soft(·)是一个逐点的软阈值函数:where soft(·) is a point-wise soft threshold function:
3c2)关于U的子问题可表示为:3c2) The subproblem about U can be expressed as:
由于矩阵V和W都是正交矩阵,因此关于U的子问题可改写为:Since matrices V and W are both orthogonal matrices, the subproblem about U can be rewritten as:
其中unfold1(·)表示张量按Tucker模式-1展开,即意味着将张量中所有列纤维作为列向量构成矩阵,对进行奇异值分解:The expand 1 (·) indicates that the tensor is expanded according to Tucker mode -1, which means that all column fibers in the tensor are used as column vectors to form a matrix. Perform singular value decomposition:
其中P1、Q1是的左奇异向量矩阵、右奇异向量矩阵,Σ1是奇异值矩阵,最终可得U的闭合解:Where P 1 and Q 1 are The left singular vector matrix and the right singular vector matrix of , Σ 1 is the singular value matrix, and finally the closed solution of U can be obtained:
3c3)关于V的子问题可表示为:3c3) The subproblem about V can be expressed as:
其中unfold2(·)表示张量按Tucker模式-2展开,即意味着将张量中所有行纤维作为列向量构成矩阵,同理对进行奇异值分解:The expand 2 (·) indicates that the tensor is expanded according to Tucker mode -2, which means that all row fibers in the tensor are used as column vectors to form a matrix. Perform singular value decomposition:
其中P2、Q2是的左奇异向量矩阵、右奇异向量矩阵,Σ2是奇异值矩阵,最终可得V的闭合解:Where P 2 and Q 2 are The left singular vector matrix and the right singular vector matrix of , Σ 2 is the singular value matrix, and finally the closed solution of V can be obtained:
3c4)关于W的子问题可表示为:3c4) The subproblem about W can be expressed as:
其中unfold3(·)表示张量按Tucker模式-3展开,即意味着将张量中所有管纤维作为列向量构成矩阵,同样地,对进行奇异值分解:The expand 3 (·) indicates that the tensor is expanded according to Tucker mode-3, which means that all the tube fibers in the tensor are used as column vectors to form a matrix. Similarly, Perform singular value decomposition:
其中P3、Q3是的左奇异向量矩阵、右奇异向量矩阵,Σ3是奇异值矩阵,最终可得W的闭合解:Among them, P 3 and Q 3 are The left singular vector matrix and the right singular vector matrix of , Σ 3 is the singular value matrix, and finally the closed solution of W can be obtained:
3c5)重复步骤3c1)~3c4)交替求解可得小波系数张量的解 3c5) Repeat steps 3c1) to 3c4) alternately to obtain the solution of the wavelet coefficient tensor
(4)重复步骤(3),直至相邻两次重构结果间变分小于迭代终止门限或满足最大迭代次数。(4) Repeat step (3) until the variation between two adjacent reconstruction results is less than the iteration termination threshold or the maximum number of iterations is met.
本发明的效果可以通过以下仿真实验进一步说明:The effect of the present invention can be further illustrated by the following simulation experiment:
一、实验条件和内容1. Experimental conditions and contents
实验条件:实验场景包含图像修补、图像去模糊和图像去噪实验,实验图像采用标准的数字图像测试图片,分别如图2、10、18所示;实验结果评价指标采用峰值信噪比PSNR和结构相似性SSIM来客观评价复原结果,PSNR值和SSIM值越高表示复原结果越好,越接近真实图像。Experimental conditions: The experimental scenes include image inpainting, image deblurring and image denoising experiments. The experimental images use standard digital image test pictures, as shown in Figures 2, 10 and 18 respectively. The experimental result evaluation indicators use peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) to objectively evaluate the restoration results. The higher the PSNR and SSIM values, the better the restoration results are and the closer they are to the real image.
实验内容:在图像修补场景下,复原结果使用目前在图像修补领域具有代表性的SALSA方法、SKR方法、BPFA方法、IRCNN方法和IDBP方法与本发明方法进行对比。在图像去模糊场景下,复原结果使用目前在图像去模糊领域具有代表性的SALSA方法、SKR方法、BPFA方法、IRCNN方法和IDBP方法与本发明方法进行对比。在图像去噪场景下,复原结果使用目前在图像去噪领域具有代表性的SALSA方法、SKR方法、BPFA方法、IRCNN方法和IDBP方法与本发明方法进行对比。Experimental content: In the image inpainting scenario, the restoration results are compared with the method of the present invention using the SALSA method, SKR method, BPFA method, IRCNN method and IDBP method, which are currently representative methods in the field of image inpainting. In the image deblurring scenario, the restoration results are compared with the method of the present invention using the SALSA method, SKR method, BPFA method, IRCNN method and IDBP method, which are currently representative methods in the field of image deblurring. In the image denoising scenario, the restoration results are compared with the method of the present invention using the SALSA method, SKR method, BPFA method, IRCNN method and IDBP method, which are currently representative methods in the field of image denoising.
实验1:在图像修补场景下,用本发明方法与SALSA方法、SKR方法、BPFA方法、IRCNN方法和IDBP方法分别对图2覆盖文本后的图像(图3)进行复原。其中SALSA方法是一种利用全变分来快速求解无约束优化问题的方法,其复原结果为图4;SKR方法利用了自适应的核回归函数的方法,它依靠图像内在局部结构的像素位置和强度来刻画空域邻域像素,其复原结果为图5;BPFA方法是一种利用非参数贝叶斯框架下的字典学习来挖掘图像空域相关性的方法,其复原结果为图6;IRCNN方法和IDBP方法是两种基于深度学习的重构方法,其复原结果分别为图7和图8。实验中本发明方法设置正则化参数β=0.06,λ=0.85,最大迭代次数T=100,迭代终止门限η=1×10-6;最终复原结果为图9。Experiment 1: In the image repair scenario, the image (Figure 3) covered with text in Figure 2 is restored using the method of the present invention, the SALSA method, the SKR method, the BPFA method, the IRCNN method and the IDBP method. The SALSA method is a method that uses total variation to quickly solve unconstrained optimization problems, and its restoration result is shown in Figure 4; the SKR method uses an adaptive kernel regression function method, which relies on the pixel position and intensity of the local structure of the image to characterize the spatial neighborhood pixels, and its restoration result is shown in Figure 5; the BPFA method is a method that uses dictionary learning under a non-parametric Bayesian framework to mine the spatial correlation of the image, and its restoration result is shown in Figure 6; the IRCNN method and the IDBP method are two reconstruction methods based on deep learning, and their restoration results are shown in Figures 7 and 8, respectively. In the experiment, the method of the present invention sets the regularization parameters β = 0.06, λ = 0.85, the maximum number of iterations T = 100, and the iteration termination threshold η = 1×10 -6 ; the final restoration result is shown in Figure 9.
从图4、图5、图6、图7、图8和图9各方法的复原结果及局部区域放大图可以看出,对比SALSA方法、SKR方法、BPFA方法、IRCNN方法和IDBP方法与本发明方法可以看出,本发明方法对细节部分的复原效果优于其他对比方法。From the restoration results of each method in Figures 4, 5, 6, 7, 8 and 9 and the magnified images of the local areas, it can be seen that by comparing the SALSA method, SKR method, BPFA method, IRCNN method and IDBP method with the method of the present invention, it can be seen that the restoration effect of the method of the present invention on the details is better than that of other compared methods.
表1不同复原方法的PSNR/SSIM指标Table 1 PSNR/SSIM indicators of different restoration methods
表1给出了各复原方法PSNR和SSIM指标情况,其中PSNR值和SSIM值越高表示复原效果越好;可以看出在图像修补场景下,本发明方法对比其他方法PSNR值和SSIM值均有较大提高,说明本方法复原结果更接近真实图像,此结果与复原效果图相吻合。Table 1 gives the PSNR and SSIM indicators of various restoration methods, where the higher the PSNR and SSIM values are, the better the restoration effect is. It can be seen that in the image repair scenario, the PSNR and SSIM values of the method of the present invention are greatly improved compared with other methods, indicating that the restoration result of this method is closer to the real image, and this result is consistent with the restoration effect diagram.
实验2:在图像去模糊场景下,用本发明方法与SALSA方法、SA-DCT方法、IDD-BM3D方法、IRCNN方法和IDBP方法分别对图10被高斯模糊核破坏后的图像(图11)进行复原。其中SALSA方法是一种利用全变分来快速求解无约束优化问题的方法,其复原结果为图12;SA-DCT方法是一种在形状自适应的离散余弦变换域实施硬阈值算法和维纳滤波的图像处理方法,其复原结果为图13;IDD-BM3D方法是一种常用于图像复原的经典去噪算法,以BM3D的改进版本而闻名,其复原结果为图14;IRCNN方法和IDBP方法是两种基于深度学习的重构方法,其复原结果分别为图15和图16。实验中本发明方法设置正则化参数β=0.045,λ=0.75,最大迭代次数T=100,迭代终止门限η=1×10-6;最终复原结果为图17。Experiment 2: In the image deblurring scenario, the image (Figure 11) destroyed by the Gaussian blur kernel in Figure 10 is restored using the method of the present invention, the SALSA method, the SA-DCT method, the IDD-BM3D method, the IRCNN method and the IDBP method. The SALSA method is a method that uses total variation to quickly solve unconstrained optimization problems, and its restoration result is shown in Figure 12; the SA-DCT method is an image processing method that implements a hard threshold algorithm and Wiener filtering in a shape-adaptive discrete cosine transform domain, and its restoration result is shown in Figure 13; the IDD-BM3D method is a classic denoising algorithm commonly used for image restoration, known as an improved version of BM3D, and its restoration result is shown in Figure 14; the IRCNN method and the IDBP method are two reconstruction methods based on deep learning, and their restoration results are shown in Figures 15 and 16, respectively. In the experiment, the method of the present invention sets the regularization parameters β = 0.045, λ = 0.75, the maximum number of iterations T = 100, and the iteration termination threshold η = 1×10 -6 ; the final restoration result is shown in Figure 17.
从图12、图13、图14、图15、图16和图17各方法的复原结果及局部区域放大图可以看出,对比SALSA方法、SA-DCT方法、IDD-BM3D方法、IRCNN方法和IDBP方法与本发明方法可以看出,本发明方法对细节部分的复原效果优于其他对比方法。From the restoration results of each method in Figures 12, 13, 14, 15, 16 and 17 and the enlarged images of the local areas, it can be seen that by comparing the SALSA method, SA-DCT method, IDD-BM3D method, IRCNN method and IDBP method with the method of the present invention, it can be seen that the restoration effect of the method of the present invention on the details is better than that of other compared methods.
表2不同复原方法的PSNR/SSIM指标Table 2 PSNR/SSIM indicators of different restoration methods
表2给出了各复原方法PSNR和SSIM指标情况,其中PSNR值和SSIM值越高表示复原效果越好;可以看出在图像去模糊场景下,本发明方法对比其他方法PSNR值和SSIM值均有较大提高,说明本方法复原结果更接近真实图像,此结果与复原效果图相吻合。Table 2 gives the PSNR and SSIM indicators of various restoration methods, where the higher the PSNR and SSIM values are, the better the restoration effect is. It can be seen that in the image deblurring scenario, the PSNR and SSIM values of the method of the present invention are greatly improved compared with other methods, indicating that the restoration result of the method is closer to the real image, and this result is consistent with the restoration effect diagram.
实验3:在图像去噪场景下,用本发明方法与NLM方法、SA-DCT方法、OWT-SURE-LET方法和IRCNN方法分别对图18加噪后的图像(图19)进行复原。其中NLM方法是一种对图像的非局部信息加权平均的经典去噪方法,其复原结果为图20;SA-DCT方法是一种在形状自适应的离散余弦变换域实施硬阈值算法和维纳滤波的图像处理方法,其复原结果为图21;OWT-SURE-LET方法是一种利用正交小波的阈值去噪方法,其复原结果为图22;IRCNN方法是一种基于深度学习的重构方法,其复原结果分别为图23。实验中本发明方法设置正则化参数β=0.055,λ=0.8,最大迭代次数T=100,迭代终止门限η=1×10-6;最终复原结果为图24。Experiment 3: In the image denoising scenario, the image (Figure 19) after adding noise to Figure 18 is restored using the method of the present invention, the NLM method, the SA-DCT method, the OWT-SURE-LET method and the IRCNN method. The NLM method is a classic denoising method that weights the non-local information of the image and its restoration result is shown in Figure 20; the SA-DCT method is an image processing method that implements a hard threshold algorithm and Wiener filtering in the shape-adaptive discrete cosine transform domain, and its restoration result is shown in Figure 21; the OWT-SURE-LET method is a threshold denoising method using orthogonal wavelets, and its restoration result is shown in Figure 22; the IRCNN method is a reconstruction method based on deep learning, and its restoration results are shown in Figure 23. In the experiment, the method of the present invention sets the regularization parameters β = 0.055, λ = 0.8, the maximum number of iterations T = 100, and the iteration termination threshold η = 1×10 -6 ; the final restoration result is shown in Figure 24.
从图20、图21、图22、图23和图24各方法的复原结果及局部区域放大图可以看出,对比NLM方法、SA-DCT方法、OWT-SURE-LET方法和IRCNN方法与本发明方法可见,本发明方法对细节部分的复原效果优于其他对比方法。From the restoration results of each method in Figures 20, 21, 22, 23 and 24 and the enlarged images of the local areas, it can be seen that by comparing the NLM method, SA-DCT method, OWT-SURE-LET method and IRCNN method with the method of the present invention, it can be seen that the restoration effect of the method of the present invention on the details is better than that of other compared methods.
表3不同复原方法的PSNR/SSIM指标Table 3 PSNR/SSIM indicators of different restoration methods
表3给出了各复原方法PSNR和SSIM指标情况,其中PSNR值和SSIM值越高表示复原效果越好;可以看出在图像去噪场景下,本发明方法对比其他方法PSNR值和SSIM值均有较大提高,说明本方法复原结果更接近真实图像,此结果与复原效果图相吻合。Table 3 gives the PSNR and SSIM indicators of various restoration methods, where the higher the PSNR and SSIM values are, the better the restoration effect is. It can be seen that in the image denoising scenario, the PSNR and SSIM values of the method of the present invention are greatly improved compared with other methods, indicating that the restoration result of the method is closer to the real image, and this result is consistent with the restoration effect diagram.
上述三个实验表明,在图像修补、图像去模糊和图像去噪实验场景下,本发明方法不仅还原效果明显,而且复原后图像内容丰富,同时客观评价指标较高,由此可见本发明对退化图像复原是有效的。The above three experiments show that in the experimental scenarios of image repair, image deblurring and image denoising, the method of the present invention not only has obvious restoration effect, but also has rich content of the restored image and high objective evaluation index. It can be seen that the present invention is effective for restoring degraded images.
Claims (3)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210339100.1A CN115131226B (en) | 2022-04-01 | 2022-04-01 | Image restoration method based on wavelet tensor low-rank regularization |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210339100.1A CN115131226B (en) | 2022-04-01 | 2022-04-01 | Image restoration method based on wavelet tensor low-rank regularization |
Publications (2)
Publication Number | Publication Date |
---|---|
CN115131226A CN115131226A (en) | 2022-09-30 |
CN115131226B true CN115131226B (en) | 2024-06-14 |
Family
ID=83376401
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210339100.1A Active CN115131226B (en) | 2022-04-01 | 2022-04-01 | Image restoration method based on wavelet tensor low-rank regularization |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN115131226B (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116503279A (en) * | 2023-04-25 | 2023-07-28 | 广东工业大学 | A CUP-VISAR compressed image inversion method and device |
CN117058886A (en) * | 2023-10-12 | 2023-11-14 | 安徽宇疆科技有限公司 | Beidou space-time data model based on third-order tensor and traffic flow analysis method |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9778391B2 (en) * | 2013-03-15 | 2017-10-03 | Varex Imaging Corporation | Systems and methods for multi-view imaging and tomography |
CN109241491A (en) * | 2018-07-28 | 2019-01-18 | 天津大学 | The structural missing fill method of tensor based on joint low-rank and rarefaction representation |
CN111047661B (en) * | 2019-12-12 | 2022-04-08 | 重庆大学 | CS-MRI image reconstruction method based on sparse manifold joint constraint |
CN111369457B (en) * | 2020-02-28 | 2022-05-17 | 西南电子技术研究所(中国电子科技集团公司第十研究所) | Remote sensing image denoising method for sparse discrimination tensor robustness PCA |
CN113204051B (en) * | 2021-06-10 | 2022-04-15 | 成都理工大学 | Low-rank tensor seismic data denoising method based on variational modal decomposition |
CN114166850B (en) * | 2021-11-30 | 2023-06-09 | 电子科技大学 | Light excitation infrared thermal imaging defect detection method based on differential tensor decomposition |
-
2022
- 2022-04-01 CN CN202210339100.1A patent/CN115131226B/en active Active
Non-Patent Citations (1)
Title |
---|
Image restoration via wavelet-based low-rank tensor regularization;Shujun Liu等;《Optik》;20230201;全文 * |
Also Published As
Publication number | Publication date |
---|---|
CN115131226A (en) | 2022-09-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Liu et al. | Image restoration using total variation with overlapping group sparsity | |
CN102722896B (en) | Adaptive compressed sensing-based non-local reconstruction method for natural image | |
CN110796625B (en) | An Image Compressive Sensing Reconstruction Method Based on Group Sparse Representation and Weighted Total Variation | |
Danielyan et al. | BM3D frames and variational image deblurring | |
CN114820352B (en) | Hyperspectral image denoising method, device and storage medium | |
CN110276726B (en) | Image deblurring method based on multichannel network prior information guidance | |
CN107248144A (en) | A kind of image de-noising method based on compression-type convolutional neural networks | |
CN107067367A (en) | A kind of Image Super-resolution Reconstruction processing method | |
CN115131226B (en) | Image restoration method based on wavelet tensor low-rank regularization | |
Singh et al. | ResDNN: deep residual learning for natural image denoising | |
Liu et al. | Block matching local SVD operator based sparsity and TV regularization for image denoising | |
CN105513026A (en) | Compressed sensing reconstruction method based on image nonlocal similarity | |
CN102542542A (en) | Image denoising method based on non-local sparse model | |
CN107784638A (en) | A kind of Dongba ancient books image enchancing method of optimization | |
CN112801889A (en) | Image denoising method, system, device and storage medium | |
CN103093433A (en) | Natural image denoising method based on regionalism and dictionary learning | |
CN113204051A (en) | Low-rank tensor seismic data denoising method based on variational modal decomposition | |
Peyré et al. | Learning the morphological diversity | |
CN111754430B (en) | Color image denoising method based on pure quaternion dictionary learning | |
CN108765330A (en) | Image de-noising method and device based on the joint constraint of global and local priori | |
CN116452455B (en) | Hyperspectral image denoising method based on low-rank sparse coding model | |
CN117495710A (en) | An image multiplicative noise removal method and system | |
CN114549300A (en) | Image dictionary generation method, image reconstruction method and related device | |
Huang et al. | Image restoration from patch-based compressed sensing measurement | |
Hu et al. | Patch-based low-rank minimization for image denoising |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20240904 Address after: No. 319 North Huafu Road, Jiulongpo District, Chongqing 401329, Building 4, Annex 4 (storefront of Building 4, Shilong Community) Patentee after: Chongqing Point Control Technology Co.,Ltd. Country or region after: China Address before: 400044 No. 174 Sha Jie street, Shapingba District, Chongqing Patentee before: Chongqing University Country or region before: China |