CN109671029A - Image denoising algorithm based on gamma norm minimum - Google Patents
Image denoising algorithm based on gamma norm minimum Download PDFInfo
- Publication number
- CN109671029A CN109671029A CN201811492110.9A CN201811492110A CN109671029A CN 109671029 A CN109671029 A CN 109671029A CN 201811492110 A CN201811492110 A CN 201811492110A CN 109671029 A CN109671029 A CN 109671029A
- Authority
- CN
- China
- Prior art keywords
- image
- image block
- matrix
- denoising
- gamma
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 239000011159 matrix material Substances 0.000 claims abstract description 68
- 238000000354 decomposition reaction Methods 0.000 claims abstract description 14
- 238000005457 optimization Methods 0.000 claims abstract description 13
- 238000000034 method Methods 0.000 claims description 36
- 239000013598 vector Substances 0.000 claims description 11
- 230000008569 process Effects 0.000 claims description 9
- 238000011156 evaluation Methods 0.000 claims description 5
- 230000003044 adaptive effect Effects 0.000 claims description 3
- 238000006116 polymerization reaction Methods 0.000 claims description 3
- 238000012545 processing Methods 0.000 abstract description 4
- 238000004088 simulation Methods 0.000 abstract description 3
- 238000005192 partition Methods 0.000 abstract 1
- 230000006870 function Effects 0.000 description 21
- 238000002474 experimental method Methods 0.000 description 5
- 238000012360 testing method Methods 0.000 description 5
- 238000010276 construction Methods 0.000 description 3
- 230000007547 defect Effects 0.000 description 3
- NAWXUBYGYWOOIX-SFHVURJKSA-N (2s)-2-[[4-[2-(2,4-diaminoquinazolin-6-yl)ethyl]benzoyl]amino]-4-methylidenepentanedioic acid Chemical group C1=CC2=NC(N)=NC(N)=C2C=C1CCC1=CC=C(C(=O)N[C@@H](CC(=C)C(O)=O)C(O)=O)C=C1 NAWXUBYGYWOOIX-SFHVURJKSA-N 0.000 description 2
- 238000000137 annealing Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000015556 catabolic process Effects 0.000 description 2
- 238000006731 degradation reaction Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02T—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
- Y02T10/00—Road transport of goods or passengers
- Y02T10/10—Internal combustion engine [ICE] based vehicles
- Y02T10/40—Engine management systems
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
Abstract
The invention belongs to digital image processing fields, are related to a kind of Image denoising algorithm based on gamma norm minimum.The algorithm is first to noise image overlap partition, structural similarity index adaptable search and the most like several non local image blocks of current image block are then based on to form similar image block matrix, and then using the unbiased approximate matrix rank function of non-convex gamma norm to construct low-rank denoising model, optimization problem solving is finally denoised to gained low-rank based on singular value decomposition, and denoising image block is reassembled as denoising image.Simulation result show with existing PID, NLM, BM3D with NNM algorithm compares, and the mentioned algorithm of the present invention can effectively eliminate Gaussian noise, and can preferably restore original image details.
Description
Technical Field
The invention belongs to the field of digital image processing, and particularly relates to an image denoising algorithm based on gamma norm minimization.
Background
Digital images are inevitably contaminated by noise during acquisition and transmission, resulting in imagesLoss of detail and degradation of quality, which in turn affects subsequent image processing. The purpose of image denoising is to recover the original image x from the noise image y as accurately as possible and to retain important detail features such as edges and textures. The degradation model of the denoising problem can be expressed as: y x + v, where v is generally assumed to be a mean of 0 and a variance of σn 2White gaussian noise. Due to the unsuitability of the image denoising problem, denoising by using the priori knowledge representing the statistical characteristics of the image is very important.
In recent years, numerous image noise reduction algorithms have been proposed in succession, which can be roughly classified into the following two categories: based on a local prior method and based on a non-local Self-Similarity (NSS) prior method. The local prior-based method mainly comprises a Wavelet Shrinkage method (WS), a Total Variation method (TV) and an improved Image Denoising method (PID) based on an annealing algorithm. However, these methods only consider local a priori knowledge, neglect similarity a priori information between non-local image blocks, and thus result in poor denoising performance of the algorithm. The image non-local similarity prior refers to: a certain local image block in a given image is searched for a large number of image blocks similar to the given image block by utilizing the linear correlation characteristic among non-local similar blocks in the image, and practice shows that NSS becomes very effective prior information in an image recovery task. Based on this, Buades a et al propose a non-local mean denoising (NLM) algorithm, which can obtain better denoising performance by weighted averaging of similar image blocks, but when the noise level is higher, the similar image blocks contain a large amount of noise, so that the denoised image has a large-area fuzzy phenomenon. Aiming at the problem, Dabov K proposes a three-dimensional Block Matching (BM 3D Filtering, 3D) algorithm, which constructs 2D image blocks with similar structures as three-dimensional data and then performs joint denoising to improve denoising performance, but the algorithm application is limited by high time complexity. Based on this, Dong W et al propose a Non-local centralized sparse Representation (NCSR) algorithm, construct similar image blocks as a matrix, and improve denoising performance by using a group sparse method. However, the denoised image obtained by the algorithm has the problems of strong artifact phenomenon, fuzzy key details and the like. In response to the above problems, researchers have noted that: the non-local similar image blocks are constructed into a matrix in a vector form, and the matrix has low-rank characteristics and sparse singular values, so that the denoising performance can be improved by using low-rank prior information. Based on this, Ji H et al propose a Nuclear Norm Minimization (NNM) algorithm, which utilizes a Nuclear Norm approximation matrix rank function to construct a low-rank denoising model, thereby obtaining better denoising performance. However, the singular values are processed in a balanced mode, the prior knowledge that the singular values reflect image textures, details and the like to different degrees is ignored, and therefore the improvement of the denoising performance is limited. To address this problem, Gu S et al propose a Weighted Nuclear Norm Minimization (WNNM) algorithm that utilizes a Weighted Nuclear Norm approximation matrix rank function to improve denoising performance by assigning different weights to singular values. However, the use of the kernel norm to approximate the matrix rank function excessively penalizes large singular values, so that the denoising problem can only obtain a suboptimal solution.
Disclosure of Invention
In order to improve the image denoising performance under the Gaussian noise condition, the invention provides an image denoising algorithm based on gamma norm minimization based on a low-rank theory.
The method comprises the following steps of firstly, overlapping and blocking a noise image, constructing a similar image block matrix by adopting a block matching algorithm based on SSIM, then constructing a low-rank denoising model by utilizing a non-convex gamma norm of an approximate unbiased approximate rank function, finally solving the obtained non-convex problem based on singular value decomposition, and recombining the denoised image blocks to obtain the denoised image. The technical scheme of the invention is as follows:
1. establishing a low-rank denoising model
The low-rank denoising method is one of the research hotspots in the current image denoising field, and the principle thereof can be described as follows: of size M x NThe noisy image y is overlappingly divided into n sizes ofImage block yi1, 2.., n. Then searching the window with the size of L multiplied by L and the current image block yiM most similar image blocks are constructed into a similar image block matrix Y in the form of column vectorsi∈Rd×mI.e. Yi=(yi,1,yi,2,...,yi,m),yi,mRepresenting the current image block yiIs similar to the image block. Based on this, the low-rank denoising problem can be expressed as the following optimization problem:
wherein ,YiFor a matrix of noise-like image blocks, XiTo denoise the similar image block matrix, | ·| non-wovenFIs Frobenius norm, rank (X)i) Is a matrix Xiλ is a regularization parameter to balance the regularization term and the fidelity term.
It should be noted that the above-mentioned rank minimization problem is an NP-hard problem, and it is very difficult to directly solve the problem. To address this problem, Gu S et al propose a kernel norm minimization algorithm, which converts the non-convex optimization problem into a convex optimization problem using a kernel norm approximation matrix rank function, thereby making the optimization problem (1) easy to solve, which can be expressed as follows:
wherein ,||Xi||*Is a matrix XiThe nuclear norm of (d). The solution to problem (2) can be expressed as:
wherein ,YiIs decomposed into Yi=PΛQT,Sλ(Λ) is a soft threshold operator on the diagonal matrix Λ and the parameter λ, defined as:
Sλ(Λ)jj=max(Λjj-λ,0) (4)
and executing the above operations on each overlapped image block, and reconstructing the original image by recombining all the image blocks. However, the kernel norm is a biased estimator, and the approximate matrix rank function may excessively penalize a larger singular value of the matrix, so that the kernel norm minimization problem cannot obtain an optimal solution, and the denoising performance is reduced. Aiming at the problem, the non-convex gamma norm is adopted to replace the nuclear norm so as to obtain the approximate unbiased estimation of the rank function, and further improve the performance of the low-rank denoising model.
2. Adaptive similar image block search
The traditional searching method for the non-local similar image blocks based on the Euclidean distance does not consider the structural similarity of the image blocks, so that the non-local similar image blocks are not searched accurately. In order to improve the searching accuracy of similar image blocks, the invention provides a self-adaptive similar image block searching method based on a structural similarity index. The Structural Similarity Index (SSIM) is a comprehensive image similarity evaluation Index, which considers three different characteristics of brightness, contrast and structure between images and can better evaluate the similarity degree of the two images. Given two images x and y, the SSIM is defined as shown in equation (5):
wherein ,μx,μy,σx 2,σy 2Mean and variance, σ, of the images x, y, respectivelyxyIs the covariance of the images x, y. Furthermore, C1=(k1L)2,C2=(k2L)2To ensure that the denominator is notConstant of zero, L255 is the maximum value of the pixel, k1=0.01,k20.03 is the default constant.
The main idea of the self-adaptive similar image block searching method is as follows: given a current image block yiAnd the target data set is used for calculating the structural similarity indexes of the current image block and each image block of the target data set, wherein the larger the value of the structural similarity indexes is, the more similar the two image blocks are, and then m image blocks which are most similar to the current image block are searched. Wherein, the number m of similar image blocks needs to be determined adaptively according to the noise level. Then, each similar image block is converted into a column vector and is sequentially arranged from left to right according to the descending order of similarity to form a similar image block matrix YiThe construction process is shown in fig. 2.
In summary, the provided similar image block searching method can fully utilize the non-local self-similar prior information of the image to improve the searching accuracy of the similar image block. Based on the obtained similar image block matrix YiThe image denoising model based on gamma norm minimization is as follows.
3. Establishing a gamma norm minimization model
The gamma norm is a matrix extension of the non-convex MCP function, which can approximate the rank function nearly unbiased compared to the kernel norm of the biased estimate. Let singular value decomposition of matrix X be X ═ U Σ VTWherein U is [ U ═ U1,u2,...,un],V=[v1,v2,...,vn],Σ=diag(λ1,λ2,...,λn) And λ1≥λ2≥...≥λn≧ 0, then the gamma norm may be defined as follows:
wherein ,[x]+=max(x,0)。
Based on the characteristic that the gamma norm can approximate a rank function almost unbiased, the invention uses the low-rank term in the alternative formula (1) to construct a non-convex gamma norm minimum denoising model, which can be expressed as follows:
wherein ,YiFor the matrix of noise-like image blocks,to denoise the similar image block matrix, | Xi||γIs a matrix XiGamma norm of (d).
4. Proposed non-convex model solution
For convenience of description, let X be Xi,Y=YiThen the solution to the optimization problem (8) can be derived as follows:
through simple matrix operations, equation (9) can be re-expressed as:
fixed ui and viFor y (X) with respect to λiDifferentiating to obtain:
order toEquation (11) can be expressed as:
finishing to obtain:
wherein ,Sλ,γ(. cndot.) is a non-convex soft shrink operator. Will be provided withCan be substituted by the formula (10):
order toSince the first term at the right end of the above equation is independent of the variable X to be optimized, then y (X) the minimization problem with respect to X is equivalent toAbout ξiThe minimization problem of (2).Can be re-expressed as follows:
wherein ,when lambda is less than ξiWhen the gamma value is less than or equal to gamma,can be expressed as:
when ξiWhen the alpha value is larger than gamma value,can be expressed as:
to pairAbout ξiDifferentiating to obtain:
due to the fact thatTo make it possible toAbout ξiTake the minimum value ui and viThe left and right singular vectors corresponding to the minimum singular value of the matrix Y are respectively taken, and ξ is obtainedi=σi. Thus, the optimal solution of the gamma norm minimization problem (8) can be expressed as follows:
wherein ,Y=U1Σ1V1 TIs a singular value decomposition of the matrix Y, sigma1=diag(σ1,σ2,...,σn),Σλ,γ=diag(Sλ,γ(σ1),Sλ,γ(σ2),...,Sλ,γ(σn) ) is a diagonal matrix whose diagonal elements are:
the optimization problem is solved for each overlapped image block in sequence, and then all the denoised similar image block matrixes { X can be obtainedi1, 2.., n, and reconstructing each denoised image block into a denoised image x. In practical application, the steps can be repeatedly iterated to obtain better denoising performance.
The process of the image denoising algorithm based on the gamma norm minimization comprises the following steps:
inputting: noisy image y
1: initialization:y(0)=y
2:for k=1:K
3: iterative regularization:
4:for y(k)of each overlapping image block yi
5: similar image block matrix Y constructed based on SSIM image block searching methodi
6: for YiSingular value decomposition: [ U, Σ, V)]=SVD(Yi)
7: evaluating an estimation value based on the model of formula (8):
8:end for
9: polymerization of XiTo reconstruct a denoised image
10:end for
And (3) outputting: de-noised image
And 3, the iterative regularization process is used for improving the denoising performance of the algorithm.
The invention has the beneficial effects that: the method disclosed by the invention has the advantages that the similar image blocks are searched by utilizing the structural similarity index to avoid the defect of inaccurate searching of the similar image blocks in the traditional method, the gamma norm is approximately unbiased to approximate the matrix rank function to construct the low-rank denoising model, the problem of poor estimation precision of the traditional matrix rank function approximation method is solved, and the non-convex problem is solved based on singular value decomposition. Simulation results show that compared with the existing PID, NLM, BM3D and NNM algorithms, the algorithm can obviously eliminate Gaussian noise, better avoid artifacts and detail blurring phenomena, and can restore original image details with higher precision.
Drawings
FIG. 1 is a flow chart of an implementation of the present invention;
FIG. 2 is a similar image block matrix construction process;
FIG. 3 is six test images;
FIG. 4 shows the denoising results (σ) of the House image by different algorithmsn50). (a) Noise image (b) PID (c) NLM (d) BM3D (e) NNM (f) algorithm;
FIG. 5 shows the denoising results (σ) of Boats images by different algorithmsn100). (a) Noise image (b) PID (c) NLM (d) BM3D (e) NNM (f).
Detailed Description
The invention is further described with reference to the following drawings and detailed description.
The specific steps of the image denoising algorithm based on the gamma norm minimization are as follows:
1. establishing a low-rank denoising model
The principle of the low-rank denoising method can be described as follows: dividing a noise image y of size M × N into N noise images of size M × NImage block yi1, 2.., n. Then searching the window with the size of L multiplied by L and the current image block yiM most similar image blocks are constructed into a similar image block matrix Y in the form of column vectorsi∈Rd×mI.e. Yi=(yi,1,yi,2,...,yi,m),yi,mRepresenting the current image block yiIs similar to the image block. Based on this, the low-rank denoising problem can be expressed as the following optimization problem:
wherein ,YiFor a matrix of noise-like image blocks, XiTo denoise the similar image block matrix, | ·| non-wovenFIs Frobenius norm, rank (X)i) Is a matrix Xiλ is a regularization parameter to balance the regularization term and the fidelity term.
2. Adaptive similar image block search
The Structural Similarity Index (SSIM) is a comprehensive image Similarity evaluation Index, which can evaluate the Similarity of two images by considering three different characteristics of brightness, contrast and structure between the images, and given two images x and y, the SSIM is defined as formula (5):
wherein ,μx,μy,σx 2,σy 2Mean and variance, σ, of the images x, y, respectivelyxyIs the covariance of the images x, y. Furthermore, C1=(k1L)2,C2=(k2L)2To ensure a constant with a denominator that is not zero, L255 is the maximum value of the pixel, k1=0.01,k20.03 is the default constant.
The main scheme of the self-adaptive similar image block search is as follows: given a current image block yiAnd the target data set is used for calculating the structural similarity indexes of the current image block and each image block of the target data set, wherein the larger the value of the structural similarity indexes is, the more similar the two image blocks are, and then m image blocks which are most similar to the current image block are searched. Wherein, the number m of similar image blocks needs to be determined adaptively according to the noise level. Then, each similar image block is converted into a column vector and is sequentially arranged from left to right according to the descending order of similarity to form a similar image block matrix YiThe construction process is shown in fig. 2.
3. Establishing a gamma norm minimization model
The gamma norm is a matrix extension of the non-convex MCP function, which can approximate the rank function nearly unbiased compared to the kernel norm of the biased estimate. Let singular value decomposition of matrix X be X ═ U Σ VTWherein U is [ U ═ U1,u2,...,un],V=[v1,v2,...,vn],Σ=diag(λ1,λ2,...,λn) And λ1≥λ2≥...≥λn≧ 0, then the gamma norm may be defined as follows:
wherein ,[x]+=max(x,0)。
Based on the characteristic that the gamma norm can approximate a rank function almost unbiased, the invention uses the low-rank term in the alternative formula (1) to construct a non-convex gamma norm minimum denoising model, which can be expressed as follows:
wherein ,YiFor the matrix of noise-like image blocks,to denoise the similar image block matrix, | Xi||γIs a matrix XiGamma norm of (d).
4. Proposed non-convex model solution
For convenience of description, let X be Xi,Y=YiThen the solution to the optimization problem (8) can be derived as follows:
through simple matrix operations, equation (9) can be re-expressed as:
fixed ui and viFor y (X) with respect to λiDifferentiating to obtain:
order toEquation (11) can be expressed as:
finishing to obtain:
wherein ,Sλ,γ(. cndot.) is a non-convex soft shrink operator. Will be provided withCan be substituted by the formula (10):
order toSince the first term at the right end of the above equation is independent of the variable X to be optimized, then y (X) the minimization problem with respect to X is equivalent toAbout ξiThe minimization problem of (2).Can be re-expressed as follows:
wherein ,when lambda is less than ξiWhen the gamma value is less than or equal to gamma,can be expressed as:
when ξiWhen the alpha value is larger than gamma value,can be expressed as:
to pairAbout ξiDifferentiating to obtain:
due to the fact thatTo make it possible toAbout ξiTake the minimum value ui and viThe left and right singular vectors corresponding to the minimum singular value of the matrix Y are respectively taken, and ξ is obtainedi=σi. Thus, the optimal solution of the gamma norm minimization problem (8) can be expressed as follows:
wherein ,is a singular value decomposition of the matrix Y, sigma1=diag(σ1,σ2,...,σn),Σλ,γ=diag(Sλ,γ(σ1),Sλ,γ(σ2),...,Sλ,γ(σn) ) is a diagonal matrix whose diagonal elements are:
the optimization problem is solved for each overlapped image block in sequence, and then all the denoised similar image block matrixes { X can be obtainedi1, 2.., n, and reconstructing each denoised image block into a denoised image x. In practical application, the steps can be repeatedly iterated to obtain better denoising performance.
The process of the image denoising algorithm based on the gamma norm minimization comprises the following steps:
inputting: noisy imagey
1: initialization:y(0)=y
2:for k=1:K
3: iterative regularization:
4:fory(k)of each overlapping image block yi
5: similar image block matrix Y constructed based on SSIM image block searching methodi
6: for YiSingular value decomposition: [ U, Σ, V)]=SVD(Yi)
7: evaluating an estimation value based on the model of formula (8):
8:end for
9: polymerization of XiTo reconstruct a denoised image
10:end for
And (3) outputting: de-noised image
And 3, the iterative regularization process is used for improving the denoising performance of the algorithm.
The beneficial effects of the present invention can be further illustrated by the following experiments:
the experimental conditions are as follows:
to verify the denoising performance of the proposed algorithm, six images in a standard image library were selected for testing, which are 256 × 256Monarch, 720 × 576Boats, 512 × 512Lena, 512 × 512 peper, 256 × 256House and 720 × 576Barbara images, respectively, as shown in fig. 3. PID, NLM, BM3D and NNM algorithms are adopted as comparison algorithms, and the comparison algorithms are compared with the proposed algorithms respectively from two aspects of denoising performance and running time. The experimental environment is as follows: the processor Intel Core i7-7700, the main frequency 3.60GHz, the memory 8GB, the operating system 64 bits Windows 10, the simulation software Matlab R2014 a.
In order to quantitatively evaluate the denoising performance of the proposed algorithm, the invention adopts Peak Signal to Noise Ratio (PSNR) defined by Ghanbari M and the like as an evaluation index. Given two images x and y, the PSNR is defined as shown in equation (38):
where MSE represents the Mean Square Error (Mean Square Error) and mxn is the size of the two images.
According to the experiment, the search window size L × L is set to 30 × 30, and the image block sizeThe number m of similar image blocks and the iteration number K of the algorithm need to be determined in a self-adaptive mode according to the noise level. For the noise variance σn≤20,20<σn≤40,40<σn≤60 and σnNoise image > 60, the image block sizes are set to 6 × 6, 7 × 7, 8 × 8 and 9 × 9, respectively, and the number of similar image blocks m is set to 70, 90, 120 and 140, respectively. Accordingly, the number of iterations K is set to 8, 12, 14, and 14, respectively. The parameters δ, λ and γ are set to 0.1, 0.001 and 100, respectively.
The experimental contents are as follows:
experiment 1: zero-mean white gaussian noise is added to the six test images to generate a noise image. Due to space limitation, the invention only displays the denoising results of the four noise level algorithms. Wherein for the noise variance σn=10,σn=30,σn=50 and σnThe different algorithm denoise results are shown in table 1, with the experimental peak PSNR shown in bold, 100 gaussian white noise. As shown in Table 1, the denoising performance of the NLM algorithm is not obvious, and the proposed algorithm can obtain higher PSNR in almost every case. Compared with PID, NLM, BM3D and NNM algorithms, the PSNR of the algorithm is respectively and averagely improved by 0.32dB, 2.76dB, 0.35dB and 1.99dB, and the PSNR is changed along with the improvement of the noise levelIs better and more remarkable. The above phenomenon is because the proposed algorithm improves similar image block search accuracy by using SSIM for block matching, and improves matrix rank function approximation accuracy based on non-convex gamma norm. Therefore, compared with the other four algorithms, the algorithm has better denoising performance under different noise levels.
TABLE 1 PSNR comparison of different denoising algorithms
Experiment 2: for the noise variance σn50 House image and noise variance σnThe denoising results of different algorithms are shown in fig. 4 and 5, respectively, for a Boats image of 100. As can be seen from the figure, the NLM denoised image has a large-area fuzzy phenomenon and a poor denoising effect, which is caused by the fact that a large amount of noise exists in the similar image blocks searched by the NLM algorithm and only the weighted average similar image blocks are used for denoising. The NNM algorithm can effectively avoid the phenomenon of large-area blurring of images by using matrix low-rank prior, but the NNM algorithm can balance and process each singular value, so that the denoising images have the problems of blurring and losing key details and the like, for example, part of masts of a ship in FIG. 5(e) are obviously lost. The PID algorithm utilizes a spatial domain and frequency domain combined processing and annealing algorithm, so that the problem of loss of key details of a denoised image is effectively solved, and the detail blurring phenomenon still exists. The BM3D algorithm obtains a good denoising effect by using a joint filtering method, but the denoised image has a strong artifact phenomenon. The provided algorithm adopts a similar image block searching method based on a structural similarity index and utilizes a non-convex gamma norm approximate to an unbiased approximate matrix rank function to overcome the defects, so that the denoising performance of the algorithm is improved. As can be seen from fig. 4(f) and fig. 5(f), the artifact phenomenon of the de-noised image of the proposed algorithm is weak, and key detail features such as edges and textures can be better recovered. In conclusion, under the condition of different levels of Gaussian noise, the denoising performance of the algorithm is remarkably improved compared with other four algorithms, the phenomena of blurring and artifacts of a denoised image can be effectively avoided, and the key detail information of the original image can be well recovered.
Experiment 3: the time complexity is an important index for evaluating the running speed of the algorithm. From theoretical analysis, the time complexity of the PID algorithm is wherein ,σsStandard deviation of space domain Gaussian function; the time complexity of NLM algorithm is O (MNL)2d) (ii) a The time complexity of the BM3D algorithm isThe time complexity of NNM and proposed algorithm is O (K (MNL)2d+MN2)). From the above analysis, it can be seen that NNM and the proposed algorithm are time consuming compared to the other three algorithms due to singular value decomposition and multiple iterative operations. Six test images in the standard image library were selected for the evaluation of the average run times of the different algorithms on the above-mentioned computing platform, and the test results are shown in table 2. As can be seen from the table, the BM3D algorithm runs much faster than the other four algorithms, and the average time consumption is short. The main reasons are that the frequency domain discrete Fourier transform operation adopted by the PID algorithm, the image block extraction and similar image block search operation adopted by the NLM, the NNM and the proposed algorithm are time-consuming, and the NNM and the proposed algorithm have long operation time because of singular value decomposition and multiple iterative denoising operations on a similar image block matrix. However, although the BM3D algorithm includes image block extraction and similar image block search operations, the algorithm is significantly accelerated due to the optimized code. In addition, the running time of the algorithm is similar to that of the NNM algorithm, but the average time consumption is longer than that of the NNM algorithm due to the adoption of the similar image block searching method based on the structural similarity index. However, the benefit obtained by sacrificing the operation speed is that the denoising performance of the proposed algorithm is outstanding under different noise levels, not only gaussian noise can be better eliminated, but also artifacts and detail blurring phenomena can be better avoided.
Table 2 average run time comparison of different algorithms
Algorithm | PID | NLM | BM3D | NNM | Proposed algorithm |
Mean time(s) | 307 | 132 | 3 | 462 | 473 |
In summary, the invention provides an image denoising algorithm based on gamma norm minimization, aiming at the problems of artifacts and detail blurring of denoised images under the Gaussian noise condition, based on a non-convex gamma norm which can approximate to an unbiased approximate rank function and a low-rank denoising model. Firstly, the noise image is overlapped and partitioned, and a similar image block matrix is constructed by adopting a block matching algorithm based on SSIM, so that the defect that similar image block searching is inaccurate in the traditional method is avoided. And then, constructing a low-rank denoising model by using a non-convex gamma norm which is approximate to an unbiased approximate rank function, thereby solving the problem of poor estimation accuracy of the traditional rank function approximation method. And finally, solving the obtained non-convex problem based on singular value decomposition and recombining the de-noised image blocks to obtain a de-noised image. Simulation results show that compared with the existing mainstream algorithm, the algorithm can better eliminate Gaussian noise and can better avoid artifacts and detail blurring phenomena.
Claims (2)
1. The image denoising algorithm based on the gamma norm minimization is characterized by comprising the following steps of:
firstly, establishing a low-rank denoising model
The principle of the low-rank denoising method can be described as follows: dividing a noise image y of size M × N into N noise images of size M × NImage block yiI 1, 2.. times.n, and then searching for the current image block y in a window of size lxliM most similar image blocks are constructed into a similar image block matrix Y in the form of column vectorsi∈Rd×mI.e. Yi=(yi,1,yi,2,…,yi,m),yi,mRepresenting the current image block yiThe m-th similar image block of (b),
based on this, the low-rank denoising problem can be expressed as the following optimization problem:
wherein ,YiFor a matrix of noise-like image blocks, XiTo denoise the similar image block matrix, | ·| non-wovenFIs Frobenius norm, rank (X)i) Is a matrix Xiλ is a regularization parameter to balance the regularization term and the fidelity term;
adaptive similar image block search
The Structural Similarity Index (SSIM) is a comprehensive image Similarity evaluation Index, which can evaluate the Similarity of two images by considering three different characteristics of brightness, contrast and structure between the images, and given two images x and y, the SSIM is defined as formula (5):
wherein ,μx,μy,σx 2,σy 2Mean and variance, σ, of the images x, y, respectivelyxyIs the covariance of the image x, y, and, in addition, C1=(k1L)2,C2=(k2L)2To ensure a constant with a denominator that is not zero, L255 is the maximum value of the pixel, k1=0.01,k20.03 is the default constant;
the main scheme of the self-adaptive similar image block search is as follows: given a current image block yiAnd a target data set, calculating the structural similarity index of the current image block and each image block of the target data set, wherein the larger the value of the structural similarity index is, the larger the structural similarity index is, the structural similarity index isThe two image blocks are more similar to each other, and then m image blocks most similar to the current image block are searched, wherein the number m of the similar image blocks needs to be determined in a self-adaptive manner according to the noise level, then all the similar image blocks are converted into column vectors, and the column vectors are sequentially arranged from left to right according to the descending order of the similarity to form a similar image block matrix Yi;
Thirdly, establishing a gamma norm minimization model
The gamma norm is a matrix extension of the non-convex MCP function, which can approximate the rank function almost unbiased compared to the kernel norm with biased estimation, assuming that the singular value of matrix X is decomposed into X ═ U Σ VTWherein U is [ U ═ U1,u2,…,un],V=[v1,v2,...,vn],Σ=diag(λ1,λ2,...,λn) And λ1≥λ2≥...≥λn≧ 0, then the gamma norm may be defined as follows:
wherein ,[x]+=max(x,0);
Based on the characteristic that the gamma norm can approximate to a rank function almost unbiased, a non-convex gamma norm minimization denoising model is constructed by using a low-rank term in the alternative expression (1), and the non-convex gamma norm minimization denoising model can be expressed as follows:
wherein ,YiFor the matrix of noise-like image blocks,to denoise the similar image block matrix, | Xi||γIs a matrix XiThe gamma norm of (d);
solving the proposed non-convex model
For convenience of description, let X be Xi,Y=YiThen the solution to the optimization problem (5) can be derived as follows:
through simple matrix operations, equation (6) can be re-expressed as:
fixed ui and viFor y (X) with respect to λiDifferentiating to obtain:
order toEquation (8) can be expressed as:
finishing to obtain:
wherein ,Sλ,γ(. is a non-convex soft shrink operator, willCan be substituted by the formula (7):
order toSince the first term at the right end of the above equation is independent of the variable X to be optimized, then y (X) the minimization problem with respect to X is equivalent toAbout ξiThe problem of minimization of (a) is,can be re-expressed as follows:
wherein ,when lambda is less than ξiWhen the gamma value is less than or equal to gamma,can be expressed as:
when ξiWhen the alpha value is larger than gamma value,can be expressed as:
to pairAbout ξiDifferentiating to obtain:
due to the fact thatTo make it possible toAbout ξiTake the minimum value ui and viThe left and right singular vectors corresponding to the minimum singular value of the matrix Y are respectively taken, and ξ is obtainedi=σi,
Thus, the optimal solution of the gamma norm minimization problem (5) can be expressed as follows:
wherein ,Y=U1Σ1V1 TIs a singular value decomposition of the matrix Y, sigma1=diag(σ1,σ2,...,σn),Σλ,γ=diag(Sλ,γ(σ1),Sλ,γ(σ2),...,Sλ,γ(σn) ) is a diagonal matrix whose diagonal elements are:
the optimization problem is solved for each overlapped image block in sequence, and then all the denoised similar image block matrixes { X can be obtainediAnd (4) reconstructing each denoised image block into a denoised image x, wherein the steps can be repeatedly iterated in practical application.
2. The image denoising algorithm based on gamma norm minimization of claim 1, wherein the algorithm flow is as follows:
inputting: noisy image y
1: initialization:
2:for k=1:K
3: iterative regularization:
4:for y(k)of each overlapping image block yi
5: similar image block matrix Y constructed based on SSIM image block searching methodi
6: for YiSingular value decomposition: [ U, Σ, V)]=SVD(Yi)
7: evaluating an estimation value based on the model of the formula (5):
8:end for
9: polymerization of XiTo reconstruct a denoised image
10:end for
And (3) outputting: de-noised image
And 3, the iterative regularization process is used for improving the denoising performance of the algorithm.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811492110.9A CN109671029B (en) | 2018-12-07 | 2018-12-07 | Image denoising method based on gamma norm minimization |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811492110.9A CN109671029B (en) | 2018-12-07 | 2018-12-07 | Image denoising method based on gamma norm minimization |
Publications (2)
Publication Number | Publication Date |
---|---|
CN109671029A true CN109671029A (en) | 2019-04-23 |
CN109671029B CN109671029B (en) | 2023-05-02 |
Family
ID=66144720
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201811492110.9A Active CN109671029B (en) | 2018-12-07 | 2018-12-07 | Image denoising method based on gamma norm minimization |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109671029B (en) |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110287819A (en) * | 2019-06-05 | 2019-09-27 | 大连大学 | Moving target detection method under dynamic background based on low-rank and sparse decomposition |
CN110310234A (en) * | 2019-05-17 | 2019-10-08 | 浙江工业大学 | The facial image denoising method and device with Shannon fully differential are approached based on low-rank |
CN110349112A (en) * | 2019-07-16 | 2019-10-18 | 山东工商学院 | A kind of two stages image de-noising method based on adaptive singular value threshold value |
CN111161184A (en) * | 2019-12-27 | 2020-05-15 | 广东工业大学 | Rapid MR image denoising method based on MCP sparse constraint |
CN112686814A (en) * | 2020-12-25 | 2021-04-20 | 国家电网有限公司 | Affine low-rank based image denoising method |
CN112785528A (en) * | 2021-02-01 | 2021-05-11 | 南京信息工程大学 | Image denoising method based on self-adaptive block rotary filtering |
CN112927169A (en) * | 2021-04-06 | 2021-06-08 | 江苏海洋大学 | Remote sensing image denoising method based on wavelet transformation and improved weighted nuclear norm minimization |
CN113793278A (en) * | 2021-09-13 | 2021-12-14 | 江苏海洋大学 | Improved remote sensing image denoising method with minimized weighted nuclear norm and selectively enhanced Laplace operator |
CN114240772A (en) * | 2021-11-23 | 2022-03-25 | 合肥工业大学 | Image denoising method combining multi-scale with generalized nuclear norm |
CN114820387A (en) * | 2022-05-27 | 2022-07-29 | 山东财经大学 | Image recovery method and terminal based on probability induced kernel norm minimization |
CN117012055A (en) * | 2023-08-14 | 2023-11-07 | 河南新电信息科技有限公司 | Intelligent early warning system and method for right dead zone of dangerous goods transport vehicle |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170221234A1 (en) * | 2016-01-29 | 2017-08-03 | Wisconsin Alumni Research Foundation | System and method for denoising medical images by enforcing low rank spatial-temporal or spatial-spectral image matrices |
CN108765313A (en) * | 2018-05-02 | 2018-11-06 | 西北工业大学 | High spectrum image denoising method based on low-rank representation in class |
CN108876750A (en) * | 2018-07-05 | 2018-11-23 | 湖南师范大学 | A method of the image based on non local similitude low-rank matrix removes poisson noise |
-
2018
- 2018-12-07 CN CN201811492110.9A patent/CN109671029B/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170221234A1 (en) * | 2016-01-29 | 2017-08-03 | Wisconsin Alumni Research Foundation | System and method for denoising medical images by enforcing low rank spatial-temporal or spatial-spectral image matrices |
CN108765313A (en) * | 2018-05-02 | 2018-11-06 | 西北工业大学 | High spectrum image denoising method based on low-rank representation in class |
CN108876750A (en) * | 2018-07-05 | 2018-11-23 | 湖南师范大学 | A method of the image based on non local similitude low-rank matrix removes poisson noise |
Non-Patent Citations (3)
Title |
---|
ZHIYUAN ZHA 等: "Group Sparsity Residual Constraint for Image Denoising with External Nonlocal Self-Similarity Prio", 《NEUROCOMPUTING (2017)》 * |
张怡婷等: "基于L_(2,1)范数正则化矩阵分解的图像结构化噪声平滑算法", 《南昌大学学报(理科版)》 * |
彭真明 等: "基于稀疏表示及正则约束的图像去噪方法综述", 《JOURNAL OF DATA ACQUISITION AND PROCESSING》 * |
Cited By (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110310234A (en) * | 2019-05-17 | 2019-10-08 | 浙江工业大学 | The facial image denoising method and device with Shannon fully differential are approached based on low-rank |
CN110287819A (en) * | 2019-06-05 | 2019-09-27 | 大连大学 | Moving target detection method under dynamic background based on low-rank and sparse decomposition |
CN110287819B (en) * | 2019-06-05 | 2023-06-02 | 大连大学 | Moving target detection method based on low rank and sparse decomposition under dynamic background |
CN110349112A (en) * | 2019-07-16 | 2019-10-18 | 山东工商学院 | A kind of two stages image de-noising method based on adaptive singular value threshold value |
CN110349112B (en) * | 2019-07-16 | 2024-02-23 | 山东工商学院 | Two-stage image denoising method based on self-adaptive singular value threshold |
CN111161184B (en) * | 2019-12-27 | 2022-03-25 | 广东工业大学 | Rapid MR image denoising method based on MCP sparse constraint |
CN111161184A (en) * | 2019-12-27 | 2020-05-15 | 广东工业大学 | Rapid MR image denoising method based on MCP sparse constraint |
CN112686814A (en) * | 2020-12-25 | 2021-04-20 | 国家电网有限公司 | Affine low-rank based image denoising method |
CN112686814B (en) * | 2020-12-25 | 2023-03-03 | 国家电网有限公司 | Affine low-rank based image denoising method |
CN112785528B (en) * | 2021-02-01 | 2022-08-02 | 南京信息工程大学 | Image denoising method based on self-adaptive block rotary filtering |
CN112785528A (en) * | 2021-02-01 | 2021-05-11 | 南京信息工程大学 | Image denoising method based on self-adaptive block rotary filtering |
CN112927169A (en) * | 2021-04-06 | 2021-06-08 | 江苏海洋大学 | Remote sensing image denoising method based on wavelet transformation and improved weighted nuclear norm minimization |
CN112927169B (en) * | 2021-04-06 | 2023-08-15 | 江苏海洋大学 | Remote sensing image denoising method based on wavelet transformation and improved weighted kernel norm minimization |
CN113793278A (en) * | 2021-09-13 | 2021-12-14 | 江苏海洋大学 | Improved remote sensing image denoising method with minimized weighted nuclear norm and selectively enhanced Laplace operator |
CN113793278B (en) * | 2021-09-13 | 2023-06-23 | 江苏海洋大学 | Remote sensing image denoising method based on Laplace operator selectivity enhancement |
CN114240772A (en) * | 2021-11-23 | 2022-03-25 | 合肥工业大学 | Image denoising method combining multi-scale with generalized nuclear norm |
CN114240772B (en) * | 2021-11-23 | 2024-07-02 | 合肥工业大学 | Image denoising method combining multiple scales with generalized kernel norms |
CN114820387A (en) * | 2022-05-27 | 2022-07-29 | 山东财经大学 | Image recovery method and terminal based on probability induced kernel norm minimization |
CN117012055A (en) * | 2023-08-14 | 2023-11-07 | 河南新电信息科技有限公司 | Intelligent early warning system and method for right dead zone of dangerous goods transport vehicle |
Also Published As
Publication number | Publication date |
---|---|
CN109671029B (en) | 2023-05-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109671029B (en) | Image denoising method based on gamma norm minimization | |
CN112200750B (en) | Ultrasonic image denoising model establishing method and ultrasonic image denoising method | |
CN105513026B (en) | One kind being based on the non local similar compressed sensing reconstructing method of image | |
CN104159003B (en) | A kind of cooperateed with based on 3D filters the video denoising method rebuild with low-rank matrix and system | |
Abiko et al. | Blind denoising of mixed Gaussian-impulse noise by single CNN | |
CN108932699B (en) | Three-dimensional matching harmonic filtering image denoising method based on transform domain | |
CN110751612A (en) | Single image rain removing method of multi-channel multi-scale convolution neural network | |
CN110992292A (en) | Enhanced low-rank sparse decomposition model medical CT image denoising method | |
CN112598711B (en) | Hyperspectral target tracking method based on joint spectrum dimensionality reduction and feature fusion | |
CN112598069B (en) | Hyperspectral target tracking method based on feature extraction and weight coefficient parameter updating | |
CN110830043B (en) | Image compressed sensing reconstruction method based on mixed weighted total variation and non-local low rank | |
CN104657951A (en) | Multiplicative noise removal method for image | |
CN114820352A (en) | Hyperspectral image denoising method and device and storage medium | |
Yang et al. | An improved weighted nuclear norm minimization method for image denoising | |
CN116563146A (en) | Image enhancement method and system based on leachable curvature map | |
CN107292855B (en) | Image denoising method combining self-adaptive non-local sample and low rank | |
CN112233046A (en) | Image restoration method under Cauchy noise and application thereof | |
CN109741258B (en) | Image super-resolution method based on reconstruction | |
CN115082336A (en) | SAR image speckle suppression method based on machine learning | |
CN112200752B (en) | Multi-frame image deblurring system and method based on ER network | |
TU et al. | MULTITEMPORAL IMAGE CLOUD REMOVAL USING GROUP SPARSITY AND NONCONVEX LOW-RANK APPROXIMATION. | |
Chen et al. | Learning blind denoising network for noisy image deblurring | |
CN115131226B (en) | Image restoration method based on wavelet tensor low-rank regularization | |
Yufeng et al. | Research on SAR image change detection algorithm based on hybrid genetic FCM and image registration | |
CN115953299A (en) | Infrared remote sensing image super-resolution method and system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |