CN110503113A - A kind of saliency object detection method restored based on low-rank matrix - Google Patents
A kind of saliency object detection method restored based on low-rank matrix Download PDFInfo
- Publication number
- CN110503113A CN110503113A CN201910801714.5A CN201910801714A CN110503113A CN 110503113 A CN110503113 A CN 110503113A CN 201910801714 A CN201910801714 A CN 201910801714A CN 110503113 A CN110503113 A CN 110503113A
- Authority
- CN
- China
- Prior art keywords
- low
- original image
- rank matrix
- matrix
- indicate
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/213—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods
- G06F18/2134—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods based on separation criteria, e.g. independent component analysis
- G06F18/21345—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods based on separation criteria, e.g. independent component analysis enforcing sparsity or involving a domain transformation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/213—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods
- G06F18/2135—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods based on approximation criteria, e.g. principal component analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
- G06V10/462—Salient features, e.g. scale invariant feature transforms [SIFT]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/56—Extraction of image or video features relating to colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/513—Sparse representations
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02T—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
- Y02T10/00—Road transport of goods or passengers
- Y02T10/10—Internal combustion engine [ICE] based vehicles
- Y02T10/40—Engine management systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Multimedia (AREA)
- Life Sciences & Earth Sciences (AREA)
- Evolutionary Computation (AREA)
- Evolutionary Biology (AREA)
- General Engineering & Computer Science (AREA)
- Bioinformatics & Computational Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Artificial Intelligence (AREA)
- Image Analysis (AREA)
Abstract
The invention discloses a kind of saliency object detection methods restored based on low-rank matrix, comprising: extracts color characteristic from original image, in conjunction with image superpixel, determines the eigenmatrix of original image;Low-rank matrix is decomposited from eigenmatrix;The sparse norm of the layering of original image is determined in conjunction with high-rise prior information according to the hierarchical index tree of index tree generation algorithm construction original image using image superpixel;Low-rank matrix is subjected to ternary decomposition, determines the structuring low-rank matrix Restoration model of original image;By the structuring low-rank matrix Restoration model fusion of the sparse norm of layering of original image and original image, and alternating direction optimization algorithm is combined, obtains notable figure.The method for accelerating singular value decomposition is decomposed present invention introduces low-rank matrix ternary, solves the problems, such as high computation complexity caused by minimizing matrix trace norm;Solve the unsupervised saliency target detection problems under complex background in conjunction with high-rise priori by construction index tree.
Description
Technical field
The present invention relates to technical field of image detection, and it is significant to more particularly relate to a kind of image restored based on low-rank matrix
Property object detection method.
Background technique
Conspicuousness target detection effectively can accurately divide foreground target from single scene, or from multiple images in fact
Existing cooperation detection.Currently, it is widely used to image segmentation, and content-based image retrieval, compression of images, image cut etc..
According to whether conspicuousness object detection method has been roughly divided into supervision and unsupervised two class using mark information.There is measure of supervision
Usually target detection is realized using deep learning model and large-scale training algorithm.Unsupervised approaches are decent without Large Scale Graphs
This, has better flexibility and lower computation complexity.
Unsupervised conspicuousness object detection method usually realizes fast target using high-rise priori and low layer significant characteristics
Detection.Achanta etc. positions conspicuousness target using color contrast prior information and center priori.In addition to color and center are first
Information is tested, Wei etc. positions target as background priori by calculating the geometric distance of conspicuousness target and image boundary.Shen etc.
In conjunction with different prior informations and Robust Principal Component Analysis (Robust Principal Component Analysis, RPCA), build
Found unified detection model.Lang etc. realizes that the conspicuousness target of region class generates by integrating different high-rise priori.Tang etc.
Infer that each image-region belongs to the probability of background using color, position and contour connection.Huo etc. establish one it is special
Linear Feedback Control Systems model, the model can receive multiple conspicuousness priori and characteristics of image.Liu et al. is estimated based on cuclear density
Meter proposes that a kind of non-ginseng conspicuousness target detection model, the model are generated pixel-by-pixel using project likelihood measurement and significance measure
Notable figure.Goferman etc. is based on part and global contrast devises a context attention salient region and extracts mould
Type, then multiscale contrast, center-surrounding histogram and Color-spatial distribution introduce condition random field, significant for being promoted
The quality of figure.In addition, the global characteristics contrast extracted on small echo and Fourier transform domain be also effective to it is unsupervised significant
Property target detection.
In above-mentioned unsupervised conspicuousness object detection method, the method based on low-rank matrix decomposition is because of its robustness and efficiently
Property attract wide attention, original image is decomposed into low-rank matrix and sparse matrix by this method, and wherein low-rank matrix is corresponding high
Spend the image background regions of redundancy, the conspicuousness foreground target region of sparse matrix correspondence image.However, these existing methods are logical
It is often used simple matrix norm induction sparse matrix, the structured message of saliency target is ignored, so as to cause life
At notable figure occur dissipating or imperfect phenomenon.In addition, these methods constrain low-rank matrix using matrix nuclear norm, cause to calculate
Method needs to execute singular value decomposition in each iteration, increases calculating cost.
Summary of the invention
The embodiment of the present invention provides a kind of saliency object detection method restored based on low-rank matrix, to solve
Problems of the prior art.
The embodiment of the present invention provides a kind of saliency object detection method restored based on low-rank matrix, comprising:
Color characteristic is extracted from original image, in conjunction with image superpixel, determines the eigenmatrix of original image;Pass through Shandong
Stick principal component analytical method, decomposites low-rank matrix from eigenmatrix;
Using image superpixel according to the hierarchical index tree of index tree generation algorithm construction original image, in conjunction with high-rise priori
Information determines the sparse norm of the layering of original image;
Low-rank matrix is subjected to ternary decomposition, determines the structuring low-rank matrix Restoration model of original image;
By the structuring low-rank matrix Restoration model fusion of the sparse norm of layering of original image and original image, and combine
Alternating direction optimization algorithm obtains notable figure.
Further, described that color characteristic is extracted from original image, in conjunction with image superpixel, determine the spy of original image
Levy matrix;It specifically includes:
Color characteristic is extracted from original image, and generates image superpixel { P using simple linear Iterative Clustering1,
P2..., Pn, wherein each super-pixel block PiA corresponding feature vector xiIt indicates, the eigenmatrix of original image isWherein,Indicate Euclidean space, D indicate feature vector dimension, n indicate feature to
Measure number.
Further, the sparse norm of the layering of the original image;It specifically includes:
Wherein, i-th layer of j-th of index tree nodeWeight be expressed as| | table
Show set element number, d indicates the number of plies of index tree, niIndicate every layer of tree node number, | | | |∞Indicate l∞Norm,
InIt indicates are as follows:
Wherein, m indicates the super-pixel number that i-th layer of j-th of tree node includes;Use position, color and contour connection three
A priori figure is fused to final high-rise priori figure, hmIndicate each super-pixel block PiThe correspondence of the corresponding high-rise priori figure of ∈ P
Value.
Further, described that low-rank matrix is subjected to ternary decomposition, determine that the structuring low-rank matrix of original image is restored
Model;It specifically includes:
Low-rank matrix is decomposed into the product L=QMR of three matrixes,
QTQ=I, RRT=I, wherein r < < min (m, n);Wherein, the dimension of Q is expressed as D × r, and the dimension of M is expressed as r × r, the dimension of R
Number is r × N, the order of r representing matrix L;
It is assumed that matrix Q and R are respectively provided with orthogonal row and column vector, i.e. QTQ=I, RRT=I, then equation | | QMR | |*=|
|M||*It sets up;According to above-mentioned relation | | L | |*=| | QMR | |*=| | M | |*, structuring low-rank matrix Restoration model is as follows:
S.t.X=L+S, L=QMR, QTQ=I, RRT=1
Wherein, | | M | |*Indicate the nuclear norm of M;It indicates to be layered sparse regular terms;α, β indicate coefficient of balance;Indicate manifold regular terms, and expression formula is as follows:
Wherein, SiIt is the i-th column of sparse matrix S;Indicate Laplacian Matrix, i.e. Lg=D-W, D are degree
Matrix;The mark of Tr () representing matrix;W indicates neighbour matrix of the super-pixel to generation, WI, jIndicate ith and jth super-pixel it
Between distance.
Further, the structuring low-rank matrix by the sparse norm of layering of original image and original image restores mould
Type fusion, and alternating direction optimization algorithm is combined, obtain notable figure;It specifically includes:
It is indicated after optimizing to structuring low-rank matrix Restoration model are as follows:
S.t.X=L+S, L=QMR, QTQ=I, RRT=I.
The derivation algorithm of model after optimization is derived as follows:
Using auxiliary variable E objective function is decomposed, model is expressed as after optimization:
S.t.X=QMR+S, QTQ=I, RRT=I, S=E.
The Augmented Lagrangian Functions of Optimized model after decomposition are indicated are as follows:
Wherein,WithIndicate Lagrange multiplier, μ > 0 indicates punishment parameter, uses friendship
For direction optimization algorithm minimumTo variable M, E, S, Q, R, Y1And Y2Alternately solve.
The embodiment of the present invention provides a kind of saliency object detection method restored based on low-rank matrix, with existing skill
Art is compared, and its advantages are as follows:
The present invention proposes a kind of conspicuousness target detection side for merging quick low-rank matrix and decomposing with being layered sparse regularization
Method, the method for introducing low-rank matrix ternary decomposition quickening singular value decomposition, the graphical rule for reducing singular value decomposition, reduction calculate
Complexity is asked to reduce the scale of singular value decomposition and solve high computation complexity caused by minimizing matrix trace norm
Topic.By constructing index tree, in conjunction with high-rise priori, it will be layered sparse regularization and matrix low rank decomposition effective integration, introduce and divide
The sparse regularization of layer promotes the conspicuousness target detection performance under complex background, and the unsupervised image solved under complex background is significant
Property target detection problems.
Detailed description of the invention
Fig. 1 is conspicuousness target detection frame provided in an embodiment of the present invention;
Fig. 2 a is the PR curve comparison figure on iCoSeg data set provided in an embodiment of the present invention with traditional algorithm;
Fig. 2 b is the PR curve comparison figure on iCoSeg data set provided in an embodiment of the present invention with classic algorithm;
Fig. 3 a is the F-measure curve comparison on iCoSeg data set provided in an embodiment of the present invention with traditional algorithm
Figure;
Fig. 3 b is the F-measure curve comparison on iCoSeg data set provided in an embodiment of the present invention with mainstream algorithm
Figure;
Fig. 4 a is the PR curve comparison figure on SOD data set provided in an embodiment of the present invention with traditional algorithm;
Fig. 4 b is the PR curve comparison figure on SOD data set provided in an embodiment of the present invention with mainstream algorithm;
Fig. 5 a is the F-measure curve comparison figure on ECSSD data set provided in an embodiment of the present invention with traditional algorithm;
Fig. 5 b is the F-measure curve comparison figure on ECSSD data set provided in an embodiment of the present invention with mainstream algorithm;
Fig. 6 is the notable figure that each algorithm provided in an embodiment of the present invention generates.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
Referring to Fig. 1, the embodiment of the present invention provides a kind of saliency object detection method restored based on low-rank matrix,
This method comprises:
Step 1: extracting color characteristic from original image, in conjunction with image superpixel, determine the eigenmatrix of original image;
By Robust Principal Component Analysis method, low-rank matrix is decomposited from eigenmatrix.
Step 2: using image superpixel according to the hierarchical index tree of index tree generation algorithm construction original image, in conjunction with height
Layer prior information, determines the sparse norm of the layering of original image.
Step 3: low-rank matrix being subjected to ternary decomposition, determines the structuring low-rank matrix Restoration model of original image.
Step 4: using the structuring low-rank matrix Restoration model of the sparse norm constraint image of layering of original image, in conjunction with
Alternating direction optimization algorithm obtains notable figure.
For being described as follows for above-mentioned steps 1~4:
Color characteristic is extracted from original image first, generates image superpixel followed by simple linear Iterative Clustering
{P1, P2..., Pn}.Wherein each super-pixel block PiA corresponding feature vector xiIt indicates.Therefore, original image can be expressed as
One eigenmatrix
In order to which the sparse regularization method of effective integrated structureization promotes significant map generalization quality.Utilize the super-pixel of generation
According to the hierarchical index tree of index tree generation algorithm construction original image, the hierarchical structure for obtaining image is indicated.It is then based on rope
The sparse norm of layering for drawing tree definition image is as follows:
Wherein, i-th layer of j-th of index tree nodeWeight be expressed as| | table
Show set element number, d indicates the number of plies of index tree, niIndicate every layer of tree node number, | | | |∞Indicate l∞Norm, should
Foreground and background region can effectively be divided by being layered sparse norm, whereinIndicate the corresponding high-rise Posterior weight of each tree node
Weight, is defined as follows:
Wherein, m indicates the super-pixel number that i-th layer of j-th of tree node includes;Use position, color and contour connection three
A priori figure is fused to final high-rise priori figure, hmIndicate each super-pixel block PiThe respective value of the corresponding high-rise priori figure of ∈ P
Eigenmatrix X can be decomposed into the corresponding low-rank matrix L of image background by classical Robust Principal Component Analysis method
Sparse matrix S corresponding with prospect conspicuousness target.But each iteration of algorithm needs to carry out singular value decomposition, complexity compared with
It is high.For this purpose, order is rxLow-rank matrix be decomposed into the products of three matrixes, i.e. L=QMR,QTQ=I, RRT=I, wherein r < < min (m, n).
It is theoretical: it is assumed that matrix Q and R are respectively provided with orthogonal row and column vector, i.e. QTQ=I, RRT=I, then equation | | QMR |
|*=| | M | |*It sets up.
Above-mentioned theory can be derived | | L | |*=| | QMR | |*=| | M | |*.It is therefore proposed that following structuring low-rank matrix
Restoration model:
S.t.X=L+S, L=QMR, QTQ=I, RRT=I
Wherein, | | M | |*Indicate the nuclear norm of M;It indicates to be layered sparse regular terms;α, β indicate coefficient of balance;It indicates manifold regular terms, is defined as follows:
Wherein, SiIt is the i-th column of sparse matrix S;Indicate Laplacian Matrix, i.e. Lg=D-W, D are degree
Matrix;The mark of Tr () representing matrix;W indicates neighbour matrix of the super-pixel to generation, wI, jIndicate ith and jth super-pixel it
Between distance.
Based on discussed above, optimization problem above formula can be indicated are as follows:
S.t.X=L+S, L=QMR, QTQ=I, RRT=I.
The derivation algorithm of above-mentioned Optimized model derives as follows:
Firstly, using auxiliary variable E objective function can be divided, optimization problem conversion are as follows:
S.t.X=QMR+S, QTQ=I, RRT=I, S=E.
Then, the Augmented Lagrangian Functions for optimizing the above problem indicate are as follows:
Wherein,WithIndicate Lagrange multiplier, μ > 0 indicates punishment parameter, uses friendship
For direction optimization algorithm minimumTo variable M, E, S, Q, R, Y1And Y2Alternately solve.
Structuring low-rank matrix ternary decomposition algorithm is as follows:
Input: eigenmatrix X, parameter alpha β, index treeWeightOrder upper bound r.
Output:L=QMR and S.
1: initialization Q0=0, M0=0, R0=eye (r, N), S0=0, E0=0,μ0: 0.1,
μmax=1010, ρ=1.1, ε=10-5K=0.
2: judging whether to restrain | | X-QkMkRk-Sk||∞< ε and | | Sk-Ek||∞< ε,
If so, terminating, (13) are gone to, otherwise recycle (3)-(12).
3:
4:
5:
6:
7:
8:
9:
10: μk+1=min (ρ μk, μmax)
11:k=k+1
12: going to (3) and continue cycling through
13: returning to Lk=QkMkRkAnd Sk.
Using alternating direction method, each variable in Augmented Lagrangian Functions is updated respectively:
1) Q is updatedk+1And Rk+1
Its dependent variable is fixed, the optimization subproblem about Q indicates are as follows:
s.t.QTQ=I,
Wherein,
The above problem is the least square problem under an orthogonality constraint, fixed Mk, Rk, SkWithTwo matrixes Q and Mk
Product beWhereinRepresenting matrix RkPseudoinverse, can with meet constraint Rk
(Rk)T(the R of=Ik)TInstead of.Qk+1It can calculate according to the following formula:
Qk+1=QR (QMk)=QR (Z (Rk)T),
Wherein, QR () indicates QR decomposition operator.Similarly, Rk+1It calculates as follows:
(Rk+1)T=QR ((Qk+1)TZ)
2) M is updatedk+1
Its dependent variable is fixed, the optimization subproblem about M is as follows:
And there is following closed solution:
Wherein, SVTμ(X)=Udiag (max (σ-μ, 0)) VTIndicate singular value threshold operator,Indicate the singular value of X, i.e. X=Udiag (σ) VT,
3) E is updatedk+1
Fixed Mk+1, Sk, Qk+1, Rk+1,WithDerive following optimization subproblem:
To variable E derivation, can obtain:
4) S is updatedk+1
Optimization subproblem about S is expressed as follows:
Wherein, λ=α/(2 μk),
The above problem can be solved by layering neighbour's operator.
Algorithm complexity analysis
To matrix (Qk+1)TZ(Rk+1)TCarry out singular value decomposition time complexity beQR is decomposed and matrix multiple
Time complexity isTherefore, structuring low-rank matrix ternary decomposes total time complexity and isWherein t indicates the number of iterations.R < < D, N in practical application, therefore algorithm
Computation complexity is reduced to
Embodiment
Notable figure generation and experimental verification, while the conspicuousness target detection with prevalence are carried out for above-mentioned model and algorithm
Algorithm compares and analyzes.The best algorithm of these current performances includes SMD, WLRR, DRFI, RBD and DSR and other nothings
Supervise conspicuousness algorithm of target detection.
The selection of data set
As shown in table 1, experiment proposes the robustness of algorithm, these data sets using the data set under different condition, test
Including the simple background data set SOD and iCoSeg of multiple target and multiple target complex background data set ECSSD.All algorithms are equal
Using Matlab2016 (a) environment, test and right is carried out using Intel Duo double-core CPU i5-6200U and memory 8GB configuration
Than.
The description of 1 data set of table
Model parameter setting and evaluation index
The dimension of eigenmatrix is 200 × 75, and wherein super-pixel number is 200, the corresponding feature vector of each super-pixel block
Dimension is 75.The number of plies of index tree is set as 5 layers.Parameter σ in objective function2=0.05, balance parameters α and β are respectively set
For 0.5 and 1.0.Estimated using QR decomposition algorithm in the upper bound of the order of the low-rank matrix of input.
Evaluation index includes PR curve, F-measure curve, mean absolute error MAE, area (AUC) under ROC curve,
Duplication (OR) and weighting F-measure (WF) score.It is bent that PR and F-measure wherein is generated by the way that different threshold values is arranged
Line.
Experiment test is carried out on different data sets, and verifying proposes the validity of algorithm:
1) the simple background of multiple target
Firstly, the algorithm that background data set SOD simple to multiple target and iCoSeg test proposes.Fig. 2 a Fig. 2 b, Fig. 3 a, figure
PR and F-measure curve is set forth in 3b.According to PR curve, the algorithm of proposition and the performance of SMD algorithm are better than its other party
Method.And as can be seen that the algorithm and SMD algorithm that propose are insensitive for threshold value from Fig. 3 a, Fig. 3 b, and other methods only exist
A certain range could obtain preferable detection effect.In addition, the performance of DRFI is also preferable, but it is that a kind of shallow-layer has supervision mould
Type, needs preparatory training, and the method proposed be it is unsupervised, can directly carry out target detection, therefore more deemed-to-satisfy4 than DRFI
Can be more preferable, it is also more flexible.The algorithm and SMD algorithm performance of proposition are suitable, but the algorithm proposed is because used efficient knot
Structure low-rank matrix ternary decomposition algorithm, thus it is more efficient, and the runing time comparison of the two is shown in Table 2.
2) multiple target complex background
Under complex background, the performance of each algorithm will receive larger impact, pass through the multiple target under test complex background condition
Detection performance can compare the robustness of each algorithm.Multiple target complicated image SOD and ECSSD are tested in experiment.Figure
Each algorithm is set forth in the PR curve on SOD data set and the F- on ECSSD data set in 4a, Fig. 4 b, Fig. 5 a, Fig. 5 b
Measure curve.As can be seen that the algorithm and SMD algorithm performance that propose are suitable from Fig. 4 a, Fig. 4 b.DRFI achieves best
Performance, but DRFI has supervision, needs training pattern in advance.In addition, from Fig. 5 a, Fig. 5 b, the algorithm of proposition compared with
Big threshold range is substantially better than DRFI algorithm, and DRFI only obtains relatively high F-measure in the lesser situation of threshold value
Index, but index still is below index of the proposition method in other threshold ranges.Therefore, comprehensive two more mesh of complex background
Data set is marked, the algorithm of proposition is not only not necessarily to preparatory training, but also overall target is better than other algorithms.Illustrate the algorithm pair proposed
The interference robust of complex background is stronger.
3) with the Experimental comparison of SMD
As seen from the above analysis, the performance of the algorithm of proposition and SMD algorithm is suitable.Below from the notable figure of generation and
Two aspect of runing time further carries out experimental analysis to the algorithm of proposition and SMD.Fig. 6 is showed under the conditions of giving different images
The notable figure that best algorithm generates.From fig. 6 it can be seen that the significant plot quality that the algorithm and SMD algorithm that propose generate is bright
It is aobvious to be better than other algorithms.But the algorithm proposed can extract the conspicuousness target of more details, such as the first row in Fig. 6, can be with
Notable figure that SMD algorithm generates is found out there are certain details missing, and the algorithm proposed is better than introducing structuring low-rank square
Battle array ternary is decomposed, and is had better low-rank matrix recovery effects, can utmostly be separated foreground and background image.In addition, right
Analysis comparison is carried out in the algorithm of proposition and the runing time of SMD, the results are shown in Table 2.Super-pixel quantity is more, feature square
Battle array becomes larger, and the runing time of algorithm is longer, but the algorithm speed of service proposed in this paper is faster, and eigenmatrix is bigger, fortune
Line efficiency is about obvious.The performance evaluation of comprehensive each index of different data collection it can be concluded that, method proposed by the present invention it is comprehensive
It can be optimal in all methods.
2 runing time of table compares (dividing)
In conclusion enhancing the image Shandong to background complexity to promote the efficiency of the unsupervised algorithm of target detection of tradition
Stick.The present invention proposes the conspicuousness object detection method that a kind of fusion low-rank matrix ternary decomposes and is layered sparse regularization,
Low-rank matrix ternary solves the problems, such as the high computation complexity of singular value decomposition, is layered sparse regularization and solves to pass under complex background
The system weak robustness problem of conspicuousness target detection, by testing the image under different condition, the results showed that the present invention mentions
Method out is better than other unsupervised conspicuousness algorithm of target detection, and has lower time complexity.
Disclosed above is only several specific embodiments of the invention, and those skilled in the art can carry out the present invention
Various modification and variations without departing from the spirit and scope of the present invention, if these modifications and changes of the present invention belongs to the present invention
Within the scope of claim and its equivalent technologies, then the present invention is also intended to include these modifications and variations.
Claims (5)
1. a kind of saliency object detection method restored based on low-rank matrix characterized by comprising
Color characteristic is extracted from original image, in conjunction with image superpixel, determines the eigenmatrix of original image;Pass through robust master
Component analyzing method decomposites low-rank matrix from eigenmatrix;
Using image superpixel according to the hierarchical index tree of index tree generation algorithm construction original image, believe in conjunction with high-rise priori
Breath, determines the sparse norm of the layering of original image;
Low-rank matrix is subjected to ternary decomposition, determines the structuring low-rank matrix Restoration model of original image;
It is excellent in conjunction with alternating direction using the structuring low-rank matrix Restoration model of the sparse norm constraint image of layering of original image
Change algorithm, obtains notable figure.
2. the saliency object detection method restored as described in claim 1 based on low-rank matrix, which is characterized in that institute
It states and extracts color characteristic from original image, in conjunction with image superpixel, determine the eigenmatrix of original image;It specifically includes:
Color characteristic is extracted from original image, and generates image superpixel { P using simple linear Iterative Clustering1,
P2..., Pn, wherein each super-pixel block PiA corresponding feature vector xiIt indicates, the eigenmatrix of original image isWherein,Indicate Euclidean space, D indicate feature vector dimension, n indicate feature to
Measure number.
3. the saliency object detection method restored as claimed in claim 2 based on low-rank matrix, which is characterized in that institute
State the sparse norm of layering of original image;It specifically includes:
Wherein, i-th layer of j-th of index tree nodeWeight be expressed as | | indicate set
Element number, d indicate the number of plies of index tree, niIndicate every layer of tree node number, | | | |∞Indicate l∞Norm, whereinTable
It is shown as:
Wherein, m indicates the super-pixel number that i-th layer of j-th of tree node includes;Use three position, color and contour connection elder generations
It tests figure and is fused to final high-rise priori figure, hmIndicate each super-pixel block PiThe respective value of the corresponding high-rise priori figure of ∈ P.
4. the saliency object detection method restored as claimed in claim 3 based on low-rank matrix, which is characterized in that institute
It states and low-rank matrix is subjected to ternary decomposition, determine the structuring low-rank matrix Restoration model of original image;It specifically includes:
Low-rank matrix is decomposed into the product L=QMR of three matrixes,QTQ=
I, RRT=I, wherein r < < min (m, n);Wherein, the dimension of Q is expressed as D × r, and the dimension of M is expressed as r × r, and the dimension of R is
The order of r × N, r representing matrix L;
It is assumed that matrix Q and R are respectively provided with orthogonal row and column vector, i.e. QTQ=I, RRT=I, then equation | | QMR | |*=| | M | |*
It sets up;According to above-mentioned relation | | L | |*=| | QMR | |*=| | M | |*, structuring low-rank matrix Restoration model is as follows:
St.X=L+S, L=QMR, QTQ=I, RRT=1
Wherein, | | M | |*Indicate the nuclear norm of M;It indicates to be layered sparse regular terms;α, β indicate coefficient of balance;Table
Show manifold regular terms, and expression formula is as follows:
Wherein, SiIt is the i-th column of sparse matrix S;Indicate Laplacian Matrix, i.e. Lg=D-W, D are degree matrix;
The mark of Tr () representing matrix;W indicates neighbour matrix of the super-pixel to generation, wI, jIt indicates between ith and jth super-pixel
Distance.
5. the saliency object detection method restored as claimed in claim 4 based on low-rank matrix, which is characterized in that institute
The structuring low-rank matrix Restoration model fusion by the sparse norm of layering of original image and original image is stated, and combines alternating side
To optimization algorithm, notable figure is obtained;It specifically includes:
It is indicated after optimizing to structuring low-rank matrix Restoration model are as follows:
S.t.X=L+S, L=QMR, QTQ=I, RRT=I.
The derivation algorithm of model after optimization is derived as follows:
Using auxiliary variable E objective function is decomposed, model is expressed as after optimization:
S.t.X=QMR+S, QTQ=I, RRT=I, S=E.
The Augmented Lagrangian Functions of Optimized model after decomposition are indicated are as follows:
Wherein,WithIndicate Lagrange multiplier, μ > 0 indicates punishment parameter, uses alternating direction
Optimization algorithm minimizesTo variable M, E, S, Q, R, Y1And Y2Alternately solve.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910801714.5A CN110503113B (en) | 2019-08-28 | 2019-08-28 | Image saliency target detection method based on low-rank matrix recovery |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910801714.5A CN110503113B (en) | 2019-08-28 | 2019-08-28 | Image saliency target detection method based on low-rank matrix recovery |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110503113A true CN110503113A (en) | 2019-11-26 |
CN110503113B CN110503113B (en) | 2023-07-28 |
Family
ID=68589889
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910801714.5A Active CN110503113B (en) | 2019-08-28 | 2019-08-28 | Image saliency target detection method based on low-rank matrix recovery |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110503113B (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112561949A (en) * | 2020-12-23 | 2021-03-26 | 江苏信息职业技术学院 | Fast moving target detection algorithm based on RPCA and support vector machine |
CN112597330A (en) * | 2020-12-30 | 2021-04-02 | 宁波职业技术学院 | Image processing method fusing sparsity and low rank |
CN113628144A (en) * | 2021-08-25 | 2021-11-09 | 厦门美图之家科技有限公司 | Portrait restoration method and device, electronic equipment and storage medium |
CN114638039A (en) * | 2022-03-24 | 2022-06-17 | 任鹏 | Structural health monitoring characteristic data interpretation method based on low-rank matrix recovery |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106778814A (en) * | 2016-11-24 | 2017-05-31 | 郑州航空工业管理学院 | A kind of method of the removal SAR image spot based on projection spectral clustering |
CN108734174A (en) * | 2018-04-21 | 2018-11-02 | 大连海事大学 | A kind of complex background image conspicuousness detection method based on low-rank representation |
-
2019
- 2019-08-28 CN CN201910801714.5A patent/CN110503113B/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106778814A (en) * | 2016-11-24 | 2017-05-31 | 郑州航空工业管理学院 | A kind of method of the removal SAR image spot based on projection spectral clustering |
CN108734174A (en) * | 2018-04-21 | 2018-11-02 | 大连海事大学 | A kind of complex background image conspicuousness detection method based on low-rank representation |
Non-Patent Citations (1)
Title |
---|
HOUWEN PENG等: ""Salient Object Detection via Structured Matrix Decomposition"", 《IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE》 * |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112561949A (en) * | 2020-12-23 | 2021-03-26 | 江苏信息职业技术学院 | Fast moving target detection algorithm based on RPCA and support vector machine |
CN112561949B (en) * | 2020-12-23 | 2023-08-22 | 江苏信息职业技术学院 | Rapid moving object detection algorithm based on RPCA and support vector machine |
CN112597330A (en) * | 2020-12-30 | 2021-04-02 | 宁波职业技术学院 | Image processing method fusing sparsity and low rank |
CN113628144A (en) * | 2021-08-25 | 2021-11-09 | 厦门美图之家科技有限公司 | Portrait restoration method and device, electronic equipment and storage medium |
CN114638039A (en) * | 2022-03-24 | 2022-06-17 | 任鹏 | Structural health monitoring characteristic data interpretation method based on low-rank matrix recovery |
CN114638039B (en) * | 2022-03-24 | 2024-05-03 | 沈阳大学 | Structural health monitoring characteristic data interpretation method based on low-rank matrix recovery |
Also Published As
Publication number | Publication date |
---|---|
CN110503113B (en) | 2023-07-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111832655B (en) | Multi-scale three-dimensional target detection method based on characteristic pyramid network | |
CN105574534B (en) | Conspicuousness object detection method based on sparse subspace clustering and low-rank representation | |
CN110503113A (en) | A kind of saliency object detection method restored based on low-rank matrix | |
CN103413151B (en) | Hyperspectral image classification method based on figure canonical low-rank representation Dimensionality Reduction | |
CN109034210A (en) | Object detection method based on super Fusion Features Yu multi-Scale Pyramid network | |
CN108510012A (en) | A kind of target rapid detection method based on Analysis On Multi-scale Features figure | |
CN108319957A (en) | A kind of large-scale point cloud semantic segmentation method based on overtrick figure | |
CN111310773A (en) | Efficient license plate positioning method of convolutional neural network | |
CN106354735A (en) | Image target searching method and device | |
CN104268593A (en) | Multiple-sparse-representation face recognition method for solving small sample size problem | |
CN111311702B (en) | Image generation and identification module and method based on BlockGAN | |
CN110569782A (en) | Target detection method based on deep learning | |
CN106408039A (en) | Off-line handwritten Chinese character recognition method carrying out data expansion based on deformation method | |
CN108960260B (en) | Classification model generation method, medical image classification method and medical image classification device | |
JP6107531B2 (en) | Feature extraction program and information processing apparatus | |
CN110991444A (en) | Complex scene-oriented license plate recognition method and device | |
CN106355210B (en) | Insulator Infrared Image feature representation method based on depth neuron response modes | |
CN113095333A (en) | Unsupervised feature point detection method and unsupervised feature point detection device | |
CN112132145A (en) | Image classification method and system based on model extended convolutional neural network | |
CN108388901B (en) | Collaborative significant target detection method based on space-semantic channel | |
CN112215157A (en) | Multi-model fusion-based face feature dimension reduction extraction method | |
CN105069459B (en) | One kind is directed to High Resolution SAR Images type of ground objects extracting method | |
CN117576402B (en) | Deep learning-based multi-scale aggregation transducer remote sensing image semantic segmentation method | |
CN105160666B (en) | SAR image change detection based on Non-Stationary Analysis and condition random field | |
CN115131384B (en) | Bionic robot 3D printing method, device and medium based on edge preservation |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |