CN101299799A - Image detection, repair method and image detection, repair apparatus - Google Patents

Image detection, repair method and image detection, repair apparatus Download PDF

Info

Publication number
CN101299799A
CN101299799A CNA2008101149215A CN200810114921A CN101299799A CN 101299799 A CN101299799 A CN 101299799A CN A2008101149215 A CNA2008101149215 A CN A2008101149215A CN 200810114921 A CN200810114921 A CN 200810114921A CN 101299799 A CN101299799 A CN 101299799A
Authority
CN
China
Prior art keywords
motion vector
block motion
piecemeal
image
field picture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA2008101149215A
Other languages
Chinese (zh)
Other versions
CN101299799B (en
Inventor
谌安军
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mid Star Technology Ltd By Share Ltd
Original Assignee
Vimicro Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vimicro Corp filed Critical Vimicro Corp
Priority to CN2008101149215A priority Critical patent/CN101299799B/en
Publication of CN101299799A publication Critical patent/CN101299799A/en
Application granted granted Critical
Publication of CN101299799B publication Critical patent/CN101299799B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Image Analysis (AREA)

Abstract

The invention provides an image bad point detecting method, comprising: performing the buffer memory on at least three continuous images including an origin image, at least a former image and at least a latter image; determining the pixel point in the origin image respectively relative to the forward motion vector of the former image and the backward motion vector of the latter image; determining the pixel point in the origin image respectively relative to the forward motion compensation point of the former image and relative to the backward motion compensation point of the latter image; performing the bad point detection on the pixel point in the origin image according to the forward motion compensation point and the backward motion compensation point. The method considers the characteristic of the image gray scale and the motion vector on the time and the space, obtains the motion compensation point in the former image and the latter image corresponding to the pixel in the origin image according to the motion vector, thereby increasing the detection precision of the bad point or the bad ring, improving the reparative accuracy of the bad point or the bad ring in the image.

Description

Image detection, restorative procedure and image detection, prosthetic device
Technical field
The present invention relates to technical field of image processing, particularly image detection, restorative procedure and image detection, prosthetic device.
Background technology
Along with the continuous development of digital image technology, various digital images are handled or the shooting product has obtained popularizing widely.People are also more and more higher to the quality requirement of image simultaneously, therefore just need make it can satisfy vision, psychology and other requirement to image is analyzed, processed and handles, and are referred to as image processing.Image repair is an important content in the image processing, and its application surface is very extensive, can repair the details of losing in damaged paintings, photo, the recovery Streaming Media, as repairing badly point or the bad piece etc. in the image.
Below just the technology that in the prior art bad point and bad piece in the image is detected and repair is simply introduced:
In the prior art, judge whether a pixel is bad point, and this pixel is repaired mainly in the following ways, promptly in a picture frame, judge according to the pixel value of other pixel around this pixel whether this pixel is bad point, if this pixel is very big with the pixel value difference of other pixel all around, can think that then this pixel is a bad point, for example Si Zhou pixel all is a dim spot, and this pixel is a bright spot, so just can think that this pixel is a bad point.Simultaneously, with reference to this bad point (pixel) pixel value of other pixel on every side, calculate the pixel value of this evil idea point by weighted average or alternate manner it is repaired.
Yet above-mentioned this mode but can't effectively detect the bad piece that occurs in the image and repair, this mainly is because the gray scale of other pixel around the above-mentioned bad point of repair mode main reference to bad point is repaired, but for the bad piece in the image, form by a plurality of bad points often, other pixel around these bad points often also is a bad point, do not have effective reference value, therefore just can't effectively repair yet the bad piece in the image.
Yet bad piece is the problem that often runs in actual life, as because camera lens on dust or CCD (Charge Coupled Device, charge coupled device) dielectric material reason such as come off causes the piece of fault at random bright or dark in the video image etc. on the imaging sensor, therefore needs a kind of method and solves reparation to bad piece in the image.
Prior art has also proposed a kind of detection and restorative procedure of image, and this method is promptly applicable to the detection and the reparation of bad point, also applicable to the detection and the reparation of bad piece.This method is simply said and is judged with reference to the pixel value of the pairing pixel of this pixel in the two field picture of front and back exactly and repair.When going bad some detection, (whether x is bad some y) for example to detect pixel, then with reference to pixel in the prior image frame frame (x, pixel y) and in the two field picture frame of back (x, pixel value y) is judged, if the pixel value of itself and front and back two field picture corresponding points differs too big, think that then it is exactly a bad point.The method that the different and above-mentioned same picture frame of this method detects, this method also is applicable to the detection to bad piece, for example comprises three bad point (x in the bad piece 1, y 1), (x 2, y 2) and (x 3, y 3), to bad point (x 1, y 1) when repairing, at first need to find pixel (x in the prior image frame 1, y 1) pairing pixel value, and pixel (x in the two field picture of back 1, y 1) pairing pixel value, obtain bad point (x according to weighted average or alternate manner then 1, y 1) pixel value, it is repaired; In the same way to bad point (x 2, y 2) and (x 3, y 3) repair, thereby finish reparation to bad piece.
The shortcoming that prior art exists is: mention in the above-mentioned prior art with reference to do not consider to move the influence to image of the method for front and back two field picture, that is to say the pixel A in this two field picture 1(x 1, y 1), in the next frame image, moved to pixel B 2(x 2, y 2), and this moment prior art also with reference to the pixel A in the next frame image 2(x 1, y 1) judgement pixel A 1(x 1, y 1) whether be bad point, thus the detection mistake caused, and influence is to the accuracy of the reparation of image.
Summary of the invention
Purpose of the present invention is intended to solve at least one of above-mentioned technological deficiency, is prone to when solving dead pixel points of images in the prior art or bad piece especially and detects wrong technological deficiency, reaches the purpose of the accuracy that improves image repair.
For achieving the above object, one aspect of the present invention proposes a kind of dead pixel points of images detection method, may further comprise the steps: at least three frame continuous images are carried out buffer memory, comprise this two field picture, at least one prior image frame and at least one back two field picture; Determine that pixel is respectively with respect to the forward motion vector of described prior image frame with respect to the described backward motion vector of two field picture afterwards in described the two field picture; Determine that according to described forward motion vector and described backward motion vector pixel described in described the two field picture is respectively with respect to the preceding frame motion compensation point of described prior image frame with respect to the described back frame motion compensation point of two field picture afterwards; According to frame motion compensation point before described and described back frame motion compensation point pixel described in described the two field picture is gone bad some detection.
The present invention also proposes a kind of dead pixel points of images restorative procedure on the other hand, may further comprise the steps: at least three frame continuous images are carried out buffer memory, comprise this two field picture, at least one prior image frame and at least one back two field picture; Determine that pixel is respectively with respect to the forward motion vector of described prior image frame with respect to the described backward motion vector of two field picture afterwards in described the two field picture; Determine that according to described forward motion vector and described backward motion vector pixel described in described the two field picture is respectively with respect to the preceding frame motion compensation point of described prior image frame with respect to the described back frame motion compensation point of two field picture afterwards; Judge according to frame motion compensation point before described and described back frame motion compensation point whether described pixel is bad point; If bad point is then repaired described pixel.
The present invention also proposes the bad piece detection method of a kind of image on the other hand, may further comprise the steps: at least three frame continuous images are carried out buffer memory, comprise this two field picture, at least one prior image frame and at least one back two field picture; Described two field picture, described prior image frame and described back two field picture are carried out piecemeal; Determine that piecemeal in described the two field picture is respectively with respect to the forward block motion vector of described prior image frame and back to block motion vector with respect to described back two field picture; Determine counting of bad pixel in the described piecemeal according to described forward block motion vector and described back to block motion vector; Judge according to counting of bad pixel in the described piecemeal whether described piecemeal is bad piece, if the counting greater than predetermined threshold value of described bad pixel, then described piecemeal is a bad piece.
The present invention also proposes the bad piece restorative procedure of a kind of image on the other hand, may further comprise the steps: at least three frame continuous images are carried out buffer memory, comprise this two field picture, at least one prior image frame and at least one back two field picture; Described two field picture, described prior image frame and described back two field picture are carried out piecemeal; Determine that piecemeal in described the two field picture is respectively with respect to the forward block motion vector of described prior image frame and back to block motion vector with respect to described back two field picture; To block motion vector the pixel in the described piecemeal is gone bad some detection according to described forward block motion vector and described back; Respectively detected bad point in the described piecemeal is repaired.
The present invention also proposes a kind of dead pixel points of images checkout gear on the other hand, comprise that picture frame cache module, motion vector computation module, motion compensation point determination module and bad point detect module, described picture frame cache module, be used at least three frame continuous images are carried out buffer memory, comprise this two field picture, at least one prior image frame and at least one back two field picture; Described motion vector computation module is used for the image according to described picture frame cache module buffer memory, determines that pixel is respectively with respect to the forward motion vector of described prior image frame with respect to the described backward motion vector of two field picture afterwards in described the two field picture; Described motion compensation point determination module, the described forward motion vector and the described backward motion vector that are used for obtaining according to described motion vector computation module determine that pixel described in described the two field picture is respectively with respect to the preceding frame motion compensation point of described prior image frame with respect to the described back frame motion compensation point of two field picture afterwards; Described bad is detected module, and the described preceding frame motion compensation point and the described back frame motion compensation point that are used for determining according to described motion compensation point determination module are gone bad some detection to pixel described in described the two field picture.
The present invention also proposes a kind of dead pixel points of images prosthetic device on the other hand, comprise that picture frame cache module, motion vector computation module, motion compensation point determination module, bad point detect module and repair module, described picture frame cache module, be used at least three frame continuous images are carried out buffer memory, comprise this two field picture, at least one prior image frame and at least one back two field picture; Described motion vector computation module is used for the image according to described picture frame cache module buffer memory, determines that pixel is respectively with respect to the forward motion vector of described prior image frame with respect to the described backward motion vector of two field picture afterwards in described the two field picture; Described motion compensation point determination module, the described forward motion vector and the described backward motion vector that are used for obtaining according to described motion vector computation module determine that pixel described in described the two field picture is respectively with respect to the preceding frame motion compensation point of described prior image frame with respect to the described back frame motion compensation point of two field picture afterwards; Described bad is detected module, and the described preceding frame motion compensation point and the described back frame motion compensation point that are used for determining according to described motion compensation point determination module are gone bad some detection to pixel described in described the two field picture; Described reparation module is used for when described bad some detection module detects described pixel for bad point described pixel being repaired.
The present invention also proposes the bad piece checkout gear of a kind of image on the other hand, comprise picture frame cache module, piecemeal module, block motion vector computing module, bad count determination module and bad piece detection module, described picture frame cache module, be used at least three frame continuous images are carried out buffer memory, comprise this two field picture, at least one prior image frame and at least one back two field picture; Described piecemeal module is used for this two field picture of described picture frame cache module buffer memory, described prior image frame and described back two field picture are carried out piecemeal; Described block motion vector computing module, be used for determining described piecemeal module to the piecemeal of described two field picture respectively with respect to the forward block motion vector of described prior image frame and back with respect to described back two field picture to block motion vector; The described evil idea determination module of counting, counting of described bad pixel of piecemeal determined to block motion vector in the described forward block motion vector and the described back that are used for obtaining according to described block motion vector computing module; Described bad piece detection module is used for judging according to described evil idea the counting of bad pixel that determination module determines of counting whether described piecemeal is bad piece, if the counting greater than predetermined threshold value of described bad pixel, then described piecemeal is a bad piece.
The present invention also proposes a kind of bad block repair apparatus of image on the other hand, comprise that picture frame cache module, piecemeal module, block motion vector computing module, bad point detect module and repair module, described picture frame cache module, be used at least three frame continuous images are carried out buffer memory, comprise this two field picture, at least one prior image frame and at least one back two field picture; Described piecemeal module is used for described two field picture of described picture frame cache module buffer memory, described prior image frame and described back two field picture are carried out piecemeal; Described block motion vector computing module is used for determining that described two field picture piecemeal is respectively with respect to the forward block motion vector of described prior image frame and back to block motion vector with respect to described back two field picture; Described bad point detects module, and the described forward block motion vector and the described back that are used for obtaining according to described block motion vector computing module are gone bad some detection to block motion vector to each pixel of described piecemeal; Described reparation module is used for the bad point of the detected piecemeal of described bad some detection module is repaired.
As embodiments of the invention, taken into full account image in time with the epigraph gray scale characteristics relevant in space with motion vector, obtain the motion compensation point in the two field picture of pixel correspondence front and back in this two field picture according to motion vector, and according to the pixel after the motion compensation pixel of this two field picture is gone bad a little and to be detected, thereby improve the accuracy of detection of bad point or bad piece, the accuracy that bad point or bad piece are repaired in the improvement image.
Aspect that the present invention adds and advantage part in the following description provide, and part will become obviously from the following description, or recognize by practice of the present invention.
Description of drawings
Above-mentioned and/or additional aspect of the present invention and advantage are from obviously and easily understanding becoming the description of embodiment below in conjunction with accompanying drawing, wherein:
Fig. 1 is the flow chart of one embodiment of the invention dead pixel points of images detection method;
Fig. 2 is the flow chart of one embodiment of the invention by classification piece matching way computing block motion vector;
Fig. 3 judges for a kind of of one embodiment of the invention proposition whether pixel is the method flow diagram of bad point;
The concrete implementation flow chart of reparation vector median filtering mode that Fig. 4 proposes for one embodiment of the invention;
The filter template W that Fig. 5 proposes for one embodiment of the invention zSchematic diagram;
Fig. 6 is the flow chart of the bad piece detection method of the image of one embodiment of the invention;
Fig. 7 is definite forward block motion vector and the flow chart of back to block motion vector of one embodiment of the invention;
Fig. 8 is the dead pixel points of images checkout gear structure chart of one embodiment of the invention;
Fig. 9 is the dead pixel points of images prosthetic device structure chart of one embodiment of the invention;
Figure 10 is the bad piece checkout gear of the image of an one embodiment of the invention structure chart;
Figure 11 is the bad block repair apparatus structure chart of the image of one embodiment of the invention.
Embodiment
Describe embodiments of the invention below in detail, the example of described embodiment is shown in the drawings, and wherein identical from start to finish or similar label is represented identical or similar elements or the element with identical or similar functions.Below by the embodiment that is described with reference to the drawings is exemplary, only is used to explain the present invention, and can not be interpreted as limitation of the present invention.
The present invention mainly is: according to the kinetic characteristic of image on room and time bad piece or bad point are detected, obtain the preceding frame motion compensation point and the back frame motion compensation point of pixel correspondence in this two field picture by motion vector, thereby just can detect bad piece or bad point more accurately according to frame motion compensation point before described and back frame motion compensation point.For example (x, y), (x, forward motion vector y) and backward motion vector just can obtain this pixel A (x according to described forward motion vector and backward motion vector to access this pixel A by calculating for the pixel A in this two field picture 1, y 1) preceding frame motion compensation point B (x in the corresponding prior image frame 2, y 2) and corresponding back two field picture in back frame motion compensation point C (x 3, y 3).That is to say that in this three two field picture image is frame motion compensation point B (x in the past 2, y 2) move to pixel A (x 1, y 1), again by pixel A (x 1, y 1) move to back frame motion compensation point C (x 3, y 3).Definite by to preceding frame motion compensation point B and back frame motion compensation point C just can judge accurately whether pixel A is bad point, and this method also is applicable to the detection to bad piece equally like this.As one embodiment of the present of invention, the present invention carries out piecemeal to this two field picture, prior image frame and back two field picture simultaneously, and calculate the block motion vector of each piecemeal in this two field picture with respect to prior image frame and back two field picture, conduct belongs to the motion vector of all pixels in this piecemeal with regard to the available block motion vector like this, thereby can reduce operand effectively.Wherein, preferably, the mode of employing classification piece coupling obtains the block motion vector of piecemeal, with revised block motion vector in subordinate's image as the initial value of block motion vector at the corresponding levels, like this by can guarantee the accuracy of the block motion vector that finally obtains in every grade of image to the correction of this grade block motion vector.
Below just the description by specific embodiment the present invention is introduced:
As described in Figure 1, flow chart for one embodiment of the invention dead pixel points of images detection method, preceding frame motion compensation point and back frame motion compensation point by relative prior image frame of pixel in definite this two field picture and back two field picture, can effectively detect this pixel, improve the accuracy that dead pixel points of images detects.This embodiment may further comprise the steps:
Step S101 carries out buffer memory at least three frame continuous images, comprises this two field picture, at least one prior image frame and at least one back two field picture.Wherein, the number of prior image frame and back two field picture is at least one, as selects for use a plurality of prior image frames and/or back two field picture then will help to improve the precision that bad point detects.Need to prove select for use prior image frame and the back two field picture number can be unequal.
Step S102 determines that pixel in this two field picture is respectively with respect to the forward motion vector of prior image frame with respect to the backward motion vector of back two field picture.
As an optimal way of this step, can carry out piecemeal to this two field picture, prior image frame and back two field picture, and determine that each piecemeal in this two field picture is respectively with respect to the forward block motion vector of prior image frame and back to block motion vector with respect to the back two field picture.So just can be with the forward block motion vector of piecemeal and back to block motion vector as forward motion vector that belongs to all pixels in this piecemeal and backward motion vector, so can reduce operand effectively.As the foregoing description mode more preferably, the block motion vector that obtains by classification piece coupling, begin to calculate the block motion vector of this grade from the lowermost level image, and the block motion vector that subordinate's image the is obtained initial value of higher level's image motion vector the most, until the block motion vector that obtains highest image, thereby further improve the accuracy of block motion vector by the mode of approaching step by step.More preferably, subordinate's image is as before the image block motion vector initial value at the corresponding levels in the above-described embodiments, it is judged, if this subordinate's image unreliable then it is revised, thereby the accuracy of the block motion vector that assurance finally obtains further improves the accuracy of bad some detection.
As shown in Figure 2, be the flow chart of one embodiment of the invention, may further comprise the steps by classification piece matching way computing block motion vector:
Step S201 carries out m filtering with low pass filter respectively to this two field picture, prior image frame and back two field picture, obtains this two field picture, prior image frame and the back two field picture of m level different resolution, and the high more then described image level of resolution is high more.Wherein, m is preferably 2-5 time, and more excellent is 3 times.
Step S202 carries out piecemeal to this two field picture, prior image frame and back two field picture under different resolution, wherein, the resolution of classification is big or small opposite with described piecemeal, and resolution is low more, and piecemeal is big more; Otherwise resolution is big more, and then piecemeal is more little.
Step S203 from this two field picture of lowermost level (lowest resolution), searches for best matching blocks to each piecemeal in this this two field picture in prior image frame and back two field picture.Wherein, the fast adoptable matching criterior of search optimum Match is that modes such as the absolute value difference of minimum average B configuration (MAD), sqrt, crossvariance or the equal value difference of piece are determined best matching blocks.
Step S204, according to the above-mentioned best matching blocks that searches determine each piecemeal in this two field picture of lowermost level the forward block motion vector and the back to block motion vector.
Step S205 judges whether the forward block motion vector of piecemeal in above-mentioned definite this two field picture of lowermost level and back be reliable to block motion vector.Wherein, as a specific embodiment, the present invention proposes a kind of reliable method that judges whether, be about to calculate the MAD value of corresponding rectangular block in forward motion vector and backward motion vector MAD value and the calculating front and back frame, judge according to following formula whether motion vector is reliable:
MV ( x , y ) = 1 if MAD b ( x , y ) > T 1 and MAD f ( x , y ) > T 1 and MAD bf ( x , y ) < T 2 0 else - - - ( 1 )
In above-mentioned formula (1), 1 expression (x, y) the motion vector MV of piece place (x, y) unreliable, 0 expression motion vector MV (x, y) reliable, wherein, T 1And T 2Be respectively preset threshold value, T 2<T 1, b represents reverse, f represents propulsion, the motion before and after bf represents between the frame.Preferably, T 1Be 20, T 2Be 10.Wherein, above-mentioned judgment criterion has been utilized the continuity of moving on the time shaft, has therefore reduced the sensitivity to noise to a certain extent.
Step S206 if judge that the block motion vector of this two field picture of lowermost level calculating is unreliable, then revises it; If judge reliably, then execution in step S207.For detected unreliable motion vector, then calculate the MAD of this piece, and this block motion vector is revised with the neighborhood block motion vector of minimum MAD correspondence with the neighborhood block motion vector.Modified motion vector is as the initial value of next stage piece coupling.Equation expression is:
MV ( x , y ) = arg min MVnb ( x , y ) &Element; A MAD MVnb ( x , y ) - - - ( 2 )
In above-mentioned formula (2), (x, y) (x, neighborhood block motion vector y), A are the neighborhood set to expression motion vector MV to MVnb, MAD MVnb (x, y)Be motion vector MV (x, the absolute value difference of minimum average B configuration of neighborhood block motion vector y).
Step S207, with each piecemeal correspondence in this two field picture of lowermost level reliably or through the block motion vector revised block motion vector initial value as corresponding piecemeal in this two field picture of its higher level, calculate the block motion vector of this two field picture of higher level.Be specially: search for the best matching blocks of this grade at one in more among a small circle reliably or through the block motion vector revised according to what subordinate's image provided, and then determine the block motion vector of each piecemeal in this two field picture of this grade according to the best matching blocks that searches.
Step S208, whether the block motion vector of each piecemeal is reliable in this two field picture of this grade that obtains among the determining step S207.Judge whether that reliable method is identical with the method that step S205 is adopted in same this step.If judge reliably, then execution in step S210; If it is unreliable to judge, execution in step S209 then.
Step S209 if judge that the block motion vector of this this two field picture of level (non-lowermost level image) calculating is unreliable, then revises it.
Same the present invention has also proposed a kind of correcting mode, but different with the formula of step S206 correction here, its difference is to have added upper level motion vector initial value, and this motion vector correction formula is:
MV i - 1 ( x , y ) = ( 1 - &lambda; ) MV i ( x , y ) + &lambda; arg min MVnb i - 1 ( x , y ) &Element; A MAD MVnb i - 1 ( x , y ) - - - ( 3 )
Wherein, MV I-1(x y) is (x, y) the revised motion vector in piece place, MV at the corresponding levels iBe that (x, y) the revised motion vector in piece place, λ are weights to upper level, weigh upper level motion vector shared proportion in the correction of this grade motion vector, MVnb I-1Be that (x, the y) motion vector of piece place neighborhood, A are the neighborhood set to this level, MAD MVnb (x, y)Be motion vector MV (x, the absolute value difference of minimum average B configuration of neighborhood block motion vector y).
Step S210 will judge the block motion vector initial value of the block motion vector of reliable or process step S209 correction as corresponding piecemeal in this two field picture of its higher level among the step S208, calculate the block motion vector of this two field picture of higher level.The forward block motion vector of repeating step S208-S210 piecemeal in drawing highest this two field picture and back are to block motion vector.
Step S211, with the forward block motion vector of piecemeal in highest this two field picture and back to block motion vector as piecemeal described in this two field picture in the forward motion vector and the backward motion vector of all pixels.
Step S103, the forward motion vector and the backward motion vector of each pixel in this two field picture that obtains according to step S102, determine pixel in this two field picture respectively with respect to the preceding frame motion compensation point of prior image frame, and with respect to the back frame motion compensation point of back two field picture.As according to as described in forward motion vector and backward motion vector obtain this pixel A (x 1, y 1) preceding frame motion compensation point B (x in the corresponding prior image frame 2, y 2) and corresponding back two field picture in back frame motion compensation point C (x 3, y 3).
Step S104 goes bad some detection according to frame motion compensation point before described and described back frame motion compensation point to pixel described in described the two field picture.The present invention proposes a species diversity sort method and go bad the method that a little detects, be specially according to preceding frame motion compensation point B (x 2, y 2) and back frame motion compensation point C (x 3, y 3), and preceding frame motion compensation point B (x 2, y 2) neighborhood and back frame motion compensation point C (x 3, y 3) pixel A (x in u pixel of neighborhood and this two field picture 1, y 1) correlation, judge this pixel A (x 1, y 1) whether be bad point.Wherein, optional preceding frame motion compensation point B (x 2, y 2) and back frame motion compensation point C (x 3, y 3) horizontal u the pixel (do not comprise back frame motion compensation point C) of neighborhood, or vertically conduct such as u pixel with reference to point.Wherein, u is 1-9, and preferred u is 2, also can select more reference point for use in order to improve the accuracy of judgement degree certainly.
As one embodiment of the present of invention, the present invention proposes and a kind ofly judge that whether pixel is the method for bad point, select to remove preceding frame motion compensation point B (x among this embodiment 2, y 2) and back frame motion compensation point C (x 3, y 3) outside horizontal 2 neighborhood territory pixel points as with reference to pixel.As shown in Figure 3, specifically may further comprise the steps:
Step S301 supposes It is n two field picture coordinate r &RightArrow; = ( x , y ) Place's gray value, and definition vector
Figure A20081011492100373
: vector wherein
Figure A20081011492100374
Be frame motion compensation point B (x before comprising 2, y 2) and back frame motion compensation point C (x 3, y 3), with and the vector of neighborhood territory pixel point.
P ( r &RightArrow; ) = [ p 1 ( r &RightArrow; ) , p 2 ( r &RightArrow; ) , p 3 ( r &RightArrow; ) , p 4 ( r &RightArrow; ) , p 5 ( r &RightArrow; ) , p 6 ( r &RightArrow; ) ]
Figure A20081011492100376
Figure A20081011492100377
In the following formula (4),
Figure A20081011492100378
N-1 frame and n+1 two field picture have been comprised r &RightArrow; = ( x , y ) If six pixels of neighborhood are at the n two field picture r &RightArrow; = ( x , y ) The place is a spot, so
Figure A200810114921003711
Will with In pixel between no correlation, gray scale difference value each other is bigger, on the contrary gray scale difference value can be smaller.
Step S302 averages preceding frame motion compensation vertex neighborhood and back frame motion compensation vertex neighborhood gray values of pixel points, obtains the grade average.Wherein, proposed a kind of method that obtains the grade average, be specially vector as one embodiment of the present of invention In element resequence according to gray value, obtain new vector
Figure A200810114921003714
S ( r &RightArrow; ) = [ s 1 ( r &RightArrow; ) , s 2 ( r &RightArrow; ) , s 3 ( r &RightArrow; ) , s 4 ( r &RightArrow; ) , s 5 ( r &RightArrow; ) , s 6 ( r &RightArrow; ) ] - - - ( 5 )
Wherein, s 1 ( r &RightArrow; ) &le; s 2 ( r &RightArrow; ) &le; s 3 ( r &RightArrow; ) &le; s 4 ( r &RightArrow; ) &le; s 5 ( r &RightArrow; ) &le; s 6 ( r &RightArrow; ) , And define a grade average
Figure A200810114921003717
m ( r &RightArrow; ) = ( s 3 ( r &RightArrow; ) + s 4 ( r &RightArrow; ) ) / 2 - - - ( 6 )
Step S303 determines the grade difference, and described grade difference is weighed the size of spot correlation on pixel and the time neighborhood, described grade difference d ( r &RightArrow; ) = [ d 1 ( r &RightArrow; ) , d 2 ( r &RightArrow; ) , d 3 ( r &RightArrow; ) ] Obtain by following formula:
d i ( r &RightArrow; ) = S i ( r &RightArrow; ) - I n ( r &RightArrow; ) I n ( r &RightArrow; ) &le; m ( r &RightArrow; ) I n ( r &RightArrow; ) - S 1 - i ( r &RightArrow; ) I n ( r &RightArrow; ) > m ( r &RightArrow; ) &ForAll; i = 1,2,3 - - - ( 7 )
Wherein, described
Figure A200810114921003721
It is n two field picture coordinate r &RightArrow; = ( x , y ) Place's gray value.
Step S304 judges the correlation of pixel and grade average in described the two field picture, if relevant, then this pixel is not a bad point; If uncorrelated, then this pixel is a bad point.Be specially according to the grade difference
Figure A20081011492100381
Whether greater than threshold value T iJudge whether this pixel is relevant with the grade average in described the two field picture: d i ( r &RightArrow; ) > T i I=1,2,3, wherein, i=1,2,3, T 1, T 2And T 3Be predetermined threshold, and T 1<T 2<T 3Set up as arbitrary inequality in the above-mentioned formula, judge that then pixel is uncorrelated with the grade average in this two field picture, this pixel is a bad point.Wherein, preferably, T1 is 5, T2 is 10, T3 is 40.Wherein, because threshold value T1 weighs each pixel of vertex neighborhood to be detected and the immediate degree of measuring point pixel value to be checked, so threshold value T1 is a most important threshold value.
As one embodiment of the present of invention, the present invention also proposes a kind of restorative procedure of dead pixel points of images, at first utilizes the dead pixel points of images detection method of the foregoing description to determine not repeat them here bad point in the image; By vector median filtering mode, gradient diffusion repair mode or weighted average repair mode described bad point is repaired then.As one embodiment of the present of invention, the present invention proposes and repair the concrete implementation of vector median filtering mode, as shown in Figure 4, may further comprise the steps:
Step S401 transfers filter template W z, the template W of this filter wherein z(z=1,2,3,4,5) are at the n two field picture r &RightArrow; = ( x , y ) Place definition, template figure as shown in Figure 5, wherein template is of a size of 3 * 3, black region is represented the pixel that will use in the filtering in the template.Certainly also can select the template of other sizes, or select the template of other corresponding black region.
Step S402 finds described template W according to described bad point zLast corresponding pixel, and obtain
Figure A20081011492100384
Described
Figure A20081011492100385
Determine by following formula, X W z ( i ) = arg min X i &Element; W z s W z ( i ) , Wherein, s W z ( i ) = &Sigma; j &Element; W z d ( i , j ) , D (i, j)=| X i-X j|, X i, X jBe the bad some template W of institute zThe middle pairing pixel gray value of black region, (i j) is X to d i, X jBetween distance.
Step S403, definition set X ^ = { X W z : z = 1,2,3,4,5 } , And according to described X ^ = { X W z : z = 1,2,3,4,5 } Calculate s (z), described s ( z ) = &Sigma; j = 1 5 d ( z , j ) z=1,2,3,4,5。
Step S404 selects s (z) minimum value pairing
Figure A200810114921003811
As the pixel value at described bad some place, as pass through formula X ^ n ( r &RightArrow; ) = arg min X z &Element; X ^ s ( z ) Obtain.
The foregoing description has illustrated the detection and the restorative procedure of the present invention's bad point in to image, and the present invention equally also can be applicable to the detection of bad piece in the image and reparation, below will be described with detection and the reparation to bad piece of the mode of embodiment.
As shown in Figure 6, the flow chart for the bad piece detection method of the image of one embodiment of the invention may further comprise the steps:
Step S601 carries out buffer memory at least three frame continuous images, comprises this two field picture, at least one prior image frame and at least one back two field picture.Wherein, the number of prior image frame and back two field picture is at least one, as selects for use a plurality of prior image frames and/or back two field picture will help to improve the precision that bad point detects.Need to prove select for use prior image frame and the back two field picture number can be unequal.
Step S602 carries out m filtering with low pass filter respectively to this two field picture, prior image frame and back two field picture, obtains this two field picture, prior image frame and the back two field picture of m level different resolution, and the high more then described image level of resolution is high more.Wherein, m is preferably 2-5 time, and more excellent is 3 times.
Step S603 carries out piecemeal to this two field picture, prior image frame and back two field picture under different resolution, wherein, the resolution of classification is big or small opposite with described piecemeal, and resolution is low more, and piecemeal is big more; Otherwise resolution is big more, and then piecemeal is more little.
Step S604 determines that piecemeal in this two field picture is respectively with respect to the forward block motion vector of prior image frame and back to block motion vector with respect to the back two field picture.As shown in Figure 7, the flow chart for one embodiment of the invention computing block motion vector specifically may further comprise the steps:
Step S701 from this two field picture of lowermost level (lowest resolution), searches for best matching blocks to each piecemeal in this this two field picture in prior image frame and back two field picture.Wherein, the fast adoptable matching criterior of search optimum Match is the absolute value difference of minimum average B configuration (MAD), sqrt, crossvariance or the equal value difference of piece etc.
Step S702, according to the above-mentioned best matching blocks that searches determine each piecemeal in this two field picture of lowermost level the forward block motion vector and the back to block motion vector.
Step S703 judges whether the forward block motion vector of piecemeal in above-mentioned definite this two field picture of lowermost level and back be reliable to block motion vector.Wherein, as a specific embodiment, the present invention proposes a kind of reliable method that judges whether, be about to calculate the MAD value of corresponding rectangular block in forward motion vector and backward motion vector MAD value and the calculating front and back frame, judge according to following formula whether motion vector is reliable:
MV ( x , y ) = 1 if MAD b ( x , y ) > T 1 and MAD f ( x , y ) > T 1 and MAD bf ( x , y ) < T 2 0 else - - - ( 1 )
In above-mentioned formula (1), 1 expression (x, y) the motion vector MV of piece place (x, y) unreliable, 0 expression motion vector MV (x, y) reliable, wherein, T 1And T 2Be respectively preset threshold value, T 2<T 1, b represents reverse, f represents propulsion, the motion before and after bf represents between the frame.Preferably, T 1Be 20, T 2Be 10.Wherein above-mentioned judgment criterion has been utilized the continuity of moving on the time shaft, has therefore reduced the sensitivity to noise to a certain extent.
Step S704 if judge that the block motion vector of this two field picture of lowermost level calculating is unreliable, then revises it; If reliable, execution in step S207 then.For detected unreliable motion vector, then calculate the MAD of this piece, and this block motion vector is revised with the neighborhood block motion vector of minimum MAD correspondence with the neighborhood block motion vector.Modified motion vector is as the initial value of next stage piece coupling.Equation expression is:
MV ( x , y ) = arg min MVnb ( x , y ) &Element; A MAD MVnb ( x , y ) - - - ( 2 )
In above-mentioned formula (2), (x, y) (x, neighborhood block motion vector y), A are the neighborhood set to expression motion vector MV to MVnb, MAD MVnb (x, y)Be motion vector MV (x, the absolute value difference of minimum average B configuration of neighborhood block motion vector y).
Step S705, with each piecemeal correspondence in this two field picture of lowermost level reliably or through the block motion vector revised block motion vector initial value as corresponding piecemeal in this two field picture of its higher level, calculate the block motion vector of its this two field picture of higher level.Be specially: search for the best matching blocks of this grade at one in more among a small circle reliably or through the block motion vector revised according to what subordinate's image provided, and then determine the block motion vector of each piecemeal in this two field picture of this grade according to the best matching blocks that searches.
Step S706, whether the block motion vector of each piecemeal is reliable in this two field picture of this grade that obtains among the determining step S705.Judge whether that reliable method is identical with the method that step S703 is adopted in same this step.If judge reliably, then execution in step S708; If it is unreliable to judge, execution in step S707 then.
Step S707 if judge that the block motion vector of this this two field picture of level (non-lowermost level image) calculating is unreliable, then revises it.
The correction formula of same this step is different with the formula that step S704 revises, and its difference is to have added upper level motion vector initial value, and this motion vector correction formula is:
MV i - 1 ( x , y ) = ( 1 - &lambda; ) MV i ( x , y ) + &lambda; arg min MVnb i - 1 ( x , y ) &Element; A MAD MVnb i - 1 ( x , y ) - - - ( 3 )
Wherein, MV I-1(x y) is (x, y) the revised motion vector in piece place, MV at the corresponding levels iBe that (x, y) the revised motion vector in piece place, λ are weights to upper level, weigh upper level motion vector shared proportion in the correction of this grade motion vector, MVnb I-1Be that (x, the y) motion vector of piece place neighborhood, A are the neighborhood set to this level, MAD MVb (x, y)Be motion vector MV (x, the absolute value difference of minimum average B configuration of neighborhood block motion vector y).
Step S708 will judge the block motion vector initial value of the block motion vector of reliable or process step S707 correction as corresponding piecemeal in this two field picture of its higher level among the step S706, calculate the block motion vector of its this two field picture of higher level.The forward block motion vector of repeating step S706-S708 piecemeal in drawing highest this two field picture and back are to block motion vector.
Step S605 go bad a little detection to block motion vector to each pixel in the piecemeal according to the forward block motion vector of piecemeal and back, determines counting of bad pixel in the piecemeal.Be specially: determine each pixel in this piecemeal respectively with respect to the forward motion vector of prior image frame with respect to the backward motion vector of back two field picture according to the forward block motion vector of the piecemeal correspondence in this two field picture and back to block motion vector, before determining according to forward motion vector and backward motion vector again frame motion compensation point and after frame motion compensation point; Last again according to each pixel in the piecemeal, and corresponding described before frame motion compensation point and described after frame motion compensation point each pixel in the described piecemeal is gone bad some detection, determine counting of bad pixel in the described piecemeal.Whether wherein, detect pixel is that the method for going bad point can not repeat them here with reference to flow process shown in Figure 3.
Step S606 judges according to counting of bad pixel in the piecemeal whether piecemeal is bad piece, if the counting greater than predetermined threshold value of bad pixel, then this piecemeal is a bad piece.Wherein, predetermined threshold value needs the size decision according to piecemeal, and as one 3 * 3 piecemeal, then can establish threshold value is 2, promptly just thinks that if any 2 bad points this piecemeal is a bad piece in this piecemeal.If piecemeal is very big certainly, and 1 or 2 bad point is wherein only arranged,, so just can think that this piecemeal is not a bad piece for insignificant.
Same the present invention has also proposed the restorative procedure to bad piece, when promptly step S606 determines that this piecemeal is bad piece in the above-described embodiments, respectively each the bad point in this bad piece is repaired.Wherein, can repair bad point by vector median filtering mode, gradient diffusion repair mode or weighted average repair mode.Wherein, the vector median filtering mode does not repeat them here shown in Fig. 4 flow chart.
As shown in Figure 8, dead pixel points of images checkout gear structure chart for one embodiment of the invention, this device comprises that picture frame cache module 810, motion vector computation module 820, motion compensation point determination module 830 and bad point detect module 840, picture frame cache module 810 is used at least three frame continuous images are carried out buffer memory, comprises this two field picture, at least one prior image frame and at least one back two field picture; Motion vector computation module 820 is used for the image according to picture frame cache module 810 buffer memorys, determines pixel in this two field picture respectively with respect to the forward motion vector of prior image frame, and with respect to the backward motion vector of back two field picture; Motion compensation point determination module 830 is used for the forward motion vector that obtains according to motion vector computation module 820 and backward motion vector and determines that this two field picture pixel is respectively with respect to the preceding frame motion compensation point of prior image frame with respect to the back back frame motion compensation point of two field picture; The preceding frame motion compensation points that bad some detection module 840 is used for determining according to motion compensation point determination module 830 are gone bad a little this two field picture pixel with back frame motion compensation point and are detected.
Wherein, as an embodiment, motion vector computation module 820 comprises piecemeal submodule 821 and block motion vector calculating sub module 822, and piecemeal submodule 821 is used for described two field picture of picture frame cache module 810 buffer memorys, described prior image frame and described back two field picture are carried out piecemeal; Block motion vector calculating sub module 822 is used for determining this two field picture piecemeal respectively with respect to the forward block motion vector of prior image frame and back to block motion vector with respect to the back two field picture, and wherein the forward block motion vector of piecemeal and back can be used as described forward motion vector and the described backward motion vector that belongs to pixel in the piecemeal to block motion vector.
Wherein, motion vector computation module 820 also comprises classification submodule 823 in the above-described embodiments, is used for according to resolution this two field picture, prior image frame and back two field picture being carried out classification respectively, wherein, the high more then described image level of resolution is high more, and the resolution of classification is big or small opposite with piecemeal; Block motion vector calculating sub module 822 also be used for the forward block motion vector of subordinate's image piecemeal and back to block motion vector as image at the corresponding levels in the initial value of corresponding piecemeal, obtain piecemeal in the described image at the corresponding levels the forward block motion vector and the back to block motion vector, in drawing highest image the forward block motion vector of piecemeal and the back to block motion vector.
Wherein, the motion vector computation module 820 in the foregoing description also comprises to be judged submodule 824 and revises submodule 825, judges that submodule 824 is used for judging whether the block motion vector of subordinate's image piecemeal is reliable; Revising submodule 825 is used for when judging that submodule 824 decision block motion vectors are unreliable this block motion vector being revised.
As shown in Figure 9, dead pixel points of images prosthetic device structure chart for one embodiment of the invention, this prosthetic device comprises that picture frame cache module 910, motion vector computation module 920, motion compensation point determination module 930, bad point detect module 940 and repair module 950, picture frame cache module 910 is used at least three frame continuous images are carried out buffer memory, comprises this two field picture, at least one prior image frame and at least one back two field picture; Motion vector computation module 920 is used for the image according to picture frame cache module 910 buffer memorys, determines that pixel in this two field picture is respectively with respect to the forward motion vector of prior image frame with respect to the backward motion vector of back two field picture; Motion compensation point determination module 930 is used for the forward motion vector that obtains according to motion vector computation module 920 and backward motion vector and determines that this two field picture pixel is respectively with respect to the preceding frame motion compensation point of prior image frame with respect to the back back frame motion compensation point of two field picture; The preceding frame motion compensation points that bad some detection module 940 is used for determining according to motion compensation point determination module 930 are gone bad a little this two field picture pixel with back frame motion compensation point and are detected; Repairing module 950 is used for when bad point detects module 940 detection pixels for bad point this pixel being repaired.
Wherein, as one embodiment of the present of invention, motion vector computation module 920 comprises piecemeal submodule 921 and block motion vector calculating sub module 922, and piecemeal submodule 921 is used for described two field picture of picture frame cache module 910 buffer memorys, described prior image frame and described back two field picture are carried out piecemeal; Block motion vector calculating sub module 922 is used for determining this two field picture piecemeal respectively with respect to the forward block motion vector of prior image frame and back to block motion vector with respect to the back two field picture, and wherein the forward block motion vector of piecemeal and back can be used as the forward motion vector and the backward motion vector of the described pixel that belongs to this piecemeal to block motion vector.
Wherein, motion vector computation module 920 also comprises classification submodule 923 in the above-described embodiments, is used for according to resolution this two field picture, prior image frame and back two field picture being carried out classification, wherein, the high more then image level of resolution is high more, and the resolution of classification is big or small opposite with piecemeal; Block motion vector calculating sub module 922 also be used for the forward block motion vector of subordinate's image piecemeal and back to block motion vector as image at the corresponding levels in the initial value of corresponding piecemeal, obtain piecemeal in the described image at the corresponding levels the forward block motion vector and the back to block motion vector, in drawing described highest image the forward block motion vector of piecemeal and the back to block motion vector.
Wherein, motion vector computation module 920 also comprises judgement submodule 924 and revises submodule 925 in the above-described embodiments, judges that submodule 924 is used for judging whether the block motion vector of subordinate's image piecemeal is reliable; Revising submodule 925 is used for when judging that submodule 924 judges that described block motion vector is unreliable this block motion vector being revised.
As shown in figure 10, be the bad piece checkout gear of the image of one embodiment of the invention structure chart, this bad piece checkout gear comprises picture frame cache module 1010, piecemeal module 1020, block motion vector computing module 1030, bad count determination module 1040 and bad piece detection module 1050, picture frame cache module 1010 is used at least three frame continuous images are carried out buffer memory, comprises this two field picture, at least one prior image frame and at least one back two field picture; Piecemeal module 1020 is used for this two field picture of picture frame cache module 1010 buffer memorys, prior image frame and back two field picture are carried out piecemeal; The piecemeal that block motion vector computing module 1030 is used for determining 1020 pairs of these two field pictures of piecemeal module is respectively with respect to the forward block motion vector of prior image frame and back to block motion vector with respect to the back two field picture; Counting of described bad pixel of piecemeal determined to block motion vector in forward block motion vector and back that the bad determination module 1040 of counting is used for obtaining according to block motion vector computing module 1030; Bad piece detection module 1050 is used for judging according to the counting of bad pixel that the bad determination module 1040 of counting is determined whether described piecemeal is bad piece, if the counting greater than predetermined threshold value of described bad pixel, then described piecemeal is a bad piece.
Wherein, as one embodiment of the present of invention, the bad determination module 1040 of counting comprises that motion compensation point determines that submodule 1041 and bad point detect submodule 1042, motion compensation point determine submodule 1041 be used for according to the forward block motion vector and after to block motion vector determine each pixel of piecemeal respectively with respect to the preceding frame motion compensation point of prior image frame and with respect to after the back frame motion compensation point of two field picture; Bad point detects submodule 1042 and is used for each pixel according to described piecemeal, and motion compensation point determine the correspondence that submodule 1041 obtains preceding frame motion compensation point and after frame motion compensation point each pixel in the piecemeal is gone bad some detection.
Wherein, block motion vector computing module 1030 also comprises classification submodule 1031 and block motion vector calculating sub module 1032 at the corresponding levels in the above-described embodiments, classification submodule 1031 is used for according to resolution this two field picture, prior image frame and back two field picture being carried out classification, wherein, the high more then described image level of resolution is high more, and the resolution of classification is big or small opposite with piecemeal; Block motion vector calculating sub module 1032 at the corresponding levels be used for the forward block motion vector of subordinate's image piecemeal and back to block motion vector as image at the corresponding levels in the initial value of corresponding piecemeal, obtain piecemeal in the image at the corresponding levels the forward block motion vector and the back to block motion vector, in drawing highest image the forward block motion vector of piecemeal and the back to block motion vector.
Wherein, block motion vector computing module 1030 also comprises judgement submodule 1033 and revises submodule 1034 in the above-described embodiments, judges that submodule 1033 is used for judging whether the block motion vector of subordinate's image piecemeal is reliable; Revising submodule 1034 is used for when judging that submodule 1033 decision block motion vectors are unreliable block motion vector being revised.
As shown in figure 11, be the bad block repair apparatus structure chart of the image of one embodiment of the invention, this bad block repair apparatus of image comprises that picture frame cache module 1110, piecemeal module 1120, block motion vector computing module 1130, bad point detect module 1140 and repair module 1150, picture frame cache module 1110 is used at least three frame continuous images are carried out buffer memory, comprises this two field picture, at least one prior image frame and at least one back two field picture; Piecemeal module 1120 is used for this two field picture of picture frame cache module 1110 buffer memorys, prior image frame and back two field picture are carried out piecemeal; Block motion vector computing module 1130 is used for determining that this two field picture piecemeal is respectively with respect to the forward block motion vector of prior image frame and back to block motion vector with respect to the back two field picture; The forward block motion vector that bad some detection module 1140 is used for obtaining according to block motion vector computing module 1130 is gone bad a little each pixel of piecemeal to block motion vector with the back and is detected; Repairing module 1150 is used for that bad point is detected the bad point that module 1140 detects piecemeal and repairs.
Wherein, as one embodiment of the present of invention, bad point detects a module 1140 and comprises that motion compensation point determines that submodule 1141 and bad point detect submodule 1142, motion compensation point determine submodule 1141 be used for according to the forward block motion vector and after to block motion vector determine each pixel of piecemeal respectively with respect to the preceding frame motion compensation point of prior image frame and with respect to after the back frame motion compensation point of two field picture; Bad point detects submodule 1142 and is used for each pixel according to piecemeal, and motion compensation point determine the correspondence that submodule 1141 obtains preceding frame motion compensation point and after frame motion compensation point each pixel in the piecemeal is gone bad some detection.
Wherein, block motion vector computing module 1130 also comprises classification submodule 1131 and block motion vector calculating sub module 1132 at the corresponding levels in the above-described embodiments, classification submodule 1131 is used for according to resolution this two field picture, prior image frame and back two field picture being carried out classification, wherein, the high more then image level of resolution is high more, and the resolution of classification is big or small opposite with piecemeal; Block motion vector calculating sub module 1132 at the corresponding levels be used for the forward block motion vector of subordinate's image piecemeal and back to block motion vector as image at the corresponding levels in the initial value of corresponding piecemeal, obtain piecemeal in the described image at the corresponding levels the forward block motion vector and the back to block motion vector, in drawing highest image the forward block motion vector of piecemeal and the back to block motion vector.
Wherein, block motion vector computing module 1130 also comprises judgement submodule 1133 and revises submodule 1134 in the above-described embodiments, judges that submodule 1131 is used for judging whether the block motion vector of subordinate's image piecemeal is reliable; Revising submodule 1134 is used for when judging that submodule 1133 decision block motion vectors are unreliable block motion vector being revised.
Advantage of the present invention is: taken into full account image in time with the epigraph gray scale characteristics relevant in space with motion vector, obtain the motion compensation point in the two field picture of pixel correspondence front and back in this two field picture according to motion vector, and according to the pixel after the motion compensation pixel of this two field picture is gone bad a little and to be detected, thereby improve the accuracy of detection of bad point or bad piece, the accuracy of the reparation of bad point or bad piece in the improvement image.
And the present invention represents the motion vector of each pixel in the piecemeal by block motion vector, thereby can effectively reduce operand.
The present invention also obtains piecemeal by the mode that adopts classification piece coupling block motion vector mates step by step, thereby has improved the accuracy that block motion vector calculates.
The present invention is also when the classification piece mates, reliability to the block motion vector of subordinate's image is judged, if it is unreliable then it is revised, thereby guarantee that block motion vector as higher level's image initial value all is reliably or through revising, thereby further improved the accuracy that block motion vector calculates.
Although illustrated and described embodiments of the invention, for the ordinary skill in the art, be appreciated that without departing from the principles and spirit of the present invention and can carry out multiple variation, modification, replacement and modification that scope of the present invention is by claims and be equal to and limit to these embodiment.

Claims (71)

1, a kind of dead pixel points of images detection method is characterized in that, may further comprise the steps:
At least three frame continuous images are carried out buffer memory, comprise this two field picture, at least one prior image frame and at least one back two field picture;
Determine that pixel is respectively with respect to the forward motion vector of described prior image frame with respect to the described backward motion vector of two field picture afterwards in described the two field picture;
Determine that according to described forward motion vector and described backward motion vector pixel described in described the two field picture is respectively with respect to the preceding frame motion compensation point of described prior image frame with respect to the described back frame motion compensation point of two field picture afterwards;
According to frame motion compensation point before described and described back frame motion compensation point pixel described in described the two field picture is gone bad some detection.
According to the described dead pixel points of images detection method of claim 1, it is characterized in that 2, pixel may further comprise the steps with respect to the forward motion vector of described prior image frame with respect to the described backward motion vector of two field picture afterwards respectively in described definite this two field picture:
Described two field picture, described prior image frame and described back two field picture are carried out piecemeal;
Determine that piecemeal in described the two field picture is respectively with respect to the forward block motion vector of described prior image frame and back to block motion vector with respect to described back two field picture;
With the forward block motion vector of described piecemeal with afterwards to described forward motion vector and the described backward motion vector of block motion vector as the pixel that belongs to described piecemeal.
3, according to the described dead pixel points of images detection method of claim 2, it is characterized in that, to this two field picture, prior image frame with before afterwards two field picture carries out piecemeal, also comprise described:
According to resolution described two field picture, described prior image frame and described back two field picture are carried out classification, wherein, the high more then described image level of resolution is high more, and the resolution of described classification and described piecemeal is big or small opposite;
The forward block motion vector of described definite described piecemeal and back specifically comprise to block motion vector:
Determine piecemeal in the highest image the forward block motion vector and the back to block motion vector.
According to the described dead pixel points of images detection method of claim 3, it is characterized in that 4, the forward block motion vector of piecemeal and back are determined by following steps to block motion vector in the described highest image:
The forward block motion vector of piecemeal and back are to block motion vector in the calculating lowermost level image;
Higher level's image from described lowermost level image, with the forward block motion vector of piecemeal in subordinate's image and back to block motion vector as image at the corresponding levels in the initial value of corresponding piecemeal, obtain piecemeal in the described image at the corresponding levels the forward block motion vector and the back to block motion vector, in drawing described highest image the forward block motion vector of piecemeal and the back to block motion vector.
According to the described dead pixel points of images detection method of claim 4, it is characterized in that 5, the forward block motion vector of piecemeal and back also comprise in obtaining subordinate's image after block motion vector:
Whether forward block motion vector and the back of judging piecemeal in the described subordinate image be reliable to block motion vector;
If judge reliably, then offer described image at the corresponding levels as forward block motion vector in the image at the corresponding levels and the initial value of back to block motion vector;
If it is unreliable to judge, then the forward block motion vector and the back of piecemeal in the described subordinate image are revised to block motion vector, revised forward block motion vector and back are offered image at the corresponding levels to block motion vector, as forward block motion vector in the image at the corresponding levels and the initial value of back to block motion vector.
6, according to each described dead pixel points of images detection method of claim 3 to 5, it is characterized in that piecemeal specifically comprises to block motion vector with respect to the forward block motion vector of described prior image frame with respect to described back the back of two field picture respectively in described definite this two field picture:
Determine the preceding frame best matching blocks of the corresponding described prior image frame of piecemeal in described the two field picture and the back frame best matching blocks of corresponding described back two field picture respectively;
Determine described forward block motion vector according to described piecemeal and described preceding frame best matching blocks, determine that according to described piecemeal and described back frame best matching blocks described back is to block motion vector.
7, according to the described dead pixel points of images detection method of claim 6, it is characterized in that, determine best matching blocks by piecemeal in described the two field picture is carried out the absolute value difference MAD of minimum average B configuration, sqrt, crossvariance or the equal value difference of piece.
According to the described dead pixel points of images detection method of claim 5, it is characterized in that 8, whether the described forward block motion vector of judging piecemeal in subordinate's image and back reliably specifically comprise to block motion vector: judge whether to satisfy MAD b(x, y)>T 1, MAD f(x, y)>T 1And MAD Bf(x, y)<T 2, wherein, MAD bThe absolute value difference of minimum average B configuration of expression reverse, MAD fThe absolute value difference of minimum average B configuration of expression propulsion, MAD BfThe absolute value difference of minimum average B configuration before and after the expression between the frame, T 1, T 2Be predetermined threshold value, and T 2<T 1
If satisfy, think that then described block motion vector is unreliable;
If do not satisfy, think that then described block motion vector is reliable.
9, described according to Claim 8 dead pixel points of images detection method is characterized in that, described T 1Be 20, described T 2Be 10.
10, according to the described dead pixel points of images detection method of claim 7, it is characterized in that, block motion vector is revised further be may further comprise the steps:
Judge that whether described block motion vector is the block motion vector in the lowermost level image;
If then pass through formula MV ( x , y ) = arg min MVnb ( x , y ) &Element; A MAD MVnb ( x , y ) Described block motion vector is revised, and wherein, (x y) is block motion vector, MAD to MV MVnb (x, y)(x, the absolute value difference of minimum average B configuration of neighborhood block motion vector y), A are the neighborhood set for motion vector MV;
If not, then pass through formula MV i - 1 ( x , y ) = ( 1 - &lambda; ) MV i ( x , y ) + &lambda; arg min MVnb i - 1 ( x , y ) &Element; A MAD MVnb i - 1 ( x , y ) Described block motion vector is revised, wherein MV (x y) is block motion vector, wherein, M4D MVnb (x, y)Be motion vector MV (x, the absolute value difference of minimum average B configuration of neighborhood block motion vector y), MV i(x is the revised motion vector in upper level image block place y), and λ is weights, MVnb I-1Be the motion vector of this grade image block place neighborhood, A is the neighborhood set.
According to the described dead pixel points of images detection method of claim 1, it is characterized in that 11, preceding frame motion compensation point of described basis and back frame motion compensation point carry out bad spot check measuring tool body 4 to pixel in this two field picture and comprise:
According to frame motion compensation point before described and described back frame motion compensation point, and the correlation of pixel described in u pixel of frame motion compensation point and the described motion compensation of frame afterwards vertex neighborhood and described the two field picture before described, judge whether pixel described in described the two field picture is bad point.
According to the described dead pixel points of images detection method of claim 11, it is characterized in that 12, a described u pixel is 2 pixels,
Describedly judge that whether pixel described in this two field picture is that bad point further may further comprise the steps:
To frame motion compensation point before described and described back frame motion compensation point, 2 gray values of pixel points that reach described preceding frame motion compensation point and described back frame motion compensation vertex neighborhood average, and obtain the grade average;
Judge the correlation of pixel gray value described in described the two field picture and described grade average;
If relevant, then described pixel is not a bad point;
If uncorrelated, then described pixel is a bad point.
13, according to the described dead pixel points of images detection method of claim 12, it is characterized in that, described to preceding frame motion compensation point and described back frame motion compensation point, 2 gray values of pixel points that reach described preceding frame motion compensation point and described back frame motion compensation vertex neighborhood average, and obtain the grade average and are specially::
To frame motion compensation point before described and described back frame motion compensation point, 2 pixels that reach described preceding frame motion compensation point and described back frame motion compensation vertex neighborhood sort according to gray value, obtain vector S ( r &RightArrow; ) = [ s 1 ( r &RightArrow; ) , s 2 ( r &RightArrow; ) , s 3 ( r &RightArrow; ) , s 4 ( r &RightArrow; ) , s 5 ( r &RightArrow; ) , s 6 ( r &RightArrow; ) ] , Wherein,
Figure A2008101149210005C2
Pixel coordinate after the expression motion compensation, s 1 ( r &RightArrow; ) &le; s 2 ( r &RightArrow; ) &le; s 3 ( r &RightArrow; ) &le; s 4 ( r &RightArrow; ) &le; s 5 ( r &RightArrow; ) &le; s 6 ( r &RightArrow; ) ;
Described grade average For: m ( r &RightArrow; ) = ( s 3 ( r &RightArrow; ) + s 4 ( r &RightArrow; ) ) / 2 .
According to the described dead pixel points of images detection method of claim 13, it is characterized in that 14, the correlation of pixel and grade average further may further comprise the steps in described this two field picture of judgement:
Determine the grade difference, described grade difference is weighed the size of spot correlation on pixel and the time neighborhood, described grade difference Obtain by following formula:
d i ( r &RightArrow; ) = s i ( r &RightArrow; ) - I n ( r &RightArrow; ) I n ( r &RightArrow; ) &le; m ( r &RightArrow; ) I n ( r &RightArrow; ) - s l - i ( r &RightArrow; ) I n ( r &RightArrow; ) > m ( r &RightArrow; ) &ForAll; i = 1,2,3 , wherein, described
Figure A2008101149210006C2
It is n two field picture coordinate r &RightArrow; = ( x , y ) Place's gray value,
According to described grade difference
Figure A2008101149210006C4
Whether greater than threshold value T iJudge whether pixel described in described the two field picture is relevant with described grade average: d i ( r &RightArrow; ) > T i I=1,2,3, wherein, i=1,2,3, T 1, T 2And T 3Be predetermined threshold, and T 1<T 2<T 3
Set up as arbitrary inequality in the above-mentioned formula, judge that then pixel described in described the two field picture is uncorrelated with described grade average.
15, a kind of dead pixel points of images restorative procedure is characterized in that, may further comprise the steps:
At least three frame continuous images are carried out buffer memory, comprise this two field picture, at least one prior image frame and at least one back two field picture;
Determine that pixel is respectively with respect to the forward motion vector of described prior image frame with respect to the described backward motion vector of two field picture afterwards in described the two field picture;
Determine that according to described forward motion vector and described backward motion vector pixel described in described the two field picture is respectively with respect to the preceding frame motion compensation point of described prior image frame with respect to the described back frame motion compensation point of two field picture afterwards;
Judge according to frame motion compensation point before described and described back frame motion compensation point whether described pixel is bad point;
If bad point is then repaired described pixel.
According to the described dead pixel points of images restorative procedure of claim 15, it is characterized in that 16, pixel may further comprise the steps with respect to the forward motion vector of described prior image frame with respect to the described backward motion vector of two field picture afterwards respectively in described definite this two field picture:
Described two field picture, described prior image frame and described back two field picture are carried out piecemeal;
Determine that piecemeal in described the two field picture is respectively with respect to the forward block motion vector of described prior image frame and back to block motion vector with respect to described back two field picture;
With the forward block motion vector of described piecemeal with afterwards to described forward motion vector and the described backward motion vector of block motion vector as the described pixel that belongs to described piecemeal.
17, according to the described dead pixel points of images restorative procedure of claim 16, it is characterized in that, described this two field picture, described prior image frame and described back two field picture are carried out piecemeal before, also comprise:
According to resolution described two field picture, described prior image frame and described back two field picture are carried out classification, wherein, the high more then described image level of resolution is high more, and the resolution of described classification and described piecemeal is big or small opposite;
The forward block motion vector of described definite described piecemeal and back specifically comprise to block motion vector:
Determine piecemeal in the highest image the forward block motion vector and the back to block motion vector.
According to the described dead pixel points of images restorative procedure of claim 17, it is characterized in that 18, the forward block motion vector of piecemeal and back are determined by following steps to block motion vector in the described highest image:
The forward block motion vector of piecemeal and back are to block motion vector in the calculating lowermost level image;
Higher level's image from described lowermost level image, with the forward block motion vector of piecemeal in subordinate's image and back to block motion vector as image at the corresponding levels in the initial value of corresponding piecemeal, obtain piecemeal in the described image at the corresponding levels the forward block motion vector and the back to block motion vector, in drawing described highest image the forward block motion vector of piecemeal and the back to block motion vector.
According to the described dead pixel points of images restorative procedure of claim 18, it is characterized in that 19, the forward block motion vector of piecemeal and back also comprise in obtaining subordinate's image after block motion vector:
Whether forward block motion vector and the back of judging piecemeal in the described subordinate image be reliable to block motion vector;
If judge reliably, then offer image at the corresponding levels as forward block motion vector described in the image at the corresponding levels and the initial value of back to block motion vector;
If it is unreliable to judge, then the forward block motion vector and the back of piecemeal in the described subordinate image are revised to block motion vector, revised forward block motion vector and back are offered image at the corresponding levels to block motion vector, as forward block motion vector in the image at the corresponding levels and the initial value of back to block motion vector.
20, according to each described dead pixel points of images restorative procedure of claim 17 to 19, piecemeal specifically comprises to block motion vector with respect to the forward block motion vector of described prior image frame with respect to described back the back of two field picture respectively in described definite this two field picture:
Determine the preceding frame best matching blocks of the corresponding described prior image frame of piecemeal in described the two field picture and the back frame best matching blocks of corresponding described back two field picture respectively;
Determine described forward block motion vector according to described piecemeal and described preceding frame best matching blocks, determine that according to described piecemeal and described back frame best matching blocks described back is to block motion vector.
21, according to the described dead pixel points of images restorative procedure of claim 20, it is characterized in that, determine best matching blocks by piecemeal in described the two field picture is carried out the absolute value difference MAD of minimum average B configuration, sqrt, crossvariance or the equal value difference of piece.
According to the described dead pixel points of images restorative procedure of claim 19, it is characterized in that 22, whether the described forward block motion vector of judging piecemeal in subordinate's image and back reliably specifically comprise to block motion vector: judge whether to satisfy MAD b(x, y)>T 1, MAD f(x, y)>T 1And MAD Bf(x, y)<T 2, wherein, MAD bThe absolute value difference of minimum average B configuration of expression reverse, MAD fThe absolute value difference of minimum average B configuration of expression propulsion, MAD BfThe absolute value difference of minimum average B configuration before and after the expression between the frame, T 1, T 2Be predetermined threshold value, and T 2<T 1
If satisfy, think that then described block motion vector is unreliable;
If do not satisfy, think that then described block motion vector is reliable.
23, according to the described dead pixel points of images restorative procedure of claim 19, it is characterized in that, block motion vector is revised further be may further comprise the steps:
Judge that whether described block motion vector is the block motion vector in the lowermost level image;
If then pass through formula MV ( x , y ) = arg min MVnb ( x , y ) &Element; A MAD MVnb ( x , y ) Described block motion vector is revised, and wherein, (x y) is block motion vector, MAD to MV MVnb (x, y)(x, the absolute value difference of minimum average B configuration of neighborhood block motion vector y), A are the neighborhood set for motion vector MV;
If not, then pass through formula MV i - 1 ( x , y ) = ( 1 - &lambda; ) MV i ( x , y ) + &lambda; arg min MVnb i - 1 ( x , y ) &Element; A MAD MVnb i - 1 ( x , y ) Described block motion vector is revised, wherein MV (x y) is block motion vector, wherein, MAD MVnb (x, y)Be motion vector MV (x, the absolute value difference of minimum average B configuration of neighborhood block motion vector y), MV i(x is the revised motion vector in upper level image block place y), and λ is weights, MVnb I-1Be the motion vector of this grade image block place neighborhood, A is the neighborhood set.
According to the described dead pixel points of images restorative procedure of claim 15, it is characterized in that 24, frame motion compensation point and back frame motion compensation point judge whether described pixel is that bad point specifically comprises before the described basis:
According to frame motion compensation point before described and described back frame motion compensation point, and the correlation of pixel described in u pixel of described preceding frame motion compensation point and described back frame motion compensation vertex neighborhood and this two field picture, judge whether pixel described in described the two field picture is bad point.
According to the described dead pixel points of images restorative procedure of claim 24, it is characterized in that 25, a described u pixel is 2 pixels,
Describedly judge that whether pixel described in this two field picture is that bad point further may further comprise the steps:
To frame motion compensation point before described and described back frame motion compensation point, 2 gray values of pixel points that reach described preceding frame motion compensation point and described back frame motion compensation vertex neighborhood average, and obtain the grade average;
Judge the correlation of pixel described in described the two field picture and described grade average;
If relevant, then described pixel is not a bad point;
If uncorrelated, then described pixel is a bad point.
26, according to the described dead pixel points of images restorative procedure of claim 25, it is characterized in that, to preceding frame motion compensation point and described back frame motion compensation point, and 2 gray values of pixel points of described preceding frame motion compensation point and described back frame motion compensation vertex neighborhood average, obtaining the grade average is specially: to frame motion compensation point before described and described back frame motion compensation point, 2 pixels that reach described preceding frame motion compensation point and described back frame motion compensation vertex neighborhood sort according to gray value, obtain vector S ( r &RightArrow; ) = [ s 1 ( r &RightArrow; ) , s 2 ( r &RightArrow; ) , s 3 ( r &RightArrow; ) , s 4 ( r &RightArrow; ) , s 5 ( r &RightArrow; ) , s 6 ( r &RightArrow; ) ] , Wherein,
Figure A2008101149210009C2
Pixel coordinate after the expression motion compensation, s 1 ( r &RightArrow; ) &le; s 2 ( r &RightArrow; ) &le; s 3 ( r &RightArrow; ) &le; s 4 ( r &RightArrow; ) &le; s 5 ( r &RightArrow; ) &le; s 6 ( r &RightArrow; ) ;
Described grade average For: m ( r &RightArrow; ) = ( s 3 ( r &RightArrow; ) + s 4 ( r &RightArrow; ) ) / 2 .
According to the described dead pixel points of images restorative procedure of claim 26, it is characterized in that 27, the correlation of pixel and grade average further may further comprise the steps in described this two field picture of judgement:
Determine the grade difference, described grade difference is weighed the size of spot correlation on pixel and the time neighborhood, described grade difference
Figure A2008101149210010C1
Obtain by following formula:
d i ( r &RightArrow; ) = s i ( r &RightArrow; ) - I n ( r &RightArrow; ) I n ( r &RightArrow; ) &le; m ( r &RightArrow; ) I n ( r &RightArrow; ) - s l - i ( r &RightArrow; ) I n ( r &RightArrow; ) > m ( r &RightArrow; ) &ForAll; i = 1,2,3 , wherein, described
Figure A2008101149210010C3
It is n two field picture coordinate r &RightArrow; = ( x , y ) Place's gray value,
According to described grade difference Whether greater than threshold value T iJudge whether pixel described in described the two field picture is relevant with described grade average: d i ( r &RightArrow; ) > T i I=1,2,3, wherein, i=1,2,3, T 1, T 2And T 3Be predetermined threshold, and T 1<T 2<T 3
Set up as arbitrary inequality in the above-mentioned formula, judge that then pixel described in this two field picture is uncorrelated with described grade average.
According to the described dead pixel points of images restorative procedure of claim 14, it is characterized in that 28, described bad point is repaired is specially:
By vector median filtering mode, gradient diffusion repair mode or weighted average repair mode described bad point is repaired.
According to the described dead pixel points of images restorative procedure of claim 28, it is characterized in that 29, described reparation vector median filtering mode may further comprise the steps:
Transfer filter template W z
Find pixel corresponding on the described template Wz according to described bad point, and obtain , described
Figure A2008101149210010C8
Determine by following formula, X W z ( i ) = arg min X i &Element; W z s W z ( i ) , wherein, s W z ( i ) = &Sigma; j &Element; W z d ( i , j ) , D (i, j)=| X i-X j|, X i, X jBe the bad some template W of institute zThe middle pairing pixel gray value of black region, (i j) is X to d i, X jBetween distance;
Definition set X ^ = { X W z : z = 1,2,3,4,5 } , And according to described X ^ = { X W z : z = 1,2,3,4,5 } Calculate s (z), described s ( z ) = &Sigma; j = 1 5 d ( z , j ) z=1,2,3,4,5;
Select s (z) minimum value pairing
Figure A2008101149210011C4
Pixel value as described bad some place.
30, the bad piece detection method of a kind of image is characterized in that, may further comprise the steps:
At least three frame continuous images are carried out buffer memory, comprise this two field picture, at least one prior image frame and at least one back two field picture;
Described two field picture, described prior image frame and described back two field picture are carried out piecemeal;
Determine that piecemeal in described the two field picture is respectively with respect to the forward block motion vector of described prior image frame and back to block motion vector with respect to described back two field picture;
Determine counting of bad pixel in the described piecemeal according to described forward block motion vector and described back to block motion vector;
Judge according to counting of bad pixel in the described piecemeal whether described piecemeal is bad piece, if counting greater than predetermined threshold value of described bad pixel judges that then described piecemeal is a bad piece.
31, according to the bad piece detection method of the described image of claim 30, it is characterized in that, described according to the forward block motion vector and the back determine that to block motion vector counting of bad pixel further comprises in the piecemeal:
Determine that to block motion vector each pixel is respectively with respect to the preceding frame motion compensation point of described prior image frame with respect to the described back frame motion compensation point of two field picture afterwards in the described piecemeal according to described forward block motion vector and described back;
According to each pixel in the described piecemeal, and frame motion compensation point and described frame motion compensation point are afterwards gone bad some detection to each pixel in the described piecemeal before each pixel correspondence described, determine counting of bad pixel in the described piecemeal.
32, according to the bad piece detection method of the described image of claim 30, it is characterized in that, described this two field picture, described prior image frame and described back two field picture are carried out piecemeal before, also comprise:
According to resolution described two field picture, described prior image frame and described back two field picture are carried out classification, wherein, the high more then described image level of resolution is high more, and the resolution of described classification and described piecemeal is big or small opposite;
The forward block motion vector of described definite described piecemeal and back specifically comprise to block motion vector:
Determine piecemeal in the highest image the forward block motion vector and the back to block motion vector.
According to the bad piece detection method of the described image of claim 32, it is characterized in that 33, the forward block motion vector of piecemeal and back are determined by following steps to block motion vector in the described highest image:
The forward block motion vector of piecemeal and back are to block motion vector in the calculating lowermost level image;
Higher level's image from described lowermost level image, with the forward block motion vector of piecemeal in subordinate's image and back to block motion vector as image at the corresponding levels in the initial value of corresponding piecemeal, obtain piecemeal in the described image at the corresponding levels the forward block motion vector and the back to block motion vector, in drawing described highest image the forward block motion vector of piecemeal and the back to block motion vector.
According to the bad piece detection method of the described image of claim 33, it is characterized in that 34, the forward block motion vector of piecemeal and back also comprise in obtaining subordinate's image after block motion vector:
Whether forward block motion vector and the back of judging piecemeal in the described subordinate image be reliable to block motion vector;
If judge reliably, then offer image at the corresponding levels as forward block motion vector in the image at the corresponding levels and the initial value of back to block motion vector;
If it is unreliable to judge, then the forward block motion vector and the back of piecemeal in the described subordinate image are revised to block motion vector, revised forward block motion vector and back are offered image at the corresponding levels to block motion vector, as forward block motion vector in the image at the corresponding levels and the initial value of back to block motion vector.
35, according to the bad piece detection method of each described image of claim 32 to 34, it is characterized in that, calculate the forward block motion vector and specifically comprise to block motion vector with the back:
Determine the preceding frame best matching blocks of the corresponding described prior image frame of piecemeal in described the two field picture and the back frame best matching blocks of corresponding described back two field picture respectively;
Determine described forward block motion vector according to described piecemeal and described preceding frame best matching blocks, determine that according to described piecemeal and described back frame best matching blocks described back is to block motion vector.
According to the bad piece detection method of the described image of claim 34, it is characterized in that 36, whether the described forward block motion vector of judging piecemeal in subordinate's image and back reliably specifically comprise to block motion vector: judge whether to satisfy MAD b(x, y)>T 1, MAD f(x, y)>T 1And MAD Bf(x, y)<T 2, wherein, MAD bThe absolute value difference of minimum average B configuration of expression reverse, MAD fThe absolute value difference of minimum average B configuration of expression propulsion, MAD BfThe absolute value difference of minimum average B configuration before and after the expression between the frame, T 1, T 2Be predetermined threshold value, and T 2<T 1
If satisfy, think that then described block motion vector is unreliable;
If do not satisfy, think that then described block motion vector is reliable.
According to the bad piece detection method of the described image of claim 34, it is characterized in that 37, described block motion vector is revised further may further comprise the steps:
Judge that whether described block motion vector is the block motion vector in the lowermost level image;
If then pass through formula MV ( x , y ) = arg min MVnb ( x , y ) &Element; A MAD MVnb ( x , y ) Described block motion vector is revised, and wherein, (x y) is block motion vector, MAD to MV MVnb (x, y)(x, the absolute value difference of minimum average B configuration of neighborhood block motion vector y), A are the neighborhood set for motion vector MV;
If not, then pass through formula MV i - 1 ( x , y ) = ( 1 - &lambda; ) MV i ( x , y ) + &lambda; arg min MVnb i - 1 ( x , y ) &Element; A MAD MVnb i - 1 ( x , y ) Described block motion vector is revised, wherein MV (x y) is block motion vector, wherein, MAD MVnb (x, y)Be motion vector MV (x, the absolute value difference of minimum average B configuration of neighborhood block motion vector y), MV i(x is the revised motion vector in upper level image block place y), and λ is weights, MVnb I-1Be the motion vector of this grade image block place neighborhood, A is the neighborhood set.
38, according to the bad piece detection method of the described image of claim 31, it is characterized in that, describedly each pixel in the piecemeal is carried out bad spot check measuring tool body may further comprise the steps:
Preceding frame motion compensation point and back frame motion compensation point according to each the pixel correspondence in the piecemeal, and the correlation of pixel described in u pixel of described preceding frame motion compensation point and described back frame motion compensation vertex neighborhood and this two field picture, judge whether the pixel in the described piecemeal is bad point.
According to the bad piece detection method of the described image of claim 38, it is characterized in that 39, a described u pixel is 2 pixels,
Describedly judge that whether the pixel in the piecemeal is that bad point further may further comprise the steps:
To frame motion compensation point before described and described back frame motion compensation point, 2 gray values of pixel points that reach described preceding frame motion compensation point and described back frame motion compensation vertex neighborhood average, and obtain the grade average;
Judge the pixel in the described piecemeal and the correlation of described grade average;
If relevant, the pixel in the then described piecemeal is not a bad point;
If uncorrelated, the pixel in the then described piecemeal is a bad point.
40, according to the bad piece detection method of the described image of claim 39, it is characterized in that, to preceding frame motion compensation point and described back frame motion compensation point, and 2 gray values of pixel points of described preceding frame motion compensation point and described back frame motion compensation vertex neighborhood average, obtaining the grade average is specially: to frame motion compensation point before described and described back frame motion compensation point, 2 pixels that reach described preceding frame motion compensation point and described back frame motion compensation vertex neighborhood sort according to gray value, obtain vector S ( r &RightArrow; ) = [ s 1 ( r &RightArrow; ) , s 2 ( r &RightArrow; ) , s 3 ( r &RightArrow; ) , s 4 ( r &RightArrow; ) , s 5 ( r &RightArrow; ) , s 6 ( r &RightArrow; ) ] , Wherein,
Figure A2008101149210014C2
Pixel coordinate after the expression motion compensation,
s 1 ( r &RightArrow; ) &le; s 2 ( r &RightArrow; ) &le; s 3 ( r &RightArrow; ) &le; s 4 ( r &RightArrow; ) &le; s 5 ( r &RightArrow; ) &le; s 6 ( r &RightArrow; ) ;
Described grade average For: m ( r &RightArrow; ) = ( s 3 ( r &RightArrow; ) + s 4 ( r &RightArrow; ) ) / 2 .
According to the bad piece detection method of the described image of claim 40, it is characterized in that 41, the pixel in the described judgement piecemeal and the correlation of grade average further may further comprise the steps:
Determine the grade difference, described grade difference is weighed the size of spot correlation on pixel and the time neighborhood, described grade difference
Figure A2008101149210014C6
Obtain by following formula:
d i ( r &RightArrow; ) = s i ( r &RightArrow; ) - I n ( r &RightArrow; ) I n ( r &RightArrow; ) &le; m ( r &RightArrow; ) I n ( r &RightArrow; ) - s l - i ( r &RightArrow; ) I n ( r &RightArrow; ) > m ( r &RightArrow; ) &ForAll; i = 1,2,3 , wherein, described
Figure A2008101149210015C2
It is n two field picture coordinate r &RightArrow; = ( x , y ) Place's gray value,
According to described grade difference
Figure A2008101149210015C4
Whether greater than threshold value T iJudge whether the pixel in the described piecemeal is relevant with described grade average: d i ( r &RightArrow; ) > T i I=1,2,3, wherein, i=1,2,3, T 1, T 2And T 3Be predetermined threshold, and T 1<T 2<T 3
Set up as arbitrary inequality in the above-mentioned formula, judge that then the pixel in the piecemeal is uncorrelated with described grade average.
42, the bad piece restorative procedure of a kind of image is characterized in that, may further comprise the steps:
At least three frame continuous images are carried out buffer memory, comprise this two field picture, at least one prior image frame and at least one back two field picture;
Described two field picture, described prior image frame and described back two field picture are carried out piecemeal;
Determine that piecemeal in described the two field picture is respectively with respect to the forward block motion vector of described prior image frame and back to block motion vector with respect to described back two field picture;
To block motion vector the pixel in the described piecemeal is gone bad some detection according to described forward block motion vector and described back;
Respectively detected bad point in the described piecemeal is repaired.
According to the bad piece restorative procedure of the described image of claim 42, it is characterized in that 43, described detection further comprises with afterwards going bad a little to block motion vector to the pixel in the described piecemeal according to the forward block motion vector:
Determine that to block motion vector each pixel is respectively with respect to the preceding frame motion compensation point of described prior image frame with respect to the described back frame motion compensation point of two field picture afterwards in the described piecemeal according to described forward block motion vector and described back;
According to each pixel in the described piecemeal, and frame motion compensation point and described frame motion compensation point are afterwards gone bad some detection to each pixel in the described piecemeal before each pixel correspondence described.
44, according to the bad piece restorative procedure of the described image of claim 43, it is characterized in that, described this two field picture, described prior image frame and described back two field picture are carried out piecemeal before, also comprise:
According to resolution described two field picture, described prior image frame and described back two field picture are carried out classification, wherein, the high more then described image level of resolution is high more, and the resolution of described classification and described piecemeal is big or small opposite;
The forward block motion vector of described definite described piecemeal and back specifically comprise to block motion vector:
Determine piecemeal in the highest image the forward block motion vector and the back to block motion vector.
According to the bad piece restorative procedure of the described image of claim 44, it is characterized in that 45, the forward block motion vector of piecemeal and back are determined by following steps to block motion vector in the described highest image:
The forward block motion vector of piecemeal and back are to block motion vector in the calculating lowermost level image;
Higher level's image from described lowermost level image, with the forward block motion vector of piecemeal in subordinate's image and back to block motion vector as image at the corresponding levels in the initial value of corresponding piecemeal, obtain piecemeal in the described image at the corresponding levels the forward block motion vector and the back to block motion vector, in drawing described highest image the forward block motion vector of piecemeal and the back to block motion vector.
According to the bad piece restorative procedure of the described image of claim 45, it is characterized in that 46, the forward block motion vector of piecemeal and back also comprise in obtaining subordinate's image after block motion vector:
Whether forward block motion vector and the back of judging piecemeal in the described subordinate image be reliable to block motion vector;
If judge reliably, then offer image at the corresponding levels as forward block motion vector in the image at the corresponding levels and the initial value of back to block motion vector;
If it is unreliable to judge, then the forward block motion vector and the back of piecemeal in the described subordinate image are revised to block motion vector, revised forward block motion vector and back are offered image at the corresponding levels to block motion vector, as forward block motion vector in the image at the corresponding levels and the initial value of back to block motion vector.
47, according to the bad piece restorative procedure of each described image of claim 44 to 46, it is characterized in that, calculate the forward block motion vector and specifically comprise to block motion vector with the back:
Determine the preceding frame best matching blocks of the corresponding described prior image frame of piecemeal in described the two field picture and the back frame best matching blocks of corresponding described back two field picture respectively;
Determine described forward block motion vector according to described piecemeal and described preceding frame best matching blocks, determine that according to described piecemeal and described back frame best matching blocks described back is to block motion vector.
According to the bad piece restorative procedure of the described image of claim 47, it is characterized in that 48, whether the described forward block motion vector of judging piecemeal in subordinate's image and back reliably specifically comprise to block motion vector: judge whether to satisfy MAD b(x, y)>T 1, MAD f(x, y)>T 1And MAD Bf(x, y)<T 2, wherein, MAD bThe absolute value difference of minimum average B configuration of expression reverse, MAD fThe absolute value difference of minimum average B configuration of expression propulsion, MAD BfThe absolute value difference of minimum average B configuration before and after the expression between the frame, T 1, T 2Be predetermined threshold value, and T 2<T 1
If satisfy, think that then described block motion vector is unreliable;
If do not satisfy, think that then described block motion vector is reliable.
According to the bad piece restorative procedure of the described image of claim 46, it is characterized in that 49, described block motion vector is revised further may further comprise the steps:
Judge that whether described block motion vector is the block motion vector in the lowermost level image;
If then pass through formula MV ( x , y ) = arg min MVnb ( x , y ) &Element; A MAD MVnb ( x , y ) Described block motion vector is revised, and wherein, (x y) is block motion vector, MAD to MV MVnb (x, y)(x, the absolute value difference of minimum average B configuration of neighborhood block motion vector y), A are the neighborhood set for motion vector MV;
If not, then pass through formula MV i - 1 ( x , y ) = ( 1 - &lambda; ) MV i ( x , y ) + &lambda; arg min MVnb i - 1 ( x , y ) &Element; A MAD MVnb i - 1 ( x , y ) Described block motion vector is revised, wherein MV (x y) is block motion vector, wherein, MAD MVnb (x, y)Be motion vector MV (x, the absolute value difference of minimum average B configuration of neighborhood block motion vector y), MV i(x is the revised motion vector in upper level image block place y), and λ is weights, MVnb I-1Be the motion vector of this grade image block place neighborhood, A is the neighborhood set.
50, according to the bad piece restorative procedure of the described image of claim 43, it is characterized in that, described each pixel in the piecemeal is gone bad a little to detect may further comprise the steps:
Preceding frame motion compensation point and back frame motion compensation point according to each the pixel correspondence in the piecemeal, and the correlation of pixel described in u pixel of frame motion compensation point and the described motion compensation of frame afterwards vertex neighborhood and this two field picture before described, judge in the described piecemeal pixel whether be bad point.
According to the bad piece restorative procedure of the described image of claim 50, it is characterized in that 51, a described u pixel is 2 pixels,
Describedly judge that whether the pixel in the piecemeal is that bad point further may further comprise the steps:
To frame motion compensation point before described and described back frame motion compensation point, 2 gray values of pixel points that reach described preceding frame motion compensation point and described back frame motion compensation vertex neighborhood average, and obtain the grade average;
Judge the pixel in the described piecemeal and the correlation of described grade average;
If relevant, the pixel in the then described piecemeal is not a bad point;
If uncorrelated, the pixel in the then described piecemeal is a bad point.
52, according to the bad piece restorative procedure of the described image of claim 51, it is characterized in that, to preceding frame motion compensation point and described back frame motion compensation point, and 2 gray values of pixel points of described preceding frame motion compensation point and described back frame motion compensation vertex neighborhood average, obtaining the grade average is specially: to frame motion compensation point before described and described back frame motion compensation point, 2 pixels that reach described preceding frame motion compensation point and described back frame motion compensation vertex neighborhood sort according to gray value, obtain vector S ( r &RightArrow; ) = [ s 1 ( r &RightArrow; ) , s 2 ( r &RightArrow; ) , s 3 ( r &RightArrow; ) , s 4 ( r &RightArrow; ) , s 5 ( r &RightArrow; ) , s 6 ( r &RightArrow; ) ] , Wherein,
Figure A2008101149210018C2
Pixel coordinate after the expression motion compensation, s 1 ( r &RightArrow; ) &le; s 2 ( r &RightArrow; ) &le; s 3 ( r &RightArrow; ) &le; s 4 ( r &RightArrow; ) &le; s 5 ( r &RightArrow; ) &le; s 6 ( r &RightArrow; ) ;
Described grade average
Figure A2008101149210018C4
For: m ( r &RightArrow; ) = ( s 3 ( r &RightArrow; ) + s 4 ( r &RightArrow; ) ) / 2 .
According to the bad piece restorative procedure of the described image of claim 52, it is characterized in that 53, the pixel in the described judgement piecemeal and the correlation of grade average further may further comprise the steps:
Determine the grade difference, described grade difference is weighed the size of spot correlation on pixel and the time neighborhood, described grade difference
Figure A2008101149210018C6
Obtain by following formula:
d i ( r &RightArrow; ) = s i ( r &RightArrow; ) - I n ( r &RightArrow; ) I n ( r &RightArrow; ) &le; m ( r &RightArrow; ) I n ( r &RightArrow; ) - s l - i ( r &RightArrow; ) I n ( r &RightArrow; ) > m ( r &RightArrow; ) &ForAll; i = 1,2,3 , wherein, described
Figure A2008101149210019C2
It is n two field picture coordinate r &RightArrow; = ( x , y ) Place's gray value,
According to described grade difference
Figure A2008101149210019C4
Whether greater than threshold value T iJudge whether the pixel in the described piecemeal is relevant with described grade average: d i ( r &RightArrow; ) > T i I=1,2,3, wherein, i=1,2,3, T 1, T 2And T 3Be predetermined threshold, and T 1<T 2<T 3
Set up as arbitrary inequality in the above-mentioned formula, judge that then the pixel in the piecemeal is uncorrelated with described grade average.
54, according to the bad piece restorative procedure of the described image of claim 42, it is characterized in that described detected bad point in the bad piece is repaired specifically comprises: by vector median filtering mode, gradient diffusion repair mode or weighted average repair mode described bad point is repaired.
According to the described dead pixel points of images restorative procedure of claim 54, it is characterized in that 55, described reparation vector median filtering mode may further comprise the steps:
Transfer filter template W z
Find pixel corresponding on the described template Wz according to described bad point, and obtain , described
Figure A2008101149210019C7
Determine by following formula, X W z ( i ) arg min X i &Element; W z s W z ( i ) , wherein, s W z ( i ) = &Sigma; j &Element; W z d ( i , j ) , D (i, j)=| X i-X j|, X i, X jBe the bad some template W of institute zThe middle pairing pixel gray value of black region, (i j) is X to d i, X jBetween distance;
Definition set X ^ = { X W z : z = 1,2,3,4,5 } , And according to described X ^ = { X W z : z = 1,2,3,4,5 } Calculate s (z), described s ( z ) = &Sigma; j = 1 5 d ( z , j ) z=1,2,3,4,5;
Select s (z) minimum value pairing
Figure A2008101149210019C13
Pixel value as described bad some place.
56, a kind of dead pixel points of images checkout gear is characterized in that, comprises that picture frame cache module, motion vector computation module, motion compensation point determination module and bad point detect module,
Described picture frame cache module is used at least three frame continuous images are carried out buffer memory, comprises this two field picture, at least one prior image frame and at least one back two field picture;
Described motion vector computation module is used for the image according to described picture frame cache module buffer memory, determines that pixel is respectively with respect to the forward motion vector of described prior image frame with respect to the described backward motion vector of two field picture afterwards in described the two field picture;
Described motion compensation point determination module, the described forward motion vector and the described backward motion vector that are used for obtaining according to described motion vector computation module determine that pixel described in described the two field picture is respectively with respect to the preceding frame motion compensation point of described prior image frame with respect to the described back frame motion compensation point of two field picture afterwards;
Described bad is detected module, and the described preceding frame motion compensation point and the described back frame motion compensation point that are used for determining according to described motion compensation point determination module are gone bad some detection to pixel described in described the two field picture.
According to the described dead pixel points of images checkout gear of claim 56, it is characterized in that 57, described motion vector computation module comprises piecemeal submodule and block motion vector calculating sub module,
Described piecemeal submodule is used for described two field picture of described picture frame cache module buffer memory, described prior image frame and described back two field picture are carried out piecemeal;
Described block motion vector calculating sub module, be used for determining described two field picture piecemeal respectively with respect to the forward block motion vector of described prior image frame and back to block motion vector with respect to described back two field picture, the forward block motion vector of wherein said piecemeal and back can be used as the described forward motion vector and the described backward motion vector of the described pixel that belongs to described piecemeal to block motion vector.
58, according to claim 56 or 57 described dead pixel points of images checkout gears, it is characterized in that, described motion vector computation module also comprises the classification submodule, be used for described two field picture, described prior image frame and described back two field picture being carried out classification according to resolution, wherein, the high more then described image level of resolution is high more, and the resolution of described classification is big or small opposite with described piecemeal;
Described block motion vector calculating sub module, also be used for the forward block motion vector of subordinate's image piecemeal and back to block motion vector as image at the corresponding levels in the initial value of corresponding piecemeal, obtain piecemeal in the described image at the corresponding levels the forward block motion vector and the back to block motion vector, in drawing described highest image the forward block motion vector of piecemeal and the back to block motion vector.
According to the described dead pixel points of images checkout gear of claim 57, it is characterized in that 59, described motion vector computation module also comprises to be judged submodule and revise submodule,
Described judgement submodule is used for judging whether the block motion vector of described subordinate image piecemeal is reliable;
Described correction submodule is used for when described judgement submodule judges that described block motion vector is unreliable described block motion vector being revised.
60, a kind of dead pixel points of images prosthetic device is characterized in that, comprises that picture frame cache module, motion vector computation module, motion compensation point determination module, bad point detect module and repair module,
Described picture frame cache module is used at least three frame continuous images are carried out buffer memory, comprises this two field picture, at least one prior image frame and at least one back two field picture;
Described motion vector computation module is used for the image according to described picture frame cache module buffer memory, determines that pixel is respectively with respect to the forward motion vector of described prior image frame with respect to the described backward motion vector of two field picture afterwards in described the two field picture;
Described motion compensation point determination module, the described forward motion vector and the described backward motion vector that are used for obtaining according to described motion vector computation module determine that pixel described in described the two field picture is respectively with respect to the preceding frame motion compensation point of described prior image frame with respect to the described back frame motion compensation point of two field picture afterwards;
Described bad is detected module, and the described preceding frame motion compensation point and the described back frame motion compensation point that are used for determining according to described motion compensation point determination module are gone bad some detection to pixel described in described the two field picture;
Described reparation module is used for when described bad some detection module detects described pixel for bad point described pixel being repaired.
According to the described dead pixel points of images prosthetic device of claim 60, it is characterized in that 61, described motion vector computation module comprises piecemeal submodule and block motion vector calculating sub module,
Described piecemeal submodule is used for described two field picture of described picture frame cache module buffer memory, described prior image frame and described back two field picture are carried out piecemeal;
Described block motion vector calculating sub module, be used for determining described two field picture piecemeal respectively with respect to the forward block motion vector of described prior image frame and back to block motion vector with respect to described back two field picture, the forward block motion vector of wherein said piecemeal and back can be used as the described forward motion vector and the described backward motion vector of the described pixel that belongs to described piecemeal to block motion vector.
62, according to claim 60 or 61 described dead pixel points of images prosthetic devices, it is characterized in that, described motion vector computation module also comprises the classification submodule, be used for described two field picture, described prior image frame and described back two field picture being carried out classification according to resolution, wherein, the high more then described image level of resolution is high more, and the resolution of described classification is big or small opposite with described piecemeal;
Described block motion vector calculating sub module, also be used for the forward block motion vector of subordinate's image piecemeal and back to block motion vector as image at the corresponding levels in the initial value of corresponding piecemeal, obtain piecemeal in the described image at the corresponding levels the forward block motion vector and the back to block motion vector, in drawing described highest image the forward block motion vector of piecemeal and the back to block motion vector.
According to the described dead pixel points of images prosthetic device of claim 61, it is characterized in that 63, described motion vector computation module also comprises to be judged submodule and revise submodule,
Described judgement submodule is used for judging whether the block motion vector of described subordinate image piecemeal is reliable;
Described correction submodule is used for when described judgement submodule judges that described block motion vector is unreliable described block motion vector being revised.
64, the bad piece checkout gear of a kind of image is characterized in that, comprises picture frame cache module, piecemeal module, block motion vector computing module, bad count determination module and bad piece detection module,
Described picture frame cache module is used at least three frame continuous images are carried out buffer memory, comprises this two field picture, at least one prior image frame and at least one back two field picture;
Described piecemeal module is used for this two field picture of described picture frame cache module buffer memory, described prior image frame and described back two field picture are carried out piecemeal;
Described block motion vector computing module, be used for determining described piecemeal module to the piecemeal of described two field picture respectively with respect to the forward block motion vector of described prior image frame and back with respect to described back two field picture to block motion vector;
The described evil idea determination module of counting, counting of described bad pixel of piecemeal determined to block motion vector in the described forward block motion vector and the described back that are used for obtaining according to described block motion vector computing module;
Described bad piece detection module is used for judging according to described evil idea the counting of bad pixel that determination module determines of counting whether described piecemeal is bad piece, if the counting greater than predetermined threshold value of described bad pixel, then described piecemeal is a bad piece.
According to the bad piece checkout gear of the described image of claim 64, it is characterized in that 65, the described evil idea determination module of counting comprises that motion compensation point determines that submodule and bad point detect submodule,
Described motion compensation point is determined submodule, is used for determining that to block motion vector each pixel of described piecemeal is respectively with respect to the preceding frame motion compensation point of described prior image frame with respect to the described back frame motion compensation point of two field picture afterwards according to described forward block motion vector and described back;
Described bad point detects submodule, be used for each pixel, and described motion compensation point determines that frame motion compensation point and the described point of frame motion compensation are afterwards gone bad some detection to each pixel in the described piecemeal before correspondence that submodule obtains described according to described piecemeal.
According to the bad piece checkout gear of the described image of claim 65, it is characterized in that 66, described block motion vector computing module also comprises classification submodule and block motion vector calculating sub module at the corresponding levels,
Described classification submodule is used for according to resolution described two field picture, described prior image frame and described back two field picture being carried out classification, and wherein, the high more then described image level of resolution is high more, and the resolution of described classification and described piecemeal is big or small opposite;
Described block motion vector calculating sub module at the corresponding levels, be used for the forward block motion vector of subordinate's image piecemeal and back to block motion vector as image at the corresponding levels in the initial value of corresponding piecemeal, obtain piecemeal in the described image at the corresponding levels the forward block motion vector and the back to block motion vector, in drawing described highest image the forward block motion vector of piecemeal and the back to block motion vector.
According to the bad piece checkout gear of the described image of claim 66, it is characterized in that 67, described block motion vector computing module also comprises to be judged submodule and revise submodule,
Described judgement submodule is used for judging whether the block motion vector of described subordinate image piecemeal is reliable;
Described correction submodule is used for when described judgement submodule judges that described block motion vector is unreliable described block motion vector being revised.
68, a kind of bad block repair apparatus of image is characterized in that, comprises that picture frame cache module, piecemeal module, block motion vector computing module, bad point detect module and repair module,
Described picture frame cache module is used at least three frame continuous images are carried out buffer memory, comprises this two field picture, at least one prior image frame and at least one back two field picture;
Described piecemeal module is used for described two field picture of described picture frame cache module buffer memory, described prior image frame and described back two field picture are carried out piecemeal;
Described block motion vector computing module is used for determining that described two field picture piecemeal is respectively with respect to the forward block motion vector of described prior image frame and back to block motion vector with respect to described back two field picture;
Described bad point detects module, and the described forward block motion vector and the described back that are used for obtaining according to described block motion vector computing module are gone bad some detection to block motion vector to each pixel of described piecemeal;
Described reparation module is used for the bad point of the detected described piecemeal of described bad some detection module is repaired.
According to bad block repair apparatus of the described image of claim 68, it is characterized in that 69, described bad point detects module and comprises that definite submodule of motion compensation point and bad point detect submodule,
Described motion compensation point is determined submodule, is used for determining that to block motion vector each pixel of described piecemeal is respectively with respect to the preceding frame motion compensation point of described prior image frame with respect to the described back frame motion compensation point of two field picture afterwards according to described forward block motion vector and described back;
Described bad point detects submodule, be used for each pixel, and described motion compensation point determines that frame motion compensation point and the described point of frame motion compensation are afterwards gone bad some detection to each pixel in the described piecemeal before correspondence that submodule obtains described according to described piecemeal.
According to bad block repair apparatus of the described image of claim 69, it is characterized in that 70, described block motion vector computing module also comprises classification submodule and block motion vector calculating sub module at the corresponding levels,
Described classification submodule is used for according to resolution described two field picture, described prior image frame and described back two field picture being carried out classification, and wherein, the high more then described image level of resolution is high more, and the resolution of described classification is big or small opposite with described piecemeal;
Described block motion vector calculating sub module at the corresponding levels, be used for the forward block motion vector of subordinate's image piecemeal and back to block motion vector as image at the corresponding levels in the initial value of corresponding piecemeal, obtain piecemeal in the described image at the corresponding levels the forward block motion vector and the back to block motion vector, in drawing described highest image the forward block motion vector of piecemeal and the back to block motion vector.
According to the bad piece checkout gear of the described image of claim 70, it is characterized in that 71, described block motion vector computing module also comprises to be judged submodule and revise submodule,
Described judgement submodule is used for judging whether the block motion vector of described subordinate image piecemeal is reliable;
Described correction submodule is used for when described judgement submodule judges that described block motion vector is unreliable described block motion vector being revised.
CN2008101149215A 2008-06-13 2008-06-13 Image detection, repair method and image detection, repair apparatus Active CN101299799B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2008101149215A CN101299799B (en) 2008-06-13 2008-06-13 Image detection, repair method and image detection, repair apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2008101149215A CN101299799B (en) 2008-06-13 2008-06-13 Image detection, repair method and image detection, repair apparatus

Publications (2)

Publication Number Publication Date
CN101299799A true CN101299799A (en) 2008-11-05
CN101299799B CN101299799B (en) 2011-11-09

Family

ID=40079470

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2008101149215A Active CN101299799B (en) 2008-06-13 2008-06-13 Image detection, repair method and image detection, repair apparatus

Country Status (1)

Country Link
CN (1) CN101299799B (en)

Cited By (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102567970A (en) * 2011-12-29 2012-07-11 方正国际软件有限公司 Image restoring method and device
CN102685544A (en) * 2011-03-17 2012-09-19 上海微电子装备有限公司 Image sensor detection device and method
CN102752585A (en) * 2011-04-18 2012-10-24 联咏科技股份有限公司 Data processing method and digital image processing device
CN101751670B (en) * 2009-12-17 2014-09-10 北京中星微电子有限公司 Method and device for detecting foreground object
CN104104945A (en) * 2014-07-22 2014-10-15 西北工业大学 Star sky image defective pixel robustness detection method
CN104301638A (en) * 2013-07-16 2015-01-21 聚晶半导体股份有限公司 Bad pixel processing method and image processing device
CN104363461A (en) * 2014-11-04 2015-02-18 中国科学技术大学 Video frame error concealment method and video decoding method applying same
CN104363391A (en) * 2014-11-28 2015-02-18 广东欧珀移动通信有限公司 Image defective pixel compensation method and system and photographing device
CN104599995A (en) * 2015-01-14 2015-05-06 上海华岭集成电路技术股份有限公司 Method for offline positioning of continuous bad points of image sensing chip
CN105100669A (en) * 2015-07-03 2015-11-25 百度在线网络技术(北京)有限公司 Digital-image conversion method and device
CN105163114A (en) * 2015-08-21 2015-12-16 深圳创维-Rgb电子有限公司 Method and system for detecting screen dead pixel based on camera
CN105354281A (en) * 2014-02-03 2016-02-24 株式会社隆创 Image inspection apparatus and image inspection procedure
CN105451015A (en) * 2014-08-12 2016-03-30 炬力集成电路设计有限公司 Detection method and device for image dead pixels
CN106031144A (en) * 2014-03-28 2016-10-12 华为技术有限公司 Method and device for generating a motion-compensated video frame
CN106131423A (en) * 2016-07-27 2016-11-16 宇龙计算机通信科技(深圳)有限公司 A kind of photographic method, device and terminal
CN106358044A (en) * 2016-10-28 2017-01-25 济南大学 Detecting and correcting method and system for motion vector in process of increasing stereoscopic video frame rate
CN106791852A (en) * 2016-12-14 2017-05-31 深圳市迪威码半导体有限公司 image processing method and device
CN107194359A (en) * 2017-05-26 2017-09-22 深圳大学 The metric space building method and device of a kind of sequence of video images
CN107948634A (en) * 2017-11-22 2018-04-20 深圳开阳电子股份有限公司 A kind of dead pixel points of images detection method, device and picture processing chip
CN109660698A (en) * 2018-12-25 2019-04-19 苏州佳世达电通有限公司 Image processing system and image treatment method
CN110288599A (en) * 2019-07-10 2019-09-27 浙江大华技术股份有限公司 A kind of dead pixel detection method, device, electronic equipment and storage medium
CN112135127A (en) * 2019-11-05 2020-12-25 杭州海康威视数字技术股份有限公司 Encoding and decoding method, device and equipment
CN112348807A (en) * 2020-11-27 2021-02-09 安徽大学 Endoscope highlight point repairing method and system based on contour pixel statistics
CN112637587A (en) * 2020-12-22 2021-04-09 维沃移动通信有限公司 Dead pixel detection method and device
CN114095721A (en) * 2020-08-25 2022-02-25 京东方科技集团股份有限公司 Method and device for detecting video dead pixel and computer readable medium

Cited By (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101751670B (en) * 2009-12-17 2014-09-10 北京中星微电子有限公司 Method and device for detecting foreground object
CN102685544A (en) * 2011-03-17 2012-09-19 上海微电子装备有限公司 Image sensor detection device and method
CN102752585A (en) * 2011-04-18 2012-10-24 联咏科技股份有限公司 Data processing method and digital image processing device
CN102752585B (en) * 2011-04-18 2015-04-15 联咏科技股份有限公司 Data processing method and digital image processing device
CN102567970B (en) * 2011-12-29 2014-06-25 方正国际软件有限公司 Image restoring method and device
CN102567970A (en) * 2011-12-29 2012-07-11 方正国际软件有限公司 Image restoring method and device
CN104301638A (en) * 2013-07-16 2015-01-21 聚晶半导体股份有限公司 Bad pixel processing method and image processing device
CN104301638B (en) * 2013-07-16 2018-03-13 聚晶半导体股份有限公司 Bad pixel processing method and image processing apparatus
CN105354281A (en) * 2014-02-03 2016-02-24 株式会社隆创 Image inspection apparatus and image inspection procedure
CN106031144B (en) * 2014-03-28 2019-05-24 华为技术有限公司 The method and apparatus for generating motion compensated video frame
CN106031144A (en) * 2014-03-28 2016-10-12 华为技术有限公司 Method and device for generating a motion-compensated video frame
CN104104945B (en) * 2014-07-22 2015-12-09 西北工业大学 Starry sky image bad point Robust Detection Method
CN104104945A (en) * 2014-07-22 2014-10-15 西北工业大学 Star sky image defective pixel robustness detection method
CN105451015A (en) * 2014-08-12 2016-03-30 炬力集成电路设计有限公司 Detection method and device for image dead pixels
CN104363461A (en) * 2014-11-04 2015-02-18 中国科学技术大学 Video frame error concealment method and video decoding method applying same
CN104363461B (en) * 2014-11-04 2017-12-22 中国科学技术大学 The error concealing method of frame of video and apply its video encoding/decoding method
CN104363391A (en) * 2014-11-28 2015-02-18 广东欧珀移动通信有限公司 Image defective pixel compensation method and system and photographing device
CN104363391B (en) * 2014-11-28 2018-11-27 广东欧珀移动通信有限公司 Dead pixel points of images compensation method, system and photographing device
CN104599995A (en) * 2015-01-14 2015-05-06 上海华岭集成电路技术股份有限公司 Method for offline positioning of continuous bad points of image sensing chip
CN104599995B (en) * 2015-01-14 2017-04-05 上海华岭集成电路技术股份有限公司 The offline method for positioning the continuous bad point of image sensor chip
US10951870B2 (en) 2015-07-03 2021-03-16 Baidu Online Network Technology (Beijing) Co., Ltd. Digital image conversion method and apparatus, storage medium, and device
CN105100669A (en) * 2015-07-03 2015-11-25 百度在线网络技术(北京)有限公司 Digital-image conversion method and device
CN105163114A (en) * 2015-08-21 2015-12-16 深圳创维-Rgb电子有限公司 Method and system for detecting screen dead pixel based on camera
CN106131423A (en) * 2016-07-27 2016-11-16 宇龙计算机通信科技(深圳)有限公司 A kind of photographic method, device and terminal
CN106358044A (en) * 2016-10-28 2017-01-25 济南大学 Detecting and correcting method and system for motion vector in process of increasing stereoscopic video frame rate
CN106791852A (en) * 2016-12-14 2017-05-31 深圳市迪威码半导体有限公司 image processing method and device
CN106791852B (en) * 2016-12-14 2019-08-16 深圳市迪威码半导体有限公司 Image processing method and device
CN107194359A (en) * 2017-05-26 2017-09-22 深圳大学 The metric space building method and device of a kind of sequence of video images
CN107948634A (en) * 2017-11-22 2018-04-20 深圳开阳电子股份有限公司 A kind of dead pixel points of images detection method, device and picture processing chip
CN107948634B (en) * 2017-11-22 2021-11-05 深圳开阳电子股份有限公司 Image dead pixel detection method and device and image processing chip
CN109660698A (en) * 2018-12-25 2019-04-19 苏州佳世达电通有限公司 Image processing system and image treatment method
CN109660698B (en) * 2018-12-25 2021-08-03 苏州佳世达电通有限公司 Image processing system and image processing method
CN110288599A (en) * 2019-07-10 2019-09-27 浙江大华技术股份有限公司 A kind of dead pixel detection method, device, electronic equipment and storage medium
CN112135126B (en) * 2019-11-05 2021-09-21 杭州海康威视数字技术股份有限公司 Encoding and decoding method, device, equipment and machine readable storage medium
CN112135127A (en) * 2019-11-05 2020-12-25 杭州海康威视数字技术股份有限公司 Encoding and decoding method, device and equipment
CN112135126A (en) * 2019-11-05 2020-12-25 杭州海康威视数字技术股份有限公司 Encoding and decoding method, device and equipment
CN114095721A (en) * 2020-08-25 2022-02-25 京东方科技集团股份有限公司 Method and device for detecting video dead pixel and computer readable medium
CN114095721B (en) * 2020-08-25 2023-04-28 京东方科技集团股份有限公司 Method and device for detecting video dead pixel and computer readable medium
CN112348807A (en) * 2020-11-27 2021-02-09 安徽大学 Endoscope highlight point repairing method and system based on contour pixel statistics
CN112348807B (en) * 2020-11-27 2022-11-18 安徽大学 Endoscope highlight point repairing method and system based on contour pixel statistics
CN112637587A (en) * 2020-12-22 2021-04-09 维沃移动通信有限公司 Dead pixel detection method and device
CN112637587B (en) * 2020-12-22 2022-04-01 维沃移动通信有限公司 Dead pixel detection method and device

Also Published As

Publication number Publication date
CN101299799B (en) 2011-11-09

Similar Documents

Publication Publication Date Title
CN101299799A (en) Image detection, repair method and image detection, repair apparatus
US7697749B2 (en) Stereo image processing device
CN101764926B (en) Apparatus and system for defect pixel detection and correction, method for detecting and correcting defect pixel
JP4816725B2 (en) Image processing apparatus, image processing program, electronic camera, and image processing method for image analysis of lateral chromatic aberration
JP4961234B2 (en) Object tracking device
CN101651786B (en) Method for restoring brightness change of video sequence and video processing equipment
US9401029B2 (en) Moving object detection method
US20030123726A1 (en) Scene change detection apparatus
CN103093458B (en) The detection method of key frame and device
CN104168478B (en) Based on the video image color cast detection method of Lab space and relevance function
CN104410855A (en) Jitter detection method of monitoring video
CN102047290A (en) Image processing device, image processing program, image processing method, and electronic device
US8774276B2 (en) Image processing method for determining motion vectors of interpolated picture and related apparatus
CN101193201A (en) Interpolated frame generating method and interpolated frame generating apparatus
CN115147418B (en) Compression training method and device for defect detection model
CN115578310A (en) Binocular vision detection method and system for refractory bricks
US9478041B2 (en) Moving object detection method
KR100742762B1 (en) Detector for predicting of movement
US20090059065A1 (en) Interpolative frame generating apparatus and method
CN103096009B (en) Image processing apparatus and method and image display device and method
CN115963114B (en) Lithium battery production quality inspection system
JP4605582B2 (en) Stereo image recognition apparatus and method
CN102007767A (en) Imaging position determination method and imaging position determination device
EP2237220A2 (en) Method of correcting image distortion
CN108734707B (en) Mobile phone horn foam presence/absence detection method based on infrared laser and 3D camera

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20171221

Address after: 100083 Haidian District, Xueyuan Road, No. 35, the world building, the second floor of the building on the ground floor, No. 16

Patentee after: Zhongxing Technology Co., Ltd.

Address before: 100083 Haidian District, Xueyuan Road, No. 35, the world building, the second floor of the building on the ground floor, No. 16

Patentee before: Beijing Vimicro Corporation

CP01 Change in the name or title of a patent holder
CP01 Change in the name or title of a patent holder

Address after: 100083 Haidian District, Xueyuan Road, No. 35, the world building, the second floor of the building on the ground floor, No. 16

Patentee after: Mid Star Technology Limited by Share Ltd

Address before: 100083 Haidian District, Xueyuan Road, No. 35, the world building, the second floor of the building on the ground floor, No. 16

Patentee before: Zhongxing Technology Co., Ltd.