CN104899881A - Shadow detection method for moving vehicle in video image - Google Patents

Shadow detection method for moving vehicle in video image Download PDF

Info

Publication number
CN104899881A
CN104899881A CN201510282190.5A CN201510282190A CN104899881A CN 104899881 A CN104899881 A CN 104899881A CN 201510282190 A CN201510282190 A CN 201510282190A CN 104899881 A CN104899881 A CN 104899881A
Authority
CN
China
Prior art keywords
seg
image
region
shadow
fea
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510282190.5A
Other languages
Chinese (zh)
Other versions
CN104899881B (en
Inventor
贺科学
李树涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hunan University
Changsha University of Science and Technology
Original Assignee
Hunan University
Changsha University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hunan University, Changsha University of Science and Technology filed Critical Hunan University
Priority to CN201510282190.5A priority Critical patent/CN104899881B/en
Publication of CN104899881A publication Critical patent/CN104899881A/en
Application granted granted Critical
Publication of CN104899881B publication Critical patent/CN104899881B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/12Edge-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30248Vehicle exterior or interior
    • G06T2207/30252Vehicle exterior; Vicinity of vehicle

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Image Analysis (AREA)

Abstract

The present invention discloses a shadow detection method for a moving vehicle in a video image, used for eliminating the shadow of a moving target in a foreground image and improving the accuracy of target detection and tracing. The shadow detection method provided by the present invention comprises steps of: building a feature image of information of fusion brightness, chrominance, edge gradient and the like; after cutting the image, taking a region with highest color difference as a starting region of vehicle body search; performing iterative search and detection on a region with highest feature value in peripheral adjacent regions until meeting a stopping criterion for iteration; if the rest sub-region set is a null set, showing that the shadow of the moving target can be neglected, otherwise, taking the rest sub-regions as shadow candidate regions; then searching shadow sub-regions from each of the shadow candidate regions; and finally combining all the searched shadow sub-regions into a complete shadow region. The method is capable of automatically determining whether the shadow exists, fusing various features more reasonably and reducing manual interventions, and is high in shadow detection rate and good in universality.

Description

Moving vehicle shadow detection method in a kind of video image
Technical field
The invention belongs to digital image processing field, particularly the shadow detection method of moving vehicle in a kind of video image.
Background technology
Shade mainly object block light source and formed dark areas, the feature according to shade can be divided into from shade and cast shadow.From shade be object itself not by the part that light irradiates, the part that should belong to target object from shade of moving target in video analysis.And cast shadow is object block light source after be incident upon shade in scene, the objects such as such as trees, vehicle, pedestrian are incident upon the shade on road surface, and this is the part of video scene but not moving target.Cast shadow in video can be divided into static shade and motion shade.Static shade is dissolved in background gradually in background modeling.Motion shade is shut out the light by the foreground target of movement in scene and is incident upon the dark areas in scene, along with target is moved together.
The motion shade being incident upon road surface due to vehicle has very similar motion feature to vehicle, and thus motion shade is usually mistaken for a part for foreground moving object.If do not eliminate this type games shade, the defect such as foreground target shape distortion, multiple moving target adhesions can be caused, the image processing operations such as follow-up vehicle detection, vehicle tracking, vehicle detection are had a huge impact, the link so detection moving vehicle shade is very important is one of hot subject of research always.
At present, the algorithm of shadow Detection can be divided into method, the type such as the method based on shading attributes feature and the method based on machine learning based on shadow model.
(1) based on the method for shadow model: mainly carry out modeling to video scene, comprise types such as source modeling and projecting direction modelings.In source modeling, one is suppose that pure white light is unique light source, shade is caused by linear attenuation due to light, and another kind is hypothesis light source is direct light (as sunshine) and the acting in conjunction that diffuses, and light is formed shade by non-linearly decaying.Such as Nadimi and Bhanu proposes a kind of double-colored model, considers two kinds of light sources to the impact of shadow region.In projecting direction modeling, Liu Zhifang etc. propose a kind of cast shadow direction model, Yuan Jiwei and Shi Zhongke further provides eight kinds of vehicle/shadow model on this basis.Method based on model needs to obtain the prior imformations such as illumination condition, moving target, scene in advance, and under numerous scenes such as background complexity, illuminance abrupt variation, the model set up exists the defect of adaptability aspect.
(2) based on the method for shading attributes feature: mainly utilize the information such as the brightness of shade, gradient, color, texture to identify shadow region.It has been generally acknowledged that the brightness step-down of shadow region (particularly penumbra region), and the change such as gradient, colourity, texture is less or ignore.The method of feature based has stronger robustness to different scenes and illumination condition, but the universality of algorithm still has much room for improvement.
(3) based on the method for machine learning: by sorter model such as structure support vector machine, neural network etc., set up the learning database of the feature such as texture, gray scale, and carry out training study to sorter model, then by the sorter trained to differentiate that whether dark areas is for shade.These class methods solve the aspect such as automatic learning, a pattern-recognition difficult problem, but the aspects such as the generalization ability of sorter, universality wait to improve.
In sum, each class methods still have certain limitation in process shadow problem, are necessary to improve shadow detection method.
Summary of the invention
Given this, the invention provides the detection method of moving vehicle shade in a kind of video image, to overcome the defect and deficiency that exist in existing method.
For achieving the above object, the invention provides a kind of moving vehicle shadow removing method, comprising:
(1) the image I of moving vehicle target is extracted fwith background image I bafter, be converted to YCbCr color space respectively, obtain image I fwith luminance component Y, chrominance C b and the Cr component of background, then build the image I merging brightness, chromaticity information fea, image I feaits pixel value of middle each point is
I fea ( x , y ) = Σ ( x , y ) ∈ D Y F ( x , y ) Σ ( x , y ) ∈ D Y B ( x , y ) · ( 1 + Σ ( x , y ) ∈ D Cb F ( x , y ) - Σ ( x , y ) ∈ D Cb B ( x , y ) Σ ( x , y ) ∈ D [ BW ( x , y ) · Cb B ( x , y ) ] ) · ( 1 + Σ ( x , y ) ∈ D Cr F ( x , y ) - Σ ( x , y ) ∈ D Cr B ( x , y ) Σ ( x , y ) ∈ D [ BW ( x , y ) · Cr B ( x , y ) ] ) - - - ( 1 )
Wherein, the binaryzation foreground target image of BW for obtaining based on the moving target detecting method of background subtracting, D is the neighborhood of pixel P (x, y), then by image I feathreshold value T is tried to achieve through maximum variance between clusters fea, then by image I feain be less than threshold value T feapixel value vanishing, thus obtain image H fea;
(2) to image I fcarry out region segmentation, and computed image I feach region and its background image between the absolute value summation of difference between chrominance C b and Cr, by the region D of its maximal value seg(i) as the search initiation region of carbody, namely
D seg ( i ) = arg max F [ Σ ( x , y ) ∈ Desg ( | Cb F ( x , y ) - Cb B ( x , y ) | + | Cr F ( x , y ) - Cr B ( x , y ) | ) ] ;
(3) adopt boundary operator to image I feacarry out rim detection, obtain edge image E, try to achieve the binary-state threshold T of edge image E according to maximum variance between clusters edge, will threshold value T be less than edgerim value vanishing, obtain the image I containing edge feature edge, and by image H feawith image I edgesuperpose, form the characteristic image M containing edge, brightness and chrominance information, namely
M(x,y)=I edge+H fea(x,y)
Wherein, I edge ( x , y ) = E ( x , y ) E ( x , y ) &GreaterEqual; T edge 0 E ( x , y ) < T edge ;
(4) structure suppresses the mask image of shadow region and background edge, first try to achieve the boundary B of binaryzation foreground target image BW, every bit P (the x all over border is gone through along boundary B, y), again by P (x, y) the pixel M (x, y) put in corresponding neighborhood L is set to zero, and the width calculation formula of neighborhood L is
L=λ·arccot[α·(d c-d z)]
Wherein, λ is amplitude Dynamic gene, and α is rate of change Dynamic gene, d cfor P (x, y) point is to the distance of characteristic image M centre of form C, d zfor P (x, y) point is to characteristic image M barycenter Z distance, as L<0, L is set to zero;
(5) search initiation region D is obtained segi the border b of (), finds out all and D along border b segi r region that () is connected, forms set [D seg(1), D seg(2) ... D seg(r)], get the region D that the pixel average of characteristic image M in this set is maximum seg(j), then by D seg(j) and D segi () region merging technique forms larger region D seg(i), namely
D seg k ( i ) = D seg k - 1 ( i ) + D seg k - 1 ( j ) - - - ( 6 )
Wherein, n is D segm the number of pixel in () region, k is current iteration counting, iterates until the region D that obtains segstop when () meets formula (7) i, i.e. region D segi in the periphery subregion of (), no longer domain of the existence pixel average is greater than the subregion of threshold xi, threshold xi gets the region D that segment that in boundary B, neighborhood L width is greater than zero is touched segthe characteristic image M pixel average of (j);
max { 1 n &Sigma; ( x , y ) &Element; Desg ( m ) M ( x , y ) } < &xi; , m = r + 1 , r + 2 . . . r + k - - - ( 7 )
Region D segi () other subregion untouched forms 2 set Q 1=[D seg(r+1), D seg(r+2) ... D seg] and Q (r+k) 2=[D seg(r+k+1), D seg(r+k+2) ... D seg(N)], Q 1d segthe adjacent subarea territory set of (i), Q 2for not with D segi regional ensemble that () is adjacent, if Q 1and Q 2being empty set, there is not shade in account for motion target, namely completes the testing process of whole shade candidate region; Otherwise, judge set Q 2whether the area pixel mean value in middle region is greater than threshold xi, if be not more than, gathers Q 1and Q 2all elements composition region be the candidate regions of shade, if be greater than, illustrated that two moving targets there occurs adhesion, then will Q have been gathered 2by formula (6), shadowing analysis is carried out to another target, until Q will be gathered when meeting (7) formula 1and Q 2all elements composition region be the candidate regions of shade;
(6) with shade candidate regions for starting point, adopt region-growing method to search the shadow region of shade candidate regions and periphery thereof, the criterion of region growing search is
S(j)={P(x,y):M(x,y)<T edge&|I fea(x,y)-I fea(x+d,y+d)|<ζσ&BW(x,y)=1}
Go through all over set Q 1and Q 2subregion representated by each element, in search subregion and neighboring area, obtains shade subregion S (r+1), S (r+2) ... S (N), all shade subregions obtain whole shadow region S of moving vehicle by logical "or" computing, namely
S=D seg(r+1)|D seg(r+2)|…D seg(N)|S(r+1)|S(r+2)|…S(N)。
Moving vehicle shadow detection method in described a kind of video image, in described step (1), as background image I bluminance component Y, chrominance C b and Cr component in any channel components is less than normal when causing denominator to be zero, adopt the mean value of this channel components to substitute
The present invention considers the multicharacteristic informations such as brightness, colourity and edge gradient simultaneously, shadow region brightness is utilized to be the ratio decay of its background and the colourity change feature such as small, adopt the attenuation ratio value between the brightness of movement destination image and its background image, chromatic component, construct shadow character image.This characteristic image has been decayed the texture of shadow region effectively, and strengthens the texture of nonshaded area further.After image region segmentation, with the maximum region of colour difference for start point search vehicle body region, and untouched remaining area is considered as shade candidate regions.Again from each its neighboring area of shade candidate regions search, all shade subregions of final integration, obtain the whole shadow region of vehicle.Compared with existing shadow detection method, experimental result shows: the method proposed independently can differentiate whether there is shade, there is good shadow Detection performance and universality, reduce the impact of shade on subsequent video analysis, be applicable to the application such as target following, vehicle, vehicle Flow Detection that traffic video is analyzed.
Accompanying drawing explanation
Fig. 1 is a two field picture of the present invention's video sequence in an embodiment;
Fig. 2 is the background image I of the present invention's video scene in an embodiment b;
Fig. 3 is that the present invention is in an embodiment containing the moving vehicle image I of shadow region f;
Fig. 4 is the moving vehicle image I that brightness and chrominance information are merged in the present invention in an embodiment fea;
Fig. 5 is the present invention's region, search starting point of moving vehicle car body and shade candidate regions in an embodiment;
Fig. 6 is the moving vehicle characteristic image M that gray scale, edge and colourity are merged in the present invention in an embodiment;
Fig. 7 is the mask image that the present invention suppresses shadow region marginal information in an embodiment;
Fig. 8 is the characteristic image M that the present invention eliminates shadow region marginal information in an embodiment;
Fig. 9 is the testing result of the present invention's moving vehicle shade in an embodiment.
Embodiment
Below in conjunction with the drawings and specific embodiments, the method for moving vehicle shadow Detection in video image of the present invention is set forth further.
In the present invention's video image in an embodiment, moving vehicle shadow detection method comprises the following steps.
Steps A. set up background model for traffic monitoring scene as shown in Figure 1.Background real-time update is obtained to the background of moving vehicle, as shown in Figure 2.The PBAS method in moving target detecting method is adopted to obtain moving vehicle target, as shown in Figure 3.
Step B. is by movement destination image I fwith background image I bbe converted to YCbCr color space from rgb color space, obtain the value of brightness Y, chrominance C b and Cr tri-components respectively, conversion formula is as follows
Y=16+65.481*R+128.553*G+24.966*B
Cb=128-37.797*R-74.203*G+112*B
Cr=128+112*R-93.785*G-18.214*B
Step C. design of graphics is as I fea, reach and cut down shadow region texture and the object strengthening car body texture, as shown in Figure 4.Image I feain each calculated for pixel values formula such as formula shown in (1)
I fea ( x , y ) = &Sigma; ( x , y ) &Element; D Y F ( x , y ) &Sigma; ( x , y ) &Element; D Y B ( x , y ) &CenterDot; ( 1 + &Sigma; ( x , y ) &Element; D Cb F ( x , y ) - &Sigma; ( x , y ) &Element; D Cb B ( x , y ) &Sigma; ( x , y ) &Element; D [ BW ( x , y ) &CenterDot; Cb B ( x , y ) ] ) &CenterDot; ( 1 + &Sigma; ( x , y ) &Element; D Cr F ( x , y ) - &Sigma; ( x , y ) &Element; D Cr B ( x , y ) &Sigma; ( x , y ) &Element; D [ BW ( x , y ) &CenterDot; Cr B ( x , y ) ] ) - - - ( 1 )
Wherein, BW is the binary image of foreground target, and D is the neighborhood of pixel P (x, y), and in the present embodiment, Size of Neighborhood D value gets 3, i.e. 8 neighborhoods.When denominator is 0, adopt background image I respectively bbrightness Y, chrominance C b and Cr mean value replace corresponding denominator.
Image I is tried to achieve according to maximum variance between clusters feabinary-state threshold T fea, in view of being less than threshold value T feapixel normally shade or black car body cause, for reducing the impact that this kind of pixel is searched for car body, therefore, will threshold value T be less than feavalue become 0, obtain image H fea, namely
H fea ( x , y ) = I fea ( x , y ) I fea ( x , y ) &GreaterEqual; T fea 0 I fea ( x , y ) < T fea
Step D. adopts Meanshift algorithm to carry out image I fsplit some subregions and form set D seg(N), image I is got according to formula (2) fchrominance C b, Cr component differ maximum region D with background image segi (), as the region, search starting point of carbody, as shown in Figure 5, the region that wherein color is the darkest is region, search starting point, namely
D seg ( i ) = arg max F [ &Sigma; ( x , y ) &Element; Desg ( | Cb F ( x , y ) - Cb B ( x , y ) | + | Cr F ( x , y ) - Cr B ( x , y ) | ) ] ;
Step e. adopt boundary operator to image I feacarry out rim detection, adopt Sobel boundary operator to obtain edge image E in the present embodiment, its computing formula is
E ( x , y ) = ( | G x | + | G y | ) ( 1 + &Sigma; ( x , y ) &Element; D Cb F ( x , y ) - &Sigma; ( x , y ) &Element; D Cb B ( x , y ) &Sigma; ( x , y ) &Element; D [ BW ( x , y ) &CenterDot; Cb B ( x , y ) ] ) &CenterDot; ( 1 + &Sigma; ( x , y ) &Element; D Cr F ( x , y ) - &Sigma; ( x , y ) &Element; D Cr B ( x , y ) &Sigma; ( x , y ) &Element; D [ BW ( x , y ) &CenterDot; Cr B ( x , y ) ] )
Wherein, G x=I fea(x-1, y-1)+2I fea(x, y-1)+I fea(x+1, y-1)-I fea(x-1, y+1)-2I fea(x, y+1)-I fea(x+1, y+1),
G y=I fea(x-1,y-1)+2I fea(x-1,y)+I fea(x-1,y+1)-I fea(x+1,y-1)-2I fea(x+1,y)-I fea(x+1,y+1)
Maximum variance between clusters is adopted to try to achieve the binary-state threshold T of edge image E edge, will threshold value T be less than edgerim value become 0, to reduce the interference that slight edge causes, namely
I edge ( x , y ) = E ( x , y ) E ( x , y ) &GreaterEqual; T edge 0 E ( x , y ) < T edge - - - ( 3 )
Then, by image H feawith edge image I edgesuperpose, obtain the characteristic image M having merged edge gradient, brightness and colourity, the value of each pixel is
M(x,y)=I edge+H fea(x,y) (4)
The characteristic image M obtained in the present embodiment as shown in Figure 6.
Step F. obtain binaryzation foreground target image BW, calculate the centre of form C (x of binaryzation BW c, y c), centroid calculation formula is
x c = 1 n &Sigma; i = 1 m &Sigma; j = 1 n i &CenterDot; BW ( i , j ) , y c = 1 n &Sigma; i = 1 m &Sigma; j = 1 n j &CenterDot; BW ( i , j )
Wherein n = &Sigma; i = 1 m &Sigma; j = 1 n BW ( i , j )
Due to the marginal information skewness of characteristic image M, show as that car body area marginal information is enriched and the marginal information in shadow region is very rare, therefore characteristic image M barycenter is closer to car body, its barycenter Z (x z, y z) computing formula be
x z = 1 n &Sigma; i = 1 m &Sigma; j = 1 n i &CenterDot; I edge ( i , j ) &CenterDot; BW ( i , j ) , y z = 1 n &Sigma; i = 1 m &Sigma; j = 1 n j &CenterDot; I edge ( i , j ) &CenterDot; BW ( i , j )
Wherein n = &Sigma; i = 1 m &Sigma; j = 1 n BW ( i , j )
In order to cut down the edge in shadow region and background area, build the mask image suppressing shadow region marginal information, as shown in Figure 7.In order to retain car body marginal information, the width of neighborhood L is variable, and time in shadow region, L value is comparatively large, and L value is less when nonshaded area.If the distance that any point in the boundary B of binaryzation foreground image BW is P (x, y) to centre of form C is d c, P (x, y) point is d to barycenter Z distance z, then the width of neighborhood L is
L=λ·arccot[α·(d c-d z)] (5)
In the present embodiment, as L<0, putting L is 0; λ is amplitude Dynamic gene, and in the present embodiment, λ value is 1; α is rate of change Dynamic gene, and in the present embodiment, α value is 1.The effect of this mask image is that the pixel M (x, y) in P (x, y) vertex neighborhood L is set to 0.To characteristic image M after the operation of mask image, restrained effectively the marginal information in shadow region, as shown in Figure 8.
Step G. obtains region, search starting point D segi the border b of (), finds out all and D along border b segi region that () is connected, supposes that region quantity is r, forms set [D seg(1), D seg(1) ... D seg(r)], calculate the pixel average in each region of characteristic image M, average maximum D seg(j) region and original D segi () merges, namely
D seg k ( i ) = D seg k - 1 ( i ) + D seg k - 1 ( j ) - - - ( 6 )
Wherein, n is D segm the number of pixel in () region, k is current iteration counting.
Then loop iteration tries to achieve region D seg(i), until termination of iterations when meeting formula (7), namely in characteristic image M with D segin i other subregion that () is adjacent, no longer domain of the existence pixel characteristic mean value is all less than the subregion of threshold xi, threshold xi be approximately equal to zero decimal, the value of threshold xi of adjusting according to the difference of video scene.
max { 1 n &Sigma; ( x , y ) &Element; Desg ( m ) M ( x , y ) } < &xi; , m = r + 1 , r + 2 . . . r + k - - - ( 7 )
Region D segi () other subregion untouched forms 2 set Q 1=[D seg(r+1), D seg(r+2) ... D seg] and Q (r+k) 2=[D seg(r+k+1), D seg(r+k+2) ... D seg(N)], Q 1d segthe periphery subregion set of (i), Q 2be not with D segi regional ensemble that () is adjacent.
Q in the present embodiment 1and Q 2set is non-NULL, and account for motion target exists shade.Again due to set Q 2middle area pixel mean value is all less than threshold xi, and the shade only having a moving target is described.Then, Q will be gathered 1and Q 2all elements be considered as the candidate regions of shade.The mainly shadow region, the region involved by segment that in boundary B, neighborhood L width value is greater than zero, as shown in Figure 6 and Figure 7, therefore, threshold xi gets the characteristic image M pixel average that neighborhood L width value is greater than the region involved by segment of zero, and in the present embodiment, threshold xi is 0.1.D after iteration ends segi () as the gray area in Fig. 5, i.e. carbody part, the white space be not colored is then shade candidate region.
Step H. is from Q 1and Q 2each element [D of set seg(r+1), D seg(r+2) ... D seg(N) subregion] sets out, and adopts region-growing method at characteristic image I feasearch shadow region S (j) in (x, y), the criterion of region growing calculates according to formula (8).
S(j)={P(x,y):M(x,y)<T edge&|I fea(x,y)-I fea(x+d,y+d)|<ζσ&BW(x,y)=1} (8)
Obtain shade subregion S (r+1), S (r+2) ... after S (N), all subregions are obtained whole shade subregion S of moving vehicle by logical "or" computing, namely
S=D seg(r+1)|D seg(r+2)|…D seg(N)|S(r+1)|S(r+2)|…S(N)
In the present embodiment, as shown in Figure 9, its grey area is the shade detected to whole shade subregion S, and white portion is the car body of vehicle.As can be seen from Figure 9, the present invention detects the effective of shade from moving target.

Claims (2)

1. a moving vehicle shadow detection method in video image, is characterized in that, comprise following steps:
(1) the image I of moving vehicle target is extracted fwith background image I bafter, be converted to YCbCr color space respectively, obtain image I fwith luminance component Y, chrominance C b and the Cr component of background, then build the image I merging brightness, chromaticity information fea, image I feaits pixel value of middle each point is
I fea ( x , y ) = &Sigma; ( x , y ) &Element; D Y F ( x , y ) &Sigma; ( x , y ) &Element; D Y B ( x , y ) &CenterDot; ( 1 + &Sigma; ( x , y ) &Element; D Cb F ( x , y ) - &Sigma; ( x , y ) &Element; D Cb B ( x , y ) &Sigma; ( x , y ) &Element; D [ BW ( x , y ) &CenterDot; Cb B ( x , y ) ] ) &CenterDot; ( 1 + &Sigma; ( x , y ) &Element; D Cr F ( x , y ) - &Sigma; ( x , y ) &Element; D Cr B ( x , y ) &Sigma; ( x , y ) &Element; D [ BW ( x , y ) &CenterDot; Cr B ( x , y ) ] ) - - - ( 1 )
Wherein, the binaryzation foreground target image of BW for obtaining based on the moving target detecting method of background subtracting, D is the neighborhood of pixel P (x, y), then by image I feathreshold value T is tried to achieve through maximum variance between clusters fea, then by image I feain be less than threshold value T feapixel value vanishing, thus obtain image H fea;
(2) to image I fcarry out region segmentation, and computed image I feach region and its background image between the absolute value summation of difference between chrominance C b and Cr, by the region D of its maximal value seg(i) as the search initiation region of carbody, namely
D seg ( i ) = arg max F [ &Sigma; ( x , y ) &Element; Dseg ( | Cb F ( x , y ) - Cb B ( x , y ) | + | Cr F ( x , y ) - Cr B ( x , y ) | ) ] ;
(3) adopt boundary operator to image I feacarry out rim detection, obtain edge image E, try to achieve the binary-state threshold T of edge image E according to maximum variance between clusters edge, will threshold value T be less than edgerim value vanishing, obtain the image I containing edge feature edge, and by image H feawith image I edgesuperpose, form the characteristic image M containing edge, brightness and chrominance information, namely
M(x,y)=I edge+H fea(x,y)
Wherein, I edge ( x , y ) = E ( x , y ) E ( x , y ) &GreaterEqual; T edge 0 E ( x , y ) < T edge ;
(4) structure suppresses the mask image of shadow region and background edge, first try to achieve the boundary B of binaryzation foreground target image BW, every bit P (the x all over border is gone through along boundary B, y), again by P (x, y) the pixel M (x, y) put in corresponding neighborhood L is set to zero, and the width calculation formula of neighborhood L is
L=λ·arccot[α·(d c-d z)]
Wherein, λ is amplitude Dynamic gene, and α is rate of change Dynamic gene, d cfor P (x, y) point is to the distance of characteristic image M centre of form C, d zfor P (x, y) point is to characteristic image M barycenter Z distance, as L<0, L is set to zero;
(5) search initiation region D is obtained segi the border b of (), finds out all and D along border b segi r region that () is connected, forms set [D seg(1), D seg(2) ... D seg(r)], get the region D that the pixel average of characteristic image M in this set is maximum seg(j), then by D seg(j) and D segi () region merging technique forms larger region D seg(i), namely
D seg k ( i ) = D seg k - 1 ( i ) + D seg k - 1 ( j ) - - - ( 6 )
Wherein, n is D segm the number of pixel in () region, k is current iteration counting, iterates until the region D that obtains segstop when () meets formula (7) i, i.e. region D segi in the periphery subregion of (), no longer domain of the existence pixel average is greater than the subregion of threshold xi, threshold xi gets the region D that segment that in boundary B, neighborhood L width is greater than zero is touched segthe characteristic image M pixel average of (j);
max { 1 n &Sigma; ( x , y ) &Element; Dseg ( m ) M ( x , y ) } < &xi; , m = r + 1 , r + 2 . . . r + k - - - ( 7 )
Region D segi () other subregion untouched forms 2 set Q 1=[D seg(r+1), D seg(r+2) ... D seg] and Q (r+k) 2=[D seg(r+k+1), D seg(r+k+2) ... D seg(N)], Q 1d segthe adjacent subarea territory set of (i), Q 2for not with D segi regional ensemble that () is adjacent, if Q 1and Q 2being empty set, there is not shade in account for motion target, namely completes the testing process of whole shade candidate region; Otherwise, judge set Q 2whether the area pixel mean value in middle region is greater than threshold xi, if be not more than, gathers Q 1and Q 2all elements composition region be the candidate regions of shade, if be greater than, illustrated that two moving targets there occurs adhesion, then will Q have been gathered 2by formula (6), shadowing analysis is carried out to another target, until Q will be gathered when meeting (7) formula 1and Q 2all elements composition region be the candidate regions of shade;
(6) with shade candidate regions for starting point, adopt region-growing method to search the shadow region of shade candidate regions and periphery thereof, the criterion of region growing search is
S(j)={P(x,y):M(x,y)<T edge&|I fea(x,y)-I fea(x+d,y+d)|<ζσ&BW(x,y)=1}
Go through all over set Q 1and Q 2subregion representated by each element, in search subregion and neighboring area, obtains shade subregion S (r+1), S (r+2) ... S (N), all shade subregions obtain whole shadow region S of moving vehicle by logical "or" computing, namely
S=D seg(r+1)|D seg(r+2)|…D seg(N)|S(r+1)|S(r+2)|…S(N)。
2. moving vehicle shadow detection method in a kind of video image according to claim 1, is characterized in that, in described step (1), as background image I bluminance component Y, chrominance C b and Cr component in any channel components is less than normal when causing denominator to be zero, adopt the mean value of this channel components to substitute.
CN201510282190.5A 2015-05-28 2015-05-28 Moving vehicle shadow detection method in a kind of video image Expired - Fee Related CN104899881B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510282190.5A CN104899881B (en) 2015-05-28 2015-05-28 Moving vehicle shadow detection method in a kind of video image

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510282190.5A CN104899881B (en) 2015-05-28 2015-05-28 Moving vehicle shadow detection method in a kind of video image

Publications (2)

Publication Number Publication Date
CN104899881A true CN104899881A (en) 2015-09-09
CN104899881B CN104899881B (en) 2017-11-28

Family

ID=54032526

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510282190.5A Expired - Fee Related CN104899881B (en) 2015-05-28 2015-05-28 Moving vehicle shadow detection method in a kind of video image

Country Status (1)

Country Link
CN (1) CN104899881B (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106940784A (en) * 2016-12-26 2017-07-11 无锡高新兴智能交通技术有限公司 A kind of bus detection and recognition methods and system based on video
CN107220949A (en) * 2017-05-27 2017-09-29 安徽大学 The self adaptive elimination method of moving vehicle shade in highway monitoring video
CN108197622A (en) * 2017-12-26 2018-06-22 新智数字科技有限公司 A kind of detection method of license plate, device and equipment
CN108446705A (en) * 2017-02-16 2018-08-24 华为技术有限公司 The method and apparatus of image procossing
CN108986058A (en) * 2018-06-22 2018-12-11 华东师范大学 The image interfusion method of lightness Consistency Learning
RU2676026C1 (en) * 2018-03-23 2018-12-25 Акционерное Общество "Крафтвэй Корпорэйшн Плс" Video stream analysis method
CN112215168A (en) * 2020-10-14 2021-01-12 上海爱购智能科技有限公司 Image editing method for commodity identification training
CN113052845A (en) * 2021-06-02 2021-06-29 常州星宇车灯股份有限公司 Method and device for detecting vehicle carpet lamp
CN113763410A (en) * 2021-09-30 2021-12-07 江苏天汇空间信息研究院有限公司 Image shadow detection method based on HIS combined with spectral feature detection condition

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101982825A (en) * 2010-11-04 2011-03-02 杭州海康威视***技术有限公司 Method and device for processing video image under intelligent transportation monitoring scene
US7970168B1 (en) * 2004-02-19 2011-06-28 The Research Foundation Of State University Of New York Hierarchical static shadow detection method
CN102509101A (en) * 2011-11-30 2012-06-20 昆山市工业技术研究院有限责任公司 Background updating method and vehicle target extracting method in traffic video monitoring
CN103106796A (en) * 2013-01-15 2013-05-15 江苏大学 Vehicle detection method and device of intelligent traffic surveillance and control system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7970168B1 (en) * 2004-02-19 2011-06-28 The Research Foundation Of State University Of New York Hierarchical static shadow detection method
CN101982825A (en) * 2010-11-04 2011-03-02 杭州海康威视***技术有限公司 Method and device for processing video image under intelligent transportation monitoring scene
CN102509101A (en) * 2011-11-30 2012-06-20 昆山市工业技术研究院有限责任公司 Background updating method and vehicle target extracting method in traffic video monitoring
CN103106796A (en) * 2013-01-15 2013-05-15 江苏大学 Vehicle detection method and device of intelligent traffic surveillance and control system

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
KAUSHIK DEB 等: "Shadow Detection and Removal Based on YCbCr Color Space", 《SMART COMPUTING REVIEW》 *
XIA ZHU 等: "Shadow removal based on YCbCr color space", 《NEUROCOMPUTING》 *
余孟泽 等: "融合纹理特征和阴影属性的阴影检测方法", 《计算机工程与设计》 *

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106940784A (en) * 2016-12-26 2017-07-11 无锡高新兴智能交通技术有限公司 A kind of bus detection and recognition methods and system based on video
CN108446705A (en) * 2017-02-16 2018-08-24 华为技术有限公司 The method and apparatus of image procossing
CN108446705B (en) * 2017-02-16 2021-03-23 华为技术有限公司 Method and apparatus for image processing
CN107220949A (en) * 2017-05-27 2017-09-29 安徽大学 The self adaptive elimination method of moving vehicle shade in highway monitoring video
CN108197622A (en) * 2017-12-26 2018-06-22 新智数字科技有限公司 A kind of detection method of license plate, device and equipment
RU2676026C1 (en) * 2018-03-23 2018-12-25 Акционерное Общество "Крафтвэй Корпорэйшн Плс" Video stream analysis method
CN108986058A (en) * 2018-06-22 2018-12-11 华东师范大学 The image interfusion method of lightness Consistency Learning
CN108986058B (en) * 2018-06-22 2021-11-19 华东师范大学 Image fusion method for brightness consistency learning
CN112215168A (en) * 2020-10-14 2021-01-12 上海爱购智能科技有限公司 Image editing method for commodity identification training
CN113052845A (en) * 2021-06-02 2021-06-29 常州星宇车灯股份有限公司 Method and device for detecting vehicle carpet lamp
CN113763410A (en) * 2021-09-30 2021-12-07 江苏天汇空间信息研究院有限公司 Image shadow detection method based on HIS combined with spectral feature detection condition
CN113763410B (en) * 2021-09-30 2022-08-02 江苏天汇空间信息研究院有限公司 Image shadow detection method based on HIS combined with spectral feature detection condition

Also Published As

Publication number Publication date
CN104899881B (en) 2017-11-28

Similar Documents

Publication Publication Date Title
CN104899881A (en) Shadow detection method for moving vehicle in video image
Wang et al. Image segmentation of overlapping leaves based on Chan–Vese model and Sobel operator
Amato et al. Accurate moving cast shadow suppression based on local color constancy detection
CN110276267A (en) Method for detecting lane lines based on Spatial-LargeFOV deep learning network
CN102385753B (en) Illumination-classification-based adaptive image segmentation method
CN104952256B (en) A kind of detection method of the intersection vehicle based on video information
CN105493141B (en) Unstructured road border detection
CN112036254B (en) Moving vehicle foreground detection method based on video image
EP1683105A2 (en) Object detection in images
CN102096821A (en) Number plate identification method under strong interference environment on basis of complex network theory
CN104063885A (en) Improved movement target detecting and tracking method
CN104599511B (en) Traffic flow detection method based on background modeling
CN104463870A (en) Image salient region detection method
CN105005766A (en) Vehicle body color identification method
CN102096802A (en) Face detection method and device
CN102306307B (en) Positioning method of fixed point noise in color microscopic image sequence
CN109754440A (en) A kind of shadow region detection method based on full convolutional network and average drifting
CN103473547A (en) Vehicle target recognizing algorithm used for intelligent traffic detecting system
CN104021566A (en) GrabCut algorithm-based automatic segmentation method of tongue diagnosis image
CN104463138A (en) Text positioning method and system based on visual structure attribute
Ma et al. Vision-based lane detection and lane-marking model inference: a three-step deep learning approach
Fung et al. Effective moving cast shadow detection for monocular color image sequences
CN103065145A (en) Vehicle movement shadow eliminating method
CN102006462A (en) Rapid monitoring video enhancement method by using motion information and implementation device thereof
Russell et al. Vehicle detection based on color analysis

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20171128

Termination date: 20210528