CN104112255A - Rain removing method and system for single image - Google Patents

Abstract

The invention relates to a rain removing method and system for a single image. The method comprises the following steps: converting an RGB color image into a YIQ color space; extracting a Y component expressing the image brightness in the YIQ color space; carrying out rain removing processing on the Y component; combining the Y component processed by rain removing with an I component and a Q component and converting the YIQ unit after combination into a CMYK color space so as to obtain a CMYK image after the rain removing process. With the method and system, the RGB image is converted into the YIQ color space; only the Y component is processed by rain removing and the Y component processed by rain removing is combined with I component and the Q component; and conversion is carried out to obtain an RGB image. Therefore, rain removing processing of the single color image is realized; the image color distortion is prevented; and the usage range of the rain removing algorithm of the single image is expanded. Moreover, the mode of the output image is converted into a CMYK mode and direct printing can be realized, thereby avoiding the phenomenon of distortion of the RGB image printed directly, saving the cost, and reducing the operation step.

Description

Single image removes rain method and system

Technical field

The present invention relates to image processing field, particularly relate to a kind of single image and remove rain method and system.

Background technology

Rain has a great impact image imaging, can cause the fuzzy and information of image imaging to cover, and its direct result is that the sharpness of video image declines, and the digitized processing of video image is affected and hydraulic performance decline by this also can.The video image that polluted by raindrop is carried out to the further processing that repair process is conducive to image, comprise target detection, identification based on image, follow the trail of, cut apart and the raising of the technical feature such as monitoring.

Traditional rain algorithm that goes has a lot, as the video image based on methods such as degree of bias calculating, K mean cluster, Kalman filtering, dictionary learning and sparse coding, guiding filtering, interframe luminance differences removes rain algorithm.Wherein, single image goes rain algorithm kind a lot, carry out single image as the method by picture breakdown and remove rain, remove rain etc. by context aware, but, what traditional single image went to obtain after rain algorithm process is all gray level image, cannot process to ensure that image color is undistorted to coloured image, and output image cannot be printed.

Summary of the invention

Based on this, be necessary to remove for traditional single width the gray level image that is that rain method obtains, the problem that cannot process coloured image, provide a kind of single image to remove rain method and system, can realize coloured image is gone to rain processing, guarantee image color is undistorted, and output image can be printed.

A kind of single image goes rain method, comprises the following steps:

RGB image is converted to YIQ color space;

Extract the Y component of the presentation video brightness in described YIQ color space;

Described Y component is gone to rain processing;

To go Y component after rain in conjunction with I and Q component, and in connection with after YIQ be converted to cmyk color space, obtain the CMYK image after rain.

Therein in an embodiment, describedly RGB image is converted to YIQ color space adopts matrix conversion.

Therein in an embodiment, describedly RGB image be converted to YIQ color space adopt the formula of matrix conversion to be:

$\left[\begin{array}{c}Y\\ I\\ Q\end{array}\right]\left[\begin{array}{ccc}0.299& 0.587& 0.114\\ 0.596& -0.274& -0.322\\ 0.211& -0.523& 0.312\end{array}\right]\left[\begin{array}{c}R\\ G\\ B\end{array}\right].$

Therein in an embodiment, describedly will go Y component after rain in conjunction with I and Q component, and in connection with after YIQ be converted to cmyk color space, the step that obtains the CMYK image after rain comprises:

To go Y component after rain in conjunction with I and Q component, and in connection with after YIQ be converted to rgb color space;

Rgb color space is converted to cmyk color space, obtains the CMYK image after rain.

Therein in an embodiment, described in connection with after the YIQ formula that is converted to rgb color space be:

$\left[\begin{array}{c}R\\ G\\ B\end{array}\right]\left[\begin{array}{ccc}1& 0.956& 0.621\\ 1& -0.272& -0.647\\ 1& -1.106& 1.703\end{array}\right]\left[\begin{array}{c}Y\\ I\\ Q\end{array}\right],$

Described rgb color space is converted to cmyk color space, the computing formula that obtains the CMYK image after rain comprises:

C'＝1-R/255

M'＝1-G/255，

Y'＝1-B/255

If min{C', M', Y'}=1, C'=0, M'=0, K=1, otherwise:

K＝min{C',M',Y'},

$\frac{C^{\′}-K}{1-K}$

$M=\frac{M^{\′}-K}{1-K}.$

$Y=\frac{Y^{\′}-K}{1-K}$

A kind of single image goes rain system, comprising:

The first modular converter, for being converted to YIQ color space by RGB image;

Extraction module, for extracting the Y component of presentation video brightness of described YIQ color space;

Go rain module, for described Y component is gone to rain processing;

The second modular converter, for going Y component after rain in conjunction with I and Q component, and in connection with after YIQ be converted to cmyk color space, obtain the CMYK image after rain.

Therein in an embodiment, describedly RGB image is converted to YIQ color space adopts matrix conversion.

Therein in an embodiment, describedly RGB image be converted to YIQ color space adopt the formula of matrix conversion to be:

$\left[\begin{array}{c}Y\\ I\\ Q\end{array}\right]\left[\begin{array}{ccc}0.299& 0.587& 0.114\\ 0.596& -0.274& -0.322\\ 0.211& -0.523& 0.312\end{array}\right]\left[\begin{array}{c}R\\ G\\ B\end{array}\right].$

Therein in an embodiment, described the second modular converter is also for going Y component after rain in conjunction with I and Q component, and in connection with after YIQ be converted to rgb color space; Rgb color space is converted to cmyk color space, obtains the CMYK image after rain.

Therein in an embodiment, described in connection with after the YIQ formula that is converted to rgb color space be:

$\left[\begin{array}{c}R\\ G\\ B\end{array}\right]\left[\begin{array}{ccc}1& 0.956& 0.621\\ 1& -0.272& -0.647\\ 1& -1.106& 1.703\end{array}\right]\left[\begin{array}{c}Y\\ I\\ Q\end{array}\right],$

Described rgb color space is converted to cmyk color space, the computing formula that obtains the CMYK image after rain comprises:

C'＝1-R/255

M'＝1-G/255，

Y'＝1-B/255

If min{C', M', Y'}=1, C'=0, M'=0, K=1, otherwise:

K＝min{C',M',Y'},

$\frac{C^{\′}-K}{1-K}$

$M=\frac{M^{\′}-K}{1-K}.$

$Y=\frac{Y^{\′}-K}{1-K}$

Above-mentioned single image removes rain method and system, by RGB image is converted to YIQ color space, then only Y component is gone to rain processing, to go rain Y component after treatment and I, Q component combination, be converted to RGB image, that has realized single width coloured image goes rain processing, guarantee image color is undistorted, improve the usable range that single image removes rain algorithm, and output image is converted to CMYK pattern, can directly prints, avoided direct printing RGB image to occur the phenomenon of distortion, cost-saving, reduce operation steps.

Brief description of the drawings

Fig. 1 is that in an embodiment, single image removes the process flow diagram of rain method;

Fig. 2 is the schematic diagram of raindrop impact;

Fig. 3 is that in an embodiment, single image removes the structured flowchart of rain system.

Embodiment

In order to make object of the present invention, technical scheme and advantage clearer, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that specific embodiment described herein, only in order to explain the present invention, is not intended to limit the present invention.

Fig. 1 is that in an embodiment, single image removes the process flow diagram of rain method.As shown in Figure 1, this RGB (Red-Green-Blue, R-G-B) color image processing method, comprises the following steps:

Step 102, is converted to YIQ color space by RGB image.

Concrete, YIQ is NTSC (National Television Standards Committee) standard television system.Y is to provide luminance signal, and I represents In-phase, and color is from orange to cyan, and Q represents Quadrature-phase, and color is from purple to yellow green.

Because the brightness of capped pixel is affected by raindrop not only, also can be subject to background influence.Consider that the camera exposure time is T, suppose that the time that raindrop during this period of time cover a certain pixel is τ, and τ is much smaller than camera exposure time T.The rain line brightness I of this pixel in time shutter T on image _brjointly determined by raindrop and background luminance, computing formula is suc as formula (1) and (2):

$I_{\mathrm{br}}={\∫}_o^{\mathrm{\τ}}{E}_r\mathrm{dt}+{\∫}_{\mathrm{\τ}}^T{E}_b\mathrm{dt}---\left(1\right)$

I _br＝I _b+ΔI (2)

Wherein, E _rthe instantaneous raindrop brightness while having raindrop to cover, E _bit is the instantaneous background luminance while covering without raindrop.I _bbe the background luminance that does not have raindrop to cover in the T time, Δ I is the brightness variable quantity that affected by raindrop.The brightness of rain line higher than background luminance be mainly because raindrop in imaging because the light within the scope of Wide-angle has more been converged in the effects such as mirror-reflection, internal reflection, refraction, as shown in Figure 2, mirror-reflection internal reflection refraction the brightness of rain line because of ruddiness, green glow close with blue light frequency, the critical angle approximately equal of raindrop to three, and the variation of light intensity directly determines that the brightness of pixel changes, the mirror-reflection of adding three is the same, therefore raindrop cause brightness variation delta R, Δ G, the also approximately equal of Δ B of pixel, belong to the chromatic characteristic of raindrop.

In the present embodiment, this is converted to YIQ color space by RGB image and adopts matrix conversion.

Concrete, this is converted to YIQ color space by RGB image and adopts the formula of matrix conversion to be:

$\left[\begin{array}{c}Y\\ I\\ Q\end{array}\right]\left[\begin{array}{ccc}0.299& 0.587& 0.114\\ 0.596& -0.274& -0.322\\ 0.211& -0.523& 0.312\end{array}\right]\left[\begin{array}{c}R\\ G\\ B\end{array}\right]---\left(3\right)$

Known according to formula (2), its rgb value of the pixel not affected by raindrop remains unchanged, and the pixel intensity being affected by raindrop can change, and RGB converts to after YIQ, the brightness of Y represent pixel, i.e. and the gray-scale value of gray level image, I and Q are:

I＝0.596(R _b+ΔR)-0.274(G _b+ΔG)-0.322(B _b+ΔB) (4)

Q＝0.211(R _b+ΔR)-0.523(G _b+ΔG)+0.312(B _b+ΔB) (5)

In formula (4) and (5), R _b, G _b, B _brespectively the background luminance value that red, green, blue triple channel is not affected by raindrop, from the chromatic characteristic of raindrop, Δ R, Δ G, Δ B approximately equal:

I＝0.596R _b-0.274G _b-0.322B _b (6)

Q＝0.211R _b-0.523G _b+0.312B _b (7)

Therefore the value of I and Q passage is not subject to the impact that raindrop brightness changes, and only has Y passage influenced.

Step 104, extracts the Y component of the presentation video brightness in this YIQ color space.

Step 106, goes rain processing to this Y component.

Concrete, adopt single image to go rain algorithm to go rain processing to this Y component.Single image goes rain algorithm can comprise (the Fu Y H such as Yu-Hsiang Fu, Kang L W, Lin C W, et al.Single-frame-based rain removal via image decomposition.In:Proceeding of 2011IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) .Prague, Czech:IEEE Press, 2011:1453-1456.) and (the Kang L W such as Li-Wei Kang, Lin C W, Fu Y H.Automatic single-image-based rain streaks removal via image decomposition.Image Processing, IEEE Transactions on, 2012, 21 (4): 1742-1755.) proposed to carry out single image by the method for picture breakdown and removed rain, (the Huang D A such as De-An Huang, Kang L W, Yang M C, et al.Context-aware single image rain removal.In:Proceeding of 2012IEEE International Conference on Multimedia and Expo (ICME) .Melbourne, Australia:IEEEPress, 2012:164-169.) propose to remove rain by context aware, (the George J such as Jaina George, Bhavani S, Jaya J.Certain explorations on removal of rain streaks using morphological component analysis.International Journal of Engineering Research & Technology.2013,2 (2) .) propose to use the method for morphology constituent analysis to remove rain, (the Chen D Y such as Duan-Yu Chen, Chen C C, Kang L W.Visual depth guided image rain streaks removal via sparse coding.In:Proceeding of2012International Symposium on Intelligent Signal Processing and Communications Systems.New Taipei, Taiwan:IEEE, 2012:151-156.) remove rain by guiding filtering and sparse coding.

Step 108, will go Y component after rain in conjunction with I and Q component, and in connection with after YIQ be converted to cmyk color space, obtain the CMYK image after rain.

Concrete, CMYK, also referred to as printing color pattern, is a kind of reflective color mode that relies on.Wherein, CMY is the initial of 3 kinds of printing-ink titles: cyan Cyan, magenta Magenta, yellow Yellow.K is derived from a kind of galley Key Plate that uses tusche.In theory, only need tri-kinds of ink of CMY enough, three are added together and just obtain black, but due to the restriction of technique, and result that CMY is added is actual is a kind of kermesinus.

In one embodiment, to go Y component after rain in conjunction with I and Q component, and in connection with after YIQ be converted to cmyk color space, the step that obtains the CMYK image after rain comprises: will go Y component after rain in conjunction with I and Q component, and in connection with after YIQ be converted to rgb color space; Rgb color space is converted to cmyk color space, obtains the CMYK image after rain.

In one embodiment, should in connection with after YIQ be converted to rgb color space and adopt and ask for matrix $\left[\begin{array}{ccc}0.299& 0.587& 0.114\\ 0.596& -0.274& -0.322\\ 0.211& -0.523& 0.312\end{array}\right]$ Inverse matrix change, obtain the RGB image after rain, its precision is high.

In one embodiment, should in connection with after the YIQ formula that is converted to rgb color space be:

$\left[\begin{array}{c}R\\ G\\ B\end{array}\right]\left[\begin{array}{ccc}1& 0.956& 0.621\\ 1& -0.272& -0.647\\ 1& -1.106& 1.703\end{array}\right]\left[\begin{array}{c}Y\\ I\\ Q\end{array}\right]---\left(8\right)$

Rgb color space is converted to cmyk color space, and the computing formula that obtains the CMYK image after rain comprises:

C'＝1-R/255

M'＝1-G/255 (9)

Y'＝1-B/255

If min{C', M', Y'}=1, C'=0, M'=0, K=1, otherwise:

K＝min{C',M',Y'},

$\frac{C^{\′}-K}{1-K}$

$M=\frac{M^{\′}-K}{1-K}---.\left(10\right)$

$Y=\frac{Y^{\′}-K}{1-K}$

Above-mentioned single image goes rain method, by RGB image is converted to YIQ color space, then only Y component is gone to rain processing, to go rain Y component after treatment and I, Q component combination, be converted to RGB image, that has realized single width coloured image goes rain processing, guarantee image color is undistorted, improve the usable range that single image removes rain algorithm, and output image is converted to CMYK pattern, can directly prints, avoided direct printing RGB image to occur the phenomenon of distortion, cost-saving, reduce operation steps.

Fig. 3 is that in an embodiment, single image removes the structured flowchart of rain system.As shown in Figure 3, this single image goes rain system, comprises the first modular converter 320, extraction module 340, removes rain module 360 and the second modular converter 380.Wherein:

The first modular converter 320 is for being converted to YIQ color space by RGB image.

In one embodiment, this is converted to YIQ color space by RGB image and adopts matrix conversion.

This is converted to YIQ color space by RGB image and adopts the formula of matrix conversion to be:

$\left[\begin{array}{c}Y\\ I\\ Q\end{array}\right]\left[\begin{array}{ccc}0.299& 0.587& 0.114\\ 0.596& -0.274& -0.322\\ 0.211& -0.523& 0.312\end{array}\right]\left[\begin{array}{c}R\\ G\\ B\end{array}\right]---\left(3\right)$

Extraction module 340 is for extracting the Y component of presentation video brightness of this YIQ color space.

Go rain module 360 for this Y component is gone to rain processing.

The second modular converter 380 is for going Y component after rain in conjunction with I and Q component, and in connection with after YIQ be converted to cmyk color space, obtain the CMYK image after rain.

The second modular converter 380 is also for going Y component after rain in conjunction with I and Q component, and in connection with after YIQ be converted to rgb color space; Rgb color space is converted to cmyk color space, obtains the CMYK image after rain.

In one embodiment, should in connection with after YIQ be converted to rgb color space and adopt and ask for matrix $\left[\begin{array}{ccc}0.299& 0.587& 0.114\\ 0.596& -0.274& -0.322\\ 0.211& -0.523& 0.312\end{array}\right]$ Inverse matrix change.

In one embodiment, should in connection with after the YIQ formula that is converted to rgb color space be:

$\left[\begin{array}{c}R\\ G\\ B\end{array}\right]\left[\begin{array}{ccc}1& 0.956& 0.621\\ 1& -0.272& -0.647\\ 1& -1.106& 1.703\end{array}\right]\left[\begin{array}{c}Y\\ I\\ Q\end{array}\right]---\left(8\right).$

Rgb color space is converted to cmyk color space, and the computing formula that obtains the CMYK image after rain comprises:

C'＝1-R/255

M'＝1-G/255(9)

Y'＝1-B/255

If min{C', M', Y'}=1, C'=0, M'=0, K=1, otherwise:

K＝min{C',M',Y'},

$\frac{C^{\′}-K}{1-K}$

$M=\frac{M^{\′}-K}{1-K}---.\left(10\right)$

$Y=\frac{Y^{\′}-K}{1-K}$

Above-mentioned single image goes rain system, by RGB image is converted to YIQ color space, then only Y component is gone to rain processing, to go rain Y component after treatment and I, Q component combination, be converted to RGB image, that has realized single width coloured image goes rain processing, guarantee image color is undistorted, improve the usable range that single image removes rain algorithm, and output image is converted to CMYK pattern, can directly prints, avoided direct printing RGB image to occur the phenomenon of distortion, cost-saving, reduce operation steps.

The above embodiment has only expressed several embodiment of the present invention, and it describes comparatively concrete and detailed, but can not therefore be interpreted as the restriction to the scope of the claims of the present invention.It should be pointed out that for the person of ordinary skill of the art, without departing from the inventive concept of the premise, can also make some distortion and improvement, these all belong to protection scope of the present invention.Therefore, the protection domain of patent of the present invention should be as the criterion with claims.

Claims (10)

1. single image goes a rain method, comprises the following steps:

RGB image is converted to YIQ color space;

Extract the Y component of the presentation video brightness in described YIQ color space;

Described Y component is gone to rain processing;

To go Y component after rain in conjunction with I and Q component, and in connection with after YIQ be converted to cmyk color space, obtain the CMYK image after rain.

2. single image according to claim 1 goes rain method, it is characterized in that, described by RGB image be converted to YIQ color space adopt matrix conversion.

3. single image according to claim 2 goes rain method, it is characterized in that, describedly RGB image is converted to YIQ color space adopts the formula of matrix conversion to be:

$\left[\begin{array}{c}Y\\ I\\ Q\end{array}\right]\left[\begin{array}{ccc}0.299& 0.587& 0.114\\ 0.596& -0.274& -0.322\\ 0.211& -0.523& 0.312\end{array}\right]\left[\begin{array}{c}R\\ G\\ B\end{array}\right].$

4. single image according to claim 1 goes rain method, it is characterized in that, describedly will go Y component after rain in conjunction with I and Q component, and in connection with after YIQ be converted to cmyk color space, the step that obtains the CMYK image after rain comprises:

To go Y component after rain in conjunction with I and Q component, and in connection with after YIQ be converted to rgb color space;

Rgb color space is converted to cmyk color space, obtains the CMYK image after rain.

5. single image according to claim 1 goes rain method, it is characterized in that, described in connection with after the YIQ formula that is converted to rgb color space be:

$\left[\begin{array}{c}R\\ G\\ B\end{array}\right]\left[\begin{array}{ccc}1& 0.956& 0.621\\ 1& -0.272& -0.647\\ 1& -1.106& 1.703\end{array}\right]\left[\begin{array}{c}Y\\ I\\ Q\end{array}\right];$

Described rgb color space is converted to cmyk color space, the computing formula that obtains the CMYK image after rain comprises:

C'＝1-R/255

M'＝1-G/255，

Y'＝1-B/255

If min{C', M', Y'}=1, C'=0, M'=0, K=1, otherwise:

K＝min{C',M',Y'},

$\frac{C^{\′}-K}{1-K}$

$M=\frac{M^{\′}-K}{1-K}.$

$Y=\frac{Y^{\′}-K}{1-K}$

6. single image goes a rain system, it is characterized in that, comprising:

The first modular converter, for being converted to YIQ color space by RGB image;

Extraction module, for extracting the Y component of presentation video brightness of described YIQ color space;

Go rain module, for described Y component is gone to rain processing;

The second modular converter, for going Y component after rain in conjunction with I and Q component, and in connection with after YIQ be converted to cmyk color space, obtain the CMYK image after rain.

7. single image according to claim 6 goes rain system, it is characterized in that, described by RGB image be converted to YIQ color space adopt matrix conversion.

8. single image according to claim 7 goes rain system, it is characterized in that, describedly RGB image is converted to YIQ color space adopts the formula of matrix conversion to be:

$\left[\begin{array}{c}Y\\ I\\ Q\end{array}\right]\left[\begin{array}{ccc}0.299& 0.587& 0.114\\ 0.596& -0.274& -0.322\\ 0.211& -0.523& 0.312\end{array}\right]\left[\begin{array}{c}R\\ G\\ B\end{array}\right].$

9. single image according to claim 6 goes rain system, it is characterized in that, described the second modular converter is also for going Y component after rain in conjunction with I and Q component, and in connection with after YIQ be converted to rgb color space; Rgb color space is converted to cmyk color space, obtains the CMYK image after rain.

10. single image according to claim 9 goes rain system, it is characterized in that, described in connection with after the YIQ formula that is converted to rgb color space be:

$\left[\begin{array}{c}R\\ G\\ B\end{array}\right]\left[\begin{array}{ccc}1& 0.956& 0.621\\ 1& -0.272& -0.647\\ 1& -1.106& 1.703\end{array}\right]\left[\begin{array}{c}Y\\ I\\ Q\end{array}\right],$

Described rgb color space is converted to cmyk color space, the computing formula that obtains the CMYK image after rain comprises:

C'＝1-R/255

M'＝1-G/255，

Y'＝1-B/255

If min{C', M', Y'}=1, C'=0, M'=0, K=1, otherwise:

K＝min{C',M',Y'},

$\frac{C^{\′}-K}{1-K}$

$M=\frac{M^{\′}-K}{1-K}.$

$Y=\frac{Y^{\′}-K}{1-K}$