CN110473155B - Image defogging method based on retina color perception dark channel principle - Google Patents

Image defogging method based on retina color perception dark channel principle Download PDF

Info

Publication number
CN110473155B
CN110473155B CN201910712543.9A CN201910712543A CN110473155B CN 110473155 B CN110473155 B CN 110473155B CN 201910712543 A CN201910712543 A CN 201910712543A CN 110473155 B CN110473155 B CN 110473155B
Authority
CN
China
Prior art keywords
image
color
cen
sur
foggy
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910712543.9A
Other languages
Chinese (zh)
Other versions
CN110473155A (en
Inventor
赵雪青
师昕
樊珂
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xian Polytechnic University
Original Assignee
Xian Polytechnic University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xian Polytechnic University filed Critical Xian Polytechnic University
Priority to CN201910712543.9A priority Critical patent/CN110473155B/en
Publication of CN110473155A publication Critical patent/CN110473155A/en
Application granted granted Critical
Publication of CN110473155B publication Critical patent/CN110473155B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/73Deblurring; Sharpening
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/90Determination of colour characteristics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30168Image quality inspection
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02ATECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
    • Y02A90/00Technologies having an indirect contribution to adaptation to climate change
    • Y02A90/10Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Image Processing (AREA)

Abstract

The invention discloses an image defogging method based on a retina color perception dark channel principle, which comprises the following steps: s1: acquiring an original fog-containing image; s2: calculating the foggy image in the step S1 by utilizing a retina color perception mechanism, and calculating three color channels of the color foggy image; s3: restoring the fog-containing image obtained in the step S2 by adopting a transmissivity estimation function, an atmospheric light estimation function and a restoration function to obtain a final output image; the invention solves the problems of low self-adaptation capability and further improvement of the visual quality of the image in the existing image defogging technology, and the method has simple process and is suitable for restoration of any foggy image.

Description

Image defogging method based on retina color perception dark channel principle
Technical Field
The invention belongs to the technical field of computer image processing, and particularly relates to an image defogging method based on a retina color perception dark channel principle.
Background
With the rapid development of computer vision technology and hardware sensor technology, various image or video acquisition technologies have been widely applied to important fields such as virtual battlefield, intelligent medical treatment, aerospace, traffic monitoring and public security. The colorful visual information is reproduced on the electronic equipment, the visual feeling is better in the aspect of reality, and the accurate visual information is better in the aspect of application.
In recent years, the demand of human beings for sensing the outside is increasingly increased, various image acquisition technologies are continuously developed, and more convenient conditions are provided for acquiring visual information, however, in the haze weather, as the visibility of objects in the environment is reduced, the color information and contrast characteristics of the objects are scattered and absorbed by suspended particles in the air, so that the quality of images acquired in foggy days is reduced, the processing difficulty of the images is further increased, and the method is particularly suitable for target scenes which are difficult to reproduce in aerospace, traffic monitoring, public safety and the like. Therefore, image defogging has become an important research direction for computer vision.
The image defogging method aims at reducing the influence of haze on the image, improving the quality of the image and obtaining the image with higher signal-to-noise ratio and larger information entropy. So far, the image defogging method is mainly based on two directions of image enhancement and physical model. Aiming at the degraded image, an image enhancement means is adopted to improve the visual effect of the image and the demand of a computer visual system, the method does not consider the cause of the degraded image, can not be generally used in any scene, and has low self-adaptive capacity; the method aims at the degradation image cause, an image degradation model is physically constructed, and the method achieves a good visual effect by combining the degradation image cause and essential defogging.
Disclosure of Invention
The invention aims to provide an image defogging method based on a retina color perception dark channel principle, which comprises the following steps of: s1: acquiring an original fog-containing image; s2: calculating the foggy image in the step S1 by utilizing a retina color perception mechanism, and calculating three color channels of the color foggy image; s3: and (2) restoring the foggy image obtained in the step (S2) by adopting a transmissivity estimation function, an atmospheric light estimation function and a restoration function to obtain a final output image, thereby solving the problems of low self-adaption capability and further improvement of the visual quality of the image in the existing image defogging technology.
In order to achieve the above purpose, the present invention adopts the following technical scheme:
an image defogging method based on a retina color perception dark channel principle comprises the following steps:
s1: acquiring an original fog-containing image;
s2: calculating the foggy image in the step S1 by utilizing a retina color perception mechanism, and calculating three color channels of the color foggy image;
s3: and (2) restoring the fog-containing image obtained in the step (S2) by adopting a transmissivity estimation function, an atmospheric light estimation function and a restoration function to obtain a final output image.
Further, the calculation process in step S2 includes the steps of:
(1) The retinal bipolar cell response was calculated as follows:
(2) Retinal ganglion cell response, calculated as follows:
(3) Based on the perception mechanism of the retina receptive field to the color in the visual system, respectively performing color perception calculation aiming at three color channels of the color image, wherein a calculation model is as follows:
wherein alpha is cen Is the sensitivity around the receptive field of bipolar cells;
α sur sensitivity at the center of the bipolar receptive field;
(x, y) is the position coordinates of the image;
I c (x, y) is the raw foggy image pixel value obtained in step S1;
σ cen 、σ sur is the standard deviation of the gaussian function;
BF c cen is the cellular response of retinal bipolar cells in the central receptive field;
BF c sur is the cellular response of retinal bipolar cells in the surrounding receptive field;
RGC c cen is the cellular response of retinal ganglion cells in the central receptive field;
RGC c sur is the cellular response of retinal ganglion cells to the surrounding receptive field;
β cen is the sensitivity around ganglion cell receptive fields;
β sur is the sensitivity of the ganglion cell receptive field center.
Further, the image restoration process in step S3 includes the steps of:
(1) Transmittance estimation
According to the foggy day imaging mode, the transmittance estimation calculation formula is as follows:
for each color channel, the following formula is calculated:
according to the dark channel prior principle, the following formula is calculated:
then the first time period of the first time period,
in combination with the retinal color perception calculation model in step S2, there are the following calculation formulas:
(2) Atmospheric light estimation
The estimate of atmospheric light Ac is calculated as follows:
(3) Foggy image restoration
The foggy image recovery is calculated as follows:
wherein I is c (x) Is an input color image;
J c (x) Is an defogged image;
A c is atmospheric light;
t (x) is a transmission image;
t (x) =exp { - αd (x) }, α is the atmospheric diffusion coefficient, D (x) is the depth of field;
ζ is an image enhancement coefficient;
I c is the light intensity of the input color image;
R c (x) Is a response of retinal perception;
σ c is a constant;
t 0 is a factor that constrains the transmission t (x) to be non-zero, taking a value of 0.1.
Specifically, in step S2, α cen Alpha and alpha sur Take a value of 1, sigma cen Sigma (sigma) sur Take the value of 1, beta cen Beta and beta sur The value is 1.
Specifically, in step S3, α has a value of 1, d (x) has a value of 0.95, ζ has a value of 1, σ c Take the value of 1, t 0 The value is 0.1.
The invention has the beneficial effects that the retina color perception calculation and dark channel principle is adopted to carry out image defogging treatment on the image acquired in foggy weather environment, and the image defogging treatment is output, so that the problems of low self-adaption capability and further improvement of image vision quality in the existing image defogging technology are solved.
Drawings
In order to more clearly illustrate the technical solutions of the present invention, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of an image defogging method of the present invention;
FIG. 2 is an image of the defogging process in example 1 of the present invention;
FIG. 3 is a view of the original unagglomerated color image obtained in example 2 of the present invention;
FIG. 4 is a color misted image after artificial misting in example 2 of the invention;
FIG. 5 is a color image of example 2 of the present invention after defogging by the method of the present invention.
Detailed Description
In the description of the present invention, it should be understood that the terms "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "inner", "outer", etc. indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, are merely for convenience in describing the present invention and simplifying the description, and do not indicate or imply that the devices or elements referred to must have a specific orientation, be configured and operated in a specific orientation, and thus should not be construed as limiting the present invention.
The present invention will be described in detail with reference to the accompanying drawings and examples.
The method of the present invention is implemented using MatlabR2018 programming in the following examples. The experimental platform is mainly configured as follows: the operating system is Windows10, the CPU is Intel Corei75600U, and the RAM is 8G.
Example 1
An image defogging method based on the principle of retina color perception dark channel takes a pair of true color foggy images as an example, and comprises the following steps:
s1: acquiring an original foggy image, wherein the original foggy image mainly comes from a real test image data set which is common at home and abroad, as shown in fig. 2;
s2: calculating the foggy image in the step S1 by utilizing a retina color perception mechanism, and calculating three color channels of the color foggy image, wherein the calculating process comprises the following steps:
(1) The retinal bipolar cell response was calculated as follows:
(2) Retinal ganglion cell response, calculated as follows:
(3) Based on the perception mechanism of the retina receptive field to the color in the visual system, respectively performing color perception calculation aiming at three color channels of the color image, wherein a calculation model is as follows:
wherein alpha is cen The sensitivity around the bipolar cell receptive field is 1;
α sur the sensitivity of the center of the bipolar cell receptive field is 1;
(x, y) is the position coordinates of the image;
I c (x, y) is the raw foggy image pixel value obtained in step S1;
σ cen 、σ sur is the standard deviation of Gaussian function, sigma cen Sigma (sigma) sur The values are all 1;
BF c cen is the cellular response of retinal bipolar cells in the central receptive field;
BF c sur is the cellular response of retinal bipolar cells in the surrounding receptive field;
RGC c cen is the cellular response of retinal ganglion cells in the central receptive field;
RGC c sur is the cellular response of retinal ganglion cells to the surrounding receptive field;
β cen the sensitivity around ganglion cell receptive field is 1;
β sur the sensitivity of the center of the ganglion cell receptive field is 1;
s3: and (2) restoring the foggy image obtained in the step (S2) by adopting a transmissivity estimation function, an atmospheric light estimation function and a restoration function to obtain a final output image, wherein the image restoration process comprises the following steps of:
(1) Transmittance estimation
According to the foggy day imaging mode, the transmittance estimation calculation formula is as follows:
for each color channel, the following formula is calculated:
according to the dark channel prior principle, the following formula is calculated:
then the first time period of the first time period,
in combination with the retinal color perception calculation model in step S2, there are the following calculation formulas:
(2) Atmospheric light estimation
The estimate of atmospheric light Ac is calculated as follows:
(3) Foggy image restoration
The foggy image recovery is calculated as follows:
wherein I is c (x) Is an input color image;
J c (x) Is an defogged image;
A c is atmospheric light;
t (x) is a transmission image;
t (x) =exp { - αd (x) }, α is the atmospheric diffusion coefficient, D (x) is the depth of field;
ζ is an image enhancement coefficient;
I c is the light intensity of the input color image;
R c (x) Is a response of retinal perception;
σ c is a constant;
t 0 is a factor that constrains the transmission t (x) to be non-zero, taking a value of 0.1.
Example 2
An image defogging method based on a retina color perception dark channel principle takes a color foggy image after artificial atomization as an example, wherein the color foggy image which is not infected by fog is obtained as shown in fig. 3, the color foggy image after artificial atomization is obtained as shown in fig. 4, the color foggy image after artificial atomization is recovered as shown in fig. 5, and the color foggy image after artificial atomization is derived from a common artificially synthesized test image data set at home and abroad.
In embodiment 2, the same steps and parameters as those in embodiment 1, that is, the same parameters as those in embodiment 1 are adopted in the retinal color perception calculation step 2, the same parameters as those in embodiment 1 are adopted in the image restoration based on the dark channel principle step 3, the same parameters as those in embodiment 1 are adopted in the image quality after defogging is objectively evaluated by objective quality evaluation on a color foggy image after artificial atomization by adopting a peak signal-to-noise ratio (Peak Signal to Noise Ratio, abbreviated as PSNR) as follows:
where MSE is the mean square error of two images, calculated as follows:
where fi, j is the original uncolored image, f' i, j is the atomized image, and M, N are the sizes of the images, respectively. The objective quality PSNR value before defogging is 10.71, and the PSNR value after defogging by the method is 17.26.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (3)

1. An image defogging method based on a retina color perception dark channel principle is characterized by comprising the following steps of:
s1: acquiring an original fog-containing image;
s2: calculating the foggy image in the step S1 by utilizing a retina color perception mechanism, and calculating three color channels of the color foggy image;
s3: restoring the fog-containing image obtained in the step S2 by adopting a transmissivity estimation function, an atmospheric light estimation function and a restoration function to obtain a final output image;
the calculation process of the step S2 includes the following steps:
(1) The retinal bipolar cell response was calculated as follows:
(2) Retinal ganglion cell response, calculated as follows:
(3) Based on the perception mechanism of the retina receptive field to the color in the visual system, respectively performing color perception calculation aiming at three color channels of the color image, wherein a calculation model is as follows:
wherein alpha is cen Is the sensitivity around the receptive field of bipolar cells;
α sur sensitivity at the center of the bipolar receptive field;
(x, y) is the position coordinates of the image;
I c (x, y) is the raw foggy image pixel value obtained in step S1;
σ cen 、σ sur is the standard deviation of the gaussian function;
BF c cen is the cellular response of retinal bipolar cells in the central receptive field; BF (BF) c sur Is the cellular response of retinal bipolar cells in the surrounding receptive field;
RGC c cen is the cellular response of retinal ganglion cells in the central receptive field; RGC (RGC) c sur Is the cellular response of retinal ganglion cells to the surrounding receptive field; beta cen Is the sensitivity around ganglion cell receptive fields;
β sur is the sensitivity of the center of the ganglion cell receptive field;
the image restoration process in the step S3 includes the following steps:
(4) Transmittance estimation
According to the foggy day imaging mode, the transmittance estimation calculation formula is as follows:
for each color channel, the following formula is calculated:
according to the dark channel prior principle, the following formula is calculated:
then the first time period of the first time period,
in combination with the retinal color perception calculation model in step S2, there are the following calculation formulas:
(5) Atmospheric light estimation
Atmospheric light A c Is calculated as follows:
(6) Foggy image restoration
The foggy image recovery is calculated as follows:
wherein I is c (x) Is an input color image;
J c (x) Is an defogged image;
A c is atmospheric light;
t (x) is a transmission image;
t (x) =exp { - αd (x) }, α is the atmospheric diffusion coefficient, D (x) is the depth of field;
ζ is an image enhancement coefficient;
I c is the light intensity of the input color image;
R c (x) Is a response of retinal perception;
σ c is a constant;
t 0 is a factor that constrains the transmission t (x) to be non-zero.
2. The image defogging method based on the principle of a dark channel perceived by a retina color according to claim 1, wherein in said step S2, α cen Alpha and alpha sur Take a value of 1, sigma cen Sigma (sigma) sur Take the value of 1, beta cen Beta and beta sur The value is 1.
3. The image defogging method according to claim 1, wherein in said step S3, alpha is 1, D (x) is 0.95, ζ is 1, σ c Take the value of 1, t 0 The value is 0.1.
CN201910712543.9A 2019-08-02 2019-08-02 Image defogging method based on retina color perception dark channel principle Active CN110473155B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910712543.9A CN110473155B (en) 2019-08-02 2019-08-02 Image defogging method based on retina color perception dark channel principle

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910712543.9A CN110473155B (en) 2019-08-02 2019-08-02 Image defogging method based on retina color perception dark channel principle

Publications (2)

Publication Number Publication Date
CN110473155A CN110473155A (en) 2019-11-19
CN110473155B true CN110473155B (en) 2023-07-18

Family

ID=68509946

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910712543.9A Active CN110473155B (en) 2019-08-02 2019-08-02 Image defogging method based on retina color perception dark channel principle

Country Status (1)

Country Link
CN (1) CN110473155B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2192158C2 (en) * 2000-10-18 2002-11-10 Московский научно-исследовательский институт глазных болезней им. Гельмгольца Method for diagnosis of acquired color perception disturbances
CN103955900A (en) * 2014-05-07 2014-07-30 电子科技大学 Image defogging method based on biological vision mechanism
US9177363B1 (en) * 2014-09-02 2015-11-03 National Taipei University Of Technology Method and image processing apparatus for image visibility restoration
CN105976337A (en) * 2016-05-10 2016-09-28 长安大学 Image defogging method based on filtering guiding via medians
CN107527329A (en) * 2017-09-19 2017-12-29 重庆邮电大学 A kind of image defogging method based on dark channel prior and Markov random field

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102768760B (en) * 2012-07-04 2014-12-17 电子科技大学 Quick image dehazing method on basis of image textures
CN104240192B (en) * 2013-07-04 2017-09-26 西南科技大学 A kind of quick single image to the fog method
US9361670B2 (en) * 2014-09-04 2016-06-07 National Taipei University Of Technology Method and system for image haze removal based on hybrid dark channel prior
CN106530257A (en) * 2016-11-22 2017-03-22 重庆邮电大学 Remote sensing image de-fogging method based on dark channel prior model
CN107133926A (en) * 2017-04-13 2017-09-05 中原智慧城市设计研究院有限公司 A kind of image defogging method based on dark primary priori
US10367976B2 (en) * 2017-09-21 2019-07-30 The United States Of America As Represented By The Secretary Of The Navy Single image haze removal

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2192158C2 (en) * 2000-10-18 2002-11-10 Московский научно-исследовательский институт глазных болезней им. Гельмгольца Method for diagnosis of acquired color perception disturbances
CN103955900A (en) * 2014-05-07 2014-07-30 电子科技大学 Image defogging method based on biological vision mechanism
US9177363B1 (en) * 2014-09-02 2015-11-03 National Taipei University Of Technology Method and image processing apparatus for image visibility restoration
CN105976337A (en) * 2016-05-10 2016-09-28 长安大学 Image defogging method based on filtering guiding via medians
CN107527329A (en) * 2017-09-19 2017-12-29 重庆邮电大学 A kind of image defogging method based on dark channel prior and Markov random field

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
A Fast Single Image Haze Removal Method Based on Human Retina Property;Xin Ning 等;IEICE TRANSACTIONS on Information and Systems(第1期);211-214 *
Contrast in Haze Removal: Configurable Contrast Enhancement Model Based on Dark Channel Prior;Ping-Juei Liu 等;IEEE Transactions on Image Processing(第5期);2212 - 2227 *
基于HSI颜色空间与暗原色先验原理的单幅图像去雾算法;衷佩玮 等;软件导刊(第01期);267-270 *
结合暗通道先验和MRF理论的单幅图像去雾算法;吴翠先 等;电讯技术(第06期);714-720 *
雾霾天气下基于二次滤波的交通图像去雾算法;黄鹤 等;科学技术与工程(第30期);274-277 *

Also Published As

Publication number Publication date
CN110473155A (en) 2019-11-19

Similar Documents

Publication Publication Date Title
Shi et al. Let you see in sand dust weather: A method based on halo-reduced dark channel prior dehazing for sand-dust image enhancement
Huang et al. An advanced single-image visibility restoration algorithm for real-world hazy scenes
CN110009720B (en) Image processing method and device in AR scene, electronic equipment and storage medium
Chen et al. A high-efficiency and high-speed gain intervention refinement filter for haze removal
CN106296612B (en) Hierarchical monitoring video sharpening system and method for image quality evaluation and weather condition guidance
Huang et al. An efficient visibility enhancement algorithm for road scenes captured by intelligent transportation systems
CN101996407B (en) Colour calibration method for multiple cameras
CN102722868B (en) Tone mapping method for high dynamic range image
CN105118027B (en) A kind of defogging method of image
CN107103591A (en) A kind of single image to the fog method based on image haze concentration sealing
CN113361604A (en) Target detection-oriented physical attack counterattack patch generation method and system
CN107453811B (en) A method of the unmanned plane based on photopic vision communication cooperates with SLAM
CN110517306A (en) A kind of method and system of the binocular depth vision estimation based on deep learning
CN105989583B (en) A kind of image defogging method
CN111861896A (en) UUV-oriented underwater image color compensation and recovery method
CN112950502B (en) Image processing method and device, electronic equipment and storage medium
CN108305225A (en) Traffic monitoring image rapid defogging method based on dark channel prior
CN108280807A (en) Monocular depth image collecting device and system and its image processing method
Wang et al. Multiscale supervision-guided context aggregation network for single image dehazing
CN108742495A (en) A kind of three-dimensional stereo laparoscope system and solid matching method for medical field
CN110473155B (en) Image defogging method based on retina color perception dark channel principle
CN110909571B (en) High-precision face recognition space positioning method
CN108814543A (en) High-speed video nystagmus instrument system
CN107464225B (en) Image processing method, image processing device, computer-readable storage medium and mobile terminal
CN104424623B (en) A kind of natural image defogging method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant