CN112581404A - Rail transit video monitoring image enhancement algorithm - Google Patents

Rail transit video monitoring image enhancement algorithm Download PDF

Info

Publication number
CN112581404A
CN112581404A CN202011566292.7A CN202011566292A CN112581404A CN 112581404 A CN112581404 A CN 112581404A CN 202011566292 A CN202011566292 A CN 202011566292A CN 112581404 A CN112581404 A CN 112581404A
Authority
CN
China
Prior art keywords
image
frequency
low
frequency component
enhanced
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011566292.7A
Other languages
Chinese (zh)
Inventor
贾平
蒋春华
赵健
连磊
管才路
赵佳佳
杨王伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hefei Siwill Intelligent Co ltd
Original Assignee
Hefei Siwill Intelligent Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hefei Siwill Intelligent Co ltd filed Critical Hefei Siwill Intelligent Co ltd
Priority to CN202011566292.7A priority Critical patent/CN112581404A/en
Publication of CN112581404A publication Critical patent/CN112581404A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/80Geometric correction
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/50Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/90Dynamic range modification of images or parts thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/13Edge detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20024Filtering details
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20048Transform domain processing
    • G06T2207/20056Discrete and fast Fourier transform, [DFT, FFT]

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)

Abstract

The invention provides a track traffic video monitoring image enhancement algorithm, which comprises the following steps: s1, dividing an image into two color blocks and two edge components, and respectively corresponding to the frequency domain, wherein the color blocks correspond to the low-frequency component of the image, and the edge details correspond to the high-frequency component of the image; s2, enhancing the low-frequency component by using global self-adaptive gamma correction, and enhancing the high-frequency component by using Fourier transform; and S3, overlapping the enhancement maps corresponding to the low-frequency component and the high-frequency component to obtain an output image. The invention belongs to a brightness adjustment algorithm with high and low frequency separation, and better results can be obtained by respectively enhancing low-frequency images and high-frequency images by adopting different suitable methods.

Description

Rail transit video monitoring image enhancement algorithm
Technical Field
The invention relates to the technical field of image enhancement processing, in particular to a track traffic video monitoring image enhancement algorithm.
Background
The rail transit video monitoring system can facilitate the on-duty personnel to monitor the subway operation condition, the passenger flow and the conditions of passengers getting on and off the train in real time, facilitate the maintenance personnel to monitor the equipment condition in time, and ensure that the management personnel effectively control and command the field condition. The frame of the rail transit video system often has the low illumination condition, which directly leads to poor quality of the collected image, and greatly reduces the practical value of the video monitoring system. Therefore, exploring the image enhancement algorithm and application of the rail transit video monitoring system has great practical significance for fully exerting the use value of the video system.
For low-light images in rail transit video surveillance, the main purpose is to adjust their brightness in order to view the target. However, the existing enhancement algorithms such as BBHE and DHE have low fidelity to details, often lose original details while enhancing contrast, and have poor enhancement effect.
Disclosure of Invention
In order to improve the enhancement effect of low-illumination images, the patent provides a method for enhancing track traffic video monitoring images, and the specific scheme is as follows:
the rail transit video monitoring image enhancement algorithm comprises the following steps:
s1, dividing an image into two color blocks and two edge components, and respectively corresponding to the frequency domain, wherein the color blocks correspond to the low-frequency component of the image, and the edge details correspond to the high-frequency component of the image;
s2, enhancing the low-frequency component by using global self-adaptive gamma correction, and enhancing the high-frequency component by using Fourier transform;
and S3, overlapping the enhancement maps corresponding to the low-frequency component and the high-frequency component to obtain an output image.
Specifically, step S1 specifically includes: acquiring low-frequency components of the image by a Gaussian low-pass filter, and recording the obtained low-frequency image as Z; in the high-frequency component extraction process, a manner of retaining all pixels instead of direct subtraction is adopted.
Specifically, the high-frequency component extraction process in step S1 is:
respectively judging the pixel value a of the original image in R, G, B three channelscAnd a low-frequency component pixel value bcThe size of the image is c ∈ { R, G, B }, if the original image pixel is larger than the low-frequency image pixel, the original image pixel is directly subtracted, and the obtained difference value is stored in a high-frequency image X; if the original image pixel is smaller than the low-frequency component pixel, taking the opposite number of the difference value and storing the opposite number into a high-frequency image Y; the mathematical expressions of the images calculated in the R, G, B channels are as follows:
X=ac-bc,ac>bc,c∈{R,G,B}
Y=bc-ac,ac<bc,c∈{R,G,B}。
specifically, the step of enhancing the low-frequency component in step S2 specifically includes: the method is realized by a gamma correction power function, and the mathematical expression of the power function is as follows:
L=Zγ
where L is the output enhanced low-frequency image, Z is the input low-frequency original, and γ is the power exponent.
Specifically, γ takes a value of 2.2.
Specifically, the enhancement of the high-frequency component in step S2 is specifically:
s21, transforming the image from a space domain to a frequency domain through Fourier transform;
s22, homomorphic filtering operation and processing are carried out on the frequency spectrum in the frequency domain;
s23, inverse transforming the image into a spatial domain to obtain an enhanced image, wherein the enhanced image of the high-frequency image X is P and the enhanced image of the high-frequency image Y is Q.
Specifically, step S3 is as follows: and (3) superposing the enhanced image and the low-frequency enhanced image corresponding to the high-frequency image X and the high-frequency image Y, wherein the pixel value stored by q is a negative value, and the superposition needs to be subjected to inverse number processing, and the mathematical expression of the method is as follows:
J=Pc+Lc+Qc,c∈{R,G,B}
wherein J is the superimposed image, PcFor the X enhanced image, LcFor low-frequency images Z enhanced images, QcIs the image after Y enhancement.
The invention has the beneficial effects that:
(1) the invention belongs to a brightness adjustment algorithm with high and low frequency separation, and better results can be obtained by respectively enhancing low-frequency images and high-frequency images by adopting different suitable methods.
(2) The low frequency components of an image are the color block portions of the image, i.e., most of the pixels of the image, which determine the brightness of the image to some extent. The low-frequency components are enhanced by adopting a gamma correction method, wherein the gamma correction refers to a mode of editing a gamma curve of an image to perform nonlinear brightness adjustment on the image, and essentially, a dark color pixel and a light color pixel in the image are separated by a gray level transformation equation, and the difference between the two parts is enlarged, so that the contrast of the image is enhanced.
(3) The common algorithm for enhancing high-frequency images is guide map filtering, which requires separately processing steps for R, G, B three channels, and the enhancing effect is not significant. The texture characteristics of the image after the guide map filtering can be maintained, but the detail highlighting cannot be realized. According to the method, the Fourier transform mode is adopted, so that the steps are simple, and the details can be highlighted.
Drawings
Fig. 1 is a flowchart of an image enhancement algorithm for rail transit video surveillance provided by the present invention.
Fig. 2 shows the original image of the experimental treatment.
Fig. 3 is a diagram illustrating the effect of the BBHE algorithm process in the prior art.
FIG. 4 is a diagram of the effect of DHE algorithm processing in the prior art.
Fig. 5 is a diagram illustrating the effect of the algorithm process of the present application.
Detailed Description
Referring to fig. 1, the invention provides an image enhancement algorithm for rail transit video surveillance, which comprises the following steps:
s1, dividing an image into two color blocks and two edge components, and respectively corresponding to the frequency domain, wherein the color blocks correspond to the low-frequency component of the image, and the edge details correspond to the high-frequency component of the image; specifically, the low-frequency component of the image is obtained by a Gaussian low-pass filter, and the obtained low-frequency image is recorded as Z; in the high-frequency component extraction process, a manner of retaining all pixels instead of direct subtraction is adopted. The original image is a live video slice collected by a track traffic video monitoring system in a certain city randomly extracted in video monitoring, and the picture size is 702 × 525, as shown in fig. 2.
The high-frequency component extraction process comprises the following steps:
respectively judging the pixel value a of the original image in R, G, B three channelscAnd a low-frequency component pixel value bcThe size of the image is c ∈ { R, G, B }, if the original image pixel is larger than the low-frequency image pixel, the original image pixel is directly subtracted, and the obtained difference value is stored in a high-frequency image X; if the original image pixel is smaller than the low-frequency component pixel, taking the opposite number of the difference value and storing the opposite number into a high-frequency image Y; the mathematical expressions of the images calculated in the R, G, B channels are as follows:
X=ac-bc,ac>bc,c∈{R,G,B}
Y=bc-ac,ac<bc,c∈{R,G,B}。
s2, enhancing the low-frequency component by using global self-adaptive gamma correction, and enhancing the high-frequency component by using Fourier transform;
the step of enhancing the low frequency component specifically comprises:
the method is realized by a gamma correction power function, and the mathematical expression of the power function is as follows:
L=Zγ
where L is the output enhanced low-frequency image, Z is the input low-frequency original, and γ is the power exponent.
Specifically, γ takes a value of 2.2.
The enhancement of the high-frequency component is specifically:
s21, transforming the image from a space domain to a frequency domain through Fourier transform;
s22, homomorphic filtering operation and processing are carried out on the frequency spectrum in the frequency domain;
s23, inverse transforming the image into a spatial domain to obtain an enhanced image, wherein the enhanced image of the high-frequency image X is P and the enhanced image of the high-frequency image Y is Q.
And S3, overlapping the enhancement maps corresponding to the low-frequency component and the high-frequency component to obtain an output image. The method comprises the following specific steps:
and (3) superposing the enhanced image and the low-frequency enhanced image corresponding to the high-frequency image X and the high-frequency image Y, wherein the pixel value stored by q is a negative value, and the superposition needs to be subjected to inverse number processing, and the mathematical expression of the method is as follows:
J=Pc+Lc+Qc,c∈{R,G,B}
wherein J is the superimposed image, PcFor the X enhanced image, LcFor low-frequency images Z enhanced images, QcIs the image after Y enhancement.
Based on the above algorithm, the effect graph shown in fig. 5 can be obtained, and as can be seen by comparing fig. 3 and fig. 4: the information entropy and the average brightness of the BBHE algorithm are large, but partial details are blurred; the contrast of the processing result of the DHE algorithm is obviously enhanced, the definition is high, but an obvious gray overflow effect is generated at the site indication bar; the algorithm result of the method not only keeps higher brightness and definition, but also solves the problems of detail blurring, gray overflow effect and the like. The following table shows the superiority of the algorithm by means of quantitative analysis:
Method entropy of information Contrast ratio Average brightness Definition of
BBHE 7.94 377 138 9.88
DHE 7.14 628 85 11.73
Algorithm of the patent 7.91 644 145 12.52
As can be seen from the table above, the entropy of the image information obtained by the algorithm of the patent is equivalent to that of the BBHE algorithm, but better than that of the DHE algorithm; in contrast, the algorithm of the patent is obviously higher than a BBHE algorithm and slightly higher than a DHE algorithm; in the aspect of average brightness, the algorithm of the patent is slightly higher than a BBHE algorithm and is obviously higher than a DHE algorithm; in the aspect of definition, the algorithm of the patent is also due to BBHE algorithm and DHE algorithm; in general, the algorithm of the present patent is superior.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be considered to be within the technical scope of the present invention, and the technical solutions and the inventive concepts thereof according to the present invention should be equivalent or changed within the scope of the present invention.

Claims (7)

1. The rail transit video monitoring image enhancement algorithm is characterized by comprising the following steps of:
s1, dividing an image into two color blocks and two edge components, and respectively corresponding to the frequency domain, wherein the color blocks correspond to the low-frequency component of the image, and the edge details correspond to the high-frequency component of the image;
s2, enhancing the low-frequency component by using global self-adaptive gamma correction, and enhancing the high-frequency component by using Fourier transform;
and S3, overlapping the enhancement maps corresponding to the low-frequency component and the high-frequency component to obtain an output image.
2. The track traffic video monitoring image enhancement algorithm according to claim 1, wherein the step S1 specifically comprises: acquiring low-frequency components of the image by a Gaussian low-pass filter, and recording the obtained low-frequency image as Z; in the high-frequency component extraction process, a manner of retaining all pixels instead of direct subtraction is adopted.
3. The track traffic video surveillance image enhancement algorithm of claim 2, wherein the extraction process of the high frequency component in step S1 is as follows:
respectively judging the pixel value a of the original image in R, G, B three channelscAnd a low-frequency component pixel value bcThe size of the image is c ∈ { R, G, B }, if the original image pixel is larger than the low-frequency image pixel, the original image pixel is directly subtracted, and the obtained difference value is stored in a high-frequency image X; if the original image pixel is smaller than the low-frequency component pixel, taking the opposite number of the difference value and storing the opposite number into a high-frequency image Y; the mathematical expressions of the images calculated in the R, G, B channels are as follows:
X=ac-bc,ac>bc,c∈{R,G,B}
Y=bc-ac,ac<bc,c∈{R,G,B}。
4. the track traffic video monitoring image enhancement algorithm according to claim 1 or 3, wherein the step of enhancing the low frequency component in step S2 is specifically: the method is realized by a gamma correction power function, and the mathematical expression of the power function is as follows:
L=Zγ
where L is the output enhanced low-frequency image, Z is the input low-frequency original, and γ is the power exponent.
5. The track traffic video surveillance image enhancement algorithm of claim 3, wherein γ takes the value of 2.2.
6. The track traffic video monitoring image enhancement algorithm according to claim 3, wherein the enhancement of the high frequency component in step S2 specifically comprises:
s21, transforming the image from a space domain to a frequency domain through Fourier transform;
s22, homomorphic filtering operation and processing are carried out on the frequency spectrum in the frequency domain;
s23, inverse transforming the image into a spatial domain to obtain an enhanced image, wherein the enhanced image of the high-frequency image X is P and the enhanced image of the high-frequency image Y is Q.
7. The track traffic video monitoring image enhancement algorithm according to claim 6, wherein the step S3 is as follows: and (3) superposing the enhanced image and the low-frequency enhanced image corresponding to the high-frequency image X and the high-frequency image Y, wherein the pixel value stored by q is a negative value, and the superposition needs to be subjected to inverse number processing, and the mathematical expression of the method is as follows:
J=Pc+Lc+Qc,c∈{R,G,B}
wherein J is the superimposed image, PcFor the X enhanced image, LcFor low-frequency images Z enhanced images, QcIs the image after Y enhancement.
CN202011566292.7A 2020-12-25 2020-12-25 Rail transit video monitoring image enhancement algorithm Pending CN112581404A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011566292.7A CN112581404A (en) 2020-12-25 2020-12-25 Rail transit video monitoring image enhancement algorithm

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011566292.7A CN112581404A (en) 2020-12-25 2020-12-25 Rail transit video monitoring image enhancement algorithm

Publications (1)

Publication Number Publication Date
CN112581404A true CN112581404A (en) 2021-03-30

Family

ID=75140663

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011566292.7A Pending CN112581404A (en) 2020-12-25 2020-12-25 Rail transit video monitoring image enhancement algorithm

Country Status (1)

Country Link
CN (1) CN112581404A (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120201455A1 (en) * 2008-06-04 2012-08-09 Vijay Kumar Kodavalla Method and apparatus for dynamic and adaptive enhancement of colors in digital video images using value bright-gain
CN105931201A (en) * 2016-04-20 2016-09-07 北京航空航天大学 Image subjective visual effect enhancing method based on wavelet transformation
CN109919861A (en) * 2019-01-29 2019-06-21 浙江数链科技有限公司 Infrared image enhancing method, device, computer equipment and storage medium
CN111383299A (en) * 2018-12-28 2020-07-07 Tcl集团股份有限公司 Image processing method and device and computer readable storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120201455A1 (en) * 2008-06-04 2012-08-09 Vijay Kumar Kodavalla Method and apparatus for dynamic and adaptive enhancement of colors in digital video images using value bright-gain
CN105931201A (en) * 2016-04-20 2016-09-07 北京航空航天大学 Image subjective visual effect enhancing method based on wavelet transformation
CN111383299A (en) * 2018-12-28 2020-07-07 Tcl集团股份有限公司 Image processing method and device and computer readable storage medium
CN109919861A (en) * 2019-01-29 2019-06-21 浙江数链科技有限公司 Infrared image enhancing method, device, computer equipment and storage medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
杨紫烟: ""轨道交通闭路电视监控***视频图像增强算法研究及应用"", 《中国优秀博硕士学位论文全文数据库(硕士) 工程科技II辑》 *

Similar Documents

Publication Publication Date Title
KR102234092B1 (en) Method for inverse tone mapping of an image
CN102611828B (en) Real-time enhanced processing system for foggy continuous video image
CN104240194B (en) A kind of enhancement algorithm for low-illumination image based on parabolic function
CN107292830B (en) Low-illumination image enhancement and evaluation method
CN111598791B (en) Image defogging method based on improved dynamic atmospheric scattering coefficient function
CN106875358A (en) Image enchancing method and image intensifier device based on Bayer format
CN105550999A (en) Video image enhancement processing method based on background reuse
CN105427255A (en) GRHP based unmanned plane infrared image detail enhancement method
CN100367770C (en) Method for removing isolated noise point in video
CN111598814A (en) Single image defogging method based on extreme scattering channel
CN109544470A (en) A kind of convolutional neural networks single image to the fog method of boundary constraint
Lal et al. Automatic method for contrast enhancement of natural color images
CN112581404A (en) Rail transit video monitoring image enhancement algorithm
CN111161189A (en) Single image re-enhancement method based on detail compensation network
CN111429375A (en) Night monitoring video quality improving method assisted by daytime image reference
CN107871311A (en) A kind of image enhaucament and fusion method applied to cmos image sensor
Tang et al. Sky-preserved image dehazing and enhancement for outdoor scenes
CN112019774B (en) High-quality display method of infrared high-bit-width digital image
Lyu et al. A novel visual perception enhancement algorithm for high-speed railway in the low light condition
CN111028184B (en) Image enhancement method and system
CN114222033A (en) Adaptive Euler video amplification method based on empirical mode decomposition
CN109886901B (en) Night image enhancement method based on multi-channel decomposition
Kaur et al. Image enhancement of underwater digital images by utilizing L* A* B* color space on gradient and CLAHE based smoothing
Dhingra et al. Fusion of fuzzy enhanced overexposed and underexposed images
CN108259873B (en) Gradient domain video contrast enhancement method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20210330