CN111225278A - Method and device for enhancing video under low illumination - Google Patents
Method and device for enhancing video under low illumination Download PDFInfo
- Publication number
- CN111225278A CN111225278A CN202010134785.7A CN202010134785A CN111225278A CN 111225278 A CN111225278 A CN 111225278A CN 202010134785 A CN202010134785 A CN 202010134785A CN 111225278 A CN111225278 A CN 111225278A
- Authority
- CN
- China
- Prior art keywords
- frame image
- contrast
- video
- image
- frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 66
- 230000002708 enhancing effect Effects 0.000 title claims abstract description 44
- 238000005286 illumination Methods 0.000 title claims abstract description 43
- 230000006872 improvement Effects 0.000 claims description 10
- 238000012935 Averaging Methods 0.000 claims description 6
- 230000003321 amplification Effects 0.000 claims description 6
- 230000004927 fusion Effects 0.000 claims description 6
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 6
- 230000001131 transforming effect Effects 0.000 claims description 2
- 230000008569 process Effects 0.000 abstract description 15
- 238000003384 imaging method Methods 0.000 abstract description 12
- 238000012545 processing Methods 0.000 abstract description 11
- 238000003860 storage Methods 0.000 description 19
- 238000010586 diagram Methods 0.000 description 13
- 238000004590 computer program Methods 0.000 description 9
- 230000008859 change Effects 0.000 description 6
- 238000001914 filtration Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 230000002349 favourable effect Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 239000000779 smoke Substances 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000012271 agricultural production Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 238000003706 image smoothing Methods 0.000 description 1
- 238000009776 industrial production Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000002688 persistence Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
- H04N21/4854—End-user interface for client configuration for modifying image parameters, e.g. image brightness, contrast
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Image Processing (AREA)
- Studio Devices (AREA)
Abstract
The embodiment of the invention provides a method and a device for enhancing a video under low illumination, wherein the method comprises the following steps: splitting a video into a plurality of single-frame images frame by frame, wherein the video is obtained by shooting under low illumination; the contrast of each single frame image is improved; enhancing the image details of each single-frame image after the contrast is improved; and merging each single-frame image after the image details are enhanced to obtain an enhanced video. By improving the contrast of each single-frame image and enhancing the image details of each single-frame image, the whole video can be enhanced, the recognition degree of scenes in the video is further improved, and the imaging quality of the video is improved. And the processing process is simple, the time consumed for improving the imaging quality of the video can be shortened, and the real-time performance of video enhancement under low illumination is realized. Meanwhile, the problem of over-enhancement of bright areas near the light source in the video can be avoided.
Description
Technical Field
The invention relates to the technical field of image processing, in particular to a method and a device for enhancing a video under low illumination.
Background
With the rapid development of computer networks, multimedia and other technologies, the application of video is changing the life style of people and gradually becoming an indispensable part in people's life. By video is meant a sequence of images that varies over time. According to the principle of persistence of vision, when a continuous image changes over 24 frames of pictures in a unit time, human eyes cannot distinguish static pictures of a single frame, and the continuous image looks like balancing continuous visual effect and sometimes contains corresponding audio information.
At present, videos are used by people to solve practical problems in various fields such as medical diagnosis, aerospace, industrial and agricultural production, meteorology and monitoring. For example: the video is applied to an object recognition system, an intelligent robot system, a video monitoring system, an advanced driver assistance system and the like.
However, in practical applications, the imaging quality of the video is reduced due to various factors, and the requirements of practical applications cannot be met. For example: due to less illumination, contrast and color degradation of scenes in the captured video are caused, so that the recognition degree of the scenes in the video is reduced, the scenes in the video are not convenient to recognize and analyze, and the video is not favorable for monitoring and navigation. Especially in poor weather conditions, such as: under the environment of heavy rain, heavy fog, dense smoke, night and the like, the imaging quality of the video is lower. How to improve the imaging quality of videos under low illumination is a problem to be solved currently.
Disclosure of Invention
In view of the foregoing problems, an object of the embodiments of the present invention is to provide a method and an apparatus for enhancing a video under low illumination, aiming to improve the imaging quality of the video under low illumination.
In order to solve the above technical problems, embodiments of the present invention provide the following technical solutions:
in a first aspect, an embodiment of the present invention provides a method for enhancing a video under low illumination, where the method includes: splitting a video into a plurality of single-frame images frame by frame, wherein the video is obtained by shooting under low illumination; the contrast of each single frame image is improved; enhancing the image details of each single-frame image after the contrast is improved; and merging each single-frame image after the image details are enhanced to obtain an enhanced video.
In other embodiments of the present invention, the increasing the contrast of each single frame image includes: transforming each single frame image from a first color space to a second color space, wherein the degree of improvement of the image contrast in the second color space is higher than that in the first color space under the same condition; and in the second color space, the contrast of each single-frame image is improved according to preset parameters.
In other embodiments of the present invention, the second color space is an HSV color model.
In other embodiments of the present invention, the enhancing the image details of each single frame image after the contrast enhancement includes: decomposing each single-frame image with the improved contrast into a high-frequency part and a low-frequency part; performing energy amplification on the high frequency part and averaging the low frequency part; and merging the amplified high-frequency part and the averaged low-frequency part belonging to the same frame to obtain each merged single-frame image.
In other embodiments of the present invention, the enhancing the image details of each single frame image after the contrast enhancement includes: and enhancing the image details of each single-frame image after the contrast is improved by adopting a wavelet fusion algorithm.
In a second aspect, an embodiment of the present invention provides an apparatus for enhancing a video under low illumination, where the apparatus includes: the splitting module is configured to split a video into a plurality of single-frame images frame by frame, wherein the video is shot under low illumination; a lifting module configured to lift a contrast of each single frame image; the enhancement module is configured to enhance the image details of each single-frame image after the contrast is improved; and the merging module is configured to merge each single-frame image after the image details are enhanced to obtain an enhanced video.
In other embodiments of the present invention, the lifting module is configured to transform each single frame image from a first color space to a second color space, and the lifting degree of the image contrast in the second color space is higher than that in the first color space under the same condition; and in the second color space, the contrast of each single-frame image is improved according to preset parameters.
In other embodiments of the present invention, the second color space is an HSV color model.
In other embodiments of the present invention, the enhancement module is configured to decompose each single frame image after the contrast enhancement into a high frequency part and a low frequency part; performing energy amplification on the high frequency part and averaging the low frequency part; and merging the amplified high-frequency part and the averaged low-frequency part belonging to the same frame to obtain each merged single-frame image.
In other embodiments of the present invention, the enhancing module is configured to enhance the image details of each single frame image after the contrast lifting by using a wavelet fusion algorithm.
In a third aspect, an embodiment of the present invention provides an electronic device, where the electronic device includes: at least one processor; and at least one memory, bus connected with the processor; the processor and the memory complete mutual communication through the bus; the processor is configured to call the program instructions in the memory to perform the method for enhancing the video under low illumination in one or more of the above technical solutions.
In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, where the storage medium includes a stored program, where when the program runs, a device in which the storage medium is located is controlled to execute a method for enhancing a video under low illumination in one or more of the foregoing technical solutions.
The method and the device for enhancing the video under low illumination provided by the embodiment of the invention have the advantages that firstly, the video is split into a plurality of single-frame images frame by frame, and the video is obtained by shooting under low illumination; then, the contrast of each single frame image is improved; secondly, enhancing the image details of each single-frame image after the contrast is improved; and finally, merging each single-frame image after the image details are enhanced to obtain an enhanced video. By improving the contrast of each single-frame image and enhancing the image details of each single-frame image, the whole video can be enhanced, the recognition degree of scenes in the video is further improved, and the imaging quality of the video is improved. And the processing process is simple, the time consumed for improving the imaging quality of the video can be shortened, and the real-time performance of video enhancement under low illumination is realized. Meanwhile, the problem of over-enhancement of bright areas near the light source in the video can be avoided.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
fig. 1 is a first flowchart illustrating a method for enhancing a video under low illumination according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating a second method for enhancing a video under low illumination according to an embodiment of the present invention;
FIG. 3 is a schematic structural diagram of a video enhancement apparatus under low illumination according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device in an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the invention are shown in the drawings, it should be understood that the invention can be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.
An embodiment of the present invention provides a method for enhancing a video under low illumination, and fig. 1 is a first flowchart of the method for enhancing a video under low illumination in an embodiment of the present invention, and as shown in fig. 1, the method may include:
s101: the video is split frame by frame into a plurality of single frame images.
Here, the video is taken under low illumination. That is, when a video is captured, the amount of light in the surrounding environment is small, so that the brightness of the captured video image is low, which is not favorable for identifying the person or the scene in the video. In practical applications, the video captured under low illumination may be a video captured under an environment with a small amount of illumination, such as heavy rain, heavy fog, heavy smoke, and night. Of course, the present invention may also refer to a video shot in other environments with a small amount of light, and is not limited herein.
In a specific implementation process, because the video is composed of a plurality of image sequences which change along with time, and each image is a frame, in order to facilitate more accurate processing of images in the video, after the video is acquired, the video can be split into a plurality of single-frame images frame by frame, and then each single-frame image is processed respectively, and each single-frame image is enhanced, so that the identification degree of the whole video is improved.
For example, it is assumed that a video is composed of 10 consecutive images, i.e., the video is 10 frames. Then, after the video is acquired, the video is split frame by frame to obtain the 1 st frame, the 2 nd frame, the 3 rd frame, the 4 th frame, the 5 th frame, the 6 th frame, the 7 th frame, the 8 th frame, the 9 th frame, and the 10 single-frame images, so as to respectively process the 10 single-frame images in the following.
S102: and the contrast of each single-frame image is improved.
When the contrast of each single-frame image is improved, the contrast of all the single-frame images can be improved in the same color space. Here, the contrast lifting may include, but is not limited to, the following color spaces for each single frame image:
the first method comprises the following steps: RGB color space.
Wherein R is Red (Red), G is Green (Green), and B is Blue.
In a specific implementation process, three parameters of red, green and blue of a single-frame image in an RGB color space can be adjusted, so that the contrast of the single-frame image is improved, and an object in the single-frame image can be clearly identified from the single-frame image.
And the second method comprises the following steps: a CMY color space.
Where C is Cyan (Cyan), M is Magenta (Magenta), and Y is Yellow (Yellow).
In the implementation process, three parameters of cyan, magenta and yellow of a single-frame image in a CMY color space can be adjusted, so that the contrast of the single-frame image is improved, and an object in the single-frame image can be clearly identified from the single-frame image.
And the third is that: HSV color space.
Where H is Hue (Hue), S is Saturation (Saturation), and V is lightness (Value).
In the specific implementation process, three parameters of hue, saturation and brightness of the single-frame image in the HSV color space can be adjusted, so that the contrast of the single-frame image is improved, and an object in the single-frame image can be clearly identified from the single-frame image.
Of course, the contrast of each single frame image may be improved in other color spaces, and all the color spaces are not listed.
It should be noted that, no matter which color space each single-frame image is placed in for contrast enhancement, all single-frame images belonging to the same video need to be placed in the same color space for contrast enhancement. Moreover, the parameters adjusted in the same color space for each single-frame image may be the same or different, as long as the contrast of each single-frame image is maximally improved, and this is not limited here.
S103: and enhancing the image details of each single-frame image after the contrast is improved.
And after the contrast of each single-frame image is promoted, enhancing the image details of the single-frame image continuously. Specifically, the detail enhancement can be performed on each single frame image from, but not limited to, the following two aspects:
in a first aspect: the spatial domain.
In particular, each single frame image is directly enhanced. In practical application, the method mainly comprises the following steps: grayscale enhancement of image pixels, image smoothing, etc. Of course, other ways of detail enhancement are possible and not limited herein.
In a second aspect: the frequency domain.
Specifically, after each single frame image is transformed to the frequency domain, various coefficients of each single frame image in the frequency domain are corrected, and then the single frame image is transformed to the original space domain, so that the enhanced single frame image is obtained. In practical application, the method mainly comprises the following steps: low pass filtering, high pass filtering, band stop filtering, homomorphic filtering, and the like. Of course, other ways of detail enhancement are possible and not limited herein.
S104: and merging each single-frame image after the image details are enhanced to obtain an enhanced video.
After the contrast and the image details of each single frame image are successively enhanced, each enhanced single frame image can be combined. Because each enhanced single-frame image is enhanced, objects in the image can be clearly identified from each enhanced single-frame image, therefore, videos obtained by combining each enhanced single-frame image are also enhanced, and the objects in the videos can be clearly identified from the combined videos.
In the implementation process, each enhanced single-frame image can be written into a disk, so that an enhanced video can be obtained.
As can be seen from the above, in the method for enhancing a video under low illumination provided by the embodiment of the present invention, first, a video is split into a plurality of single-frame images frame by frame, and the video is obtained by shooting under low illumination; then, the contrast of each single frame image is improved; secondly, enhancing the image details of each single-frame image after the contrast is improved; and finally, merging each single-frame image after the image details are enhanced to obtain an enhanced video. By improving the contrast of each single-frame image and enhancing the image details of each single-frame image, the whole video can be enhanced, the recognition degree of scenes in the video is further improved, and the imaging quality of the video is improved. And the processing process is simple, the time consumed for improving the imaging quality of the video can be shortened, and the real-time performance of video enhancement under low illumination is realized. Meanwhile, the problem of over-enhancement of bright areas near the light source in the video can be avoided.
Further, as refinement and expansion of the method for enhancing the video under low illumination shown in fig. 1, an embodiment of the present invention further provides a method for enhancing the video under low illumination, and fig. 2 is a schematic flow diagram of the method for enhancing the video under low illumination in the embodiment of the present invention, and as shown in fig. 2, the method may include:
s201: the video is split frame by frame into a plurality of single frame images.
The implementation of this step is the same as that of step 101 in fig. 1, and is not described here again.
S202: each single frame image is transformed from a first color space to a second color space.
Under the same condition, the degree of improving the image contrast in the second color space is higher than that in the first color space. The same condition here may mean that the amounts of change of the respective parameters in different color spaces are the same. That is, in the case where the amount of change in the parameter is the same, the color space corresponding to the most significant contrast improvement of the image is selected. Because the variation of the corresponding parameters in different color spaces is the same, and the improvement degree of the contrast of the image is different, it is indicated that in some color spaces, the corresponding parameters can obviously improve the contrast of the image, therefore, when the contrast of the image is improved, the image can be transformed into the color space to improve the contrast, which is beneficial to the maximization of the contrast improvement of the image.
For example, assume that for a single-frame image a, in the first color space, the first parameter is changed by 10, and the degree of contrast improvement in the single-frame image a is 2; in the second color space, the second parameter is changed by 10, and the degree of improvement of the contrast in the single-frame image a is 3 at this time. The first parameter and the second parameter are respectively one or more corresponding parameters in the first color space and the second color space. In this example, the single-frame image a is transformed from the first color space to the second color space, and the maximum contrast improvement of the single-frame image a is achieved by adjusting the second parameter in the second color space.
It should be noted that, if the single-frame image a is in the first color space and the first parameter is changed by 10, the degree of contrast enhancement is 5, and the degree of contrast enhancement in the second color space is 3, which indicates that the single-frame image a is currently in the color space most suitable for contrast enhancement, that is, when the single-frame image a is already in the most suitable color space, the color space conversion of the single-frame image a is not needed.
In practical application, a large number of experiments show that the contrast of a single-frame image can be improved to the maximum extent by changing the single-frame image into an HSV color model and adjusting one or more parameters in the HSV color model. Here, the amount of change of one or more parameters in the HSV color model may be determined according to the quality of different videos, and is not particularly limited herein. And for videos shot in the same scene, the change amount of one or more parameters in the HSV color model of each single-frame image is the same.
S203: and in the second color space, the contrast of each single-frame image is improved according to preset parameters.
After each single frame image is transformed to the second color space, the contrast of each single frame image can be improved according to the preset parameters. Here, the preset parameter is a value of the preset parameter corresponding to the second color space when the degree of contrast improvement of each single-frame image is maximum, and the preset parameter may be set by a user according to an actual situation, which is not limited herein.
S204: and decomposing each single frame image after the contrast is improved into a high-frequency part and a low-frequency part.
After the contrast of each single-frame image is improved, the image details of each single-frame image can be continuously enhanced. Specifically, each single frame image may be transformed from the spatial domain to the frequency domain, where the high and low frequency portions of each single frame image can be more easily separated and processed separately.
S205: the high frequency part is energy amplified and the low frequency part is averaged.
Since the information of the brighter part in the single-frame image, that is, the information of the object is mainly in the high-frequency part, the object in the single-frame image can be enhanced by amplifying the energy of the high-frequency part. The low-frequency part is mainly information of a darker part in the single-frame image, namely information of the background, so that the low-frequency part is averaged, and the interference of the background and noise in the single-frame image can be reduced.
S206: and merging the amplified high-frequency part and the averaged low-frequency part belonging to the same frame to obtain each merged single-frame image.
Since a video corresponds to a plurality of single-frame images each of which is divided into a high-frequency part and a low-frequency part, the high-frequency part and the low-frequency part belonging to the same frame are combined. After the merging, the merged part is converted from the frequency domain back to the spatial domain, and a plurality of merged single-frame images, i.e. each merged single-frame image, are obtained.
In practical applications, for the process from step 204 to step 206 for processing each single frame image, a wavelet fusion algorithm may be used to enhance the image details of each single frame image.
S207: and merging each single-frame image after the image details are enhanced to obtain an enhanced video.
The implementation of this step is the same as that of step 104 in fig. 1, and is not described here again.
As can be seen from the above, in the method for enhancing a video under low illumination provided by the embodiment of the present invention, first, a video is split into a plurality of single-frame images frame by frame; then, converting each single-frame image from a first color space to a second color space, and in the second color space, improving the contrast of each single-frame image according to preset parameters; then, decomposing each single-frame image with improved contrast into a high-frequency part and a low-frequency part, carrying out energy amplification on the high-frequency part, averaging the low-frequency part, and combining the amplified high-frequency part and the averaged low-frequency part which belong to the same frame to obtain each combined single-frame image; and finally, merging each single-frame image after the image details are enhanced to obtain an enhanced video. By improving the contrast of each single-frame image and enhancing the image details of each single-frame image, the whole video can be enhanced, the recognition degree of scenes in the video is further improved, and the imaging quality of the video is improved. And the processing process is simple, the time consumed for improving the imaging quality of the video can be shortened, and the real-time performance of video enhancement under low illumination is realized. Meanwhile, the problem of over-enhancement of bright areas near the light source in the video can be avoided.
Based on the same inventive concept, as an implementation of the method for enhancing a video under low illumination, an embodiment of the present invention further provides an apparatus for enhancing a video under low illumination, fig. 3 is a schematic structural diagram of the apparatus for enhancing a video under low illumination in an embodiment of the present invention, and referring to fig. 3, the apparatus 30 may include: a splitting module 301 configured to split a video, which is captured under low illumination, into a plurality of single-frame images frame by frame; a lifting module 302 configured to lift the contrast of each single frame image; an enhancement module 303 configured to enhance image details of each single frame image after the contrast enhancement; and the merging module 304 is configured to merge each single-frame image after the image details are enhanced, so as to obtain an enhanced video.
Based on the foregoing embodiments, the lifting module is configured to transform each single frame image from a first color space to a second color space, where the degree of lifting of the image contrast in the second color space is higher than that in the first color space under the same condition; and in the second color space, the contrast of each single-frame image is improved according to preset parameters.
Based on the foregoing embodiment, the second color space is an HSV color model.
Based on the foregoing embodiments, the enhancement module is configured to decompose each single frame image after the contrast enhancement into a high frequency part and a low frequency part; performing energy amplification on the high frequency part and averaging the low frequency part; and merging the amplified high-frequency part and the averaged low-frequency part belonging to the same frame to obtain each merged single-frame image.
Based on the foregoing embodiment, the enhancing module is configured to enhance the image details of each single frame image after the contrast lifting by using a wavelet fusion algorithm.
Here, it should be noted that: the above description of the apparatus embodiments, similar to the above description of the method embodiments, has similar beneficial effects as the method embodiments. For technical details not disclosed in the embodiments of the apparatus according to the invention, reference is made to the description of the embodiments of the method according to the invention for understanding.
Based on the same inventive concept, an embodiment of the present invention further provides an electronic device, fig. 4 is a schematic structural diagram of the electronic device in the embodiment of the present invention, and referring to fig. 4, the electronic device 40 may include: at least one processor 401; and at least one memory 402, a bus 403 connected to the processor 401; the processor 401 and the memory 402 complete communication with each other through the bus 403; the processor 401 is configured to call program instructions in the memory 402 to perform the enhancement method of the video under low illumination in one or more embodiments described above.
Here, it should be noted that: the above description of the embodiments of the electronic device is similar to the description of the embodiments of the method described above, and has similar advantageous effects to the embodiments of the method. For technical details not disclosed in the embodiments of the electronic device according to the embodiments of the present invention, please refer to the description of the method embodiments of the present invention.
Based on the same inventive concept, an embodiment of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium includes a stored program, and when the program runs, an apparatus on which the storage medium is controlled to execute the method for enhancing a video under low illumination in one or more embodiments described above.
Here, it should be noted that: the above description of the computer-readable storage medium embodiments is similar to the description of the method embodiments described above, with similar beneficial effects as the method embodiments. For technical details not disclosed in the embodiments of the computer-readable storage medium of the embodiments of the present invention, reference is made to the description of the method embodiments of the present invention for understanding.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (10)
1. A method for enhancing video at low light levels, the method comprising:
splitting a video into a plurality of single-frame images frame by frame, wherein the video is obtained by shooting under low illumination;
the contrast of each single frame image is improved;
enhancing the image details of each single-frame image after the contrast is improved;
and merging each single-frame image after the image details are enhanced to obtain an enhanced video.
2. The method of claim 1, wherein the increasing the contrast of each single frame image comprises:
transforming each single frame image from a first color space to a second color space, wherein the degree of improvement of the image contrast in the second color space is higher than that in the first color space under the same condition;
and in the second color space, the contrast of each single-frame image is improved according to preset parameters.
3. The method of claim 2, wherein the second color space is an HSV color model.
4. The method of claim 1, wherein the enhancing the image details of each single frame image after the contrast enhancement comprises:
decomposing each single-frame image with the improved contrast into a high-frequency part and a low-frequency part;
performing energy amplification on the high frequency part and averaging the low frequency part;
and merging the amplified high-frequency part and the averaged low-frequency part belonging to the same frame to obtain each merged single-frame image.
5. The method of claim 1, wherein the enhancing the image details of each single frame image after the contrast enhancement comprises:
and enhancing the image details of each single-frame image after the contrast is improved by adopting a wavelet fusion algorithm.
6. An apparatus for enhancing video at low light levels, the apparatus comprising:
the splitting module is configured to split a video into a plurality of single-frame images frame by frame, wherein the video is shot under low illumination;
a lifting module configured to lift a contrast of each single frame image;
the enhancement module is configured to enhance the image details of each single-frame image after the contrast is improved;
and the merging module is configured to merge each single-frame image after the image details are enhanced to obtain an enhanced video.
7. The apparatus of claim 6, wherein the lifting module is configured to transform each single frame image from a first color space to a second color space, and under the same conditions, the degree of lifting of the image contrast in the second color space is higher than the degree of lifting of the image contrast in the first color space; and in the second color space, the contrast of each single-frame image is improved according to preset parameters.
8. The apparatus of claim 7, wherein the second color space is an HSV color model.
9. The apparatus of claim 6, wherein the enhancement module is configured to decompose each single frame image after the contrast boosting into a high frequency part and a low frequency part; performing energy amplification on the high frequency part and averaging the low frequency part; and merging the amplified high-frequency part and the averaged low-frequency part belonging to the same frame to obtain each merged single-frame image.
10. The apparatus of claim 6, wherein the enhancement module is configured to enhance image details of each single frame image after the contrast lifting by using a wavelet fusion algorithm.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010134785.7A CN111225278A (en) | 2020-03-02 | 2020-03-02 | Method and device for enhancing video under low illumination |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010134785.7A CN111225278A (en) | 2020-03-02 | 2020-03-02 | Method and device for enhancing video under low illumination |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111225278A true CN111225278A (en) | 2020-06-02 |
Family
ID=70829900
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010134785.7A Pending CN111225278A (en) | 2020-03-02 | 2020-03-02 | Method and device for enhancing video under low illumination |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111225278A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2169943A2 (en) * | 2008-09-30 | 2010-03-31 | Intel Corporation | Joint enhancement of lightness, color and contrast of images and video |
| CN102014279A (en) * | 2010-12-20 | 2011-04-13 | 杭州华三通信技术有限公司 | Method and device for intensifying video image contrast |
| CN103593830A (en) * | 2013-11-29 | 2014-02-19 | 大连理工大学 | Low-light video image reinforcing method |
| CN105427257A (en) * | 2015-11-18 | 2016-03-23 | 四川汇源光通信有限公司 | Image enhancement method and apparatus |
| CN109118437A (en) * | 2018-06-27 | 2019-01-01 | 福建海图智能科技有限公司 | A kind of method, storage medium that can handle muddy water image in real time |
| CN110276729A (en) * | 2019-06-10 | 2019-09-24 | 浙江工业大学 | A kind of Enhancement Method of low-luminance color image |
-
2020
- 2020-03-02 CN CN202010134785.7A patent/CN111225278A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2169943A2 (en) * | 2008-09-30 | 2010-03-31 | Intel Corporation | Joint enhancement of lightness, color and contrast of images and video |
| CN103281544A (en) * | 2008-09-30 | 2013-09-04 | 英特尔公司 | Joint enhancement of lightness, color and contrast of images and video |
| CN102014279A (en) * | 2010-12-20 | 2011-04-13 | 杭州华三通信技术有限公司 | Method and device for intensifying video image contrast |
| CN103593830A (en) * | 2013-11-29 | 2014-02-19 | 大连理工大学 | Low-light video image reinforcing method |
| CN105427257A (en) * | 2015-11-18 | 2016-03-23 | 四川汇源光通信有限公司 | Image enhancement method and apparatus |
| CN109118437A (en) * | 2018-06-27 | 2019-01-01 | 福建海图智能科技有限公司 | A kind of method, storage medium that can handle muddy water image in real time |
| CN110276729A (en) * | 2019-06-10 | 2019-09-24 | 浙江工业大学 | A kind of Enhancement Method of low-luminance color image |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102523505B1 (en) | Method and Apparatus for Inverse Tone Mapping | |
| WO2018099136A1 (en) | Method and device for denoising image with low illumination, and storage medium | |
| US11700457B2 (en) | Flicker mitigation via image signal processing | |
| CN106412448B (en) | Wide dynamic range processing method and system based on single frame image | |
| CN111260580B (en) | Image denoising method, computer device and computer readable storage medium | |
| CN111784605B (en) | Image noise reduction method based on region guidance, computer device and computer readable storage medium | |
| KR101621614B1 (en) | Method and apparatus for enhancing digital image, and apparatus for image processing using the same | |
| US20210374925A1 (en) | Image Enhancement System and Method | |
| CN111429370A (en) | Method and system for enhancing images in coal mine and computer storage medium | |
| CN111340732B (en) | Low-illumination video image enhancement method and device | |
| CN113129236B (en) | Single low-light image enhancement method and system based on Retinex and convolutional neural network | |
| CN111899197B (en) | Image brightening and denoising method and device, mobile terminal and storage medium | |
| CN115619683B (en) | Image processing method, apparatus, device, storage medium, and computer program product | |
| CN110188640B (en) | Face recognition method, face recognition device, server and computer readable medium | |
| CN116309152A (en) | Detail enhancement method, system, equipment and storage medium for low-illumination image | |
| CN111311503A (en) | Night low-brightness image enhancement system | |
| CN115082350A (en) | Stroboscopic image processing method and device, electronic device and readable storage medium | |
| CN114998122A (en) | Low-illumination image enhancement method | |
| US9672447B2 (en) | Segmentation based image transform | |
| Sadia et al. | Color image enhancement using multiscale retinex with guided filter | |
| CN111225278A (en) | Method and device for enhancing video under low illumination | |
| CN112822343B (en) | Night video oriented sharpening method and storage medium | |
| CN116263942A (en) | Method for adjusting image contrast, storage medium and computer program product | |
| KR20150040559A (en) | Apparatus for Improving Image Quality and Computer-Readable Recording Medium with Program Therefor | |
| CN112419187A (en) | Image processing method, device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200602 |
|
| RJ01 | Rejection of invention patent application after publication |