CN111539902B - Image processing method, system, equipment and computer readable storage medium - Google Patents

Image processing method, system, equipment and computer readable storage medium Download PDF

Info

Publication number
CN111539902B
CN111539902B CN202010300217.XA CN202010300217A CN111539902B CN 111539902 B CN111539902 B CN 111539902B CN 202010300217 A CN202010300217 A CN 202010300217A CN 111539902 B CN111539902 B CN 111539902B
Authority
CN
China
Prior art keywords
image
target
detail
visible light
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010300217.XA
Other languages
Chinese (zh)
Other versions
CN111539902A (en
Inventor
李红领
齐亚鲁
李东婧
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Iray Technology Co Ltd
Original Assignee
Iray Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Iray Technology Co Ltd filed Critical Iray Technology Co Ltd
Priority to CN202010300217.XA priority Critical patent/CN111539902B/en
Publication of CN111539902A publication Critical patent/CN111539902A/en
Application granted granted Critical
Publication of CN111539902B publication Critical patent/CN111539902B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)

Abstract

The application discloses an image processing method, a system, equipment and a computer readable storage medium, which are used for acquiring a target visible light image and a target infrared image corresponding to a target scene; determining detail information of a target visible light image; determining detail gain of a target visible light image; and based on the detail gain, fusing the detail information and the target infrared image to obtain a fused image. According to the method and the device, after the target visible light image and the target infrared image are obtained, the detail information and the detail gain of the target visible light image are determined, and the detail information and the target infrared image are fused based on the detail gain, so that a fused image which is only fused by the detail information of the target visible light image and the target infrared image is obtained, the corresponding relation between infrared temperature information and a palette cannot be changed, the interpretation of the temperature information of the fused image cannot be influenced, and the fusion effect of the infrared image and the visible light image is improved.

Description

Image processing method, system, equipment and computer readable storage medium
Technical Field
The present application relates to the field of image processing technologies, and in particular, to an image processing method, system, device, and computer readable storage medium.
Background
With the development of image processing technology, in the process of taking an image of a target scene, in order to make the image reflect information of the target scene in a diversified manner, the taken image can be processed by adopting an image fusion method, i.e. image information of different detectors is combined and displayed.
Because the infrared image can provide the temperature information of the scene, and the visible light image has rich scene details, the infrared image and the visible light image of the target scene can be fused to obtain a fused image fusing the temperature information and the visible light information of the target scene, and a user can conveniently and accurately position the specific position of an object with a specific temperature more easily.
However, in the process of fusing the infrared image and the visible light image, the corresponding relationship between the infrared temperature information and the color palette can be changed, and the interpretation of the temperature information of the fused image can be influenced, so that the image fusion effect is poor.
In summary, how to improve the fusion effect of the infrared image and the visible light image is a problem to be urgently solved by those skilled in the art.
Disclosure of Invention
The application aims to provide an image processing method which can solve the technical problem of improving the fusion effect of an infrared image and a visible light image to a certain extent. The application also provides an image processing system, an image processing device and a computer readable storage medium.
In order to achieve the above purpose, the present application provides the following technical solutions:
an image processing method, comprising:
acquiring a target visible light image and a target infrared image corresponding to a target scene;
determining detail information of the target visible light image;
determining a detail gain of the target visible light image;
and based on the detail gain, fusing the detail information and the target infrared image to obtain a fused image.
Preferably, the fusing the detail information with the target infrared image based on the detail gain to obtain a fused image includes:
acquiring adjustment information input by a user;
and fusing the detail information and the target infrared image based on the detail gain and the adjusting information to obtain the fused image.
Preferably, the determining the detail information of the target visible light image includes:
extracting the target visible light image on a preset image channel to obtain an extracted image;
carrying out low-pass filtering on the extracted image to obtain a filtered image;
determining the detail information based on the extracted image and the filtered image.
Preferably, the determining the detail information based on the extracted image and the filtered image includes:
dividing the pixel points at the corresponding positions of the extracted image and the filtered image to obtain a quotient image;
and taking the difference value between the quotient image and 1 as the detail information.
Preferably, the determining the detail gain of the target visible light image includes:
calculating the detail intensity of the target visible light image based on the extracted image;
and taking the reciprocal of the detail intensity as the detail gain.
Preferably, the calculating the detail gain of the target visible light image based on the extracted image includes:
calculating the detail gain based on the extracted image according to the definition that the detail intensity of the pixel point is the variance or standard deviation of the pixel value in the preset range; the preset range is a range containing the pixel points.
Preferably, the calculating the detail gain of the target visible light image based on the extracted image includes:
calculating the detail gain based on the extracted image according to the definition that the detail intensity of the pixel point meets the preset relation with the preset difference value;
the preset difference value is the difference value between a pixel value and a central point in a preset range, or the difference value between the pixel value and a mean value in the preset range, and the mean value is the mean value of the pixel values in the preset unit; the preset range is a range containing the pixel points.
Preferably, after the taking the inverse of the detail intensity as the detail gain, the method further includes:
and judging whether the value of the detail gain is larger than a preset threshold value, if so, adjusting the value of the detail gain to be 0, and if not, keeping the value of the detail gain unchanged.
Preferably, the acquiring a target visible light image and a target infrared image corresponding to a target scene includes:
acquiring an initial visible light image and an initial infrared image corresponding to the target scene;
adjusting the initial visible light image to the target visible light image based on preset information, the initial visible light image and the initial infrared image;
adjusting the initial infrared image to be the target infrared image based on preset information, the initial visible light image and the initial infrared image;
the preset information comprises field angle information, resolution information and relative position information of an infrared system and a visible light system; and the image size difference value of the target visible light image and the target infrared image is within a first preset range, and the resolution difference value of the target visible light image and the target infrared image is within a second preset range.
An image processing system comprising:
the first acquisition module is used for acquiring a target visible light image and a target infrared image corresponding to a target scene;
the first determining module is used for determining detail information of the target visible light image;
a second determining module, configured to determine a detail gain of the target visible light image;
and the first fusion module is used for fusing the detail information and the target infrared image based on the detail gain to obtain a fusion image.
An image processing apparatus comprising:
a memory for storing a computer program;
a processor for implementing the steps of the image processing method as described in any one of the above when the computer program is executed.
A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the image processing method as set forth in any one of the preceding claims.
According to the image processing method, a target visible light image and a target infrared image corresponding to a target scene are obtained; determining detail information of the target visible light image; determining detail gain of the target visible light image; and based on the detail gain, fusing the detail information and the target infrared image to obtain a fused image. According to the method and the device, after the target visible light image and the target infrared image are obtained, the detail information and the detail gain of the target visible light image are determined, and the detail information and the target infrared image are fused based on the detail gain, so that a fused image which is only fused by the detail information of the target visible light image and the target infrared image is obtained, the corresponding relation between infrared temperature information and a palette cannot be changed, the interpretation of the temperature information of the fused image cannot be influenced, and the fusion effect of the infrared image and the visible light image is improved. The image processing system, the image processing device and the computer readable storage medium solve the corresponding technical problems.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the embodiments or the prior art descriptions will be briefly described below, it is obvious that the drawings in the following description are only the embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a first flowchart of an image processing method according to an embodiment of the present application;
fig. 2 is a second flowchart of an image processing method according to an embodiment of the present application;
fig. 3 is a third flowchart of an image processing method according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of an image processing system according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application;
fig. 6 is another schematic structural diagram of an image processing apparatus according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
With the development of image processing technology, in the process of taking an image of a target scene, in order to make the image reflect information of the target scene in a diversified manner, the taken image can be processed by adopting an image fusion method, i.e. image information of different detectors is combined and displayed. Because the infrared image can provide the temperature information of the scene, and the visible light image has rich scene details, the infrared image and the visible light image of the target scene can be fused to obtain a fused image fusing the temperature information and the visible light information of the target scene, and a user can conveniently and accurately position the specific position of an object with a specific temperature more easily. However, in the process of fusing the infrared image and the visible light image in the prior art, the temperature data and the color or brightness data of the visible light are fused, so that the corresponding relationship between the infrared temperature information and the color palette is changed, and the interpretation of the temperature information of the fused image is influenced, so that the image fusion effect is poor. The image processing method provided by the application can improve the fusion effect of the infrared image and the visible light image.
Referring to fig. 1, fig. 1 is a first flowchart of an image processing method according to an embodiment of the present disclosure.
An image processing method provided by the embodiment of the application may include the following steps:
step S101: and acquiring a target visible light image and a target infrared image corresponding to the target scene.
In practical application, a target visible light image and a target infrared image corresponding to a target scene may be obtained first, the target visible light image refers to an image obtained by shooting the target scene through a visible light system, the target infrared image refers to an image obtained by shooting the target scene through an infrared system, and the target scene may be determined according to actual needs, which is not specifically limited herein.
Step S102: and determining the detail information of the target visible light image.
In practical application, after a target visible light image and a target infrared image are obtained, the detail information of the target visible light image can be determined; the detail information refers to the texture of the image, the edge contour information of the object in the image, and the place where the color change exists in the image.
Step S103: the detail gain of the target visible light image is determined.
In practical application, after the detail information is determined, the detail gain of the target visible light image can be determined; the detail gain is used for balancing the strength of the details, so that the situation that the details are strong is avoided from being strong, the situation that the details are weak is avoided, and the details are uniform and fine.
Step S104: and based on the detail gain, fusing the detail information and the target infrared image to obtain a fused image.
In practical application, the detail gain is used for balancing the strength of the details, so that the situation that the details are strong is avoided, the situation that the details are weak is avoided, and the details are uniform and fine, so that after the detail gain is determined, the detail information and the target infrared image can be fused based on the detail gain to obtain a fused image, and the detail information of the target visible light image can be uniformly and finely fused with the target infrared image.
It should be noted that the type of the fused image may be determined by the type of the target infrared image, for example, when the target infrared image is a grayscale image, the fused image is a grayscale image with visible light detail enhancement; when the target infrared image is a three-channel color image after pseudo-color enhancement, the fused image is a color image with visible light detail enhancement.
The image processing method comprises the steps of obtaining a target visible light image and a target infrared image corresponding to a target scene; determining detail information of the target visible light image; determining detail gain of the target visible light image; and based on the detail gain, fusing the detail information and the target infrared image to obtain a fused image. According to the method and the device, after the target visible light image and the target infrared image are obtained, the detail information and the detail gain of the target visible light image are determined, and the detail information and the target infrared image are fused based on the detail gain, so that the fused image which is only fused by the detail information of the target visible light image and the target infrared image is obtained, the corresponding relation between the infrared temperature information and the color palette cannot be changed, the interpretation of the temperature information of the fused image cannot be influenced, and the fusion effect of the infrared image and the visible light image is improved.
Referring to fig. 2, fig. 2 is a second flowchart of an image processing method according to an embodiment of the present disclosure.
An image processing method provided by the embodiment of the application may include the following steps:
step S201: and acquiring a target visible light image and a target infrared image corresponding to the target scene.
Step S202: and extracting the target visible light image on a preset image channel to obtain an extracted image.
In practical application, since the target visible light image is a color image of three channels, and the detail information can be extracted in one of the image channels, such as a green channel, or in three image channels, when the detail information of the target visible light image is determined, the target visible light image can be extracted in a preset image channel to obtain an extracted image. Of course, the extracted image may be extracted from the luminance component of the target visible light image.
It should be noted that if the extracted image is from a single channel of the target visible light image, the obtained detail information is also in a single channel, and at this time, the detail information may be directly fused with the target infrared image, or the detail information may be respectively superimposed on three components of the target infrared image; correspondingly, when the extracted image comes from three channels of the target visible light image, the detail information is also three channels, and at the moment, the detail information can be directly fused with the target infrared image, or the average value of the three channels of the detail information can be obtained and fused with the target infrared image.
Step S203: and carrying out low-pass filtering on the extracted image to obtain a filtered image.
In practical application, in order to determine the detail information conveniently, after the extracted image is obtained, low-pass filtering can be performed on the extracted image to obtain a filtered image, and since the filtered image after the low-pass filtering is obviously different from the extracted image in the position of the image detail, the detail information can be determined by extracting the image and the filtered image subsequently.
It should be noted that the type of the low-pass filter used for performing the low-pass filtering may be determined according to actual needs, and may be, for example, an average filter, a gaussian filter, or the like, or a combination of these low-pass filters, or the like.
Step S204: detail information is determined based on the extracted image and the filtered image.
Step S205: and determining the detail gain of the target visible light image.
Step S206: and based on the detail gain, fusing the detail information and the target infrared image to obtain a fused image.
In practical application, the step of determining the detail information based on the extracted image and the filtered image may specifically be: dividing the pixel points at the corresponding positions of the extracted image and the filtered image to obtain a quotient image; and taking the difference value of the quotient image and 1 as detail information.
Since the pixel points at the corresponding positions of the extracted image and the filtered image are divided to obtain a quotient image, and the difference value between the quotient image and 1 is used as detail information, in the process, the difference value is almost equal before and after the filtering where no color or brightness change exists in the image, is equal to 1 after division, and is equal to 0 after subtraction of 1; the edge part of an object in the image has difference before and after filtering, is not equal to 1 after division, and is not equal to 0 after subtraction of 1; therefore, a value of 0 for the detail information indicates that there is no detail information, and a value of 0 for the detail information indicates that there is detail information.
In a specific application scenario, the detailed information may be obtained through calculation of a formula VLdetail = VL/VL _ lp-1, or a formula VLdetail = VL _ lp/VL-1, or a formula VLdetail =1-VL _ lp/VL, or a formula VLdetail =1-VL/VL _ lp; where VLdetail represents detail information, VL represents an extracted image, and VL _ lp represents a filtered image.
Referring to fig. 3, fig. 3 is a third flowchart of an image processing method according to an embodiment of the present disclosure.
An image processing method provided in an embodiment of the present application may include the following steps:
step S301: and acquiring a target visible light image and a target infrared image corresponding to the target scene.
Step S302: and extracting the target visible light image on a preset image channel to obtain an extracted image.
Step S303: and carrying out low-pass filtering on the extracted image to obtain a filtered image.
Step S304: detail information is determined based on the extracted image and the filtered image.
Step S305: and calculating the detail intensity of the target visible light image based on the extracted image.
Step S306: the reciprocal of the detail intensity is taken as the detail gain.
In practical applications, the detail intensity is a definition degree of an edge of an object in an image, and the detail intensity value is large if the edge of the object in the image is clear, and is small if the edge of the object in the image is not clear, so that the process of determining the detail gain of the target visible light image to facilitate determining the detail gain may specifically be: calculating the detail intensity of the target visible light image based on the extracted image; the reciprocal of the detail intensity is taken as the detail gain.
It should be noted that, since the reciprocal of the detail strength is used as the detail gain, the detail gain is inversely related to the detail strength, and therefore, the detail gain can balance the strength of the detail, so that the places with strong detail are not stronger, and the places with weak detail are not weaker, and finally, the detail is more uniform and finer.
Step S307: and based on the detail gain, fusing the detail information and the target infrared image to obtain a fused image.
In practical application, the step of calculating the detail gain of the target visible light image based on the extracted image may specifically be: calculating detail gain based on the extracted image according to the definition that the detail intensity of the pixel point is the variance or standard deviation of the pixel value in the preset range; the preset range is a range including pixel points. The size of the preset range may be determined according to actual needs, for example, the preset range is a 5X5 area, a 3X3 area, and the like, and the preset range may be an area with a pixel point as a center point.
In practical application, the step of calculating the detail gain of the target visible light image based on the extracted image may specifically be: calculating detail gain based on the extracted image according to the definition that the detail intensity of the pixel point and the preset difference value meet the preset relation; the preset difference value is the difference value between a pixel value and a central point in a preset range, or the difference value between the pixel value and a mean value in the preset range, and the mean value is the mean value of the pixel values in a preset unit; the preset range is a range including pixel points.
In a specific application scenario, assuming that the preset range is a 5X5 region, when the detail intensity of a pixel point is defined as the variance of a pixel value within the preset range, a formula may be used
Figure BDA0002453706150000081
Calculating the detail strength; when the detail intensity of the pixel point is defined by the variance of the pixel value in the preset range, the pixel value can be determined by a formula>
Figure BDA0002453706150000082
Calculating to obtain detail intensity; when the detail intensity of the pixel point and the preset difference value meet the definition of the preset relation, and the preset difference value is the difference value between the pixel value and the central point in the preset range, the formula can be used
Figure BDA0002453706150000083
Calculating the detail intensity and the like. Wherein +>
Figure BDA0002453706150000091
S (m, n) represents the detail intensity of the pixel point with the coordinate (m, n); sigma 1 And σ 2 Representing an adjustable variable; sigma 2 Associated with the preset range, which may be a third of the radius of the preset range; sigma 1 May be gray scale maximumFunction of the difference between large and grey minimum values, e.g. sigma 1 ＝(gray max -gray min )/N，gray max Representing the maximum value of the gray min Representing the minimum value of the gray scale, the value of N can be determined as desired, such as 16, etc. Correspondingly, by simultaneously->
Figure BDA0002453706150000092
And calculating to obtain detail gains, wherein G (m, n) represents the detail gains of the pixel points with the coordinates (m, n).
In the image processing method provided by the embodiment of the application, for a uniform region in an image, the detail intensity is close to 0, the detail gain is infinite, and accordingly, noise of the uniform region can be infinitely amplified, so that in order to avoid amplifying the noise of the uniform region, the detail gain of the uniform region in the image can be set to 0, and the uniform region in the image has almost no detail information, and therefore, enhancement is not needed, and therefore, after the reciprocal of the detail intensity is taken as the detail gain, whether the value of the detail gain is greater than a preset threshold value can be judged, if yes, the value of the detail gain is adjusted to 0, and if not, the value of the detail gain is kept unchanged.
In the image processing method provided by the embodiment of the application, in the process of image fusion by a user, the user may need to control the fusion process of the target visible light image and the target infrared image according to the user's own needs, and then based on the detail gain, the detail information and the target infrared image are fused to obtain the process of the fusion image, and the process may be as follows: acquiring adjustment information input by a user; and fusing the detail information and the target infrared image based on the detail gain and the adjustment information to obtain a fused image. Assuming that the adjustment information input by the user is represented by D, the fused Image may be obtained by the formula Image _ fusion = D × G × VL _ detail + IR, where Image _ fusion represents the fused Image and IR represents the target infrared Image.
In the image processing method provided in the embodiment of the present application, the step of obtaining the target visible light image and the target infrared image corresponding to the target scene may specifically be: acquiring an initial visible light image and an initial infrared image corresponding to a target scene; adjusting the initial visible light image into a target visible light image based on preset information, the initial visible light image and the initial infrared image; adjusting the initial infrared image into a target infrared image based on preset information, the initial visible light image and the initial infrared image; the preset information comprises field angle information, resolution information and relative position information of an infrared system and a visible light system; and the image size difference value of the target visible light image and the target infrared image is within a first preset range, and the resolution difference value of the target visible light image and the target infrared image is within a second preset range.
In a specific application scene, the size difference and the resolution difference between the initial visible light image and the initial infrared image can be directly adjusted to a first preset range and a second preset range respectively, and the initial visible light image and the initial infrared image can also be adjusted by means of a third-party image.
Referring to fig. 4, fig. 4 is a schematic structural diagram of an image processing system according to an embodiment of the present disclosure.
An image processing system provided in an embodiment of the present application may include:
a first obtaining module 101, configured to obtain a target visible light image and a target infrared image corresponding to a target scene;
a first determining module 102, configured to determine detail information of a target visible light image;
a second determining module 103, configured to determine a detail gain of the target visible light image;
and a first fusion module 104, configured to fuse the detail information with the target infrared image based on the detail gain to obtain a fusion image.
In an image processing system provided in an embodiment of the present application, the first fusion module may include:
the first acquisition submodule is used for acquiring the adjustment information input by a user;
and the first fusion submodule is used for fusing the detail information and the target infrared image based on the detail gain and the adjustment information to obtain a fusion image.
In an image processing system provided in an embodiment of the present application, the first determining module may include:
the first extraction submodule is used for extracting the target visible light image on a preset image channel to obtain an extracted image;
the first filtering submodule is used for carrying out low-pass filtering on the extracted image to obtain a filtered image;
a first determining sub-module for determining detail information based on the extracted image and the filtered image.
In an image processing system provided by an embodiment of the present application, the first determining sub-module may include:
the first calculation unit is used for dividing the pixel points at the corresponding positions of the extracted image and the filtered image to obtain a quotient image;
and the first setting unit is used for taking the difference value between the quotient image and 1 as detail information.
In an image processing system provided by an embodiment of the present application, the second determining module may include:
the first calculation submodule is used for calculating the detail intensity of the target visible light image based on the extracted image;
and the first setting submodule is used for taking the reciprocal of the detail intensity as the detail gain.
In an image processing system provided in an embodiment of the present application, the first computing sub-module may include:
the second calculation unit is used for calculating detail gain based on the extracted image according to the definition that the detail intensity of the pixel point is the variance or standard deviation of the pixel value within the preset range; the preset range is a range including pixel points.
In an image processing system provided in an embodiment of the present application, the first computing sub-module may include:
the third calculating unit is used for calculating detail gain based on the extracted image according to the definition that the detail intensity of the pixel point meets the preset relation with the preset difference value;
the preset difference value is a difference value between a pixel value and a central point in a preset range, or a difference value between a pixel value and a mean value in the preset range, and the mean value is a mean value of the pixel values in a preset unit; the preset range is a range including pixel points.
An image processing system provided in an embodiment of the present application may further include:
and the first judgment sub-module is used for judging whether the value of the detail gain is greater than a preset threshold value after the first setting sub-module takes the reciprocal of the detail intensity as the detail gain, if so, the value of the detail gain is adjusted to be 0, and if not, the value of the detail gain is kept unchanged.
In an image processing system provided in an embodiment of the present application, the first obtaining sub-module may include:
the device comprises a first acquisition unit, a second acquisition unit and a third acquisition unit, wherein the first acquisition unit is used for acquiring an initial visible light image and an initial infrared image corresponding to a target scene;
the first adjusting unit is used for adjusting the initial visible light image into a target visible light image based on preset information, the initial visible light image and the initial infrared image;
the second adjusting unit is used for adjusting the initial infrared image into a target infrared image based on the preset information, the initial visible light image and the initial infrared image;
the preset information comprises field angle information, resolution information and relative position information of an infrared system and a visible light system; and the image size difference value of the target visible light image and the target infrared image is within a first preset range, and the resolution difference value of the target visible light image and the target infrared image is within a second preset range.
The application also provides an image processing device and a computer readable storage medium, which have the corresponding effects of the image processing method provided by the embodiment of the application. Referring to fig. 5, fig. 5 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present disclosure.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program:
acquiring a target visible light image and a target infrared image corresponding to a target scene;
determining detail information of a target visible light image;
determining detail gain of a target visible light image;
and based on the detail gain, fusing the detail information and the target infrared image to obtain a fused image.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: acquiring adjustment information input by a user; and fusing the detail information and the target infrared image based on the detail gain and the adjustment information to obtain a fused image.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: extracting the target visible light image on a preset image channel to obtain an extracted image; carrying out low-pass filtering on the extracted image to obtain a filtered image; detail information is determined based on the extracted image and the filtered image.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: dividing the pixel points at the corresponding positions of the extracted image and the filtered image to obtain a quotient image; and taking the difference value of the quotient image and 1 as detail information.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: calculating the detail intensity of the target visible light image based on the extracted image; the reciprocal of the detail intensity is taken as the detail gain.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: calculating detail gain based on the extracted image according to the definition that the detail intensity of the pixel point is the variance or standard deviation of the pixel value in the preset range; the preset range is a range including pixel points.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: calculating a detail gain based on the extracted image according to the definition that the detail intensity of the pixel point meets a preset relation with a preset difference value; the preset difference value is the difference value between a pixel value and a central point in a preset range, or the difference value between the pixel value and a mean value in the preset range, and the mean value is the mean value of the pixel values in a preset unit; the preset range is a range including pixel points.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: and after the reciprocal of the detail intensity is taken as the detail gain, judging whether the value of the detail gain is larger than a preset threshold value, if so, adjusting the value of the detail gain to be 0, and if not, keeping the value of the detail gain unchanged.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: acquiring an initial visible light image and an initial infrared image corresponding to a target scene; adjusting the initial visible light image into a target visible light image based on preset information, the initial visible light image and the initial infrared image; adjusting the initial infrared image into a target infrared image based on preset information, the initial visible light image and the initial infrared image; the preset information comprises field angle information, resolution information and relative position information of an infrared system and a visible light system; and the image size difference value of the target visible light image and the target infrared image is within a first preset range, and the resolution difference value of the target visible light image and the target infrared image is within a second preset range.
Referring to fig. 6, another image processing apparatus provided in the embodiment of the present application may further include: an input port 203 connected to the processor 202, for transmitting externally input commands to the processor 202; a display unit 204 connected to the processor 202, for displaying the processing result of the processor 202 to the outside; and the communication module 205 is connected with the processor 202 and is used for realizing the communication between the image processing device and the outside. The display unit 204 may be a display panel, a laser scanning display, or the like; the communication method adopted by the communication module 205 includes, but is not limited to, mobile high definition link technology (HML), universal Serial Bus (USB), high Definition Multimedia Interface (HDMI), and wireless connection: wireless fidelity technology (WiFi), bluetooth communication technology, bluetooth low energy communication technology, ieee802.11s based communication technology.
A computer-readable storage medium provided in an embodiment of the present application stores a computer program, and when executed by a processor, the computer program implements the following steps:
acquiring a target visible light image and a target infrared image corresponding to a target scene;
determining detail information of a target visible light image;
determining detail gain of a target visible light image;
and based on the detail gain, fusing the detail information and the target infrared image to obtain a fused image.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: acquiring adjustment information input by a user; and fusing the detail information and the target infrared image based on the detail gain and the adjustment information to obtain a fused image.
A computer-readable storage medium provided in an embodiment of the present application stores a computer program, and when executed by a processor, the computer program implements the following steps: extracting the target visible light image on a preset image channel to obtain an extracted image; performing low-pass filtering on the extracted image to obtain a filtered image; detail information is determined based on the extracted image and the filtered image.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: dividing the pixel points at the corresponding positions of the extracted image and the filtered image to obtain a quotient image; and taking the difference value of the quotient image and 1 as detail information.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: calculating the detail intensity of the target visible light image based on the extracted image; the reciprocal of the detail intensity is taken as the detail gain.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: calculating detail gain based on the extracted image according to the definition that the detail intensity of the pixel point is the variance or standard deviation of the pixel value in the preset range; the preset range is a range including pixel points.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: calculating a detail gain based on the extracted image according to the definition that the detail intensity of the pixel point meets a preset relation with a preset difference value; the preset difference value is a difference value between a pixel value and a central point in a preset range, or a difference value between a pixel value and a mean value in the preset range, and the mean value is a mean value of the pixel values in a preset unit; the preset range is a range including pixel points.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: and after the reciprocal of the detail intensity is taken as the detail gain, judging whether the value of the detail gain is larger than a preset threshold value, if so, adjusting the value of the detail gain to be 0, and if not, keeping the value of the detail gain unchanged.
A computer-readable storage medium provided in an embodiment of the present application stores a computer program, and when executed by a processor, the computer program implements the following steps: acquiring an initial visible light image and an initial infrared image corresponding to a target scene; adjusting the initial visible light image into a target visible light image based on preset information, the initial visible light image and the initial infrared image; adjusting the initial infrared image to be a target infrared image based on preset information, the initial visible light image and the initial infrared image; the preset information comprises field angle information, resolution information and relative position information of an infrared system and a visible light system; and the image size difference value of the target visible light image and the target infrared image is within a first preset range, and the resolution difference value of the target visible light image and the target infrared image is within a second preset range.
The computer-readable storage media to which the present application relates include Random Access Memory (RAM), memory, read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage media known in the art.
For a description of a relevant part in the image processing system, the image processing apparatus, and the computer-readable storage medium provided in the embodiments of the present application, reference is made to detailed descriptions of a corresponding part in the image processing method provided in the embodiments of the present application, and details are not repeated here. In addition, parts of the technical solutions provided in the embodiments of the present application that are consistent with implementation principles of corresponding technical solutions in the prior art are not described in detail, so as to avoid redundant description.
It is further noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising a," "8230," "8230," or "comprising" does not exclude the presence of additional like elements in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (8)

1. An image processing method, comprising:
acquiring a target visible light image and a target infrared image corresponding to a target scene;
determining detail information of the target visible light image;
determining a detail gain of the target visible light image;
based on the detail gain, fusing the detail information and the target infrared image to obtain a fused image;
the target infrared image is an image obtained after the target scene is shot through an infrared system;
the fusing the detail information and the target infrared image based on the detail gain to obtain a fused image, comprising:
acquiring adjustment information input by a user;
based on the detail gain and the adjustment information, fusing the detail information and the target infrared image to obtain a fused image;
the determining the detail information of the target visible light image comprises:
extracting the target visible light image on a preset image channel to obtain an extracted image;
performing low-pass filtering on the extracted image to obtain a filtered image;
determining the detail information based on the extracted image and the filtered image;
the determining the detail information based on the extracted image and the filtered image comprises:
dividing the pixel points at the corresponding positions of the extracted image and the filtered image to obtain a quotient image;
taking the difference value between the quotient image and 1 as the detail information;
the determining the detail gain of the target visible light image comprises:
calculating the detail intensity of the target visible light image based on the extracted image;
and taking the reciprocal of the detail intensity as the detail gain.
2. The method of claim 1, wherein the calculating a detail gain for the target visible light image based on the extracted image comprises:
calculating the detail gain based on the extracted image according to the definition that the detail intensity of the pixel point is the variance or standard deviation of the pixel value in the preset range; the preset range is a range containing the pixel points.
3. The method of claim 1, wherein the calculating a detail gain for the target visible light image based on the extracted image comprises:
calculating the detail gain based on the extracted image according to the definition that the detail intensity of the pixel point and a preset difference value meet a preset relation;
the preset difference value is the difference value between a pixel value and a central point in a preset range, or the difference value between the pixel value and a mean value in the preset range, and the mean value is the mean value of the pixel values in the preset unit; the preset range is a range containing the pixel points.
4. The method of claim 1, wherein the taking the inverse of the detail intensity as the detail gain further comprises:
and judging whether the value of the detail gain is larger than a preset threshold value, if so, adjusting the value of the detail gain to be 0, and if not, keeping the value of the detail gain unchanged.
5. The method of any one of claims 1 to 4, wherein the acquiring a target visible light image and a target infrared image corresponding to a target scene comprises:
acquiring an initial visible light image and an initial infrared image corresponding to the target scene;
adjusting the initial visible light image to the target visible light image based on preset information, the initial visible light image and the initial infrared image;
adjusting the initial infrared image to be the target infrared image based on preset information, the initial visible light image and the initial infrared image;
the preset information comprises field angle information, resolution information and relative position information of an infrared system and a visible light system; and the image size difference value of the target visible light image and the target infrared image is within a first preset range, and the resolution difference value of the target visible light image and the target infrared image is within a second preset range.
6. An image processing system, comprising:
the first acquisition module is used for acquiring a target visible light image and a target infrared image corresponding to a target scene; the target infrared image is an image obtained after the target scene is shot through an infrared system;
the first determining module is used for determining detail information of the target visible light image;
a second determining module, configured to determine a detail gain of the target visible light image;
the first fusion module is used for acquiring the adjustment information input by the user; based on the detail gain and the adjustment information, fusing the detail information and the target infrared image to obtain a fused image;
the first determining module is specifically configured to extract the target visible light image on a preset image channel to obtain an extracted image; carrying out low-pass filtering on the extracted image to obtain a filtered image; dividing the pixel points at the corresponding positions of the extracted image and the filtered image to obtain a quotient image; taking the difference value between the quotient image and 1 as the detail information;
the second determining module is specifically configured to calculate a detail intensity of the target visible light image based on the extracted image; and taking the reciprocal of the detail intensity as the detail gain.
7. An image processing apparatus characterized by comprising:
a memory for storing a computer program;
a processor for implementing the steps of the image processing method according to any one of claims 1 to 5 when executing the computer program.
8. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of an image processing method according to any one of claims 1 to 5.
CN202010300217.XA 2020-04-16 2020-04-16 Image processing method, system, equipment and computer readable storage medium Active CN111539902B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010300217.XA CN111539902B (en) 2020-04-16 2020-04-16 Image processing method, system, equipment and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010300217.XA CN111539902B (en) 2020-04-16 2020-04-16 Image processing method, system, equipment and computer readable storage medium

Publications (2)

Publication Number Publication Date
CN111539902A CN111539902A (en) 2020-08-14
CN111539902B true CN111539902B (en) 2023-03-28

Family

ID=71979953

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010300217.XA Active CN111539902B (en) 2020-04-16 2020-04-16 Image processing method, system, equipment and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN111539902B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111968068A (en) * 2020-08-18 2020-11-20 杭州海康微影传感科技有限公司 Thermal imaging image processing method and device
CN112767291B (en) * 2021-01-04 2024-05-28 浙江华感科技有限公司 Visible light image and infrared image fusion method, device and readable storage medium
CN113284128B (en) * 2021-06-11 2023-05-16 中国南方电网有限责任公司超高压输电公司天生桥局 Image fusion display method and device based on power equipment and computer equipment
CN113610738A (en) * 2021-08-06 2021-11-05 烟台艾睿光电科技有限公司 Image processing method, device, equipment and computer readable storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106960428A (en) * 2016-01-12 2017-07-18 浙江大立科技股份有限公司 Visible ray and infrared double-waveband image co-registration Enhancement Method
CN107194906A (en) * 2017-05-22 2017-09-22 阜阳师范学院 A kind of image processing method merged based on warp wavelet and system
CN110047059A (en) * 2019-04-10 2019-07-23 北京旷视科技有限公司 Image processing method, device, electronic equipment and readable storage medium storing program for executing
CN110136183A (en) * 2018-02-09 2019-08-16 华为技术有限公司 A kind of method and relevant device of image procossing
CN110930311A (en) * 2018-09-19 2020-03-27 杭州萤石软件有限公司 Method and device for improving signal-to-noise ratio of infrared image and visible light image fusion

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105069768B (en) * 2015-08-05 2017-12-29 武汉高德红外股份有限公司 A kind of visible images and infrared image fusion processing system and fusion method
CN107784642B (en) * 2016-08-26 2019-01-29 北京航空航天大学 A kind of infrared video and visible light video method for self-adaption amalgamation
CN108765358A (en) * 2018-05-22 2018-11-06 烟台艾睿光电科技有限公司 The double light fusion methods and plug-in type thermal imager system of visible light and infrared light
CN110223265B (en) * 2019-05-05 2021-05-28 中国地质大学（武汉） Image fusion method and system with obvious target based on multi-scale transformation decomposition
CN110189286B (en) * 2019-05-30 2022-10-04 兰州交通大学 Infrared and visible light image fusion method based on ResNet
CN110415202B (en) * 2019-07-31 2022-04-12 浙江大华技术股份有限公司 Image fusion method and device, electronic equipment and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106960428A (en) * 2016-01-12 2017-07-18 浙江大立科技股份有限公司 Visible ray and infrared double-waveband image co-registration Enhancement Method
CN107194906A (en) * 2017-05-22 2017-09-22 阜阳师范学院 A kind of image processing method merged based on warp wavelet and system
CN110136183A (en) * 2018-02-09 2019-08-16 华为技术有限公司 A kind of method and relevant device of image procossing
CN110930311A (en) * 2018-09-19 2020-03-27 杭州萤石软件有限公司 Method and device for improving signal-to-noise ratio of infrared image and visible light image fusion
CN110047059A (en) * 2019-04-10 2019-07-23 北京旷视科技有限公司 Image processing method, device, electronic equipment and readable storage medium storing program for executing

Also Published As

Publication number Publication date
CN111539902A (en) 2020-08-14

Similar Documents

Publication Publication Date Title
CN111539902B (en) Image processing method, system, equipment and computer readable storage medium
CN109272459B (en) Image processing method, image processing device, storage medium and electronic equipment
CN109146814B (en) Image processing method, image processing device, storage medium and electronic equipment
CN109191395B (en) Image contrast enhancement method, device, equipment and storage medium
US11006045B2 (en) Electronic device for adjusting image including multiple objects and control method thereof
CN109741281B (en) Image processing method, image processing device, storage medium and terminal
CN107403421B (en) Image defogging method, storage medium and terminal equipment
CN111107333B (en) Brightness correction method, system, equipment and computer readable storage medium
CN109727215B (en) Image processing method, device, terminal equipment and storage medium
CN109727216B (en) Image processing method, device, terminal equipment and storage medium
KR20160036662A (en) System and method of correcting image artifacts
CN108063928B (en) A kind of image automatic adjusting method, device and the electronic equipment of projector
CN105608716B (en) Information processing method and electronic equipment
CN112218065B (en) Image white balance method, system, terminal device and storage medium
CN111192205A (en) Image defogging method and system and computer readable storage medium
US20220360707A1 (en) Photographing method, photographing device, storage medium and electronic device
CN111626967A (en) Image enhancement method, image enhancement device, computer device and readable storage medium
US20230259264A1 (en) Method for providing filter and electronic device supporting the same
CN110648296A (en) Pupil color correction method, correction device, terminal device and storage medium
CN111368587A (en) Scene detection method and device, terminal equipment and computer readable storage medium
US9319666B1 (en) Detecting control points for camera calibration
CN112446830A (en) Image color edge processing method and device, storage medium and electronic equipment
CN110738712B (en) Geometric pattern reconstruction method, device, equipment and storage medium
CN111861965B (en) Image backlight detection method, image backlight detection device and terminal equipment
CN108805883B (en) Image segmentation method, image segmentation device and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
EE01 Entry into force of recordation of patent licensing contract
EE01 Entry into force of recordation of patent licensing contract

Application publication date: 20200814

Assignee: INFIRAY TECHNOLOGIES CO.,LTD.

Assignor: Yantai Airui Photo-Electric Technology Co.,Ltd.

Contract record no.: X2024980006380

Denomination of invention: An image processing method, system, device, and computer-readable storage medium

Granted publication date: 20230328

License type: Common License

Record date: 20240530