CN110542482B - Blind pixel detection method and device and electronic equipment - Google Patents

Blind pixel detection method and device and electronic equipment Download PDF

Info

Publication number
CN110542482B
CN110542482B CN201810531030.3A CN201810531030A CN110542482B CN 110542482 B CN110542482 B CN 110542482B CN 201810531030 A CN201810531030 A CN 201810531030A CN 110542482 B CN110542482 B CN 110542482B
Authority
CN
China
Prior art keywords
pixel
difference image
image
target
focal plane
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810531030.3A
Other languages
Chinese (zh)
Other versions
CN110542482A (en
Inventor
马甲迎
唐杰
谢浩山
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Hikmicro Sensing Technology Co Ltd
Original Assignee
Hangzhou Hikmicro Sensing Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Hikmicro Sensing Technology Co Ltd filed Critical Hangzhou Hikmicro Sensing Technology Co Ltd
Priority to CN201810531030.3A priority Critical patent/CN110542482B/en
Publication of CN110542482A publication Critical patent/CN110542482A/en
Application granted granted Critical
Publication of CN110542482B publication Critical patent/CN110542482B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/52—Radiation pyrometry, e.g. infrared or optical thermometry using comparison with reference sources, e.g. disappearing-filament pyrometer

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Studio Devices (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Image Processing (AREA)

Abstract

The embodiment of the application provides a blind pixel detection method, a blind pixel detection device and electronic equipment. The method comprises the following steps: obtaining a plurality of frames of target images about the auxiliary object; wherein, any frame of target image is: under a preset environment temperature, images which are induced by an infrared focal plane array in the infrared thermal imaging equipment and are related to the auxiliary object, and different frames of target images correspond to different preset environment temperatures; calculating at least one frame of difference image corresponding to the multiple frames of target images, wherein any frame of difference image is an image obtained by subtracting two frames of target images; and for each frame of difference image, determining blind pixels in the infrared focal plane array based on the difference image and pixel values corresponding to each pixel element in the infrared focal plane array and related to the difference image. Through the scheme, the blind pixels of the infrared focal plane array under different temperature environments can be quickly and effectively detected.

Description

Blind pixel detection method and device and electronic equipment
Technical Field
The present application relates to the field of infrared thermal imaging technologies, and in particular, to a blind pixel detection method and apparatus, and an electronic device.
Background
The infrared focal plane array in the infrared thermal imaging device inevitably has the problems of blind pixels, non-uniformity and the like under the influence of factors such as manufacturing process, materials and the like. Because the existence of the blind pixels can affect the image processing algorithm and the visual effect in the later period, the blind pixels in the infrared focal plane array need to be detected, and therefore blind pixel removing processing is performed subsequently. The blind pixels comprise dead pixels and overheated pixels, the dead pixels are pixels with response rate lower than the average response rate of 1/10, and the overheated pixels are pixels with response rate 10 times higher than the average response rate according to the regulations in the national standard GB/T17444-1998.
In addition, for the infrared focal plane array without temperature control, the change of the response rate of the pixels under different environmental temperatures has great influence on the blind pixels, namely, the response rate of the pixels in a normal range under one environmental temperature is changed into the response rate in an abnormal range under other environmental temperatures, and the pixels become new blind pixels.
Therefore, how to rapidly and effectively detect the blind pixels of the infrared focal plane array in different temperature environments is an urgent problem to be solved.
Disclosure of Invention
An object of the embodiments of the present application is to provide a method and an apparatus for detecting blind pixels, and an electronic device, so as to quickly and effectively detect the blind pixels of an infrared focal plane array in different temperature environments. The specific technical scheme is as follows:
in a first aspect, an embodiment of the present application provides a blind pixel detection method, including:
obtaining a plurality of frames of target images about the auxiliary object; wherein, any frame of target image is: under a preset environment temperature, images which are induced by an infrared focal plane array in the infrared thermal imaging equipment and are related to the auxiliary object, and different frames of target images correspond to different preset environment temperatures;
calculating at least one frame of difference image corresponding to the multiple frames of target images, wherein any frame of difference image is an image obtained by subtracting two frames of target images;
and for each frame of difference image, determining blind pixels in the infrared focal plane array based on the difference image and pixel values corresponding to each pixel element in the infrared focal plane array and related to the difference image.
Optionally, a plurality of predetermined ambient temperatures corresponding to the multi-frame target images belong to at least two temperature zones, and each temperature zone includes at least two predetermined ambient temperatures; under different temperature zones, the target equipment parameters of the infrared thermal imaging equipment are different;
the step of calculating at least one frame of difference image corresponding to the multiple frames of target images includes:
and calculating a difference image corresponding to each group of target images aiming at each group of target images, wherein the preset environmental temperature corresponding to any group of target images belongs to the same temperature zone.
Optionally, the step of obtaining multiple frames of target images related to the auxiliary object includes:
sequentially obtaining multi-frame target images related to the auxiliary objects according to the ascending order or the descending order of the corresponding preset environmental temperatures;
the step of calculating the difference image corresponding to each group of target images comprises:
and for each group of target images, after the target image is obtained for the second time, the currently obtained target image is differenced with the last obtained target image to obtain a difference image, and the last obtained target image is deleted.
Optionally, before the step of determining, for each frame of difference image, a blind pixel in the infrared focal plane array based on the difference image and a pixel value corresponding to each pixel element in the infrared focal plane array and related to the difference image, the method further includes:
and acquiring a gain matrix matched with the difference image for each frame of difference image, and performing data amplification processing on the difference image by using the acquired gain matrix.
Optionally, the step of obtaining a gain matrix matched to the difference image includes:
determining target reference information, wherein the target reference information is as follows: acquiring a target device parameter utilized in a first image or a temperature partition to which a preset environment temperature corresponding to the first image belongs, wherein the first image is a target image for generating the difference image;
and determining a target gain matrix corresponding to the target reference information based on the corresponding relation between the preset reference information and the gain matrix, and taking the target gain matrix as a gain matrix matched with the difference image.
Optionally, the determining manner of the gain matrix corresponding to any reference information includes:
obtaining a first image about a first object and a second image about a second object, wherein the first image is: an image of the first object sensed by the infrared focal plane array at a first temperature; the second image is: an image of the second object sensed by the infrared focal plane array at a first temperature; the temperature of the first object is lower than the first temperature, the temperature of the second object is higher than the first temperature, and the first temperature is the temperature in the temperature partition corresponding to the current reference information;
according to a preset calculation mode, calculating a gain value corresponding to each pixel in the infrared focal plane array to obtain a gain matrix;
the predetermined calculation method comprises the following steps:
determining a first difference value of the pixel mean value of the second image and the pixel mean value of the first image;
calculating a second difference value between the pixel value of the second image and the pixel value of the first image corresponding to the pixel;
and taking the ratio of the first difference value to the second difference value as a gain value corresponding to the pixel.
Optionally, the step of determining, for each frame of difference image, a blind pixel in the infrared focal plane array based on the difference image and a pixel value of the difference image corresponding to each pixel element in the infrared focal plane array includes:
calculating a global mean and a global standard deviation of the difference image for each frame of difference image;
and aiming at each pixel element in the infrared focal plane array, calculating a third difference value of the pixel value of the difference image corresponding to the pixel element and the global mean value, judging whether the third difference value is greater than a first preset multiple of the global standard deviation, and if so, determining that the pixel element is a blind pixel.
Optionally, the step of determining, for each frame of difference image, a blind pixel in the infrared focal plane array based on the difference image and a pixel value of the difference image corresponding to each pixel element in the infrared focal plane array includes:
for each frame of difference image, calculating the mean value and the standard deviation of the difference image in a partition mode to obtain the local mean value and the local standard deviation of the difference image;
calculating a fourth difference value of a pixel value of the difference image corresponding to each pixel element in the infrared focal plane array and a target local mean value, judging whether the fourth difference value is larger than a second preset multiple of a target local standard deviation or not, and if so, determining that the pixel element is a blind pixel;
wherein the target local mean is: the corresponding difference image area comprises a local mean value of the pixel value corresponding to the pixel;
the target local standard deviation is: the corresponding difference image area contains the local standard deviation of the pixel value corresponding to the pixel element.
In a second aspect, an embodiment of the present application provides a blind pixel detection apparatus, including:
a target image obtaining unit for obtaining a plurality of frames of target images about the auxiliary object; wherein, any frame of target image is: under a preset environment temperature, images which are induced by an infrared focal plane array in the infrared thermal imaging equipment and are related to the auxiliary object, and different frames of target images correspond to different preset environment temperatures;
the difference image calculating unit is used for calculating at least one frame of difference image corresponding to the multiple frames of target images, wherein any frame of difference image is an image obtained by subtracting two frames of target images; and the blind pixel determining unit is used for determining the blind pixels in the infrared focal plane array according to each frame of difference image and the pixel values of the difference image corresponding to each pixel element in the infrared focal plane array.
Optionally, a plurality of predetermined ambient temperatures corresponding to the multi-frame target images belong to at least two temperature zones, and each temperature zone includes at least two predetermined ambient temperatures; under different temperature zones, the target equipment parameters of the infrared thermal imaging equipment are different;
the difference image calculation unit includes:
and the difference image calculation subunit is used for calculating a difference image corresponding to each group of target images, wherein the preset environmental temperature corresponding to any group of target images belongs to the same temperature partition.
Optionally, the target image obtaining unit is specifically configured to:
sequentially obtaining multi-frame target images related to the auxiliary objects according to the ascending order or the descending order of the corresponding preset environmental temperatures;
the difference image calculation subunit is specifically configured to:
and for each group of target images, after the target image is obtained for the second time, the currently obtained target image is differenced with the last obtained target image to obtain a difference image, and the last obtained target image is deleted.
Optionally, the blind pixel detection apparatus further includes:
and the gain unit is used for acquiring a gain matrix matched with the difference image for each frame of difference image and performing data amplification processing on the difference image by using the acquired gain matrix before the step of determining the blind pixels in the infrared focal plane array based on the difference image and the pixel values of the difference image corresponding to the pixel elements in the infrared focal plane array by the blind pixel determination unit.
Optionally, the obtaining, by the gain unit, a gain matrix matched with the difference image specifically includes:
determining target reference information, wherein the target reference information is as follows: acquiring a target device parameter utilized in a first image or a temperature partition to which a preset environment temperature corresponding to the first image belongs, wherein the first image is a target image for generating the difference image;
and determining a target gain matrix corresponding to the target reference information based on the corresponding relation between the preset reference information and the gain matrix, and taking the target gain matrix as a gain matrix matched with the difference image.
Optionally, the determining manner of the gain matrix corresponding to any reference information includes:
obtaining a first image about a first object and a second image about a second object, wherein the first image is: an image of the first object sensed by the infrared focal plane array at a first temperature; the second image is: an image of the second object sensed by the infrared focal plane array at a first temperature; the temperature of the first object is lower than the first temperature, the temperature of the second object is higher than the first temperature, and the first temperature is the temperature in the temperature partition corresponding to the current reference information;
according to a preset calculation mode, calculating a gain value corresponding to each pixel in the infrared focal plane array to obtain a gain matrix;
the predetermined calculation method comprises the following steps:
determining a first difference value of the pixel mean value of the second image and the pixel mean value of the first image;
calculating a second difference value between the pixel value of the second image and the pixel value of the first image corresponding to the pixel;
and taking the ratio of the first difference value to the second difference value as a gain value corresponding to the pixel.
Optionally, the blind pixel determination unit includes a first determination unit;
the first determination unit is configured to:
calculating a global mean and a global standard deviation of the difference image for each frame of difference image;
and aiming at each pixel element in the infrared focal plane array, calculating a third difference value of the pixel value of the difference image corresponding to the pixel element and the global mean value, judging whether the third difference value is greater than a first preset multiple of the global standard deviation, and if so, determining that the pixel element is a blind pixel.
Optionally, the blind pixel determination unit includes a second determination unit;
the second determination unit is configured to:
for each frame of difference image, calculating the mean value and the standard deviation of the difference image in a partition mode to obtain the local mean value and the local standard deviation of the difference image;
calculating a fourth difference value of a pixel value of the difference image corresponding to each pixel element in the infrared focal plane array and a target local mean value, judging whether the fourth difference value is larger than a second preset multiple of a target local standard deviation or not, and if so, determining that the pixel element is a blind pixel;
wherein the target local mean is: the corresponding difference image area comprises a local mean value of the pixel value corresponding to the pixel;
the target local standard deviation is: the corresponding difference image area contains the local standard deviation of the pixel value corresponding to the pixel element.
In a third aspect, an embodiment of the present application provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, where the processor and the communication interface complete communication between the memory and the processor through the communication bus;
a memory for storing a computer program;
the processor is configured to implement the steps of the blind pixel detection method provided in the embodiment of the present application when executing the program stored in the memory.
In the embodiment of the application, multi-frame target images related to auxiliary objects are obtained; wherein, any frame of target image is: under a preset environment temperature, sensing an image related to the auxiliary object by an infrared focal plane array in the infrared thermal imaging equipment, wherein different frames of target images correspond to different preset environment temperatures; calculating at least one frame of difference image corresponding to the multiple frames of target images, wherein any frame of difference image is an image obtained by subtracting two frames of target images; and determining blind pixels in the infrared focal plane array based on the difference image and pixel values corresponding to the pixel elements in the infrared focal plane array and related to the difference image for each frame of difference image. In the scheme, the blind pixels in the infrared focal plane array are determined based on the difference relationship of the pixel data sensed by the pixels in the infrared focal plane array at different preset environmental temperatures, so that the blind pixels of the infrared focal plane array in different temperature environments can be quickly and effectively detected.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart of a blind pixel detection method according to an embodiment of the present disclosure;
fig. 2 is another flowchart of a blind pixel detection method according to an embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of a blind pixel detection apparatus according to an embodiment of the present disclosure;
fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In order to quickly and effectively detect blind pixels of an infrared focal plane array in different temperature environments, the embodiment of the application provides a blind pixel detection method, a blind pixel detection device and electronic equipment.
First, a blind pixel detection method provided in an embodiment of the present application is described below.
It should be noted that an execution subject of the blind pixel detection method provided in the embodiments of the present application may be a blind pixel detection apparatus. In a specific application, the blind pixel detection device can be operated in an infrared thermal imaging device with an infrared focal plane array, and of course, can also be operated in an electronic device which is communicated with the infrared thermal imaging device. The infrared thermal imaging equipment can be an infrared focal plane detector, an infrared thermal imaging engine core assembly, an infrared thermal imager and the like, wherein the type of the infrared thermal imager comprises but is not limited to a temperature measurement type, an observation type and a vehicle-mounted type; it is reasonable that the electronic device may be a terminal device or a server.
It is understood that the infrared Focal Plane Array (infrared Focal Plane Array) belongs to the Focal Plane of the infrared optical system, and a multi-element planar Array infrared detection element corresponding to one sensitive element can be arranged on each image element of a scene in the whole view field.
As shown in fig. 1, a method for detecting a blind pixel provided in an embodiment of the present application may include the following steps:
s101, obtaining multi-frame target images of auxiliary objects;
wherein, any frame of target image is: under a preset environment temperature, the infrared focal plane array in the infrared thermal imaging device senses images related to the auxiliary object, and different frame target images correspond to different preset environment temperatures.
In order to detect the blind pixels, the optical path of the infrared thermal imaging device can be shielded by an auxiliary object, so that the infrared focal plane array of the infrared thermal imaging device can sense the auxiliary object, and a target image of the auxiliary object is generated; and, the ambient temperature in which the infrared thermal imaging apparatus is located may be adjusted in accordance with a plurality of predetermined ambient temperatures. In this way, the blind pixel detection device can obtain a plurality of frames of target images about the auxiliary object, and further perform the subsequent processing. It is to be understood that in a particular application, any target image may be a frame of image generated by the infrared thermal imaging device; of course, any target image may also be a result of performing mean filtering on multiple frames of images generated by the infrared thermal imaging apparatus, where the multiple frames of images correspond to the same predetermined ambient temperature.
Wherein the auxiliary object may be an object with uniform radiation properties, such as: and (4) a uniform radiation surface. Also, in order to ensure uniform radiation, the auxiliary object may be an object made of only one material, but is not limited thereto. In addition, the auxiliary object can be fixed manually or through a specific fixing device, so that the auxiliary object can stably shield the optical path of the infrared thermal imaging device.
Wherein the plurality of predetermined ambient temperatures may be: the temperature in the working temperature range of the infrared focal plane array is not limited by the specific temperature values of a plurality of preset environment temperatures. In a specific application, the blind pixel detection device can obtain multiple frames of target images together; of course, multiple frames of target images about the auxiliary object may also be obtained in sequence, for example: the multiple frames of target images about the auxiliary object may be sequentially obtained in descending or ascending order of the corresponding predetermined environmental temperatures.
S102, calculating at least one frame of difference image corresponding to the multiple frames of target images, wherein any frame of difference image is an image obtained by subtracting two frames of target images;
in order to quickly and effectively detect the blind pixels of the infrared focal plane array in different temperature environments, the scheme provided by the embodiment of the application uses the difference relationship of the pixel data sensed by the pixels in the infrared focal plane array at different preset environmental temperatures as the basis for judging whether the pixels are blind or not. Therefore, the blind pixel detection device can calculate at least one frame of difference image corresponding to a plurality of frames of target images, and further perform subsequent processing by using the at least one frame of difference image.
The blind pixel detection device may perform difference processing on any two obtained target images, or perform difference processing on two successively obtained target images, which is reasonable. The difference image is obtained by subtracting two frames of target images, so that each pixel value in the difference image is a pixel difference value of the two frames of target images, and each pixel element in the infrared focal plane array has a corresponding pixel value in the difference image.
Optionally, when multiple frames of target images are obtained in sequence, in order to reduce the storage space occupancy rate, the step of calculating at least one difference image corresponding to the multiple frames of target images may include:
after the target image is obtained each time from the second time, the current obtained target image is differed from the last obtained target image to obtain a difference image, and the last obtained target image is deleted.
In addition, it is understood that, after the target image is obtained, the blind pixel detection apparatus may calculate the difference image directly using the obtained target image. Of course, since noise usually exists in the target image, in order to further improve the blind pixel detection accuracy, after the target image is obtained, the blind pixel detection apparatus may perform denoising processing on the obtained target image, and calculate a difference image based on the denoised target image. The denoising process may include, but is not limited to, mean filtering, median filtering, K-nearest neighbor smoothing filtering, symmetric nearest neighbor mean filtering, and the like.
S103, for each frame of difference image, determining blind pixels in the infrared focal plane array based on the difference image and pixel values corresponding to the difference image in each pixel of the infrared focal plane array.
The blind pixel detection device has the same processing procedure for each frame of difference image. Specifically, the processing procedure may include: and determining blind pixels in the infrared focal plane array based on the difference image and the pixel values corresponding to the pixel elements in the infrared focal plane array and related to the difference image. After all difference images are processed, the blind pixel detection device can quickly and effectively detect the blind pixels of the infrared focal plane array in different temperature environments.
In addition, for convenience of calculation, for each frame of difference image, before the step of determining the blind pixels in the infrared focal plane array based on the difference image and the pixel values of the difference image corresponding to the pixels in the infrared focal plane array, each difference image may be subjected to data amplification by using a preset gain matrix. All difference images may correspond to the same gain matrix, and the preset gain matrix may be set according to an empirical value, which is not limited in the present application.
It should be noted that, for each frame of difference image, there are various specific implementation manners for determining the blind pixels in the infrared focal plane array based on the difference image and the pixel values of the difference image corresponding to each pixel element in the infrared focal plane array, and the following description is given by combining the two specific implementation manners.
Optionally, in an implementation manner, the step of determining, for each frame of difference image, a blind pixel in the infrared focal plane array based on the difference image and a pixel value corresponding to each pixel element and related to the difference image includes:
calculating a global mean and a global standard deviation of the difference image for each frame of difference image;
and calculating a third difference value of the pixel value of the difference image corresponding to each pixel in the infrared focal plane array and the global mean value, judging whether the third difference value is greater than a first preset multiple of the global standard deviation, and if so, determining that the pixel is a blind pixel. The first predetermined multiple may be 2 times, 3 times, 4 times, and the like, which is not limited in this application.
Specifically, the formula used for calculating the global mean of any difference image may be:
Figure BDA0001677184440000101
wherein, mugIs the global mean of the difference image, and MxN is the size of the difference image, i.e. the resolution of the infrared focal plane array, imgd(i, j) is the pixel value of coordinate point (i, j).
Specifically, the formula used for calculating the global standard deviation of any difference image may be:
Figure BDA0001677184440000102
wherein σgIs the global standard deviation, mu, of the difference imagegIs the global mean of the difference image, and MxN is the size of the difference image, i.e. the resolution of the infrared focal plane array, imgd(i, j) is the pixel value of coordinate point (i, j).
Optionally, in another implementation manner, the step of determining, for each frame of difference image, a blind pixel in the infrared focal plane array based on the difference image and a pixel value corresponding to each pixel element and related to the difference image may include:
for each frame of difference image, calculating the mean value and the standard deviation of the difference image in a partition mode to obtain the local mean value and the local standard deviation of the difference image;
calculating a fourth difference value of the pixel value of the difference image and the target local mean value corresponding to each pixel element, judging whether the fourth difference value is larger than a second preset multiple of the target local standard deviation, and if so, determining the pixel element as a blind pixel;
wherein the target local mean is: the corresponding difference image area comprises a local mean value of the pixel value corresponding to the pixel;
the target local standard deviation is: the corresponding difference image area contains the local standard deviation of the pixel value corresponding to the pixel element.
Wherein the second predetermined multiple may be 2 times, 3 times, 4 times, etc.; in addition, the difference image can be partitioned according to actual conditions, and the number of partitions and the partition mode are not limited in the application.
Specifically, the formula used for calculating the local mean of any difference image may be:
Figure BDA0001677184440000111
wherein, mulAs a local mean of the difference image, (2 × R +1) × (2 × R +1) as a partition size of the difference image, imgd(i, j) is the pixel value of coordinate point (i, j), and R is the radius of the partition.
Specifically, the formula used for calculating the local standard deviation of any difference image may be:
Figure BDA0001677184440000112
wherein σlIs the local standard deviation, mu, of the difference imagelAs a local mean of the difference image, (2 × R +1) × (2 × R +1) as a partition size of the difference image, imgd(i, j) is the pixel value of coordinate point (i, j), and R is the radius of the partition.
It should be noted that, the above-mentioned determining of the blind pixels in the infrared focal plane array based on the difference image and the pixel values of the difference image corresponding to each pixel element in the infrared focal plane array is only an example, and should not be construed as a limitation to the embodiments of the present application.
In addition, it is understood that the blind pixel detection device may perform the step of determining the blind pixels in the infrared focal plane array based on the difference image and the pixel values corresponding to the respective pixel elements in the infrared focal plane array with respect to the difference image, for the currently obtained difference image, after obtaining the difference image each time. Of course, the blind pixel detection apparatus may also perform, after obtaining all the difference images, for each frame of difference image, a step of determining the blind pixels in the infrared focal plane array based on the difference image and the pixel values of the difference image corresponding to the respective pixel elements in the infrared focal plane array.
In the scheme provided by the embodiment, a plurality of frames of target images of auxiliary objects are obtained; wherein, any frame of target image is: under a preset environment temperature, sensing an image related to the auxiliary object by an infrared focal plane array in the infrared thermal imaging equipment, wherein different frames of target images correspond to different preset environment temperatures; calculating at least one frame of difference image corresponding to the multiple frames of target images, wherein any frame of difference image is an image obtained by subtracting two frames of target images; and determining blind pixels in the infrared focal plane array based on the difference image and pixel values corresponding to the pixel elements in the infrared focal plane array and related to the difference image for each frame of difference image. In the scheme, the blind pixels in the infrared focal plane array are determined based on the difference relationship of the pixel data sensed by the pixels in the infrared focal plane array at different preset environmental temperatures, so that the blind pixels of the infrared focal plane array in different temperature environments can be quickly and effectively detected.
In addition, in order to ensure the imaging temperature dynamic range and the response capability of the infrared focal plane array in the whole working temperature range, the working temperature range of the infrared focal plane array can be partitioned to obtain at least two temperature partitions. Further, selecting at least two temperatures from each temperature zone as predetermined ambient temperatures; and target equipment parameters of the infrared thermal imaging equipment are different under different temperature zones. Specifically, the type of target device parameter may include one or more of integration time, integration capacitance, pixel bias, blind pixel bias, on-chip correction parameters, and the like. For example: assuming that the type of the target device parameter is integration time, the integration time of the infrared thermal imaging device in temperature partition 1 may be t1, and the integration time of the infrared thermal imaging device in temperature partition 2 may be t 2.
Because different temperature partitions correspond to different target device parameters, when the ambient temperature of the infrared thermal imaging device is adjusted according to a plurality of preset ambient temperatures, the target device parameters of the infrared thermal imaging device can also be adaptively adjusted, and then the acquisition of the target image is completed based on the target device parameters after the adaptive adjustment. The temperature sensor in the infrared thermal imaging device can be used for detecting the ambient temperature, determining the temperature partition where the detected ambient temperature is located, and adjusting the target device parameters of the infrared thermal imaging device according to the preset corresponding relation between the temperature partition and the target device parameters.
It is emphasized that the selection of the division points of the temperature divisions can follow the following principle: a. avoiding a normal temperature working area, namely, the temperature value of a normal temperature working range is not taken as a partition point; b. each temperature zone ensures the imaging temperature dynamic range of the infrared focal plane array under the condition of maximum response capability. And, considering that the responsivity of the infrared focal plane array decreases with a decrease in temperature, for the operating temperature range [ a, b ], the temperature range [ a, c ] is partitioned at a first temperature interval and the temperature range (c, b ] is partitioned at a second temperature interval in the partitioning.
Based on the processing idea that different temperature partitions correspond to different target device parameters, as shown in fig. 2, a blind pixel detection method provided in an embodiment of the present application may include the following steps:
s201, obtaining a multi-frame target image of an auxiliary object;
wherein, any frame of target image is: under a preset environment temperature, the infrared focal plane array in the infrared thermal imaging device senses images related to the auxiliary object, and different frame target images correspond to different preset environment temperatures.
S201 in this embodiment is similar to S101 in the above embodiment, except that: the method comprises the following steps that a plurality of preset ambient temperatures corresponding to a multi-frame target image belong to at least two temperature partitions, and each temperature partition comprises at least two preset ambient temperatures; and under different temperature zones, the target equipment parameters of the infrared thermal imaging equipment are different.
S202, calculating a difference image corresponding to each group of target images aiming at each group of target images, wherein the preset environmental temperature corresponding to any group of target images belongs to the same temperature zone;
in order to quickly and effectively detect the blind pixels of the infrared focal plane array in different temperature environments, the scheme provided by the embodiment of the application uses the difference relationship of the pixel data sensed by the pixels in the infrared focal plane array at different preset environmental temperatures of the same temperature zone as the basis for judging whether the pixels are blind or not. Therefore, the blind pixel detection device can calculate the difference image corresponding to each group of target images, and further perform subsequent processing by using at least one frame of difference image. When the infrared thermal imaging device generates a target image, target device parameters used in generating the target image may be recorded, or a predetermined ambient temperature corresponding to the generated target image may be recorded. In this way, at the time of blind pixel detection, a plurality of frames of target images can be divided into a plurality of groups of target images based on the recorded target device parameters or the predetermined ambient temperature.
The blind pixel detection device may perform difference processing on any two frames of images in each group of target images, or perform difference processing on two frames of target images obtained successively, which is reasonable. The difference image is obtained by subtracting two frames of target images, so that each pixel value in the difference image is a pixel difference value of the two frames of target images, and each pixel element in the infrared focal plane array has a corresponding pixel value in the difference image.
Optionally, when multiple frames of target images about the auxiliary object are sequentially obtained in an ascending order or a descending order of the corresponding predetermined environmental temperatures, in order to reduce the storage space occupancy rate, the step of calculating, for each group of target images, a difference image corresponding to the group of target images may include:
and for each group of target images, after the target image is obtained for the second time, the currently obtained target image is differenced with the last obtained target image to obtain a difference image, and the last obtained target image is deleted.
It is to be understood that, after the target image is obtained, the blind pixel detection means may calculate the difference image directly using the obtained target image. Of course, since noise usually exists in the target image, in order to further improve the blind pixel detection accuracy, after the target image is obtained, the blind pixel detection apparatus may perform denoising processing on the obtained target image, and calculate a difference image based on the denoised target image. The denoising process may include, but is not limited to, mean filtering, median filtering, K-nearest neighbor smoothing filtering, symmetric nearest neighbor mean filtering, and the like.
S203, aiming at each frame of difference image, determining blind pixels in the infrared focal plane array based on the difference image and pixel values corresponding to the pixel elements in the infrared focal plane array and related to the difference image.
The blind pixel detection device has the same processing procedure for each frame of difference image. Specifically, the processing procedure may include: and determining blind pixels in the infrared focal plane array based on the difference image and the pixel values corresponding to the pixel elements in the infrared focal plane array and related to the difference image. After all difference images are processed, the blind pixel detection device can quickly and effectively detect the blind pixels of the infrared focal plane array in different temperature environments.
It should be noted that, in this embodiment, for each frame of the difference image, based on the difference image and the pixel values corresponding to the difference image in each pixel element in the infrared focal plane array, a specific implementation manner of determining the blind pixels in the infrared focal plane array may refer to the related description of S103 in the foregoing embodiment, which is not described herein again.
It is understood that the blind pixel detection device may perform the step of determining the blind pixels in the infrared focal plane array based on the difference image and the pixel values corresponding to the respective pixel elements in the infrared focal plane array with respect to the difference image, for the currently obtained difference image, after obtaining the difference image each time. Of course, the blind pixel detection apparatus may also perform, after obtaining all the difference images, for each frame of difference image, a step of determining the blind pixels in the infrared focal plane array based on the difference image and the pixel values of the difference image corresponding to the respective pixel elements in the infrared focal plane array.
In addition, for convenience of calculation, before the step of determining, for each frame of the difference image, blind pixels in the infrared focal plane array based on the difference image and pixel values corresponding to the respective pixel elements in the infrared focal plane array and related to the difference image, the method may further include:
and acquiring a gain matrix matched with the difference image for each frame of difference image, and performing data amplification processing on the difference image by using the acquired gain matrix.
At this time, for each frame of difference image, determining the blind pixels in the infrared focal plane array based on the difference image and the pixel values of the difference image corresponding to the respective pixel elements in the infrared focal plane array may include: and determining blind pixels in the infrared focal plane array based on the difference image and pixel values corresponding to the difference image and corresponding to each pixel in the infrared focal plane array aiming at the difference image obtained after amplification processing of each frame of data.
Optionally, in an implementation manner, all difference images may correspond to the same gain matrix, and the preset gain matrix may be set according to an empirical value, which is not limited in this application.
Optionally, in another implementation, different target device parameters correspond to different gain matrices, that is, different temperature zones correspond to different gain matrices. At this time, the step of acquiring the gain matrix matched with the difference image may include:
determining target reference information, wherein the target reference information is as follows: acquiring a target device parameter utilized in a first image or a temperature partition to which a preset environment temperature corresponding to the first image belongs, wherein the first image is a target image for generating the difference image;
and determining a target gain matrix corresponding to the target reference information based on the corresponding relation between the preset reference information and the gain matrix, and taking the target gain matrix as the gain matrix matched with the difference image.
It is understood that the preset reference information and the gain matrix may correspond to: and (3) corresponding relation between preset target equipment parameters and the gain matrix, or corresponding relation between preset temperature partitions and the gain matrix.
The determining method of the gain matrix corresponding to any reference information may include:
obtaining a first image about a first object and a second image about a second object, wherein the first image is: an image of the first object sensed by the infrared focal plane array at a first temperature; the second image is: an image of the second object sensed by the infrared focal plane array at a first temperature; the temperature of the first object is lower than the first temperature, the temperature of the second object is higher than the first temperature, and the first temperature is the temperature in the temperature partition corresponding to the current reference information;
calculating a gain value corresponding to each pixel in the infrared focal plane array according to a preset calculation mode to obtain a gain matrix;
the predetermined calculation method may include:
determining a first difference value of the pixel mean value of the second image and the pixel mean value of the first image;
calculating a second difference value between the pixel value of the second image and the pixel value of the first image corresponding to the pixel;
and taking the ratio of the first difference value to the second difference value as a gain value corresponding to the pixel. It should be noted that the calculation formula corresponding to the predetermined calculation method may be as follows:
Figure BDA0001677184440000161
the gain (i, j) is a gain value corresponding to a pixel with a coordinate (i, j), mean (VBH) is a pixel mean value of the second image, mean (VBL) is a pixel mean value of the first image, VBH (i, j) is a pixel value related to the second image corresponding to the pixel with the coordinate (i, j), and VBL (i, j) is a pixel value related to the first image corresponding to the pixel with the coordinate (i, j).
For convenience of understanding, the following describes a determination method of a gain matrix corresponding to any reference information, taking the reference information as a temperature partition and a target device parameter as examples.
(1) Taking the reference information as the temperature partition as an example:
assuming that the temperature partition is (30 ℃,50 ℃), when calculating the gain matrix corresponding to the temperature partition, selecting a temperature from the temperature partition: 40 ℃ and taking the selected temperature as the first temperature;
adjusting the temperature of the first object to 25 ℃ and the temperature of the second object to 55 ℃;
sensing an image about the first object by the infrared focal plane array at an ambient temperature of 40 ℃, and taking the sensed image as a first image;
sensing an image about the second object by the infrared focal plane array at an ambient temperature of 40 ℃, and taking the sensed image as a second image;
and according to a preset calculation mode, calculating a gain value corresponding to each pixel in the infrared focal plane array by using the first image and the second image to obtain a gain matrix corresponding to a temperature partition (30 ℃,50 ℃).
(2) Taking the reference information as the target device parameter as an example:
assume that the target equipment parameter is a1, which corresponds to a temperature partition of (20 ℃,30 ℃);
when calculating the gain matrix corresponding to the target device parameter a1, a temperature is selected from the temperature partitions (20 ℃,30 ℃): 22 ℃ and taking the selected temperature as the first temperature;
adjusting the temperature of the first object to 20 ℃ and the temperature of the second object to 40 ℃;
sensing an image about the first object by the infrared focal plane array at an ambient temperature of 22 ℃, and taking the sensed image as a first image;
at an ambient temperature of 22 ℃, sensing an image about the second object by the infrared focal plane array, and taking the sensed image as a second image;
and according to a preset calculation mode, calculating a gain value corresponding to each pixel in the infrared focal plane array by using the first image and the second image to obtain a gain matrix corresponding to the target equipment parameter A1.
It should be noted that the first object and the second object may be objects with uniform radiation properties, such as: and (4) a uniform radiation surface. Also, in order to ensure uniform radiation, the first object and the second object may be objects formed using only one material, but are not limited thereto. In addition, the first object and the second object can be fixed by manual fixing or a specific fixing device, so that the first object and the second object can stably block the optical path of the infrared thermal imaging device.
In the solution provided in this embodiment, the blind pixels in the infrared focal plane array are determined based on the difference relationship between the pixel data sensed by the pixels in the infrared focal plane array at different predetermined environmental temperatures of the same temperature zone. Therefore, on the premise of ensuring the imaging temperature dynamic range and the response capability of the infrared focal plane array in the whole working temperature range, the blind pixels of the infrared focal plane array in different temperature environments can be quickly and effectively detected.
Corresponding to the method embodiment, the embodiment of the application also provides a blind pixel detection device. As shown in fig. 3, the blind pixel detecting apparatus may include:
a target image obtaining unit 310 for obtaining a plurality of frames of target images regarding the auxiliary object; wherein, any frame of target image is: under a preset environment temperature, images which are induced by an infrared focal plane array in the infrared thermal imaging equipment and are related to the auxiliary object, and different frames of target images correspond to different preset environment temperatures;
a difference image calculating unit 320, configured to calculate at least one frame of difference image corresponding to the multiple frames of target images, where any frame of difference image is an image obtained by subtracting two frames of target images;
a blind pixel determining unit 330, configured to determine, for each frame of difference image, a blind pixel in the infrared focal plane array based on the difference image and a pixel value of the difference image corresponding to each pixel element in the infrared focal plane array.
In the embodiment of the application, multi-frame target images related to auxiliary objects are obtained; wherein, any frame of target image is: under a preset environment temperature, sensing an image related to the auxiliary object by an infrared focal plane array in the infrared thermal imaging equipment, wherein different frames of target images correspond to different preset environment temperatures; calculating at least one frame of difference image corresponding to the multiple frames of target images, wherein any frame of difference image is an image obtained by subtracting two frames of target images; and determining blind pixels in the infrared focal plane array based on the difference image and pixel values corresponding to the pixel elements in the infrared focal plane array and related to the difference image for each frame of difference image. In the scheme, the blind pixels in the infrared focal plane array are determined based on the difference relationship of the pixel data sensed by the pixels in the infrared focal plane array at different preset environmental temperatures, so that the blind pixels of the infrared focal plane array in different temperature environments can be quickly and effectively detected.
Optionally, a plurality of predetermined ambient temperatures corresponding to the multi-frame target images belong to at least two temperature zones, and each temperature zone includes at least two predetermined ambient temperatures; under different temperature zones, the target equipment parameters of the infrared thermal imaging equipment are different;
the difference image calculating unit 320 may include:
and the difference image calculation subunit is used for calculating a difference image corresponding to each group of target images, wherein the preset environmental temperature corresponding to any group of target images belongs to the same temperature partition.
Optionally, the target image obtaining unit is specifically configured to:
sequentially obtaining multi-frame target images related to the auxiliary objects according to the ascending order or the descending order of the corresponding preset environmental temperatures;
the difference image calculation subunit is specifically configured to:
and for each group of target images, after the target image is obtained for the second time, the currently obtained target image is differenced with the last obtained target image to obtain a difference image, and the last obtained target image is deleted.
Optionally, the blind pixel detection apparatus provided in this embodiment of the present application may further include:
and the gain unit is used for acquiring a gain matrix matched with the difference image for each frame of difference image and performing data amplification processing on the difference image by using the acquired gain matrix before the step of determining the blind pixels in the infrared focal plane array based on the difference image and the pixel values of the difference image corresponding to the pixel elements in the infrared focal plane array by the blind pixel determination unit.
Optionally, the obtaining, by the gain unit, a gain matrix matched with the difference image specifically includes:
determining target reference information, wherein the target reference information is as follows: acquiring a target device parameter utilized in a first image or a temperature partition to which a preset environment temperature corresponding to the first image belongs, wherein the first image is a target image for generating the difference image;
and determining a target gain matrix corresponding to the target reference information based on the corresponding relation between the preset reference information and the gain matrix, and taking the target gain matrix as a gain matrix matched with the difference image.
Optionally, the determining manner of the gain matrix corresponding to any reference information includes:
obtaining a first image about a first object and a second image about a second object, wherein the first image is: an image of the first object sensed by the infrared focal plane array at a first temperature; the second image is: an image of the second object sensed by the infrared focal plane array at a first temperature; the temperature of the first object is lower than the first temperature, the temperature of the second object is higher than the first temperature, and the temperature of the first object in the temperature partition corresponding to the current reference information of the first temperature;
according to a preset calculation mode, calculating a gain value corresponding to each pixel in the infrared focal plane array to obtain a gain matrix;
the predetermined calculation method comprises the following steps:
determining a first difference value of the pixel mean value of the second image and the pixel mean value of the first image;
calculating a second difference value between the pixel value of the second image and the pixel value of the first image corresponding to the pixel;
and taking the ratio of the first difference value to the second difference value as a gain value corresponding to the pixel.
Optionally, the blind pixel determination unit includes a first determination unit;
the first determination unit is configured to:
calculating a global mean and a global standard deviation of the difference image for each frame of difference image;
and aiming at each pixel element in the infrared focal plane array, calculating a third difference value of the pixel value of the difference image corresponding to the pixel element and the global mean value, judging whether the third difference value is greater than a first preset multiple of the global standard deviation, and if so, determining that the pixel element is a blind pixel.
Optionally, the blind pixel determination unit includes a second determination unit;
the second determination unit is configured to:
for each frame of difference image, calculating the mean value and the standard deviation of the difference image in a partition mode to obtain the local mean value and the local standard deviation of the difference image;
calculating a fourth difference value of a pixel value of the difference image corresponding to each pixel element in the infrared focal plane array and a target local mean value, judging whether the fourth difference value is larger than a second preset multiple of a target local standard deviation or not, and if so, determining that the pixel element is a blind pixel;
wherein the target local mean is: the corresponding difference image area comprises a local mean value of the pixel value corresponding to the pixel;
the target local standard deviation is: the corresponding difference image area contains the local standard deviation of the pixel value corresponding to the pixel element.
In addition, an electronic device is provided in the embodiments of the present application, as shown in fig. 4, and includes a processor 410, a communication interface 420, a memory 430, and a communication bus 440, where the processor 410, the communication interface 420, and the memory 430 complete communication with each other through the communication bus 440,
a memory 430 for storing computer programs;
the processor 410 is configured to implement the steps of the method for detecting blind pixels provided in the embodiment of the present application when executing the program stored in the memory 430.
The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface is used for communication between the electronic equipment and other equipment.
The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.
In addition, a computer-readable storage medium is provided, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the blind pixel detection method provided in the embodiments of the present application are implemented.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The above description is only for the preferred embodiment of the present application, and is not intended to limit the scope of the present application. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application are included in the protection scope of the present application.

Claims (8)

1. A blind pixel detection method is characterized by comprising the following steps:
obtaining a plurality of frames of target images about the auxiliary object; wherein, any frame of target image is: under a preset environment temperature, images which are induced by an infrared focal plane array in the infrared thermal imaging equipment and are related to the auxiliary object, and different frames of target images correspond to different preset environment temperatures;
calculating at least one frame of difference image corresponding to the multiple frames of target images, wherein any frame of difference image is an image obtained by subtracting two frames of target images;
for each frame of difference image, determining blind pixels in the infrared focal plane array based on the difference image and pixel values of the difference image corresponding to all pixel elements in the infrared focal plane array;
the step of determining the blind pixels in the infrared focal plane array based on the difference image and the pixel values of the difference image corresponding to the pixel elements in the infrared focal plane array for each frame of difference image comprises the following steps:
calculating a global mean and a global standard deviation of the difference image for each frame of difference image;
calculating a third difference value of a pixel value of the difference image corresponding to each pixel element in the infrared focal plane array and the global mean value, judging whether the third difference value is larger than a first preset multiple of the global standard deviation, and if so, determining the pixel element as a blind pixel;
alternatively, the first and second electrodes may be,
for each frame of difference image, calculating the mean value and the standard deviation of the difference image in a partition mode to obtain the local mean value and the local standard deviation of the difference image; calculating a fourth difference value of a pixel value of the difference image corresponding to each pixel element in the infrared focal plane array and a target local mean value, judging whether the fourth difference value is larger than a second preset multiple of a target local standard deviation or not, and if so, determining that the pixel element is a blind pixel; wherein the target local mean is: the corresponding difference image area comprises a local mean value of the pixel value corresponding to the pixel; the target local standard deviation is: the corresponding difference image area contains the local standard deviation of the pixel value corresponding to the pixel element.
2. The blind pixel detection method according to claim 1, wherein the plurality of predetermined ambient temperatures corresponding to the plurality of frames of target images belong to at least two temperature zones, and each temperature zone comprises at least two predetermined ambient temperatures; under different temperature zones, the target equipment parameters of the infrared thermal imaging equipment are different;
the step of calculating at least one frame of difference image corresponding to the multiple frames of target images includes:
and calculating a difference image corresponding to each group of target images aiming at each group of target images, wherein the preset environmental temperature corresponding to any group of target images belongs to the same temperature zone.
3. The blind pixel detection method according to claim 2, wherein the step of obtaining a plurality of frames of target images about auxiliary objects comprises:
sequentially obtaining multi-frame target images related to the auxiliary objects according to the ascending order or the descending order of the corresponding preset environmental temperatures;
the step of calculating the difference image corresponding to each group of target images comprises:
and for each group of target images, after the target image is obtained for the second time, the currently obtained target image is differenced with the last obtained target image to obtain a difference image, and the last obtained target image is deleted.
4. The blind pixel detection method according to claim 2, wherein, before the step of determining the blind pixels in the infrared focal plane array based on the difference image and the pixel values of the difference image corresponding to the respective pixel elements in the infrared focal plane array, for each frame of difference image, the method further comprises:
and acquiring a gain matrix matched with the difference image for each frame of difference image, and performing data amplification processing on the difference image by using the acquired gain matrix.
5. The blind pixel detection method of claim 4, wherein said step of obtaining a gain matrix matching the difference image comprises:
determining target reference information, wherein the target reference information is as follows: acquiring a target device parameter utilized in a first image or a temperature partition to which a preset environment temperature corresponding to the first image belongs, wherein the first image is a target image for generating the difference image;
and determining a target gain matrix corresponding to the target reference information based on the corresponding relation between the preset reference information and the gain matrix, and taking the target gain matrix as a gain matrix matched with the difference image.
6. The blind pixel detection method of claim 5, wherein the determining manner of the gain matrix corresponding to any reference information comprises:
obtaining a first image about a first object and a second image about a second object, wherein the first image is: an image of the first object sensed by the infrared focal plane array at a first temperature; the second image is: an image of the second object sensed by the infrared focal plane array at a first temperature; the temperature of the first object is lower than the first temperature, the temperature of the second object is higher than the first temperature, and the first temperature is the temperature in the temperature partition corresponding to the current reference information;
according to a preset calculation mode, calculating a gain value corresponding to each pixel in the infrared focal plane array to obtain a gain matrix;
the predetermined calculation method comprises the following steps:
determining a first difference value of the pixel mean value of the second image and the pixel mean value of the first image;
calculating a second difference value between the pixel value of the second image and the pixel value of the first image corresponding to the pixel;
and taking the ratio of the first difference value to the second difference value as a gain value corresponding to the pixel.
7. A blind pixel detection apparatus, comprising:
a target image obtaining unit for obtaining a plurality of frames of target images about the auxiliary object; wherein, any frame of target image is: under a preset environment temperature, images which are induced by an infrared focal plane array in the infrared thermal imaging equipment and are related to the auxiliary object, and different frames of target images correspond to different preset environment temperatures;
the difference image calculating unit is used for calculating at least one frame of difference image corresponding to the multiple frames of target images, wherein any frame of difference image is an image obtained by subtracting two frames of target images;
a blind pixel determining unit, configured to determine, for each frame of difference image, a blind pixel in the infrared focal plane array based on the difference image and a pixel value of the difference image corresponding to each pixel element in the infrared focal plane array;
wherein the blind pixel determination unit includes:
a first determining unit, configured to calculate, for each frame of the difference image, a global mean and a global standard deviation of the difference image; calculating a third difference value of a pixel value of the difference image corresponding to each pixel element in the infrared focal plane array and the global mean value, judging whether the third difference value is larger than a first preset multiple of the global standard deviation, and if so, determining the pixel element as a blind pixel;
alternatively, the first and second electrodes may be,
the second determining unit is used for calculating the mean value and the standard deviation of each frame of difference image in a partition mode to obtain the local mean value and the local standard deviation of the difference image; calculating a fourth difference value of a pixel value of the difference image corresponding to each pixel element in the infrared focal plane array and a target local mean value, judging whether the fourth difference value is larger than a second preset multiple of a target local standard deviation or not, and if so, determining that the pixel element is a blind pixel; wherein the target local mean is: the corresponding difference image area comprises a local mean value of the pixel value corresponding to the pixel; the target local standard deviation is: the corresponding difference image area contains the local standard deviation of the pixel value corresponding to the pixel element.
8. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;
a memory for storing a computer program;
a processor for implementing the blind pixel detection method steps of any one of claims 1 to 6 when executing a program stored in a memory.
CN201810531030.3A 2018-05-29 2018-05-29 Blind pixel detection method and device and electronic equipment Active CN110542482B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810531030.3A CN110542482B (en) 2018-05-29 2018-05-29 Blind pixel detection method and device and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810531030.3A CN110542482B (en) 2018-05-29 2018-05-29 Blind pixel detection method and device and electronic equipment

Publications (2)

Publication Number Publication Date
CN110542482A CN110542482A (en) 2019-12-06
CN110542482B true CN110542482B (en) 2020-11-13

Family

ID=68701534

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810531030.3A Active CN110542482B (en) 2018-05-29 2018-05-29 Blind pixel detection method and device and electronic equipment

Country Status (1)

Country Link
CN (1) CN110542482B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112508825B (en) * 2020-11-12 2022-09-20 苏州长风航空电子有限公司 Real-time detection and elimination method for blind pixels of infrared detector
CN113160158B (en) * 2021-04-13 2022-06-07 浙江大华技术股份有限公司 Unstable pixel determination method, device, equipment and medium
CN117537930B (en) * 2023-10-31 2024-05-07 雷玺智能科技(上海)有限公司 Array temperature measurement method and management system based on infrared thermal imaging

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101895786A (en) * 2010-07-15 2010-11-24 杭州海康威视软件有限公司 Detection method and device for image sensor
CN103076156A (en) * 2013-01-08 2013-05-01 江苏涛源电子科技有限公司 Multi-criteria blind pixel detection method of infrared focal planar array
CN105191288A (en) * 2012-12-31 2015-12-23 菲力尔***公司 Anomalous pixel detection

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2686166B2 (en) * 1990-06-25 1997-12-08 富士写真フイルム株式会社 Image read signal correction method
CN102410880B (en) * 2011-08-05 2013-06-19 重庆邮电大学 Infrared focal plane array blind pixel detection method based on integral time adjustment
CN103335721B (en) * 2013-06-21 2015-10-21 中国科学院西安光学精密机械研究所 Scene matching-based dynamic blind pixel detection method for infrared focal plane array
US9077941B2 (en) * 2013-09-03 2015-07-07 Himax Imaging Limited Image processing method and image processing device
CN104330164B (en) * 2014-08-05 2018-03-23 凯迈（洛阳）测控有限公司 The blind pixel detection method and device of infrared focal plane array
US9958328B2 (en) * 2015-03-19 2018-05-01 Ci Systems (Israel) Ltd. Single device for gas and flame detection, imaging and measurement, and drift correction method thereof
CN105547490B (en) * 2015-12-08 2019-01-25 中国科学院上海技术物理研究所 A kind of real-time blind pixel detection method of number TDI infrared detector
CN105606223A (en) * 2015-12-17 2016-05-25 深圳市景阳科技股份有限公司 Blocking piece value correction method and system
CN106768383B (en) * 2017-01-21 2019-10-29 浙江红相科技股份有限公司 A kind of automatic blind element detection of infrared focal plane array and compensation method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101895786A (en) * 2010-07-15 2010-11-24 杭州海康威视软件有限公司 Detection method and device for image sensor
CN105191288A (en) * 2012-12-31 2015-12-23 菲力尔***公司 Anomalous pixel detection
CN103076156A (en) * 2013-01-08 2013-05-01 江苏涛源电子科技有限公司 Multi-criteria blind pixel detection method of infrared focal planar array

Also Published As

Publication number Publication date
CN110542482A (en) 2019-12-06

Similar Documents

Publication Publication Date Title
CN110542480B (en) Blind pixel detection method and device and electronic equipment
CN107636686B (en) Fingerprint acquisition method, device, chip and terminal equipment
CN110542482B (en) Blind pixel detection method and device and electronic equipment
CN111337142A (en) Body temperature correction method and device and electronic equipment
US20180063454A1 (en) Method and apparatus for correcting fixed pattern noise of an infrared image
TW201419853A (en) Image processor and image dead pixel detection method thereof
CN112689100B (en) Image detection method, device, equipment and storage medium
CN113538286B (en) Image processing method and device, electronic equipment and storage medium
CN110726700B (en) Smoke transmittance distribution measurement and acquisition method and device
RU2717346C2 (en) Correction of bad pixels in infrared image capturing device
CN110599479A (en) Monitoring area change detection method and device and storage medium
CN103389310A (en) Online sub-pixel optical component damage detection method based on radiation calibration
CN113138026A (en) Temperature measurement method and device based on temperature measurement system and computer equipment
CN110490196A (en) Subject detection method and apparatus, electronic equipment, computer readable storage medium
US20050157942A1 (en) System and method for estimating noise using measurement based parametric fitting non-uniformity correction
CN111652314A (en) Temperature detection method and device, computer equipment and storage medium
CN112393804B (en) Image correction method and device
CN113379636A (en) Infrared image non-uniformity correction method, device, equipment and storage medium
JP6838651B2 (en) Image processing equipment, image processing methods and programs
CN110702231A (en) Method for processing image
KR101911860B1 (en) Method and Apparatus for Detecting Road Using Camera Model and Filter in Depth Image
US20180150966A1 (en) System and method for estimating object size
US10652490B2 (en) Detection of bad pixels in an infrared image-capturing apparatus
CN111435080B (en) Water level measuring method, device and system
US10984536B2 (en) Motion detection in digital images and a communication method of the results thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20200707

Address after: 311501 building A1, No. 299, Qiushi Road, Tonglu Economic Development Zone, Tonglu County, Hangzhou City, Zhejiang Province

Applicant after: Hangzhou Haikang Micro Shadow Sensing Technology Co.,Ltd.

Address before: Hangzhou City, Zhejiang province 310051 Binjiang District Qianmo Road No. 555

Applicant before: Hangzhou Hikvision Digital Technology Co.,Ltd.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant