WO2015096824A1 - Analysis device and analysis method - Google Patents

Analysis device and analysis method Download PDF

Info

Publication number
WO2015096824A1
WO2015096824A1 PCT/CN2014/095438 CN2014095438W WO2015096824A1 WO 2015096824 A1 WO2015096824 A1 WO 2015096824A1 CN 2014095438 W CN2014095438 W CN 2014095438W WO 2015096824 A1 WO2015096824 A1 WO 2015096824A1
Authority
WO
WIPO (PCT)
Prior art keywords
analysis
thermal image
image data
information
data frame
Prior art date
Application number
PCT/CN2014/095438
Other languages
French (fr)
Chinese (zh)
Inventor
王浩
Original Assignee
王浩
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 王浩 filed Critical 王浩
Publication of WO2015096824A1 publication Critical patent/WO2015096824A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/02Constructional details
    • G01J5/026Control of working procedures of a pyrometer, other than calibration; Bandwidth calculation; Gain control
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/0096Radiation pyrometry, e.g. infrared or optical thermometry for measuring wires, electrical contacts or electronic systems
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/02Constructional details
    • G01J5/025Interfacing a pyrometer to an external device or network; User interface
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/48Thermography; Techniques using wholly visual means

Definitions

  • an analysis area such as a point, a line, a surface, and the like for the thermal image data frame.
  • an analysis mode such as an analysis calculation rule corresponding to the analysis region, such as calculating a maximum temperature, an average temperature, a minimum temperature, a percentage content, etc., and may also include analysis Calculation relationships between regions such as temperature differences; diagnostic rules, such as comparisons and thresholds corresponding to analysis regions and analysis modes.
  • diagnostic rules taking the analysis of cable terminations as an example, where the upper and lower parts of the body casing need to be set up, and then the analysis area is set, and then the maximum temperature and the temperature difference between each other are calculated; If the area is not accurately set at the above location, or the analysis mode setting is unreasonable, the correct analysis data cannot be obtained. Setting the diagnostic rules requires the user to be very proficient in the diagnosis of the subject, and the requirements are very high. The power industry involves dozens of types of subjects that require infrared detection. Depending on the voltage level, there may be thousands of types, and the technical difficulty can be considered.
  • the size of the analysis area and the like are also strictly required, because the analysis areas of different sizes, even if they are placed in the same part, the analysis results may be different, for example, the setting is too small, and may be missed.
  • the critical part range, if set too large, may be susceptible to interference.
  • the prior art requires manual setting of the analysis area, analysis mode, and diagnostic rule corresponding to the thermal image of the subject, and relies on the subjective experience of the user, and the drawbacks can be summarized as cumbersome operation and technical difficulty.
  • thermal imaging diagnostic apparatus that can easily set one or more of an analysis area, an analysis mode, and a diagnosis rule without excessively relying on the user's subjective idea, and solve the prior art problem.
  • the present invention provides an analysis apparatus and an analysis method, which automatically set one or more of an analysis area, an analysis mode, and a diagnosis rule when a specific subject thermal image is detected in the acquired thermal image data frame, and can perform diagnosis and / or notify the diagnosis results, thereby solving the prior art problems.
  • the analysis configuration unit is configured to arrange one or more of the following: the configuration data of the analysis region, the position parameter of the analysis region, the analysis mode, and the diagnosis rule according to the predetermined information obtained by the detection unit.
  • the analysis configuration step is configured to configure one or more of the following according to the specified information obtained by the detecting step: the composition data of the analysis area, the position parameter of the analysis area, the analysis mode, and the diagnosis rule.
  • Fig. 2 is a perspective view showing the thermal imaging device 100 of the first embodiment.
  • FIG. 3 is a schematic diagram of object information, diagnosis, object identification information, and the like stored in the storage medium of the first embodiment.
  • Fig. 6 is a display example of the diagnosis process of the first embodiment.
  • Fig. 8 is a diagram showing an example of display in which analysis area setting is performed in various ways.
  • Fig. 9 is a schematic diagram showing a comparison table (or correspondence relationship) between diagnosis and evaluation values.
  • Fig. 10 is a flowchart showing the control of the second embodiment.
  • Fig. 11 is a display example of the diagnosis process of the second embodiment.
  • Fig. 12 is a display example of the analysis area setting of the second embodiment.
  • Fig. 13 is a flowchart showing the control of the third embodiment.
  • Fig. 14 is a view showing a display example of the diagnosis process of the third embodiment.
  • Fig. 15 is a display example of a reference image.
  • FIG. 1 is a block diagram showing a schematic configuration of a thermal imaging device 100 as an example of an analysis device in the first embodiment.
  • the thermal imaging device 100 includes an imaging unit 1, a temporary storage unit 2, a flash memory 3, a communication I/F 4, a memory card I/F 5, a memory card 6, an image processing unit 7, a detection unit 8, and a display control unit 9,
  • the display unit 10, the control unit 11, the operation unit 12, and the control unit 11 are connected to the corresponding portion of the data bus 13 by control, and are responsible for overall control of the thermal image device 100.
  • the imaging unit 1 is composed of an optical member (not shown), a lens driving member, an infrared detector, a signal preprocessing circuit, and the like.
  • the optical component consists of an infrared optical lens for focusing the received infrared radiation onto the infrared detector.
  • the lens driving section drives the lens in accordance with a control signal of the control section 11 to perform a focusing or zooming operation. In addition, it can also be a manually adjusted optical component.
  • Infrared detectors such as infrared or non-refrigerated infrared focal plane detectors, convert infrared radiation through optical components into electrical signals.
  • the signal pre-processing circuit comprises a sampling circuit, an AD conversion circuit, a timing trigger circuit, etc., and the signal output from the infrared detector is sampled and processed in a predetermined period, and converted by the AD conversion circuit to obtain a digital thermal image data frame.
  • the thermal image data frame includes thermal image AD value data such as 14-bit or 16-bit binary data; the thermal image data frame is not limited to the inherent resolution of the infrared detector, and may be lower or higher than the infrared detector. rate.
  • the thermal image data frame is not limited to the analog signal output by the infrared detector, and may be obtained, for example, based on a digital signal output from the infrared detector itself.
  • the imaging unit 1 functions as an acquisition unit for acquiring a thermal image data frame.
  • the thermal image data frame is not limited to including thermal image AD value data; for example, image data of an infrared thermal image may be included, and for example, array data of temperature values or other data generated based on thermal image AD value data may be included.
  • the so-called thermal image data frame hereinafter is exemplified by data including thermal image AD values.
  • the temporary storage unit 2 is a buffer memory that temporarily stores a thermal image data frame output from the imaging unit 1 as a buffer memory that temporarily stores the thermal image data frame output from the imaging unit 1. For example, the following processing is repeated, and the acquired thermal image data frame is temporarily stored for a predetermined time portion.
  • a new frame is acquired by the acquisition unit, a new thermal image data frame is stored after the old frame is deleted, and a work memory such as the image processing unit 7, the detection unit 8, the control unit 11, and the like are temporarily stored. The data to be processed.
  • the flash memory 3 stores programs for control and various data used in the control of each part.
  • data related to detection and diagnosis is stored in a storage medium such as the flash memory 3, for example, a database storing subject identification information, and may be stored, for example, in a data file of a specific format or the like.
  • the configuration information such as the subject information, the subject identification information, the predetermined judgment value, the analysis data of the analysis region, the analysis mode, and the diagnosis rule are associated with each other and stored.
  • a predetermined positional relationship between the analysis area and the subject identification information (not shown in the table of FIG.
  • the positional relationship such as the positional parameter in the template, such as the base point position, is specified.
  • the positional relationship such as the positional parameter in the template, such as the base point position, is specified.
  • the positional relationship such as the positional parameter in the template, such as the base point position, is specified.
  • base point position size, such as base point position, size, rotation angle; for example, the analysis area is located in the position corresponding to the feature quantity, such as the base point position, such as the base point position, size, such as the base point position, size, rotation angle.
  • the subject information is information related to the subject, for example, information representing the location, type, number, and the like of the subject, and the generated subject indication information should allow the user to recognize the captured photographed subject.
  • the body may further include a belonging unit related to the subject, a classification level (such as a voltage level, an important level, etc.), a model, a manufacturer, performance and characteristics, a history of past shooting or overhaul, a date of manufacture, Various information such as the duration of use.
  • a classification level such as a voltage level, an important level, etc.
  • a model such as a voltage level, an important level, etc.
  • a model such as a manufacturer, performance and characteristics
  • a history of past shooting or overhaul a date of manufacture
  • Various information such as the duration of use.
  • the embodiment in which the subject identification information is associated with the subject information is a preferred embodiment, and various applicable subject information can be prepared depending on the application.
  • the object information is identity information of a representative object recognizable by the user, such as information representing the location, type, and phase of the subject; but may also be representative of the type of the subject. information.
  • the subject identification information is not limited to being associated with the subject information.
  • the so-called subject identification information for example, a template related to the calculation of the relevance, a feature amount, and the like; the so-called subject identification information may be, for example, a template for template matching; for example, it may be a feature quantity of the parameter description.
  • the template is, for example, a template image, for example, each pixel is a template of temperature value data or the like.
  • the feature quantity is a feature such as a point, a line, a surface, or the like in a specific area, for example, a value determined according to a state of a pixel included in the detection window, such as a ratio of a predetermined portion of pixels in a specific detection window, and a pixel value. The average value, the center point, area, etc.
  • the subject The corresponding subject identification information is the template image 301, and the subject identification information corresponding to the subject 2 is the feature amount 302.
  • a combination of one or more types of subject identification information may be selected depending on the situation.
  • the judgment value for example, compares the value of the correlation obtained by the detection with the judgment value, and determines whether or not there is a specific subject thermal image.
  • the predetermined judgment value is stored in the flash memory 3 in advance corresponding to the subject identification information, but other manners may be prepared, such as a judgment value temporarily set by the user.
  • composition data of the analysis area is used to set the analysis area, such as data representing points, lines, and faces, for example, vector graphic data, for example, bitmap image data, and the composition data of the analysis area may include the analysis area.
  • Information such as number, including number information of each analysis area when the analysis area is composed of a plurality of analysis areas.
  • the so-called analysis mode such as the analysis and calculation rules corresponding to the analysis area; for example, the temperature analysis based on the thermal image data determined by the analysis area is used to obtain the analysis result, and the analysis calculation rules are used, such as calculating the highest temperature, the average temperature, the lowest temperature, The percentage content and the like; and, may also include the calculation relationship of the analysis area of the same thermal image data frame and/or the analysis area between different thermal image data frames, such as temperature difference and the like.
  • the same analysis area may correspond to a plurality of different analysis modes, and the same analysis mode may correspond to a plurality of different analysis areas.
  • the diagnostic rule includes, for example, at least one comparison relationship and its diagnostic threshold corresponding to the analysis region and the analysis mode, or further associated with a diagnosis conclusion; the diagnosis conclusion, such as a diagnosis basis, a detailed defect type, a defect degree, Handling suggestions, etc.
  • the diagnosis conclusion such as a diagnosis basis, a detailed defect type, a defect degree, Handling suggestions, etc.
  • it includes at least one comparison relationship and its diagnostic threshold corresponding to the analysis mode, or further associated with a diagnosis conclusion; wherein the specific analysis region is omitted, and the analysis region can be generally applied to any analysis region to which the analysis mode is applied.
  • the analysis region, the analysis mode, the corresponding comparison relationship and its diagnostic threshold, or further associated with the diagnosis conclusion can also be understood as an overall diagnostic rule.
  • comparison relationships and diagnostic thresholds for the combination of the same analysis area and the analysis mode, there may be one or more comparison relationships and diagnostic thresholds, or corresponding one or more diagnostic conclusions respectively; for example, the diagnosis conclusions of normal, attention, and defects are respectively different. Compare relationships and diagnostic thresholds. Corresponding to one subject, there may be multiple diagnostic rules for different analysis areas and analysis mode combinations.
  • the diagnosis rule may be such a configuration that, corresponding to a plurality of analysis regions and analysis mode combinations, the evaluation values of the plurality of analysis results obtained are configured with a comparison relationship and a diagnosis threshold value corresponding to the evaluation values.
  • the evaluation values of the plurality of analysis results are obtained, for example, by weighting each of the weights of the plurality of analysis results.
  • the plurality of analysis results are not limited to one frame of thermal image data frames, but may be obtained based on analysis of a plurality of thermal image data frames.
  • the communication I/F 4 is an interface that connects and exchanges data between the thermal image device 100 and an external device in accordance with a communication specification such as USB, 1394, or network.
  • a communication specification such as USB, 1394, or network.
  • a personal computer, a server, and a PDA (personal digital assistant device) can be cited as an external device.
  • other thermal imaging devices such as visible light imaging devices, storage devices, and the like.
  • the analysis unit 6 may include an analysis configuration unit, an analysis area setting unit, an analysis unit, and a diagnosis unit.
  • the analysis configuration unit is configured to configure one or more of the following: the configuration data of the analysis area, the position parameter of the analysis area, the analysis mode, and the diagnosis rule according to the predetermined information obtained by the detection unit.
  • the position parameter of the analysis area is configured according to the position parameter of the specific subject thermal image obtained by the detecting unit;
  • the analysis area may be configured according to a positional parameter in which a specific subject thermal image is detected; in one example, a detection window, a template image, or the like in which a specific subject thermal image is detected is configured as an analysis area.
  • the constituent data of the analysis region is determined based on the constituent data of the analysis region associated with the subject identification information; based on the predetermined positional relationship between the subject identification information and the analysis region, and the specific The positional parameter of the thermal image in the thermal image data frame is configured to configure the positional parameter of the analysis area in the thermal image data frame.
  • the positional parameter of the analysis area is configured according to the positional parameter of the specific subject thermal image; and the positional parameter of the analysis area is analyzed according to the constituent data of different analysis areas such as a point, a line, a surface (such as a circle, a frame, etc.), for example, only Contains a position (such as a point), for example, including a position and a size, such as a position, a size, and a rotation angle.
  • the position of the analysis area (such as a point), or the position, size, or also the rotation angle of the analysis area (such as a frame) is set, for example, according to the position, size, and inclination angle of the specific subject thermal image.
  • the positional parameters of the analysis area may be a part thereof, for example, setting the position of the analysis area (such as a frame) according to the position of the thermal image of the subject, and the size and the rotation angle thereof are The default parameters.
  • the predetermined calculation target may be calculated according to a predetermined calculation rule, and the analysis region may be set based on the predetermined information obtained by the detection, for example, the positional parameter of the thermal image of the subject.
  • the calculation target such as the detection window, the template image, the thermal image data in the detection window, and other objects having a predetermined positional relationship with the subject identification information (such as an analysis region having a predetermined positional relationship) are defined.
  • the prescribed calculation rule includes at least cutting the specified calculation object, extracting features (for example, extracting characteristic pixels of a specified image range, extracting edges, etc.), scaling, deforming, dividing, dividing, calculating an outsourcing rectangle, and calculating Cutting a rectangle, calculating a center line, calculating a feature point, calculating an inner envelope, and calculating one or more of the outer envelope lines; in the storage medium, pre-storing parameters corresponding to the prescribed calculation rule (for example, based on the center point Scaled parameters: based on center point, zoom rate), or configured by the user.
  • extracting features for example, extracting characteristic pixels of a specified image range, extracting edges, etc.
  • scaling deforming, dividing, dividing, calculating an outsourcing rectangle, and calculating Cutting a rectangle, calculating a center line, calculating a feature point, calculating an inner envelope, and calculating one or more of the outer envelope lines
  • pre-storing parameters corresponding to the prescribed calculation rule for example, based on the center point Scaled parameters: based on center
  • the template T2 is used as a calculation object, and the analysis area F2 obtained after scaling and deformation using the center point as a base point can be used for analyzing and calculating the temperature distribution of a predetermined area on the body of the thermal image of the object. To reduce the impact of the surrounding environment on the assessment.
  • the template T3 is used as a calculation target, and an analysis area F3 that is equally divided into eight is provided; it can be used to analyze the thermal field distribution of different parts of the subject body in detail.
  • an analysis area F3 that is equally divided into eight is provided; it can be used to analyze the thermal field distribution of different parts of the subject body in detail.
  • the set analysis area contains multiple analysis areas, automatic numbering can be performed as needed, for example, the analysis area F3 includes the numbered analysis area F01-F08.
  • the edge image is extracted by the thermal image data TU5 in the detection window, and the obtained analysis region F5 of the edge contour can be used for analyzing and measuring the maximum temperature of the object, which can reduce the influence of the high temperature object in the background. .
  • the template image TU6 is extracted from a pixel point having a predetermined threshold or more, and the obtained analysis region F6 can be used for analysis and calculation of the subject feature portion.
  • the analysis area may be set according to the relationship between the detected information obtained by the specified information and/or the predetermined information and the analysis area, and the analysis mode may be configured according to the purpose of the infrared detection. .
  • the configuration data of the analysis region, the position parameter of the analysis region, the analysis mode, and the diagnosis rule are arranged based on the predetermined information detected by the detection unit.
  • the analysis configuration unit arranges the configuration data of the analysis area, the positional parameter of the analysis area, the analysis mode, and the diagnosis rule based on the above information to the specific subject thermal image.
  • the subject information and its associated subject identification information and analysis region configuration data, a predetermined positional relationship between the analysis region and the subject identification information, an analysis mode, and a diagnosis rule are stored in advance;
  • the selection unit is configured to Selecting subject information;
  • the detecting unit detects a specific subject thermal image based on the specific subject identification information associated with the selected subject information;
  • the analysis configuration unit configures the composition data of the analysis region based on the information, Analyze the location parameters, analysis mode, and diagnostic rules of the area.
  • the analysis configuration unit is based on the following factors:
  • the rest may be configured by other means such as the default of the thermal imaging device 100, for example.
  • the position data of the analysis area is set according to the detected position and size of the specific subject thermal image, but is configured according to the default analysis area composition data, analysis mode, and diagnostic rule; when analyzing the area, analyzing the mode, and diagnosing
  • the rules are not all determined by the detected regulatory information, but are also superior to the prior art.
  • the analyzing unit analyzes the analysis mode set by the configuration unit according to the analysis area set by the analysis area setting unit, analyzes the thermal image data frame, and illustrates the specific implementation manner of the analysis unit by taking temperature analysis as an example.
  • the analyzing unit extracts the analysis area from the analyzed thermal image data frame or the thermal image data frame subjected to predetermined processing such as correction and interpolation, based on the analysis area set by the analysis area setting unit.
  • the determined thermal image data is subjected to temperature value conversion processing to obtain temperature values corresponding to the thermal image data, and then the obtained temperature values are analyzed and calculated according to the analysis mode. For example, if the maximum value is calculated, the largest temperature value among them is extracted as the analysis result.
  • the analysis area includes a plurality of analysis area units, as shown in FIG. 6(b), the analysis area F1 has analysis area units S01 and S02, and sequentially converts the temperature values of the thermal image data in each analysis area unit.
  • the process of converting the thermal image data in the analysis region into a temperature value may be to convert all the thermal image data in the analysis region into a temperature value; or to convert the predetermined partial thermal image data into a temperature value; It is possible to determine the conversion of the thermal image data according to the different modes of calculating the highest, lowest, and average temperatures in the analysis mode, whether to convert part of the thermal image data in the analysis region, or all; for example, the analysis mode is the highest in the calculation analysis region.
  • the thermal image AD value can also be compared for the thermal image data in the analysis area.
  • the size, the largest thermal image AD value is converted into a temperature value, and it is not necessary to convert all the thermal image data in the analysis area into a temperature value.
  • the case where the algorithm is different is also included. For example, when calculating the highest temperature, the AD value of the adjacent pixel of the maximum average value is not converted into the temperature by the average value of the AD values of the predetermined number of adjacent pixels instead of a single pixel. A value and an average value of temperature values of the adjacent pixel thermal image data is taken as the highest temperature value.
  • the analysis unit 6 has a diagnosis unit that obtains an analysis result based on the analysis unit, performs diagnosis in accordance with the configured diagnosis rule, and obtains a diagnosis result.
  • the analysis results obtained by the analysis region (S01, S02) and the analysis mode include:
  • the analysis result is compared according to the diagnosis rule to obtain a diagnosis result; the output of the diagnosis result may also be a control signal and output to other external devices connected to the thermal image device 100.
  • the notification is performed according to the diagnosis result, for example, by controlling display changes of characters or images (including infrared thermal images, reference images, etc.) in the display unit 10 or the like; or light, sound prompts, vibrations, and the like generated by the indicator lights, As long as it is a method that users can perceive.
  • control display unit 10 displays the diagnosis conclusion, and further, the analysis area related to the diagnosis, the analysis mode, the comparison relationship and the corresponding diagnosis threshold, the diagnosis basis, the defect type, the defect degree, the treatment suggestion, etc.
  • the notification is made in a manner that the user can perceive, such as text, and accordingly, the data of the related data and the diagnostic rule can be prepared in advance, for example, stored in a storage medium.
  • a predetermined thermal image data frame is diagnosed.
  • the predetermined thermal image data frame may be a thermal image data frame in which a specific subject thermal image is detected; but is not limited thereto, and may be a frame before or after the timing of the frame, or more The frame obtained by the frame operation, and so on. Or it may be a predetermined multi-frame thermal image data frame.
  • the image processing unit 7 is configured to perform predetermined processing on the thermal image data frame obtained by the imaging unit 1, for example, a thermal image of a predetermined time portion temporarily stored in the temporary storage unit 2 when the display timing comes. In the data frame, the frame of each predetermined time interval is selected and read; the processing of the image processing unit 7 is converted into data suitable for display, recording, etc., such as correction, interpolation, pseudo color, synthesis, compression, decompression, and the like. deal with.
  • the image processing unit 7 can be realized by, for example, a DSP or another microprocessor, a programmable FPGA, or the like, or can be integrated with a processor such as the analysis unit 6, the detection unit 8, and the control unit 11.
  • the image processing unit 7 is configured to perform predetermined processing on the obtained thermal image data frame to obtain image data of the infrared thermal image. Specifically, for example, the image processing unit 7 performs predetermined processing such as non-uniformity correction and interpolation on the thermal image data frame obtained by imaging, and then performs pseudo color processing to obtain image data of the infrared thermal image; an embodiment of the pseudo color processing For example, the corresponding pseudo-color table range is determined according to the AD value range or the AD value setting range of the thermal image data frame, and the specific color value corresponding to the thermal image AD value data in the pseudo color plate range is taken as the infrared thermal image thereof. Image data corresponding to the pixel position.
  • a feature registration unit for registering subject identification information related to the correlation calculation.
  • the subject identification information may be registered according to the subject identification information stored in advance in the storage medium; for example, the subject identification information associated with the selected subject information of the user is registered with the correlation calculation Subject identification information. Further, the subject identification information may be specified by the user. For example, the subject identification information may be obtained by specifying the subject region from the displayed infrared thermal image, for example, obtaining a template image.
  • the registered subject identification information is stored, for example, at a predetermined position of the temporary storage unit 2, or is distinguished from other stored subject identification information by the mark when stored.
  • a detection window setting unit for setting a detection window, and one or more detection windows may be set based on the thermal image data frame or a specific detection area therein. For example, according to a certain range of detection areas (such as G1 in FIG. 5), a plurality of detection windows are disposed in the detection area G1, which may be a plurality of detection windows of different sizes, or may be a detection window after a further tilt, usually The size, tilt, and the like of the detection window may be preset according to the requirements of the photographing quality; as shown in FIG. 4, wherein FIG. 4(a) is a standard detection window, and FIG. 4(b) is a detection window according to the reduced size. 4(c) is a detection window set for the enlargement size, and FIG.
  • the detection area may be set by the user according to the shooting habits, for example, and one or more detection areas may be set according to the position and size specified by the user; for example, it may be pre-stored, such as associated with the subject information; or Set a specific detection area, that is, the range of the default thermal image data frame is the detection area.
  • the substation is filled with a large number of similarly shaped devices, but with different names, in order to avoid misleading users and accidental shooting, it is preferable to set the detection area. Overlapping the detection area on the infrared thermal image, using It is easy to understand the approximate position, size, and the like of the captured thermal image of the subject, and it is easy to take a reference. However, the detection area may not be displayed. Preferably, information such as a detection area related to the detection processing, a detection window setting, and the like is associated with the subject information together with the subject identification information.
  • the detecting unit compares the thermal image data in the detection window set by the detection window setting unit, for example, with the subject identification information, in the read thermal image data frame, to obtain a correlation for evaluating similarity The value of the degree.
  • a value of the maximum correlation obtained therein may be detected as a value of the correlation of the thermal image data frame.
  • the judging unit determines whether the value of the correlation degree is determined according to the predetermined judgment value to determine whether a specific subject thermal image is detected; for example, when the value representing the degree of similarity between the representative image and the template image exceeds the judgment In the case of a value, the frame is determined to be a frame including a specific subject thermal image, that is, a specific subject thermal image is detected.
  • the detection processing of the detecting unit 8 is based on the detection method of the feature amount described by the parameter.
  • the feature amount of the thermal image data in the detection window may be calculated as the value of the correlation degree according to the subject identification information; for example, the subject identification information may further include a feature amount reference value, and a predetermined operation may be performed to obtain the detection.
  • the feature quantity reference value is a prescribed pixel ratio of a specific pixel value
  • the detecting unit calculates the thermal image
  • the pixel ratio of a specific pixel value in the data is compared to obtain the value of the correlation, and the smaller the calculated difference is, the higher the correlation is.
  • the value of the correlation is compared with the judgment value to determine whether a specific subject thermal image is detected.
  • the contour image is used as the matched template image
  • the detecting unit 8 detects whether or not there is a specific subject in the thermal image data frame, for example, by the following processing; first, the detecting unit 8 extracts the thermal image data located in the detection window, And normalizing the thermal image data in the read detection window according to a predetermined threshold of the AD value; then, extracting the connected image of the binary image having the predetermined pixel value (1 or 0) connected; and then determining Whether the connected image has a predetermined range of size; if it is determined that the size of the connected image is within a predetermined range, a comparison process is performed between the extracted connected image and the registered template image, for example, between the two The sum of the ratios of the overlapping areas in the respective total areas obtains the value of the correlation; the larger the value, the higher the correlation; the value of the correlation is judged according to the specified judgment value to determine whether a specific one is detected Thermal image of the subject.
  • the detecting section 8 moves the window J1 from the upper left corner to the lower right corner of the predetermined detection area G1 of the thermal image data frame 501 to detect, cuts the thermal image data in the window, and detects it.
  • the range of the detected window size, window displacement, and tilt angle of the window is defined in advance, for example, the window size varies from 150 ⁇ 50 pixels to 120 ⁇ 40 pixels, and the range of window displacement varies. From 10 pixels to 1 pixel, the tilt angle of the window varies from 0° to 10° based on the center point. Detection unit 8 successively, each The window size is changed 5 pixels later, and the window displacement is changed 1 pixel at a time, and the window tilt angle is changed 2° each time.
  • the detecting unit 8 performs correlation calculation of the template image T1 and the thermal image data frame 501; after completing the detection of all the detection windows, the value of the correlation obtained by selecting the detection window with the highest correlation is selected as the thermal image data frame 501. The value of the corresponding relevance.
  • a notification may be made; for example, the position of the thermal image of the subject is indicated by displaying the diagnosis result, displaying the analysis region, and the like; Further, for example, a reduced infrared thermal image obtained by displaying a thermal image data frame of a maximum correlation within a predetermined time period or a notification of a character, a color, a flicker change, or the like is also displayed.
  • the information of the correlation degree is displayed; the information of the correlation degree, for example, the value of the correlation degree, the result of detecting the specific subject thermal image, etc., may be converted into information indicating the degree of matching that is easy for the user to understand, and displayed.
  • the value of the correlation is converted into a percentage value; in one example, the sum of the extracted specific object contour and the ratio of the overlap area of the contour T1 in the respective total areas is divided by 200%, which can be converted into The percentage value of the correlation, which converts the value of the correlation into a percentage value.
  • the control unit 11 controls the overall operation of the thermal imaging device 100, and stores a program for control and various data used for control of each part in a storage medium such as the flash memory 3.
  • the control unit 11 is realized by, for example, a CPU, an MPU, an SOC, a programmable FPGA, or the like.
  • control unit 11 is used as an example of the selection unit for selecting subject information; for example, the subject corresponding to the subject instruction information is selected according to the user's selection of the subject instruction information. information.
  • the operation unit 12 is for the user to perform various instruction operations or input various operations such as setting information, and the control unit 11 executes the corresponding program based on the operation signal of the operation unit 12.
  • the buttons for providing user operations include a record button 01, a focus button 02, a confirmation button 03, a play button 04, a menu button 05, a direction button 06, and the like; in addition, a touch screen 07 or a touch screen can be used.
  • a speech recognition component (not shown) or the like is used to implement related operations.
  • the control flow of the detection mode of the thermal image device 100 will be described.
  • the control unit 11 initializes the internal circuit, and then enters the imaging mode, that is, the imaging unit 1 captures a thermal image data frame, and the image processing unit 7 defines the thermal image data frame captured by the imaging unit 1.
  • the processing is stored in the temporary storage unit 2, and the infrared thermal image is continuously displayed in the form of a moving image on the display unit 10.
  • the control unit 11 performs its control. Continuously monitor whether the process of switching to another mode or the shutdown operation is performed according to a predetermined operation, and if so, the corresponding process control is entered.
  • the control mode of the detection mode is as follows:
  • the feature registration unit registers the subject identification information.
  • the control unit 11 displays the subject instruction information generated by the subject information on the display unit 10 based on the table stored in the flash memory 3, and the user operates by the subject "subject 1" at the shooting scene.
  • the portion 12 selects "subject 1" displayed on the display portion 10, and the feature registration unit determines the subject identification information for the detection processing based on the subject identification information associated with the "subject 1", from the flash memory
  • the template image 301 is read in 3 and transmitted to the temporary storage unit 2.
  • Step A02 the thermal image data frame is acquired, and the thermal image data frame obtained by the imaging unit 1 is transmitted to the temporary storage unit 2;
  • step A03 the thermal image data frame obtained by the image capturing unit 1 for example, for example, is detected in the temporary storage unit 2, the detection window setting unit is set, and the detection window is set. For example, based on the upper left corner of the prescribed detection area G1, a detection window is first set;
  • step A04 the processing of the correlation calculation is performed based on the subject identification information on the thermal image data in the detection window.
  • the detecting unit 8 extracts the thermal image data located in the detection window based on the detection window set by the detection window setting unit, and calculates the correlation between the two based on the template registered by the feature registration unit. For example, according to the thermal image data in the detection window, the contour of the extracted specific subject thermal image is compared with the contour of the contour image T1 (obtained by the template image 301), and the overlapping area between the two is calculated in the respective total areas. The sum of the ratios.
  • step A05 the value of the obtained correlation is stored.
  • step A06 the detecting section 8 judges whether or not the correlation degree has been calculated for all the detection windows when the detection window is set in the thermal image data frame. If there is no area where the correlation has not been calculated yet (NO in step A06), the process returns to step A03, and the detection window setting unit shifts the position of the detection window by a predetermined number of pixels in a predetermined direction, and sets the position as the detection window. Next position and repeat the subsequent processing.
  • the detection processing similar to that described above is also performed when the detection window is enlarged and reduced and the detection window is tilted by a predetermined angle.
  • step A09 after detecting the thermal image data frame having the specific subject thermal image, the analyzing unit 6 performs thermal imaging diagnosis on the thermal image data frame to obtain a diagnosis result.
  • the analysis area is set based on the position and size of the detection window B1 having the highest correlation, and the analysis area F1 shown in FIG. 6(b) is analyzed in accordance with the analysis mode 1 corresponding to the analysis area F1, and then the diagnosis is performed.
  • the position, size, and inclination angle of the window B1 in the thermal image data frame are detected, and the positional parameter of the analysis area located in the thermal image data frame is calculated. And then the composition of the analysis area The data is subjected to corresponding scaling and the like, and the obtained constituent data of the analysis region and the positional parameters of the analysis region are used as configuration information.
  • the detected positional parameters of the position, size, inclination angle, and the like of the specific subject thermal image are not limited to the positional parameters of the detection window, for example, further extracting features of the thermal image data in the detection window, for example, extraction
  • the subject contour is used to obtain a more accurate positional parameter, and the analysis area can be set according to the positional parameter.
  • the analysis area setting unit sets the analysis area F1, including the analysis areas S01 and S02, to the thermal image data frame according to the configuration information of the analysis area, for example, the calculation of the position parameter, the corresponding scaling, and the like;
  • the analysis unit analyzes according to the analysis area F1 set by the analysis area setting unit and the corresponding analysis mode 1, and obtains the analysis result; the diagnosis unit, according to the analysis result, the diagnosis rule 1 corresponding to the analysis area F1 and the analysis mode 1 ", to get the diagnosis.
  • the analysis area F1 the analysis result and the display column of the diagnosis result, wherein the difference between the highest temperature of S01 and S02 is 3 ° C, less than 4 ° C, and more than 2 ° C; diagnosis conclusion and comment: attention. Note that the analysis area F1, the analysis result, and the diagnosis result do not have to be displayed.
  • the diagnosis result can be notified, and the notification display unit 10 displays the diagnosis result and the like.
  • the change of the display screen of characters or images (including infrared thermal images, reference images, etc.) in the display unit 10 or the like the light generated by the indicator light in the thermal image device 100, the sound prompt from the speaker, and the vibration component are accompanied by changes. Vibrations, etc., are included as long as they are perceptible by the user.
  • analysis and/or diagnostic results may also be output, such as output from communication interface I/F 4, received by other external devices connected to thermal imaging device 100.
  • the user does not have to manually set the analysis area, the analysis mode, and the diagnostic rule by subjectively judging the morphological characteristics of the subject thermal image, thereby reducing the workload of the analysis area setting operation and reducing the technical difficulty of the analysis area setting. It is convenient to set accurate analysis area, analysis mode, diagnosis rule, quickly obtain the diagnosis result, avoid the harmful effect of shooting the wrong part and angle.
  • the detection unit 8 performs detection processing based on the thermal image data frames continuously acquired by the acquisition unit. For example, all of the continuously acquired thermal image data frames may be sequentially detected. For example, only the thermal image data frames of a predetermined interval may be read.
  • the detection processing is performed; for example, the processing of the thermal image data in the read thermal image data frame or the detection window is reduced, sparse, and the like before the detection; thereby, the detection processing load can be reduced.
  • the configured analysis region, analysis mode, and diagnostic rule are not limited to processing the thermal image data frame in which the specific subject thermal image is detected, and are also used for subsequent newly obtained thermal image data frames such as predetermined time. Analytical diagnosis and other processing.
  • the temporary storage section 2 stores a plurality of frames of thermal image data frames, it can be used to analyze and diagnose a thermal image data frame before the timing of detecting a thermal image data frame having a specific subject thermal image.
  • the above-configured information may be stored in a predetermined area of the temporary storage unit in association with each other; and subsequent processing such as display, analysis, and recording may be facilitated.
  • whether or not a specific subject thermal image is detected is not limited to a comparison between the value of the correlation and the judgment value; for example, it may be replaced with a predetermined information obtained based on the detection and/or a rating based on the prescribed information.
  • the value, the result of comparison with the corresponding judgment value is used as a basis for detecting whether or not a specific subject thermal image is detected.
  • the predetermined information includes at least one of a position, a size, an inclination angle, and a value of a correlation of a specific subject thermal image, or any combination thereof. In this way, for example, The preferred position and size of the thermal image of the subject can improve the quality of the subject's thermal image, thereby further improving the effectiveness of the analysis area setting and improving the photographing quality.
  • the speed of detection can be speeded up, and the display can facilitate the user to understand the range of shooting; when a specific subject thermal image is detected, it can be automatically set.
  • the composition data of the associated analysis area, and the specified positional relationship between the analysis area and the object identification information, to set the analysis area can set an extremely accurate analysis area; can facilitate the next processing and operation of storage, analysis, etc. The problem of the prior art is solved.
  • Embodiment 1 is a preferred embodiment, and of course, it is not necessarily required to achieve all of the advantages described above while implementing any of the embodiments of the present invention.
  • the combination of the same or different analysis areas, analysis modes, and diagnostic rules can be arranged; and the predetermined information obtained by the detecting unit 8 can be determined, for example, according to the regulations obtained by the detection.
  • the corresponding analysis area and/or analysis mode and/or diagnostic rule are configured by the information and/or the evaluation value obtained by the specified information, the correspondence relationship with the analysis area and/or the analysis mode and/or the diagnostic rule.
  • the prescribed information includes at least information of a position, a size, an inclination angle, a correlation value of a specific subject thermal image, one or any combination thereof.
  • the evaluation value obtained by one or more of the specified information and the one or more of the same or different information in the information may be corresponding to the analysis area and/or the analysis mode and/or the diagnostic rule. Relationships to configure the corresponding analysis area and/or analysis mode and/or diagnostic rules.
  • the predetermined information having a direct correspondence with the analysis area and the predetermined information for obtaining the evaluation value may include the same or different information.
  • the respective analysis area and/or analysis mode and/or diagnostic rules may represent analysis areas and/or analysis modes and/or diagnostic rules of the same or different analysis effects, and/or the same Or an analysis area with different display effects.
  • the analysis area and/or analysis mode and/or diagnostic rule of different analysis effects may include, for example, composition data of the analysis area, positional parameters of the analysis area in the thermal image data frame, analysis mode, and diagnostic rules, one of which is different.
  • the analysis area of different display effects may include, for example, a difference in color, line shape, thickness, transparency, content, blinking state, brightness, composition data, and size.
  • the thermal image of the object in the infrared thermal image is taken into consideration, different photographing qualities are corresponding; therefore, preferably, the thermal image of the subject is located in the thermal image.
  • Factors such as position, size, and tilt angle in the data frame are used as factors for configuring the analysis area and/or analysis mode and/or diagnostic rule of the corresponding analysis effect and/or display effect to improve the quality of analysis and diagnosis.
  • analysis configuration information includes at least one or more related configuration information in the analysis area, the analysis area, and the diagnosis rule; for example, different evaluation values correspond to different analysis areas, analysis modes, and combinations of diagnosis rules.
  • the comparison table of the evaluation value and the analysis configuration information assumes that "subject 1" in FIG. 3 corresponds, and different evaluation values correspond to different analysis configuration information; wherein the evaluation value is 80-90% and The evaluation value is 91%-100%, and the analysis configuration information of the analysis area, analysis mode, and diagnosis rule corresponding to the two is different.
  • the specific information in the detected prescribed information may correspond to different coefficients, and the other specified information in the detected prescribed information is combined with the coefficient to obtain an evaluation value;
  • FIG. 11(a) detects the corresponding 0.8 of the window J1
  • FIG. 11(b) detects that the window coefficient of the window J2 is 0.95
  • the evaluation value the value of the correlation degree ⁇ the window coefficient
  • the value of the correlation is combined with the evaluation value of the detection window J1 (for example, converted to 80%), and the analysis region J1 of FIG. 11(a) and the analysis region of FIG. 11(b) are obtained based on the analysis region corresponding to the evaluation value. J2 and analysis area F1, and their respective analysis modes and diagnostic rules.
  • a detection window in which a specific subject thermal image is detected for example, a positional parameter representing a general image of the specific subject, such as a positional parameter that is desired to obtain a more accurate specific subject thermal image, and an embodiment may further By extracting the contour of the specific subject thermal image from the thermal image data corresponding to the detection window, a more accurate evaluation value can be obtained.
  • the weights of different information are used, and the evaluation values are obtained by weighting.
  • the evaluation value may be obtained according to other factors, for example, in combination with the parameters required by the specific industry, in combination with the prescribed information obtained by the detection; the final evaluation value may be obtained by various calculation methods.
  • the evaluation table obtained from the predetermined information and/or the predetermined information and the comparison table between the analysis configuration information are prepared in advance according to the different subjects, and the subject information and the subject identification information in FIG. 3 are prepared. Corresponding storage.
  • Step B01 obtaining a thermal image data frame, for example, the thermal image data frame obtained by the imaging unit 1 is transmitted to the temporary storage unit 2;
  • Step B02 is similar to steps A01 and A03-A06 of Embodiment 1, and the description is omitted;
  • Step B03 the detecting unit 8 obtains the value of the correlation degree of the detection window of the maximum correlation degree in the thermal image data frame and the corresponding position parameter thereof;
  • step B04 if the obtained correlation degree is smaller than the predetermined determination value, the detecting unit 8 determines that the specific subject thermal image is not detected, and proceeds to step B06, and when the correlation degree detected in step B04 is greater than the predetermined determination value, enters Step B05.
  • the analysis unit 6 configures the corresponding value based on the correspondence between the evaluation value and the analysis arrangement information as shown in FIG. 9 based on the obtained evaluation information and the detected position and size of the specific subject thermal image. Analysis area, analysis mode, diagnostic rules;
  • the evaluation value 80% shown in Fig. 11(a) is set to the analysis area J1; the evaluation value shown in Fig. 11(b) is 95%, and the analysis area J2 and the analysis area F1 are set.
  • J1 and J2 are analysis area setting units, and the detection window is set as an analysis area, according to which the analysis area can effectively avoid the influence of other objects in the background on the analysis of the subject thermal image, and F1 For more detailed analysis of the area, for further detailed analysis and diagnosis.
  • the analysis area, the analysis result, the diagnosis result, and the infrared thermal image obtained by the thermal image data frame may be combined and overlapped, and then displayed.
  • step B06 it is judged whether to exit, if it is exited, it ends. If it is not exited, it returns to step B01, and the above processing is repeated.
  • the corresponding analysis region, analysis mode, and diagnostic rule can be automatically set. Improve the quality of the analysis area and analysis mode, prompt the user, and avoid the cumbersome operation of the user settings.
  • Embodiment 3 is different from Embodiments 1 and 2 in that the detecting unit 8 is configured to detect predetermined information of a specific subject thermal image in the thermal image data frame based on the acquired thermal image data frame;
  • the analysis unit 6 arranges the analysis region and/or the analysis mode and/or the diagnosis rule related to the analysis based on the predetermined auxiliary information and the predetermined information that the detection unit 8 detects, and according to the configured analysis region and/or Analyze patterns and/or diagnostic rules for analysis and diagnosis.
  • the evaluation value is obtained based on the predetermined auxiliary information and the predetermined information, and the analysis region and/or the analysis mode and/or the diagnostic rule are arranged based on the comparison table of the evaluation value and the analysis configuration information, and the analysis diagnosis is performed.
  • the analyzing configuration information includes at least one or more related configuration information in an analysis area, an analysis area, and a diagnosis rule;
  • the predetermined information includes at least one of a position, a size, an inclination angle, and a value of a correlation of a specific subject thermal image, or any combination thereof.
  • the auxiliary information may include various factors other than the prescribed information that affect the analysis and diagnosis, and are all within the scope thereof.
  • the auxiliary information includes, for example, at least one of an analysis value, a diagnosis result, an ambient temperature, a background factor, a wind speed, a humidity, a distance, or any combination.
  • the acquired analysis values may be for all pixels in the thermal image data frame or pixels in a particular analysis region; for example, by ambient temperature to obtain ambient temperature; for example, by a hygrometer to obtain humidity; for example, by a rangefinder to obtain a thermal image
  • the auxiliary information may be acquired, for example, according to the auxiliary information stored in advance in the storage medium, for example, historical data of the auxiliary information; or the auxiliary data acquired in combination with the current measurement, and the historical data of the auxiliary information stored in advance in the storage medium.
  • the auxiliary information For example, the auxiliary information set by the user can also be performed.
  • the comprehensive evaluation value is obtained by specifying the information and the auxiliary information; for example, the specific information in the predetermined information or the auxiliary information may be used to correspond to different coefficients, and the other predetermined information or auxiliary information may be combined with the coefficient to obtain the evaluation value.
  • the weight of the specific information may be used to obtain the evaluation value by weighting; for example, obtaining the value of the position, size, inclination angle, auxiliary information, and correlation of the specific subject thermal image, and obtaining the evaluation Value
  • the evaluation value is obtained based on the prescribed information and a comparison table of the auxiliary information and the comprehensive evaluation value.
  • the analysis area and/or the analysis mode and/or the diagnostic rule are then configured based on a correspondence between the evaluation value and the analysis area and/or the analysis mode and/or the diagnostic rule, such as a comparison table of the evaluation value and the analysis configuration information.
  • step C01 the thermal image data frame is acquired, and for example, the thermal image data frame obtained by the imaging unit 1 is transmitted to the temporary storage unit 2.
  • Step C02 the detection processing is similar to the steps A01 and A03-A06 of the first embodiment, and the description is omitted;
  • Step C03 the detecting unit 8 obtains the value of the correlation degree of the detection window of the maximum correlation degree in the thermal image data frame and the corresponding position parameter thereof;
  • step C04 if the correlation obtained by the predetermined number of detection windows is smaller than the predetermined determination value, the detecting unit 8 determines that the specific subject thermal image is not detected, returns to step C01, repeats the subsequent processing, and detects in step C04. If the degree of correlation is greater than the predetermined judgment value, the process proceeds to step C05.
  • Step C05 the analyzing unit 6 configures the corresponding analysis area, the analysis mode, and the diagnosis rule according to the obtained auxiliary information and the predetermined information obtained by the detection;
  • the display interface is as shown in FIG. 14.
  • the analysis area J1 and the corresponding analysis mode and diagnosis rule are set according to the evaluation value of 80%;
  • FIG. 14(b) In the middle, based on the evaluation value of 95%, the analysis area J1 and the corresponding analysis mode and diagnosis rule are set, and the area F1 and the corresponding analysis mode and diagnosis rule are analyzed.
  • the analysis value and the diagnosis result can be obtained by analyzing and diagnosing according to the above analysis region and the analysis mode diagnosis rule.
  • the set analysis area F1 can reduce environmental disturbances such as the reflection of the edge of the surface of the object due to the difference in evaluation values.
  • the auxiliary information is an analysis value obtained by analyzing the analysis component
  • the analysis value is determined based on the analysis value (the highest temperature in the detection window) or in combination with other auxiliary information and predetermined information.
  • it may be configured to go through a plurality of such processes: "Step S1, obtain an evaluation value or an analysis value, such as obtaining an evaluation value according to the prescribed information and the auxiliary information, and step S2 sets the analysis area according to the correspondence relationship in the comparison table.
  • Step S3 obtains the analysis value, and returns to step S1 to repeat steps S1-S3", thereby, until the final analysis area, and the corresponding analysis mode and diagnosis rule are set.
  • the analysis of the thermal image of the subject can be performed in a more detailed manner based on the analysis region set by the evaluation value of 95%.
  • the analysis area (detection window) and its analysis mode are set based on the evaluation values obtained by the auxiliary information other than the analysis value and the predetermined information, and then based on the obtained analysis value and the prescribed value. Compare the comparison values (or find the corresponding comparison table) to determine whether to set the analysis area again.
  • the specified comparison value is 40 ° C (the judgment threshold of whether the subject temperature exceeds the standard).
  • the analysis value the highest temperature in J1
  • Fig. 14 (b) According to the analysis value (the highest temperature in J2) is 50 ° C, the analysis needs to be set again.
  • the region, and then the analysis region F1 set according to the comparison table of the analysis value and the analysis region and the corresponding analysis mode and diagnosis rule; the analysis result and the diagnosis result of the analysis region F1 can be further analyzed in detail.
  • the predetermined information having a direct correspondence relationship with the analysis region and the predetermined information for obtaining the evaluation value may include the same or different information.
  • the auxiliary information having a direct correspondence with the analysis area and the auxiliary information for obtaining the evaluation value may include the same or different information.
  • the analysis area, the analysis mode, and the diagnosis rule can be comprehensively considered, and the cumbersome operation for improving the analysis efficiency and avoiding the user setting can be further achieved.
  • the fourth embodiment has a recording unit for specifying recording information of one or more of an analysis area, an analysis mode, a diagnosis rule, an analysis result, and a diagnosis result set in the above embodiment, and a predetermined thermal image data frame. Associated records.
  • the control unit 11 includes a recording unit (not shown) to perform recording control. For example, based on the detection result of the detecting section 8, in response to the recording instruction, the thermal image data frame to be subjected to the recording processing is selected from the thermal image data frames stored in the temporary storage section 2, and the selected thermal image data frame is performed. Record processing control.
  • the predetermined thermal image data frame is associated with the predetermined recording information for recording.
  • the predetermined thermal image data frame is data obtained by performing predetermined processing on a thermal image data frame obtained by the imaging unit and/or a thermal image data frame obtained by the imaging unit 1 .
  • One or a plurality of kinds of processes such as correction, interpolation, pseudo color, conversion to temperature value, down pixel, compression, and the like are specified.
  • the temporary storage unit 2 specifies the detection of the specific subject thermal image held in the area and sets the thermal image data frame corresponding to the analysis area. Further, the thermal image data frame obtained by the infrared detector reading the signal at the time when the specific subject thermal image is detected (or a predetermined time thereafter) may be determined; or the temporary storage unit 2 may be used. The thermal image data frame with the highest correlation selected in the stored multi-frame thermal image data frame; in addition, a predetermined number of multi-frame thermal image data frames may be recorded; or a predetermined number of multi-frame thermal image data may be used.
  • the specified record information may be the set analysis area and/or the analysis result and/or the diagnosis rule, including the position parameter (position, or also including the size, or also the rotation angle) of the analysis area in the infrared thermal image.
  • the recording unit controls to associate the predetermined recording information with the compressed thermal image data frame, generate a thermal image file to be recorded on the memory card 8, and end the processing.
  • An embodiment of the association record wherein the predetermined record information is added as information of a thermal image data frame of a predetermined format.
  • the association record processing also means that the prescribed record information can be recorded in an information file or an index file associated with the thermal image file, and the recording portion can generate the information file or the index file.
  • the recorded storage medium is not limited to the memory card 8, the flash memory 9, and the like, and may be a network destination that is communicated through the communication unit 4.
  • an analysis region of a predetermined position and a corresponding analysis mode and a diagnosis rule may be prepared in advance, and when a specific subject thermal image is detected, analysis is performed according to the analysis region, an analysis result is obtained, and diagnosis is performed; or The analysis and diagnosis are continuously performed, but the diagnosis result is not notified, and the diagnosis result is notified when a specific subject thermal image is detected.
  • the diagnosis result is notified, for example, the diagnosis result is displayed; for example, the diagnosis result is output through the communication I/F 4; for example, although the analysis and the diagnosis result are displayed, when a specific subject thermal image is detected, a specific notification method is accompanied (for example, at At this time, the analysis and the diagnosis result are accompanied by discoloration, flicker, vibration of the thermal imaging device 100, etc.; for example, although the analysis or diagnosis result is output, However, when a specific subject thermal image is detected, it is accompanied by a specific notification method (for example, the analysis or diagnosis result output at this time is marked).
  • thermal image data frame from the outside
  • a thermal imaging device or a thermal image processing device for example, acquiring a thermal image data frame from other components, and also forming a thermal image data frame.
  • Embodiments of the invention are not limited to photographing or acquiring a thermal image data frame from the outside, and may be used as a constituent component or a functional module in a thermal imaging device or a thermal image processing device, for example, acquiring a thermal image data frame from other components, and also forming a thermal image data frame.
  • a notification unit is preferably provided for notifying (such as display, voice, etc.) diagnostic results such as diagnosis conclusions; other notification methods such as changing the pseudo color of the image to notify the diagnosis result, but also There is no notification department, such as the network destination that communicates the diagnosis result through the communication I/F4.
  • Subject identification information may be a template or feature quantity.
  • the plurality of feature quantities in the corresponding detection window may be calculated according to the plurality of feature quantities of the template, and the determination result is obtained according to the comparison value corresponding to the plurality of feature quantities, for example, according to the plurality of feature quantities. Weighted to get the final judgment result.
  • a comparison result of one of the feature quantities and the infrared thermal image may be first calculated. When the value is greater than a predetermined threshold, the comparison result of the next feature quantity and the infrared thermal image is calculated, and the comparison result is obtained according to multiple comparisons. The final judgment result.
  • an analysis configuration unit an analysis area setting unit, an analysis unit, a diagnosis unit, and the like
  • whether or not the specific subject thermal image is detected is not limited to the comparison between the value of the correlation degree and the judgment value of the correlation degree; and may be modified into, for example, the evaluation value obtained based on the predetermined information obtained by the detection and the predetermined information. And one or more of the evaluation values obtained by the prescribed information and the auxiliary information, or an evaluation value obtained by combining the auxiliary information and the auxiliary information, one or more of which is compared with the prescribed judgment value. Decide whether a specific subject thermal image is detected. Preferably, whether a specific subject thermal image is detected is determined based on the detected position, size, tilt angle, value of the correlation, and/or the evaluation value obtained by the information, compared with the specific comparison value.
  • a display control unit for controlling an infrared thermal image obtained by displaying the acquired thermal image data frame and a reference image at a predetermined position; and a detecting unit for detecting based on the acquired thermal image data frame Whether there is a specific subject thermal image; the analysis configuration portion, the configured analysis region, and the analysis region are configured according to an object having a predetermined positional relationship with the reference image (for example, an analysis region associated with the reference image. As shown in FIG.
  • the detection region J15 may also be set according to the positional parameter of the reference image T15 located in the infrared thermal image (for example, according to the outer rectangle of the reference image, the predetermined ratio is obtained Detection area); and user-friendly Shooting according to the position and size and morphological features of the reference image T1 speeds up the detection process and ensures the quality of the shooting.
  • the corresponding subject identification information can be prepared, for example, the reference image T15 can also be used as a template for the detection process.
  • control unit 11 the image processing unit 7, the analysis unit 6, and the like include a plurality of processors, there may be parallel processing to which some steps are applied.
  • the analysis configuration step is configured to configure one or more of the following according to the specified information obtained by the detecting step: the constituent data, the position parameter of the analysis area, the analysis mode, and the diagnosis rule.
  • Embodiments of the present invention also provide a readable storage medium storing a computer program for electronic data exchange, wherein the computer program causes a computer in the thermal image device to perform the above steps.
  • the functional blocks in the drawings may be implemented by hardware, software modules, or a combination thereof, it is generally not necessary to provide a one-to-one correspondence to implement the structure of the functional blocks.
  • a block of multiple functions can be implemented by one software or hardware module.
  • a block of functionality can be implemented by multiple software or hardware units.
  • the processing and control functions of some or all of the functional portions of the embodiments of the present invention may also be implemented by a dedicated circuit or a general purpose processor or a programmable FPGA.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Radiation Pyrometers (AREA)
  • Investigating Or Analyzing Materials Using Thermal Means (AREA)

Abstract

An analysis device and an analysis method, which relate to the application field of thermal image analyses. For a thermal image device in the prior art, a thermal image needs to be observed depending on the subjective experience of a user during shooting; alternatively, an analysis region, an analysis mode and a diagnosis rule for a thermal image of a shot object are manually set, thereby obtaining analysis and diagnosis results. Such analysis device can automatically set an analysis region, an analysis mode and a diagnosis rule for a thermal image of a shot object according to the detected prescribed information about the thermal image of the specific shot object, or perform analysis and diagnosis processing as well so as to make the operation of shooting simple and increase the accuracy of analysis and diagnosis, thereby being beneficial to processing or operations of further performing analysis, diagnosis, recording and so on.

Description

分析装置和分析方法Analysis device and analysis method 技术领域Technical field
本发明的分析装置和分析方法,涉及热像分析的应用领域。The analysis device and analysis method of the present invention relate to the field of application of thermal image analysis.
背景技术Background technique
在热像分析时,为获得对被摄体热像的分析数据和诊断结果,目前,需要人工对热像数据帧设置分析区域、分析模式、诊断规则,分析区域例如点、线、面等一个或多个区域的组合,对应被摄体热像需要分析的部位;分析模式,例如分析区域对应的分析计算规则,如计算最高温度、平均温度、最低温度、百分比含量等,以及还可包括分析区域之间的计算关系如温差等;诊断规则,例如与分析区域和分析模式,相对应的比较关系及阈值等。In the thermal image analysis, in order to obtain the analysis data and diagnosis results of the thermal image of the subject, at present, it is necessary to manually set an analysis area, an analysis mode, a diagnosis rule, and an analysis area such as a point, a line, a surface, and the like for the thermal image data frame. Or a combination of multiple regions, corresponding to the part of the subject's thermal image that needs to be analyzed; an analysis mode, such as an analysis calculation rule corresponding to the analysis region, such as calculating a maximum temperature, an average temperature, a minimum temperature, a percentage content, etc., and may also include analysis Calculation relationships between regions such as temperature differences; diagnostic rules, such as comparisons and thresholds corresponding to analysis regions and analysis modes.
分析区域、分析模式、诊断规则的设置,当由人工完成,操作非常繁琐;目前的操作步骤一般是先选择分析区域的构成数据,例如点、线、面;而后,将分析区域设置在红外热像中,并调整分析区域位于红外热像中的位置参数;如设置多个分析区域时,将设置操作多次。而后,根据分析区域的编号,来输入分析模式;而后根据分析模式,来编排诊断规则。The analysis area, analysis mode, and diagnostic rule settings are very cumbersome when done manually; the current operation steps generally select the constituent data of the analysis area, such as points, lines, and faces; then, set the analysis area to infrared heat. In the image, and adjust the position parameter of the analysis area in the infrared thermal image; if multiple analysis areas are set, the operation will be set multiple times. Then, according to the number of the analysis area, the analysis mode is input; and then the diagnosis rule is arranged according to the analysis mode.
人工设置分析区域、分析模式、诊断规则的操作,技术要求非常高;因为对于被摄体热像,分析区域对应的部位、应用的分析模式、诊断规则等都有非常严格的要求,需要使用者对被摄体热像分析具有非常强的专业性;例如,在电力行业,根据电力行业规范的规定,各种被摄体例如开关、避雷器、电缆终端等均有特定分析的部位及特定的分析模式、诊断规则,以电缆终端的分析为例,其中需要对其本体套管的上部和下部的规定部位,设置分析区域,而后,来计算各自的最高温度、及相互之间的温差;如果分析区域没有精确地设置在上述部位,或分析模式设置不合理,则无法获得正确的分析数据。而设置诊断规则,则需要使用者对被摄体的诊断依据等非常精通,要求非常高。而电力行业涉及的需要红外检测的被摄体种类达几十种,根据不同的电压等级来分,可能达上千个类型,可想其中的技术难度。Manually setting the analysis area, analysis mode, and diagnostic rules, the technical requirements are very high; because the thermal image of the subject, the corresponding part of the analysis area, the analysis mode of the application, and the diagnostic rules have very strict requirements, requiring users. It has a very strong professionalism in the thermal image analysis of the subject; for example, in the power industry, according to the regulations of the power industry, various subjects such as switches, arresters, cable terminals, etc. have specific analysis parts and specific analysis. Modes, diagnostic rules, taking the analysis of cable terminations as an example, where the upper and lower parts of the body casing need to be set up, and then the analysis area is set, and then the maximum temperature and the temperature difference between each other are calculated; If the area is not accurately set at the above location, or the analysis mode setting is unreasonable, the correct analysis data cannot be obtained. Setting the diagnostic rules requires the user to be very proficient in the diagnosis of the subject, and the requirements are very high. The power industry involves dozens of types of subjects that require infrared detection. Depending on the voltage level, there may be thousands of types, and the technical difficulty can be considered.
并且,在进一步深入的应用中,分析区域的尺寸等也有严格的要求,因为不同尺寸的分析区域,即便设置在相同的部位,其分析结果也可能不同,例如设置的太小,有可能遗漏了关键的部位范围,如设置的太大,则有可能导致容易受干扰因素影响。Moreover, in further in-depth applications, the size of the analysis area and the like are also strictly required, because the analysis areas of different sizes, even if they are placed in the same part, the analysis results may be different, for example, the setting is too small, and may be missed. The critical part range, if set too large, may be susceptible to interference.
在更为深入的应用中,还对分析区域的编号,有规范的要求,否则,同类被摄体的相同部位,如果设置了不同编号的分析区域,即便各自的分析模式、诊断规则是正确的,后续仍很难进行相互之间的对比。In more in-depth applications, there are also specifications for the number of analysis areas. Otherwise, if the same part of the same type of object is set with different numbered analysis areas, even if the respective analysis mode and diagnostic rules are correct. It is still difficult to compare them with each other.
而对于很多类型的被摄体拍摄获得的被摄体热像而言,如要追求精细的分析结果,需要设置较多的分析区域和更为复杂的分析模式、诊断规则,这时,操作极为繁琐易错。For the thermal image of the subject obtained by many types of subjects, if you want to pursue detailed analysis results, you need to set more analysis areas and more complicated analysis modes and diagnostic rules. It is cumbersome and error-prone.
此外,即便是非常有经验的使用者,由于拍摄的热像并不一定能满足分析的要求,这时,即便进行了细致的设置,也未必能获得满意的分析结果。目前,对于很多用户,由于拍摄时设置操作过于繁琐和技术性太强,因此热像的拍摄工作和分析区域、分析模式、诊断规则的后续设置工作,往往由不同的人员完成,也加剧了这种情况。In addition, even a very experienced user, because the thermal image taken does not necessarily meet the requirements of the analysis, even if the detailed settings are made, it may not be possible to obtain satisfactory analysis results. At present, for many users, because the setting operation is too cumbersome and technically strong during shooting, the shooting work of the thermal image and the subsequent setting work of the analysis area, analysis mode, and diagnostic rules are often completed by different personnel, which also aggravates this Happening.
综上,现有技术需要人工设置被摄体热像对应的分析区域、分析模式、诊断规则,需要依赖使用者的主观经验,其弊端可总结为操作繁琐、技术难度大等。In summary, the prior art requires manual setting of the analysis area, analysis mode, and diagnostic rule corresponding to the thermal image of the subject, and relies on the subjective experience of the user, and the drawbacks can be summarized as cumbersome operation and technical difficulty.
因此,所理解需要一种热像诊断装置,其能达到无需过度依赖使用者主观上的意念,能方便地设置分析区域、分析模式、诊断规则其中之一或多个,解决现有技术问题的部分或全部问题。 Therefore, it is understood that there is a need for a thermal imaging diagnostic apparatus that can easily set one or more of an analysis area, an analysis mode, and a diagnosis rule without excessively relying on the user's subjective idea, and solve the prior art problem. Some or all of the questions.
发明内容Summary of the invention
本发明提供一种分析装置和分析方法,当获取的热像数据帧中检测出特定被摄体热像时,自动设置分析区域、分析模式、诊断规则其中之一或多个,可进行诊断和/或通知诊断结果,由此,解决现有技术问题。The present invention provides an analysis apparatus and an analysis method, which automatically set one or more of an analysis area, an analysis mode, and a diagnosis rule when a specific subject thermal image is detected in the acquired thermal image data frame, and can perform diagnosis and / or notify the diagnosis results, thereby solving the prior art problems.
为此,本发明采用以下技术方案,分析装置,包括:To this end, the present invention adopts the following technical solutions, the analysis device, including:
获取部,用于获取热像数据帧;An acquisition unit, configured to acquire a thermal image data frame;
检测部,用于基于获取的热像数据帧,检测与特定被摄体热像有关的规定信息;a detecting unit configured to detect predetermined information related to a specific subject thermal image based on the acquired thermal image data frame;
分析配置部,用于根据检测部检测获得的规定信息,可配置如下一项或多项:分析区域的构成数据、分析区域的位置参数、分析模式、诊断规则。The analysis configuration unit is configured to arrange one or more of the following: the configuration data of the analysis region, the position parameter of the analysis region, the analysis mode, and the diagnosis rule according to the predetermined information obtained by the detection unit.
本发明的分析方法,包括:The analytical method of the present invention comprises:
获取步骤,用于获取热像数据帧;An obtaining step of acquiring a thermal image data frame;
检测步骤,用于基于获取的热像数据帧,检测与特定被摄体热像有关的规定信息;a detecting step of detecting predetermined information related to a specific subject thermal image based on the acquired thermal image data frame;
分析配置步骤,用于根据检测步骤检测获得的规定信息,可配置如下一项或多项:分析区域的构成数据、分析区域的位置参数、分析模式、诊断规则。The analysis configuration step is configured to configure one or more of the following according to the specified information obtained by the detecting step: the composition data of the analysis area, the position parameter of the analysis area, the analysis mode, and the diagnosis rule.
本发明的其他方面和优点将通过下面的说明书进行阐述。Other aspects and advantages of the invention will be set forth in the description which follows.
附图说明:BRIEF DESCRIPTION OF THE DRAWINGS:
图1是表示本发明的实施例1的热像装置100的概略构成的框图。Fig. 1 is a block diagram showing a schematic configuration of a thermal imaging device 100 according to a first embodiment of the present invention.
图2是实施例1的热像装置100的外型图。Fig. 2 is a perspective view showing the thermal imaging device 100 of the first embodiment.
图3是实施例1存储介质中存储的被摄体信息、诊断、被摄体识别信息等的示意图。3 is a schematic diagram of object information, diagnosis, object identification information, and the like stored in the storage medium of the first embodiment.
图4是检测窗口的示意图。4 is a schematic diagram of a detection window.
图5是多个检测窗口检测的示意图。Figure 5 is a schematic illustration of multiple detection window detections.
图6是实施例1的诊断处理的显示例。Fig. 6 is a display example of the diagnosis process of the first embodiment.
图7是表示实施例1的控制流程图。Fig. 7 is a flowchart showing the control of the first embodiment.
图8是表示多种方式来进行分析区域设置的显示例。Fig. 8 is a diagram showing an example of display in which analysis area setting is performed in various ways.
图9是表示诊断与评价值的对照表(或对应关系)的示意图。Fig. 9 is a schematic diagram showing a comparison table (or correspondence relationship) between diagnosis and evaluation values.
图10是表示实施例2的控制流程图。Fig. 10 is a flowchart showing the control of the second embodiment.
图11是实施例2的诊断处理的显示例。Fig. 11 is a display example of the diagnosis process of the second embodiment.
图12是实施例2的分析区域设置的显示例。Fig. 12 is a display example of the analysis area setting of the second embodiment.
图13是表示实施例3的控制流程图。Fig. 13 is a flowchart showing the control of the third embodiment.
图14是实施例3的诊断处理的显示例。Fig. 14 is a view showing a display example of the diagnosis process of the third embodiment.
图15是参考图像的显示例。Fig. 15 is a display example of a reference image.
具体实施方式detailed description
现在将根据附图详细说明本发明的典型实施例。注意,以下要说明的实施例用于更好地理解本发明,而不限制本发明的范围,并且可以改变本发明范围内的各种形式。Exemplary embodiments of the present invention will now be described in detail in accordance with the accompanying drawings. It is to be noted that the embodiments described below are intended to better understand the present invention without limiting the scope of the invention, and various forms within the scope of the invention.
实施例1Example 1
图1是表示实施例1的作为分析装置示例的热像装置100的概略构成的框图。1 is a block diagram showing a schematic configuration of a thermal imaging device 100 as an example of an analysis device in the first embodiment.
具体而言,热像装置100具有拍摄部1、临时存储部2、闪存3、通信I/F4、存储卡I/F5、存储卡6、图像处理部7、检测部8、显示控制部9、显示部10,控制部11、操作部12、控制部11通过控制与数据总线13与上述相应部分进行连接,负责热像装置100的总体控制。 Specifically, the thermal imaging device 100 includes an imaging unit 1, a temporary storage unit 2, a flash memory 3, a communication I/F 4, a memory card I/F 5, a memory card 6, an image processing unit 7, a detection unit 8, and a display control unit 9, The display unit 10, the control unit 11, the operation unit 12, and the control unit 11 are connected to the corresponding portion of the data bus 13 by control, and are responsible for overall control of the thermal image device 100.
拍摄部1由未图示的光学部件、镜头驱动部件、红外探测器、信号预处理电路等构成。光学部件由红外光学透镜组成,用于将接收的红外辐射聚焦到红外探测器。镜头驱动部件根据控制部11的控制信号驱动透镜来执行聚焦或变焦操作。此外,也可为手动调节的光学部件。红外探测器如制冷或非制冷类型的红外焦平面探测器,把通过光学部件的红外辐射转换为电信号。信号预处理电路包括采样电路、AD转换电路、定时触发电路等,将从红外探测器输出的电信号在规定的周期内进行取样等信号处理,经AD转换电路转换,获得数字的热像数据帧,该热像数据帧包含的热像AD值数据例如为14位或16位等的二进制数据;热像数据帧并不限于红外探测器固有分辨率,也可以低于或高于红外探测器分辨率。热像数据帧并不限于红外探测器输出的模拟信号规定处理后获得,例如也可以根据红外探测器自身内部输出的数字信号而获得。在实施例1中,拍摄部1作为获取部,用于获取热像数据帧。The imaging unit 1 is composed of an optical member (not shown), a lens driving member, an infrared detector, a signal preprocessing circuit, and the like. The optical component consists of an infrared optical lens for focusing the received infrared radiation onto the infrared detector. The lens driving section drives the lens in accordance with a control signal of the control section 11 to perform a focusing or zooming operation. In addition, it can also be a manually adjusted optical component. Infrared detectors, such as infrared or non-refrigerated infrared focal plane detectors, convert infrared radiation through optical components into electrical signals. The signal pre-processing circuit comprises a sampling circuit, an AD conversion circuit, a timing trigger circuit, etc., and the signal output from the infrared detector is sampled and processed in a predetermined period, and converted by the AD conversion circuit to obtain a digital thermal image data frame. The thermal image data frame includes thermal image AD value data such as 14-bit or 16-bit binary data; the thermal image data frame is not limited to the inherent resolution of the infrared detector, and may be lower or higher than the infrared detector. rate. The thermal image data frame is not limited to the analog signal output by the infrared detector, and may be obtained, for example, based on a digital signal output from the infrared detector itself. In the first embodiment, the imaging unit 1 functions as an acquisition unit for acquiring a thermal image data frame.
热像数据帧,并不限定于包含热像AD值数据;例如也可以包含红外热像的图像数据,例如也可以包含温度值的阵列数据,或其他基于热像AD值数据生成的数据等。在下文中所谓的热像数据帧以包含热像AD值数据为例。The thermal image data frame is not limited to including thermal image AD value data; for example, image data of an infrared thermal image may be included, and for example, array data of temperature values or other data generated based on thermal image AD value data may be included. The so-called thermal image data frame hereinafter is exemplified by data including thermal image AD values.
临时存储部2如RAM、DRAM等易失性存储器,作为对拍摄部1输出的热像数据帧进行临时存储的缓冲存储器,例如重复如下处理,即将获取的热像数据帧临时存储规定时间份,并在由所述获取部获取新的帧时,删除旧的帧后存储新的热像数据帧;同时,作为图像处理部7、检测部8、控制部11等的工作存储器起作用,暂时存储进行处理的数据。The temporary storage unit 2 is a buffer memory that temporarily stores a thermal image data frame output from the imaging unit 1 as a buffer memory that temporarily stores the thermal image data frame output from the imaging unit 1. For example, the following processing is repeated, and the acquired thermal image data frame is temporarily stored for a predetermined time portion. When a new frame is acquired by the acquisition unit, a new thermal image data frame is stored after the old frame is deleted, and a work memory such as the image processing unit 7, the detection unit 8, the control unit 11, and the like are temporarily stored. The data to be processed.
闪存3,存储有用于控制的程序,以及各部分控制中使用的各种数据。本实施例中,如图3所示,与检测、诊断有关的数据存储在存储介质如闪存3中,例如存储被摄体识别信息的数据库,例如也可以特定格式的数据文件等来存储。如图3所示的表,将每个被摄体的被摄体信息、被摄体识别信息、规定的判断值、分析区域的构成数据、分析模式、诊断规则等配置信息相互对应,进行存储;本实施例中,还存储了分析区域与被摄体识别信息之间的规定位置关系(图3的表中未图示),规定位置关系例如分析区域位于模板中的位置参数,如基点位置,如基点位置、尺寸,如基点位置、尺寸、旋转角度;例如分析区域位于与特征量对应区域中的位置参数,如基点位置,如基点位置、尺寸,如基点位置、尺寸、旋转角度。The flash memory 3 stores programs for control and various data used in the control of each part. In the present embodiment, as shown in FIG. 3, data related to detection and diagnosis is stored in a storage medium such as the flash memory 3, for example, a database storing subject identification information, and may be stored, for example, in a data file of a specific format or the like. In the table shown in FIG. 3, the configuration information such as the subject information, the subject identification information, the predetermined judgment value, the analysis data of the analysis region, the analysis mode, and the diagnosis rule are associated with each other and stored. In the present embodiment, a predetermined positional relationship between the analysis area and the subject identification information (not shown in the table of FIG. 3) is stored, and the positional relationship such as the positional parameter in the template, such as the base point position, is specified. Such as base point position, size, such as base point position, size, rotation angle; for example, the analysis area is located in the position corresponding to the feature quantity, such as the base point position, such as the base point position, size, such as the base point position, size, rotation angle.
被摄体信息为与被摄体有关的信息,例如代表被摄体地点、类型、编号等的信息,所生成的被摄体指示信息应可让使用者可辩识理解的所拍摄的被摄体,此外,还可以例举可包含被摄体有关的归属单位、分类等级(如电压等级、重要等级等)、型号、制造厂商、性能和特性、过去的拍摄或检修的履历、制造日期、使用期限等各种信息。采用被摄体信息关联被摄体识别信息的实施方式,为优选的方式,可根据应用的不同可以准备各种适用的被摄体信息。例如对于电力行业,优选的,被摄体信息为使用者可辨识的代表被摄体的身份信息,如代表被摄体地点、类型、相别的信息;但也可以是代表被摄体类型的信息。显然,被摄体识别信息并不限于必须与被摄体信息关联。The subject information is information related to the subject, for example, information representing the location, type, number, and the like of the subject, and the generated subject indication information should allow the user to recognize the captured photographed subject. The body may further include a belonging unit related to the subject, a classification level (such as a voltage level, an important level, etc.), a model, a manufacturer, performance and characteristics, a history of past shooting or overhaul, a date of manufacture, Various information such as the duration of use. The embodiment in which the subject identification information is associated with the subject information is a preferred embodiment, and various applicable subject information can be prepared depending on the application. For example, in the power industry, preferably, the object information is identity information of a representative object recognizable by the user, such as information representing the location, type, and phase of the subject; but may also be representative of the type of the subject. information. Obviously, the subject identification information is not limited to being associated with the subject information.
所谓的被摄体识别信息,例如与计算相关度有关的模板、特征量等;所谓被摄体识别信息例如可以是用于模板匹配的模板;例如也可以是参数描述的特征量。所述模板例如模板图像,例如各像素为温度值数据的模板等。所谓特征量如代表特定区域中的点、线、面等特征,例如,为根据检测窗口中所包含的像素的状态所决定的值,如为特定检测窗口中的规定部分像素的比例、像素值的平均值、特定被摄体的轮廓的中心点、面积等。例如图3中,被摄体 1对应的被摄体识别信息为模板图像301,被摄体2对应的被摄体识别信息为特征量302。在具体应用中,可以根据情况选择一种或多种被摄体识别信息方式的结合。The so-called subject identification information, for example, a template related to the calculation of the relevance, a feature amount, and the like; the so-called subject identification information may be, for example, a template for template matching; for example, it may be a feature quantity of the parameter description. The template is, for example, a template image, for example, each pixel is a template of temperature value data or the like. The feature quantity is a feature such as a point, a line, a surface, or the like in a specific area, for example, a value determined according to a state of a pixel included in the detection window, such as a ratio of a predetermined portion of pixels in a specific detection window, and a pixel value. The average value, the center point, area, etc. of the outline of a specific subject. For example, in Figure 3, the subject The corresponding subject identification information is the template image 301, and the subject identification information corresponding to the subject 2 is the feature amount 302. In a specific application, a combination of one or more types of subject identification information may be selected depending on the situation.
所谓判断值,例如将所检测获得的相关度的值,与判断值进行对比,判断是否具有特定被摄体热像。优选的,规定的判断值预先与被摄体识别信息相对应存储在闪存3中,但也可采用其他方式来准备,如使用者临时设置的判断值。The judgment value, for example, compares the value of the correlation obtained by the detection with the judgment value, and determines whether or not there is a specific subject thermal image. Preferably, the predetermined judgment value is stored in the flash memory 3 in advance corresponding to the subject identification information, but other manners may be prepared, such as a judgment value temporarily set by the user.
所谓分析区域的构成数据,用来设置分析区域,如代表了点、线、面的数据,例如可以是矢量图形数据,例如也可以是点阵图像数据,分析区域的构成数据可包括分析区域的编号等信息,包括当分析区域由多个分析区域组成时,各分析区域的编号信息等。The composition data of the analysis area is used to set the analysis area, such as data representing points, lines, and faces, for example, vector graphic data, for example, bitmap image data, and the composition data of the analysis area may include the analysis area. Information such as number, including number information of each analysis area when the analysis area is composed of a plurality of analysis areas.
所谓分析模式,如对应分析区域的分析计算规则;例如代表了基于分析区域所决定的热像数据进行温度分析获得分析结果,所采用的分析计算规则,如计算最高温度、平均温度、最低温度、百分比含量等;以及,还可包括同一热像数据帧的分析区域和/或不同热像数据帧之间的分析区域的计算关系,如温差等。The so-called analysis mode, such as the analysis and calculation rules corresponding to the analysis area; for example, the temperature analysis based on the thermal image data determined by the analysis area is used to obtain the analysis result, and the analysis calculation rules are used, such as calculating the highest temperature, the average temperature, the lowest temperature, The percentage content and the like; and, may also include the calculation relationship of the analysis area of the same thermal image data frame and/or the analysis area between different thermal image data frames, such as temperature difference and the like.
同一分析区域可以对应多个不同的分析模式,同一分析模式也可对应有多个不同的分析区域。The same analysis area may correspond to a plurality of different analysis modes, and the same analysis mode may correspond to a plurality of different analysis areas.
所谓诊断规则,例如包含了对应于分析区域和分析模式的,至少一个比较关系及其诊断阈值,或还进一步关联有诊断结论;所述诊断结论,例如诊断依据、详细的缺陷类型、缺陷程度、处理建议等。例如包含了对应于分析模式,至少一个比较关系及其诊断阈值,或还进一步关联有诊断结论;其中,省略特指的分析区域,可通用于应用该分析模式的任意分析区域。The diagnostic rule includes, for example, at least one comparison relationship and its diagnostic threshold corresponding to the analysis region and the analysis mode, or further associated with a diagnosis conclusion; the diagnosis conclusion, such as a diagnosis basis, a detailed defect type, a defect degree, Handling suggestions, etc. For example, it includes at least one comparison relationship and its diagnostic threshold corresponding to the analysis mode, or further associated with a diagnosis conclusion; wherein the specific analysis region is omitted, and the analysis region can be generally applied to any analysis region to which the analysis mode is applied.
也可将分析区域、分析模式、对应的比较关系及其诊断阈值,或还进一步关联有诊断结论等配置在一起理解作为整体诊断规则。The analysis region, the analysis mode, the corresponding comparison relationship and its diagnostic threshold, or further associated with the diagnosis conclusion can also be understood as an overall diagnostic rule.
针对同一分析区域和分析模式的组合,可以有一个或多个比较关系及诊断阈值,或还分别对应了一个或多个的诊断结论;例如正常、关注、缺陷的诊断结论,分别有各自不同的比较关系及诊断阈值。对应一个被摄体,可以有多个针对不同分析区域和分析模式组合的诊断规则。For the combination of the same analysis area and the analysis mode, there may be one or more comparison relationships and diagnostic thresholds, or corresponding one or more diagnostic conclusions respectively; for example, the diagnosis conclusions of normal, attention, and defects are respectively different. Compare relationships and diagnostic thresholds. Corresponding to one subject, there may be multiple diagnostic rules for different analysis areas and analysis mode combinations.
例如,诊断规则也可以是这样的配置,对应于多个分析区域和分析模式组合,所得到的多个分析结果的评价值,配置了对应评价值的比较关系及诊断阈值。多个分析结果的评价值,例如根据多个分析结果各自所占的权重进行加权来获得。多个分析结果并不限于对一帧热像数据帧来获得,也可根据对多个热像数据帧的分析来获得。For example, the diagnosis rule may be such a configuration that, corresponding to a plurality of analysis regions and analysis mode combinations, the evaluation values of the plurality of analysis results obtained are configured with a comparison relationship and a diagnosis threshold value corresponding to the evaluation values. The evaluation values of the plurality of analysis results are obtained, for example, by weighting each of the weights of the plurality of analysis results. The plurality of analysis results are not limited to one frame of thermal image data frames, but may be obtained based on analysis of a plurality of thermal image data frames.
通信I/F4是例如按照USB、1394、网络等通信规范,将热像装置100与外部装置进行连接并数据交换的接口,作为外部装置,例如可以列举个人计算机、服务器、PDA(个人数字助理装置)、其他的热像装置、可见光拍摄装置、存储装置等。The communication I/F 4 is an interface that connects and exchanges data between the thermal image device 100 and an external device in accordance with a communication specification such as USB, 1394, or network. For example, a personal computer, a server, and a PDA (personal digital assistant device) can be cited as an external device. ), other thermal imaging devices, visible light imaging devices, storage devices, and the like.
存储卡5,作为可改写的非易失性存储器,通过存储卡接口与热像装置100连接,可自由拆装地安装在热像装置100主体的卡槽内,根据控制部11的控制记录热像数据帧等数据。The memory card 5 is connected to the thermal image device 100 via a memory card interface as a rewritable nonvolatile memory, and is detachably mounted in a card slot of the main body of the thermal image device 100, and records heat according to the control of the control unit 11. Data such as data frames.
分析部6,可包括分析配置单元、分析区域设置单元、分析单元、诊断单元。The analysis unit 6 may include an analysis configuration unit, an analysis area setting unit, an analysis unit, and a diagnosis unit.
分析配置单元,用于根据检测部检测获得的规定信息,可配置如下一项或多项:分析区域的构成数据、分析区域的位置参数、分析模式、诊断规则。The analysis configuration unit is configured to configure one or more of the following: the configuration data of the analysis area, the position parameter of the analysis area, the analysis mode, and the diagnosis rule according to the predetermined information obtained by the detection unit.
优选的,根据检测部检测获得的特定被摄体热像的位置参数,来配置分析区域的位置参数; Preferably, the position parameter of the analysis area is configured according to the position parameter of the specific subject thermal image obtained by the detecting unit;
例如,可根据检测到特定被摄体热像的位置参数,来配置分析区域;在一个例子中,将检测到特定被摄体热像的检测窗口、模板图像等,配置为分析区域。For example, the analysis area may be configured according to a positional parameter in which a specific subject thermal image is detected; in one example, a detection window, a template image, or the like in which a specific subject thermal image is detected is configured as an analysis area.
优选的,在本实施例中,根据被摄体识别信息关联的分析区域的构成数据,来确定分析区域的构成数据;基于被摄体识别信息与分析区域之间的规定位置关系,及特定被摄体热像位于热像数据帧中的位置参数,来配置分析区域位于热像数据帧中的位置参数。Preferably, in the present embodiment, the constituent data of the analysis region is determined based on the constituent data of the analysis region associated with the subject identification information; based on the predetermined positional relationship between the subject identification information and the analysis region, and the specific The positional parameter of the thermal image in the thermal image data frame is configured to configure the positional parameter of the analysis area in the thermal image data frame.
根据特定被摄体热像的位置参数,来配置分析区域的位置参数;根据点、线、面(如圆、框等)等不同的分析区域的构成数据,分析区域的位置参数,例如可仅包含位置(如点),例如包含位置和尺寸,例如包含位置、尺寸、旋转角度。优选的,例如根据特定被摄体热像的位置、尺寸、倾斜角度,来设置分析区域(如点)的位置,或分析区域(如框)的位置、尺寸、或还包括旋转角度。但并不限于设置分析区域的位置参数中的全部,也可以是其中的部分,例如根据被摄体热像的位置来设置分析区域(如框)的位置,而其尺寸和旋转角度等,为默认的参数。The positional parameter of the analysis area is configured according to the positional parameter of the specific subject thermal image; and the positional parameter of the analysis area is analyzed according to the constituent data of different analysis areas such as a point, a line, a surface (such as a circle, a frame, etc.), for example, only Contains a position (such as a point), for example, including a position and a size, such as a position, a size, and a rotation angle. Preferably, the position of the analysis area (such as a point), or the position, size, or also the rotation angle of the analysis area (such as a frame) is set, for example, according to the position, size, and inclination angle of the specific subject thermal image. However, it is not limited to setting all of the positional parameters of the analysis area, and may be a part thereof, for example, setting the position of the analysis area (such as a frame) according to the position of the thermal image of the subject, and the size and the rotation angle thereof are The default parameters.
此外,在另一实施方式中,可对规定计算对象按照规定计算规则进行计算,基于检测获得的规定信息例如被摄体热像的位置参数,来设置分析区域。其中,规定计算对象,例如检测窗口、模板图像、检测窗口中的热像数据、与被摄体识别信息具有规定位置关系的其他对象(如具有规定位置关系的分析区域)中的一个或多个;所述规定计算规则,至少包括对规定计算对象进行剪切、特征提取(例如提取规定像数值范围的特征像素、边缘提取等)、缩放、变形、分割、等分、计算外包矩形、计算内切矩形、计算中心线、计算特征点、计算内包络线、计算外包络线中的一种或一种以上;可以在存储介质中,预先存储规定计算规则对应的参数(例如基于中心点缩放的参数:基于中心点、缩放率),或由使用者进行配置。Further, in another embodiment, the predetermined calculation target may be calculated according to a predetermined calculation rule, and the analysis region may be set based on the predetermined information obtained by the detection, for example, the positional parameter of the thermal image of the subject. Wherein, one or more of the calculation target, such as the detection window, the template image, the thermal image data in the detection window, and other objects having a predetermined positional relationship with the subject identification information (such as an analysis region having a predetermined positional relationship) are defined. The prescribed calculation rule includes at least cutting the specified calculation object, extracting features (for example, extracting characteristic pixels of a specified image range, extracting edges, etc.), scaling, deforming, dividing, dividing, calculating an outsourcing rectangle, and calculating Cutting a rectangle, calculating a center line, calculating a feature point, calculating an inner envelope, and calculating one or more of the outer envelope lines; in the storage medium, pre-storing parameters corresponding to the prescribed calculation rule (for example, based on the center point Scaled parameters: based on center point, zoom rate), or configured by the user.
参考图8来说明设置的分析区域的示例。An example of the set analysis area will be explained with reference to FIG.
参考图8(a)所示,将模板T1所关联的分析区域F1的构成数据,根据分析区域F1位于模板T1中的位置、尺寸等的位置参数,来设置的分析区域F1(包含分析区域S01、S02)。Referring to FIG. 8(a), the analysis area F1 (including the analysis area S01) is set based on the positional data of the analysis area F1 associated with the template T1 and the position, size, and the like of the analysis area F1 in the template T1. , S02).
参考图8(b)所示,将模板T2作为计算对象,以中心点作为基点,进行缩放和变形后,获得的分析区域F2;可用于分析计算被摄体热像本体上规定区域的温度分布,减少周围环境对评估的影响。Referring to FIG. 8(b), the template T2 is used as a calculation object, and the analysis area F2 obtained after scaling and deformation using the center point as a base point can be used for analyzing and calculating the temperature distribution of a predetermined area on the body of the thermal image of the object. To reduce the impact of the surrounding environment on the assessment.
参考图8(c)所示,将模板T3作为计算对象,进行8等分设置的分析区域F3;可用于详细分析被摄体本体不同部分的热场分布。当设置的分析区域包含多个分析区域时,根据需要,可进行自动编号,如分析区域F3包含编号的分析区域F01-F08。Referring to FIG. 8(c), the template T3 is used as a calculation target, and an analysis area F3 that is equally divided into eight is provided; it can be used to analyze the thermal field distribution of different parts of the subject body in detail. When the set analysis area contains multiple analysis areas, automatic numbering can be performed as needed, for example, the analysis area F3 includes the numbered analysis area F01-F08.
参考图8(d),将检测窗口设置为分析区域F4;可用于分析测量被摄体的最高温度,可以减少背景中的高温物体的影响。注:T4为模板图像。Referring to FIG. 8(d), the detection window is set to the analysis area F4; it can be used to analyze the highest temperature of the measurement object, and the influence of the high temperature object in the background can be reduced. Note: T4 is a template image.
参考图8(e),将检测窗口中的热像数据TU5进行边缘轮廓提取,获得的边缘轮廓的分析区域F5,可用于分析测量被摄体的最高温度,可以减少背景中的高温物体的影响。Referring to FIG. 8(e), the edge image is extracted by the thermal image data TU5 in the detection window, and the obtained analysis region F5 of the edge contour can be used for analyzing and measuring the maximum temperature of the object, which can reduce the influence of the high temperature object in the background. .
参考图8(f),将模板图像TU6提取规定阀值以上的像素点,获得的分析区域F6,可用于对被摄体特征部位进行分析计算。Referring to FIG. 8(f), the template image TU6 is extracted from a pixel point having a predetermined threshold or more, and the obtained analysis region F6 can be used for analysis and calculation of the subject feature portion.
此外,也可根据检测到的规定信息和/或规定信息获得的评价值等,与分析区域的对应关系,来设置分析区域;采用哪一种分析区域的设置方式可以根据红外检测的目的来配置。In addition, the analysis area may be set according to the relationship between the detected information obtained by the specified information and/or the predetermined information and the analysis area, and the analysis mode may be configured according to the purpose of the infrared detection. .
优选的,根据检测部检测获得的规定信息,配置分析区域的构成数据、分析区域的位置参数、分析模式、诊断规则。 Preferably, the configuration data of the analysis region, the position parameter of the analysis region, the analysis mode, and the diagnosis rule are arranged based on the predetermined information detected by the detection unit.
例如,预先存储与被摄体识别信息及其关联的分析区域构成数据、分析区域与被摄体识别信息之间的规定位置关系、分析模式、诊断规则的至少其中之一或多个;当检测到特定被摄体热像,分析配置单元根据上述信息,来配置分析区域的构成数据、分析区域的位置参数、分析模式、诊断规则。For example, at least one or more of a predetermined positional relationship, an analysis mode, and a diagnosis rule between the analysis region configuration data associated with the subject identification information and the object identification information, the analysis mode, and the diagnosis rule are stored in advance; The analysis configuration unit arranges the configuration data of the analysis area, the positional parameter of the analysis area, the analysis mode, and the diagnosis rule based on the above information to the specific subject thermal image.
进一步优选的,预先存储被摄体信息及其关联被摄体识别信息及分析区域构成数据、分析区域与被摄体识别信息之间的规定位置关系、分析模式、诊断规则;选择部,用于选择被摄体信息;所述检测部根据所选择的被摄体信息关联的特定被摄体识别信息来检测特定被摄体热像;分析配置单元根据上述信息,来配置分析区域的构成数据、分析区域的位置参数、分析模式、诊断规则。More preferably, the subject information and its associated subject identification information and analysis region configuration data, a predetermined positional relationship between the analysis region and the subject identification information, an analysis mode, and a diagnosis rule are stored in advance; the selection unit is configured to Selecting subject information; the detecting unit detects a specific subject thermal image based on the specific subject identification information associated with the selected subject information; and the analysis configuration unit configures the composition data of the analysis region based on the information, Analyze the location parameters, analysis mode, and diagnostic rules of the area.
优选的,所述分析配置单元,根据如下因素:Preferably, the analysis configuration unit is based on the following factors:
1)规定信息1) Prescribed information
2)辅助信息;2) auxiliary information;
3)规定信息得到的评价值;3) the evaluation value obtained by the specified information;
4)辅助信息得到的评价值;4) the evaluation value obtained from the auxiliary information;
5)规定信息和辅助信息得到的评价值;5) The evaluation value obtained by specifying information and auxiliary information;
其中的一项或多项,与分析区域的构成数据、分析区域的位置参数、分析模式、诊断规则中一项或多项的对应关系,来配置相应的分析区域、分析模式、诊断规则中一项或多项。One or more of the corresponding analysis areas, analysis modes, and diagnostic rules are configured in one or more of the analysis data of the analysis area, the positional parameters of the analysis area, the analysis mode, and one or more of the diagnostic rules. Item or multiple items.
但也可根据检测到的规定信息等,来配置其中的部分项,其余的例如可采用其他方式配置的如热像装置100默认的等。例如按照检测到的特定被摄体热像的位置和尺寸,来设置分析区域的位置数据,但按照默认的分析区域的构成数据、分析模式、诊断规则来配置;当分析区域、分析模式、诊断规则并非全部由所检测到的规定信息来决定时,但也优于现有技术。However, some of the items may be configured according to the detected specified information, etc., and the rest may be configured by other means such as the default of the thermal imaging device 100, for example. For example, the position data of the analysis area is set according to the detected position and size of the specific subject thermal image, but is configured according to the default analysis area composition data, analysis mode, and diagnostic rule; when analyzing the area, analyzing the mode, and diagnosing The rules are not all determined by the detected regulatory information, but are also superior to the prior art.
分析区域设置单元,根据分析配置单元配置的分析区域的构成数据和位置参数,对热像数据帧设置分析区域。The analysis area setting unit sets an analysis area for the thermal image data frame according to the composition data and the position parameter of the analysis area configured by the analysis configuration unit.
分析单元,根据分析区域设置单元设置的分析区域,分析配置单元设置的分析模式,进行热像数据帧的分析,以温度分析为例来说明分析单元的具体实施方式。The analyzing unit analyzes the analysis mode set by the configuration unit according to the analysis area set by the analysis area setting unit, analyzes the thermal image data frame, and illustrates the specific implementation manner of the analysis unit by taking temperature analysis as an example.
一种实施方式,基于控制部11的控制,分析单元对所分析的热像数据帧或进行规定处理如修正、插值的热像数据帧,基于分析区域设置单元所设置的分析区域,提取分析区域所决定的热像数据,进行温度值的转换处理,获得这些热像数据对应的温度值,而后对得到的温度值,按照分析模式进行分析计算。例如计算其中最大值,则提取其中最大的温度值作为分析结果。当分析区域包含多个分析区域单元时,如图6(b)所示,分析区域F1有分析区域单元S01、S02,则依次对各分析区域单元中的热像数据,进行温度值的转换和进行分析,获得各区域单元的分析结果,将计算获得的分析结果与分析区域单元的编号关联存储在临时存储部6的规定区域,而后根据各分析区域单元的分析结果,按照分析模式中各分析区域单元的相互关系,来计算获得相互关系的分析结果。According to an embodiment, based on the control of the control unit 11, the analyzing unit extracts the analysis area from the analyzed thermal image data frame or the thermal image data frame subjected to predetermined processing such as correction and interpolation, based on the analysis area set by the analysis area setting unit. The determined thermal image data is subjected to temperature value conversion processing to obtain temperature values corresponding to the thermal image data, and then the obtained temperature values are analyzed and calculated according to the analysis mode. For example, if the maximum value is calculated, the largest temperature value among them is extracted as the analysis result. When the analysis area includes a plurality of analysis area units, as shown in FIG. 6(b), the analysis area F1 has analysis area units S01 and S02, and sequentially converts the temperature values of the thermal image data in each analysis area unit. Perform analysis to obtain the analysis result of each regional unit, store the calculated analysis result in association with the number of the analysis area unit in a predetermined area of the temporary storage unit 6, and then analyze each analysis according to the analysis result of each analysis area unit. The relationship between the regional units is used to calculate the analysis results of the mutual relationship.
上述的例举并非作为分析处理的实施方式的限定。例如,对分析区域中的热像数据进行转换为温度值的处理,可以是将分析区域中所有的热像数据都转换为温度值;也可以是规定的部分热像数据转换为温度值;还可以是根据分析模式中计算最高、最低、平均温度等不同的模式,来决定对热像数据的转换,是转换分析区域中的一部分热像数据,还是全部;如分析模式为计算分析区域中最高温度时,也可针对分析区域中的热像数据,先比较热像AD值的 大小,将其中最大的热像AD值转换为温度值,而并不必须将分析区域中的热像数据全部转化为温度值。此外,也包括算法不同的情况,例如计算最高温度时,并不以单个像素而是以规定数量的相邻像素的AD值的平均值,将最大平均值的相邻像素的AD值转换为温度值,并将该相邻像素热像数据的温度值的平均值作为最高温度值。其中,热像数据经过规定处理转换为温度值,例如根据设置的被摄体的辐射系数、环境温度、湿度、与热像装置13的距离等以及热像AD值与温度之间的转换系数,通过规定转换公式,得到温度值。此外,分析区域所决定的热像数据,如图6(b)所示,可以是分析区域单元S01、S02内的热像数据,也可以是分析单元S01、S02外的热像数据,也可以是分析区域单元S01、S02的线条所在像素的热像数据。The above examples are not intended to be limiting as to the embodiment of the analysis process. For example, the process of converting the thermal image data in the analysis region into a temperature value may be to convert all the thermal image data in the analysis region into a temperature value; or to convert the predetermined partial thermal image data into a temperature value; It is possible to determine the conversion of the thermal image data according to the different modes of calculating the highest, lowest, and average temperatures in the analysis mode, whether to convert part of the thermal image data in the analysis region, or all; for example, the analysis mode is the highest in the calculation analysis region. At the temperature, the thermal image AD value can also be compared for the thermal image data in the analysis area. The size, the largest thermal image AD value is converted into a temperature value, and it is not necessary to convert all the thermal image data in the analysis area into a temperature value. In addition, the case where the algorithm is different is also included. For example, when calculating the highest temperature, the AD value of the adjacent pixel of the maximum average value is not converted into the temperature by the average value of the AD values of the predetermined number of adjacent pixels instead of a single pixel. A value and an average value of temperature values of the adjacent pixel thermal image data is taken as the highest temperature value. Wherein the thermal image data is converted into a temperature value by a predetermined process, for example, according to the set emissivity of the object, the ambient temperature, the humidity, the distance from the thermal image device 13, and the conversion coefficient between the thermal image AD value and the temperature, The temperature value is obtained by specifying a conversion formula. Further, as shown in FIG. 6(b), the thermal image data determined by the analysis area may be thermal image data in the analysis area units S01 and S02, or may be thermal image data outside the analysis units S01 and S02. It is the thermal image data of the pixel in which the lines of the area units S01 and S02 are analyzed.
上面的示例说明的根据分析区域来获得温度分析结果的情况,但不限与此,对于热像分析根据应用场合的不同,并不一定是将热像数据转换为温度值来进行的,例如,可以转换为辐射能量值、灰度值、辐射率值等进行分析的情况。本发明同样适用于这些情况。The above example illustrates the case where the temperature analysis result is obtained according to the analysis area, but is not limited thereto. For the thermal image analysis, depending on the application, it is not necessarily the conversion of the thermal image data into the temperature value, for example, It can be converted into a radiant energy value, a gray value, an illuminance value, and the like for analysis. The invention is equally applicable to these situations.
并且,分析部6具有诊断单元,根据分析单元获得分析结果,按照配置的诊断规则进行诊断,获得诊断结果。Further, the analysis unit 6 has a diagnosis unit that obtains an analysis result based on the analysis unit, performs diagnosis in accordance with the configured diagnosis rule, and obtains a diagnosis result.
以图3中的被摄体1为例,诊断规则1的信息可以是:包含了对应于分析区域(由f1构成数据获得)、分析模式(由分析模式1来获得)的至少一个比较关系及诊断阈值(由诊断规则1来获得)。Taking the object 1 in FIG. 3 as an example, the information of the diagnosis rule 1 may include at least one comparison relationship corresponding to the analysis region (obtained by f1 composition data) and the analysis mode (obtained by analysis mode 1). Diagnostic threshold (obtained by Diagnostic Rule 1).
进一步,由于在电力行业,期望直接得到诊断结论,对被摄体的正常、关注、缺陷3种(也可能是一种或多于3种)情况,分别具有对应的比较关系及诊断阈值;优选的,诊断规则中或关联有对应的诊断结论的注释信息,例如诊断依据、详细的缺陷类型、缺陷程度、处理建议等。以被摄体1的诊断规则1为例,对应分析区域(S01、S02)及分析模式(S01和S02最高温度的差值)获得的分析结果,诊断规则包括:Further, in the power industry, it is expected to directly obtain the diagnosis conclusion, and the three types (or one or more than three types) of the normal, attention, and defect of the subject respectively have corresponding comparison relationships and diagnostic thresholds; , in the diagnostic rules or associated with the corresponding diagnostic conclusions of the annotation information, such as the diagnosis basis, detailed defect types, defect levels, treatment recommendations. Taking the diagnosis rule 1 of the subject 1 as an example, the analysis results obtained by the analysis region (S01, S02) and the analysis mode (the difference between the maximum temperatures of S01 and S02) include:
1)小于等于2℃;诊断结论:正常;1) Less than or equal to 2 ° C; diagnosis conclusion: normal;
2)小于4℃,大于2℃;诊断结论:关注;2) less than 4 ° C, greater than 2 ° C; diagnosis conclusion: attention;
3)大于等于4℃;诊断结论及注释:缺陷,疑似介损超标,立即检修!3) greater than or equal to 4 ° C; diagnosis conclusions and notes: defects, suspected dielectric loss exceeds the standard, immediately repair!
可获得如图6(b)、图11(b)所示的诊断结果。The diagnosis results shown in Fig. 6 (b) and Fig. 11 (b) can be obtained.
诊断处理具体而言,例如,根据得到的分析结果,将分析结果依据诊断规则进行比较,来得到诊断结果;诊断结果的输出也可以是控制信号,输出给与热像装置100连接的其他外部装置;优选的,根据诊断结果来进行通知,例如通过控制显示部10等中以文字或图像(包括红外热像、参考图像等)的显示变化;或指示灯产生的光、声音提示、振动等,只要是使用者可以感知的方法都包含在内。优选的方式,控制显示部10将诊断结论进行显示,进一步,还可将与诊断有关的分析区域、分析模式、比较关系及对应的诊断阈值、诊断依据、缺陷类型、缺陷程度、处理建议等以文字等使用者能感知的方式进行通知,相应的,这些相关的数据与诊断规则的数据可以预先准备例如关联存储在存储介质中。Specifically, for example, based on the obtained analysis result, the analysis result is compared according to the diagnosis rule to obtain a diagnosis result; the output of the diagnosis result may also be a control signal and output to other external devices connected to the thermal image device 100. Preferably, the notification is performed according to the diagnosis result, for example, by controlling display changes of characters or images (including infrared thermal images, reference images, etc.) in the display unit 10 or the like; or light, sound prompts, vibrations, and the like generated by the indicator lights, As long as it is a method that users can perceive. In a preferred manner, the control display unit 10 displays the diagnosis conclusion, and further, the analysis area related to the diagnosis, the analysis mode, the comparison relationship and the corresponding diagnosis threshold, the diagnosis basis, the defect type, the defect degree, the treatment suggestion, etc. The notification is made in a manner that the user can perceive, such as text, and accordingly, the data of the related data and the diagnostic rule can be prepared in advance, for example, stored in a storage medium.
优选的,当检测到特定被摄体热像时,对规定的热像数据帧进行诊断。其中,规定的热像数据帧,可以是检测到特定被摄体热像的热像数据帧;但并不限定于此,也可以是该帧的时序之前或之后的那一帧,或由多帧运算获得的那一帧等。或者也可以是规定的多帧热像数据帧。 Preferably, when a specific subject thermal image is detected, a predetermined thermal image data frame is diagnosed. The predetermined thermal image data frame may be a thermal image data frame in which a specific subject thermal image is detected; but is not limited thereto, and may be a frame before or after the timing of the frame, or more The frame obtained by the frame operation, and so on. Or it may be a predetermined multi-frame thermal image data frame.
图像处理部7用于对通过拍摄部1获得的热像数据帧进行规定的处理,例如其在显示定时每次到来之际,从临时存储在所述临时存储部2的规定时间份的热像数据帧中,选择并读出每个规定时间间隔的帧;图像处理部7的处理如修正、插值、伪彩、合成、压缩、解压等,进行转换为适合于显示用、记录用等数据的处理。图像处理部7例如可以采用DSP或其他微处理器或可编程的FPGA等来实现,或者,也可与分析部6、检测部8、控制部11等的处理器为一体。The image processing unit 7 is configured to perform predetermined processing on the thermal image data frame obtained by the imaging unit 1, for example, a thermal image of a predetermined time portion temporarily stored in the temporary storage unit 2 when the display timing comes. In the data frame, the frame of each predetermined time interval is selected and read; the processing of the image processing unit 7 is converted into data suitable for display, recording, etc., such as correction, interpolation, pseudo color, synthesis, compression, decompression, and the like. deal with. The image processing unit 7 can be realized by, for example, a DSP or another microprocessor, a programmable FPGA, or the like, or can be integrated with a processor such as the analysis unit 6, the detection unit 8, and the control unit 11.
图像处理部7用于对获得的热像数据帧实施规定的处理来获得红外热像的图像数据。具体而言,例如,图像处理部7对拍摄获得的热像数据帧进行非均匀性校正、插值等规定处理,而后进行伪彩处理获得红外热像的图像数据;伪彩处理的一种实施方式,例如根据热像数据帧的AD值范围或AD值的设定范围来确定对应的伪彩表范围,将热像AD值数据在伪彩板范围中对应的具体颜色值作为其在红外热像中对应像素位置的图像数据。The image processing unit 7 is configured to perform predetermined processing on the obtained thermal image data frame to obtain image data of the infrared thermal image. Specifically, for example, the image processing unit 7 performs predetermined processing such as non-uniformity correction and interpolation on the thermal image data frame obtained by imaging, and then performs pseudo color processing to obtain image data of the infrared thermal image; an embodiment of the pseudo color processing For example, the corresponding pseudo-color table range is determined according to the AD value range or the AD value setting range of the thermal image data frame, and the specific color value corresponding to the thermal image AD value data in the pseudo color plate range is taken as the infrared thermal image thereof. Image data corresponding to the pixel position.
检测部8基于获取的热像数据帧,可根据被摄体识别信息进行相关度计算;例如,检测部8基于控制部11的控制,可以通过读取临时存储部2中所存储的拍摄部1拍摄获得的热像数据帧,或拍摄获得的热像数据帧进行规定处理获得的数据,例如伪彩处理获得的红外热像的图像数据,来执行与所登记的被摄体识别信息之间的相关度的检测处理。热像数据帧,不限于拍摄获得,例如也可接收外部的热像数据帧获得,例如也可从存储介质中读取热像文件等获得。The detection unit 8 can perform correlation calculation based on the acquired thermal image data frame. For example, the detection unit 8 can read the imaging unit 1 stored in the temporary storage unit 2 based on the control of the control unit 11. Acquiring the obtained thermal image data frame, or capturing the obtained thermal image data frame for performing predetermined processing, such as image data of the infrared thermal image obtained by pseudo color processing, to perform execution with the registered subject identification information Detection processing of correlation. The thermal image data frame is not limited to photographing, and may be obtained, for example, by receiving an external thermal image data frame, for example, by reading a thermal image file or the like from a storage medium.
检测部8包括特征登记单元、检测窗口设置单元、检测单元、判断单元(未图示)。The detecting unit 8 includes a feature registration unit, a detection window setting unit, a detecting unit, and a determining unit (not shown).
特征登记单元,用于登记用来相关度计算有关的被摄体识别信息。可根据存储介质中预先存储的被摄体识别信息来登记被摄体识别信息;例如,根据使用者的选择的被摄体信息关联的被摄体识别信息,来登记用与相关度计算有关的被摄体识别信息。此外,也可以由用户来指定被摄体识别信息,例如可以通过从显示的红外热像中,指定被摄体区域来获得被摄体识别信息,例如获得模板图像。所登记的被摄体识别信息例如被存储在临时存储部2的规定位置,或存储时以标记与存储的其他被摄体识别信息区别。A feature registration unit for registering subject identification information related to the correlation calculation. The subject identification information may be registered according to the subject identification information stored in advance in the storage medium; for example, the subject identification information associated with the selected subject information of the user is registered with the correlation calculation Subject identification information. Further, the subject identification information may be specified by the user. For example, the subject identification information may be obtained by specifying the subject region from the displayed infrared thermal image, for example, obtaining a template image. The registered subject identification information is stored, for example, at a predetermined position of the temporary storage unit 2, or is distinguished from other stored subject identification information by the mark when stored.
检测窗口设置单元,用于设置检测窗口,可基于热像数据帧或其中的特定检测区域,设置一个或多个检测窗口。例如根据一定范围的检测区域(如图5中的G1),在该检测区域G1中设置多个检测窗口,可以是多个不同尺寸的检测窗口,也可以是近一步倾斜后的检测窗口,通常可根据拍摄质量的要求来预先设定检测窗口的尺寸、倾斜等;如图4所示,其中图4(a)为标准的检测窗口,图4(b)为根据缩小尺寸的检测窗口,图4(c)为放大尺寸设置的检测窗口,图4(d)为按照规定角度倾斜而设置的检测窗口。为了等于检测窗口的尺寸,此处模板图像以缩小或放大或还倾斜的状态被使用,或者,也可以准备及存储尺寸等于窗口尺寸的模板图像以备使用。此外,也可将检测窗口中的热像数据以缩小或放大或还倾斜的状态被使用,以对应模板图像。检测窗口不限定于方形,也可以是其它形状,例如可以根据模板图像的形状来定。A detection window setting unit for setting a detection window, and one or more detection windows may be set based on the thermal image data frame or a specific detection area therein. For example, according to a certain range of detection areas (such as G1 in FIG. 5), a plurality of detection windows are disposed in the detection area G1, which may be a plurality of detection windows of different sizes, or may be a detection window after a further tilt, usually The size, tilt, and the like of the detection window may be preset according to the requirements of the photographing quality; as shown in FIG. 4, wherein FIG. 4(a) is a standard detection window, and FIG. 4(b) is a detection window according to the reduced size. 4(c) is a detection window set for the enlargement size, and FIG. 4(d) is a detection window set at a predetermined angle. In order to be equal to the size of the detection window, the template image here is used in a state of being reduced or enlarged or also tilted, or a template image having a size equal to the window size may be prepared and stored for use. Further, it is also possible to use the thermal image data in the detection window in a state of being reduced or enlarged or also tilted to correspond to the template image. The detection window is not limited to a square shape, and may be other shapes, for example, depending on the shape of the template image.
检测区域例如可由使用者根据拍摄习惯来设置,可根据使用者指定的位置和尺寸来设置一个或多个检测区域;例如也可以是预存的如与被摄体信息关联的等;此外,也可不设置特定的检测区域,即默认热像数据帧的范围为检测区域。The detection area may be set by the user according to the shooting habits, for example, and one or more detection areas may be set according to the position and size specified by the user; for example, it may be pre-stored, such as associated with the subject information; or Set a specific detection area, that is, the range of the default thermal image data frame is the detection area.
对于红外检测的应用领域,例如变电站中充斥着大量外形类似,但名称不同的设备,为避免误导使用者及误拍摄,优选的是设置检测区域。在红外热像上重叠显示检测区域,使用 者易于明白所拍摄的被摄体热像的大致位置、尺寸等,便于拍摄参照。但检测区域也可不显示。优选的,将于检测处理有关的检测区域、检测窗口设置等的信息,与被摄体识别信息一起,与被摄体信息相关联。For the application field of infrared detection, for example, the substation is filled with a large number of similarly shaped devices, but with different names, in order to avoid misleading users and accidental shooting, it is preferable to set the detection area. Overlapping the detection area on the infrared thermal image, using It is easy to understand the approximate position, size, and the like of the captured thermal image of the subject, and it is easy to take a reference. However, the detection area may not be displayed. Preferably, information such as a detection area related to the detection processing, a detection window setting, and the like is associated with the subject information together with the subject identification information.
检测单元,将所读取的热像数据帧中,基于检测窗口设置单元所设置的检测窗口中的热像数据,例如与被摄体识别信息进行比对,来获得用于评价类似程度的相关度的值。当设置了多个检测窗口时,例如可将其中检测获得的最大相关度的值,作为该热像数据帧的相关度的值。The detecting unit compares the thermal image data in the detection window set by the detection window setting unit, for example, with the subject identification information, in the read thermal image data frame, to obtain a correlation for evaluating similarity The value of the degree. When a plurality of detection windows are set, for example, a value of the maximum correlation obtained therein may be detected as a value of the correlation of the thermal image data frame.
判断单元,将相关度的值,根据规定的判断值进行判断,来确定是否检测到特定被摄体热像;例如,当代表与模板图像之间的类似程度的相关度的值,超过了判断值时,将该帧判断为包含有特定被摄体热像的帧,即检测到特定被摄体热像。The judging unit determines whether the value of the correlation degree is determined according to the predetermined judgment value to determine whether a specific subject thermal image is detected; for example, when the value representing the degree of similarity between the representative image and the template image exceeds the judgment In the case of a value, the frame is determined to be a frame including a specific subject thermal image, that is, a specific subject thermal image is detected.
检测部8的检测处理可以是基于模板匹配的检测方式,基于检测窗口中的热像数据与模板图像进行相关度的计算和比较;例如,计算检测窗口中的红外热像和作为模板的红外热像相互对应的位置的像素之间的差的和,所计算出的差的和越小,相关度越高。其中,模板匹配的处理,也可配置为提取特征量进行匹配的实施方式,利用模板图像的特征量与检测窗口中的热像数据的特征量,二者之间的比较来确定相关度。例如,提取检测窗口中的被摄体图像的特定像素的比例,与模板图像中的特定像素的比例越接近,所计算出的差越小,相关度越高。The detection processing of the detecting portion 8 may be based on a template matching detection method, and performs correlation calculation and comparison based on the thermal image data in the detection window and the template image; for example, calculating an infrared thermal image in the detection window and infrared heat as a template The sum of the differences between the pixels of the positions corresponding to each other, the smaller the sum of the calculated differences, the higher the correlation. The processing of the template matching may also be configured to extract the feature quantity for matching, and use the comparison between the feature quantity of the template image and the feature quantity of the thermal image data in the detection window to determine the correlation. For example, the closer the ratio of the specific pixel of the subject image in the detection window is extracted to the specific pixel in the template image, the smaller the calculated difference is, and the higher the correlation is.
检测部8的检测处理,基于参数描述的特征量的检测实施方式。例如,可根据被摄体识别信息计算获得检测窗口中热像数据的特征量,作为相关度的值;例如,被摄体识别信息还可包含特征量基准值,可进行规定的运算来获得检测窗口中的热像数据的特征量,并与特征量基准值进行比较,来获得相关度的值;在一例中,所述特征量基准值为特定像素值的规定像素比例,检测单元计算热像数据中特定像素值的像素比例,二者进行比较,来获得相关度的值,所计算出的差越小,相关度越高。将相关度的值,与判断值进行比较,来确定是否检测到特定被摄体热像。The detection processing of the detecting unit 8 is based on the detection method of the feature amount described by the parameter. For example, the feature amount of the thermal image data in the detection window may be calculated as the value of the correlation degree according to the subject identification information; for example, the subject identification information may further include a feature amount reference value, and a predetermined operation may be performed to obtain the detection. a feature quantity of the thermal image data in the window, and comparing with the feature quantity reference value to obtain a value of the correlation degree; in one example, the feature quantity reference value is a prescribed pixel ratio of a specific pixel value, and the detecting unit calculates the thermal image The pixel ratio of a specific pixel value in the data is compared to obtain the value of the correlation, and the smaller the calculated difference is, the higher the correlation is. The value of the correlation is compared with the judgment value to determine whether a specific subject thermal image is detected.
优选的方式,采用轮廓图像作为匹配的模板图像,检测部8例如通过以下的处理来检测热像数据帧中是否具有特定被摄体;首先,检测部8提取位于检测窗口中的热像数据,按照AD值的预定阀值对读取的检测窗口中的热像数据进行二值化;接着,提取该二值图像的具有预定像素值(1或0)的像素相连通的连通图像;而后判断该连通图像是否具有预定范围的大小;如果判断出该连通图像的大小在预定范围内,则近一步在提取的连通图像与所登记的模板图像之间执行比较处理,例如计算二者之间的重叠面积在各自总面积中的比例之和,获得相关度的值;该数值越大,则相关度越高;将相关度的值,根据规定的判断值进行判断,来确定是否检测到特定被摄体热像。In a preferred embodiment, the contour image is used as the matched template image, and the detecting unit 8 detects whether or not there is a specific subject in the thermal image data frame, for example, by the following processing; first, the detecting unit 8 extracts the thermal image data located in the detection window, And normalizing the thermal image data in the read detection window according to a predetermined threshold of the AD value; then, extracting the connected image of the binary image having the predetermined pixel value (1 or 0) connected; and then determining Whether the connected image has a predetermined range of size; if it is determined that the size of the connected image is within a predetermined range, a comparison process is performed between the extracted connected image and the registered template image, for example, between the two The sum of the ratios of the overlapping areas in the respective total areas obtains the value of the correlation; the larger the value, the higher the correlation; the value of the correlation is judged according to the specified judgment value to determine whether a specific one is detected Thermal image of the subject.
对于检测的示例,如图5所示,检测部8从热像数据帧501的规定检测区域G1的左上角到右下角移动窗口J1以进行检测,剪切窗口中的热像数据,并检测其与模板图像T1的相关度。具体而言,窗口J1从左端向右以规定值的窗口位移(例如一个像素)逐步地移动,并在到达右端后,被设置返回左端并向下移动窗口位移,以及随后再次逐步地向右移动。为高精度地检测被摄体,检测的窗口尺寸、窗口位移、窗口的倾斜角度的变换范围被预先定义,例如窗口尺寸的变化范围从150×50像素到120×40像素,窗口位移的变化范围从10个像素到1个像素,窗口的倾斜角度的变化范围为基于中心点的0°到10°。检测部8逐次的,每 次5个像素地改变窗口尺寸,并每次1个像素地改变窗口位移,并每次2°地改变窗口倾斜角度。检测部8进行模板图像T1和热像数据帧501的相关度计算;在完成所有检测窗口的检测后,从中选择相关度最高的检测窗口所获得的相关度的值,作为该热像数据帧501对应的相关度的值。For the example of detection, as shown in FIG. 5, the detecting section 8 moves the window J1 from the upper left corner to the lower right corner of the predetermined detection area G1 of the thermal image data frame 501 to detect, cuts the thermal image data in the window, and detects it. The degree of correlation with the template image T1. Specifically, the window J1 is gradually moved from the left end to the right with a window displacement of a prescribed value (for example, one pixel), and after reaching the right end, is set to return to the left end and move the window displacement downward, and then gradually move to the right again. . In order to detect the subject with high precision, the range of the detected window size, window displacement, and tilt angle of the window is defined in advance, for example, the window size varies from 150×50 pixels to 120×40 pixels, and the range of window displacement varies. From 10 pixels to 1 pixel, the tilt angle of the window varies from 0° to 10° based on the center point. Detection unit 8 successively, each The window size is changed 5 pixels later, and the window displacement is changed 1 pixel at a time, and the window tilt angle is changed 2° each time. The detecting unit 8 performs correlation calculation of the template image T1 and the thermal image data frame 501; after completing the detection of all the detection windows, the value of the correlation obtained by selecting the detection window with the highest correlation is selected as the thermal image data frame 501. The value of the corresponding relevance.
注意,可以基于被摄体识别信息,来计算相关度的各种方法,上述例举的处理仅是可使用方法的示例。Note that various methods of calculating the degree of correlation may be calculated based on the subject identification information, and the above-exemplified processing is only an example of a usable method.
显示控制部9,用于将临时存储部2所存储的显示用的图像数据显示在显示部10。例如,可连续显示拍摄获得的热像数据帧生成的红外热像,可显示各种设定信息。具体而言,显示控制部9具有VRAM、VRAM控制单元、信号生成单元(未图示)等,并且,信号生成单元在控制部11的控制下,从VRAM中定期读出图像数据(从临时存储部2读出并存储到VRAM的图像数据),产生视频信号输出,显示在显示部10。在热像装置100中,显示部10例如是液晶显示装置。不限于此,显示部10还可以是与热像装置100连接的其他显示装置,而热像装置100自身的电气结构中可以没有显示部。The display control unit 9 displays the image data for display stored in the temporary storage unit 2 on the display unit 10. For example, the infrared thermal image generated by the captured thermal image data frame can be continuously displayed, and various setting information can be displayed. Specifically, the display control unit 9 has a VRAM, a VRAM control unit, a signal generating unit (not shown), and the like, and the signal generating unit periodically reads out image data from the VRAM under the control of the control unit 11 (from temporary storage) The portion 2 reads out and stores the image data to the VRAM, generates a video signal output, and displays it on the display unit 10. In the thermal imaging device 100, the display unit 10 is, for example, a liquid crystal display device. Not limited to this, the display unit 10 may be another display device connected to the thermal image device 100, and the thermal image device 100 itself may have no display portion in the electrical configuration.
在检测到特定被摄体热像时、或诊断到缺陷的特定被摄体热像时,可进行通知;例如以显示诊断结果、显示分析区域的方式来指示被摄体热像的位置等;此外例如显示规定时间内最大相关度的热像数据帧获得的缩小的红外热像,或者还伴随着文字、颜色、闪烁变化等方式来进行通知。When a specific subject thermal image is detected or a specific subject thermal image of the defect is diagnosed, a notification may be made; for example, the position of the thermal image of the subject is indicated by displaying the diagnosis result, displaying the analysis region, and the like; Further, for example, a reduced infrared thermal image obtained by displaying a thermal image data frame of a maximum correlation within a predetermined time period or a notification of a character, a color, a flicker change, or the like is also displayed.
优选的,可显示相关度的信息;相关度的信息,例如可以将相关度的值、检测到特定被摄体热像的结果等换算为,示意匹配程度的便于使用者理解的信息,进行显示;例如将相关度的值换算为百分比值;在一个例子中,将所提取的特定被摄体轮廓与轮廓T1重叠面积在各自总面积中的比例之和,除以200%,即可换算为相关度的百分比值,将相关度的值换算为百分比值。也可根据相关度的值与百分比的规定的对照表,来换算;也可采用其他方式,例如直接显示检测处理计算获得的相关度的值,在一个例子中,直接显示像素值之差的和的数值等。为便于说明,在下文中,将相关度的值、评价值等换算的百分比值作为示例,但实际中并不必须换算成百分比值。Preferably, the information of the correlation degree is displayed; the information of the correlation degree, for example, the value of the correlation degree, the result of detecting the specific subject thermal image, etc., may be converted into information indicating the degree of matching that is easy for the user to understand, and displayed. For example, the value of the correlation is converted into a percentage value; in one example, the sum of the extracted specific object contour and the ratio of the overlap area of the contour T1 in the respective total areas is divided by 200%, which can be converted into The percentage value of the correlation, which converts the value of the correlation into a percentage value. It can also be converted according to the specified comparison table of the value and the percentage of the correlation degree; other methods such as directly displaying the value of the correlation obtained by the detection processing calculation, and in one example, directly displaying the sum of the differences of the pixel values Values, etc. For convenience of explanation, in the following, the percentage value converted into the correlation value, the evaluation value, and the like is taken as an example, but in practice, it is not necessary to convert into a percentage value.
控制部11控制了热像装置100的整体的动作,在存储介质例如闪存3中存储有用于控制的程序,以及各部分控制中使用的各种数据。控制部11例如由CPU、MPU、SOC、可编程的FPGA等来实现。The control unit 11 controls the overall operation of the thermal imaging device 100, and stores a program for control and various data used for control of each part in a storage medium such as the flash memory 3. The control unit 11 is realized by, for example, a CPU, an MPU, an SOC, a programmable FPGA, or the like.
在本实施例中,控制部11作为选择部的例子,用于选择被摄体信息;例如根据使用者对被摄体指示信息的选择,来选择所述被摄体指示信息对应的被摄体信息。In the present embodiment, the control unit 11 is used as an example of the selection unit for selecting subject information; for example, the subject corresponding to the subject instruction information is selected according to the user's selection of the subject instruction information. information.
操作部12:用于使用者进行各种指示操作,或者输入设定信息等各种操作,控制部11根据操作部12的操作信号,执行相应的程序。参考图2来说明操作部12,提供使用者操作的按键有记录键01、调焦键02、确认键03、回放键04、菜单健05、方向键06等;此外,也可采用触摸屏07或语音识别部件(未图示)等来实现相关的操作。The operation unit 12 is for the user to perform various instruction operations or input various operations such as setting information, and the control unit 11 executes the corresponding program based on the operation signal of the operation unit 12. Referring to FIG. 2, the operation unit 12 is provided. The buttons for providing user operations include a record button 01, a focus button 02, a confirmation button 03, a play button 04, a menu button 05, a direction button 06, and the like; in addition, a touch screen 07 or a touch screen can be used. A speech recognition component (not shown) or the like is used to implement related operations.
参考图6来说明拍摄过程中的显示界面的变化,参见图7来说明热像装置100的检测模式的控制流程,本应用场景如使用者手持热像装置100对变电站的被摄体进行拍摄。在接通电源后,控制部11进行内部电路的初始化,而后,进入拍摄模式,即拍摄部1拍摄获得热像数据帧,图像处理部7将拍摄部1拍摄获得的热像数据帧进行规定的处理,存储在临时存储部2中,显示部10上以动态图像形式连续显示红外热像,在此状态,控制部11实施其控制, 持续监视是否按照预定操作切换到了其他模式的处理或进行了关机操作,如果有,则进入相应的处理控制。检测模式的控制步骤如下:The change of the display interface during photographing will be described with reference to FIG. 6. Referring to FIG. 7, the control flow of the detection mode of the thermal image device 100 will be described. In this application scenario, the user holds the thermal image device 100 to photograph the subject of the substation. After the power is turned on, the control unit 11 initializes the internal circuit, and then enters the imaging mode, that is, the imaging unit 1 captures a thermal image data frame, and the image processing unit 7 defines the thermal image data frame captured by the imaging unit 1. The processing is stored in the temporary storage unit 2, and the infrared thermal image is continuously displayed in the form of a moving image on the display unit 10. In this state, the control unit 11 performs its control. Continuously monitor whether the process of switching to another mode or the shutdown operation is performed according to a predetermined operation, and if so, the corresponding process control is entered. The control mode of the detection mode is as follows:
在步骤A01,特征登记单元登记被摄体识别信息。例如,控制部11基于闪存3中存储的表,将被摄体信息生成的被摄体指示信息显示在显示部10,当使用者根据拍摄现场的被摄体“被摄体1”,通过操作部12来选择显示部10上所显示的“被摄体1”,根据“被摄体1”关联的被摄体识别信息,特征登记单元确定用于检测处理的被摄体识别信息,从闪存3中读取模板图像301,传送到临时存储部2。In step A01, the feature registration unit registers the subject identification information. For example, the control unit 11 displays the subject instruction information generated by the subject information on the display unit 10 based on the table stored in the flash memory 3, and the user operates by the subject "subject 1" at the shooting scene. The portion 12 selects "subject 1" displayed on the display portion 10, and the feature registration unit determines the subject identification information for the detection processing based on the subject identification information associated with the "subject 1", from the flash memory The template image 301 is read in 3 and transmitted to the temporary storage unit 2.
步骤A02,获取热像数据帧,将拍摄部1拍摄获得的热像数据帧传送到临时存储部2;Step A02, the thermal image data frame is acquired, and the thermal image data frame obtained by the imaging unit 1 is transmitted to the temporary storage unit 2;
步骤A03,读取临时存储部2中例如由拍摄部1即时拍摄获得的热像数据帧,检测窗口设置单元,设置检测窗口。例如,基于规定的检测区域G1的左上角,首先设置了检测窗口;In step A03, the thermal image data frame obtained by the image capturing unit 1 for example, for example, is detected in the temporary storage unit 2, the detection window setting unit is set, and the detection window is set. For example, based on the upper left corner of the prescribed detection area G1, a detection window is first set;
步骤A04,对检测窗口中的热像数据,基于被摄体识别信息,进行相关度计算的处理。In step A04, the processing of the correlation calculation is performed based on the subject identification information on the thermal image data in the detection window.
检测部8基于检测窗口设置单元所设置的检测窗口,抽取位于该检测窗口中的热像数据,根据特征登记单元所登记的模板,计算二者之间的相关度。例如,根据检测窗口中的热像数据,提取的特定被摄体热像的轮廓,与轮廓图像T1(模板图像301获得)的轮廓对比,计算二者之间的重叠面积在各自总面积中的比例之和。The detecting unit 8 extracts the thermal image data located in the detection window based on the detection window set by the detection window setting unit, and calculates the correlation between the two based on the template registered by the feature registration unit. For example, according to the thermal image data in the detection window, the contour of the extracted specific subject thermal image is compared with the contour of the contour image T1 (obtained by the template image 301), and the overlapping area between the two is calculated in the respective total areas. The sum of the ratios.
并且,在步骤A05,存储所得到的相关度的值。And, in step A05, the value of the obtained correlation is stored.
在步骤A06中,检测部8判断在热像数据帧中设置检测窗口时,是否已经针对所有检测窗口计算了相关度。如果剩余还没有计算相关度的区域(步骤A06中为否)则回到步骤A03中,检测窗口设置单元在预定方向上将检测窗口的位置偏移预定像素数,将该位置设置为检测窗口的下一位置,并重复后续的处理。In step A06, the detecting section 8 judges whether or not the correlation degree has been calculated for all the detection windows when the detection window is set in the thermal image data frame. If there is no area where the correlation has not been calculated yet (NO in step A06), the process returns to step A03, and the detection window setting unit shifts the position of the detection window by a predetermined number of pixels in a predetermined direction, and sets the position as the detection window. Next position and repeat the subsequent processing.
此外,从热像数据帧中搜索与模板类似的部分时,对于放大及缩小、以及将检测窗口倾斜规定角度后的检测窗口时,也进行类似上述说明的检测处理。Further, when searching for a portion similar to the template from the thermal image data frame, the detection processing similar to that described above is also performed when the detection window is enlarged and reduced and the detection window is tilted by a predetermined angle.
如果已经针对要在热像数据帧中设置的所有检测窗口计算了相关度(步骤A06中为是),则在步骤A07中获得检测到的最大相关度的值及所对应的检测窗口的位置参数。If the correlation has been calculated for all the detection windows to be set in the thermal image data frame (YES in step A06), the value of the detected maximum correlation and the position parameter of the corresponding detection window are obtained in step A07. .
并且,在步骤A08,如果相关度小于规定的判断值,则检测部8判断没有检测到特定被摄体热像,到步骤A10,如图6(a)所示,由于未在检测区域G1中检测到匹配的被摄体热像,则没有分析、诊断等处理。当在步骤A08检测到的相关度大于规定的判断值,则进入步骤A09。Further, in step A08, if the correlation degree is smaller than the predetermined determination value, the detecting unit 8 determines that the specific subject thermal image is not detected, and proceeds to step A10, as shown in FIG. 6(a), because it is not in the detection area G1. If a matching subject thermal image is detected, there is no processing such as analysis or diagnosis. When the correlation detected in step A08 is greater than the predetermined determination value, the process proceeds to step A09.
步骤A09,在检测到具有特定被摄体热像的热像数据帧后,分析部6,对该热像数据帧进行热像诊断,获得诊断结果。In step A09, after detecting the thermal image data frame having the specific subject thermal image, the analyzing unit 6 performs thermal imaging diagnosis on the thermal image data frame to obtain a diagnosis result.
例如根据相关度最大的检测窗口B1的位置、尺寸来设置分析区域,如图6(b)所示的分析区域F1,并按照分析区域F1对应的分析模式1进行分析,而后进行诊断。For example, the analysis area is set based on the position and size of the detection window B1 having the highest correlation, and the analysis area F1 shown in FIG. 6(b) is analyzed in accordance with the analysis mode 1 corresponding to the analysis area F1, and then the diagnosis is performed.
在检测到具有特定被摄体热像的热像数据帧后,分析配置单元进行分析区域的配置;具体而言,如根据与模板301关联存储的分析区域的构成数据(f1构成数据),来确定分析区域的构成数据;根据分析区域F1与模板301的规定位置关系,检测窗口B1位于该热像数据帧中的位置、尺寸、倾斜角度,来作为分析区域的位置参数相关的配置信息;并且,可根据图3中的对应关系,配置分析模式1、诊断规则1作为分析模式、诊断规则。在另一例中,也可根据分析区域F1与模板301的规定位置关系,检测窗口B1位于该热像数据帧中的位置、尺寸、倾斜角度,计算获得分析区域位于热像数据帧中的位置参数,而后对分析区域的构成 数据进行相应的缩放等处理,所获得的分析区域的构成数据和分析区域的位置参数,来作为的配置信息。After detecting the thermal image data frame having the specific subject thermal image, the analysis configuration unit performs the configuration of the analysis region; specifically, according to the constituent data of the analysis region stored in association with the template 301 (f1 constitutes data), Determining the composition data of the analysis area; according to the specified positional relationship between the analysis area F1 and the template 301, detecting the position, size, and inclination angle of the window B1 in the thermal image data frame as the configuration information related to the position parameter of the analysis area; According to the correspondence in FIG. 3, the analysis mode 1 and the diagnosis rule 1 can be configured as the analysis mode and the diagnosis rule. In another example, according to the specified positional relationship between the analysis area F1 and the template 301, the position, size, and inclination angle of the window B1 in the thermal image data frame are detected, and the positional parameter of the analysis area located in the thermal image data frame is calculated. And then the composition of the analysis area The data is subjected to corresponding scaling and the like, and the obtained constituent data of the analysis region and the positional parameters of the analysis region are used as configuration information.
此外,所检测到的特定被摄体热像的位置、尺寸、倾斜角度等的位置参数,并不限定于检测窗口的位置参数,例如,进一步提取检测窗口中的热像数据的特征,例如提取被摄体轮廓,来获得更为精确的位置参数,可根据该位置参数来设置分析区域。Further, the detected positional parameters of the position, size, inclination angle, and the like of the specific subject thermal image are not limited to the positional parameters of the detection window, for example, further extracting features of the thermal image data in the detection window, for example, extraction The subject contour is used to obtain a more accurate positional parameter, and the analysis area can be set according to the positional parameter.
分析区域设置单元,根据分析区域的配置信息,例如进行计算位置参数、相应的缩放等处理后,对该热像数据帧设置分析区域F1,包括分析区域S01、S02;The analysis area setting unit sets the analysis area F1, including the analysis areas S01 and S02, to the thermal image data frame according to the configuration information of the analysis area, for example, the calculation of the position parameter, the corresponding scaling, and the like;
而后,分析单元,根据分析区域设置单元设置的分析区域F1,及对应的分析模式1进行分析,获得分析结果;诊断单元,根据分析结果,与分析区域F1和分析模式1对应的“诊断规则1”,来获得诊断结果。如图6(b)所示的分析区域F1,分析结果、诊断结果的显示栏,其中,根据S01和S02最高温度的差值为3℃,小于4℃,大于2℃;诊断结论及注释:关注。注意,分析区域F1、分析结果、诊断结果并不必须显示。Then, the analysis unit analyzes according to the analysis area F1 set by the analysis area setting unit and the corresponding analysis mode 1, and obtains the analysis result; the diagnosis unit, according to the analysis result, the diagnosis rule 1 corresponding to the analysis area F1 and the analysis mode 1 ", to get the diagnosis. As shown in Fig. 6(b), the analysis area F1, the analysis result and the display column of the diagnosis result, wherein the difference between the highest temperature of S01 and S02 is 3 ° C, less than 4 ° C, and more than 2 ° C; diagnosis conclusion and comment: attention. Note that the analysis area F1, the analysis result, and the diagnosis result do not have to be displayed.
后续,可进行诊断结果的通知,通知的方式,控制显示部10将诊断结果等进行显示。并伴随着例如通过显示部10等中以文字或图像(包括红外热像、参考图像等)的显示画面的变化,热像装置100中的指示灯产生的光、扬声器发出的声音提示、振动部件的振动等,只要是使用者可以感知的方法都包含在内。此外,也可输出分析和/或诊断结果,例如从通信接口I/F4输出,被与热像装置100连接的其他外部装置所接收。Subsequently, the diagnosis result can be notified, and the notification display unit 10 displays the diagnosis result and the like. With the change of the display screen of characters or images (including infrared thermal images, reference images, etc.) in the display unit 10 or the like, the light generated by the indicator light in the thermal image device 100, the sound prompt from the speaker, and the vibration component are accompanied by changes. Vibrations, etc., are included as long as they are perceptible by the user. In addition, analysis and/or diagnostic results may also be output, such as output from communication interface I/F 4, received by other external devices connected to thermal imaging device 100.
步骤A10,判断是否退出,如退出,则结束,如未退出,则回到步骤A02,重复上述的处理。这样,对连续拍摄获得的热像数据帧,当检测到相关度高于规定的判断值的热像数据帧时,能根据检测到的被摄体热像,来自动配置分析区域、分析模式、诊断规则,进行相应的处理。In step A10, it is judged whether to exit, if it is exited, it ends. If it is not exited, it returns to step A02, and the above processing is repeated. In this way, when the thermal image data frame obtained by the continuous shooting is detected, when the thermal image data frame whose correlation is higher than the predetermined judgment value is detected, the analysis region, the analysis mode, and the analysis mode can be automatically configured according to the detected subject thermal image. Diagnose the rules and handle them accordingly.
这样,使用者就不必需通过人为的主观判断被摄体热像的形态特征来人工设置分析区域、分析模式、诊断规则,能达到减轻分析区域设置操作的工作量、降低分析区域设置的技术难度、便于设置精准的分析区域、分析模式、诊断规则,快速获得诊断结果、避免拍摄错误部位、角度等的有益效果。In this way, the user does not have to manually set the analysis area, the analysis mode, and the diagnostic rule by subjectively judging the morphological characteristics of the subject thermal image, thereby reducing the workload of the analysis area setting operation and reducing the technical difficulty of the analysis area setting. It is convenient to set accurate analysis area, analysis mode, diagnosis rule, quickly obtain the diagnosis result, avoid the harmful effect of shooting the wrong part and angle.
需要指出,检测部8基于获取部连续获取的热像数据帧进行的检测处理,例如可对连续获取的热像数据帧依次全部进行检测处理,例如也可只读取规定间隔的热像数据帧进行检测处理;例如还对读取的热像数据帧或检测窗口中的热像数据检测前进行了缩小、稀疏等处理;以此,能减轻检测处理负担。It is to be noted that the detection unit 8 performs detection processing based on the thermal image data frames continuously acquired by the acquisition unit. For example, all of the continuously acquired thermal image data frames may be sequentially detected. For example, only the thermal image data frames of a predetermined interval may be read. The detection processing is performed; for example, the processing of the thermal image data in the read thermal image data frame or the detection window is reduced, sparse, and the like before the detection; thereby, the detection processing load can be reduced.
并且,所配置的分析区域、分析模式、诊断规则,并不限定于对检测出特定被摄体热像的热像数据帧进行处理,也用于后续例如规定时间的新获得的热像数据帧的分析诊断等处理。当临时存储部2为存储多帧份的热像数据帧时,甚至可用于分析诊断所检测到具有特定被摄体热像的热像数据帧的时序之前的热像数据帧。可将所配置上述信息,相关联存储在临时存储部的规定区域;便于后续的显示、分析、记录等处理。Further, the configured analysis region, analysis mode, and diagnostic rule are not limited to processing the thermal image data frame in which the specific subject thermal image is detected, and are also used for subsequent newly obtained thermal image data frames such as predetermined time. Analytical diagnosis and other processing. When the temporary storage section 2 stores a plurality of frames of thermal image data frames, it can be used to analyze and diagnose a thermal image data frame before the timing of detecting a thermal image data frame having a specific subject thermal image. The above-configured information may be stored in a predetermined area of the temporary storage unit in association with each other; and subsequent processing such as display, analysis, and recording may be facilitated.
此外,对是否检测到特定的被摄体热像,并不限于相关度的值与判断值之间的比较;例如也可替换为,根据检测获得的规定信息和/或基于规定信息获得的评价值,与对应的判断值的比较结果,作为是否检测到特定被摄体热像的依据。所述规定信息,至少包括特定被摄体热像的位置、尺寸、倾斜角度、相关度的值中的一种或任意组合的信息。这样,例如事先规 范好被摄体热像的优选位置、尺寸等,能提高被摄体热像的拍摄质量,从而进一步提高分析区域设置的有效性、提高拍摄质量等的有益效果。Further, whether or not a specific subject thermal image is detected is not limited to a comparison between the value of the correlation and the judgment value; for example, it may be replaced with a predetermined information obtained based on the detection and/or a rating based on the prescribed information. The value, the result of comparison with the corresponding judgment value, is used as a basis for detecting whether or not a specific subject thermal image is detected. The predetermined information includes at least one of a position, a size, an inclination angle, and a value of a correlation of a specific subject thermal image, or any combination thereof. In this way, for example, The preferred position and size of the thermal image of the subject can improve the quality of the subject's thermal image, thereby further improving the effectiveness of the analysis area setting and improving the photographing quality.
如上所述,在实施例1中,如设定了规定的检测区域,可加快检测的速度,其如显示能便于使用者理解拍摄的范围;当检测到特定被摄体热像,可自动设置分析区域、分析模式、诊断规则,并可进行分析、诊断等处理;其中,当根据检测到特定被摄体热像的位置、尺寸(或位置、尺寸、倾斜角度),基于被摄体识别信息关联的分析区域的构成数据,及分析区域与被摄体识别信息之间的规定位置关系,来设置分析区域,可设置极为精准的分析区域;可利于下一步的存储、分析等处理和操作,解决了现有技术的问题,如果分析区域进行显示,使用者观察到该分析区域,就知道拍摄了符合要求的被摄体热像;能达到大幅度降低设置分析区域的操作难度,提高分析精度的有益效果。普通使用者容易掌握这种拍摄技能。实施例1为较优的实施方式,当然,实施本发明的实施方式的任一产品并不一定需要同时达到以上所述的所有优点。As described above, in the first embodiment, if the predetermined detection area is set, the speed of detection can be speeded up, and the display can facilitate the user to understand the range of shooting; when a specific subject thermal image is detected, it can be automatically set. The analysis area, the analysis mode, the diagnosis rule, and the analysis, diagnosis, and the like; wherein, based on the position, size (or position, size, and inclination angle) of the specific subject thermal image, the object identification information is based on the subject The composition data of the associated analysis area, and the specified positional relationship between the analysis area and the object identification information, to set the analysis area, can set an extremely accurate analysis area; can facilitate the next processing and operation of storage, analysis, etc. The problem of the prior art is solved. If the analysis area is displayed, the user observes the analysis area, and knows that the subject thermal image that meets the requirements is photographed; the operation difficulty of setting the analysis area is greatly reduced, and the analysis accuracy is improved. The benefits. It is easy for ordinary users to master this shooting skill. Embodiment 1 is a preferred embodiment, and of course, it is not necessarily required to achieve all of the advantages described above while implementing any of the embodiments of the present invention.
实施例2Example 2
实施例2中,根据检测部8检测获得的不同的规定信息,可配置相同或不同分析区域、分析模式、诊断规则的组合;根据检测部8检测获得的规定信息,例如可根据检测获得的规定信息和/或规定信息获得的评价值,与分析区域和/或分析模式和/或诊断规则的对应关系,来配置相应的分析区域和/或分析模式和/或诊断规则。规定信息,至少包括特定被摄体热像的位置、尺寸、倾斜角度、相关度的值,其中的一种或任意组合的信息。In the second embodiment, based on the detection of the different predetermined information obtained by the detecting unit 8, the combination of the same or different analysis areas, analysis modes, and diagnostic rules can be arranged; and the predetermined information obtained by the detecting unit 8 can be determined, for example, according to the regulations obtained by the detection. The corresponding analysis area and/or analysis mode and/or diagnostic rule are configured by the information and/or the evaluation value obtained by the specified information, the correspondence relationship with the analysis area and/or the analysis mode and/or the diagnostic rule. The prescribed information includes at least information of a position, a size, an inclination angle, a correlation value of a specific subject thermal image, one or any combination thereof.
其中,可根据规定信息中的一项或多项,和,规定信息中相同或不同的一项或多项获得的评价值,二者与分析区域和/或分析模式和/或诊断规则的对应关系,来配置相应的分析区域和/或分析模式和/或诊断规则。其中,与分析区域具有直接对应关系的规定信息,和用于获得评价值的规定信息,可以包含相同或不同的信息。Wherein, the evaluation value obtained by one or more of the specified information and the one or more of the same or different information in the information may be corresponding to the analysis area and/or the analysis mode and/or the diagnostic rule. Relationships to configure the corresponding analysis area and/or analysis mode and/or diagnostic rules. The predetermined information having a direct correspondence with the analysis area and the predetermined information for obtaining the evaluation value may include the same or different information.
根据检测到的不同规定信息,相应的分析区域和/或分析模式和/或诊断规则,可以代表了相同或不同分析效果的分析区域和/或分析模式和/或诊断规则,和/或,相同或不同显示效果的分析区域。Depending on the detected different regulatory information, the respective analysis area and/or analysis mode and/or diagnostic rules may represent analysis areas and/or analysis modes and/or diagnostic rules of the same or different analysis effects, and/or the same Or an analysis area with different display effects.
不同分析效果的分析区域和/或分析模式和/或诊断规则,例如可包括分析区域的构成数据、分析区域位于热像数据帧中的位置参数、分析模式、诊断规则,其中之一的不同。不同显示效果的分析区域,例如可包括颜色、线形、粗细、透明率、内容、闪烁状态、亮度、构成数据、尺寸之一的不同。The analysis area and/or analysis mode and/or diagnostic rule of different analysis effects may include, for example, composition data of the analysis area, positional parameters of the analysis area in the thermal image data frame, analysis mode, and diagnostic rules, one of which is different. The analysis area of different display effects may include, for example, a difference in color, line shape, thickness, transparency, content, blinking state, brightness, composition data, and size.
在红外检测领域,由于考虑到被摄体热像在红外热像中的位置、尺寸、倾斜角度等的不同,对应了不同的拍摄质量;因此,优选的,根据被摄体热像位于热像数据帧中的位置、尺寸、倾斜角度等因素,作为配置相应分析效果和/或显示效果的分析区域和/或分析模式和/或诊断规则的因素,来提高分析和诊断的质量。In the field of infrared detection, since the position, size, tilt angle, and the like of the thermal image of the object in the infrared thermal image are taken into consideration, different photographing qualities are corresponding; therefore, preferably, the thermal image of the subject is located in the thermal image. Factors such as position, size, and tilt angle in the data frame are used as factors for configuring the analysis area and/or analysis mode and/or diagnostic rule of the corresponding analysis effect and/or display effect to improve the quality of analysis and diagnosis.
本实施例中,根据规定信息和/或规定信息获得的评价值,与分析配置信息的对应关系,并根据所检测到的特定被摄体热像的位置参数,来配置相应的分析区域和/或分析模式和/或诊断规则。所述分析配置信息,至少包括了分析区域、分析区域、诊断规则中的一项或多项有关的配置信息;例如,不同的评价值对应了不同的分析区域、分析模式、诊断规则的组合。 In this embodiment, the correspondence between the evaluation value obtained based on the predetermined information and/or the predetermined information and the analysis configuration information, and the corresponding analysis region and/or according to the detected position parameter of the specific subject thermal image. Or analysis mode and/or diagnostic rules. The analysis configuration information includes at least one or more related configuration information in the analysis area, the analysis area, and the diagnosis rule; for example, different evaluation values correspond to different analysis areas, analysis modes, and combinations of diagnosis rules.
如图9所示的评价值与分析配置信息的对照表,假定对应了图3中的“被摄体1”,不同的评价值对应了不同的分析配置信息;其中评价值80-90%和评价值91%-100%,二者对应的分析区域、分析模式、诊断规则的分析配置信息不同。As shown in FIG. 9, the comparison table of the evaluation value and the analysis configuration information assumes that "subject 1" in FIG. 3 corresponds, and different evaluation values correspond to different analysis configuration information; wherein the evaluation value is 80-90% and The evaluation value is 91%-100%, and the analysis configuration information of the analysis area, analysis mode, and diagnosis rule corresponding to the two is different.
通过规定信息来获得综合的评价值;例如,可以采用所检测的规定信息中的特定信息对应了不同的系数,而由所检测的规定信息中的其他的规定信息结合该系数来获得评价值;例如,如图11中所示,图11(a)检测窗口J1的所对应的0.8,而图11(b)检测窗口J2的窗口系数为0.95,评价值=相关度的值×窗口系数,因此,当二个窗口中检测到相关度一样的热像数据时,图11(b)所检测出的相关度的值结合检测窗口J2的评价值(例如换算为95%)将大于图11(a)相关度的值结合检测窗口J1的评价值(例如换算为80%),根据评价值所对应的分析区域,来获得图11(a)的分析区域J1,及图11(b)的分析区域J2和分析区域F1,和各自对应的分析模式、诊断规则。检测到特定被摄体热像的检测窗口,例如代表了该特定被摄体热像大致的位置参数,如期望获得更为精确的特定被摄体热像的位置参数,一个实施方式,可进一步从该检测窗口对应的热像数据中提取特定被摄体热像的轮廓来获得,可获得更为精准的评价值。Obtaining a comprehensive evaluation value by specifying information; for example, the specific information in the detected prescribed information may correspond to different coefficients, and the other specified information in the detected prescribed information is combined with the coefficient to obtain an evaluation value; For example, as shown in FIG. 11, FIG. 11(a) detects the corresponding 0.8 of the window J1, and FIG. 11(b) detects that the window coefficient of the window J2 is 0.95, and the evaluation value = the value of the correlation degree × the window coefficient, When the thermal image data of the same correlation is detected in the two windows, the value of the correlation detected by FIG. 11(b) combined with the evaluation value of the detection window J2 (for example, 95%) will be larger than that of FIG. 11 (a). The value of the correlation is combined with the evaluation value of the detection window J1 (for example, converted to 80%), and the analysis region J1 of FIG. 11(a) and the analysis region of FIG. 11(b) are obtained based on the analysis region corresponding to the evaluation value. J2 and analysis area F1, and their respective analysis modes and diagnostic rules. A detection window in which a specific subject thermal image is detected, for example, a positional parameter representing a general image of the specific subject, such as a positional parameter that is desired to obtain a more accurate specific subject thermal image, and an embodiment may further By extracting the contour of the specific subject thermal image from the thermal image data corresponding to the detection window, a more accurate evaluation value can be obtained.
此外也包括,例如采用不同的信息所占的权重,通过加权来获得评价值。例如可根据其他因素例如结合特定行业要求的参数,结合检测获得的规定信息,来获得评价值;可以通过各种不同的计算方式来获得最终的评价值。In addition, for example, the weights of different information are used, and the evaluation values are obtained by weighting. For example, the evaluation value may be obtained according to other factors, for example, in combination with the parameters required by the specific industry, in combination with the prescribed information obtained by the detection; the final evaluation value may be obtained by various calculation methods.
优选的,根据不同的被摄体来预先准备根据规定信息和/或规定信息获得的评价值,与分析配置信息之间的对照表,并与图3中被摄体信息、被摄体识别信息等对应存储。Preferably, the evaluation table obtained from the predetermined information and/or the predetermined information and the comparison table between the analysis configuration information are prepared in advance according to the different subjects, and the subject information and the subject identification information in FIG. 3 are prepared. Corresponding storage.
参见图10来说明实施例2的热像装置100的检测模式的控制流程,参考图11来说明分析的显示例。The control flow of the detection mode of the thermal imaging device 100 of the second embodiment will be described with reference to Fig. 10. A display example of the analysis will be described with reference to Fig. 11 .
步骤B01,获取热像数据帧,例如拍摄部1拍摄获得的热像数据帧传送到临时存储部2;Step B01, obtaining a thermal image data frame, for example, the thermal image data frame obtained by the imaging unit 1 is transmitted to the temporary storage unit 2;
步骤B02,类同于实施例1的步骤A01及A03-A06,省略了说明;Step B02 is similar to steps A01 and A03-A06 of Embodiment 1, and the description is omitted;
步骤B03,检测部8,获得热像数据帧中的最大相关度的检测窗口的相关度的值及其对应的位置参数;Step B03, the detecting unit 8 obtains the value of the correlation degree of the detection window of the maximum correlation degree in the thermal image data frame and the corresponding position parameter thereof;
步骤B04,如果获得的相关度小于规定的判断值,则检测部8判断没有检测到特定被摄体热像,到步骤B06,当在步骤B04检测到的相关度大于规定的判断值,则进入步骤B05。In step B04, if the obtained correlation degree is smaller than the predetermined determination value, the detecting unit 8 determines that the specific subject thermal image is not detected, and proceeds to step B06, and when the correlation degree detected in step B04 is greater than the predetermined determination value, enters Step B05.
步骤B05,控制部11(具有评价值计算单元,未图示),根据检测到的规定信息来获得评价值,例如根据下式来获得综合的评价值,评价值=位置×位置加权系数+尺寸×尺寸加权系数+倾斜角度×倾斜角度加权系数+相关度的值×相关度加权系数;或者,另一种优选的方式,根据所检测到的规定信息与评价值的对照表来获得评价值。In step B05, the control unit 11 (having an evaluation value calculation unit (not shown)) obtains an evaluation value based on the detected predetermined information, for example, obtains a comprehensive evaluation value according to the following formula, and the evaluation value = position × position weighting coefficient + size × size weighting coefficient + tilt angle × tilt angle weighting coefficient + value of correlation degree × correlation weighting coefficient; or, in another preferred mode, an evaluation value is obtained based on the detected comparison table of the prescribed information and the evaluation value.
分析部6根据如图9所示的评价值与分析配置信息的对应关系,根据所获得的规定信息获得的评价值,及检测到的特定被摄体热像的位置、尺寸等,来配置相应的分析区域、分析模式、诊断规则;The analysis unit 6 configures the corresponding value based on the correspondence between the evaluation value and the analysis arrangement information as shown in FIG. 9 based on the obtained evaluation information and the detected position and size of the specific subject thermal image. Analysis area, analysis mode, diagnostic rules;
进一步,可对热像数据帧设置分析区域,根据所配置的分析模式和诊断规则,进行分析和诊断。Further, an analysis area can be set for the thermal image data frame, and analysis and diagnosis can be performed according to the configured analysis mode and diagnostic rule.
如图11所示,图11(a)中所显示的评价值80%,设置分析区域J1;图11(b)中所显示的评价值95%,设置分析区域J2,分析区域F1。 As shown in Fig. 11, the evaluation value 80% shown in Fig. 11(a) is set to the analysis area J1; the evaluation value shown in Fig. 11(b) is 95%, and the analysis area J2 and the analysis area F1 are set.
其中的J1、J2为分析区域设置单元将检测窗口设置为分析区域,根据该分析区域可在分析时能有效的避免降低背景中的其它物体对被摄体热像在分析时的影响,而F1为更加细致的分析区域,用来进一步的细致分析和诊断。Among them, J1 and J2 are analysis area setting units, and the detection window is set as an analysis area, according to which the analysis area can effectively avoid the influence of other objects in the background on the analysis of the subject thermal image, and F1 For more detailed analysis of the area, for further detailed analysis and diagnosis.
进一步,可将分析区域、分析结果、诊断结果与该热像数据帧获得的红外热像进行合成如重叠,而后进行显示。Further, the analysis area, the analysis result, the diagnosis result, and the infrared thermal image obtained by the thermal image data frame may be combined and overlapped, and then displayed.
步骤B06,判断是否退出,如退出,则结束,如未退出,则回到步骤B01,重复上述的处理。In step B06, it is judged whether to exit, if it is exited, it ends. If it is not exited, it returns to step B01, and the above processing is repeated.
这样,对连续拍摄获得的热像数据帧,当检测到不同位置、尺寸、旋转角度、相关度组合的特定被摄体热像时,能自动设置相应的分析区域、分析模式、诊断规则,能提高分析区域和分析模式的设置质量、提示使用者、并避免了使用者设置的繁琐操作。In this way, for a thermal image data frame obtained by continuous shooting, when a specific subject thermal image of a different position, size, rotation angle, and correlation is detected, the corresponding analysis region, analysis mode, and diagnostic rule can be automatically set. Improve the quality of the analysis area and analysis mode, prompt the user, and avoid the cumbersome operation of the user settings.
根据所检测到的规定信息,优选的,能显示不同视觉效果的分析区域,例如在图11(a)的状态,使用者可明白当前并未拍摄获得理想效果的被摄体热像,便于使用者及时采取拍摄调整的措施;当在图11(b)的状态,使用者可明白当前拍摄获得理想效果的被摄体热像;这样,能进一步达到减轻拍摄工作量、避免拍摄错误部位、提示特定检测结果的有益效果。According to the detected predetermined information, preferably, an analysis area capable of displaying different visual effects, for example, in the state of FIG. 11(a), the user can understand that the subject thermal image that does not currently obtain the desired effect is conveniently used. In the state of FIG. 11(b), the user can understand the subject thermal image that is currently photographed to obtain the desired effect; thus, the shooting workload can be further reduced, the wrong part can be avoided, and the prompt can be avoided. The beneficial effects of specific test results.
如上所述,在本实施例中,由于考虑了特定被摄体热像的位置、尺寸、倾斜角度、相关度的值中的一种或任意组合的信息,与分析区域和/或分析模式和/或诊断规则的对应关系,来配置相同或不同的分析区域、分析模式、诊断规则,能及时地提示使用者对特定情况予以注意,能达到大幅度降低拍摄的技术难度、提高被摄体热像的拍摄质量、提高分析区域和分析模式等的设置质量、避免显示过多的分析结果增加使用者工作量、避免不必要的分析结果误导使用者等的有益效果。普通使用者容易掌握这种拍摄技能。当然,实施本发明的实施方式的任一产品并不一定需要同时达到以上所述的所有优点。As described above, in the present embodiment, since the information of one or any combination of the position, the size, the inclination angle, and the correlation value of the specific subject thermal image is considered, the analysis region and/or the analysis mode and / or the corresponding relationship of the diagnostic rules, to configure the same or different analysis areas, analysis modes, diagnostic rules, can prompt users to pay attention to specific situations, can greatly reduce the technical difficulty of shooting, improve the heat of the subject The quality of the image, the improvement of the setting quality of the analysis area and the analysis mode, the avoidance of displaying too many analysis results, the increase in user workload, and the avoidance of unnecessary analysis results to mislead the user. It is easy for ordinary users to master this shooting skill. Of course, implementing any of the products of the embodiments of the present invention does not necessarily require all of the advantages described above to be achieved at the same time.
其他的例子,如图12中所示(省略了分析结果和诊断结果的图示);检测部8,获得热像数据帧中的规定数量和距离的检测区域中所设置的检测窗口的相关度的值及其对应的位置参数;并且,当从具有规定距离的多个检测窗口中,检测到相关度大于规定的判断值时,意味着检测到多个类似的被摄体热像;根据检测获得的规定信息,可配置各自对应的分析区域、分析模式;可提示使用者、避免过多不必要的分析显示、避免例如衰减而不精确的分析结果误导使用者等的有益效果。Other examples are as shown in FIG. 12 (the illustration of the analysis result and the diagnosis result is omitted); the detecting section 8 obtains the correlation degree of the detection window set in the detection area of the prescribed number and distance in the thermal image data frame. And the corresponding positional parameter; and, when detecting the correlation from the plurality of detection windows having the predetermined distance, the correlation is greater than the specified determination value, meaning that a plurality of similar subject thermal images are detected; The obtained specified information can be configured with corresponding analysis areas and analysis modes; the user can be prompted to avoid excessive unnecessary analysis display, and avoid the beneficial effects such as attenuation and inaccurate analysis results misleading the user.
实施例3Example 3
实施例3与实施例1,2的不同之处在于,所述检测部8,用于基于获取的热像数据帧,检测所述热像数据帧中的特定被摄体热像的规定信息;所述分析部6,根据规定的辅助信息及检测部8检测获得的规定信息,来配置与分析有关的分析区域和/或分析模式和/或诊断规则,并按照所配置的分析区域和/或分析模式和/或诊断规则进行分析和诊断。 Embodiment 3 is different from Embodiments 1 and 2 in that the detecting unit 8 is configured to detect predetermined information of a specific subject thermal image in the thermal image data frame based on the acquired thermal image data frame; The analysis unit 6 arranges the analysis region and/or the analysis mode and/or the diagnosis rule related to the analysis based on the predetermined auxiliary information and the predetermined information that the detection unit 8 detects, and according to the configured analysis region and/or Analyze patterns and/or diagnostic rules for analysis and diagnosis.
具体而言,根据规定的辅助信息及规定信息来获得评价值,根据评价值与分析配置信息的对照表,来配置分析区域和/或分析模式和/或诊断规则,进行分析诊断。所述分析配置信息,至少包括了分析区域、分析区域、诊断规则中的一项或多项有关的配置信息;Specifically, the evaluation value is obtained based on the predetermined auxiliary information and the predetermined information, and the analysis region and/or the analysis mode and/or the diagnostic rule are arranged based on the comparison table of the evaluation value and the analysis configuration information, and the analysis diagnosis is performed. The analyzing configuration information includes at least one or more related configuration information in an analysis area, an analysis area, and a diagnosis rule;
所述规定信息,至少包括特定被摄体热像的位置、尺寸、倾斜角度、相关度的值中的一种或任意组合的信息。所述辅助信息,可包括规定信息之外的其他各种对分析、诊断有影响的因素,都在其范围中。所述辅助信息,例如至少包括分析值、诊断结果、环境温度、背景因素、风速、湿度、距离中的一种或任意组合的信息。 The predetermined information includes at least one of a position, a size, an inclination angle, and a value of a correlation of a specific subject thermal image, or any combination thereof. The auxiliary information may include various factors other than the prescribed information that affect the analysis and diagnosis, and are all within the scope thereof. The auxiliary information includes, for example, at least one of an analysis value, a diagnosis result, an ambient temperature, a background factor, a wind speed, a humidity, a distance, or any combination.
辅助信息,例如可以根据热像装置100中包含的功能部件,或与热像装置100连接的相应功能的部件(未图示)来获取上述辅助信息;例如,通过分析部件获取的分析值,所述分析值并不限定于温度值,例如也可以是热像AD值、伪彩热像中的颜色值、特定像数值的比例,或还将这些数值按照规定公式计算获得的值等,分析部件所获取的分析值可以针对热像数据帧中的全部像素或特定分析区域中的像素;例如,通过温度传感器来获取环境温度;例如通过湿度计来获得湿度;例如通过测距仪来获得热像装置100与被摄体的距离等。The auxiliary information may be obtained, for example, according to a functional component included in the thermal imaging device 100 or a corresponding functional component (not shown) connected to the thermal imaging device 100; for example, an analysis value obtained by analyzing the component, The analysis value is not limited to the temperature value, and may be, for example, a thermal image AD value, a color value in a pseudo color thermal image, a ratio of a specific image value, or a value obtained by calculating these values according to a prescribed formula, etc., and analyzing the component. The acquired analysis values may be for all pixels in the thermal image data frame or pixels in a particular analysis region; for example, by ambient temperature to obtain ambient temperature; for example, by a hygrometer to obtain humidity; for example, by a rangefinder to obtain a thermal image The distance between the device 100 and the subject, and the like.
辅助信息,例如也可以根据存储介质中预先存储的上述辅助信息来获取,例如,辅助信息的历史数据;或结合当前测量获取的辅助信息,与存储介质中预先存储的辅助信息的历史数据的对比来获得的辅助信息。例如也可由使用者进行设置的辅助信息。The auxiliary information may be acquired, for example, according to the auxiliary information stored in advance in the storage medium, for example, historical data of the auxiliary information; or the auxiliary data acquired in combination with the current measurement, and the historical data of the auxiliary information stored in advance in the storage medium. To get the auxiliary information. For example, the auxiliary information set by the user can also be performed.
在红外检测的应用领域,根据上述的辅助信息的不同,所获得的热像数据帧的质量及重要程度不同,应有不同的条件来应对规定的热像数据帧的设置分析区域的处理;例如,当获得的特定被摄体热像中具有大于规定的对比值(例如缺陷的阀值)的分析值时,代表被摄体具有缺陷,那么,这时即便在相关度接近的情况下,也优先对分析值超标的热像数据帧进行更为细致的分析,设置较为细致的分析区域,对红外检测的意义重大;而对未大于规定的对比值的被摄体热像,可设置简单的分析区域或显示少量的分析结果数据,以免分析结果数据过多而增加了使用者观察工作量。例如考虑环境温度、背景、风速、背景因素(例如背景与被摄体热像的差异性,背景的热场分布等)等的影响因素,在相关度接近的情况下,这些影响因素可能会导致不同的热像质量及后续分析的价值降低,应选择不同的分析区域和/或分析模式和/或诊断规则来降低其他影响因素干扰的影响。In the field of application of infrared detection, according to the above-mentioned auxiliary information, the quality and importance of the obtained thermal image data frame are different, and different conditions should be met to deal with the setting analysis area of the specified thermal image data frame; for example; When the obtained specific thermal image of the subject has an analysis value larger than a prescribed contrast value (for example, a threshold value of a defect), the representative object has a defect, and then, even when the correlation is close, It is preferred to perform more detailed analysis on the thermal image data frames whose analytical values exceed the standard, and to set a more detailed analysis area, which is of great significance for infrared detection; and for the thermal image of the subject not larger than the specified contrast value, it can be set simple. Analyze the area or display a small amount of analysis result data, so as to avoid too much analysis result data and increase the user observation workload. For example, considering factors such as ambient temperature, background, wind speed, background factors (such as the difference between the background and the thermal image of the object, the thermal field distribution of the background, etc.), these factors may be caused when the correlation is close. Different thermal image quality and subsequent analysis values are reduced. Different analysis areas and/or analysis modes and/or diagnostic rules should be selected to reduce the influence of other influencing factors.
通过规定信息和辅助信息来获得综合的评价值;例如,可以采用规定信息或辅助信息中的特定信息对应了不同的系数,而由其他的规定信息或辅助信息结合该系数来获得评价值。或也可以采用不同的特定信息所占的权重,通过加权来获得评价值;例如,获得综合了特定被摄体热像的位置、尺寸、倾斜角度、辅助信息、相关度的值,获得的评价值,例如根据下式来获得综合评价值,综合评价值=位置×位置加权系数+尺寸×尺寸加权系数+倾斜角度×倾斜角度加权系数+辅助信息×辅助信息的加权系数+相关度的值×相关度加权系数。或根据所述规定信息和所述辅助信息与综合评价值的对照表来获得评价值。The comprehensive evaluation value is obtained by specifying the information and the auxiliary information; for example, the specific information in the predetermined information or the auxiliary information may be used to correspond to different coefficients, and the other predetermined information or auxiliary information may be combined with the coefficient to obtain the evaluation value. Alternatively, the weight of the specific information may be used to obtain the evaluation value by weighting; for example, obtaining the value of the position, size, inclination angle, auxiliary information, and correlation of the specific subject thermal image, and obtaining the evaluation Value, for example, a comprehensive evaluation value is obtained according to the following formula, comprehensive evaluation value = position × position weighting coefficient + size × size weighting coefficient + inclination angle × inclination angle weighting coefficient + auxiliary information × weighting coefficient of auxiliary information + value of correlation × Correlation weighting factor. Or, the evaluation value is obtained based on the prescribed information and a comparison table of the auxiliary information and the comprehensive evaluation value.
而后,根据评价值与分析区域和/或分析模式和/或诊断规则的对应关系,例如评价值与分析配置信息的对照表,来配置分析区域和/或分析模式和/或诊断规则。The analysis area and/or the analysis mode and/or the diagnostic rule are then configured based on a correspondence between the evaluation value and the analysis area and/or the analysis mode and/or the diagnostic rule, such as a comparison table of the evaluation value and the analysis configuration information.
参见图13来说明实施例3的热像装置100的检测模式的控制流程,参考图14来说明诊断处理的显示例。A control flow of the detection mode of the thermal imaging device 100 of the third embodiment will be described with reference to Fig. 13, and a display example of the diagnosis processing will be described with reference to Fig. 14 .
步骤C01,获取热像数据帧,例如拍摄部1拍摄获得的热像数据帧传送到临时存储部2。In step C01, the thermal image data frame is acquired, and for example, the thermal image data frame obtained by the imaging unit 1 is transmitted to the temporary storage unit 2.
步骤C02,检测处理,类同于实施例1的步骤A01及A03-A06,省略了说明;Step C02, the detection processing is similar to the steps A01 and A03-A06 of the first embodiment, and the description is omitted;
步骤C03,检测部8,获得热像数据帧中最大相关度的检测窗口的相关度的值及其对应的位置参数;Step C03, the detecting unit 8 obtains the value of the correlation degree of the detection window of the maximum correlation degree in the thermal image data frame and the corresponding position parameter thereof;
步骤C04,如果规定数量的检测窗口获得的相关度都小于规定的判断值,则检测部8判断没有检测到特定被摄体热像,回到步骤C01,重复后续的处理,当在步骤C04检测到的相关度大于规定的判断值,则进入步骤C05。In step C04, if the correlation obtained by the predetermined number of detection windows is smaller than the predetermined determination value, the detecting unit 8 determines that the specific subject thermal image is not detected, returns to step C01, repeats the subsequent processing, and detects in step C04. If the degree of correlation is greater than the predetermined judgment value, the process proceeds to step C05.
步骤C05,分析部6,根据所获得辅助信息及检测获得的规定信息,来配置相应的分析区域、分析模式、诊断规则; Step C05, the analyzing unit 6 configures the corresponding analysis area, the analysis mode, and the diagnosis rule according to the obtained auxiliary information and the predetermined information obtained by the detection;
进一步,可进行分析和诊断。Further, analysis and diagnosis can be performed.
基于如图9所示的对照表,其显示界面如图14所示,图14(a)中,根据评价值80%,设置分析区域J1及对应的分析模式及诊断规则;图14(b)中,根据评价值95%,设置分析区域J1及对应的分析模式及诊断规则,分析区域F1及对应的分析模式及诊断规则。可根据上述分析区域、分析模式诊断规则进行分析和诊断获得分析值和诊断结果。Based on the comparison table shown in FIG. 9, the display interface is as shown in FIG. 14. In FIG. 14(a), the analysis area J1 and the corresponding analysis mode and diagnosis rule are set according to the evaluation value of 80%; FIG. 14(b) In the middle, based on the evaluation value of 95%, the analysis area J1 and the corresponding analysis mode and diagnosis rule are set, and the area F1 and the corresponding analysis mode and diagnosis rule are analyzed. The analysis value and the diagnosis result can be obtained by analyzing and diagnosing according to the above analysis region and the analysis mode diagnosis rule.
在一个例子中,假定辅助信息为风速、环境温度等,由于评价值的不同,所设置的分析区域F1能降低环境的干扰,例如被摄体表面边缘的反光影响。In one example, assuming that the auxiliary information is wind speed, ambient temperature, etc., the set analysis area F1 can reduce environmental disturbances such as the reflection of the edge of the surface of the object due to the difference in evaluation values.
在另一个例子中,假定以辅助信息为分析部件分析获得的分析值为例,首先根据分析值以外的其它辅助信息及规定信息获得的评价值,来设置初次的分析区域(检测窗口),当该分析区域(检测窗口)获得的分析值后,以该分析值(检测窗口中的最高温度),或结合其它辅助信息及规定信息等生成评价值,来决定最终设置的分析区域。其中,例如可配置为经过多次这样的处理过程:“步骤S1,获得评价值或分析值,如根据规定信息和辅助信息获得评价值,步骤S2根据对照表中的对应关系,来设置分析区域,步骤S3获得分析值,返回步骤S1重复步骤S1-S3”,由此,直至设置最终的分析区域,及相应的分析模式、诊断规则。In another example, assuming that the auxiliary information is an analysis value obtained by analyzing the analysis component, first setting an initial analysis region (detection window) based on the auxiliary value obtained by the auxiliary information other than the analysis value and the predetermined information. After the analysis value obtained in the analysis area (detection window), the analysis value is determined based on the analysis value (the highest temperature in the detection window) or in combination with other auxiliary information and predetermined information. For example, it may be configured to go through a plurality of such processes: "Step S1, obtain an evaluation value or an analysis value, such as obtaining an evaluation value according to the prescribed information and the auxiliary information, and step S2 sets the analysis area according to the correspondence relationship in the comparison table. Step S3 obtains the analysis value, and returns to step S1 to repeat steps S1-S3", thereby, until the final analysis area, and the corresponding analysis mode and diagnosis rule are set.
图14(b)中,根据评价值95%所设置的分析区域,能对被摄体热像更为细致的分析。In Fig. 14(b), the analysis of the thermal image of the subject can be performed in a more detailed manner based on the analysis region set by the evaluation value of 95%.
例如,以图14中的处理为例,根据分析值以外的其它辅助信息及规定信息获得的评价值,来设置分析区域(检测窗口)及其分析模式,,而后根据所得到分析值与规定的对比值的比较(或查找对应的对照表),来决定是否要再次设置分析区域,规定的对比值为40℃(被摄体是否温度超标的判断阀值),在图14(a)中,根据分析值(J1中的最高温度)为30℃,则不需要再次设置分析区域;而在图14(b)中,根据分析值(J2中的最高温度)为50℃,则需要再次设置分析区域,而后,根据分析值与分析区域的对照表来设置的分析区域F1及相应的分析模式、诊断规则;可进一步细致分析获得分析区域F1的分析结果和诊断结果。For example, taking the processing in FIG. 14 as an example, the analysis area (detection window) and its analysis mode are set based on the evaluation values obtained by the auxiliary information other than the analysis value and the predetermined information, and then based on the obtained analysis value and the prescribed value. Compare the comparison values (or find the corresponding comparison table) to determine whether to set the analysis area again. The specified comparison value is 40 ° C (the judgment threshold of whether the subject temperature exceeds the standard). In Figure 14 (a), According to the analysis value (the highest temperature in J1) is 30 ° C, it is not necessary to set the analysis area again; in Fig. 14 (b), according to the analysis value (the highest temperature in J2) is 50 ° C, the analysis needs to be set again. The region, and then the analysis region F1 set according to the comparison table of the analysis value and the analysis region and the corresponding analysis mode and diagnosis rule; the analysis result and the diagnosis result of the analysis region F1 can be further analyzed in detail.
步骤C06,判断是否退出,如退出,则结束,如未退出,则回到步骤C01,重复上述的处理。In step C06, it is judged whether to exit, if it is exited, it ends. If it is not exited, it returns to step C01, and the above processing is repeated.
这样,对连续拍摄获得的热像数据帧,当检测到不同位置、尺寸、旋转角度、相关度、的特定被摄体热像时,根据规定的辅助信息,能自动配置不同或相同的分析区域和/或分析模式和/或诊断规则,并避免了使用者设置的繁琐操作。In this way, for the thermal image data frames obtained by continuous shooting, when different thermal images of different positions, sizes, rotation angles, correlations, and specific subjects are detected, different or the same analysis regions can be automatically configured according to the prescribed auxiliary information. And / or analysis mode and / or diagnostic rules, and avoid the cumbersome operation of user settings.
优选的,将规定信息、辅助信息、规定信息获得的评价值、辅助信息获得的评价值、规定信息和辅助信息获得的评价值,其中的一项或多项,与分析配置信息的对照表,与例如图3中被摄体信息、被摄体识别信息等对应存储。Preferably, one or more of the predetermined information, the auxiliary information, the evaluation value obtained by the predetermined information, the evaluation value obtained by the auxiliary information, the evaluation information obtained by the predetermined information, and the auxiliary information are compared with the analysis configuration information. It is stored in correspondence with, for example, subject information, subject identification information, and the like in FIG.
并且,规定信息中,与分析区域具有直接对应关系的规定信息,和用于获得评价值的规定信息,可以包含相同或不同的信息。其中,辅助信息中,与分析区域具有直接对应关系的辅助信息,和用于获得评价值的辅助信息,也可以包含相同或不同的信息。Further, in the predetermined information, the predetermined information having a direct correspondence relationship with the analysis region and the predetermined information for obtaining the evaluation value may include the same or different information. Among the auxiliary information, the auxiliary information having a direct correspondence with the analysis area and the auxiliary information for obtaining the evaluation value may include the same or different information.
如上所述,在实施例3中,根据所检测到的规定信息及辅助信息,能综合考虑来配置分析区域、分析模式、诊断规则,能进一步达到提高分析有效性、避免使用者设置的繁琐操作等的有益效果。As described above, in the third embodiment, based on the detected predetermined information and the auxiliary information, the analysis area, the analysis mode, and the diagnosis rule can be comprehensively considered, and the cumbersome operation for improving the analysis efficiency and avoiding the user setting can be further achieved. The beneficial effects of etc.
实施例4Example 4
实施例4,具有记录部,用于将上述实施例所设置的分析区域、分析模式、诊断规则、分析结果、诊断结果中的一项或多项的规定记录信息,与规定的热像数据帧关联记录。 The fourth embodiment has a recording unit for specifying recording information of one or more of an analysis area, an analysis mode, a diagnosis rule, an analysis result, and a diagnosis result set in the above embodiment, and a predetermined thermal image data frame. Associated records.
控制部11具备记录部(未图示),进行记录的控制。例如基于检测部8的检测结果,响应记录指示,从临时存储部2中存储的热像数据帧中选择将要经历所述记录处理的热像数据帧,并且执行对所选择的热像数据帧进行记录处理的控制。优选的,将规定的热像数据帧与规定记录信息进行关联记录。The control unit 11 includes a recording unit (not shown) to perform recording control. For example, based on the detection result of the detecting section 8, in response to the recording instruction, the thermal image data frame to be subjected to the recording processing is selected from the thermal image data frames stored in the temporary storage section 2, and the selected thermal image data frame is performed. Record processing control. Preferably, the predetermined thermal image data frame is associated with the predetermined recording information for recording.
其中,所述规定的热像数据帧为通过拍摄部拍摄获得的热像数据帧和/或通过拍摄部1拍摄获得的热像数据帧进行规定处理后获得的数据。规定处理例如修正、插值、伪彩、转换为温度数值、降像素、压缩等处理的一种或同时多种。The predetermined thermal image data frame is data obtained by performing predetermined processing on a thermal image data frame obtained by the imaging unit and/or a thermal image data frame obtained by the imaging unit 1 . One or a plurality of kinds of processes such as correction, interpolation, pseudo color, conversion to temperature value, down pixel, compression, and the like are specified.
本实施例中,为响应记录指示的时刻,临时存储部2规定区域中保持的检测到特定被摄体热像并设置了分析区域所对应的热像数据帧。此外,也可以是判断检测到特定被摄体热像的时刻(或之后的规定时刻),由红外探测器读取信号所获得的热像数据帧;此外,也可以是从临时存储部2中存储的多帧热像数据帧中所选择的相关度最大的热像数据帧;此外,也可以是记录规定数量的多帧热像数据帧;此外,也可以是规定数量的多帧热像数据帧经过规定处理获得的热像数据帧,如对临时存储部2中存储的多帧热像数据帧进行积分运算获得该处理后的一帧热像数据帧。可以是这些情况获得的热像数据帧之一或多种,如同时记录热像数据获得的各像素的温度值和红外热像的图像数据。In the present embodiment, in response to the timing of the recording instruction, the temporary storage unit 2 specifies the detection of the specific subject thermal image held in the area and sets the thermal image data frame corresponding to the analysis area. Further, the thermal image data frame obtained by the infrared detector reading the signal at the time when the specific subject thermal image is detected (or a predetermined time thereafter) may be determined; or the temporary storage unit 2 may be used. The thermal image data frame with the highest correlation selected in the stored multi-frame thermal image data frame; in addition, a predetermined number of multi-frame thermal image data frames may be recorded; or a predetermined number of multi-frame thermal image data may be used. The frame of the thermal image data obtained by the predetermined processing is integrated into the multi-frame thermal image data frame stored in the temporary storage unit 2 to obtain a frame of the thermal image data frame after the processing. It may be one or more of the thermal image data frames obtained in these cases, such as the temperature value of each pixel obtained by simultaneously recording the thermal image data and the image data of the infrared thermal image.
其中,规定记录信息,可以是所设置的分析区域和/或分析结果和/或诊断规则,包括分析区域位于红外热像中的位置参数(位置,或还包括尺寸,或还包括旋转角度)。Wherein, the specified record information may be the set analysis area and/or the analysis result and/or the diagnosis rule, including the position parameter (position, or also including the size, or also the rotation angle) of the analysis area in the infrared thermal image.
具体而言,一种实施方式,记录部控制,使规定记录信息和压缩后的热像数据帧相关联,生成热像文件记录到存储卡8,结束该处理。一种关联记录的实施方式,将规定记录信息作为规定格式的热像数据帧的信息附加。此外,关联记录处理还指可将规定记录信息记录在与热像文件关联的信息文件或索引文件中等,记录部可生成该信息文件或索引文件。Specifically, in one embodiment, the recording unit controls to associate the predetermined recording information with the compressed thermal image data frame, generate a thermal image file to be recorded on the memory card 8, and end the processing. An embodiment of the association record, wherein the predetermined record information is added as information of a thermal image data frame of a predetermined format. Further, the association record processing also means that the prescribed record information can be recorded in an information file or an index file associated with the thermal image file, and the recording portion can generate the information file or the index file.
此外,记录的存储介质不限于存储卡8、闪存9等,也可以是通过通讯部4通讯的网络目的地。Further, the recorded storage medium is not limited to the memory card 8, the flash memory 9, and the like, and may be a network destination that is communicated through the communication unit 4.
其他实施例Other embodiments
在上述实施例中各自说明了示例的热像装置100,显然可适用于便携拍摄或在线拍摄的各种热像装置;然而,本发明不仅适用于带有拍摄功能的热像装置;也可应用于通过读取热像文件,对热像数据帧进行分析处理的热像处理装置;还适用于接收和处理热像的热像处理设备,如从外部连续接收和处理热像(如按时序获取热像数据帧)的热像处理装置(如计算机、个人数字助理、与拍摄功能的热像装置配套使用的显示装置等),该热像处理装置例如为计算机,通过通信口(获取部的例子,例如按照USB、1394、网络等通信规范,将热像处理装置与外部设备连接)与热像装置进行有线或无线连接,通过连续接受与其连接的热像装置输出的热像数据帧,来实现一个实施例子,其检测处理等处理方式与上述实施方式类同,省略了说明。The exemplary thermal imaging device 100 is illustrated in each of the above embodiments, and is obviously applicable to various thermal imaging devices for portable shooting or online shooting; however, the present invention is not only applicable to thermal imaging devices with shooting functions; A thermal image processing device for analyzing and processing a thermal image data frame by reading a thermal image file; and is also suitable for a thermal image processing device that receives and processes a thermal image, such as continuously receiving and processing a thermal image from the outside (eg, acquiring by time series) Thermal image processing device (such as a computer, a personal digital assistant, a display device used in conjunction with a thermal image device of a photographing function, etc.), the thermal image processing device being, for example, a computer, passing through a communication port (an example of an acquisition unit) For example, according to a communication specification such as USB, 1394, or network, the thermal image processing device is connected to an external device, and the thermal image device is wired or wirelessly connected, and the thermal image data frame outputted by the thermal image device connected thereto is continuously received. In one embodiment, the processing such as the detection processing is similar to the above-described embodiment, and the description is omitted.
此外,例如也可预先准备预定位置的分析区域及对应的分析模式及诊断规则,当检测到特定被摄体热像时,即按照该分析区域进行分析,获得分析结果,并进行诊断;或也不断地进行分析诊断,但不通知诊断结果,当检测到特定被摄体热像时,才通知诊断结果。其中通知诊断结果,例如显示诊断结果;例如通过通信I/F4输出诊断结果;例如虽显示分析和诊断结果,但在检测到特定被摄体热像时,伴随着特定的通知方式(例如,在这时的分析和诊断结果显示中,伴随着变色、闪烁、热像装置100振动等);例如,虽然输出分析或诊断结果, 但在检测到特定被摄体热像时,伴随着特定的通知方式(例如,在这时输出的分析或诊断结果中进行了标记)。Further, for example, an analysis region of a predetermined position and a corresponding analysis mode and a diagnosis rule may be prepared in advance, and when a specific subject thermal image is detected, analysis is performed according to the analysis region, an analysis result is obtained, and diagnosis is performed; or The analysis and diagnosis are continuously performed, but the diagnosis result is not notified, and the diagnosis result is notified when a specific subject thermal image is detected. The diagnosis result is notified, for example, the diagnosis result is displayed; for example, the diagnosis result is output through the communication I/F 4; for example, although the analysis and the diagnosis result are displayed, when a specific subject thermal image is detected, a specific notification method is accompanied (for example, at At this time, the analysis and the diagnosis result are accompanied by discoloration, flicker, vibration of the thermal imaging device 100, etc.; for example, although the analysis or diagnosis result is output, However, when a specific subject thermal image is detected, it is accompanied by a specific notification method (for example, the analysis or diagnosis result output at this time is marked).
并且,不限于拍摄或从外部获取热像数据帧,也可作为热像装置或热像处理装置中的一个构成部件或功能模块,例如从其他部件来获取热像数据帧,这时,也构成本发明的实施方式。Further, it is not limited to photographing or acquiring a thermal image data frame from the outside, and may be used as a constituent component or a functional module in a thermal imaging device or a thermal image processing device, for example, acquiring a thermal image data frame from other components, and also forming a thermal image data frame. Embodiments of the invention.
此外,优选的具有通知部,用于通知(如显示、语音等通知方式)诊断结果如诊断结论;也可以采用其他的通知方式如改变图像的伪彩颜色等,来通知诊断结果,但也可以没有通知部,如将诊断结果通过通讯I/F4通讯的网络目的地。In addition, a notification unit is preferably provided for notifying (such as display, voice, etc.) diagnostic results such as diagnosis conclusions; other notification methods such as changing the pseudo color of the image to notify the diagnosis result, but also There is no notification department, such as the network destination that communicates the diagnosis result through the communication I/F4.
并且,可以不仅检测整个被摄体的整体区域,而且检测将被摄体划分为多个部件构成的多个检测窗口,这样,能够更精确检测;其中,对于各部件,与整体相同,准备对应的被摄体识别信息(可以是模板或特征量)。也可根据模板的多个特征量,来计算相应的检测窗口中的多个对应的特征量,并根据多个特征量所对应的对比值,来获得判断结果,例如,根据多个特征量的加权,来获得最终的判断结果。也可根据多个特征量,先计算其中的一个特征量与红外热像的比较结果,当大于规定的阀值,计算下一个特征量与红外热像的比较结果,根据多次比较,来获得最终的判断结果。Further, it is possible to detect not only the entire area of the entire subject but also a plurality of detection windows which are formed by dividing the subject into a plurality of parts, so that it is possible to detect more accurately; wherein, for each part, the same as the whole, prepare for correspondence Subject identification information (may be a template or feature quantity). The plurality of feature quantities in the corresponding detection window may be calculated according to the plurality of feature quantities of the template, and the determination result is obtained according to the comparison value corresponding to the plurality of feature quantities, for example, according to the plurality of feature quantities. Weighted to get the final judgment result. According to a plurality of feature quantities, a comparison result of one of the feature quantities and the infrared thermal image may be first calculated. When the value is greater than a predetermined threshold, the comparison result of the next feature quantity and the infrared thermal image is calculated, and the comparison result is obtained according to multiple comparisons. The final judgment result.
此外,并不限于具有分析配置单元、分析区域设置单元、分析单元、诊断单元等的全部功能,也可仅具有分析配置单元,或还具有分析区域设置单元,或还具有分析单元,或还具有诊断单元;例如可将根据特定被摄体热像检测获得的规定信息,而配置获得的分析区域、分析模式、诊断规则等之一或多个有关的配置信息,存储在存储介质的规定区域,便于后续的应用。Furthermore, it is not limited to having all functions of an analysis configuration unit, an analysis area setting unit, an analysis unit, a diagnosis unit, and the like, or may have only an analysis configuration unit, or an analysis area setting unit, or an analysis unit, or have a diagnostic unit; for example, one or more related configuration information such as an analysis region, an analysis mode, a diagnosis rule, and the like obtained by configuring the obtained predetermined information obtained by the specific subject thermal image may be stored in a predetermined region of the storage medium. Easy for subsequent applications.
注意,在上述的实施例中,可以对热像数据帧的检测,分析区域、分析模式、诊断规则的配置,分析区域的设置,分析,诊断,分析区域的显示,分析或诊断结果的通知,记录等处理,可进行不同的组合,这些组合均在本发明的范围之内。Note that in the above embodiments, the detection of the thermal image data frame, the analysis region, the analysis mode, the configuration of the diagnostic rule, the analysis of the analysis of the region, the analysis, the diagnosis, the display of the analysis region, the notification of the analysis or the diagnosis result, Various combinations of recordings and the like can be made, and such combinations are all within the scope of the present invention.
并且,对是否检测到特定被摄体热像,并不限于相关度的值与相关度的判断值之间的比较;也可变形为,例如根据检测获得的规定信息、规定信息获得的评价值、规定信息和辅助信息获得的评价值,其中的一项或多项,或还结合了辅助信息、辅助信息获得的评价值,其中的一项或多项,与规定的判断值的比较,来决定是否检测到特定被摄体热像。优选的,根据检测到的位置、尺寸、倾斜角度、相关度的值,和/或这些信息获得的评价值,与特定对比值的比较,来决定是否检测到特定被摄体热像。Further, whether or not the specific subject thermal image is detected is not limited to the comparison between the value of the correlation degree and the judgment value of the correlation degree; and may be modified into, for example, the evaluation value obtained based on the predetermined information obtained by the detection and the predetermined information. And one or more of the evaluation values obtained by the prescribed information and the auxiliary information, or an evaluation value obtained by combining the auxiliary information and the auxiliary information, one or more of which is compared with the prescribed judgment value. Decide whether a specific subject thermal image is detected. Preferably, whether a specific subject thermal image is detected is determined based on the detected position, size, tilt angle, value of the correlation, and/or the evaluation value obtained by the information, compared with the specific comparison value.
此外,也可变形为,例如根据检测获得的规定信息、规定信息获得的评价值、规定信息和辅助信息获得的评价值,其中的一项或多项,或还结合了辅助信息、辅助信息获得的评价值,其中的一项或多项,与分析配置信息的对应关系,来设置分析区域。而并不判断是否检测到特定被摄体热像。In addition, it may be modified into, for example, one or more of the evaluation information obtained by the detection, the evaluation value obtained by the predetermined information, the predetermined information, and the auxiliary information, or the auxiliary information and the auxiliary information. The evaluation value, one or more of them, and the analysis configuration information, to set the analysis area. It is not judged whether or not a specific subject thermal image is detected.
此外,优选的,具有显示控制部,用于控制使显示基于所获取的热像数据帧获得的红外热像,和规定位置的参考图像;检测部,用于基于获取的热像数据帧,检测是否具有特定被摄体热像;分析配置部,所配置的分析区域,根据与参考图像具有规定位置关系的对象(例如与参考图像关联的分析区域,来配置分析区域。如图15所示,显然,参考图像T15体现了被摄体的规定形态特征时,也可根据该参考图像T15位于红外热像中的位置参数,来设置检测区域J15(如根据参考图像的外包矩形来放大规定比例获得的检测区域);并便于使用者参 照参考图像T1的位置和尺寸及形态特征来拍摄,可加快检测处理的速度并确保拍摄的质量。可准备相应的被摄体识别信息,例如,也可将参考图像T15作为模板,用于检测处理。Furthermore, preferably, there is a display control unit for controlling an infrared thermal image obtained by displaying the acquired thermal image data frame and a reference image at a predetermined position; and a detecting unit for detecting based on the acquired thermal image data frame Whether there is a specific subject thermal image; the analysis configuration portion, the configured analysis region, and the analysis region are configured according to an object having a predetermined positional relationship with the reference image (for example, an analysis region associated with the reference image. As shown in FIG. Obviously, when the reference image T15 embodies the predetermined morphological feature of the subject, the detection region J15 may also be set according to the positional parameter of the reference image T15 located in the infrared thermal image (for example, according to the outer rectangle of the reference image, the predetermined ratio is obtained Detection area); and user-friendly Shooting according to the position and size and morphological features of the reference image T1 speeds up the detection process and ensures the quality of the shooting. The corresponding subject identification information can be prepared, for example, the reference image T15 can also be used as a template for the detection process.
在上述的例子,是按照一定的步骤次序来描述,但根据不同的实施方式可以有各种先后顺序,并不限于上述例子所描述的处理次序。当控制部11、图像处理部7、分析部6等包含了多个处理器时,还可能存在部分步骤适用的并行处理。In the above examples, the description is in a certain order of steps, but there may be various orders according to different embodiments, and is not limited to the processing order described in the above examples. When the control unit 11, the image processing unit 7, the analysis unit 6, and the like include a plurality of processors, there may be parallel processing to which some steps are applied.
存储被摄体识别信息等的存储介质,可以是热像装置100中的存储介质,如闪存3、存储卡6等非易失性存储介质,临时存储部2等易失性存储介质;还可以是与热像装置100有线或无线连接的其他存储介质,如通过与通信I/F4有线或无线连接的其他装置如其他存储装置、热像装置、电脑等中的存储介质或网络目的地的存储介质。The storage medium storing the object identification information or the like may be a storage medium in the thermal image device 100, such as a nonvolatile storage medium such as the flash memory 3 or the memory card 6, a volatile storage medium such as the temporary storage unit 2, or the like; Other storage media that are wired or wirelessly connected to the thermal image device 100, such as storage media or network destination storage in other devices that are wired or wirelessly connected to the communication I/F 4, such as other storage devices, thermal imaging devices, computers, and the like. medium.
此外,例子以电力行业的被摄体应用作为场景例举,也适用在红外检测的各行业广泛运用。本发明的方面还可以通过独处和执行记录在存储装置上的程序来执行上述实施例的功能的***或设备的计算机(或诸如CPU、MPU等的装置)、以及通过其步骤由***或设备的计算机通过例如读出和执行记录在存储装置上的程序来执行上述实施例的功能而知性的方法来实现。为此目的,例如经由网络或从用作存储装置的各种类型的记录介质(例如,计算机可读介质)中将程序提供至计算机或热像装置。In addition, the examples are taken as examples of scenes in the power industry, and are also widely used in various industries of infrared detection. Aspects of the present invention may also be a computer (or a device such as a CPU, MPU, etc.) of a system or device that performs the functions of the above-described embodiments by a program that is recorded on a storage device, and a step by which the system or device is The computer is realized by, for example, a method of reading and executing a program recorded on a storage device to perform the functions of the above-described embodiments. For this purpose, the program is provided to a computer or a thermal image device, for example, via a network or from various types of recording media (e.g., computer readable media) used as storage devices.
本发明提供一种计算机程序,计算机程序构成的数字信号记录在计算机或热像装置可读的记录介质中,例如硬盘、存储器等中。该程序运行后执行上述实施例中的步骤;The present invention provides a computer program in which digital signals are recorded in a recording medium readable by a computer or a thermal image device, such as a hard disk, a memory or the like. After the program is run, the steps in the above embodiments are performed;
获取步骤,用于获取热像数据帧;An obtaining step of acquiring a thermal image data frame;
检测步骤,用于基于获取的热像数据帧,检测与特定被摄体热像有关的规定信息;a detecting step of detecting predetermined information related to a specific subject thermal image based on the acquired thermal image data frame;
分析配置步骤,用于根据检测步骤检测获得的规定信息,可配置如下一项或多项:的构成数据、分析区域的位置参数、分析模式、诊断规则。The analysis configuration step is configured to configure one or more of the following according to the specified information obtained by the detecting step: the constituent data, the position parameter of the analysis area, the analysis mode, and the diagnosis rule.
本发明的实施方式还提供一种可读存储介质,其存储用于电子数据交换的计算机程序,其中,所述计算机程序使得热像装置中的计算机执行如上步骤。Embodiments of the present invention also provide a readable storage medium storing a computer program for electronic data exchange, wherein the computer program causes a computer in the thermal image device to perform the above steps.
虽然,可以通过硬件、软件模块或其结合来实现附图中的功能块,但通常不需要设置以一对一的对应方式来实现功能块的结构。可以通过一个软件或硬件模块来实现多个功能的块。或也可通过多个软件或硬件单元来实现一个功能的块。此外,也可以用专用电路或通用处理器或可编程的FPGA实现本发明的实施方式中的部分或全部功能部的处理和控制功能。Although the functional blocks in the drawings may be implemented by hardware, software modules, or a combination thereof, it is generally not necessary to provide a one-to-one correspondence to implement the structure of the functional blocks. A block of multiple functions can be implemented by one software or hardware module. Or a block of functionality can be implemented by multiple software or hardware units. In addition, the processing and control functions of some or all of the functional portions of the embodiments of the present invention may also be implemented by a dedicated circuit or a general purpose processor or a programmable FPGA.
上述所描述的仅为发明的具体例子(实施方式),各种例举说明不对发明的实质内容构成限定,并且,各种实施方式进行相应的替换和组合,可构成更多的实施方式。所属领域的技术人员在阅读了说明书后可对具体实施方式进行其他的修改和变化,而不背离发明的实质和范围。 The above description is only specific examples (embodiments) of the invention, and various exemplary embodiments are not intended to limit the scope of the invention, and various embodiments may be substituted and combined to form further embodiments. Other modifications and changes may be made to the specific embodiments without departing from the spirit and scope of the invention.

Claims (29)

  1. 分析装置,包括:Analytical devices, including:
    获取部,用于获取热像数据帧;An acquisition unit, configured to acquire a thermal image data frame;
    检测部,用于基于获取的热像数据帧,检测与特定被摄体热像有关的规定信息;a detecting unit configured to detect predetermined information related to a specific subject thermal image based on the acquired thermal image data frame;
    分析配置部,用于根据检测部检测获得的规定信息,可配置如下一项或多项:分析区域的构成数据、分析区域的位置参数、分析模式、诊断规则。The analysis configuration unit is configured to arrange one or more of the following: the configuration data of the analysis region, the position parameter of the analysis region, the analysis mode, and the diagnosis rule according to the predetermined information obtained by the detection unit.
  2. 如权利要求1所述的分析装置,其特征在于,The analyzing device according to claim 1, wherein
    所述分析配置部,根据如下因素:The analysis configuration section is based on the following factors:
    1)规定信息1) Prescribed information
    2)辅助信息;2) auxiliary information;
    3)规定信息得到的评价值;3) the evaluation value obtained by the specified information;
    4)辅助信息得到的评价值;4) the evaluation value obtained from the auxiliary information;
    5)规定信息和辅助信息得到的评价值;5) The evaluation value obtained by specifying information and auxiliary information;
    其中的一项或多项,与分析区域的构成数据、分析区域的位置参数、分析模式、诊断规则中一项或多项的对应关系,来配置相应的分析区域、分析模式、诊断规则中一项或多项。One or more of the corresponding analysis areas, analysis modes, and diagnostic rules are configured in one or more of the analysis data of the analysis area, the positional parameters of the analysis area, the analysis mode, and one or more of the diagnostic rules. Item or multiple items.
  3. 如权利要求2所述的分析装置,其特征在于,The analysis device according to claim 2, wherein
    不同因素所对应的分析区域和/或分析模式和/或诊断规则,可为相同或不同分析效果的分析区域和/或分析模式和/或诊断规则,和/或,相同或不同显示效果的分析区域。The analysis area and/or analysis mode and/or diagnostic rule corresponding to different factors may be analysis areas and/or analysis modes and/or diagnostic rules of the same or different analysis effects, and/or analysis of the same or different display effects. region.
  4. 如权利要求1所述的分析装置,其特征在于,所述规定信息,至少包括特定被摄体热像的位置、尺寸、倾斜角度、相似度的值中的一种或任意组合的信息。The analyzing apparatus according to claim 1, wherein said predetermined information includes at least one of a position, a size, a tilt angle, and a value of a similarity of a specific subject thermal image or any combination thereof.
  5. 如权利要求2所述的分析装置,其特征在于,所述规定信息,至少包括特定被摄体热像的位置、尺寸、倾斜角度、相似度的值中的一种或任意组合的信息;所述辅助信息,至少包括分析值、环境温度、风速、背景因素、湿度、距离中的一种或任意组合的信息。The analysis device according to claim 2, wherein the predetermined information includes at least one of a position, a size, an inclination angle, and a value of a similarity of a specific subject thermal image; The auxiliary information includes at least one of an analysis value, an ambient temperature, a wind speed, a background factor, a humidity, a distance, or any combination.
  6. 如权利要求1所述的分析装置,其特征在于,The analyzing device according to claim 1, wherein
    所述分析配置部,根据检测到的特定被摄体热像位于热像数据帧中的位置参数,来配置分析区域的位置参数。The analysis configuration unit configures a positional parameter of the analysis region based on the detected positional parameter of the specific subject thermal image located in the thermal image data frame.
  7. 如权利要求1所述的分析装置,其特征在于,The analyzing device according to claim 1, wherein
    所述分析配置部,根据检测到的特定被摄体热像位于热像数据帧中的位置参数,来配置分析区域的位置,或位置、尺寸,或位置、尺寸、旋转角度。The analysis configuration unit configures a position, or a position, a size, or a position, a size, and a rotation angle of the analysis region based on the position parameter of the detected specific subject thermal image located in the thermal image data frame.
  8. 如权利要求6所述的分析装置,其特征在于,The analyzing device according to claim 6, wherein
    可根据检测到的特定被摄体热像位于热像数据帧中的位置和尺寸,来配置分析区域的位置和尺寸;或可根据检测到的特定被摄体热像位于热像数据帧中的位置、尺寸、倾斜角度,来设置分析区域的位置、尺寸、旋转角度。The position and size of the analysis area may be configured according to the detected position and size of the specific subject thermal image located in the thermal image data frame; or may be located in the thermal image data frame according to the detected specific subject thermal image Position, size, and tilt angle to set the position, size, and angle of rotation of the analysis area.
  9. 如权利要求1所述的分析装置,其特征在于,The analyzing device according to claim 1, wherein
    所述分析配置部,根据与被摄体识别信息关联的分析区域的构成数据,来配置分析区域的构成数据;根据该分析区域构成数据获得的分析区域,与被摄体识别信息的规定位置关系,及检测到的特定被摄体热像位于热像数据帧中的位置参数,来配置分析区域的位置参数。The analysis placement unit arranges the configuration data of the analysis region based on the configuration data of the analysis region associated with the subject identification information, and the predetermined position relationship between the analysis region obtained based on the analysis region configuration data and the subject identification information. And the detected specific subject thermal image is located in the position parameter of the thermal image data frame to configure the positional parameter of the analysis region.
  10. 如权利要求9所述的分析装置,其特征在于,具有 An analyzing device according to claim 9, comprising
    所述分析配置部,用于根据分析区域的构成数据关联的分析模式、诊断规则,来配置所述分析区域的构成数据获得的分析区域,及相应的分析模式、诊断规则。The analysis configuration unit is configured to configure an analysis region obtained by the configuration data of the analysis region, and a corresponding analysis mode and a diagnosis rule according to an analysis mode and a diagnosis rule associated with the configuration data of the analysis region.
  11. 如权利要求9所述的分析装置,其特征在于The analyzing device according to claim 9, wherein
    选择部,用于选择被摄体信息;a selection unit for selecting subject information;
    所述检测部,根据所选择的被摄体信息,基于该被摄体信息关联的被摄体识别信息,来检测与特定被摄体热像有关的规定信息;The detecting unit detects predetermined information on a specific subject thermal image based on the selected subject information and based on the subject identification information associated with the subject information;
    所述分析配置部,用于根据检测部检测获得的规定信息,基于所述被摄体识别信息关联的分析区域的构成数据、分析模式、诊断规则其中一项或多项,来相应配置分析区域、分析模式、诊断规则;The analysis configuration unit is configured to configure an analysis region based on one or more of constituent data, analysis mode, and diagnostic rule of the analysis region associated with the subject identification information based on the predetermined information obtained by the detection unit. , analysis mode, diagnostic rules;
  12. 如权利要求1所述的分析装置,其特征在于,The analyzing device according to claim 1, wherein
    所述分析配置部,对规定计算对象按照规定计算规则进行计算,并基于检测到的特定被摄体热像的位置参数,来配置分析区域;The analysis configuration unit calculates a predetermined calculation target according to a predetermined calculation rule, and configures an analysis region based on the detected position parameter of the specific subject thermal image;
    所述规定计算规则,至少包括对所述规定计算对象进行特征提取、缩放、变形、分割、剪切、等分、计算外包矩形、计算内切矩形、计算中心线、计算特征点、计算内包络线、计算外包络线中的一种或一种以上。The prescribed calculation rule includes at least feature extraction, scaling, deformation, segmentation, clipping, halving, calculating an outsourcing rectangle, calculating an inscribed rectangle, calculating a center line, calculating a feature point, and calculating an inner package of the specified calculation object. Threading, calculating one or more of the outer envelopes.
  13. 如权利要求1所述的分析装置,其特征在于The analysis device of claim 1 wherein
    具有记录部,用于响应记录指示,将所设置的分析区域的构成数据、分析区域的位置参数、分析区域、分析模式、诊断规则中的一项或多项,与规定的热像数据帧建立关联进行记录。And a recording unit configured to, in response to the recording instruction, establish one or more of the configured data of the analysis region, the position parameter of the analysis region, the analysis region, the analysis mode, and the diagnosis rule with the specified thermal image data frame Correlate for recording.
  14. 如权利要求1所述的分析装置,其特征在于,具有分析区域设置部,根据所配置的分析区域的构成数据和分析区域的位置参数相关信息,对所获取的热像数据帧设置分析区域。The analysis apparatus according to claim 1, further comprising an analysis area setting unit that sets an analysis area for the acquired thermal image data frame based on the configuration data of the analysis area and the position parameter related information of the analysis area.
  15. 如权利要求1所述的分析装置,其特征在于,具有分析部,根据所配置的分析区域和分析模式,对所获取的热像数据帧进行分析。The analyzing apparatus according to claim 1, further comprising: an analyzing unit that analyzes the acquired thermal image data frame based on the configured analysis region and the analysis mode.
  16. 如权利要求1所述的分析装置,其特征在于,具有诊断部,根据所配置的分析区域、分析模式、诊断规则,对所获取的热像数据帧进行诊断。The analysis device according to claim 1, further comprising a diagnosis unit that diagnoses the acquired thermal image data frame based on the configured analysis region, analysis mode, and diagnostic rule.
  17. 分析装置,包括,Analytical device, including,
    获取部,用于获取热像数据帧;An acquisition unit, configured to acquire a thermal image data frame;
    检测部,用于检测获取部获取的热像数据帧中是否具有特定被摄体热像;a detecting unit configured to detect whether a thermal image data frame acquired by the acquiring unit has a specific subject thermal image;
    分析部,当检测部检测到特定被摄体热像,对所获取的热像数据帧进行分析诊断。The analysis unit analyzes and diagnoses the acquired thermal image data frame when the detection unit detects a specific subject thermal image.
  18. 分析装置,包括,Analytical device, including,
    获取部,用于获取热像数据帧;An acquisition unit, configured to acquire a thermal image data frame;
    分析部,用于基于所获取的热像数据帧进行分析;An analysis unit, configured to perform analysis based on the acquired thermal image data frame;
    检测部,用于检测获取部获取的热像数据帧中是否具有特定被摄体热像;a detecting unit configured to detect whether a thermal image data frame acquired by the acquiring unit has a specific subject thermal image;
    通知部,当检测部检测到特定被摄体热像,对分析结果进行通知。The notification unit notifies the analysis result when the detection unit detects a specific subject thermal image.
  19. 分析方法,包括:Analytical methods, including:
    获取步骤,用于获取热像数据帧;An obtaining step of acquiring a thermal image data frame;
    检测步骤,用于基于获取的热像数据帧,检测与特定被摄体热像有关的规定信息; a detecting step of detecting predetermined information related to a specific subject thermal image based on the acquired thermal image data frame;
    分析配置步骤,用于根据检测步骤检测获得的规定信息,可配置如下一项或多项:的构成数据、分析区域的位置参数、分析模式、诊断规则。The analysis configuration step is configured to configure one or more of the following according to the specified information obtained by the detecting step: the constituent data, the position parameter of the analysis area, the analysis mode, and the diagnosis rule.
  20. 如权利要求19所述的分析方法,其特征在于,The analysis method according to claim 19, wherein
    所述分析配置步骤,根据如下因素:The analysis configuration step is based on the following factors:
    1)规定信息1) Prescribed information
    2)辅助信息;2) auxiliary information;
    3)规定信息得到的评价值;3) the evaluation value obtained by the specified information;
    4)辅助信息得到的评价值;4) the evaluation value obtained from the auxiliary information;
    5)规定信息和辅助信息得到的评价值;5) The evaluation value obtained by specifying information and auxiliary information;
    其中的一项或多项,与分析区域的构成数据、分析区域的位置参数、分析模式、诊断规则中一项或多项的对应关系,来配置相应的分析区域、分析模式、诊断规则中一项或多项。One or more of the corresponding analysis areas, analysis modes, and diagnostic rules are configured in one or more of the analysis data of the analysis area, the positional parameters of the analysis area, the analysis mode, and one or more of the diagnostic rules. Item or multiple items.
  21. 如权利要求19所述的分析方法,其特征在于,The analysis method according to claim 19, wherein
    所述分析配置步骤,根据检测到的特定被摄体热像位于热像数据帧中的位置参数,来配置分析区域的位置参数。The analyzing configuration step configures a position parameter of the analysis area according to the detected position parameter of the specific subject thermal image located in the thermal image data frame.
  22. 如权利要求19所述的分析方法,其特征在于,The analysis method according to claim 19, wherein
    所述分析配置步骤,根据与被摄体识别信息关联的分析区域的构成数据,来配置分析区域的构成数据;根据该分析区域构成数据获得的分析区域,与被摄体识别信息的规定位置关系,及检测到的特定被摄体热像位于热像数据帧中的位置参数,来配置分析区域的位置参数。The analysis configuration step of arranging the configuration data of the analysis region based on the configuration data of the analysis region associated with the subject identification information; the analysis region obtained based on the analysis region configuration data, and the predetermined positional relationship with the subject identification information And the detected specific subject thermal image is located in the position parameter of the thermal image data frame to configure the positional parameter of the analysis region.
  23. 如权利要求19所述的分析方法,其特征在于,具有The analysis method according to claim 19, further comprising
    所述分析配置步骤,用于根据分析区域的构成数据关联的分析模式、诊断规则,来配置所述分析区域的构成数据获得的分析区域,及相应的分析模式、诊断规则。The analyzing configuration step is configured to configure an analysis region obtained by the constituent data of the analysis region according to an analysis mode and a diagnosis rule associated with the constituent data of the analysis region, and a corresponding analysis mode and a diagnosis rule.
  24. 如权利要求19所述的分析方法,其特征在于The analysis method according to claim 19, characterized in that
    选择步骤,用于选择被摄体信息;a selection step for selecting subject information;
    所述检测步骤,根据所选择的被摄体信息,基于该被摄体信息关联的被摄体识别信息,来检测与特定被摄体热像有关的规定信息;The detecting step detects predetermined information related to a specific subject thermal image based on the selected subject information and based on the subject identification information associated with the subject information;
    所述分析配置步骤,用于根据检测步骤检测获得的规定信息,基于所述被摄体识别信息关联的分析区域的构成数据、分析模式、诊断规则其中一项或多项,来相应配置分析区域、分析模式、诊断规则;The analyzing configuration step is configured to configure an analysis area according to one or more of constituent data, analysis mode, and diagnostic rule of the analysis region associated with the object identification information according to the predetermined information obtained by the detecting step detection. , analysis mode, diagnostic rules;
  25. 如权利要求19所述的分析方法,其特征在于,具有分析区域设置步骤,根据所配置的分析区域的构成数据和分析区域的位置参数相关信息,对所获取的热像数据帧设置分析区域。The analysis method according to claim 19, further comprising an analysis area setting step of setting an analysis area for the acquired thermal image data frame based on the configured composition data of the analysis area and the position parameter related information of the analysis area.
  26. 如权利要求19所述的分析方法,其特征在于,具有分析步骤,根据所配置的分析区域和分析模式,对所获取的热像数据帧进行分析。The analysis method according to claim 19, further comprising analyzing step of analyzing the acquired thermal image data frame according to the configured analysis region and analysis mode.
  27. 如权利要求19所述的分析方法,其特征在于,具有诊断步骤,根据所配置的分析区域、分析模式、诊断规则,对所获取的热像数据帧进行诊断。The analysis method according to claim 19, further comprising a diagnosis step of diagnosing the acquired thermal image data frame based on the configured analysis region, analysis mode, and diagnostic rule.
  28. 分析方法,包括,Analytical methods, including,
    获取步骤,用于获取热像数据帧;An obtaining step of acquiring a thermal image data frame;
    检测步骤,用于检测获取步骤获取的热像数据帧中是否具有特定被摄体热像; a detecting step of detecting whether a thermal image data frame acquired by the obtaining step has a specific subject thermal image;
    分析步骤,当检测步骤检测到特定被摄体热像,对所获取的热像数据帧进行分析诊断。The analyzing step is to analyze and diagnose the acquired thermal image data frame when the detecting step detects a specific subject thermal image.
  29. 分析方法,包括,Analytical methods, including,
    获取步骤,用于获取热像数据帧;An obtaining step of acquiring a thermal image data frame;
    分析步骤,用于基于所获取的热像数据帧进行分析;An analyzing step for analyzing based on the acquired thermal image data frame;
    检测步骤,用于检测获取步骤获取的热像数据帧中是否具有特定被摄体热像;a detecting step of detecting whether a thermal image data frame acquired by the obtaining step has a specific subject thermal image;
    通知步骤,当检测步骤检测到特定被摄体热像,对分析结果进行通知。 The notification step notifies the analysis result when the detection step detects a specific subject thermal image.
PCT/CN2014/095438 2013-12-29 2014-12-29 Analysis device and analysis method WO2015096824A1 (en)

Applications Claiming Priority (8)

Application Number Priority Date Filing Date Title
CN201310744181.4 2013-12-29
CN201310744040 2013-12-29
CN201310744181 2013-12-29
CN201310744239 2013-12-29
CN201310744113.8 2013-12-29
CN201310744040.2 2013-12-29
CN201310744239.5 2013-12-29
CN201310744113 2013-12-29

Publications (1)

Publication Number Publication Date
WO2015096824A1 true WO2015096824A1 (en) 2015-07-02

Family

ID=53477602

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/095438 WO2015096824A1 (en) 2013-12-29 2014-12-29 Analysis device and analysis method

Country Status (2)

Country Link
CN (1) CN104748862A (en)
WO (1) WO2015096824A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106597185A (en) * 2015-10-14 2017-04-26 山东鲁能智能技术有限公司 Infrared analysis system and method of primary equipment of transformer station

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106373340A (en) * 2014-10-25 2017-02-01 杭州美盛红外光电技术有限公司 Array setting device, thermal picture alarm device, alarm system and array setting method, and thermal alarm method
CN108734061A (en) * 2017-04-19 2018-11-02 台达电子工业股份有限公司 The non-warning region initialization system and its setting method of personnel's detector
CN110361704B (en) * 2019-06-27 2021-07-06 中国人民解放军海军工程大学 Sonar offshore test data playback analysis system and method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102538974A (en) * 2012-01-12 2012-07-04 杭州美盛红外光电技术有限公司 Thermal image display device, thermal image display system and thermal image display method
CN102538980A (en) * 2012-01-12 2012-07-04 杭州美盛红外光电技术有限公司 Thermal image device and shooting method for thermal image
CN102525381A (en) * 2010-12-16 2012-07-04 奥林巴斯株式会社 Image processing apparatus, image processing method and computer-readable recording device
CN102564607A (en) * 2012-01-12 2012-07-11 杭州美盛红外光电技术有限公司 Thermal imaging device and standard thermal image photographing method

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5559121B2 (en) * 2011-09-27 2014-07-23 本田技研工業株式会社 Object type determination device
CN102521832B (en) * 2011-12-07 2014-05-28 中国科学院深圳先进技术研究院 Image analysis method and system
US10230907B2 (en) * 2012-01-12 2019-03-12 Mission Infrared Electro Optics Technology Co., Ltd Thermal imaging device and normative photographing method for thermal image
CN102798470B (en) * 2012-08-14 2015-04-22 中国神华能源股份有限公司 Method and device for monitoring range of heat abnormality in mining area
CN103279741B (en) * 2013-05-20 2016-07-06 大连理工大学 A kind of pedestrian's early warning system based on vehicle mounted infrared image and method of work thereof

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102525381A (en) * 2010-12-16 2012-07-04 奥林巴斯株式会社 Image processing apparatus, image processing method and computer-readable recording device
CN102538974A (en) * 2012-01-12 2012-07-04 杭州美盛红外光电技术有限公司 Thermal image display device, thermal image display system and thermal image display method
CN102538980A (en) * 2012-01-12 2012-07-04 杭州美盛红外光电技术有限公司 Thermal image device and shooting method for thermal image
CN102564607A (en) * 2012-01-12 2012-07-11 杭州美盛红外光电技术有限公司 Thermal imaging device and standard thermal image photographing method

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106597185A (en) * 2015-10-14 2017-04-26 山东鲁能智能技术有限公司 Infrared analysis system and method of primary equipment of transformer station
CN106597185B (en) * 2015-10-14 2019-03-19 山东鲁能智能技术有限公司 Transforming plant primary equipment infrared analysis system and method

Also Published As

Publication number Publication date
CN104748862A (en) 2015-07-01

Similar Documents

Publication Publication Date Title
CN103776542B (en) Thermal image diagnosis device and thermal image diagnosis method
US10230908B2 (en) Thermal imaging device and thermal image photographing method
US10230907B2 (en) Thermal imaging device and normative photographing method for thermal image
WO2015096824A1 (en) Analysis device and analysis method
WO2015078418A1 (en) Determining apparatus and determining method
US20160005156A1 (en) Infrared selecting device and method
US10163214B2 (en) Device and method for analyzing thermal images
US20150350571A1 (en) Device and method for selecting thermal images
CN104655636B (en) Thermal image analysis device, thermal image configuration device, thermal image analysis method and thermal image configuration method
US20150358559A1 (en) Device and method for matching thermal images
WO2015074628A1 (en) Analysis comparison apparatus and analysis comparison method
CN114923581A (en) Infrared selecting device and infrared selecting method
CN104655284B (en) Analysis device, processing device, analysis method, and processing method
CN104751445A (en) Thermal image analysis configuration device and thermal image analysis configuration method
CN104748863A (en) Infrared analysis area setting device and infrared analysis area setting method
WO2015074627A1 (en) Thermal image processing apparatus and recording apparatus, processing system, and thermal image processing method and recording apparatus
CN103900713A (en) Device and method for detecting thermal image
CN116358711A (en) Infrared matching updating device and infrared matching updating method
CN105021290B (en) Shooting device, pseudo color setting device, shooting method and pseudo color setting method
CN104655637B (en) Selection device and selection method
CN114838829A (en) Thermal image selection notification device and thermal image selection notification method
CN115993191A (en) Thermal image matching updating device and thermal image matching updating method
CN112986755A (en) Insulator detection device and insulator detection method
CN114923582A (en) Thermal image selection notification device and thermal image selection notification method
CN114923580A (en) Infrared selection notification device and infrared selection notification method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14874488

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14874488

Country of ref document: EP

Kind code of ref document: A1