CN105224896B

CN105224896B - Recording apparatus, processing apparatus, recording method, and processing method

Info

Publication number: CN105224896B
Application number: CN201510202020.1A
Authority: CN
Inventors: 王浩
Original assignee: Hangzhou Mission Infrared Electro Optics Technology Co Ltd
Current assignee: Hangzhou Mission Infrared Electro Optics Technology Co Ltd
Priority date: 2014-04-29
Filing date: 2015-04-26
Publication date: 2021-03-23
Anticipated expiration: 2035-04-26
Also published as: CN105224896A

Abstract

The invention discloses a recording device, a processing device, a recording method and a processing method, and relates to the field of application of detection. The detection device in the prior art cannot conveniently correspond to the information of the detected body; the recording apparatus of the present invention includes: a first acquisition section for acquiring a first image; a second acquisition unit configured to acquire detection data and/or inspection data of the subject; a recording part for recording the specified information and the detection data and/or the routing inspection data in a correlated manner; the prescribed information includes one or more of a first image, character information recognized based on the first image, first subject information recognized based on the first image, second subject information selected based on the first subject information, configuration information associated with the first subject information recognized based on the first image, and configuration information associated with the second subject information selected based on the first subject information.

Description

Recording apparatus, processing apparatus, recording method, and processing method

Technical Field

The invention discloses a recording device, a processing device, a recording method and a processing method, and relates to the field of application of detection.

Background

At present, various detection devices such as various imaging instruments (visible light, infrared, ultraviolet, laser and the like), partial discharge testing instruments, gas leakage testing instruments and the like are widely applied; when the detection device in the prior art detects the detected body, how to conveniently obtain the information of the detected body related to the detected body is a difficult point.

In the prior art, a thermal image file obtained by shooting can generate a file name according to a time sequence number; for subsequent archiving and analysis, thermal image files obtained by shooting different detected bodies need to be distinguished, during infrared detection, a user needs to correspondingly record information of the detected bodies according to observation of the site tags of the detected bodies, and the existing common recording modes are as follows: manually recording the file name of the thermal image file and the corresponding information of the measured object by using paper; attaching a voice annotation representing the information of the measured body in the thermal image file; the above operation is cumbersome and the subsequent finishing work load is large.

There are also detection devices with orientation acquisition devices such as GPS, which can prompt GPS information and record the GPS information in association with the file of the detection data. However, in the prior art, GPS information recorded by various detection devices such as a thermal image capturing device cannot conveniently correspond to information of a detected object, only the GPS information is recorded, and in subsequent arrangement, the information of the detected object needs to be correspondingly recorded according to the GPS information, which increases workload. When a plurality of detected bodies exist in the same place, a user still needs to observe the field label of the detected body to manually record the information of the detected body, and the problem that the information of the detected bodies is correspondingly associated with the detection data cannot be solved only by recording the azimuth information.

Or a bar code and the like can be arranged on the measured body, and the information of the measured body can be obtained by bar code scanning and the like when in use; however, in some applications, such as in the power industry, the distance of about 3-20 m is usually required for detecting the object to be detected by using a detection device such as a thermal image capturing device, and if the barcode is scanned, the scanning operation needs to be performed close to the barcode mounting position of the object to be detected, which increases the workload of the user.

Therefore, it is understood that there is a need for a recording device that can conveniently obtain subject information about a detected subject, solving the problems that exist today.

Disclosure of Invention

To this end, the invention adopts the technical proposal that a recording device is provided with,

a first acquisition section for acquiring a first image;

a second acquisition unit configured to acquire detection data and/or inspection data of the subject;

a recording part for recording the specified information and the detection data and/or the routing inspection data in a correlated manner; the prescribed information includes one or more of a first image, character information recognized based on the first image, first subject information recognized based on the first image, second subject information selected based on the first subject information, configuration information associated with the first subject information recognized based on the first image, and configuration information associated with the second subject information selected based on the first subject information.

The recording method of the present invention includes the steps of:

a first acquisition step of acquiring a first image;

a second acquisition step for acquiring detection data and/or inspection data of the subject;

recording, namely recording the specified information and the detection data and/or the routing inspection data in an associated manner; the prescribed information includes one or more of a first image, character information recognized based on the first image, first subject information recognized based on the first image, second subject information selected based on the first subject information, configuration information associated with the first subject information recognized based on the first image, and configuration information associated with the second subject information selected based on the first subject information.

Other aspects and advantages of the invention will become apparent from the following description.

Description of the drawings:

fig. 1 is a block diagram of an electrical configuration of a recording apparatus 100 of embodiment 1.

Fig. 2 is an external schematic view of the recording apparatus 100 according to embodiment 1.

Fig. 3 is a schematic diagram showing an implementation of the subject information and the configuration information stored in the storage medium of the recording apparatus 100.

Fig. 4 is a control flowchart of the recording apparatus 100 of embodiment 1.

Fig. 5 is a schematic diagram of the recording apparatus 100 of embodiment 1 capturing a first image.

Fig. 6 is a block diagram of an electrical configuration of the processing device 101 of embodiment 2.

Fig. 7 is a control flowchart of the processing apparatus 101 of embodiment 2.

Fig. 8 is a block diagram of an electrical configuration of the recording apparatus 102 of embodiment 3.

Fig. 9 is a control flowchart of the recording apparatus 102 of embodiment 3.

Detailed Description

The following examples are set forth to provide a better understanding of the present invention without limiting the scope thereof and may be modified in various forms within the scope thereof. Furthermore, although the recording device 100 in embodiment 1 of the present invention is exemplified by a portable thermographic imaging device, but is not limited thereto, the idea of the embodiment is applicable to general detection devices, and the recording device 100 may be various detection devices that obtain detection data based on detectors (including various detectors and sensors), such as various imaging devices (such as imaging devices of visible light, infrared, ultraviolet, laser, and the like), partial discharge testing devices, gas leakage testing devices, vibration testing devices, and the like.

In embodiment 1, the structure of a recording apparatus 100 of embodiment 1 is described with reference to fig. 1. Fig. 1 is a block diagram of an electrical configuration of a recording apparatus 100 of embodiment 1.

Specifically, the recording apparatus 100 includes a first acquisition unit 1, a second acquisition unit 2, a temporary storage unit 3, a communication unit 4, a memory card unit 5, an image processing unit 6, a flash memory 7, a display control unit 8, a display unit 9, a control unit 10, and an operation unit 11, and the control unit 10 is connected to the respective corresponding units via control and data buses and takes charge of overall control of the recording apparatus 100.

The first acquisition unit 1 acquires a first image including information to be recognized. In embodiment 1, the first acquisition unit 1 is a visible light imaging unit, and includes an optical component, a lens driving component, a visible light detector, a signal preprocessing circuit, and the like, which are not shown; the first image is obtained by photographing a label related to the subject.

The first acquiring unit 1 may be implemented in various ways depending on the material, color, and the like of the label information and the background of the target label, and depending on the application environment conditions.

In another example, the first acquiring unit 1 may employ a near-infrared photographing device, and may photograph a first image of a sign of a corresponding retroreflective material at night based on an auxiliary lighting device, for example, an infrared lighting device of 950 nm; preferably, the recording apparatus 100 includes an auxiliary lighting device.

In still another example, the first acquiring unit 1 may employ a thermal image capturing unit for far infrared, and obtain the first image based on far infrared radiation of the sign; wherein the first image may be acquired based on a difference in emissivity of the signage information and the background surface material.

In embodiment 1, the first image is image data obtained based on an output signal of an image detector; according to the different embodiment of the first acquisition unit, the image data may be raw image data obtained by AD-converting the output signal of the image sensor, or may be image data obtained by performing predetermined processing on the basis of the raw image data, for example, by performing various image processing such as white balance compensation processing, Y compensation processing, and YC conversion processing, to generate image data composed of a digitized luminance signal and color difference signals. But not limited thereto, in other embodiments, the first image may be obtained by receiving external image data, such as a visible light image of a sign output by a visible light photographing device connected to the recording device 100; or may be obtained by reading the first image file from a storage medium.

A second acquisition unit 2 for acquiring detection data; in embodiment 1, the detection data may be obtained based on signals of detection probes, including corresponding probes and/or sensors, etc. But not limited thereto, in other embodiments, the detection data may be obtained by receiving external detection data, such as detection data output by a detection device connected to the recording device 100; or may be obtained by reading the test data file from the storage medium.

In embodiment 1, the second acquiring unit 2 is a thermal image capturing unit (e.g. a thermal image capturing unit of 8-14 μm), and is composed of an optical component, a lens driving component, an infrared detector, a signal preprocessing circuit, and the like, which are not shown in the figure. The optical component is composed of an infrared optical lens for focusing the received infrared radiation to the infrared detector. The lens driving part drives the lens to perform focusing or zooming operation according to a control signal of the control part 10. Furthermore, it may be an optical component that is manually adjusted. An infrared detector, such as a refrigeration or non-refrigeration type infrared focal plane detector, converts infrared radiation passing through the optical components into electrical signals. The signal preprocessing circuit comprises a sampling circuit, an AD conversion circuit, a timing trigger circuit and the like, and is used for sampling and other signal processing of an electric signal output from the infrared detector in a specified period and converting the electric signal into a digital thermal image signal through the AD conversion circuit, wherein the thermal image signal is binary data (also called thermal image AD value data, AD value data for short) of 14 bits or 16 bits, for example; the corresponding pseudo-color plate range can be determined according to the range of the AD value of the thermal image signal or the set range of the AD value, the specific color value corresponding to the AD value of the thermal image signal in the pseudo-color plate range is used as the image data of the corresponding pixel position in the infrared thermal image, and the image data of the infrared thermal image can be obtained. In embodiment 1, the second acquiring unit 2 is used as an example of the second acquiring unit for capturing and acquiring thermal image data (an example of detection data).

In embodiment 1, thermal image data is obtained by shooting; but not limited thereto, in other embodiments, the image may be obtained by receiving external thermal image data, or may be obtained by reading a thermal image file from a storage medium; the thermal image data is obtained based on the output signal of the infrared detector; according to different embodiments, for example, the infrared image sensor can be a thermal image signal (thermal image AD value data obtained after AD conversion of an output signal of the infrared thermal image detector); the image data may be thermal image data obtained by performing predetermined processing on the thermal image signal, for example, image data based on an infrared thermal image obtained by performing pseudo-color processing, or array data based on a temperature value obtained by performing temperature conversion.

The imaging unit is not limited to a different imaging unit; in some examples, the first and second acquiring parts may be the same photographing part, for example, the thermal image photographing part is used for photographing a first image of the label and photographing the subject to obtain the thermal image data.

A temporary storage section 3, such as a volatile memory such as a RAM, a DRAM, or the like, as a buffer memory for temporarily storing data output from the first acquisition section 1 and the second acquisition section 2; at the same time, the image processing unit 6 and the control unit 10 function as working memories and temporarily store data processed by the image processing unit 6 and the control unit 10.

A communication unit 4, for example, an interface for connecting the recording apparatus 100 to an external apparatus and exchanging data in accordance with a communication specification such as USB, 1394, network, GPRS, 3G, 4G, or 5G; examples of the external device include a personal computer, a server, a PDA (personal digital assistant), another recording device, and another storage device.

The memory card unit 5 is connected to a memory card as a rewritable nonvolatile memory as an interface of the memory card, is detachably mounted in a card slot of the main body of the recording apparatus 100, and records detection data under the control of the control unit 10.

An image processing unit 6 for performing predetermined processing on the data acquired by the first acquisition unit 1 and the second acquisition unit 2; for example, when the display timing comes, a frame at each predetermined time interval is selected and read from thermal image data of predetermined time shares temporarily stored in the temporary storage unit 3; the image processing unit 6 performs processing such as correction, interpolation, pseudo color, synthesis, compression, decompression, and the like, and converts the data into data suitable for display, recording, and the like. The image processing unit 6 may be implemented by, for example, a DSP, another microprocessor, a programmable FPGA, or the like, or may be a processor integrated with the control unit 10.

Preferably, the image processing unit 6 includes a first recognition unit configured to recognize the first image acquired by the first acquisition unit 1 and obtain character information or first subject information.

Taking as an example a first image obtained by imaging a sign including character-constituting sign information, in one embodiment, the first recognition unit includes a positioning unit, a dividing unit, a recognition unit, and a determination unit.

The positioning unit is used for positioning the label area in the first image; for example, performing a related search in a specified range on the first image, finding a plurality of areas which accord with the sign characteristics (such as different colors according to the sign area and the environmental background) as candidate areas, further analyzing the candidate areas, and finally selecting an optimal area as the sign area and extracting the optimal area from the first image; here, predetermined processing such as inclination correction may be performed on the label image or the like.

The segmentation unit is used for segmenting the characters in the label; specifically, the placard area is divided into individual characters according to the extracted placard area, and the character division may be performed by, for example, dividing an image of an individual character based on a blank space between characters by using a vertical projection method, taking into consideration conditions such as a character writing format of the placard, characters, size restrictions, and the like. And the recognition unit is used for identifying the characters of the signs and recognizing the well-divided characters. The placard character recognition method may employ, for example, a template matching algorithm, binarizes the segmented character and scales the size of the binarized character to the size of a character template in a character database, and then matches all the character templates to select the best match as a result. How to extract a character image from an image and perform character recognition is a technique well known in the art, and a detailed description is omitted.

The judging unit is used for judging whether the character information is first detected body information or not; the character information is information constituted by the recognized character or characters. Specifically, in one example, when the recording apparatus 100 matches the recognized character information with predetermined subject information (e.g., subject information stored in the flash memory 7), if the keywords of the two match, the first subject information is obtained as a result of recognition. If not, the first detected body information is judged not to be identified.

In the explanation of the identification by the label content "subject 1" in fig. 5, the character information "subject 1" constituted by the characters "subject", "measure", "body", and "1" is identified and obtained for the first image taken by the label, and if the character information "subject 1" matches the keyword of the subject information "subject 1" stored in the flash memory 7, the first subject information "subject 1" is obtained for the representative identification. The configuration information associated with the subject information "subject 1" stored in the flash memory 7 may be used as the configuration information associated with the identified first subject information "subject 1".

When the content of the placard is composed of characters (letters, numbers, letters, etc.), the first subject information may be determined whether or not to obtain the first subject information based on the recognized character information according to a matching comparison with stored subject information. However, for example, when the content of the label is a barcode, a graphic code, or the like, the barcode may be matched with a barcode template in the template library, and when the content of the label is matched, the subject information associated with the barcode template may be used as the first subject information for identification. The configuration information associated with the subject information may be used as the configuration information associated with the identified first subject information. Obviously, it is preferable that a library of barcode templates is stored in the flash memory 7 in advance.

Various embodiments of recognizing the first image to obtain the character information and/or the first subject information may be employed.

However, in another example, the determination unit may be omitted and character information may be recognized and obtained based on the first image.

In another embodiment, the recording apparatus 100 may be configured to include no first identification portion or only a partial function of the first identification portion; in one example, the first image may be transmitted to the destination through the communication unit 4, for example, to a designated server through wireless 3G, the server may perform recognition of the first image, and the first subject information and/or character information obtained through the recognition of the first image may be received through the communication unit 4. In another example, the divided character image extracted from the first image may be transmitted to a server of a destination through the communication unit 4, the server may perform recognition of the character and a process of obtaining the first subject information, and the first subject information and/or the character information obtained by the recognition process may be received through the communication unit 4. Obviously, when the configuration information can be received through the communication section 4, the content as shown in fig. 3 may not need to be stored in the storage medium of the recording apparatus 100.

The flash memory 7 stores a program for control and various data used for control of each part. Data relating to the first image recognition and the like is stored in a storage medium such as the flash memory 7, for example, a character database for character template matching is stored. In embodiment 1, as shown in the table shown in fig. 3, a flash memory 7 is used as an example of a storage medium for storing information such as subject information and associated configuration information.

The recording apparatus 100 may acquire data necessary for processing from a storage medium, which may be a storage medium in the recording apparatus 100, such as a nonvolatile storage medium like a flash memory 7, a memory card, or the like, a volatile storage medium like the temporary storage section 3, or the like; it may be another storage medium connected to the recording apparatus 100 by wire or wirelessly, such as another storage apparatus or a detection apparatus, a storage medium in a computer or the like, or a storage medium of a network destination, which performs communication by wire or wirelessly connecting to the communication interface 4.

The subject information is information related to the subject, for example, information representing a specific attribute of the subject such as a location, a type, a number, and the like of the subject;

the information of the subject stored in the flash memory 7 should include the keyword in the label information corresponding to the subject for the subsequent matching. Taking the label of the power equipment as an example, the labels of the tested objects installed in the actual substation field can be listed as the following common types: in one example, a subject label installed in correspondence with an entity of the subject includes information representing a location, a number, a type, a phase, etc. of the subject; correspondingly, the information of the tested object comprises information representing the location (such as a transformer substation and an equipment area), the number, the type (such as the type of a transformer, a switch and the like), the phase (such as A, B, C phase) and the like of the tested object; in another example, a placard associated with the device region of the subject; correspondingly, the information of the detected body is the information of the equipment area; in yet another example, the label represents the type of subject; accordingly, the subject information is information of the type of the subject. The subject information stored in advance in the storage medium may further include information such as an attribution unit, a voltage class, a model number, an importance level, a manufacturer, performance, and characteristics of the subject, past imaging or inspection history, a manufacturing date, a lifetime, an ID number, and a detection notice. The information of the measured body can be formed in various ways according to different applications.

When there are the above-mentioned various cases of the measured object information prepared in advance, for example, the actual placard contents "device area 1-1200-switch-a phase"; the stored information of the tested body comprises an equipment area 1, a switch and an equipment area 1-1200-switch-A phase; when character information 'equipment area 1-1200-switch-A phase' is obtained by recognition, the tested body information 'equipment area 1-1200-switch-A phase' with the highest matching degree is selected as representing the first tested body information obtained by recognition during matching comparison.

For convenience of explanation, in the embodiment, the following explanation will be given with reference to the abbreviated symbol contents "subject 1" shown in fig. 5.

The configuration information may be one or more items of parameters, information, programs, and the like necessary to perform the processing. The processing is, for example, one or more of display control of the presentation information, processing control of the acquired detection data, acquisition control; the recording apparatus 100 can perform processing control according to the identification configuration information.

The display control of the presentation information may be, for example, one or more of display control of presentation information related to the subject, such as display control of a reference image, past imaging or inspection history, a detection notice, second subject information, and the like. The display control of the prompt message can be carried out based on the configuration information related to the first measured object information and/or the second measured object information. The configuration information may be one or more items of parameters, information, programs, and the like necessary to perform display control of the guidance information.

The processing control of the detection data includes one or more of various processing controls such as recording, labeling, communication, recognition, analysis region setting, analysis, diagnosis, classification, and the like with the detection data. The processing control of the detection data may be performed based on the configuration information associated with the first subject information and/or the second subject information. The configuration information may be one or more items of parameters, information, programs, and the like necessary to perform process control of the detected data.

Such as lens switching, acquisition frequency of a detector output signal for detecting data, and image processing related control related to the recording apparatus 100. The acquisition control of the detection data may be performed based on the configuration information associated with the first subject information and/or the second subject information. The configuration information may be one or more items of parameters, information, programs, and the like necessary to perform acquisition control of the detection data.

For example, the configuration information associated with the first measured object information and/or the second measured object information is recorded in association with the detection data, which facilitates subsequent processing control of the detection data.

And a display control unit 8 for displaying the image data for display stored in the temporary storage unit 3 on the display unit 9. Specifically, the display control unit 8 includes a VRAM, a VRAM control means, a signal generation means (not shown), and the like, and the signal generation means periodically reads image data from the VRAM (image data read from the temporary storage unit 3 and stored in the VRAM) under the control of the control unit 10, generates a video signal, and outputs the video signal to the display unit 9.

The display unit 9 is, for example, a liquid crystal display device. Not limited to this, the display unit 9 may be another display unit connected to the recording apparatus 100, and the recording apparatus 100 itself may have no display unit in its electrical configuration.

The control unit 10 controls the overall operation of the recording apparatus 100, and a program for controlling and various data used for controlling each part are stored in a storage medium such as the flash memory 7. The control unit 10 is realized by, for example, a CPU, an MPU, an SOC, a programmable FPGA, or the like.

The control unit 10 is a recording unit for recording predetermined information in association with the detection data and/or the inspection data; the prescribed information includes one or more of a first image, character information recognized based on the first image, first subject information recognized based on the first image, second subject information selected based on the first subject information, configuration information associated with the first subject information recognized based on the first image, and configuration information associated with the second subject information selected based on the first subject information. The inspection data such as time information in the detection process, information input by a user and the like are recorded in a manner of associating the detection data with the inspection data, so that the inspection working record can be generated conveniently.

The second measured object information is information related to the measured object selected based on the first measured object information, and preferably, the storage medium such as the flash memory 7 stores the measured object information containing or associated with the second measured object information. As shown in the table of fig. 3, the stored subject information "subject 1" and "subject 2" are associated with the corresponding second subject information.

For example, when the first object information "object 1" is obtained by the first image recognition, assuming that the "object 1" corresponds to a certain electric power equipment and it is possible that a certain component of the electric power equipment, such as a body, a joint, etc., is detected, when it is necessary to photograph the "joint", the user may select the associated second object information, such as the "joint", based on the first object information "object 1".

For example, when the first subject information "subject 2" is obtained from the first image recognition, assuming that "subject 2" corresponds to a certain device area and that a certain device such as a switch, a blade, or the like of the device area is detected, the user may select the associated second subject information such as "switch" based on the first subject information "subject 2" when the "switch" needs to be photographed.

In a preferred example, the detection data is matched based on the identification configuration information associated with the subject 1, such as a subject identification information joint template and a subject identification information body template respectively corresponding to the second subject information "joint" and "subject", and the second subject information "subject" is automatically selected when the detection data is correlated with the subject template.

For example, when the first subject information includes only a part of information related to the subject; the complete information of the measured object also comprises other attribute information such as ID, and other attribute information of the same measured object is selected according to the first measured object information, and the second measured object information is ID number.

The recording process is suitable for static recording process and dynamic recording process of the detection data, and in a static thermal image data recording process example, the first detected object information and the specified (such as at the moment) thermal image data acquired by the second acquisition part 2 are recorded in a correlated manner in response to the recording instruction. In one example of dynamic thermographic data recording, when the detection data continuously acquired by the second acquiring unit 2 is dynamically recorded, the first measured object information is recorded in association with a predetermined frame (for example, at that time) in the thermographic data acquired by the second acquiring unit 2 in response to the indication of the mark.

The control unit 10 serves as a communication unit for associating one or more of the first image, character information recognized based on the first image, first subject information recognized based on the first image, and second subject information selected based on the first subject information with the detection data and/or the patrol data and wirelessly transmitting the associated data. Such as a storage medium sent to a network destination, e.g., a storage medium of a server.

The operation unit 11: the control unit 10 executes a program in response to an operation signal from the operation unit 11, for the user to perform various instruction operations or various operations such as inputting setting information. Fig. 2(a) shows an external view of the recording apparatus 100; the recording apparatus 100 includes a plurality of keys for user operations; the related operation may be realized by a touch panel, a voice recognition unit (not shown), or the like. The recording apparatus 100 can be held and used by a user.

As shown in fig. 2(b), the external appearance of the recording apparatus 100 includes a lens 201 of the first acquisition unit 1 (visible light imaging unit), a lens 202 of the second acquisition unit 2 (thermographic imaging unit), and an auxiliary lighting device 203. The auxiliary lighting device 203 is, for example, a high-intensity lighting lamp, and is used for photographing the label of the subject by the irradiation of the light source at night by the first acquisition unit 1.

The control procedure of embodiment 1 is explained with reference to the flowchart of fig. 4.

An example of the specific operation and control flow of embodiment 1 will be described in detail below. Before the main shooting, the contents of the table as in fig. 3 are stored in advance in the flash memory 7; the control unit 10 controls the overall operation of the recording apparatus 100 based on the control program stored in the flash memory 7 and various data used for controlling each unit, and the control procedure is as follows:

step a01, the control unit 10 determines whether or not there is an instruction to acquire the first image; when the user determines to acquire the first image through the operation part 11, the first acquisition part 1 shoots and acquires the first image;

in this example, the first image is a visible light image, and the user adjusts the shooting angle to display the first image as shown in fig. 5(a) on the display unit 9, and the subject 1(501) and the label 502 attached to the subject attachment seat are visible in this image; preferably, as shown in fig. 5(b), a positioning frame 503 is displayed in the image displayed on the display unit 9, so that the user can frame the image of the sign 502 in the positioning frame 503; the first recognition unit can quickly locate the signboard region according to the range of the location frame 503, and can increase the recognition processing speed.

A specific example of the first image is also a case where a signboard region is extracted from the first image obtained by photographing or a character image obtained by dividing is further extracted.

Step A02, judging whether there is identification indication; if not, the process returns to step a01, and the user can adjust the angle, distance, etc. of the label photographed by the recording device 100, or can adjust the position parameters (position, size, or rotation angle) of the positioning frame 503, and when the user confirms through the operation unit 11 (step a 02: yes), the process proceeds to the next step;

a step a03 of performing processing relating to recognition based on the first image;

specifically, the recognition section may locate the placard area based on the first image or the range of the location frame 503 in the first image; then, the character is divided, template matching is performed to specify the characters "measured", "volume", and "1", and character information "measured volume 1" formed from the recognized characters is obtained and stored in a predetermined area of the temporary storage unit 3.

Preferably, whether the first detected body information is obtained through identification is judged; specifically, when the recording apparatus 100 matches the recognized character information "subject 1" with the subject information "subject 1" stored in the flash memory 7, if the keyword matches, it represents that the first subject information is recognized; if not, judging that the first detected body information is not detected;

in step a04, the control unit 10 controls the second acquisition unit to acquire the detection data;

step A05, judging whether there is recorded indication, if not, going to step A07, if yes, going to the next step;

step A06, recording;

when the character information is identified and obtained in step a03, the character information can be recorded in association with the detection data; the detection data can be conveniently subjected to batch processing according to the associated character information;

when the first detected body information is identified and obtained in step a03, the first detected body information "detected body 1" and the detection data can be recorded in an association manner, so that the detection data can be classified, analyzed and the like in batch processing according to the associated character information;

in this case, it is preferable that the first subject information obtained by the recognition be displayed on the display unit 9 to notify the user.

Further, since the subject information "subject 1" is also associated with the second subject information: the "main body" and the "joint" are displayed on the display unit under the control of the control unit 10, and the second subject information associated with the identified first subject information "subject 1" is displayed on the display unit: the body and the joint can be selected when the user intends to shoot the joint, and at the moment, the second detected body information joint selected based on the first detected body information can be associated with the detection data for recording, so that the detection data can be further conveniently subjected to batch processing, classification, analysis and the like; further, the configuration information related to the first measured object information, the configuration information related to the second measured object information selected based on the first measured object information and the detection data can be recorded in a related manner, and batch processing, classification, analysis and the like of the detection data according to the configuration information can be further facilitated.

The detection data may be predetermined detection data among the multi-frame detection data temporarily stored in the temporary storage unit 3 in response to the time of the recording instruction or a predetermined time thereafter, and/or data obtained by performing predetermined processing on the predetermined detection data.

The essence of correlating records is to record the information needed to facilitate subsequent batch analysis. The information of the detected body is recorded, so that the detection data can be conveniently classified subsequently, and the classified detection data is subjected to batch processing analysis.

An embodiment of the related recording process, for example, in which predetermined information is added as information of the detection data in a predetermined format; in one embodiment, for example, the control unit 10 reads the signal at that time by a probe in response to a recording instruction from a user to obtain detection data, the image processing unit 6 performs predetermined processing such as compression on the detection data or performs predetermined processing such as correction or interpolation on the detection data, then performs compression processing, and stores the compression processing in the temporary storage unit 3, and the control unit 10 controls the predetermined information in the temporary storage unit 3 and the compression detection data to be recorded in a memory card in association with each other, and ends the processing.

Step A07, judging whether to end, if yes, ending; if not, the process returns to step a04, and recording processing can be performed on the detection data acquired subsequently by the second acquisition unit.

The storage medium to be recorded is not limited to the memory card, the flash memory 7, and the like, and may be a network destination to be communicated through the communication unit 4.

In addition, the association recording process may record predetermined information in an information file or an index file associated with the detection data file (in this example, a thermal image file), and the control unit 10 may generate the information file or the index file;

further, the recording section may have a file name generating unit for generating a file name of the test data file, the file name including at least the obtained character information and/or the first subject information and/or the second subject information; for example, the generated detection data file name: 1.jpg of a tested body; further, a file name is generated in combination with the time information "20140319", for example, the tested person 1-20140319. jpg; the essence of the association record is to record the information needed for subsequent batch analysis, and the file name contains the first tested object information for the user to view.

The essence of the associated records described above is to record the information needed to facilitate subsequent batch processing. Obviously, the above-described embodiments can solve the deficiencies of the prior art.

Obviously, when the detected body is detected, the corresponding recording processing is conveniently carried out according to the identified first detected body information, and the manual complicated operation of a user is avoided.

As described above, the first image is acquired, and then the first image is identified to acquire the first detected body information; performing recording processing according to first subject information and/or second subject information selected based on the first subject information; the problems of the prior art are solved; in the prior art, the label of the tested object needs to be checked to manually record the information of the tested object, and the use is inconvenient; the detection device with the first image shooting function is convenient for acquiring first detected body information of a detected body with a label, is convenient to use in the daytime and at night, does not need to be close to the label mounting part of the detected body, and has the advantages of simple and effective operation, great reduction of labor intensity of a user, accurate acquisition of the first detected body information and the like.

Further, the instruction to acquire the first image and the instruction to recognize by the user through the operation portion 11 are not limited; in one example, the first image may be continuously acquired, and the recognition processing may be performed according to a recognition instruction of the user; in another example, it may be configured to acquire the first images continuously, and also to identify the continuously acquired first images; and when the first detected body information is identified, carrying out subsequent corresponding processing according to the acquired first detected body information. In another example, when the first subject information is not detected at step a 03; the process returns to step a01, and the user can adjust the shooting angle, distance, etc. of the recording apparatus 100 to re-acquire the first image for subsequent processing.

Example 2

The processing device 101 of embodiment 2 performs processing by reading the first image and its associated detection data stored in the storage medium. The processing device 101 may be any of a variety of devices such as a personal computer, a personal digital assistant, and the like.

The structure of a processing apparatus 101 of embodiment 2 is explained with reference to fig. 6; the processing device 101 includes a communication interface 1, an auxiliary storage unit 2, a display unit 3, a RAM4, a hard disk 5, an operation unit 6, and a CPU7 connected to the above components via a bus and controlling the whole. The processing device 101 may be, for example, a computer or a personal digital assistant.

The communication interface 1 may include various wired or wireless communication interfaces, such as a network interface, a USB interface, a 1394 interface, a video interface, GPRS, 3G, 4G, 5G, and the like.

The auxiliary storage unit 2 is a storage medium such as a memory card and a related interface.

The display section 3 is, for example, a liquid crystal display, and the display section 3 may be another display connected to the information providing apparatus 100, and the information providing apparatus 100 itself may have no display in its electrical configuration.

The RAM4 functions as a work memory for the CPU7, and temporarily stores data processed by the CPU 7.

The hard disk 5 stores therein a program for control and various data used in the control. And stores a table as shown in fig. 3.

The operation unit 6: the CPU7 executes a program in response to an operation signal from the operation unit 6, for the user to perform various instruction operations or various operations such as inputting setting information. A touch screen or keys (not shown) may be employed to implement the relevant operations.

In embodiment 2, the CPU7 may be used as an example of the acquisition section, for example, to read the first image and the detection data from a storage medium such as the hard disk 5.

Further, the CPU7 may also receive the first image and/or the detection data provided by an external device such as a device for photographing the first image, a device for obtaining the detection data by a probe, through the communication interface 1.

An example of the control flow of the processing apparatus 101 is explained with reference to fig. 7; here, as an example, a process of storing a file of a first image and detection data associated with each other in the hard disk 5 is taken, and the first image and the detection data are acquired and recorded in association with each other, for example, by a recording apparatus 100 with a function of capturing the first image and obtaining the detection data by a probe.

Step B01, when an instruction to perform processing is given, for example, when the user selects one of the test data files via the operation section 6, the CPU7 reads the corresponding file from the hard disk 5, acquires the first image based on the first image file associated with the selected test data file, and proceeds to the next step;

step B02, identifying the first image to obtain the first detected body information; specifically, the CPU7 locates the placard region in the first image, then performs character segmentation, then performs template matching to determine the character, and obtains the recognized character information; then, whether the first detected body information is obtained or not can be identified by matching the identified character information with the detected body information stored in the hard disk 5, and if not, the step B05 is skipped, or further information prompt such as a word of 'unrecognized detected body information' can be performed; if yes, entering the next step;

step B03, processing according to the configuration information related to the first detected body information;

the processing control, for example, one or more of processing control related to notification processing, display control of the presentation information, processing control of the acquired detection data, acquisition control of the detection data, and the like; there may be various processing configurations associated with the identified first subject information and/or second subject information depending on the application of the detection data.

Step B04, judging whether to end, if yes, ending; if not, then the user can select the next test data file for subsequent processing in step B01. If a plurality of to-be-processed test data files are selected previously, the process can return to step B01 to read the next test data file for processing;

preferably, when the plurality of detection data files are selected to be processed, the first image file without the first detected body information identified and/or the detection data file associated with the first image file can be automatically classified, for example, stored in a specific folder, so that subsequent manual processing is facilitated;

further, it is preferable that, when the first subject information is recognized, the detection data associated with the first image is subjected to recognition processing based on the subject recognition information associated with the first subject information, and whether the first subject is photographed or a part thereof is photographed is determined and the classification is automatically performed.

As described above, since the first subject information is obtained by identifying the first image and the detection data related to the first image is processed according to the configuration information related to the first subject information, the processing quality of the detection data can be greatly improved and the manual operation of the user can be reduced.

Obviously, when the detection data is associated with character information recognized based on the first image, the character information can be matched with the information of the detected body, and if the character information is matched with the information of the detected body, the detection data can be processed according to the configuration information associated with the information of the detected body. When the detection data is associated with the first measured object information and/or the second measured object information selected based on the first measured object information, corresponding configuration information can be obtained, and the detection data is processed according to the configuration information. When the detection data is associated with the configuration information, the detection data can be processed according to the configuration information.

Example 3

One of the first acquisition section and the second acquisition section may have a function of acquiring the first image or the detection data, and the other may be realized by reading the first image or the detection data stored in the storage medium or received through the communication interface 1.

In the recording apparatus 102 according to embodiment 3, the first acquisition unit has a function of capturing the first image, and the second acquisition unit receives the detection data through the communication interface 1. The recording device 102 may be exemplified by a personal digital assistant, a portable computer, or the like with a visible light imaging device.

The structure of the recording apparatus 102 of embodiment 3 is explained with reference to fig. 8, and fig. 8 is a block diagram of the electrical structure of the recording apparatus 102 of embodiment 3.

The recording device 102 includes a communication interface 1, an auxiliary storage unit 2, a display unit 3, a RAM4, a hard disk 5, an operation unit 6, a CPU7 connected to the above components via a bus and performing overall control, and a first acquisition unit 8. The description of the components having the same numbers as those in embodiment 2 is similar to that in embodiment 2, and the description thereof is omitted.

In this example, the first acquisition unit 8 is a visible light imaging unit that images a label of the subject to acquire a first image; the CPU7 may receive, as an example of the second acquisition section, detection data supplied from an external device, such as a detection device with a detection data acquisition function, through the communication interface 1; the scene of use is, for example, a user who performs a detection operation using the portable recording apparatus 102 and the portable detection apparatus. The device can also be assembled on a carrying platform such as a vehicle for use.

An example of the control flow of the recording apparatus 102 is explained with reference to fig. 9; in this case, the recording device 102 is connected to a detection device, such as a thermal image capturing device, through the communication interface 1.

Step C01, when an instruction to acquire the first image is given, the CPU7 controls the first acquiring part 8 to shoot and acquire the first image, and the next step is carried out; a user holds the recording device 102 and first takes a first image;

step C02, performing recognition processing on the first image to obtain first subject information; specifically, the CPU7 locates the placard region, then performs character segmentation, then performs template matching to determine the character, and obtains the recognized character information; then, whether the first detected body information is obtained or not can be identified by matching the identified character information with the detected body information stored in the hard disk 5, if not, the step C05 is skipped, and if yes, the next step is performed; the detected first subject information may be displayed as a notification;

step C03, the CPU7 may function as a second acquisition section to acquire the detection data; specifically, detection data collected by a connected detection device is received through the communication interface 1; the user holds the detection device to collect the detection data.

Step C04, the first detected body information and/or the configuration information related to the first detected body information and the detection data are subjected to related recording processing;

further, other process control may be performed, for example, one or more of notification processing, display control of presentation information, processing control of acquired detection data, acquisition control of detection data, and the like; there may be various processing configurations associated with the identified first subject information and/or second subject information depending on the application of the detection data.

Step C05, judging whether to end, if yes, ending; if not, the process returns to step C01 to obtain the next first image for subsequent processing.

Other embodiments

The present invention is not limited to photographing or acquisition of detection data from the outside, and may be configured as one component or functional block of a recording device or a processing device, for example, acquisition of detection data from another component.

In the above example, the first image is acquired first, and then the detection data is acquired for processing control; however, the detection data may be acquired first, then the first image may be acquired, and the detection data may be processed according to the first detected object information acquired by the first image recognition.

In the above examples, a certain step order is described, but various sequences are possible according to different embodiments, and the processing order described in the above examples is not limited. When the control unit 11, the image processing unit, and the like include a plurality of processors, there may be parallel processing in which some steps are applied.

Aspects of the present invention can also be realized by a computer of a system or apparatus (or devices such as a CPU, MPU, or the like) that performs the functions of the above-described embodiments by separately and executing a program recorded on a storage device, and a method known by a computer of a system or apparatus by the steps thereof to perform the functions of the above-described embodiments by, for example, reading out and executing a program recorded on a storage device. For this purpose, the program is supplied to the computer, for example, via a network or from a recording medium of various types serving as a storage device (e.g., a computer-readable medium).

The present invention provides a computer program in which a digital signal formed by the computer program is recorded in a computer-readable recording medium such as a hard disk or a memory. After the program is operated, the following steps are executed:

a first acquisition step of acquiring a first image;

Embodiments of the present invention also provide a readable storage medium storing a computer program for electronic data exchange, wherein the computer program causes a computer in a thermographic imaging apparatus to perform the above steps.

Although the functional blocks in the drawings may be implemented by hardware, software, or a combination thereof, there is generally no need for structures to implement the functional blocks in a one-to-one correspondence. Blocks of multiple functions may be implemented by one software or hardware module. Or a functional block may be implemented by a plurality of software or hardware units. In addition, some or all of the processing and control functions of the components in the embodiments of the present invention may be implemented by dedicated circuits, general-purpose processors, or programmable FPGAs.

In addition, the example is exemplified by the application of the object to be measured in the power industry, and the application is also widely applied to various detection industries.

The above description is only a specific example (embodiment) of the invention, and various illustrations do not limit the essence of the invention, and various embodiments can be configured into more embodiments by performing corresponding substitution and combination. Other modifications and variations to the specific embodiments can be practiced by those skilled in the art upon reading the present specification without departing from the spirit and scope of the invention.

Claims

1. A recording apparatus, comprising,

a first acquisition section for acquiring a first image by photographing a label related to a subject;

a first recognition unit configured to acquire first subject information based on recognition of the first image;

the information of the measured body represents the specific attribute of the measured body;

a recording part for recording the specified information and the detection data and/or the routing inspection data in a correlated manner;

the prescribed information includes character information recognized based on a first image;

the prescribed information further comprises one or more of first measured body information identified based on a first image, second measured body information selected based on the first measured body information, configuration information related to the first measured body information identified based on the first image, and configuration information related to the second measured body information selected based on the first measured body information;

the second subject information is information related to the subject selected based on the first subject information.

2. The recording apparatus of claim 1, wherein the contents of the label include one or more of characters, bar codes, graphic codes, and the like.

3. The recording apparatus according to claim 1, wherein the first recognition section is provided for acquiring character information based on recognition of the first image, and acquiring the first subject information when a keyword matches according to whether the character information matches a previously stored one.

4. The recording apparatus according to claim 1, wherein the detection data is image data obtained by shooting.

5. The recording apparatus according to claim 1, wherein there are auxiliary light source means for illuminating a label associated with the subject; the first acquisition unit acquires a first image by imaging the sign illuminated by the auxiliary light source device.

6. The recording apparatus according to claim 1, wherein the first acquisition section is a visible light camera or a near infrared camera, and the first image is acquired by photographing a sign related to the subject.

7. The recording apparatus according to claim 1, wherein the first acquisition section acquires the first image by receiving visible light and/or infrared light.

8. The recording apparatus according to claim 1, wherein the first acquisition section and the second acquisition section may be the same acquisition section or different acquisition sections.

9. A recording apparatus, comprising,

a communication unit for associating the predetermined information with the detection data and/or the inspection data and transmitting the associated information wirelessly;

10. A recording method, comprising the steps of,

s1: a first acquisition step of acquiring a first image by photographing a label related to a subject;

s2: a first identification step of acquiring first subject information based on identification of the first image; the information of the measured body represents the specific attribute of the measured body;

s3: a second acquisition step for acquiring detection data and/or inspection data of the subject; recording, namely recording the specified information and the detection data and/or the routing inspection data in an associated manner;