CN104796585A

CN104796585A - Image dynamic recording device, playback device, image dynamic recording method and playback method

Info

Publication number: CN104796585A
Application number: CN201410234363.1A
Authority: CN
Inventors: 王浩
Original assignee: Hangzhou Mission Infrared Electro Optics Technology Co Ltd
Current assignee: Hangzhou Mission Infrared Electro Optics Technology Co Ltd
Priority date: 2013-05-29
Filing date: 2014-05-29
Publication date: 2015-07-22
Also published as: WO2014190921A1; CN104394303A

Abstract

The invention discloses an image dynamic recording device, a playback device, an image dynamic recording method and a playback method, and relates to the application fields of image shooting devices, image processing devices and image shooting. In the prior art, an appropriate measure for correlating dynamically-recorded image data frames with shot object information conveniently and rapidly is unavailable. According to the image dynamic recording device and the image dynamic recording method provided by the invention, a recording part records an image in a way of correlating marked image data frames with the shot object information and distinguishing the marked image data frames from other image data frames in response to a mark indicator according to the selected shot object information during execution of dynamic recording, so that existing problems are solved.

Description

Image dynamic recording device, playback reproducer and image dynamic recording method, back method

Technical field

Image dynamic recording device of the present invention, playback reproducer and image dynamic recording method, back method, relate to device for filming image, image processor, and the application of filming image.

Background technology

Device for image is widely used the fields such as industry, such as, is focusing on the industrial circle of repair based on condition of component, is using the filming apparatus such as visible ray filming apparatus, thermal imaging device, ultraviolet filming apparatus, regularly equipment etc. is shot for an important ring of repair based on condition of component.The dynamic video file that the shooting of current device for image obtains is temporally or serial number gencration filename; For follow-up file and analysis, and distinguish the image data frame of the key in dynamic video file corresponding to subject, such as need at present user according to cognitive to subject or on-the-spot nameplate come the time of image data frame crucial in manual record dynamic video file and corresponding subject information; All inconvenience such as there is operation inconvenience, easily mistake, affect shooting speed, intervene afterwards workload is large.Since the application of self imaging detection technique, do not have suitable means to make the image data frame of the key of record obtain with subject information quickly and easily and associated.Those skilled in the art is attempting to address this problem always, such as patent documentation application number: 200410001328 disclose a kind of camera, it is installed on the wireless identification tag ID of subject by receiving, be convenient to the information of associated record subject, but inconvenience installed by wireless identification tag, cost increases, inapplicable in the large occasion of some electromagnetic interference; In addition as assembled GPS receiving-member in device for image, the GPS information of subject is notified and associated record, but for the high application scenario of subject closeness or indoor, also inapplicable; How a difficult problem by the image data frame of key and the associated record of subject information easily.

Summary of the invention

The invention provides a kind of image dynamic recording device and image dynamic recording method, in dynamically taking, mark crucial image data frame, and image data frame is associated with subject information, solve prior art problem.

For this reason, by the following technical solutions, image dynamic recording device, comprising in the present invention:

Shoot part, obtains image data frame for taking continuously;

Selection portion, for selecting subject information;

Recording unit, for the instruction of response dynamics record, based on selected subject information, by information information-related for selected subject, with continuous recording image frame associated record; Described image frame is obtained image data frame and/or the data that obtain after predetermined processing based on obtained image data frame;

Operating portion, carries out marking operation for user;

Described recording unit, the mark instruction that operation response produces, carries out record by marked image frame and unlabelled image frame in the mode that can mutually distinguish.

Another program, image dynamic recording device, comprising:

Shoot part, obtains image data frame for taking continuously;

Recording unit, for the instruction of response dynamics record, continuous recording image frame, the data that described image frame obtains after predetermined processing for obtained image data frame and/or the image data frame that obtains;

Selection portion, for selecting subject information;

Operating portion, carries out marking operation for user;

Described recording unit, the mark instruction that operation response produces, by information information-related for the subject selected by marked image frame and selection portion, carries out associated record.

Another program, image dynamic recording device, comprising:

Acquisition unit, for obtaining image data frame continuously;

Selection portion, for selecting subject information;

Recording unit, for the instruction of response dynamics record, according to selected subject information, by information information-related for selected subject, with continuous recording image frame associated record; Described image frame is obtained image data frame and/or the data that obtain after predetermined processing based on obtained image data frame;

Labeling section, for sending mark instruction;

Described recording unit, response flag indicates, and marked image frame and unlabelled image frame are carried out record in the mode that can mutually distinguish.

Playback reproducer of the present invention, comprising:

Image selection portion, for selecting multiple image data frame;

Selection portion, for selecting subject information;

Mark playback portion, for based in selected multiple image data frames, is associated with the marker frame of selected subject information, shows the image that described marker frame obtains.

Another playback reproducer of the present invention, comprising:

Image capturing portion, for obtaining image data frame;

Selection portion, for selecting subject information;

Playback portion, for the image that the image data frame that frame frequency is play and subject is information-related according to the rules obtains.

A kind of image dynamic recording method of the present invention, comprising:

Shooting step, obtains image data frame for taking continuously;

Select step, for selecting subject information;

Recording step, for the instruction of response dynamics record, based on selected subject information, by information information-related for selected subject, with continuous recording image frame associated record; Described image frame is obtained image data frame and/or the data that obtain after predetermined processing based on obtained image data frame;

Operating procedure, carries out marking operation for user;

Described recording step, the mark instruction that operation response produces, carries out record by marked image frame and unlabelled image frame in the mode that can mutually distinguish.

Another image dynamic recording method of the present invention, comprising:

Obtaining step, for obtaining image data frame continuously;

Recording step, for the instruction of response dynamics record, continuous recording image frame, the data that described image frame obtains after predetermined processing for obtained image data frame and/or the image data frame that obtains;

Select step, for selecting subject information;

Markers step, for sending mark instruction;

Described recording step, response flag indicates, and by information information-related with the subject selected selected by step for marked image frame, carries out associated record.

Back method of the present invention, comprising:

Step selected by image, for selecting multiple image data frame;

Select step, for selecting subject information;

Mark replay procedure, for based in selected multiple image data frames, is associated with the marker frame of selected subject information, shows the image that described marker frame obtains.

In addition, the invention provides a kind of computer program, it is the program performed in device for filming image, and described computer program makes device for filming image perform following steps:

Shooting step, obtains image data frame for taking continuously;

Select step, for selecting subject information;

Operating procedure, carries out marking operation for user;

Other aspects of the present invention and advantage are set forth by specification below.

Accompanying drawing illustrates:

Fig. 1 is the block diagram of the schematic configuration of the device for image 13 representing embodiments of the invention.

Fig. 2 is the schematic diagram of device for image 13 profile of embodiment.

Fig. 3 is the control flow chart of the device for filming image of embodiment 1.

Fig. 4 is the exemplary list example of the subject information stored in storage medium.

Fig. 5 is the schematic diagram of the subject indication information of specified quantity and the display interface of image.

Fig. 6 is the another kind of schematic diagram of the subject indication information of specified quantity and the display interface of image.

Fig. 7 is be the control flow chart representing embodiment 2.

Fig. 8 is the schematic diagram arranging the example at interface of filter condition.

Fig. 9 is the exemplary list example of the subject information after filtering according to filter condition.

Figure 10 be filter after the subject indication information of subject information acquisition and the display of image illustrate.

Figure 11 is the control flow chart of the determination process of subject information.

Figure 12 is be the control flow chart representing embodiment 3.

Figure 13 is the block diagram of the electrical structure of a kind of enforcement of the image status-keeping system that image processor 100 and device for filming image 101 connect and compose.

Figure 14 is the schematic diagram of a kind of enforcement of the image status-keeping system that image processor 100 connects and composes with device for filming image 101.

Figure 15 is the example of the display interface of the playback reproducer representing embodiment 5.

Figure 16 is be the control flow chart representing embodiment 5.

Figure 17 is the schematic diagram to image data frame sorting examples.

Figure 18 is the example of the display interface of the playback reproducer representing embodiment 6.

Embodiment

Introduce embodiments of the invention below, although the present invention in embodiment 1, the device for image 13 with image shooting function of exemplary portable is as the example of image dynamic recording device.But in other example, be also applicable to the processing unit receiving image data frame continuously, as personal computer, the processing unit such as personal digital assistant device, as the example of image dynamic recording device.

In an embodiment, so-called image data frame is for image AD Value Data (being also called AD Value Data or AD value); But be not limited thereto, in other implementations, it can be such as the view data of image, also can be such as the digital signal that exports of image detector therein and the image data frame that formed, the data of such as, multiple mixing in these data, such as, in these data one or more mix and data etc. after compressing.

To describe exemplary embodiments of the present invention with reference to the accompanying drawings in detail now.Note, the embodiment that below will illustrate, for understanding the present invention better, so do not limit the scope of the invention, and can change the various forms in scope of the present invention.

Embodiment 1

Fig. 1 is the electrical structure block diagram of the device for image 13 of embodiment 1.Fig. 2 is the external form figure of the portable device for image 13 of embodiment 1.

Device for image 13 has shoot part 1, image processing part 2, aobvious control portion 3, display part 4, Department of Communication Force 5, interim storage part 6, storage card I/F7, storage card 8, flash memory 9, control part 10, operating portion 11, control part 10, by controlling to be connected with above-mentioned appropriate section with data/address bus 12, is responsible for the overall control of device for image 13.

For visible ray filming apparatus, a kind of execution mode, shoot part 1 is made up of not shown optics, lens driving parts, image detector, signal pre-processing circuit etc.Optics is made up of optical lens, and shot object image incides image detector from optics.Lens driving parts drive lens to perform focusing or zoom operation according to the control signal of control part 10, in addition, also can be the optics of manual adjustments.Image detector is such as made up of cmos type image detector etc., and the shot object image by optics is converted to the signal of telecommunication.Signal pre-processing circuit comprises sample circuit, A/D convertor circuit etc., is carried out sampling by the signal of telecommunication produced, the signal transacting such as automatic growth control, AD conversion from image detector under the cycle of regulation; Various signal transacting as a result, obtain digital image data frame (image AD Value Data).Image data frame is not limited to image detector intrinsic resolution, also can below or above image detector resolution.In the present embodiment, shoot part 1 as the example of acquisition unit, for taking acquisition (numeral) image data frame.The process of image processing part 2 for specifying the image data frame obtained by shoot part 1, obtains the image data frame of image; Such as implement the various image procossing such as white balance compensation process, Y compensation deals, YC conversion process, generate the view data be made up of digitized luminance signal and color difference signal.In addition, based on the control of control part 10, image processing part 2 is for obtaining the view data of image according to the process of regulation by image data frame, then these imaged image data are recorded to as recording medium such as storage card 8 grade.Image processing part 2 can adopt DSP or other microprocessor or programmable FPGA etc. to realize, or, also can be integrated with control part 10 or be same microprocessor.Be not limited to visible ray filming apparatus, for various types of filming apparatus, the process of image processing part 2 carries out digital image data frame to be converted to the process being suitable for showing and using, record the data such as use.

When device for image 13 is various dissimilar imaging device, there is the difference of optics, image detector etc., and the difference of image procossing mode.As device for image 13 be thermal imaging device time, a kind of execution mode, shoot part 1 is made up of not shown optics, lens driving parts, Infrared Detectors, signal pre-processing circuit etc.Optics is made up of infrared optics lens, for will receive focus IR radiation to Infrared Detectors.Lens driving parts drive lens to perform focusing or zoom operation according to the control signal of control part 10.Infrared Detectors, as refrigeration or the infrared focal plane detector of non-brake method type, is converted to the signal of telecommunication the infrared radiation by optics.Signal pre-processing circuit comprises sample circuit, A/D convertor circuit etc., the signal read from Infrared Detectors is carried out sampling under the cycle of regulation, the signal transacting such as automatic growth control, through A/D convertor circuit conversion, obtain numeral (heat) image data frame.The process of image processing part 2 for specifying (heat) image data frame obtained by shoot part 1, the process of image processing part 2, as correction, interpolation, pseudo-coloured silk, compression, decompress(ion) etc., carries out being converted to the process being suitable for showing and using, record the data such as use.Wherein, the process of (heat) image data frame Heat of Formation image (infrared thermal imagery) is as Pseudo-color technology, a kind of execution mode, determine corresponding pseudo-colored steel scope according to the scope of AD value of (heat) image data frame or the setting range of AD value, will the concrete color value of the AD value of (heat) image data frame correspondence in pseudo-colored steel scope as the view data of the middle respective pixel position of thermal imagery (infrared thermal imagery).

These differences above-mentioned do not cause the significant difference of execution mode below.The thought of the following examples is applicable to general device for image, as various types of imaging devices such as visible ray filming apparatus, thermal imaging device, ultraviolet filming apparatus, laser image forming apparatus; Or include the device of the shoot function that more than one said apparatus is formed simultaneously, namely device for filming image can have multiple similar or different image detector.

Aobvious control portion 3 is based on the control of control part 10, and the view data performing the display stored by interim storage part 6 is presented at display part 4.Such as at general mode, the image that the image data frame that display shooting obtains continuously generates; In dynamically recording pattern, display subject indication information and image, in addition, also can show various set information.Specifically, a kind of execution mode, aobvious control portion 3 has VRAM, VRAM control unit, signal generation unit etc., based on the control of control part 10, signal generation unit regularly reads through VRAM control unit and to read from interim storage part 6 and to be stored in the view data of VRAM from VRAM, produce display such as vision signal to export, be presented at display part 4.In this example, display part 4 is as the example of display part; In addition display part 4 can also be other display unit be connected with device for image 13, and can not have display unit in the electrical structure of device for image 13 self.Obviously, when there is no display unit in the electrical structure of device for image 13 self, control part 10 also can control the view data of output display, such as by image output interface (such as various wired or wireless image output interface, such as AV mouth, RJ45 mouth etc.), the view data (control part 10, aobvious control portion 3 etc. are as the example of display control unit) of output display; Display control unit controls display part is shown, and also includes display translation situation.The processor that aobvious control portion 3 also can be integrated with image processing part 2 or control part 10.

Department of Communication Force 5 be such as according to USB, 1394, the communication specification such as network, by the interface that device for image 13 is connected with the outside external equipment such as computer, storage device, other device for image.

Interim storage part 6 is as volatile memory such as RAM, DRAM, the interim buffer storage stored is carried out as the image data frame exported shoot part 1, based on the control of control part 10, such as be repeated below process, be about to the image data frame interim store predetermined time obtained, and when obtaining new frame by described acquisition unit (shoot part 1), after deleting old frame, store new image data frame; Meanwhile, the working storage as image processing part 2 and control part 10 works, and the data processed are carried out in temporarily storage by image processing part 2 and control part 10.Be not limited thereto, the memory that the processor inside such as control part 10, image processing part 2 comprise or register etc. also can be interpreted as a kind of interim storage part.

Storage card I/F7, as the interface of storage card 8, on storage card I/F7, be connected with the storage card 8 as rewritable nonvolatile memory, be arranged in the draw-in groove of device for image 13 main body detachably, according to data such as the control recording image Frames of control part 10.

The program for controlling is stored in flash memory 9, and the various data used in each several part control.The storage medium for storing subject information in embodiment can be the storage medium in device for image 13, as non-volatile memory mediums such as flash memory 9, storage cards 8, and the and for example volatile storage medium such as interim storage part 6; Can also be other storage mediums of being connected wired or wireless with device for image 13, as by with the storage medium in wired or wireless other storage devices carrying out communication that are connected of Department of Communication Force 5 or other camera, computer etc.Preferably, the data in advance such as the subject information relevant with subject are stored in device for image 13 or in connected non-volatile memory medium, in an embodiment, and the example using flash memory 9 as the storage medium of storage subject information.

Subject information is the information relevant with subject, such as represent the information of subject place, type, numbering etc., in addition, the various information such as resume, build date, useful life of the relevant ownership unit of subject, classification grade (as electric pressure, important level etc.), model, manufacturer, performance and characteristic, the shooting in past or maintenance can also be exemplified.Preferably, the various information in subject information are formed according to the form of information classification; Exemplary lists as shown in Figure 4 represents in storage medium the schematic diagram of a kind of enforcement storing subject information, each subject information is made up of the attribute information of some regulation attributes, as subject information 400 " transformer station 1 battery limits 1 equipment 1A phase " has attribute information " transformer station 1 ", the attribute information " battery limits 1 " of battery limits attribute 402 correspondence, the attribute information " equipment 1 " of device type attribute 403 correspondence, the attribute information " A phase " of separate attribute 404 correspondence of transformer station's attribute 401 correspondence.But be not limited thereto, such as, also the form of other forms as single attribute information can store subject information.In embodiment 1, subject packets of information contains and represents subject place (as transformer station, battery limits), type (as types such as equipment 1, equipment 2; Such as represent the switch in reality, the first-class device type of cable), the information of separate (as A, B, C phase) etc.; According to the difference of application, subject information can have various different formation.

Operating portion 11: carry out various instruction operation as dynamically recording operation (as dynamically recording key 1) for user, dynamically recording suspends/continues the operation of (as Pause key 2), marking operation (as mark key 3), or input set information is as various operations such as record frame frequencies, control part 10, according to the operation signal of operating portion 11, performs corresponding program.Operating portion 11 is made up of the dynamically recording key 1 (being configured to operate for carrying out dynamically recording) shown in Fig. 2, Pause key 2, mark key 3, cross key etc.In addition, touch-screen or speech recognition component (not shown) etc. also can be adopted to realize the operation of being correlated with.

Control part 10 controls the action of the entirety of device for image 13, stores the program for controlling in storage medium such as flash memory 9, and the various data used in each several part control.Control part 10 is such as realized by CPU, MPU, SOC, programmable FPGA etc.

Control part 10 as selection portion, for selecting subject information; Such as responding the selection operation of user, select subject information.In addition, the mode also can given tacit consent to is selected, such as, select the subject information finally selected during last start.Obviously, for the subject information of multiple attribute, selection operation repeatedly may be there is.

Control part 10, as recording unit, for the instruction of response dynamics record, records the image data frame obtained continuously; Specifically, such as, response dynamics record indicates, when recording timing arrives, from the image data frame being temporarily stored in described interim storage part 6, the image data frame (as interim storage part 6 specifies the image data frame that the instant shooting stored in region obtains) that selection will be recorded, carries out predetermined processing as correction, interpolation, the laggard line item of compression; Preferably, be recorded in as in flash memory 9, storage card in non-volatile memory medium, but be also recorded in by Department of Communication Force 5 in other storage mediums communicated with device for image 13.

Wherein, the image data frame obtained when filming image is mainly used in follow-up analysis, when ensureing follow-up basic playback dynamic effect, record can be carried out lower frame frequency the record frame frequency of 3-15 frame/second (usually can), thus, can guarantee the dynamically recording process of the larger image data frame of data volume and reduce the burden of processing apparatus.Therefore, preferred embodiment, control part 10, as recording unit, for the instruction of response dynamics record, records frame frequency according to the rules and records obtained image data frame continuously.

Further, recording unit, can during performing dynamically recording or under the state suspending dynamically recording, and response flag indicates, and marked image data frame and unlabelled image data frame are carried out record in the mode that can mutually distinguish.Wherein, the image data frame marked can be the image data frame corresponding to timing of regulation record frame frequency, such as can that frame recorded when recording timing arrives before response flag instruction be marked, also when can arriving to the next record timing of response flag instruction, that frame of record marks, in this case, assuming that timing is 1/6 second record one frame (regulation record frame frequency is 6 frames/second), 6 frame image data frames can be have recorded 1 second.

Further, that frame that the timing of the image data frame marked non-essential corresponding record is corresponding, also can have numerous embodiments; In one example in which, can select from interim storage part 6 will the image data frame of experience record and mark, such as, (6 frames/second is assumed to when recording frame frequency according to the rules, 1/6 second record one frame) recording image Frame time, response flag indicates, and the image data frame reading the instant shooting acquisition stored in interim storage part 6 carries out recording and marking, and also not necessarily is the image data frame corresponding to timing of regulation record frame frequency; Like this, press mark key 3, such as, in 1 second, likely have recorded 7 frame image data frames, wherein have a frame to be marker frame.In another example, response flag indicates, and records next image data frame that shooting obtains and marks.

Select the image data frame carrying out marking to have numerous embodiments, such as, based on the image data frame of the multiframe part kept in interim storage part 6, marker frame can be shake minimum image data frame etc.; During stipulated time when can operate from response flag or afterwards, select in the image data frame kept in interim storage part 6; Preferably, when suspending dynamically recording and the image data frame keeping the moment suspending instruction to obtain, this image data frame can also be marked.What mark can be a frame or multiframe; The frame image frame marked can obtain through predetermined processing according to a frame or multiframe image data frame.

Marked image data frame and unlabelled image data frame are carried out record in the mode that can mutually distinguish.There is numerous embodiments; Can be that document form or the file format of record is different, the region be recorded in identical file is different, be recorded in different recording mediums, storage area, record that identical storage medium is different time association the various mode that can mutually distinguish such as mode difference (the compression process as different) of process of different, the image data frame of different, the corresponding file control information of information.

For by marked image data frame and the unlabelled image data frame recording situation at a dynamic video file;

In one embodiment, the image data frame marked and unlabelled image data frame are associated with the additional information that can mutually distinguish; In another embodiment, the image data frame marked and unlabelled image data frame are corresponding different file control information; As the annotation management information that the specific region in dynamic video file stores, comprise the frame time sequence information etc. of marked image data frame, as time of image data frame of marking, and the address of image data frame in dynamic video file marked; And the content of the management information of unmarked image data frame and storage area difference.In yet, management document can be generated in addition, contain the frame time sequence information etc. of marked image data frame, and can mutually distinguish with the management document of other frames, such as different file extensions.

In addition, also unlabelled image data frame (or also together with marked image data frame) can be generated dynamic video file, in addition, also marked image data frame be generated image picture file; Such as also marked multiple image data frames can be generated another dynamic video file, file extension is different from the dynamic video file containing untagged frame.

According to different application demands, the difference mode that one or more are different can be configured with, be convenient to the follow-up beneficial effect checked, analyze to reach.

Control part 10, as labeling section, indicates for sending mark; Such as respond the operation of user, send mark instruction.In addition, also based in other situations such as the timing of such as extraneous triggering signal, miscellaneous stipulations, mark instruction can be sent.

Come concrete operations and the control flow of introducing embodiment 1 in detail below.Before formal shooting, in flash memory 9, prestore the mission data file of the subject information of the correspondence comprised as shown in Figure 4 transformer station 1.This application scene is such as taken the subject of transformer station.Control part 10 is based on the control program stored in flash memory 9, and the various data used in each several part control, control the action of the entirety of device for image 13 and perform the control of various modes process, after being powered up, control part 10 carries out the initialization of internal circuit, then, enter standby screening-mode, i.e. shoot part 1 shooting acquisition image data frame continuously, the shoot part 1 image data frame that shooting obtains immediately is carried out the process specified by image processing part 2, be stored in interim storage part 6, control part 10 performs control, make on display part 4 with the continuous show image of dynamic image form, in this state, whether control part 10 persistent surveillance has been switched to the process of other patterns according to scheduled operation or has carried out power-off operation, if had, then enter corresponding processing controls.

The rate-determining steps of dynamically recording pattern is described with reference to Fig. 3.

Steps A 01, shooting obtains image data frame, and the image data frame being taken acquisition by shoot part 1 is sent to interim storage part 6;

Steps A 02, display control unit (control part 10) controls, the image of image data frame generation display part 4 show obtain and the subject indication information of the subject information acquisition of specified quantity.

Specifically, a kind of execution mode, control the view data of the image data frame generation image that shooting obtains by image processing part 2, with based on the subject information as shown in Figure 4 stored in flash memory 9, the subject information of wherein specified quantity is generated the view data of subject indication information, synthesize; Leave the view data of synthesis in interim storage part 6; Then, control the view data of this synthesis to be presented at display part 4.As shown in the display interface of Fig. 5 signal.

When user has carried out the operation to scroll bar, then according to adjustment amount and rotating direction, redefine the subject information of specified quantity.Wherein, control part 10 judges the adjustment operation whether user carries out, such as, whether dragged the display adjustment that scroll bar 600 as shown in Figure 6 has carried out subject indication information, or user carries out the adjustment operation of page turning by operating portion, if any, then according to the adjustment amount of user to scroll bar etc., determine the subject information of the specified quantity after adjusting, then the subject indication information of correspondence is shown.

Preferred mode, display control unit will be used for generating the provisioning information of subject indication information in subject information, Layering manifestation is carried out in position according to the rules.Specifically, display control unit has hierarchy allocation units, the attribute information that level and each level for distributing hierarchy are corresponding; Based on the attribute information of the subject information stored in storage medium, the level of the hierarchy distributed according to hierarchy allocation units by the attribute information of subject information and attribute information corresponding to each level show.Shown in such as, subject indication information display window 601 in Fig. 6 display interface, display control unit by subject information according to represent transformer station, battery limits, device type and separate regulation attribute attribute information be divided into three layers of position display according to the rules; Compared with the subject indication information display window 501 in display interface in Fig. 5, obviously, the number of words of same row reduces, and user is convenient to observe and select.

Wherein, according to the subject indication information that subject information obtains, can be that the partial information of the whole of subject information or regulation obtains, can for obtaining the formation of the information of subject indication information in prespecified subject information.

Steps A 03, selects subject information.Wherein, to the selection of subject information, can be carry out before dynamically recording, also can carry out in dynamically recording, maybe can also suspend dynamically recording, carry out the selection of subject information, then Restoration dynamics record again, such as when user is according to the cognition of the subject " transformer station 1 battery limits 1 equipment 1B phase " to floor, such as check on-the-spot equipment direction board, selected by " transformer station 1 battery limits 1 equipment 1B phase " shown by 601 in operating portion 11 couples of Fig. 6, the selection operation of selection portion (control part 10) response user, just have selected the subject information corresponding with this subject indication information, such as selected subject information " transformer station 1 battery limits 1 equipment 1B phase " is remained on the regulation region (for keeping the regulation region of selected subject information) of interim storage part 6, wherein, to be replaced during selected before having subject information, when maintaining subject information in this regulation region, then representing this subject information is selected subject information, as nothing, then represent non-selected subject information.Or also can by selected subject information additional identification to distinguish other subject information.

Further, display control unit controls the subject indication information of special this subject information acquisition of display.At this, show especially, such as can the mode of subject indication information from the subject indication information of specified quantity selected by cognition with user, show this subject indication information.As the special display mode adopting the difference being convenient to the display position, color, background, size, font, content, explanatory note etc. that user distinguishes to be used as being different from other subject indication information.As shown in the subject indication information display window 602 in Fig. 6, control part 10 controls, and the underscore mark of " equipment 1B phase " selected by user, to be different from other subject indication information.Also as the subject indication information of selected subject information acquisition being superimposed upon in image, as shown in the image viewing window 602 in Fig. 6.Further, the subject indication information of special display, its content can be different from other subject indication informations, such as, can comprise as generated the more information such as producer, but also can be fewer than subject indication information, such as, only comprise " B phase ".

Also the partial information such as transformer station 1 or battery limits 1 can be selected as subject information.

Steps A 04, judges whether the instruction of dynamically recording, such as, when the record key 1 that user presses, then enters next step;

Steps A 05, carry out the dynamically recording process being associated with subject information, such as by read in the regulation region from interim storage part 6 want the image data frame of experience record process, associate with selected subject information, be written in the dynamic video file of the initial establishment of dynamically recording in storage medium.Preferred embodiment, described recording unit, takes the image data frame of acquisition continuously for recording the continuous records photographing portion of frame frequency according to the rules, in non-volatile memory medium (as in flash memory 9).

Specifically, a kind of execution mode, in the recording timing specified (when such as recording frame frequency 6 frames/second, 1/6 second) arrive when, select from the image data frame that interim storage part 6 stores and read the image data frame carrying out recording, from the regulation region of interim storage part 6, such as read the image data frame that instant shooting obtains (up-to-date be sent to interim storage part 6), then, carry out predetermined processing as revised, interpolation, pseudo-color, shear, pixel is fallen, compression waits one of them or multiple process that process, by image data frame and selected subject information or also comprise necessary additional information (as the time of image data frame, the radiance of shooting, environmental parameter temperature, humidity, shooting distance, regulation Processing Algorithm or also comprise the parameter etc. relevant to Processing Algorithm) be written in storage medium as in flash memory 9 establishment dynamic video file in.Wherein, the data that the process that image data frame carries out specifying obtains afterwards; Can be one or more of data that these situations obtain.

As do not selected subject information, the dynamically recording of subject information can not be associated with.

The information that selected subject is information-related, such as, can be all information of the subject information as selected subject information, or wherein partial information, such as can record " transformer station 1 battery limits 1 equipment 1B phase ", but also can record " battery limits 1 equipment 1B phase ", may also be other information do not shown in this subject information, such as, also there is in this subject information numbering, model, the information such as No. ID, though do not show, numbering, model, one or more the information of No. ID also can be preserved.Obviously, also can select if transformer station 1 is as the related information of all Frames of whole image file.

The header information that the additional informations such as subject information can be used as corresponding image data frame writes this image data frame; Be not limited to this, also can have the interrelational form from above-mentioned different subject information; Such as, the frame time sequence information of the image data frame that also steps A 06 can be recorded, together with subject information, as management information, as the component part of the file additional information of necessity, write dynamic video file; Or generate the message file or index file that associate with this dynamic video file, in indexed file, contain the frame time sequence information of the frame being associated with subject information and associated subject information.Control part 10 can generate this message file or index file; And must not write image data frame; The essence of associated record is that the follow-up information required for batch processing analysis be convenient in record;

Has steps A 06, judged whether mark instruction? as nothing, then jump to steps A 08, if any (such as user presses mark key 3), then enter next step;

Steps A 07, to the image data frame additional marking information that steps A 05 records, such as, by the data bit of representative mark " 0 " be attached in the additional information of marked image data frame.Another way such as writes and identifies such as watermark etc. in the data of marker frame.

In addition, such as also by the frame time sequence information of marked frame, as management information, as the component part of the file additional information of necessity, in mode diacritic with the management information of other frames, dynamic video file can be write; Or generate the index file associated with this dynamic video file, in indexed file, comprise the frame time sequence information of the frame of mark.

Does steps A 08, judge whether to terminate dynamically recording? in this way, such as user has carried out the operation terminating dynamically recording; Then in steps A 09, by file additional information (as terminated mark etc.) the write dynamic video file of necessity, complete dynamic video file.

As no, then get back to steps A 01, wherein, user can repeatedly mark, or also can reselect new subject information, when having reselected subject information, owing to pressing record key 1 before, proceeds dynamically recording process; In steps A 05, by reselected subject information and image data frame associated record.

In addition, also append mode that is multiple and steps A 07 difference label information can be had, such as, when marked frame is registered as image picture file, also the subject information selected by selection portion can generate image file name, preferably, described recording unit, has filename generation unit, and described recording unit has filename generation unit, for generating the filename of image file, in the filename of its image file generated, contain the relevant information of the subject information that selection portion is selected; The image file name such as generated: transformer station 1 battery limits 1 equipment 1B phase .JPG, further, with temporal information " 20120222 " in conjunction with spanned file name, such as transformer station 1-battery limits 1-equipment 1-B phase-20120222.JPG.Wherein, can when steps A 07, generate image picture file in addition, or also the process of time-out dynamically recording generates image picture file, or the subject information of marked image data frame and association thereof is stored in temporarily the regulation region of interim storage part 6, until time during defined terms as stored the image data frame of specified quantity, suspending dynamically recording process, generating corresponding multiple image picture files.

As mentioned above, based on the subject information prestored, by the common display subject indication information with image, user is easy to select when dynamically recording; Thus improve the efficiency of shooting, reduce working strength.By the mark to key frame, follow-up being easy to is made to search key frame.To the retrieval of subject information, can be convenient to play targetedly, fully demonstrate advantage and the effect of dynamic shooting.

Embodiment 2

The device for image 13 of embodiment 2, before formal shooting, in flash memory 9, prestore the mission data file of the subject information of the correspondence comprised as shown in Figure 4 transformer station 1, in addition, also stored for the mission data file of the subject information comprising other transformer stations.This application scene is such as taken the subject 1 of transformer station 1.In the past, because the object detected is different, have the detection of all subjects in full station, also have the detection of particular type subject, these particular type subjects were distributed in distinct device district, needed user to go to find, very inconvenient.As using subject information as filter condition, can be convenient to user shooting.

The control flow of device for image 13 is described see Fig. 7, and step is as follows:

Step B01, task determination portion determination subject information, determined subject Information Availability is in therefrom selecting subject information; Refer to the explanation of Figure 11.

Step B02, obtain image data frame, image data frame shoot part 1 being taken acquisition is sent to interim storage part 6;

In step B03, display control unit controls, the image that image data frame display part 4 show obtain generates, and the determined subject information of task based access control determination portion, show the subject indication information of the subject information acquisition of specified quantity wherein.

Step B04, selects subject information; At this, select " transformer station 1 battery limits 1 equipment 1B phase ".

In step B05, judge whether the instruction of dynamically recording? as no, then get back to step B02, repeat above-mentioned steps; In this way, then next step;

In step B06, judge whether mark instruction? if any (such as user presses mark key 3), then enter next step; As nothing, then jump to step B08;

In step B07, by marked frame and selected subject information association record;

Such as in the recording timing specified (when such as recording frame frequency 6 frames/second, 1/6 second) arrive when, select from the image data frame that interim storage part 6 stores and read the image data frame carrying out recording, such as, reading the new image data frame obtained from the regulation region of interim storage part 6; Carry out predetermined processing as one of them or multiple process such as correction, interpolation, shearing, compression process, wherein also can omit predetermined processing, by image data frame and with the relevant additional information of mark as selected subject information be written in storage medium as in the dynamic video file created in flash memory 9.

In addition, also can not judge whether the recording timing specified arrives, select from the image data frame that interim storage part 6 stores and read the image data frame carrying out recording, such as read the new image data frame obtained from the regulation region of interim storage part 6, this image data frame and the additional information relevant with mark are written in storage medium as in the dynamic video file created in flash memory 9.Then, or also can restart the timing of regulation record frame frequency.

In step B08, frame frequency carries out dynamically recording process according to the rules; Different from embodiment 1, do not have mark instruction time, the image data frame recorded not with subject information association.

Or, when have selected subject information, be associated with and marked key frame difference subject information structure, such as do not have mark instruction time, be associated with " transformer station 1 ", have mark instruction time, be associated with " transformer station 1 battery limits 1 equipment 1B phase ".

In step B09, judge whether to terminate?

As terminated, then in step B10, by the file additional information of necessity, terminating mark write dynamic video file, completing dynamic video file.

With reference to Figure 11, the determination process of task determination portion to the subject information of specified quantity is described.

Step S101, the filename of the mission data file in display flash memory 9, then enters step S102.Usually the subject in different shooting destinations can be assigned as several mission data files, such as, according to transformer station, by prepared in advance for the device name of each transformer station at a mission data file.

Step S102, judges whether user therefrom have selected one, as have selected wherein one or more, then enters step S103; As nothing, then get back to step S101.

Step S103, then, just determines the relevant mission data file of shooting according to the selection of user.

Step S104, then, task determination portion judges whether the filter condition of regulation.If any then entering step S105.As nothing, then the subject information in selected mission data file is determined.

Step S105, if any filter condition, then filter condition according to the rules, determines the subject information meeting filter condition in mission data file.

Above-mentioned execution mode is multiple mission data file based on subject information distribution.If subject information is with database, or the form of a mission data file stores, and also can omit step S101-S103.

Preferably, device for image 13 has filter condition setting unit (being such as made up of control part 10, operating portion 11, display part 4), arranges filter condition for user; There is task determination portion, for based on the subject information stored in storage medium, according to described filter condition, determine the subject information meeting filter condition.

The setting operation of filter condition is described with reference to figure 8.When user enters menu mode, select " filter and arrange " wherein, the filter condition that display part 4 shows example as shown in Figure 8 arranges interface, hurdle.

Filter condition is made up of the keyword relevant with filter condition and filter logic relation etc.Described filter condition setting unit comprises keyword determining unit, logic determining unit, and wherein, keyword determining unit, for determining the keyword relevant with filter condition; Logic determining unit, for determining the filter logic relation of the keyword relevant with filter condition.

The keyword relevant with filter condition can be a keyword, also can be multiple keyword; Wherein, multiple keyword comprises the situation representing key range, as digital scope, alphabetic ranges, time range etc.In addition, when have in subject information the ownership unit relevant with subject, classification grade (as electric pressure, important level etc.), model, manufacturer, performance and characteristic, the shooting in past or maintenance the various information such as resume, build date, useful life time, all therefrom can determine that keyword is to arrange filter condition, but these information might not be used for the subject indication information generating special display.

Keyword determining unit, for determining the keyword relevant with filter condition; Such as, can be that the keyword relevant with filter condition is determined in following one or more execution modes combination.A kind of execution mode, such as, the keyword prestored, the keyword relevant with filter condition is determined in the selection based on user.A kind of execution mode, such as, one of keyword relevant with filter condition of acquiescence or whole.A kind of execution mode, such as, by user's typing keyword, is defined as the keyword relevant with filter condition by the keyword of user's typing.A kind of execution mode, such as, provides the options of selective key attribute, based on the key attribute that user selects, the keyword meeting this key attribute is defined as the keyword relevant with filter condition.Preferred embodiment, based on the subject information stored, inquiry obtains the keyword specifying the attribute information of attribute in subject information to one, and the keyword relevant with filter condition is determined in the selection based on user.

The concrete setting operation of filter condition is described for the subject of user's shooting " equipment 1 " type.Specifically, the filter condition that display part 4 shows as Fig. 8 example arranges interface, and transformer station 803, battery limits 804, device type 805 etc. are configured to the keyword menu item of the keyword query of the attribute information representing regulation attribute.When storing subject information as shown in Figure 4, the device type 805 that control part 10 is chosen according to this shooting " equipment 1 " based on user, the subject information stored in inquiry storage medium, obtain keyword " equipment 1, the equipment 2 ... of the attribute information of regulation attribute (device type) " make display list 806, user therefrom selects " equipment 1 " wherein, keyword determining unit, determines that " equipment 1 " is for the keyword relevant with filter condition.

In addition, also can using the filter condition of the attribute information selected by keyword menu item formerly as subsequent key word menu item, such as user selects transformer station 803, then show the list of transformer station, therefrom select transformer station 1, when selection device type 805, will only show the list of the device type met in transformer station 1.

Logic determining unit, for determining the filter logic relation of the keyword relevant with filter condition; When filter logic relation refers to that the relevant keyword of filter condition is a keyword, the filtration of this keyword is non-relation; When the relevant keyword of filter condition is multiple keyword, for multiple keyword each other with or, NOT logic relation is the combination of non-relation with filtering; Filtration is the logical relation between non-relation and keyword can be acquiescence, also can arrange according to user and determine.

In fig. 8, the "Yes" of shooting condition 801 and " non-" 802 option are non-relations for arranging filtration; When have selected "Yes", the filter condition generated in conjunction with keyword " equipment 1 " for follow-up search and the subject information determining to meet " equipment 1 " as shooting task; When have selected " non-", the filter condition generated in conjunction with keyword " equipment 1 " searches for follow-up the subject information determining to meet non-" equipment 1 ".In this example, filtration is that non-relation is defined as "Yes" according to the filtration of acquiescence to be non-pass be "Yes" by logic determining unit.Then, when user is determined by operating portion 11, when task is determined, using search meet keyword " equipment 1 " subject information as the subject information determined.Obviously, multiple keyword also can be selected to be used as filter condition.

Filter condition, can arrange according to user and determine (not shown), or also can prestore, the filter condition that generation is set according to user can be recorded in interim storage part 6 or to be recorded in flash memory 9 etc. such as configuration file as use afterwards.

The subject information of Fig. 9 signal, represent task determination portion (control part 10), for based on the subject information as shown in Figure 4 stored in storage medium, according to filter condition " equipment 1 ", determine to meet the subject information of filter condition and the subject information obtained.

The subject indication information according to the subject information acquisition after filtration shown by display interface shown in Figure 10.Obviously, user needs the subject indication information selected to be only limitted to the device type of " equipment 1 ", makes simple to operate, and not easily slips up.

As mentioned above, based on the setting of filter condition, the filtration that user can carry out in advance to reference object, makes selective subject indication information reduce, makes simple to operate.And be associated with selected subject information due to marked image data frame, therefore, be convenient to follow-up searching and batch processing.

Embodiment 3

The device for image of embodiment 3, can suspend dynamically recording, freeze show etc. state under, carry out subject information selection operation.

The control flow of device for image 13 is described see Figure 12, and step is as follows:

Step C01, obtain image data frame, image data frame shoot part 1 being taken acquisition is sent to interim storage part 6;

Or can read the image data frame such as obtained by shoot part 1 shooting immediately in interim storage part 6, and the subject information of specified quantity, carry out Graphics Processing, and show.

In step C02, judge whether the instruction (such as, pressing record key 1) of dynamically recording? as no, then get back to step C01, repeat above-mentioned steps; In this way, then next step;

In step C03, judge whether to suspend instruction? as no, then jump to step C08, carry out dynamically recording process; When user presses Pause key 2, then enter step C04;

Step C04, suspends dynamically recording process, the image data frame that the moment that maintenance response suspends instruction obtains, and row of going forward side by side carries out the image of kept image data frame acquisition and the subject indication information display of specified quantity; User can carry out the selection operation of subject indication information.

In step C05, judge whether the instruction of cancellation? as no, then enter next step; In this way, then step C08 is jumped to;

In step C06, judge whether confirmation operation (for representing marking operation in this example)? in this way, then next step is entered; As no, then return step C04;

In step C07, by marked frame and selected subject information association record; Such as, by the image data frame that interim storage part 6 keeps, the additional information (as subject information etc.) relevant with mark is written in storage medium as in the dynamic video file created in flash memory 9.

In step C08, there is not the image data frame of mark instruction, record frame frequency according to the rules and carry out dynamically recording process; Subject information is not associated in this example;

Step C09, judge whether to terminate, as do not terminated, then return step C01, user repeatedly can carry out the operation marked.

As terminated, then in step C10, by file additional information (as terminated mark etc.) the write dynamic video file of necessity, complete dynamic video file.

Due to when suspending dynamically recording, carrying out the selection of subject information, thus the redundant data amount of recorded image data frame can be reduced; When adding their confirmation, kept image data frame is marked; Thus, user can examine the shooting quality of marker frame and the correctness of selected subject information again, can improve the quality of marker frame; Further, when suspending dynamically recording, display part can be shown as the moment that response suspends instruction, the subject information of the image that the image data frame kept obtains and specified quantity; In addition, in other modes, or the subject information of dynamic image and specified quantity can be also shown as; Or switch to the subject information only showing specified quantity.

The present embodiment also can be deformed into, and carries out the selection of subject information before step C03.

Embodiment 4

Although the present invention is in embodiment 1 for having the device for image 13 of shoot function, but the function of shooting acquisition image data frame is not absolutely necessary for the present invention, and the present invention also can be applicable to the image processor etc. from external reception and process image data frame.Described image processor as computer, personal digital assistant (PDA), with the matching used display unit of device for image etc. of shoot function.The example of embodiment 4 using image processor 100 as image dynamic recording device.

With reference to the block diagram that Figure 13 is the electrical structure of a kind of enforcement of the image status-keeping system that image processor 100 and device for image 101 connect and compose.

Image processor 100 is had communication interface 1, auxiliary storage portion 2, display part 3, RAM4, hard disk 5, operating portion 6 and to be connected with above-mentioned parts by bus and to carry out the overall CPU7 controlled.Image processor 100, based on the control of CPU7, receives by communication interface 1 the image data frame that the device for image 101 that is connected with image processor 100 exports.

Communication interface 1, for receiving the image data frame that device for image 101 exports continuously; Wherein, (the image data frame exported by device for image 101 is sent by relay) the image data frame receiving and sent by relay is comprised; Meanwhile, also can be used as the communication interface that device for image 101 is controlled.At this, communication interface 1 comprises the various wired or wireless communication interfaces on image processor 100, as network interface, USB interface, 1394 interfaces, video interface etc.

Auxiliary storage portion 2, the such as storage medium such as CD-ROM, storage card and relevant interface.

Display part 3 is as liquid crystal display, and display part 3 can also be other displays be connected with image processor 100, and can not have display in the electrical structure of image processor 100 self.

RAM4 carries out the interim buffer storage stored as the image data frame received communication interface 1, and meanwhile, the working storage as CPU7 works, and the data processed are carried out in temporarily storage by CPU7.The program for controlling is stored in hard disk 5, and the various data used in controlling.Operating portion 6, for operating.CPU7 controls the action of the entirety of image processor 100, wherein, CPU7 also performs the function of image processing part, the view data of image is obtained for the process implementing to specify to the image data frame received, the process of regulation, as correction, interpolation, pseudo-coloured silk, synthesis, compression, decompress(ion) etc., carries out being converted to the process being suitable for showing and using, record the data such as use.Wherein, CPU7 according to the different-format of image data frame, a kind of execution mode, such as, when the image data frame received is the image AD data of compression, the process of regulation is carried out decompress(ion) as CPU7 to the image data frame that acquisition unit receives and is carried out corresponding predetermined processing; A kind of execution mode, to predetermined processing corresponding after compressing image AD data decompression, obtains the view data of image, and in addition, the process of regulation is also as the image data frame after decompress(ion) carries out correcting, interpolation etc. specifies various process.Another kind of execution mode, such as, when the image data frame itself received has been the view data of the image of compression, then decompress(ion) obtains the view data of image.Another execution mode, such as, when communication interface 1 receive be the image of simulation time, control the view data by obtaining digital image after relevant A/D convertor circuit AD conversion.

Device for image 101 can be various types of device for filming image, and it is for taking subject, and image output Frame.See the electrical diagram of device for image 101 in Figure 12, be made up of communication interface 10, shoot part 20, flash memory 30, image processing part 40, RAM50, CPU60 etc.Wherein, CPU60 controls the action of the entirety of device for image 101, stores the various data used in control program and each several part control in flash memory 30.Shoot part 20 comprises not shown optics, driver part, image detector, signal pre-processing circuit, obtains image data frame for taking.This image data frame is temporarily stored in RAM50, and after through image processing part 40 (as DSP) through predetermined processing as compression process etc. after obtain image data frame, export through communication interface 10.At this, device for image 101 is for taking and the image data frame exported, and it acts on the shoot part 1 in similar device for image 13.

Figure 14 is the schematic diagram of a kind of enforcement of the image processing system that image processor 100 and device for image 101 connect and compose.The modes such as device for image 101 adopts The Cloud Terrace etc. to be erected at detection vehicle, the network formed via the order wires such as private cable or wired with wireless mode are connected with image processor 100.User is undertaken watching and monitor subject image by image processor 100.Device for image 101, connects and composes the image status-keeping system in execution mode, for taking subject with image processor 100.

The structure removed from device for image 13 beyond shoot part 1 is roughly the same with image processor 100, obviously obtaining image data frame by receiving, being suitable for the present embodiment equally.Because omitted herein the explanation of execution mode.Obviously, image processor 100 can support the use with various device for image such as the various portable device for image with image shooting function.

Embodiment 5

In embodiment 5, as the device for image 13 as shown in Figure 1 for the treatment of multiple image data frame of playback reproducer example, but be also applicable to without image shooting function as personal computer, the image analysing computer devices such as personal digital assistant device.

The example of the display interface of embodiment 4 is described with reference to Figure 15.

Comprise, subject Information Selection hurdle 101, for display and selection subject information;

Played column 105, for showing the image that selected image data frame (or image data frame of mark) etc. obtains;

Play operation hurdle 106, for carrying out and playing relevant operation; Wherein,

Mark broadcasting 1061, for carrying out the broadcasting of marker frame; Comprise the menu items such as not shown time-out, control to play.

Play 1062, for playing; Comprise the menu items such as not shown time-out, control to play.

Advance 1063 frame by frame, for determining forward play frame by frame.

Playback 1064 frame by frame, retreats broadcasting frame by frame for determining.

Progress field mark chi 1065, for showing the scale of selected image data frame, further, can display frame time sequence information, as number of frames etc.;

Progress vernier 1066, for showing the progress of image data frame in play sequence of current display, further, can show the frame time sequence information of the image of current display, as frame number, time etc.

The control flow of the present embodiment is described with reference to Figure 16.

Step D01, selects to need multiple image data frame to be processed; Such as from storage medium as storage card 8 select a dynamic video file;

Step D02, selects subject information, as shown in the subject Information Selection hurdle 101 in Figure 15, and user's selectively actuatable; Selective subject information can be extract to obtain from selected dynamic video file, also can be that the list such as shown in Fig. 4 stored in the storage medium of device for image 13 obtains.

Step D03, the image that the marker frame that display is associated with selected subject information obtains;

When there being multiple marker frame, multiple images can be shown simultaneously, or can show successively based on operation; It is noted that subject information selected by user can as " transformer station 1 " in Figure 15, also can be " transformer station 1, battery limits 1 " and be not limited to select complete subject information such as " transformer station 1 battery limits 1 equipment 1B phase ".

As shown in figure 15, when user have selected " the equipment 1B phase " of transformer station 1 battery limits 1 ownership; Then display control unit, searches the image data frame being associated with " transformer station 1 battery limits 1 equipment 1B phase " from image data frame, the marker frame such as first whether relevantly having searched this subject information;

Such as, when the information of the marker frame of dynamic video file is arranged in the file control information of dynamic video file, then search based in this file control information; Such as, when the information of the marker frame of dynamic video file is arranged in the index file of dynamic video file, then search based in this file;

Then, in played column 105, show the image of the marker frame acquisition being associated with " transformer station 1 battery limits 1 equipment 1B phase ".User can carry out analysis and arrange, and carries out careful analysis; Or select playback frame by frame, before come in carry out play operation frame by frame; In other example, as there is no marker frame, other frame being associated with " transformer station 1 battery limits 1 equipment 1B phase " can be searched, then, can show.

Step D04, judges whether to carry out " broadcasting " or " mark is play ", in this way, then arrives step D05; Display frame frequency plays the image that regulation frame obtains successively according to the rules;

In one example in which, selected dynamic video file, comprise the normal frames and marker frame that are associated with subject information, or also comprise the not associated normal frames having subject information, may be configured with the image data frame only play and be associated with identical subject information with marker frame selected before, contribute to especially checking targetedly.In another example, selected dynamic video file, comprises and is associated with subject information and marker frame, and the not associated normal frames having subject information, at this moment, may be configured with the image data of the front and back frame playing specified quantity.In other example, also can according to selected " mark broadcasting 1061 ", the sequence determined according to the sequence rule play, plays all marker frames;

Does step D06, judge whether to terminate? as no, then getting back to step D02, as have selected subject information, then can arrive next step; User can reselect subject information, repeats follow-up step; In this way, then terminate.

Above-mentioned execution mode, is not limited to selection dynamic video file; Multiple image picture file (each image picture file contains a frame image data frame) can be selected, one or more dynamic video file, an image picture file and one or more dynamic video file.In other example, also can have selected the image file of multiple different times.

The sequence that can determine according to the sequence rule play, carries out above-mentioned broadcasting; The sequence rule of described broadcasting, one or more of such as, chronological order, same dynamic video file etc. whether identical according to subject information special key words is because usually carrying out the sequence obtained that sorts; The rule playing order can be pre-defined.

As shown in Figure 17 (A), assuming that user have selected two image picture files C0, D0, and two dynamic video files A0, B0, between frame A2 in the frame sequence of dynamic video file A0 of the shooting time of image picture file C0 and frame A3; And between B2 and B3 of the shooting time of image picture file D0 in the frame sequence of dynamic video file B0;

The sequence of broadcasting is obtained according to the principle of the frame and chronological order that can insert image picture file in same dynamic video file; Play sequence as shown in Figure 17 (B).

In another example, assuming that C0, D0 are identical with the subject information that the frame A1-frame A4 in dynamic video file A0 associates; The principle that subject information is identical as considered is as priority ordering; The sequence example as shown in Figure 17 (C) can be obtained; Like this when playing, can be convenient to that the history that user carries out captured same subject compares, the lateral comparison etc. of similar subject.

Obviously, even if the shooting time of A0, B0 is overlapping to some extent, the various changes still by above-mentioned arrangement obtain satisfied result of broadcast.Preferably, image picture file can be used as the marker frame in new sequence, and the marker frame namely in new sequence has C0, D0, B4 (marker frame original in B0).

Above-mentioned dynamic video file, image picture file can according to different, even can be taken by the device for filming image that partial design is different and obtain.According to the difference of application, play sequence can have various applicable rule.

Also can be deformed into, based on selected image data frame, according to selected subject information, play the image data frame being associated with subject information.

Also can be deformed into, based on selected image data frame, play all marker frames.

Embodiment 6

Preferably, according to selected image data frame, carry out morphogenesis characters curve, and the position of cue mark framing bit on indicatrix, improve the specific aim of watching analysis further.In the present embodiment, so-called image data frame is for the thermal imagery Frame (thermal-image data frame) of thermal imagery filming apparatus (thermal imaging device) shooting acquisition; But be not limited thereto, the characteristic that can obtain according to the rule analyzed according to various device for image, obtains indicatrix.

The example of the display interface of embodiment 6 is described with reference to Figure 18.

Subject Information Selection hurdle 101, for display and selection subject information;

Indicatrix hurdle 102, for the coordinate system of indicating characteristic curve, the mark 1022 of indicatrix 1021, marker frame, vernier 1023.

The mark 1022 of marker frame, preferably, based on the frame time sequence information of the image data frame marked in described regulation frame (and/or image picture file), in the mark of indicatrix show tags, very directly perceived.

Vernier 1023, regulates for user or arranges the position of vernier; Preferably, field can be controlled and/or played column shows change accordingly, the i.e. characteristic of the image data frame of analytical columns display corresponding to slider position, or the characteristic of the image data frame corresponding to slider position also can be shown near vernier.The image of played column display corresponding to slider position; Corresponding image data frame can be determined according to the frame sequential of slider position.

Field 103, for showing the information relevant with selected image data frame, and/or, the information that the image data frame of display corresponding to vernier 1023 is relevant.Wherein, the relevant information of the image data frame corresponding to vernier 1023 also may be displayed on the miscellaneous stipulations position of display part, preferably, be presented near feature vernier 1023, such as top, is convenient to user and watches, such as, above vernier 1023 shown subject information.

Hurdle 104 is set, comprises

File menu item, for selecting image file to be analyzed from storage medium;

Filter condition menu item, for arranging the filter condition of the image data frame relevant to Characteristi c curve of formation; Can filter selected image file according to the filter condition of regulation, obtain the regulation frame relevant with Characteristi c curve of formation.Described filter condition, can be according to one or more in sampling frame number, sampling interval, image picture file, marker frame, frame additional information or related information, characteristic, as filter condition, filter selected multiple image data frames, obtain regulation frame.

Signature analysis condition menu item, for arranging the signature analysis condition relevant to Characteristi c curve of formation; Such as based on the signature analysis condition S01MAX of set analyzed area S01; One or more signature analysis condition can be set.

Played column 105 and play operation hurdle 106, with Figure 15 roughly the same, eliminate explanation.

Control part 10, as analysis portion, for the signature analysis condition according to regulation, is analyzed the regulation frame in the image data frame selected, is obtained characteristic.Signature analysis condition, such as relevant with analysis analyzed area and analytical model etc., the analyzed area that analysis portion feature based analysis condition determines and analytical model are to carry out analyzing and processing.So-called analyzed area represents specific analyzed area, such as point, line, surface in image data frame, also can be as analyzed area using whole image data frame.The account form such as temperature difference etc. between the maximum temperature in so-called analytical model such as computational analysis region, minimum temperature, mean temperature, different analyzed area.Characteristic such as analyzes the temperature value of acquisition.

Control part 10, as indicatrix generating unit, for the characteristic obtained based on frame time sequence information and the analysis of regulation frame of described regulation frame arrangement, is formed by the indicatrix formed after characteristic point or characteristic point connection in indicatrix coordinate system.Image data frame is with indicatrix and play relevant sequence, can be identical or different.

When being configured with multiple signature analysis condition, can analyzing and obtain the many stack features data corresponding respectively with multiple signature analysis condition; Can be formed in indicatrix coordinate system by many groups with stack features point or the many groups of multiple indicatrixes formed after connecting with stack features point;

Wherein, the ordinate of coordinate system such as represents the scale of characteristic, and abscissa represents frame time sequence information such as frame number, the time etc. of analyzed image data frame.Ordinate character numerical value, abscissa numerical value, threshold values boundary line can be eliminated (when characteristic exceedes threshold line, representing subject in the image data frame of overage may defectiveness) etc. display, even can omit ordinate, the generation of abscissa and display; Obviously also can show.

Control part 10 is as vernier display control unit, for the abscissa of relative characteristic curve, coordinate system, the ordinate of coordinate system at least one of them, corresponding display vernier, wherein, described vernier display control unit, based on the positioning action of vernier, shows the vernier of the position after being positioned at location.To the positioning action of vernier.Such as choose vernier to move by operating portion 9, such as, the operation of playing progress rate vernier, such as input specific feature data etc. are realized.

Control part 10, as information display control unit, shows the relevant data of image data frame corresponding to slider position for making display part.The characteristic that image data frame such as corresponding to slider position is relevant, can frame time sequence information corresponding to slider position, obtains described characteristic, and shows.

Control part 10 is as image display control part, for the image making display part show the image data frame acquisition corresponding to slider position, such as can frame time sequence information corresponding to slider position, determine corresponding image data frame and obtain image, and showing.

Preferably, the position of show tags frame on indicatrix, being not limited to also can in the position of at least one of them show tags frame of the ordinate of the abscissa of indicatrix, coordinate system, coordinate system.

By present embodiment, key frame can be found rapidly, thus be convenient to follow-up broadcasting and browse.

Other embodiments

Above-described embodiment is preferably execution mode, and certainly, the arbitrary product implementing embodiments of the present invention might not need to reach above-described all advantages simultaneously.In addition, exemplify using the application of the subject of power industry as scene in embodiment, the every profession and trade being also useful in Image detection is extensively used.

Because the data volume of image data frame is larger, therefore, for reducing the data volume of the image data frame recorded, further, control part 10 as time-out control part, for responding the operation (as pressing Pause key 2) of regulation, suspend dynamically recording process, and under the state of record time-out, the operation (as again pressed Pause key 2) of response regulation, continues dynamically recording process.Be convenient to management and the process of follow-up dynamic video file.In addition, also can specify the size of dynamic video file further, judge whether the dynamic video file size reaching regulation, in this way, then complete dynamic video file, and create a new dynamic video file, follow-up recorded image data frame recording is in the new dynamic video file created.Obviously, the record frame frequency of regulation is non-essential is fixing, such as preferred mode, device for image 13 also has record frame frequency control part, for not reaching set record frame frequency in the speed of recording processing, automatically carry out the adaptive control of recording frame frequency, or also a nearly step points out user to change record frame frequency.In addition, the record frame frequency of regulation also can adopt the mode of extraction etc. to implement, for example, assuming that shooting obtains the frame frequency of image data frame is 30HZ, when the record frame frequency of regulation is 6 frames/second, the record frame frequency specified can be realized according to the mode extracting a frame in 5 frames.

In addition, the display unit of display part 4 also can be configured to more than one, the display of existing show image, also the display showing subject information is specially had, the display and control of display control unit indication, can be on same display or on different display while display, or in same display unit switching display.

Further, also can be used as with a component parts in the device for image of shoot function or image processor or functional module, also form embodiments of the present invention.Obviously, when a certain parts of image dynamic recording device of the present invention as device for filming image, can display control unit etc. be saved, also form the present invention.

At above-mentioned example, be describe according to certain order of steps, but various sequencing can be had according to different execution modes, be not limited to the processing order described by above-mentioned example.Such as when one or more of control part 10, image processing part 2 etc. is divided into multiple processor, also may there is the parallel processing that part steps is suitable for.Those skilled in the art thought according to the present invention can carry out the change of multiple processing order.

In a preferred embodiment, the unlabelled additional information of image data frame, the additional information of marker frame etc. also can with the frame sequential correlation of corresponding frame, all be stored in interim storage part temporarily, when terminating dynamically recording, in disposable whole write dynamic video file, be convenient to follow-up fast finding.

Dynamically recording is not limited to generate dynamic video file; In one example in which, the each self-generating of continuous recording image data frame can be comprised the image picture file of an image data frame and relevant supplementary information, and leaving in specific file, the extension name of the file that marker frame wherein generates is different from other frames.

Aspect of the present invention can also by stay alone and executive logging program on the storage means perform the system or equipment of the function of above-described embodiment computer (or device of such as CPU, MPU etc.) and by its step by the computer of system or equipment by such as to read and executive logging program on the storage means performs the function of above-described embodiment and the method for intellectual realizes.For this purpose, such as via network or from as in various types of recording mediums (such as, computer-readable medium) of storage device, program is provided to computer.

The invention provides a kind of computer program, computer program form digital signal record in computer-readable recording medium, such as, in hard disk, memory etc.This program performs following steps after running:

Obtaining step, for obtaining image data frame continuously;

Select step, for selecting subject information;

Recording step, for the instruction of response dynamics record, according to selected subject information, by information information-related for selected subject, with continuous recording image frame associated record; Described image frame is obtained image data frame and/or the data that obtain after predetermined processing based on obtained image data frame;

Markers step, for sending mark instruction;

Described recording step, response flag indicates, and marked image frame and unlabelled image frame are carried out record in the mode that can mutually distinguish.

Embodiments of the present invention also provide a kind of readable storage medium storing program for executing, and it stores the computer program being used for electronic data interchange, wherein, and described meter

Calculation machine program makes the computer in device for image perform following steps:

Shooting step, obtains image data frame for taking continuously;

Select step, for selecting subject information;

Operating procedure, carries out marking operation for user;

Although the functional block that can be realized in accompanying drawing by hardware, software or its combination, does not need to arrange the structure carrying out practical function block with man-to-man corresponded manner usually; The block of multiple function such as can be realized by a software or hardware module.Or the block of a function is also realized by multiple software or hardware cell.In addition, process and the controlling functions of the part or all of parts in embodiments of the present invention also can be realized with special circuit or general processor or programmable FPGA.

The above-mentioned described embodiment being only invention, variously exemplify explanation and essence of an invention Composition of contents is not limited, those skilled in the art can carry out other modifications and variations after having read specification to embodiment, and does not deviate from essence of an invention and scope.Can carry out other modifications and variations to disclosed embodiment when not departing from thought of the present invention, these amendments be included in right all should as a part of the present invention.

Claims

1. image dynamic recording device, comprising:

Shoot part, obtains image data frame for taking continuously;

Selection portion, for selecting subject information;

Operating portion, carries out marking operation for user;

2. image dynamic recording device, comprising:

Shoot part, obtains image data frame for taking continuously;

Selection portion, for selecting subject information;

Operating portion, carries out marking operation for user;

3. image dynamic recording device, comprising:

Acquisition unit, for obtaining image data frame continuously;

Selection portion, for selecting subject information;

Labeling section, for sending mark instruction;

4. image dynamic recording device, comprising:

Acquisition unit, for obtaining image data frame continuously;

Selection portion, for selecting subject information;

Labeling section, for sending mark instruction;

Described recording unit, response flag indicates, and by information information-related for the subject selected by marked image frame and selection portion, carries out associated record.

5. the image dynamic recording device as described in claim 1-4 any one, is characterized in that, described recording unit records the continuous recording image frame of frame frequency according to the rules.

6. the image dynamic recording device as described in claim 1-4 any one, has

Display control unit, for the multiple subject information stored based on storage medium, makes the subject indication information of display specified quantity; Selection portion, for responding the selection operation of user, selects subject information.

7. the image dynamic recording device according to claim 1-4 any one, is characterized in that, marked image frame and unlabelled image frame can be recorded in same dynamic video file by described recording unit.

8. the image dynamic recording device as described in claim 1-4 any one, is characterized in that,

Described recording unit, suspending instruction for responding, suspending dynamically recording process;

Retentive control portion, keeps the image frame that the moment of time-out instruction is corresponding;

Described recording unit, response flag indicates, and described image frame can be marked.

9. the image dynamic recording device as described in claim 1-4 any one, it is one or more that described subject information at least embodies in the place relevant with subject, type, title, numbering.

10. the image dynamic recording device as described in claim 1-4 any one, unlabelled image frame is associated with and marked image frame difference subject information structure.

11. image dynamic recording devices as described in claim 1-4 any one, described image dynamic recording device can be one of them device in visible ray filming apparatus, thermal imaging device, ultraviolet filming apparatus, laser image forming apparatus; Or include the device of the shoot function that more than one said apparatus is formed simultaneously.

12. image dynamic recording devices as described in claim 1-4 any one, is characterized in that, the mode that can mutually distinguish can be one or more as under type:

1) file format is different; 2) additional information is different; 3) processing mode is different; 4) corresponding index information or management information difference; 5) region stored is different; 6) filename or file extension difference; 7) storage area of additional information is different.

13. image dynamic recording devices according to claim 1-4 any one, it is characterized in that, marked image frame is recorded as static video file by described recording unit.

14. playback reproducers, comprising:

Image selection portion, for selecting multiple image data frame;

Selection portion, for selecting subject information;

15. playback reproducers, comprising:

Image capturing portion, for obtaining image data frame;

Selection portion, for selecting subject information;

16. playback reproducers as described in claim 14,15, is characterized in that having

Marker frame selection portion, for selected marker frame;

Dynamic playback step, can according to selected marker frame, and frame frequency plays the image that the image data frame relevant with this marker frame obtains according to the rules.

17. playback reproducers as claimed in claim 14, is characterized in that having

Indicatrix display control unit, for the frame sequential based on the regulation frame in selected image data frame, and based on the characteristic that the analysis of regulation frame obtains, is formed by the indicatrix formed after characteristic point or characteristic point connection; And based on the frame time sequence information of the marker frame in described regulation frame in frame sequential arrayed feature curvilinear coordinate system and/or characteristic, the position of cue mark frame in indicatrix coordinate system;

Described marker frame selection portion, by the selection to described marker frame position or mark, carrys out selected marker frame.

18. playback reproducers as claimed in claim 17, is characterized in that,

The described image data frame relevant with marker frame, at least comprises the part or all of same keyword being associated with subject information with image data frame.

19. image dynamic recording methods, comprising:

Shooting step, obtains image data frame for taking continuously;

Select step, for selecting subject information;

Operating procedure, carries out marking operation for user;

20. image dynamic recording methods, comprising:

Shooting step, obtains image data frame for taking continuously;

Select step, for selecting subject information;

Operating procedure, carries out marking operation for user;

Described recording step, the mark instruction that operation response produces, by information information-related with the subject selected selected by step for marked image frame, carries out associated record.

21. image dynamic recording methods, comprising:

Obtaining step, for obtaining image data frame continuously;

Select step, for selecting subject information;

Markers step, for sending mark instruction;

22. image dynamic recording methods, comprising:

Obtaining step, for obtaining image data frame continuously;

Select step, for selecting subject information;

Markers step, for sending mark instruction;

23. image dynamic recording methods according to claim 19-22 any one, it is characterized in that, marked image frame and unlabelled image frame can be recorded in same dynamic video file by described recording step.

24. back methods, comprising:

Step selected by image, for selecting multiple image data frame;

Select step, for selecting subject information;

25. back methods, comprising:

Image capturing step, for obtaining image data frame;

Select step, for selecting subject information;

Replay procedure, for the image that the image data frame that frame frequency is play and subject is information-related according to the rules obtains.

26. back methods as described in claim 24,25, is characterized in that having

Marker frame selects step, for selected marker frame;