CN100515036C - Intelligent image process closed circuit TV camera device and its operation method - Google Patents

Intelligent image process closed circuit TV camera device and its operation method Download PDF

Info

Publication number
CN100515036C
CN100515036C CNB2004100855720A CN200410085572A CN100515036C CN 100515036 C CN100515036 C CN 100515036C CN B2004100855720 A CNB2004100855720 A CN B2004100855720A CN 200410085572 A CN200410085572 A CN 200410085572A CN 100515036 C CN100515036 C CN 100515036C
Authority
CN
China
Prior art keywords
image
camera
mobile
picture
closed circuit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CNB2004100855720A
Other languages
Chinese (zh)
Other versions
CN1758714A (en
Inventor
沈联杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yiqiang Science & Technology Co Ltd
Service and Quality Tech Co Ltd
Original Assignee
Yiqiang Science & Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yiqiang Science & Technology Co Ltd filed Critical Yiqiang Science & Technology Co Ltd
Priority to CNB2004100855720A priority Critical patent/CN100515036C/en
Publication of CN1758714A publication Critical patent/CN1758714A/en
Application granted granted Critical
Publication of CN100515036C publication Critical patent/CN100515036C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Studio Devices (AREA)

Abstract

A video camera device of closed circuit TV is featured as enabling video camera itself to carry out digital image process, compression, storage and enlargement of shot image according to digital image shooting component in it and reviving digital image to be analog or digital electronic signal form for transmitting or playing back instantly or moment later, enabling itself to carry out mobile image analysis and mobile image track for shot image and enabling to use itself image processing ability to carry out optical or digital image enlargement on tracked image for achieving purpose of image monitor and image identification.

Description

Intelligent image process closed circuit TV camera device and object tracking method thereof
Technical field
The present invention relates to a kind of video camera, himself can carry out Digital Image Processing and reach image monitoring, mobile object and detect the purpose of following the trail of automatically with clear identification to the image that is absorbed.
Background technology
The Close Circuit Television (CCTV) supervisory control system is an important component part in the safety technological guard system, general implementation is in the public place, dwelling house antitheft with important events on, be a kind of for image recording, handle and the integrated system that monitors, all situations that remote control camera by wherein and peripheral auxiliary equipment direct viewing are monitored the place, simultaneously, TV monitor system can also with other safety technological guard system cooperations such as various guard against theft and alarm systems, make its strick precaution ability more powerful, the hidden danger of discovery accident in time, as find criminal offence, tamper-proof in advance, minimizing accident etc.
Closed-circuit television system can people can't Direct observation occasion, reflect the picture that is monitored controlling object truly in good time, this has become a kind of effective adviser tool that people monitor in modern management, system by way of closed-circuit television, only need a people just can observe many zones in control centre's operation, even the unique function in remote zone, be illustrated in figure 1 as an embodiment under the known technology.
Known closed-circuit TV camera 15a as shown in Figure 1,15b, 15c etc. can be connected with long-range supervisory control system by wireless or wired mode, as long-range monitor 11 and video recording system 13.In the known technology, with closed-circuit TV camera fixing or regularly rotating manner with the image of being shot with video-corder, comprise audio files, reach remote monitoring center with analog form, and audiovisual materials can be from the video camera 15a of diverse location, 15b, 15c, the personnel of Surveillance center can be beneficial to watch supervision by monitor 11 divided frames, use again video recording system 13 with picture record on shadow bands or various medium.
Also can be by image segmentation system the picture segmentation of a monitor showing 4 images simultaneously to 16 video cameras that do not wait, only need a people just can monitor the field condition in a plurality of places simultaneously.
The monitoring picture of cutting apart that video recording system 13 is recorded in the known technology is shared by a plurality of pictures because of resolution, can not clearly react subject, thereby have a strong impact on afterwards parsing to incident, and video camera is taken in fixing mode of rotating mostly, leave the dead angle in many shooting times and space, can not definitely grasp the emphasis of event, and the image of being play in the monitor also can not be informed the on-the-spot special circumstances of supervision personnel automatically.
See also described automatic tracking prison formula device Taiwan patent TW421394 number, tracing system framework as shown in Figure 2, wherein central processing unit 20 connects a plurality of peripheral devices, takes the default module 21 of isotype as responsible fix/following/scan-type; Connect antennas 22 by a wireless image-sound transmitter module 23, with the transmitting/receiving wireless signal: connect a video camera 27 by camera setting module 24, and by connecting turning to of servo motor 26 control video cameras 27; Further also be connected with two groups of infrared detection assemblies 25 ', 25 ", central processing unit 20 meetings are moved according to two infrared detection component detection objects, move with camera setting module 24 control video cameras 27 by servo motor 26 and take.
This prior art detects object with the complementation of two infrared detection assemblies merely, only does tracking at the image that is positioned at picture central authorities, can not effectively judge at the behavior of object, even can not effectively point out supervision personnel shadow of doubt.
The use of CCTV video camera has considerable time, but at present the function of CCTV video camera only limit to transducer see through view data that camera lens obtains in addition the simple treatment conversion master control set that becomes TV signals such as the NTSC of simulation or PAL to export the rear end to record, and on TV, supervise the image that photographs.General CCTV surveillance causes following shortcoming based on the consideration of cost and system complexity:
1. every CCTV video camera all has certain scope that supervises, and causes that the intrusion object that photographs is less than normal to be difficult for identification;
Simultaneously the video camera of some also can see through multiplexer integratedly image be presented on same monitor TV (for example 16 cut apart or 9 cut apart), cause the speed of 30 full screens of every video camera per second of script to be recorded, very likely miss key picture through the picture of only surplusing 2~3 1/16 behind the multiplexer;
3. add analog signals with the characteristic that transmission range decays, it is many to cause receiving noise, image blurring.
The technology of digital picture is at a tremendous pace in recent years, shortcoming at above-mentioned CCTV video camera, the present invention proposes digital image processing techniques are applied in the device of CCTV video camera, can effectively solve the original problem of CCTV, simultaneously with than image processing image analysis technology further, reach CCTV video camera self the mobile object that can't accomplish detect tracking function automatically.
Grasp limited in one's ability to improve the disclosed surveillance camera of prior art to the action of object, or be subject to the deficiency of video recording system and influence afterwards the purpose of resolving, self promptly disposes the module with Digital Image Processing, compression, storage and amplifying power the video camera that the present invention mentioned, the electric signal form that is reduced into analog or digital immediately or after a while transmits or playback, also can carry out mobile graphical analysis and mobile picture charge pattern, to reach the purpose of effective image monitoring and clear identification at the image that is absorbed.
Summary of the invention
The present invention relates to a kind of intelligent image process closed circuit TV (CCTV) camera system and method for operation, this video camera self comprises the function that the image that absorbs is carried out Digital Image Processing, compression, storage and amplification, and transmit or playback in the electric signal form that is reduced into analog or digital immediately or after a while, can also carry out mobile graphical analysis and mobile picture charge pattern at the image that is absorbed, reach image with the image-capable that carries and amplify the purpose that monitors with clear identification.
The invention provides a kind of intelligent image process closed circuit TV camera device, self comprise that the image to picked-up carries out the Digital Image Processing ability, and can carry out mobile graphical analysis and mobile picture charge pattern at the image that is absorbed, just can reach the purpose of image monitoring and clear identification with the function that carries, this device includes a highly integrated ultra-large type image integrated circuit (IC) system single-chip, wherein include at least: an imageing sensor processing unit, externally connect an imageing sensor, control this imageing sensor and make it can see through camera lens reception optical imagery to adjust focusing, exposure also converts digital signal to; One color image processing unit is used for receiving the data image signal of imageing sensor processing unit, carries out processing such as chromatography, Automatic white balance, sharp keenization, color space conversion to obtain better picture quality; One moves graphical analysis and tracing unit, be used for receiving the digital signal of color image processing unit, continuous number image to this device picked-up carries out the computing contrast, detect the orientation and the speed that move and move of object, and see through external control unit controls camera lens and do level, vertical moving, and optics or numeral amplification, to obtain intrusion object picture the most clearly; One image compression decompression unit is used for to the static state after mobile graphical analysis and the tracing unit image processing or dynamic image compresses and decompression, so that store or playback; One CPU is used for being received from the picture signal of image compression decompression unit, and connects each unit of this device, and each functional module in the control chip is coordinated the whole system operation; One medium control unit is used for being received from the picture signal of CPU, the writing and reading on all kinds of mediums of control chart image signal, scratch-pad memory control and the control of off-line image medium when comprising on-line as system operation; One external control unit, be used for exporting or accepting the control signal of CPU, and link up with external module or system, by controls lens finish focusing, amplifications, vertically and the operation that moves horizontally or accept master station carry out actions such as playback or manual controls lens; One analog picture signal coffret electrically connects this CPU, becomes analog format and externally output with converted image; And a data image signal coffret, electrically connect this CPU, become various digital transmission form and externally output with converted image.
The present invention also provides a kind of object tracking method of intelligent image process closed circuit TV camera, comprising key steps such as the detection that a mobile object is arranged, tracking and video camera controls, this method step includes: the mobile behavior of estimating this object, the audio-visual temporary function that carries by this intelligent image process closed circuit TV camera is concerned by a plurality of front and back picture frame of register map picture wherein and to estimate this movement of objects behavior; Set up the motion-vector of this object, set up the motion-vector of this object according to a plurality of front and back picture frame relation; Mobile behavior by this this object of motion-vector compensate for estimated; Set up the moving Object Detection image of this object, with the moving range that is used for defining this object with arround the relation etc. of things; Analyze the relation of this mobile object and its affiliated partner, reach by the kenel calculation method; Set up trace data, set up by the analysis of this mobile object and its affiliated partner, and this trace data of Data Update that produces by this analytical method at any time; And the Tracing Control of carrying out this intelligent image process closed circuit TV camera, control the shooting and the image processing operations of this closed-circuit TV camera with a plurality of control signals.
This intelligent image process closed circuit TV camera device contains a highly integrated ultra-large type image integrated circuit (IC) system single-chip, comprising a plurality of formants are arranged: the imageing sensor processing unit---control is also adjusted the signal that imageing sensor is exported, color image processing unit---receive the signal of imageing sensor output, the converted image form also carries out the image quality adjustment, mobile graphical analysis and tracing unit---open image before and after analyzing and find out tracking object motion-vector, the image compression decompression unit---to static state or dynamic image compresses and the action that decompresses, so that store or playback, CPU---coordinate the operation of control whole system, the writing and reading on all kinds of mediums of medium control unit---control chart image signal, the external control unit---export or accept control signal and external module or system and link up, controls lens or accept the operation of master station for example, analog picture signal coffret---converted image becomes analog format and externally output, for example NTSC or PAL signal, data image signal coffret---converted image becomes various digital transmission form and externally exports, for example USB interface or wire and wireless network interface.
The method of operation step of this intelligent image process closed circuit TV camera includes: take step; Image processing; Image comparison; Automatically follow the trail of; The image amplification procedure; The compression storing step; The image reproducing step; And transfer step.
Description of drawings
Fig. 1 is the closed-circuit television system schematic diagram of known technology;
Fig. 2 is a known technology closed-circuit television tracing system configuration diagram;
Fig. 3 is an intelligent image process closed circuit TV system schematic of the present invention;
Fig. 4 is an intelligent image process closed circuit TV camera configuration diagram of the present invention;
Fig. 5 is an intelligent image process closed circuit TV camera operational flowchart of the present invention;
Fig. 6 is the flow chart of object tracking embodiment of the present invention.
Description of reference numerals:
11 monitors
13 video recording systems
15a, 15b, 15c video camera
16 circuit
20 central processing units
21 default modules
22 antennas
23 wireless image-sound transmitter modules
24 camera setting modules
26 servo motors
25 ', 25 " infrared detection unit
27 video cameras
31 monitors
32 audio-visual register systems
33 transmission mediums
37 objects
40 remote monitoring centers
41 imageing sensors
43 camera lenses
45 mediums
47 long-range master stations
401 imageing sensor processing units
402 color image processing unit
403 move graphical analysis and tracing unit
404 image compression decompression units
405 medium control units
406 CPU
407 external control unit
409 analog picture signal coffrets
411 data image signal coffrets
400CCTV camera control system single-chip
Embodiment
The present invention relates to a kind of intelligent image process closed circuit TV (CCTV) camera system and method for operation, one height function integrated digital image control chip (SOC) is set in the CCTV video camera, make video camera self comprise that the image to picked-up carries out the Digital Image Processing ability, and can carry out mobile graphical analysis and mobile picture charge pattern at the image that is absorbed and amplify, just can reach the purpose of image monitoring and clear identification to carry function.
See also an embodiment of the present invention's closed-circuit television camera chain shown in Figure 3.Closed-circuit television system shown in the figure is to connect video camera and Long-Range Surveillance System by man-to-man connected mode, to reach functions such as telemonitoring, control, video recording storage and playback, CCTV video camera of the present invention connects long-range monitor 31 through the transmission medium 33 of the wired or wireless section of inspiring confidence in, can digital form except that video camera itself self record media store video-audio data, also can be by an audio-visual register system 32 with numeral or analog form storage.
And object of the present invention moves automatic detection tracking function, be to differentiate with the difference of opening image before and after analyzing, in shooting process, video camera except that with image data transmission to Surveillance center, self also compares at last number word image of having stored and captured image instantly at any time, if object is mobile to some extent, walks about or other change as the object in the icon 37, promptly do to follow the trail of to amplify to wait at this object and take action, personnel do effective processing with the prompting supervision.More because of it transmits and storage in the digital picture mode, the problem that can't cause the image resolution ratio variation because of the interference or the picture segmentation pattern of shooting with video-corder of analogue transmission process takes place.
CCTV video camera of the present invention self can be for the image that is absorbed, carry out Digital Image Processing/compression/storage/amplification, and can transmit or playback in the electric signal form that is reduced into analog or digital immediately or after a while, wherein the Digital Image Processing in the video camera is to obtain original pixel or video-audio data as digital pictures such as CCD or cmos sensor picked-up assembly, through automatic exposure (AutoExposure), Automatic white balance (Auto White Balance), chromatography (Interpolation), color space conversion (RGB to YCbCr), image sharpening processing such as (Sharpen), obtaining the numerical data of better quality, and provide digital compression and storage.
And so-called automatic exposure (Auto Exposurr) is meant under different environment light source brightness, video camera must be adjusted the time of exposure automatically, whether assessment brightness is suitable, can adjust the average brightness of each pixel of whole image, actual enforcement being standard between falling within 115 to 125, but be not limited thereto, thereby make and under any environment light source brightness, all can obtain the preferable image quality.Each function declaration is as follows:
Automatic white balance (Auto White Balance) is to be human eye being seen picture under the light source of different tones, can focus the source tone automatically compensates, make same object under Different Light, see much at one color, but CCD or cmos sensor can't compensate automatically, therefore must lean on the computing of Automatic white balance to compensate, make the image that photographs the colour cast situation of some colors can not occur being partial to, and demonstrate the image of seeing as human eye.
Chromatography (Interpolation) is that digital picture picked-up assembly sees through the picture signal that each pixel absorbs in the brilliant unit of many shootings, but be not that to include the color three primary colors of each pixel (red in the picture signal that the brilliant unit of each shooting is absorbed, green, blue, RGB), but allow the brilliant unit of indivedual shootings write down solid color with filter, arrange with the mode difference interval color separation of level and vertical arrangement again, different digital image capture assembly may have different arrangement modes, when digital picture picked-up assembly is obtained preliminary image, two other primary colors of each pixel is calculated in the computing that we need do chromatography, so just can obtain complete digital picture.
And color space conversion (RGB to YCbCr) is meant that the every bit that will represent with RGB after the chromatography makes into to represent with YCbCr through the computing conversion, wherein Y represents brightness, CbCr represents chroma, because human eyeball changes far beyond the chroma sensitivity for brightness, through giving up part chroma data after the conversion, reduce data volume; Subsequent image processing such as sharpening, softening and compression etc. mainly are to do computing at brightness data in addition.
Wherein so-called image sharpening (Sharpen) is to have image blurring situation after digital picture is handled through chromatography, and sharpening is handled and seen through computing, strengthens object edge line bar, to improve the whole sharpness of image.
Digital image compression is divided into single image and consecutive image, the single image compression will be from the digital picture of video camera, utilize human varying sensitivity for color, image detail, see through various translation operation, reservation is than sensitive data, give up heterochromia and image detail that human eye can't be differentiated, to reach the purpose of amount of compressed data; The view data that aforementioned processing is crossed, come the presentation video data in the statistical coding mode, data volume further can be reduced again, compression for consecutive image, except aforementioned compression method to single image, relatively the variation of image is opened in front and back, calculates regional amount of movement, replace coded image itself with the coding amount of movement, more can significantly improve compression ratio.
After the image storage is meant that image is through image processing and compression, result's digital data conversion is become corresponding form, leave in the various digital memeory devices, these devices comprise DUM (SDRAM, DDRAM), flash memory (Flash Memory), storage card (Memory Card), Winchester disk drive (HardDisk Drive) and optical data disk (CD-R/RW, DVD) etc.
The image amplification is meant at obtained digital picture, increases whole or local resolution, in order to the identification for the target object image; Improve the point that resolution increased, by get by its peripheral reference point computing, add original image in the interpolated point mode, through enlarged image, in addition sharpening (Sharpen) or softening (Smooth) are handled again, with the raising image quality.
System architecture of the present invention is shown in the most preferred embodiment of Fig. 4.
Shown in the figure CCTV camera control unit 400 annexation peripheral with it, wherein said is each functional module of CCTV video camera of the present invention self, the video camera that replaces simple camera function in the prior art, and because of each functional module is a ultra-large type image integrated circuit (IC) system single-chip (SOC) integrally, as the disclosed CCTV camera control unit 400 of this figure, make intelligent image process closed circuit TV camera of the present invention promptly reach various image processing by self, the equipment of limited Surveillance center more can not kept audio-visual image quality.
Figure 4 shows that the system architecture diagram of CCTV video camera, primary clustering is a ultra-large type image integrated circuit (IC) system single-chip (SOC), wherein comprises several functional modules, and the discrete function module is controlled by central processing unit;
1. the imageing sensor processing unit 401---external connection layout image-position sensor 41, and the control transducer is focused, is exposed to adjust through camera lens 43 reception optical imagerys and converts digital signal to;
2. color image processing unit 402---and the data image signal of acceptance pattern image-position sensor processing unit 401, carry out processing such as chromatography, Automatic white balance, sharp keenization, color space conversion to obtain better image quality;
3. mobile graphical analysis and tracing unit 403---receive the digital signal of color image processing unit 402, and the continuous number image of this device picked-up carried out the computing contrast, detect the orientation and velocity that moves and move of object, and see through external control unit 407 controls lens 43 and do level, vertical moving, and optics or numeral amplification, to obtain intrusion object picture the most clearly.Preset ' mobile graphical analysis and mobile picture charge pattern ' algorithm on this unit, can be divided into three modules (is not shown in the circle in this embodiment, usually know the knowledgeable but still have in the technical field under can making, can implement according to this): change detection module (change detection), moving tracing module (Motion tracking) and video camera control module (camera control).Change detection module and be responsible for moving Object Detection; Tracing module is responsible for following the trail of the mobile object of preferential judgement; The video camera control module is responsible for controlling video camera level, vertical moving with the object that follows the trail of the objective, and enlarged image is to being fit to size.Details are as follows for each functions of modules:
Wherein changing detection module is can rotate under the prerequisite at video camera, owing to all objects in the image of photography all can cause whole image all in mobile illusion because of moving of video camera, thereby adopt the algorithm that stems from motion compensation (motion compensation) to detect to reach in time and to change reliably, at first every image is cut into many little mobile blocks, open image other block at front and back and carry out the comparison of image difference to obtain the motion-vector of individual block.Calculating the motion-vector of each block of cells (Motion vector) afterwards, we take the middle figure place of these regional motion-vectors is whole motion-vector.By whole motion-vector entire image is made motion compensation, we can obtain the vectorial mobile block diagram of whole mobile object.
The moving tracing module is to find out the mobile object of preferential judgement in numerous mobile blocks, at first will change the vectorial mobile block diagram that detection module obtains and connect into several moving areas, owing to the difference that belongs to same mobile object moves heavy part far away can be arranged all each other partly, therefore to be combined into be a big mobile part to our part that can reasonably these be returned to, can form one at this movable part and follow the trail of window, the mobile object information such as the motion-vector that utilize this window to provide, the follow the trail of the objective position of image in the past and size etc. assist to continue to follow the trail of this object.
In case then after the target object locking, according to the position of target object, control module level or vertical moving video camera make that target object can be in the center of display module to the video camera control module.This module has artificial intelligence, can set by the user, size, keypoint part or other setting according to mobile object, this module will start optics or digital enlarging function automatically through external control unit 407, with mobile object integral body or emphasis (as head) amplification, to obtain more picture rich in detail, do further identification.
1. the image compression decompression unit 404---with the static state after mobile graphical analysis and 403 pairs of image processing of tracing unit or dynamic image compresses and the action that decompresses, so that store or playback;
2. CPU 406---and connect this camera control unit 400 each unit, each functional module in the control chip is coordinated the whole system operation;
3. the medium control unit 405---and medium control unit 405 connects medium 45, CPU 406 writes and reads on various mediums by the control chart image signal, in on-line scratch-pad memory control or control of off-line image medium during as system operation;
4. the external control unit 407---export or accept the control signal of CPU 406, and link up with external module or system, for example controls lens 43 finish focusing, amplifications, vertically and the operation that moves horizontally or accept long-range master station 47 carry out actions such as playback or manual controls lens;
5. the analog picture signal coffret 409---and electrically connect CPU 406, the conversion of signals image is become analog format and externally exports long-range master station 47, for example NTSC or PAL signal to;
6. the data image signal coffret 411---and electrically connect CPU 406, become various digital transmission form and externally export long-range master station 47, for example USB interface or wire and wireless network interface by converted image;
Fig. 5 is the embodiment operational flowchart of intelligent image process closed circuit TV camera of the present invention.
System begins:
1. shooting step---but self takes according to the program of setting, or the fixed point wait, or obtains digital picture (step S501) with wireless or wired means remote control camera through the imageing sensor processing unit through the analog or digital mode by long-range;
2. image processing step---the image that will shoot with video-corder is done to handle (step S503) as chromatography, white balance, sharpening, sharp keenization or elimination noise etc. by color image processing unit;
3. image comparison step---carry out image comparison by mobile graphical analysis in the video camera and tracing unit, make difference with image that is stored in scratch-pad memory and the image of shooting with video-corder instantly and differentiate (step S505);
4. tracing step---find that after contrast object has mobile state, then video camera starts (auto-tracking) pattern of following the trail of automatically, and moving lens is done actions (step S507) such as focusing, shooting at mobile image automatically;
5. image amplification procedure---tracked mobile object is made numeral or optics amplifies (step S509);
6. compression storing step---the image of being shot with video-corder is stored to medium (step S511) with the digital form compression;
7. image reproducing step---the digital picture that is stored on the medium is decompressed, be converted into the analog or digital signal format (step S513) that can play immediately;
8. the image transfer step---digital picture is sent to long-range master station with wireless or wired means in real time or after a while, can does the action of amplification, playback picture at the monitor of long-range master station, the monitor staff makes related measure (step S515) with prompting
This step comes to an end, and wherein these a plurality of steps are not restriction with above-mentioned sequence of steps.
The mobile graphical analysis and the tracing unit that are provided with in the video camera body of the present invention are for this closed-circuit TV camera is analyzed for the image that is absorbed self; And mobile picture charge pattern device, for this closed-circuit TV camera self carries out picture charge pattern for the image that is absorbed.
The described flow process of Fig. 6 is an object tracking most preferred embodiment of the present invention, and comprising three key steps such as there are objects moving detection, object tracking and video camera controls, wherein be described below step: this tracing step embodiment begins;
Step S601: estimate the mobile behavior of this object, the audio-visual temporary function that carries by closed-circuit TV camera of the present invention is estimated the movement of objects behavior by front and back picture frame (frame) relation of register map picture wherein;
Step S603: set up the motion-vector of this object, set up movement of objects vector (motion vector) with above-mentioned front and back picture frame, as setting up wherein motion-vector according to the correlation of n picture frame and n-1 picture frame;
Step S605:, promptly give its estimated value and do compensation (motion compensation) with the front and back picture frame according to this motion-vector compensate for estimated movement of objects behavior;
Step S607: set up a moving Object Detection image (Movingcomponent Map by above mobile estimation, IWCM), at any time upgrade with the moving Object Detection view data that is stored to a medium, and set up a relevance image by the motion-vector of object relation, the moving range that defines mobile image as image boundary (edge) with mobile image with arround the relation etc. of things;
Step S609: carry out the renewal of this moving Object Detection image (MCM) with its motion-vector (621) and the MCM data (623) that are stored to medium before at any time;
Step S611: carry out a kenel calculation method (Morphological Method) by above-mentioned moving Object Detection image;
Step S613: analyze the relation of this mobile object and its affiliated partner, carry out the analysis of mobile object and its affiliated partner according to the kenel calculation method of above-mentioned steps;
Step S615: set up a trace data (625) by the analysis of mobile object and its affiliated partner, and, follow the trail of purpose to reach mobile object of the present invention at any time to analyze this trace data of Data Update (625):
Step S617:, produce the shooting and the image processing behavior of video camera Tracing Control signal controlling closed-circuit TV camera of the present invention when the tracking of carrying out mobile object of the present invention.
Obtain in the process of image from imageing sensor at this device, in order to obtain the better image quality, will carry out a series of image processing immediately, the purpose of these processing be with signal digitalized, obtain correct brightness, avoid under different tone light source color error ratio, make image more clear and obtain higher compression ratio.After image processing is finished, except the information of conversion output and simulation CCTV compatibility, these numerical datas can be seen through the mode of compression simultaneously, data volume is reduced, be stored in then with digital storage media that system is connected on.The numerical data of these storages can directly be read by medium, also can convert analog signal immediately to after device receives the order of main control end and send back main control end.
This device need not come inspected object to invade by any external equipment or device, pure according to captured image in addition operational analysis scout the invasion of learning object, and judge the moving direction and the speed of intrusion object according to this, control this device moving lens, intrusion object is placed all the time within the scope of photographic images.Comply with the camera lens of being installed simultaneously and have or not optical zoom function, this device will select to adopt the optical zoom or the mode of numeral amplification automatically, make intrusion object whole or monitor that the emphasis place takes the photographic images scope as far as possible, to obtain the distinct image of intrusion object.
In sum, a kind of intelligent image process closed circuit TV camera device and method of operation that the present invention proposes, himself comprise that the image to picked-up carries out the Digital Image Processing ability, and can carry out mobile graphical analysis and mobile picture charge pattern at the image that is absorbed, just can reach the purpose of image monitoring and clear identification to carry function, be rare invention article in fact, has the practicality on the industry, novelty and creativeness, meet the application for a patent for invention important document fully, so file an application in accordance with the law, would like to ask detailed survey and authorize this case patent, to ensure inventor's rights and interests.
But the above only is a preferable possible embodiments of the present invention, rather than limits claim of the present invention with this, so the equivalent structure that every utilization specification of the present invention and diagramatic content have been done changes, all is contained in the scope of the present invention.

Claims (7)

1. intelligent image process closed circuit TV camera device, self comprise that the image to picked-up carries out the Digital Image Processing ability, and can carry out mobile graphical analysis and mobile picture charge pattern at the image that is absorbed, just can reach the purpose of image monitoring and clear identification with the function that carries, this device includes a highly integrated ultra-large type image integrated circuit (IC) system single-chip, wherein includes at least:
One imageing sensor processing unit externally connects an imageing sensor, controls this imageing sensor and makes it can see through camera lens reception optical imagery to adjust focusing, expose and to convert digital signal to;
One color image processing unit is used for receiving the data image signal of imageing sensor processing unit, carries out processing such as chromatography, Automatic white balance, sharp keenization, color space conversion to obtain better picture quality;
One moves graphical analysis and tracing unit, be used for receiving the digital signal of color image processing unit, continuous number image to this device picked-up carries out the computing contrast, detect the orientation and the speed that move and move of object, and see through external control unit controls camera lens and do level, vertical moving, and optics or numeral amplification, to obtain intrusion object picture the most clearly;
One image compression decompression unit is used for to the static state after mobile graphical analysis and the tracing unit image processing or dynamic image compresses and decompression, so that store or playback;
One CPU is used for being received from the picture signal of image compression decompression unit, and connects each unit of this device, and each functional module in the control chip is coordinated the whole system operation;
One medium control unit is used for being received from the picture signal of CPU, the writing and reading on all kinds of mediums of control chart image signal, scratch-pad memory control and the control of off-line image medium when comprising on-line as system operation;
One external control unit, be used for exporting or accepting the control signal of CPU, and link up with external module or system, by controls lens finish focusing, amplifications, vertically and the operation that moves horizontally or accept master station carry out actions such as playback or manual controls lens;
One analog picture signal coffret electrically connects this CPU, becomes analog format and externally output with converted image; And
One data image signal coffret electrically connects this CPU, becomes various digital transmission form and externally output with converted image.
2. intelligent image process closed circuit TV camera device as claimed in claim 1 wherein receives the control signal of a long-range master station according to the external control unit.
3. intelligent image process closed circuit TV camera device as claimed in claim 1, wherein this imageing sensor can be charge coupled device or cmos sensor.
4. intelligent image process closed circuit TV camera device as claimed in claim 1, wherein this mobile graphical analysis and tracing unit include at least:
One changes detection module, adopts a motion compensation algorithm to reach in time and change reliably and detects, in order to detect mobile object;
One moving tracing module is found out the mobile object of preferential judgement in a plurality of mobile blocks, in order to assist to follow the trail of mobile object; And
One video camera control module, with the object that follows the trail of the objective, and magnified image is to pre-sizing in order to the level of controlling this video camera, vertical moving.
5. intelligent image process closed circuit TV camera device as claimed in claim 1 wherein can be according to this data image signal coffret with wireless or wired mode transmitting audio-video signal.
6. the object tracking method of an intelligent image process closed circuit TV camera, comprising key steps such as the detection that a mobile object is arranged, tracking and video camera controls, this method step includes:
Estimate the mobile behavior of this object, the audio-visual temporary function that carries by this intelligent image process closed circuit TV camera is concerned by a plurality of front and back picture frame of register map picture wherein and to estimate this movement of objects behavior;
Set up the motion-vector of this object, set up the motion-vector of this object according to a plurality of front and back picture frame relation;
Mobile behavior by this this object of motion-vector compensate for estimated;
Set up the moving Object Detection image of this object, with the moving range that is used for defining this object with arround the relation etc. of things;
Analyze the relation of this mobile object and its affiliated partner, reach by the kenel calculation method;
Set up trace data, set up by the analysis of this mobile object and its affiliated partner, and this trace data of Data Update that produces by this analytical method at any time; And
Carry out the Tracing Control of this intelligent image process closed circuit TV camera, control the shooting and the image processing operations of this closed-circuit TV camera with a plurality of control signals.
7. the object tracking method of intelligent image process closed circuit TV camera as claimed in claim 6 wherein in setting up the moving Object Detection image step of this object, upgrades with the moving Object Detection view data that is stored to a medium at any time.
CNB2004100855720A 2004-10-10 2004-10-10 Intelligent image process closed circuit TV camera device and its operation method Expired - Fee Related CN100515036C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2004100855720A CN100515036C (en) 2004-10-10 2004-10-10 Intelligent image process closed circuit TV camera device and its operation method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2004100855720A CN100515036C (en) 2004-10-10 2004-10-10 Intelligent image process closed circuit TV camera device and its operation method

Publications (2)

Publication Number Publication Date
CN1758714A CN1758714A (en) 2006-04-12
CN100515036C true CN100515036C (en) 2009-07-15

Family

ID=36703880

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2004100855720A Expired - Fee Related CN100515036C (en) 2004-10-10 2004-10-10 Intelligent image process closed circuit TV camera device and its operation method

Country Status (1)

Country Link
CN (1) CN100515036C (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101656826B (en) * 2008-08-21 2011-11-09 鸿富锦精密工业(深圳)有限公司 Video recording system and video recording method thereof
CN101753801A (en) * 2008-11-28 2010-06-23 康佳集团股份有限公司 Television with dancing teaching function and method for same to fulfill dancing teaching function
CN105704366B (en) * 2009-01-30 2019-01-08 英特赛尔美国有限公司 Mixed format medium transmission system and method
CN105475088A (en) * 2015-12-16 2016-04-13 无锡同春新能源科技有限公司 Unmanned tree planter
JP7405738B2 (en) * 2017-08-30 2023-12-26 ヴィド スケール インコーポレイテッド Tracked video zooming
WO2020145882A1 (en) * 2019-01-09 2020-07-16 Hitachi, Ltd. Object tracking systems and methods for tracking a target object
CN111754387B (en) * 2019-03-28 2023-08-04 杭州海康威视数字技术股份有限公司 Image processing method and device

Also Published As

Publication number Publication date
CN1758714A (en) 2006-04-12

Similar Documents

Publication Publication Date Title
US20090110058A1 (en) Smart image processing CCTV camera device and method for operating same
US6961447B2 (en) Image monitoring method, image monitoring apparatus and storage media
KR100883632B1 (en) System and method for intelligent video surveillance using high-resolution video cameras
EP1455297A1 (en) Image detection system and method
CN100446568C (en) Video monitoring equipment and device
US20040001149A1 (en) Dual-mode surveillance system
JP3681152B2 (en) Television camera control method and television camera
RU2008144120A (en) USING TELEVISION WITH DIGITAL VIDEO CAMERAS IN HOME SECURITY
US20150125130A1 (en) Method for network video recorder to accelerate history playback and event locking
JP2008042695A (en) Monitor camera apparatus, monitor camera system, and method of recording monitor camera image
KR100995949B1 (en) Image processing device, camera device and image processing method
CN100515036C (en) Intelligent image process closed circuit TV camera device and its operation method
US10440310B1 (en) Systems and methods for increasing the persistence of forensically relevant video information on space limited storage media
KR102386277B1 (en) Street parking lot license plate recognition system with reliability improved
JP3257948B2 (en) Image extraction device
KR100420620B1 (en) Object-based digital video recording system)
JP4205020B2 (en) Television camera control method and image recording apparatus control method
KR100391266B1 (en) Method for background setup in object-based compression moving-image
JPH11187350A (en) Image pickup recorder and its control method
JPH10276359A (en) Tracking device and tracking method
KR19990060503A (en) Apparatus and method for recording subject specific part of video camera
KR200273661Y1 (en) An unmanned a monitor a system
JPH1132323A (en) Monitoring system by still image
JP3702520B2 (en) Video camera system and automatic tracking method thereof
JP3267941B2 (en) Security camera equipment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20090715

Termination date: 20121010