CN101311947A - Real time intelligent control method based on natural video frequency - Google Patents
Real time intelligent control method based on natural video frequency Download PDFInfo
- Publication number
- CN101311947A CN101311947A CNA2008100624832A CN200810062483A CN101311947A CN 101311947 A CN101311947 A CN 101311947A CN A2008100624832 A CNA2008100624832 A CN A2008100624832A CN 200810062483 A CN200810062483 A CN 200810062483A CN 101311947 A CN101311947 A CN 101311947A
- Authority
- CN
- China
- Prior art keywords
- sequence
- vector
- sample
- frame
- action
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 55
- 230000009471 action Effects 0.000 claims abstract description 96
- 230000033001 locomotion Effects 0.000 claims abstract description 93
- 238000012544 monitoring process Methods 0.000 claims abstract description 59
- 230000008569 process Effects 0.000 claims abstract description 18
- 230000007246 mechanism Effects 0.000 claims abstract description 13
- 238000000605 extraction Methods 0.000 claims abstract description 6
- 230000000875 corresponding effect Effects 0.000 claims description 23
- 239000000284 extract Substances 0.000 claims description 10
- 238000013507 mapping Methods 0.000 claims description 10
- 238000013500 data storage Methods 0.000 claims description 6
- 230000000694 effects Effects 0.000 claims description 6
- 239000012634 fragment Substances 0.000 claims description 6
- 231100001261 hazardous Toxicity 0.000 claims description 6
- 238000005457 optimization Methods 0.000 claims description 6
- 101710099060 Tectonic Proteins 0.000 claims description 4
- 239000011159 matrix material Substances 0.000 claims description 4
- 238000005728 strengthening Methods 0.000 claims description 4
- 238000013473 artificial intelligence Methods 0.000 abstract description 5
- 238000012545 processing Methods 0.000 abstract description 5
- 238000005516 engineering process Methods 0.000 description 11
- 238000001514 detection method Methods 0.000 description 9
- 238000011160 research Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 6
- 230000006378 damage Effects 0.000 description 4
- 230000007123 defense Effects 0.000 description 4
- 238000010276 construction Methods 0.000 description 3
- 210000003141 lower extremity Anatomy 0.000 description 3
- 210000001364 upper extremity Anatomy 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 208000027418 Wounds and injury Diseases 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 2
- 230000002776 aggregation Effects 0.000 description 2
- 238000004220 aggregation Methods 0.000 description 2
- 238000004880 explosion Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 208000014674 injury Diseases 0.000 description 2
- 230000006855 networking Effects 0.000 description 2
- 231100000572 poisoning Toxicity 0.000 description 2
- 230000000607 poisoning effect Effects 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000003542 behavioural effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000001351 cycling effect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000003628 erosive effect Effects 0.000 description 1
- 230000009545 invasion Effects 0.000 description 1
- 230000010534 mechanism of action Effects 0.000 description 1
- 230000006740 morphological transformation Effects 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000000306 recurrent effect Effects 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 230000000192 social effect Effects 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
- 230000031068 symbiosis, encompassing mutualism through parasitism Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000007306 turnover Effects 0.000 description 1
Images
Landscapes
- Image Analysis (AREA)
Abstract
The invention discloses a real-time intelligent monitoring method based on natural video. The method uses the knowledge of computer image processing and artificial intelligence and realizes unmanned intelligent monitoring and alarm to the action of pedestrian in public places and important sensitive places. Firstly, video frame serial sections which need to be studied are extracted, movable historical images are obtained, which reflect the movement process of the people; on this base, the user-defined method for extracting the eigenvector is used, vector representation of the specific movement series is obtained, and the vector sample is stored in the sample database; as for the video frame serial which need to be monitored, the eigenvector and sample data are mapped in the low dimensional space, the corresponding classification by the optimized method is obtained and alarm is carried out. Owing to the sample study mechanism and the classification mechanism of the designed actions in the text, the method of the invention improves the accuracy of identification and strengthens the expansibility of identification; by designing the eigenvector representation and extraction method of movement serial of the people, the completeness and accuracy of action representation are strengthened.
Description
Technical field
The present invention relates to a kind of method of intelligent monitoring, relate in particular to and a kind ofly handle the method that natural video frequency obtains special scenes is carried out real time intelligent control, belong to the general field of Computer Image Processing and artificial intelligence based on Computer Image Processing and artificial intelligence knowledge.
Background technology
Along with the quick growth of urban population and the complexity day by day of urban environment, cities such as Mass disturbance, riot, attack of terrorism burst social security events is having a strong impact on municipal public safety.And the construction safe city has become an important topic of current international community.Speak of the construction of " safe city ", people can associate the terrorist incident that the world in recent years various places take place very naturally.After the U.S. " 911 " attack of terrorism, London subway case of explosion, countries in the world government brings " anti-terrorism ", " city security protection " into schedule gradually.China Ministry of Public Security has also organized " 3111 " engineering, is intended to promote the city in China and reports to the police and the monitoring construction.Make up video surveillance network and be one of main means of carrying out social public security event detection and early warning in present large-and-medium size cities.Show that according to relevant data the Guangzhou will install 250,000 monitoring cameras in 2007, these 250,000 cameras will spread all over the multiple zone of Guangzhou road, bridge, public place, public transportation system and case; In Beijing, 26.3 ten thousand of total at present cameras, and plan in the end of the year 2007 interior guarantor's supervisory system of Pekinese's ATM, big-and-middle-sized market, refuelling station, middle and primary schools kindergarten all to be networked with police monitoring networks; In Shanghai, more than 20 ten thousand monitoring cameras will be installed on road before 2010, set up " social defense system " comprehensively; In Britain, more than 420 ten thousand of cameras have been installed in the nationwide, one of average per 14 people, people may appear at nearly 300 cameras among one day before.The video monitoring technology develops towards digitizing, networking, intelligentized direction, and wherein intellectuality is the tidemark of " three change ".From present current situation both domestic and external, passed by the substantially developing stage of digitizing and networking of video monitoring technology, what current government decision department and public security department were faced no longer is the scarcity of video monitoring content, but how wherein key message is carried out automatically, intelligence, real-time selection, handles and understanding, and the aid decision making and the early warning of the social security events that is used to happen suddenly.
From technological layer, intelligent video (Intelligent Video) is derived from computer vision (ComputerVision) technology.Intelligent video monitoring is different from general networked video monitoring, and it is a kind of more high-end video surveillance applications.Intelligent video monitoring system can be discerned different objects; find the abnormal conditions in the monitored picture; and can give the alarm and provide useful information in fast and the most best mode, thus can assist the Security Officer to handle crisis more effectively, and reduce wrong report to greatest extent and fail to report phenomenon.In world's struggle against terror severe day by day today, intelligent video monitoring obviously can become the reply terrorist attack and handle the strong aid of accident, particularly after the September 11th attacks, the Madrid bombing case and London case of explosion take place, constantly increase for this type of demands of applications on the market.This type of application mainly comprises: advanced video mobile detection (Advanced VMD), human motion are followed the trail of (Human Motion Tracking), personage's face recognition (Face Recognition) and are detected illegal invasion person (Intrusion Detection) etc.In the U.S., (the Defense advanced research projects agency of Advanced Research Projects administration of Ministry of National Defence, DAPRA) set up with headed by the CMU, the vision monitoring project VSAM (Visualsurveillance and monitoring) that colleges and universities such as MIT participate in, this system can be used in the real-time monitoring in normal domestic scene and battlefield; The real-time monitoring system W4 of Maryland university can carry out effectively monitoring in real time to a suspect of the belongings of occasions such as turnover private residence, parking lot, bank.In China, the intelligent video monitoring technology also begins to come into one's own gradually, adopt the rig camera collection person's of lining up for tickets monitoring image as the Chongqing Railway police, analyze identification, find that recurrent face just reports to the police to hit " ox party " by " Identification of Images system "; Thereby Beijing police crack the supermarket of extorting with the threat mutually of the poisoning case of poisoning at one stroke by monitoring video and fuzzy people's face recovery technique.Yet the intelligent monitoring technology of current existence all is confined to a certain particular problem territory, as detection, tracking or recognition of face, multiple function is not integrated and forms complete intelligent monitoring issue-resolution.
According to present studies show that, intelligent video monitoring not only should comprise identification, video storage, video slicing and the functions such as summary generation, content-based retrieval, video compress and transmission of online moving object detection and extraction, behavioural analysis and understanding, event detection and off-line; Also relating to a plurality of research fields such as computer vision, pattern-recognition, artificial intelligence, database, computer network, is a multidisciplinary crossing research problem.Yet exploitation is towards each application, the intelligent video monitoring system of complete function is very difficult problem, therefore current already present intelligent video monitoring system all is confined to some application-specific basically, affixing one's name to (Defense Advanced Research ProjectsAgency) as U.S. national defense Advanced Research Projects in 1997 has set up with headed by Carnegie Mellon University (Carnegie Mellon University), the vision monitoring major project VSAM (Visual Surveillance and Monitoring) that colleges and universities such as (Massachusetts Institute ofTechnology) of Massachusetts Institute of Technology (MIT) participate in mainly studies in battlefield and the common scenarios technology that human body and vehicle are monitored; Real-time vision supervisory system W4 can locate the people and be partitioned into people's body part, and realizes tracking to the people by setting up display model, and judges whether the people carries object; The University of Reading of Britain (University ofReading) has carried out vehicle and pedestrian's the tracking and the correlative study of identification; Company such as IBM and Microsoft also just progressively will be based on the gesture identification Application of Interface of vision in commercial field.
Video monitoring at the public safety incident has great market application foreground, and the video monitoring content changes the leap that intelligent real-time interpretation is the video monitoring technology into by original artificial explanation, be the certainty of security and guard technology development, intelligent video monitoring also faces the technological difficulties of demanding urgently breaking through simultaneously.Under such background, research has important social effect and application prospect at the intelligent video monitoring of public safety incident.
Summary of the invention
The objective of the invention is to overcome the deficiencies in the prior art, a kind of real time intelligent control method based on natural video frequency is provided.
Real time intelligent control method based on natural video frequency comprises the steps:
1) is written into sequence of frames of video, extracts the sequence of frames of video fragment that needs study, handle the motion history image that obtains reflecting personage's motion process;
2) obtain on the basis of motion history image in step 1), use self-defining proper vector extracting method, obtain the vector representation of special exercise sequence, by self-defining study mechanism, the sample action data storage that study is obtained is in sample database;
3) to the sequence of frames of video of need monitoring, by its motion history image and sample data are shone upon at lower dimensional space, and personage's Motion Recognition and classification in the video sequence that obtains needing to monitor by optimization method, simultaneously hazardous act is warned.
The described sequence of frames of video that is written into extracts the sequence of frames of video fragment that needs study, handles the motion history image step that obtains reflecting personage's motion process:
(a) be written into the gray level image that passes through the sequence of frames of video correspondence, carry out foreground extraction and binaryzation process, obtain the two-value silhouette frame sequence of the personage that monitors motion, to certain section action sequence that needs study of appointment, with the two-value silhouette frame sequence tectonic movement history image of designated frame length;
(b) to the two-value silhouette frame sequence of designated length, according to the timestamp order of every frame in the silhouette sequence, define the freshness of the corresponding action that silhouette is described of this frame with respect to this sequence, formula is as follows:
F wherein
Fresh(i) be illustrated in that relative indexing is the pairing freshness of frame of i in proper order in the frame sequence, SeqNum represents the frame length of appointment;
(c) to the silhouette sequence of designated length, according to the freshness of each frame correspondence, generate the motion history image of this frame sequence correspondence in piece image, formula is as follows:
I(x,y)=Max(I
i(x,y)×F
fresh(i)) 2
F wherein
Fresh(i) be illustrated in that relative indexing is the pairing freshness of frame of i in proper order in the frame sequence, I (x, y) two-dimensional coordinate x in the expression motion history image, the gray-scale value of y institute corresponding pixel points, I
i(x, y) for relative indexing in the frame sequence of designated frame length is x for the frame two-dimensional coordinate of i in proper order, the gray values of pixel points of y correspondence.
On the described basis that obtains the motion history image in step 1), use self-defining proper vector extracting method, obtain the vector representation of special exercise sequence, by self-defining study mechanism, the sample action data storage that study is obtained is in the sample database step:
(d) on the basis of the motion history image that step 1) obtains, extract the sport foreground of personage in the motion history image, encirclement profile with a rectangle frame mark prospect, form with five equilibrium is carried out level and each division of 20 parts of Z-axis to rectangle frame, rectangle frame is divided into the rectangular grid of 400 identical sizes, calculate the pixel average in each rectangular grid, and the indexed sequential of these mean values according to level and vertical direction is stored in the two-dimensional chain table;
(e) for strengthening the pixel value that the zone may appear in rectangle middle body personage, each rectangular block pixel value in this chained list is carried out a parameter type gain by its position, obtain the vector of action sequence, formula is as follows:
Wherein
Be horizontal index i in the vectorial chained list, the vector element value of the rectangular grid correspondence of vertical index j, V (i, j) be horizontal index i in the whole rectangle frame, the pixel average of the rectangular grid correspondence of vertical index j, δ reaches desirable recognition effect, i for the gain constant in order to adjust
0And j
0Be the center-of-mass coordinate of whole rectangle frame, wherein the computing formula of barycenter is as follows:
Wherein n is the sum of rectangular grid in the whole rectangle frame, and i and j are the index of level and vertical direction, and (i j) is horizontal index i in the whole rectangle frame to V, the pixel average of the rectangular grid correspondence of vertical index j;
(f) behind the vector that has obtained action sequence, the user obtains the action sequence that monitoring is paid close attention to by catch mechanism, vector to the motion history image sequence correspondence that comprised in the action sequence is weighted on average, obtain reflecting the sample vector of the action sequence motion feature of being paid close attention to, formula is as follows:
Wherein
For coordinate in the vector element in the Vector Groups of the motion history image correspondence of the action sequence of being caught is i, the pairing element value of j,
For obtaining through weighted mean that coordinate is i in the sample vector, the pairing element value of j, n are the motion history image number of the action sequence of being caught;
(g) obtain reflecting the sample vector of the action sequence motion feature of being paid close attention to after, the user is divided into regular event and improper action two classes by the pairing sample vector of paying close attention to of action by its attribute, and wherein regular event is corresponding to can not cause dangerous action in this place; Improper action is corresponding to causing dangerous action in this place, the sample vector of finishing classification being stored in the sample database.
Described sequence of frames of video to need monitoring, by its motion history image and sample data are shone upon at lower dimensional space, and personage's Motion Recognition and classification in the video sequence that obtains needing to monitor by optimization method, simultaneously hazardous act is warned step:
(h) according to the pairing proper vector of motion history vector-valued image sequence continuous on time shaft, the proper vector of the sequence of frames of video of need monitoring and the sample characteristics vector that the sample storehouse is stored are carried out dimension-reduction treatment simultaneously, obtain the sample characteristics vector stored in the proper vector of being monitored and the sample database projection mapping at lower dimensional space, formula is as follows:
Y
T=X
TW 6
=V∑
X wherein
TFor emprical average is 0 data matrix, the V ∑ is X
TMonodrome divide;
The sample characteristics vector of storing in proper vector of (i) monitoring obtaining and the sample database is after the projection mapping of lower dimensional space, calculate Euclidean distance between the two, in sample database and the nearest sample of proper vector of being monitored, be the attribute and the classification of the action sequence of this proper vector correspondence, formula is as follows:
Wherein
Be the proper vector of being monitored projection properties value at lower dimensional space,
Be the projection properties value of sample characteristics vector at lower dimensional space, function D is the Euclidean distance computing formula,
Attribute and classification for the proper vector correspondence of being monitored.
The present invention has used the knowledge of Computer Image Processing and artificial intelligence, carry out a series of processing for captured natural video frequency, unmanned intelligent monitoring and warning have been realized for pedestrian's action of public place and important sensitive sites, efficiency for monitoring and accuracy have been improved, saved the cost and the manpower of monitoring, the sum of errors that has reduced monitoring disturbs.This paper has improved the accuracy of identification and has strengthened the extendability of discerning by designing the sample learning mechanism and the classification mechanism of action, makes and can dynamically adjust the content that needs the identification figure action according to the place needs; Represent and extracting method by the proper vector of designing personage's motion sequence, strengthened the integrality and the accuracy that need identification maneuver to represent, eliminated the ambiguousness in the identifying.
Description of drawings
The present invention is further illustrated below in conjunction with the drawings and specific embodiments.
Fig. 1 is the frame in the two-value silhouette frame sequence of acquisition of the present invention;
Fig. 2 is the motion history image that obtains of the present invention;
Fig. 3 is the corresponding motion characteristic vector-valued image of certain action of the present invention;
Fig. 4 is the alert status contrast images of regular event of the present invention and improper action.
Embodiment
Real time intelligent control method based on natural video frequency comprises the steps:
1) is written into sequence of frames of video, extracts the sequence of frames of video fragment that needs study, handle the motion history image that obtains reflecting personage's motion process;
2) obtain on the basis of motion history image in step 1), use self-defining proper vector extracting method, obtain the vector representation of special exercise sequence, by self-defining study mechanism, the sample action data storage that study is obtained is in sample database;
3) to the sequence of frames of video of need monitoring, by its motion history image and sample data are shone upon at lower dimensional space, and personage's Motion Recognition and classification in the video sequence that obtains needing to monitor by optimization method, simultaneously hazardous act is warned.
The described sequence of frames of video that is written into extracts the sequence of frames of video fragment that needs study, handles the motion history image step that obtains reflecting personage's motion process:
(a) be written into the gray level image that passes through the sequence of frames of video correspondence, the form of gray level image is the JPG coding format, the size of image is 400 * 293 pixels, these gray level images are carried out foreground extraction and binaryzation process, the improvement algorithm wiped out of the background frames that adopts of background extracting wherein, what binaryzation adopted is the adaptive threshold filter algorithm, the two-value silhouette frame sequence that the personage who obtains being monitored moves.To certain section action sequence that needs study of appointment, with the two-value silhouette frame sequence tectonic movement history image of designated frame length;
(b) to the two-value silhouette frame sequence of designated length, according to the timestamp order of every frame in the silhouette sequence, define the freshness of the corresponding action that silhouette is described of this frame with respect to this sequence, formula is as follows:
F wherein
Resh(i) be illustrated in the frame sequence relative indexing and be the pairing freshness of frame of i in proper order, SeqNum represents the frame length of appointment, formula table understands that the freshness of certain frame correspondence is inversely proportional in proper order with the relative indexing of this frame in the frame sequence of appointment, promptly in the action sequence of this appointment, time of origin action more early relatively, corresponding freshness is low more;
(c) to the silhouette sequence of designated length, according to the freshness of each frame correspondence, generate the motion history image of this frame sequence correspondence in piece image, formula is as follows:
I(x,y)=Max(I
i(x,y)×F
fresh(i)) 2
F wherein
Fresh(i) be illustrated in that relative indexing is the pairing freshness of frame of i in proper order in the frame sequence, I (x, y) two-dimensional coordinate x in the expression motion history image, the gray-scale value of y institute corresponding pixel points, I
i(x, y) be x for the frame two-dimensional coordinate of i in proper order for relative indexing in the frame sequence of designated frame length, the gray values of pixel points of y correspondence, publicity has shown in the motion history image that the pixel value of certain point is by the gray-scale value decision of the point of the freshness product maximum of the frame at this respective pixel value in the corresponding frame sequence and this place.
On the described basis that obtains the motion history image in step 1), use self-defining proper vector extracting method, obtain the vector representation of special exercise sequence, by self-defining study mechanism, the sample action data storage that study is obtained is in the sample database step:
(d) on the basis of the motion history image that step 1) obtains, extract the sport foreground of personage in the motion history image, encirclement profile with a rectangle frame mark prospect, form with five equilibrium is carried out level and each division of 20 parts of Z-axis to rectangle frame, rectangle frame is divided into the rectangular grid of 400 identical sizes, calculate the pixel average in each rectangular grid, and the indexed sequential of these mean values according to level and vertical direction is stored in the two-dimensional chain table;
(e) for strengthening the pixel value that the zone may appear in rectangle middle body personage, each rectangular block pixel value in this chained list is carried out a parameter type gain by its position, obtain the vector of action sequence, formula is as follows:
Wherein
Be horizontal index i in the vectorial chained list, the vector element value of the rectangular grid correspondence of vertical index j, V (i, j) be horizontal index i in the whole rectangle frame, the pixel average of the rectangular grid correspondence of vertical index j, δ reaches desirable recognition effect, i for the gain constant in order to adjust
0And j
0Be the center-of-mass coordinate of whole rectangle frame, formula table is understood far away more from the distance of whole rectangle frame barycenter, and the value of the corresponding vector element of this rectangular grid is more little.Wherein the computing formula of barycenter is as follows, and wherein the computing formula of barycenter is as follows:
Wherein n is the sum of rectangular grid in the whole rectangle frame, and i and j are the index of level and vertical direction, and (i j) is horizontal index i in the whole rectangle frame to V, the pixel average of the rectangular grid correspondence of vertical index j;
(f) behind the vector that has obtained action sequence, the user obtains the action sequence that monitoring is paid close attention to by catch mechanism, vector to the motion history image sequence correspondence that comprised in the action sequence is weighted on average, obtain reflecting the sample vector of the action sequence motion feature of being paid close attention to, formula is as follows:
Wherein
For coordinate in the vector element in the Vector Groups of the motion history image correspondence of the action sequence of being caught is i, the pairing element value of j,
Coordinate is i in the sample vector in order to obtain through weighted mean, the pairing element value of j, n is the motion history image number of the action sequence of being caught, and formula table understands that the barycenter of whole rectangle frame is near the high aggregation zone of rectangular grid average pixel value, i.e. character activities zone;
(g) obtain reflecting the sample vector of the action sequence motion feature of being paid close attention to after, the user is divided into regular event and improper action two classes by the pairing sample vector of paying close attention to of action by its attribute, and wherein regular event is corresponding to can not cause dangerous action in this place; Improper action is corresponding to may cause dangerous action in this place, this method has defined walking, has squatted down, has run, upper limbs stretches and lower limb stretch this action several frequently seen and coverage rate is extensive, wherein walking is defined as regular event, can not cause potential injury and destruction to other people and the facility in the environment because consider the walking action of normal speed; Squat down, run, upper limbs stretches and lower limb stretch and are defined as improper action, may cause potential injury and destruction to other people and the facility in the environment because consider these actions.The sample vector of finishing classification is stored in the sample database.
Described sequence of frames of video to need monitoring, by its motion history image and sample data are shone upon at lower dimensional space, and personage's Motion Recognition and classification in the video sequence that obtains needing to monitor by optimization method, simultaneously hazardous act is warned step:
(h) according to the pairing proper vector of motion history vector-valued image sequence continuous on time shaft, the proper vector of the sequence of frames of video of need monitoring and the sample characteristics vector that the sample storehouse is stored are carried out dimension-reduction treatment simultaneously, obtain the sample characteristics vector stored in the proper vector of being monitored and the sample database projection mapping at lower dimensional space, formula is as follows:
Y
T=X
TW 6
=V∑
X wherein
TFor emprical average is 0 data matrix, the V ∑ is X
TMonodrome divide, formula table is understood obtain the to reflect eigenvector projection of motion process on one group of orthogonal basis, lower dimensional space mapping expression, i.e. the lower dimensional space feature of certain section motion sequence like one stack features value vector of selected characteristic value maximum obtains recently under the situation that keeps the maximum covariance of original high dimensional feature vector;
The sample characteristics vector of storing in proper vector of (i) monitoring obtaining and the sample database is after the projection mapping of lower dimensional space, calculate Euclidean distance between the two, in sample database and the nearest sample of proper vector of being monitored, be the attribute and the classification of the action sequence of this proper vector correspondence, formula is as follows:
Wherein
Be the proper vector of being monitored projection properties value at lower dimensional space,
Be the projection properties value of sample characteristics vector at lower dimensional space, function D is the Euclidean distance computing formula,
Attribute and classification for the proper vector correspondence of being monitored, formula shows on the orthogonal basis of lower dimensional space, eigenwert and the nearest sample characteristics vector of proper vector characteristic of correspondence value Euclidean distance of being monitored are the action sequence characteristic of correspondence vector of being monitored, classification and attribute that the classification of the pairing action sequence of this sample characteristics vector and attribute are the action of monitoring.
Embodiment
(1) in the present embodiment, with the natural video frequency of the monitoring video in taken certain scene of standard picture pick-up device as input, coded format is the AVI form of standard.
Be written into gray level image through the sequence of frames of video correspondence, the form of gray level image is the JPG coding format, the size of image is 400 * 293 pixels, carry out foreground extraction and binaryzation process, the improvement algorithm that the background frames that background extracting adopts is wiped out, what binaryzation adopted is the adaptive threshold filter algorithm, obtains the two-value silhouette frame sequence that the personage that monitors of institute moves, to certain section action sequence that needs study of appointment, with the two-value silhouette frame sequence tectonic movement history image of designated frame length.As Fig. 1, the frame in the two-value silhouette frame sequence that obtains among the embodiment.
To the two-value silhouette frame sequence of designated length, according to the timestamp order of every frame in the silhouette sequence, define the freshness of the corresponding action that silhouette is described of this frame with respect to this sequence, formula is as follows:
F wherein
Fresh(i) be illustrated in that relative indexing is the pairing freshness of frame of i in proper order in the frame sequence, SeqNum represents the frame length of appointment; Formula table understands that the freshness of certain frame correspondence is inversely proportional in proper order with the relative indexing of this frame in the frame sequence of appointment, promptly in the action sequence of this appointment, and time of origin action more early relatively, the freshness of correspondence is low more.
In the present embodiment, choose the designated length of 10 frames as two-value silhouette frame sequence, through this length of test can be when keeping the action sequence continuity discrimination between the enhancement sequences to the full extent, carry out the calculating of freshness according to this parameter setting, obtain the corresponding value of every frame in the sequence.
To the silhouette sequence of designated length, according to the freshness of each frame correspondence, in piece image, generate the motion history image of this frame sequence correspondence, formula is as follows:
I(x,y)=Max(I
i(x,y)×F
fresh(i))
F wherein
Fresh(i) be illustrated in that relative indexing is the pairing freshness of frame of i in proper order in the frame sequence, I (x, y) two-dimensional coordinate x in the expression motion history image, the gray-scale value of y institute corresponding pixel points, I
i(x, y) for relative indexing in the frame sequence of designated frame length is x for the frame two-dimensional coordinate of i in proper order, the gray values of pixel points of y correspondence; Publicity has shown in the motion history image that the pixel value of certain point is by the gray-scale value decision of the point of the freshness product maximum of the frame at this respective pixel value in the corresponding frame sequence and this place.As Fig. 2, a motion history image that obtains in the present embodiment.
(2) on the basis of the motion history image that step 1) obtains, with detection technique in the Flame Image Process and noise cancellation technology, extract the sport foreground of personage in the motion history image, what wherein detection technique was used is the gray-scale value threshold detection method, what noise cancellation technology was used is the expansion and the erosion algorithm of morphological transformation in the Flame Image Process, encirclement profile with a rectangle frame mark prospect, form with five equilibrium is carried out level and each division of 20 parts of Z-axis to rectangle frame, rectangle frame is divided into the rectangular grid of 400 identical sizes, calculate the pixel average in each rectangular grid, and the indexed sequential of these mean values according to level and vertical direction is stored in the two-dimensional chain table;
For strengthening the pixel value that the zone may appear in rectangle middle body personage, each rectangular block pixel value in this chained list is carried out a parameter type gain by its position, obtain the vector of action sequence, formula is as follows:
Wherein
Be horizontal index i in the vectorial chained list, the vector element value of the rectangular grid correspondence of vertical index j, V (i, j) be horizontal index i in the whole rectangle frame, the pixel average of the rectangular grid correspondence of vertical index j, δ reaches desirable recognition effect, i for the gain constant in order to adjust
0And j
0Be the center-of-mass coordinate of whole rectangle frame, wherein the computing formula of barycenter is as follows:
Wherein n is the sum of rectangular grid in the whole rectangle frame, and i and j are the index of level and vertical direction, and (i j) is horizontal index i in the whole rectangle frame to V, the pixel average of the rectangular grid correspondence of vertical index j; Formula table understands that the barycenter of whole rectangle frame is near the high aggregation zone of rectangular grid average pixel value, i.e. character activities zone.
In the present embodiment, after this step was finished, what obtain was one 20 * 20 two-dimensional chain table, wherein according to the process gain process pixel average of the indexed sequential correspondence of rectangular block level and vertical direction.As Fig. 3, the presentation video of the motion characteristic vector that obtains among the embodiment.
Behind the vector that has obtained action sequence, the user obtains the action sequence that monitoring is paid close attention to by catch mechanism, vector to the motion history image sequence correspondence that comprised in the action sequence is weighted on average, obtains reflecting the sample vector of the action sequence motion feature of being paid close attention to, and formula is as follows:
Wherein
For coordinate in the vector element in the Vector Groups of the motion history image correspondence of the action sequence of being caught is i, the pairing element value of j,
For obtaining through weighted mean that coordinate is i in the sample vector, the pairing element value of j, n are the motion history image number of the action sequence of being caught; Formula table understands that each element value of sample vector is the weighted mean of each vector element corresponding element value in this acquisition sequence.
After obtaining reflecting the sample vector of the action sequence motion feature of being paid close attention to, the user is divided into regular event and improper action two classes by the pairing sample vector of paying close attention to of action by its attribute, and wherein regular event is corresponding to can not cause dangerous action in this place; Improper action is corresponding to causing dangerous action in this place, the sample vector of finishing classification being stored in the sample database.
In the present embodiment, catch about walk, squat down, run, upper limbs stretches and lower limb stretch the input of three to five groups of repetitive cycling processes at these several classes actions 90 degree visual angles, side as class action statistical sample, wherein the action of every class comprises forward and reverse bidirectional-movement, through the as above weighted mean of method, obtain the representative sample action data of these several classes actions respectively.
In the present embodiment, symbiosis becomes five class bidirectional-movements, adds up to 10 groups of sample datas to be stored in the sample database.
(3) according to the pairing proper vector of motion history vector-valued image sequence continuous on time shaft, the proper vector of the sequence of frames of video of need monitoring and the sample characteristics vector that the sample storehouse is stored are carried out dimension-reduction treatment simultaneously, obtain the sample characteristics vector stored in the proper vector of being monitored and the sample database projection mapping at lower dimensional space, formula is as follows:
Y
T=X
TW
=V∑
X wherein
TFor emprical average is 0 data matrix, the V ∑ is X
TMonodrome divide; Formula table is understood obtain the to reflect eigenvector projection of motion process on one group of orthogonal basis, lower dimensional space mapping expression, i.e. the lower dimensional space feature of certain section motion sequence like one stack features value vector of selected characteristic value maximum obtains recently under the situation that keeps the maximum covariance of original high dimensional feature vector.
In the present embodiment, data map is 7 dimensions to the dimension of lower dimensional space optimum.
The sample characteristics vector of storing in proper vector of monitoring obtaining and the sample database is after the projection mapping of lower dimensional space, calculate Euclidean distance between the two, in sample database and the nearest sample of proper vector of being monitored, be the attribute and the classification of the action sequence of this proper vector correspondence, formula is as follows:
Wherein
Be the proper vector of being monitored projection properties value at lower dimensional space,
Be the projection properties value of sample characteristics vector at lower dimensional space, function D is the Euclidean distance computing formula,
Attribute and classification for the proper vector correspondence of being monitored; Formula shows on the orthogonal basis of lower dimensional space, eigenwert and the nearest sample characteristics vector of proper vector characteristic of correspondence value Euclidean distance of being monitored are the action sequence characteristic of correspondence vector of being monitored, classification and attribute that the classification of the pairing action sequence of this sample characteristics vector and attribute are the action of monitoring.
According to the user-defined classification of motion in this method, this method is warned improper action, promptly predefinedly may constitute dangerous figure action to the place and report to the police in this monitor procedure, occurring, employing be the method for visual alarm.
In the present embodiment,, obtained monitored results based on the real time intelligent control method of natural video frequency by above step.As Fig. 4, the alert status image of regular event that obtains among the embodiment and improper action.
Claims (4)
1. real time intelligent control method based on natural video frequency is characterized in that comprising following several steps:
1) is written into sequence of frames of video, extracts the sequence of frames of video fragment that needs study, handle the motion history image that obtains reflecting personage's motion process;
2) obtain on the basis of motion history image in step 1), use self-defining proper vector extracting method, obtain the vector representation of special exercise sequence, by self-defining study mechanism, the sample action data storage that study is obtained is in sample database;
3) to the sequence of frames of video of need monitoring, by its motion history image and sample data are shone upon at lower dimensional space, and personage's Motion Recognition and classification in the video sequence that obtains needing to monitor by optimization method, simultaneously hazardous act is warned.
2. a kind of real time intelligent control method according to claim 1 based on natural video frequency, it is characterized in that: the described sequence of frames of video that is written into, extract the sequence of frames of video fragment that needs study, handle the motion history image step that obtains reflecting personage's motion process:
(a) be written into the gray level image that passes through the sequence of frames of video correspondence, carry out foreground extraction and binaryzation process, obtain the two-value silhouette frame sequence of the personage that monitors motion, to certain section action sequence that needs study of appointment, with the two-value silhouette frame sequence tectonic movement history image of designated frame length;
(b) to the two-value silhouette frame sequence of designated length, according to the timestamp order of every frame in the silhouette sequence, define the freshness of the corresponding action that silhouette is described of this frame with respect to this sequence, formula is as follows:
F wherein
Fresh(i) be illustrated in that relative indexing is the pairing freshness of frame of i in proper order in the frame sequence, SeqNum represents the frame length of appointment;
(c) to the silhouette sequence of designated length, according to the freshness of each frame correspondence, generate the motion history image of this frame sequence correspondence in piece image, formula is as follows:
I(x,y)=Max(I
i(x,y)×F
fresh(i)) 2
F wherein
Fresh(i) be illustrated in that relative indexing is the pairing freshness of frame of i in proper order in the frame sequence, I (x, y) two-dimensional coordinate x in the expression motion history image, the gray-scale value of y institute corresponding pixel points, I
i(x, y) for relative indexing in the frame sequence of designated frame length is x for the frame two-dimensional coordinate of i in proper order, the gray values of pixel points of y correspondence.
3. a kind of real time intelligent control method according to claim 1 based on natural video frequency, it is characterized in that: on the described basis that obtains the motion history image in step 1), use self-defining proper vector extracting method, obtain the vector representation of special exercise sequence, by self-defining study mechanism, the sample action data storage that study is obtained is in the sample database step:
(d) on the basis of the motion history image that step 1) obtains, extract the sport foreground of personage in the motion history image, encirclement profile with a rectangle frame mark prospect, form with five equilibrium is carried out level and each division of 20 parts of Z-axis to rectangle frame, rectangle frame is divided into the rectangular grid of 400 identical sizes, calculate the pixel average in each rectangular grid, and the indexed sequential of these mean values according to level and vertical direction is stored in the two-dimensional chain table;
(e) for strengthening the pixel value that the zone may appear in rectangle middle body personage, each rectangular block pixel value in this chained list is carried out a parameter type gain by its position, obtain the vector of action sequence, formula is as follows:
Wherein
Be horizontal index i in the vectorial chained list, the vector element value of the rectangular grid correspondence of vertical index j, V (i, j) be horizontal index i in the whole rectangle frame, the pixel average of the rectangular grid correspondence of vertical index j, δ reaches desirable recognition effect, i for the gain constant in order to adjust
0And j
0Be the center-of-mass coordinate of whole rectangle frame, wherein the computing formula of barycenter is as follows:
Wherein n is the sum of rectangular grid in the whole rectangle frame, and i and j are the index of level and vertical direction, and (i j) is horizontal index i in the whole rectangle frame to V, the pixel average of the rectangular grid correspondence of vertical index j;
(f) behind the vector that has obtained action sequence, the user obtains the action sequence that monitoring is paid close attention to by catch mechanism, vector to the motion history image sequence correspondence that comprised in the action sequence is weighted on average, obtain reflecting the sample vector of the action sequence motion feature of being paid close attention to, formula is as follows:
Wherein
For coordinate in the vector element in the Vector Groups of the motion history image correspondence of the action sequence of being caught is i, the pairing element value of j,
For obtaining through weighted mean that coordinate is i in the sample vector, the pairing element value of j, n are the motion history image number of the action sequence of being caught;
(g) obtain reflecting the sample vector of the action sequence motion feature of being paid close attention to after, the user is divided into regular event and improper action two classes by the pairing sample vector of paying close attention to of action by its attribute, and wherein regular event is corresponding to can not cause dangerous action in this place; Improper action is corresponding to causing dangerous action in this place, the sample vector of finishing classification being stored in the sample database.
4. a kind of real time intelligent control method according to claim 1 based on natural video frequency, it is characterized in that: described sequence of frames of video the need monitoring, by its motion history image and sample data are shone upon at lower dimensional space, and personage's Motion Recognition and classification in the video sequence that obtains needing to monitor by optimization method, simultaneously hazardous act is warned step:
(h) according to the pairing proper vector of motion history vector-valued image sequence continuous on time shaft, the proper vector of the sequence of frames of video of need monitoring and the sample characteristics vector that the sample storehouse is stored are carried out dimension-reduction treatment simultaneously, obtain the sample characteristics vector stored in the proper vector of being monitored and the sample database projection mapping at lower dimensional space, formula is as follows:
Y
T=X
TW 6
=V∑
X wherein
TFor emprical average is 0 data matrix, the V ∑ is X
TMonodrome divide.
The sample characteristics vector of storing in proper vector of (i) monitoring obtaining and the sample database is after the projection mapping of lower dimensional space, calculate Euclidean distance between the two, in sample database and the nearest sample of proper vector of being monitored, be the attribute and the classification of the action sequence of this proper vector correspondence, formula is as follows:
Wherein
Be the proper vector of being monitored projection properties value at lower dimensional space,
Be the projection properties value of sample characteristics vector at lower dimensional space, function D is the Euclidean distance computing formula,
Attribute and classification for the proper vector correspondence of being monitored.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN200810062483A CN100583128C (en) | 2008-06-12 | 2008-06-12 | Real time intelligent control method based on natural video frequency |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN200810062483A CN100583128C (en) | 2008-06-12 | 2008-06-12 | Real time intelligent control method based on natural video frequency |
Publications (2)
Publication Number | Publication Date |
---|---|
CN101311947A true CN101311947A (en) | 2008-11-26 |
CN100583128C CN100583128C (en) | 2010-01-20 |
Family
ID=40100589
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN200810062483A Expired - Fee Related CN100583128C (en) | 2008-06-12 | 2008-06-12 | Real time intelligent control method based on natural video frequency |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN100583128C (en) |
Cited By (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102054160B (en) * | 2009-10-30 | 2013-01-09 | 财团法人车辆研究测试中心 | Driver facial image identification system |
CN102920541A (en) * | 2012-11-27 | 2013-02-13 | 华夏威盛(北京)网络科技有限公司 | Body posture correcting system and body posture correcting method |
CN103049749A (en) * | 2012-12-30 | 2013-04-17 | 信帧电子技术(北京)有限公司 | Method for re-recognizing human body under grid shielding |
CN103065128A (en) * | 2012-12-30 | 2013-04-24 | 信帧电子技术(北京)有限公司 | Human body reidentification method in foggy days |
CN103093273A (en) * | 2012-12-30 | 2013-05-08 | 信帧电子技术(北京)有限公司 | Video people counting method based on body weight recognition |
CN103093274A (en) * | 2012-12-30 | 2013-05-08 | 信帧电子技术(北京)有限公司 | Pedestrian counting method based on video |
CN104050247A (en) * | 2014-06-04 | 2014-09-17 | 上海美琦浦悦通讯科技有限公司 | Method for realizing quick retrieval of mass videos |
CN104103030A (en) * | 2013-04-08 | 2014-10-15 | 佳能株式会社 | Image analysis method, camera apparatus, control apparatus and control method |
CN106203458A (en) * | 2015-04-29 | 2016-12-07 | 杭州海康威视数字技术股份有限公司 | Crowd's video analysis method and system |
CN106296736A (en) * | 2016-08-08 | 2017-01-04 | 河海大学 | The mode identification method that a kind of imitative memory guides |
CN107832708A (en) * | 2017-11-09 | 2018-03-23 | 云丁网络技术(北京)有限公司 | A kind of human motion recognition method and device |
CN110443187A (en) * | 2019-07-31 | 2019-11-12 | 上海秒针网络科技有限公司 | The recording method of characteristic information and device |
CN111225558A (en) * | 2017-08-07 | 2020-06-02 | 杰克逊实验室 | Long-term and continuous animal behavior monitoring |
CN111310605A (en) * | 2020-01-21 | 2020-06-19 | 北京迈格威科技有限公司 | Image processing method and device, electronic equipment and storage medium |
CN111437607A (en) * | 2020-03-20 | 2020-07-24 | 腾讯科技(深圳)有限公司 | Image processing method and device, electronic equipment and computer readable storage medium |
CN113359193A (en) * | 2021-06-01 | 2021-09-07 | 中国人民解放军国防科技大学 | Metal detection method, device, equipment and computer readable storage medium |
CN114127815A (en) * | 2019-07-26 | 2022-03-01 | 株式会社电装 | Image utilization system in parking |
CN114724246A (en) * | 2022-04-11 | 2022-07-08 | 中国人民解放军东部战区总医院 | Dangerous behavior identification method and device |
CN114821805A (en) * | 2022-05-18 | 2022-07-29 | 湖北大学 | Dangerous behavior early warning method, device and equipment |
-
2008
- 2008-06-12 CN CN200810062483A patent/CN100583128C/en not_active Expired - Fee Related
Cited By (39)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102054160B (en) * | 2009-10-30 | 2013-01-09 | 财团法人车辆研究测试中心 | Driver facial image identification system |
CN102920541B (en) * | 2012-11-27 | 2015-09-09 | 华夏威盛(北京)网络科技有限公司 | Body posture corrective system and method |
CN102920541A (en) * | 2012-11-27 | 2013-02-13 | 华夏威盛(北京)网络科技有限公司 | Body posture correcting system and body posture correcting method |
CN103093273B (en) * | 2012-12-30 | 2016-05-11 | 信帧电子技术(北京)有限公司 | Based on the video demographic method of body weight for humans identification |
CN103093273A (en) * | 2012-12-30 | 2013-05-08 | 信帧电子技术(北京)有限公司 | Video people counting method based on body weight recognition |
CN103093274A (en) * | 2012-12-30 | 2013-05-08 | 信帧电子技术(北京)有限公司 | Pedestrian counting method based on video |
CN103065128A (en) * | 2012-12-30 | 2013-04-24 | 信帧电子技术(北京)有限公司 | Human body reidentification method in foggy days |
CN103049749A (en) * | 2012-12-30 | 2013-04-17 | 信帧电子技术(北京)有限公司 | Method for re-recognizing human body under grid shielding |
CN103049749B (en) * | 2012-12-30 | 2016-06-29 | 信帧电子技术(北京)有限公司 | The recognition methods again of human body under grid blocks |
CN104103030A (en) * | 2013-04-08 | 2014-10-15 | 佳能株式会社 | Image analysis method, camera apparatus, control apparatus and control method |
CN104103030B (en) * | 2013-04-08 | 2017-05-03 | 佳能株式会社 | Image analysis method, camera apparatus, control apparatus and control method |
CN104050247A (en) * | 2014-06-04 | 2014-09-17 | 上海美琦浦悦通讯科技有限公司 | Method for realizing quick retrieval of mass videos |
CN104050247B (en) * | 2014-06-04 | 2017-08-08 | 上海赛特斯信息科技股份有限公司 | The method for realizing massive video quick-searching |
CN106203458A (en) * | 2015-04-29 | 2016-12-07 | 杭州海康威视数字技术股份有限公司 | Crowd's video analysis method and system |
CN106203458B (en) * | 2015-04-29 | 2020-03-06 | 杭州海康威视数字技术股份有限公司 | Crowd video analysis method and system |
GB2567595A (en) * | 2016-08-08 | 2019-04-17 | Univ Hohai | Memory mimicry guided pattern recognition method |
US10860891B2 (en) * | 2016-08-08 | 2020-12-08 | Hohai University | Memory-guide simulated pattern recognition method |
CN106296736B (en) * | 2016-08-08 | 2019-03-29 | 河海大学 | A kind of mode identification method of imitative memory guidance |
WO2018028102A1 (en) * | 2016-08-08 | 2018-02-15 | 河海大学 | Memory mimicry guided pattern recognition method |
US20190164013A1 (en) * | 2016-08-08 | 2019-05-30 | Hohai University | Memory-guide simulated pattern recognition method |
GB2567595B (en) * | 2016-08-08 | 2022-03-02 | Univ Hohai | Memory-guide simulated pattern recognition method |
CN106296736A (en) * | 2016-08-08 | 2017-01-04 | 河海大学 | The mode identification method that a kind of imitative memory guides |
AU2016418565B2 (en) * | 2016-08-08 | 2020-04-16 | Hohai University | Memory mimicry guided pattern recognition method |
CN111225558A (en) * | 2017-08-07 | 2020-06-02 | 杰克逊实验室 | Long-term and continuous animal behavior monitoring |
US11330804B2 (en) | 2017-08-07 | 2022-05-17 | The Jackson Laboratory | Long-term and continuous animal behavioral monitoring |
US11798167B2 (en) | 2017-08-07 | 2023-10-24 | The Jackson Laboratory | Long-term and continuous animal behavioral monitoring |
CN111225558B (en) * | 2017-08-07 | 2023-08-11 | 杰克逊实验室 | Long-term and continuous animal behavior monitoring |
CN107832708A (en) * | 2017-11-09 | 2018-03-23 | 云丁网络技术(北京)有限公司 | A kind of human motion recognition method and device |
CN114127815A (en) * | 2019-07-26 | 2022-03-01 | 株式会社电装 | Image utilization system in parking |
CN110443187A (en) * | 2019-07-31 | 2019-11-12 | 上海秒针网络科技有限公司 | The recording method of characteristic information and device |
CN110443187B (en) * | 2019-07-31 | 2022-08-26 | 上海秒针网络科技有限公司 | Recording method and device of characteristic information |
CN111310605A (en) * | 2020-01-21 | 2020-06-19 | 北京迈格威科技有限公司 | Image processing method and device, electronic equipment and storage medium |
CN111310605B (en) * | 2020-01-21 | 2023-09-01 | 北京迈格威科技有限公司 | Image processing method and device, electronic equipment and storage medium |
CN111437607B (en) * | 2020-03-20 | 2023-08-18 | 腾讯科技(深圳)有限公司 | Image processing method and device, electronic equipment and computer readable storage medium |
CN111437607A (en) * | 2020-03-20 | 2020-07-24 | 腾讯科技(深圳)有限公司 | Image processing method and device, electronic equipment and computer readable storage medium |
CN113359193A (en) * | 2021-06-01 | 2021-09-07 | 中国人民解放军国防科技大学 | Metal detection method, device, equipment and computer readable storage medium |
CN114724246A (en) * | 2022-04-11 | 2022-07-08 | 中国人民解放军东部战区总医院 | Dangerous behavior identification method and device |
CN114724246B (en) * | 2022-04-11 | 2024-01-30 | 中国人民解放军东部战区总医院 | Dangerous behavior identification method and device |
CN114821805A (en) * | 2022-05-18 | 2022-07-29 | 湖北大学 | Dangerous behavior early warning method, device and equipment |
Also Published As
Publication number | Publication date |
---|---|
CN100583128C (en) | 2010-01-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN100583128C (en) | Real time intelligent control method based on natural video frequency | |
CN110087099B (en) | Monitoring method and system for protecting privacy | |
CN104700434B (en) | A kind of crowd movement track method for detecting abnormality for labyrinth scene | |
CN102004920B (en) | Method for splitting and indexing surveillance videos | |
CN107273822A (en) | A kind of method for secret protection based on monitor video multiple target tracking and recognition of face | |
CN105574506A (en) | Intelligent face tracking system and method based on depth learning and large-scale clustering | |
CN105100718A (en) | Intelligent video analysis method based on video abstraction | |
Singh et al. | IoT based weapons detection system for surveillance and security using YOLOV4 | |
CN102254394A (en) | Antitheft monitoring method for poles and towers in power transmission line based on video difference analysis | |
Gong et al. | Local distinguishability aggrandizing network for human anomaly detection | |
CN111008574A (en) | Key person track analysis method based on body shape recognition technology | |
Dwivedi et al. | Weapon classification using deep convolutional neural network | |
CN109086682A (en) | A kind of intelligent video black smoke vehicle detection method based on multi-feature fusion | |
CN105809206A (en) | Pedestrian tracking method | |
CN109299700A (en) | Subway group abnormal behavior detection method based on crowd density analysis | |
Luo | Research on fire detection based on YOLOv5 | |
Hnoohom et al. | Weapon Detection Using Faster R-CNN Inception-V2 for a CCTV Surveillance System | |
Miao et al. | Abnormal behavior learning based on edge computing toward a crowd monitoring system | |
Li et al. | Application research of artificial intelligent technology in substation inspection tour | |
CN105740814A (en) | Method for determining storage states of solid waste and hazardous waste by using video analysis | |
Beiji et al. | Crime hotspot detection and monitoring using video based event modeling and mapping techniques | |
Chen et al. | Spatiotemporal vehicle tracking: the use of unsupervised learning-based segmentation and object tracking | |
Hao et al. | A detection method of abnormal event in crowds based on image entropy | |
Agrawal et al. | Suspicious event detection in real-time video surveillance system | |
Ma | Multimedia emergency event extraction and modeling based on object detection and bi-lstm network |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20100120 Termination date: 20140612 |
|
EXPY | Termination of patent right or utility model |