CN106446922A - Crowd abnormal behavior analysis method - Google Patents
Crowd abnormal behavior analysis method Download PDFInfo
- Publication number
- CN106446922A CN106446922A CN201510463318.8A CN201510463318A CN106446922A CN 106446922 A CN106446922 A CN 106446922A CN 201510463318 A CN201510463318 A CN 201510463318A CN 106446922 A CN106446922 A CN 106446922A
- Authority
- CN
- China
- Prior art keywords
- crowd
- theta
- characteristic point
- scene
- statistic histogram
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
- G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
- G06V10/758—Involving statistics of pixels or of feature values, e.g. histogram matching
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/23—Clustering techniques
- G06F18/232—Non-hierarchical techniques
- G06F18/2321—Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
- G06F18/2413—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on distances to training or reference patterns
- G06F18/24133—Distances to prototypes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/07—Target detection
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- General Physics & Mathematics (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Evolutionary Biology (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Probability & Statistics with Applications (AREA)
- Computing Systems (AREA)
- Databases & Information Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Software Systems (AREA)
- Multimedia (AREA)
- Image Analysis (AREA)
Abstract
The invention relates to a crowd abnormal behavior analysis method. The method comprises the steps that step one, a monitoring scene image is acquired, and a crowd target in the monitoring scene image is tracked in the form of feature points; step two, movement information of the crowd target is acquired by calculating the change of the position of the feature points; step three, a three-dimensional statistical histogram of the movement information of the current scene is established according to time information and the movement information of the crowd target; step four, the steps one to three are repeated, and hierarchical clustering is performed on multiple three-dimensional statistical histograms so that the representative three-dimensional statistical histograms are acquired and a crowd behavior mode codebook is formed; and step five, similarity measurement is performed on the three-dimensional statistical histogram of the movement information of the current scene and the preset crowd behavior mode codebook so as to judge whether the crowd behaviors of the current scene are normal. The representative behavior modes are excavated out of a large number of statistical movement features to form the crowd behavior mode codebook so that the uncertainty of crowd abnormal behavior detection can be reduced.
Description
Technical field
The present invention relates to computer vision field, more particularly to a kind of crowd's Deviant Behavior analysis method.
Background technology
Using computing technique, the crowd behaviour in scene being launched to automatically analyze is computer vision and public
The important subject in safety-related field.At present, also do not obtained towards individual behavior analysiss
Complete solution is determined, and the analysis to group behavior is then more difficult due to being affected by many extra factors.
In existing research, the crowd behaviour in scene is analyzed with mainly have two kinds of different thinkings.
One is the bottom-up parse method of " based on individuality ".By group behavior is regarded as individual behavior
Organic assembling, when being analyzed to group behavior, first to individual expansion detection therein and tracking,
Then according to the analysis of individual movement track, Deviant Behavior is drawn an inference.In analysis middle and small scale crowd
Behavior when, this kind of method can obtain more satisfied analysis result.But when the colony in scene
Target dimensions are increasing, and mutually blocking between individuality can have a strong impact on detection and the performance followed the tracks of, from
Bottom behavior analysis method upwards will face very big difficulty.Another kind of method is using " of overall importance "
Top down analysis thinking, by regarding target population as an entirety, realizes the target of Group-oriented
Follow the tracks of.On the basis of research in this respect in recent years primarily rests on using particle translation thinking.Logical
Cross one layer of particle of tiling on video pictures, and allow it according to the constraint campaign of optical flow field, overcome
Target detection under dense population scene and follow the tracks of a difficult problem.
In terms of unusual checking, mainly use social force model and calculate interparticle interaction
Power, and the detection to the Deviant Behavior being occurred in scene is realized by the exception of interaction force.Enter
Utilization HOG (Histogram of Oriented Gradient, the histograms of oriented gradients) feature of one step
Description is tracked to characteristic point, and is realized to colony by way of common behavior is modeled in advance
The identification of behavior.Some methods launch modeling analysis from the track of particle point, introduce chaotic invariant
With Training scene model it is achieved that identification to Deviant Behavior.Optimize also by introducing particle bee colony,
Improve the calculating of interaction force in social force model, improve the accuracy rate to Deviant Behavior identification.
Although above method has evaded the technical barrier of individual detection, in the sign side of group behavior
Face still lacks effective modeling approach, and this makes it lack foundation to the analysis of crowd behaviour, to people
There is larger uncertainty in the detection of group's Deviant Behavior.
Content of the invention
In view of the defect existing for above-mentioned prior art, it is an object of the invention to, a kind of people is provided
Group's Deviant Behavior analysis method, to solve the above problems.
To achieve these goals, according to a kind of crowd's Deviant Behavior analysis method proposed by the present invention,
The method includes:
Step one, acquisition monitoring scene image, and with characteristic point form to monitoring scene image in group
Target is tracked;
Step 2, the movable information of target population is obtained by the change in location calculating characteristic point;
Step 3, set up according to the movable information of temporal information and described target population current scene fortune
The three-dimensional statistic histogram of dynamic information;
Multiple described three-dimensional statistic histograms are carried out level and birds of the same feather flock together by step 4, repeat step one to three,
Obtain representative three-dimensional statistic histogram, constitute crowd behaviour pattern code book;
Step 5, by the three-dimensional statistic histogram of current scene movable information and default crowd behaviour mould
Formula code book carries out similarity measurement, judges whether current scene crowd behaviour is normal.
The present invention compared with prior art has clear advantage and beneficial effect.By above-mentioned technical side
Case, crowd's Deviant Behavior analysis method disclosed in this invention, to multiple described three-dimensional statistic histograms
Carry out level to birds of the same feather flock together, obtain representative three-dimensional statistic histogram, constitute crowd behaviour mode code
This.By analysis that the statistical property of group movement feature is launched to birds of the same feather flock together, by representative behavior
Pattern is excavated from a large amount of statistics motion features, constitutes crowd behaviour pattern code book, becomes to group
Body target launches the important evidence of behavior analysiss, reduces the uncertain of the detection to crowd's Deviant Behavior
Property.
Additionally, crowd's Deviant Behavior analysis method disclosed in this invention with characteristic point form to monitoring field
Scape image in group target is tracked, and carries out dynamic level to described characteristic point and birds of the same feather flock together.With dynamic
The method that level is birdsed of the same feather flock together solves " drift " problem of characteristic point, has cleverly evaded institute in crowd's scene
The target detection difficult problem that faces is it is achieved that accurate capture to group movement feature.
Brief description
Fig. 1 is a kind of crowd's Deviant Behavior analysis method schematic diagram disclosed by the invention;
Fig. 2 is that the present invention carries out, to characteristic point, the schematic diagram that dynamic level is birdsed of the same feather flock together.
Specific embodiment
For further illustrating that the present invention is to reach technological means and the work(that predetermined goal of the invention is taken
Effect, below in conjunction with accompanying drawing and preferred embodiment, to according to individual's unusual checking proposed by the present invention
The specific embodiment of method and system, step, structure, feature and its effect describe in detail.
Embodiment one
A kind of present embodiment discloses crowd's Deviant Behavior analysis method, as shown in figure 1, the method bag
Include:
Step one, acquisition monitoring scene image, and with characteristic point form to monitoring scene image in group
Target is tracked.
The present embodiment is that hydromechanical modeling method is applied to crowd to the correlational study of crowd behaviour
Modeling.Its main thought is the individual molecule being regarded as each individuality in colony in fluid, works as crowd
Scale huge enough when, this behavior that approximately just can accurately describe crowd.This analogy
Thinking is equally applicable when tackling tracking problem.
If it can be avoided that the detection to single target, a volume tracing is substituted with the tracking of characteristic point,
With regard to cleverly avoiding the difficult problem carrying out individual detection in crowd.When the density of characteristic point chooses suitable,
Due to its on movement tendency with the individuality similarity of itself, what the motion of characteristic point just can be approximate is anti-
Reflect individual movement state.If whole crowd's scene is all tracked with similar method so that it may
With the real-time kinestate obtaining crowd in scene.This approximate means of tracking is tackling single mesh
Perhaps can there is certain error in timestamp, but when target dimensions constantly rise, say error from the statistical significance
The impact being brought can constantly reduce, and therefore can objectively reflect the kinestate of crowd.
Based on above-mentioned analysis, in the present embodiment, after collecting monitoring scene image, with characteristic point shape
Formula is tracked to monitoring scene image in group target, is embodied in:
Tiling one layer of netted particle (i.e. grid is layouted) on the input picture of a certain frame, one with
In the track cycle, by optical flow method, described characteristic point is tracked.So-called characteristic point is according to image
Size and mesh-density, calculate the position (x, y) in each cross point in grid, the pixel of these positions
Point is chosen for characteristic point.Referred to herein as tracking cycle, refer to the renewal interval T that grid layouts, one
As take T=0.6s, that is, every 15 two field pictures taking the video that frame per second is 25 as a example, follow the tracks of grid update
Once.Follow the tracks of updating of grid and on the one hand ensure that all new objects entering scene can obtain effectively
Detection and tracking, on the other hand, due to the loss of existing characteristics point during following the tracks of, can by updating
Effectively to be supplemented to loss position.
What video monitoring was interested be enter scene foreground target, for prospect outside region, grid
There is certain redundancy in the mode layouted, also therefore bring many unnecessary calculating.Therefore, originally
The in group target of monitoring scene image described in embodiment is tracked process, also includes:
Moving target in monitoring scene image is separated with target context, is extracted moving target.
To reduce feature point number, effectively reduce tracing area.The present embodiment can pass through mixed Gaussian background
Moving target in monitoring scene image is separated by the method for modeling with target context, extracts motion
Target.
Further, it can be seen that spy selected by the mode layouted due to grid during actual tracking
Levy a little not angle point on ordinary meaning (on the violent point of two dimensional image brightness flop or image border curve
The point of curvature maximum), therefore in detection process frame by frame, characteristic point can occur " drift ", and progressively
Assemble in some corner location.On the one hand this convergence can lead to the minimizing of effective tracing positional, another
Aspect can constantly have new characteristic point to produce due to grid renewal, the sum of characteristic point being continuously increased,
Bring very big burden to calculating.
Based on this, birdsed of the same feather flock together by introducing dynamic level, will be apart from less than termination threshold value dthCharacteristic point
Merge, only retain longer characteristic point life cycle.Assume there is N number of spy in current time scene
Levy a little, then initial category number P=N, end of birdsing of the same feather flock together when between class distance is less than and stops threshold value.So,
Described in the present embodiment, process is tracked to monitoring scene image in group target with characteristic point form, also
Including:Carry out dynamic level to described characteristic point to birds of the same feather flock together.
As shown in Fig. 2 described characteristic point is carried out with the process that dynamic level birdss of the same feather flock together specifically including:
Triangle between class distance matrix D under step 11, calculating characteristic pointP×P, wherein, P is characterized a little
Initial category;
Step 12, in Distance matrix DP×PThe middle off diagonal element d finding minimummin=di,j;
Step 13, judge dminWhether more than termination threshold value dth,
(d if notmin≤dth), then by dminThe corresponding categories combination of ranks coordinate (i, j) is a class,
Classification number P subtracts 1, returns to step 11;
If (dmin> dth), then terminate.
Dynamic level birds of the same feather flock together algorithm distance matrix as shown in Table 1, dynamic level algorithm of birdsing of the same feather flock together every time can
Two closest classes are merged, and matrix of adjusting the distance is updated.When algorithm terminates, each
Apoplexy due to endogenous wind life cycle, the longest characteristic point can be retained, and other characteristic points can be deleted.Through such
Process, while effective removal characteristic point redundancy, also filtered out relatively representational characteristic point.
Although the continuous refreshing layouted with grid, characteristic point can be constantly replenished, " blind to eliminate tracking
Area ", but dynamic level birds of the same feather flock together algorithm dynamic constrained under, the quantity of final characteristic point can gradually tend to
Stable.
Table one:
G1 | G2 | G3 | G4 | G5 | G6 | G7 | G8 | |
G1 | 0 | |||||||
G2 | 1.52 | 0 | ||||||
G3 | 3.10 | 2.70 | 0 | |||||
G4 | 5.86 | 6.02 | 3.64 | 0 | ||||
G5 | 4.72 | 4.46 | 1.86 | 1.78 | 0 | |||
G6 | 5.79 | 5.53 | 2.93 | 0.83 | 1.07 | 0 | ||
G7 | 1.32 | 0.88 | 2.24 | 5.14 | 3.96 | 5.03 | 0 | |
G8 | 2.19 | 1.47 | 1.20 | 4.77 | 2.99 | 3.32 | 1.29 | 0 |
The embodiment of the present invention is tracked to monitoring scene image in group target with characteristic point form, and
Carry out dynamic level to described characteristic point to birds of the same feather flock together.Characteristic point is solved with the method that dynamic level is birdsed of the same feather flock together
" drift " problem, has cleverly evaded the target detection difficult problem being faced in crowd's scene it is achieved that right
The accurate capture of group movement feature.
Step 2, the movable information of target population is obtained by the change in location calculating characteristic point.
In addition to color image information, the other information that video monitoring system can provide is very limited.Especially
It is for ubiquitous video surveillance network, due to can not possibly be demarcated for each video camera,
Can only be by some relative information be obtained to the direct process of monitor video.
By way of being layouted with grid, the target population in scene is tracked, we can pass through
The movable information to obtain target population for the change of calculating characteristic point position.
Described movable information includes individual instantaneous velocity amplitude and phase place.Its concrete calculating process is:
By the position that optical flow method traces into ith feature point current time t it isThe t-1 moment
Position be
Calculate current time t, the individual instantaneous velocity of ith feature point:
Wherein,For ith feature point t, along X-direction instantaneous velocity,For
I characteristic point t, along Y direction instantaneous velocity.
Obtain current time t, the individual instantaneous velocity amplitude of ith feature point
Obtain current time t, the phase place of ith feature point
After the statistical information obtaining feature spot moving direction, scene motion can be calculated further complicated
Degree (entropy) Esce, this parameter is dimensionless number, reflects the confusion degree of group behavior in scene,
Its computing formula is:
In formula, Q is the number of direction of motion demarcation interval,It is in institute shared by this interval sample of moment t
There is the percentage ratio of interval sample.Giving part prior information (the such as general scale of scene) further
On the premise of, then the feature detection of some pedestrians in addition, the motion feature using characteristic point can also be estimated
Count some extra information, such as the individual amount P in scene and effective foreground area.
In addition to above-mentioned movable information, described movable information also includes:Individual instantaneous acceleration, individuality are flat
All speed, individual average acceleration, the average instantaneous velocity of scene and scene average accelerations.
Wherein, the intensity of variation of current time t and t-1 moment speed, i.e. current time t, i-th
The calculating process of the individual instantaneous acceleration of characteristic point is:
Wherein,For ith feature point t, along X-direction instantaneous acceleration,For
Ith feature point t, along Y direction instantaneous acceleration.
For characteristic point, its individual average speed reflects the motion feelings of characteristic point under normal circumstances
Condition, has more reference value compared to instantaneous velocity or instantaneous acceleration in some applications.To individual flat
The calculating of equal speed, needs to calculate the meansigma methodss of some its instantaneous velocitys of moment in the past.For eliminating difference
What the adjacent addition of equation brought offsets in front and back, when calculating average movement velocity it is considered to when passing by M
The transient motion speed carved, takes interval sampling strategy.
So, M moment, the individual average speed of ith feature point:
Wherein,For ith feature point M moment, along X-direction average speed,
For ith feature point M moment, along Y direction average speed, δjFor parity identifier:
In M moment, the calculating process of the individual average acceleration of ith feature point is:
Wherein,For ith feature point M moment, along X-direction average acceleration,
For ith feature point M moment, along Y direction average acceleration, δjFor parity identifier.
Current time t, the average instantaneous velocity of scene of all characteristic points (characteristic point group) can be by meter
Calculate all being worth to of current time each feature spot speed:
Wherein, N is characterized a number,For all characteristic points t, along X-direction field
The average instantaneous velocity of scape,For all characteristic points in t, averagely instantaneous along the scene of Y direction
Speed.
Current time t, the scene average acceleration of all characteristic points can be by calculating each spy of current time
Levy all being worth to of an acceleration:
Wherein, N is characterized a number,For all characteristic points t, along X-direction field
Scape average acceleration,For all characteristic points t, along Y direction scene average acceleration.
Above-mentioned movable information integrates and can represent ith feature point in moment t, comprises individual instantaneous
Speed, individual instantaneous velocity amplitude, phase place, individual instantaneous acceleration, individual average speed, individuality
Average acceleration and (T life cyclei) movable information set
Assume the N number of trace point of presence in moment t scene, with ZtRepresent the set of trace point, then:
Step 3, set up according to the movable information of temporal information and described target population current scene fortune
The three-dimensional statistic histogram of dynamic information.
In movable information setMiddle extraction instantaneous velocity amplitude and phase information, then this step specifically wrap
Include:
Calculate in t, whole scene characteristic point group velocity amplitude averageAnd variance
Wherein, N is characterized number a little.
According to statistical law, most of sample is typically distributed across the three times standard deviation scope about its average
Within, therefore can obtain the distributed area [V of described characteristic point group velocity amplitude averagemin,Vmax]:
In interval [Vmin,Vmax] in, in the form of statistic histogram, investigate trace point velocity amplitude in scene
The distribution character of average.From the angle of parallel computation simplicity, histogrammic dimension K typically takes 2
Integral number power, its selection standard:One be intended to make sample value be distributed in interval as uniform as possible, it is to avoid
Because the too small distribution character leading to of K value is inconspicuous;Two be intended to avoid K value excessive and lead to noise
Interference is excessively sensitive.According to the observation to sample, the present embodiment takes K=16, you can with preferably full
Sufficient above-mentioned two condition, thus can obtain interval the drawing of described characteristic point group velocity amplitude distribution of mean value
Divide interval:
Wherein K is histogrammic dimension.
According to described characteristic point group velocity amplitude distribution of mean value interval wink individual to described ith feature point
When velocity amplitudeVoted, then had:
Fall into the quantity of each interval characteristic point by statistics, and be recorded in statistic histogram,
Just obtain the statistic histogram of individual instantaneous velocity amplitude.
Calculate described characteristic point group phase place averageAnd variance
Obtain the distributed area [θ of described characteristic point group phase place averagemin,θmax]:
The distributed area of phase place average typically exists
In the range of -1.6 radians to 1.6 radians.
Obtain the interval division interval of described characteristic point group phase place distribution of mean value:
Wherein K is histogrammic dimension.
According to characteristic point group phase place distribution of mean value interval, described ith feature point phase place is voted, then
Have:
Statistics falls into each characteristic point group velocity amplitude distribution of mean value interval and characteristic point group phase place average area
Between feature point number, and record, generate the statistics Nogata including individuality instantaneous velocity amplitude and phase place
Figure;
Within M moment, extend the described system including instantaneous velocity and phase place average sequentially in time
Meter rectangular histogram, builds three-dimensional statistic histogram H (k) with regard to time, velocity amplitude and phase place, k=
1 ..., the initial value of K is 0.
Multiple described three-dimensional statistic histograms are carried out level and birds of the same feather flock together by step 4, repeat step one to three,
Obtain representative three-dimensional statistic histogram, constitute crowd behaviour pattern code book.
In video monitoring, the core launching behavior analysiss to large-scale crowd is its movement tendency is made
Go out rational deciphering.The tracking layouted by grid, the tracking to target population is effectively evaded
A difficult problem for individual detection, and obtain the exercise data of a large amount of characteristic points.These data reflect indirectly
The movement tendency of target population, under different crowd's scenes, the movement tendency of colony exists certain
How difference, effectively excavated to it, becomes the key of group behavior analysis.
The present embodiment is from the statistics kinetic characteristic of characteristic point group it is proposed that being moved based on Demographics
The group behavior analysis method of feature modeling.By the motion feature of characteristic point group in scene is distributed into
Row is rational to be analyzed, and excavates representative motor pattern from substantial amounts of statistics motion feature
Come, form the code book of crowd behaviour pattern.The code book of described crowd behaviour pattern is the row of target population
Provide benchmark for analysis.Set out by the similarity of subordinate act pattern, building group behavior
Modulus problem is converted into pattern classification problem, also reduces the complexity of problem.
If statistic histogram is regarded as certain characteristic point in higher dimensional space, its distribution in space
Some rules should be met.For example, the video length of certain railway station video is about 4000 frames, takes front 500
Frame, as training data, the method birdsed of the same feather flock together with level, investigates statistic histogram information in training video
Space distribution situation.Characteristic dimension in view of statistic histogram is not high, thus using euclidean away from
Distance metric between as characteristic point.
So, step 4 specifically includes:
Repeat step one to three, obtains multiple three-dimensionals statistic histogram H (k), k=1 ..., K.
For statistic histogram, its satisfactionWherein N is characterized a number, then
To three-dimensional statistic histogram H (k), k=1 ..., K is normalized according to Euclidean distance:
K=1 ..., K, eliminates feature point number N and changes to statistics with histogram
The interference of amount;
Calculate any two current scene three-dimensional statistic histogram Hi(k) and HjEuclidean between (k) away from
From Di,j:
According to described Euclidean distance Di,jCarry out level to described three-dimensional statistic histogram to birds of the same feather flock together.According to
Distance relation between three-dimensional statistic histogram, the characteristic point in higher dimensional space can be birdsed of the same feather flock together by level
Method is gradually attributed to several classes.If each class sample is characterized by its center of birdsing of the same feather flock together,
These centers of birdsing of the same feather flock together just reflect some specific behaviors of target population in scene.To these behavioral pattern
Excavation, become crowd behaviour analysis key.It is a kind of unsupervised, data-driven that level is birdsed of the same feather flock together
Mathematical method.Due to the particular number of crowd behaviour pattern in scene cannot be given, with crowd field
The difference of scape, the quantity of behavior mode of population there is also different.Accordingly, it would be desirable to be closed by design
The criterion of birdsing of the same feather flock together of reason, obtains result of objectively birdsing of the same feather flock together as far as possible.
For different scenes, the setting that algorithm of birdsing of the same feather flock together stops threshold value depends on the son to tree-shaped analysis chart
Thin research.Too high termination threshold value can lead to the sign of behavioral pattern to tend to general, and too low termination
Threshold value then can lead to the representative of single behavioral pattern to decline because of increasing of center of birdsing of the same feather flock together, and is easily subject to
The interference of noise.It is true that having when actual analysis are carried out to crowd behaviour it is found that in scene
There is the behavior mode of population generally 3 to 5 of notable sample number advantage.Remaining behavioral pattern is due to sample
This number is less, does not have stronger representativeness.Therefore, when carrying out birdsing of the same feather flock together analysis, the present embodiment
Substituted based on the method for birdsing of the same feather flock together stopping threshold value by way of artificially specifying classification number M.Set classification
Number is M, chooses E three-dimensional statistic histogram, E>M>3, then birds of the same feather flock together algorithm cluster according to level
Have:
TE×1=cluster (AE×K,M);
Wherein, E is three-dimensional statistic histogram sample size, TE×1For record birds of the same feather flock together result E × 1 arrange to
Amount, AE×KFor multiple described three-dimensional statistic histogram matrixes, K is three-dimensional statistic histogram dimension.
Obtain current scene crowd behaviour pattern in meet described level birds of the same feather flock together rule representative sexual behaviour mould
Formula three-dimensional statistic histogram:
H1, H2, H3..., HM;
Then front scene crowd behaviour pattern code book CBsceFor:
CBsce={ H1,H2,H3,…,HM}.
The Major Difficulties of crowd behaviour analysis are to lack effective criterion.By to statistics motion
Characteristic is launched to birds of the same feather flock together analysis, can be by representative statistics Nogata from a large amount of initial datas
Figure is excavated.As can be seen that these statistic histograms reflect occur in scene some specific
Crowd behaviour, these representative behavioral pattern are collected by the present embodiment, in answering afterwards
With in, just as benchmark in scene occur crowd behaviour make measurement.Crowd behaviour mode code
Originally it is the set of most representational Demographics' motion feature in scene.Consistent, the people with criterion of birdsing of the same feather flock together
M statistic histogram is comprised altogether, insufficient section is with null vector H in group's behavioral pattern code book0Polishing.
Step 5, by the three-dimensional statistic histogram of current scene movable information and default crowd behaviour mould
Formula code book carries out similarity measurement, judges whether current scene crowd behaviour is normal.
Crowd behaviour pattern code book is that the base providing measurement is analyzed in the crowd behaviour based on video monitoring
Accurate.After obtaining the crowd behaviour pattern code book of scene, current scene that each is collected
Three-dimensional statistic histogram Hi, first with crowd behaviour pattern code book and current scene three-dimensional statistics Nogata
Figure HiEuclidean distance sample is classified:
That is, calculate current scene three-dimensional statistic histogram HiWith crowd behaviour pattern codebook vectors
CBsce={ H1,H2,H3,…,HMBetween Euclidean distance, and choose with minimum Euclideam distance
Crowd behaviour pattern codebook vectors CBsce(f):
minfEuDistance(CBsce(f),Hi), i.e. front scene three-dimensional statistic histogram HiWith there is minimum Europe
Crowd behaviour pattern codebook vectors CB of distance are obtained in severalsceF () is same class.
Calculate crowd behaviour pattern codebook vectors CBsce(f) and current scene three-dimensional statistic histogram HiBetween
Pasteur is apart from d (Hi,Hf):
Wherein, HfFor crowd's behavioral pattern codebook vectors CBsceThree-dimensional statistic histogram corresponding to (f),
K is rectangular histogram dimension.Crowd behaviour pattern codebook vectors CBsce(f) and current scene three-dimensional statistics Nogata
Figure HiBetween Pasteur distance i.e. as current scene three-dimensional statistic histogram HiWith crowd behaviour pattern code book
Vectorial CBsceF the similarity measurement between (), its span is [0,1].Described Pasteur is apart from d (Hi,Hf)
Value is less, current scene three-dimensional statistic histogram HiWith crowd behaviour pattern codebook vectors CBsceBetween (f)
Similarity is higher.
Relatively described Pasteur is apart from d (Hi,Hf) and predetermined threshold value, if described Pasteur is apart from d (Hi,Hf) less
In predetermined threshold value, then judge that current scene crowd behaviour is normal;
If described Pasteur is apart from d (Hi,Hf) be more than predetermined threshold value, then judge that current scene crowd behaviour is different
Often.
Wherein, the setting of described threshold value is by estimating to normal population developing scenes video analysis,
Threshold value described in the present embodiment is the meansigma methodss of Pasteur's distance between 2 times of any two stereogram.
Crowd's Deviant Behavior analysis method disclosed in this invention, to multiple described three-dimensional statistic histograms
Carry out level to birds of the same feather flock together, obtain representative three-dimensional statistic histogram, constitute crowd behaviour mode code
This.By analysis that the statistical property of group movement feature is launched to birds of the same feather flock together, by representative behavior
Pattern is excavated from a large amount of statistics motion features, constitutes crowd behaviour pattern code book, becomes to group
Body target launches the important evidence of behavior analysiss, reduces the uncertain of the detection to crowd's Deviant Behavior
Property.
Although the present invention is disclosed above with preferred embodiment, so it is not limited to present invention enforcement
Scope, the simple equivalence changes made according to claims of the present invention and description and modification,
Still fall within the range of technical solution of the present invention.
Claims (10)
1. a kind of crowd's Deviant Behavior analysis method is it is characterised in that include:
Step one, acquisition monitoring scene image, and with characteristic point form to monitoring scene image in group
Target is tracked;
Step 2, the movable information of target population is obtained by the change in location calculating characteristic point;
Step 3, set up according to the movable information of temporal information and described target population current scene fortune
The three-dimensional statistic histogram of dynamic information;
Multiple described three-dimensional statistic histograms are carried out level and birds of the same feather flock together by step 4, repeat step one to three,
Obtain representative three-dimensional statistic histogram, constitute crowd behaviour pattern code book;
Step 5, the three-dimensional statistic histogram to current scene movable information and default crowd behaviour mould
Formula code book carries out similarity measurement, judges whether current scene crowd behaviour is normal.
2. according to claim 1 crowd's Deviant Behavior analysis method it is characterised in that described with
The process that characteristic point form will be tracked to current monitoring scene image in group target, including:
One layer of netted particle of tiling, on the input picture of a certain frame, in a tracking cycle, passes through
Optical flow method is tracked to described characteristic point.
3. according to claim 1 crowd's Deviant Behavior analysis method it is characterised in that described fortune
Dynamic information includes individual instantaneous velocity amplitude and phase place.
4. according to claim 3 crowd's Deviant Behavior analysis method it is characterised in that described step
Rapid two, including:
By the position that optical flow method traces into ith feature point current time t it isThe t-1 moment
Position be
Calculate current time t, the individual instantaneous velocity of ith feature point:
Wherein,For ith feature point t, along X-direction instantaneous velocity,For
I characteristic point t, along Y direction instantaneous velocity;
Obtain current time t, the individual instantaneous velocity amplitude of ith feature point
Obtain current time t, the phase place of ith feature point
5. according to claim 4 crowd's Deviant Behavior analysis method it is characterised in that described fortune
Dynamic information also includes:
Individual instantaneous acceleration, individual average speed, individual average acceleration, scene are averagely instantaneously fast
Degree and scene average acceleration.
6. according to claim 4 crowd's Deviant Behavior analysis method it is characterised in that described step
Rapid three, including:
Calculate in t, whole scene characteristic point group velocity amplitude averageAnd variance
Wherein, N is characterized number a little;
Obtain the distributed area [V of described characteristic point group velocity amplitude averagemin,Vmax]:
Obtain the interval division interval of described characteristic point group velocity amplitude distribution of mean value:
Wherein K is histogrammic dimension;
Interval instantaneously fast to ith feature point individuality according to described characteristic point group velocity amplitude distribution of mean value
Degree amplitude is voted, then have:
Calculate described characteristic point group phase place averageAnd variance
Obtain the distributed area [θ of described characteristic point group phase place averagemin,θmax]:
Obtain the interval division interval of described characteristic point group phase place distribution of mean value:
Wherein K is histogrammic dimension;
According to characteristic point group phase place distribution of mean value interval, described ith feature point phase place is voted, then
Have:
Statistics falls into each characteristic point group velocity amplitude distribution of mean value interval and characteristic point group phase place average area
Between feature point number, and record, generate the statistics Nogata including individuality instantaneous velocity amplitude and phase place
Figure;
Within M moment, the described statistics including instantaneous velocity and phase place that extends sequentially in time is straight
Fang Tu, builds three-dimensional statistic histogram H (k) with regard to time, individual instantaneous velocity amplitude and phase place, k
=1 ..., the initial value of K is 0.
7. according to claim 6 crowd's Deviant Behavior analysis method it is characterised in that described step
Rapid four, including:
Acquisition multiple three-dimensional statistic histograms H (k), k=1 ..., K;
To three-dimensional statistic histogram H (k), k=1 ..., K is normalized according to Euclidean distance:
Calculate any two current scene three-dimensional statistic histogram Hi(k) and HjEuclidean between (k) away from
From Di,j:
According to described Euclidean distance Di,jCarry out level to described three-dimensional statistic histogram to birds of the same feather flock together, and set
Determine classification number M, then:
TE×1=cluster (AE×K, M),
Wherein, E is three-dimensional statistic histogram sample size, TE×1For record birds of the same feather flock together result E × 1 arrange to
Amount, AE×KFor multiple described three-dimensional statistic histogram matrixes;
Obtain current scene crowd behaviour pattern in meet described level birds of the same feather flock together rule representative sexual behaviour mould
Formula three-dimensional statistic histogram:
H1, H2, H3..., HM;
Then front scene crowd behaviour pattern code book CBsceFor:
CBsce={ H1,H2,H3,…,HM}.
8. according to claim 7 crowd's Deviant Behavior analysis method it is characterised in that described step
Rapid five include:
Calculate current scene three-dimensional statistic histogram HiWith crowd behaviour pattern codebook vectors
CBsce={ H1,H2,H3,…,HMBetween Euclidean distance, and choose with minimum Euclideam distance
Crowd behaviour pattern codebook vectors CBsce(f):
minfEuDistance(CBsce(f),Hi);
Calculate crowd behaviour pattern codebook vectors CBsce(f) and current scene three-dimensional statistic histogram HiBetween
Pasteur is apart from d (Hi,Hf):
Wherein, HfFor crowd's behavioral pattern codebook vectors CBsceThree-dimensional statistic histogram corresponding to (f);
Relatively described Pasteur is apart from d (Hi,Hf) and predetermined threshold value, if described Pasteur is apart from d (Hi,Hf) less
In predetermined threshold value, then judge that current scene crowd behaviour is normal;
If described Pasteur is apart from d (Hi,Hf) be more than predetermined threshold value, then judge that current scene crowd behaviour is abnormal.
9. according to claim 2 crowd's Deviant Behavior analysis method it is characterised in that described with
Characteristic point form is tracked process to monitoring scene image in group target, also includes:
Moving target in monitoring scene image is separated with target context, is extracted moving target.
10. according to claim 2 crowd's Deviant Behavior analysis method it is characterised in that described with
Characteristic point form is tracked process to monitoring scene image in group target, also includes:To described spy
Levy click-through Mobile state level to birds of the same feather flock together.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510463318.8A CN106446922B (en) | 2015-07-31 | 2015-07-31 | A kind of crowd's abnormal behaviour analysis method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510463318.8A CN106446922B (en) | 2015-07-31 | 2015-07-31 | A kind of crowd's abnormal behaviour analysis method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106446922A true CN106446922A (en) | 2017-02-22 |
CN106446922B CN106446922B (en) | 2019-10-22 |
Family
ID=59216334
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510463318.8A Active CN106446922B (en) | 2015-07-31 | 2015-07-31 | A kind of crowd's abnormal behaviour analysis method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106446922B (en) |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106874885A (en) * | 2017-03-03 | 2017-06-20 | 燕山大学 | A kind of crowd's method for detecting abnormality based on energy level changes in distribution |
CN108363988A (en) * | 2018-03-09 | 2018-08-03 | 燕山大学 | A kind of people counting method of combination characteristics of image and hydrodynamics characteristic |
CN109977856A (en) * | 2019-03-25 | 2019-07-05 | 中国科学技术大学 | Complex behavior knows method for distinguishing in a kind of multisource video |
CN110415277A (en) * | 2019-07-24 | 2019-11-05 | 中国科学院自动化研究所 | Based on light stream and the multi-target tracking method of Kalman filtering, system, device |
CN110837529A (en) * | 2019-11-27 | 2020-02-25 | 王培根 | Big data analysis monitoring method and device, server and readable storage medium |
CN111401220A (en) * | 2020-03-12 | 2020-07-10 | 重庆特斯联智慧科技股份有限公司 | Crowd aggregation characteristic analysis method and system for intelligent security |
CN111612120A (en) * | 2020-05-11 | 2020-09-01 | 中国电子科技集团公司电子科学研究院 | Group abnormal behavior detection method and device based on fuzzy clustering algorithm |
CN112506908A (en) * | 2020-12-10 | 2021-03-16 | 云南电网有限责任公司玉溪供电局 | Electric energy metering data cleaning method and system |
CN113112528A (en) * | 2021-04-26 | 2021-07-13 | 中南财经政法大学 | Abnormal behavior monitoring method, device, equipment and storage medium |
CN113436458A (en) * | 2020-03-08 | 2021-09-24 | 广东毓秀科技有限公司 | Intelligent bus dispatching method |
CN113469080A (en) * | 2021-07-08 | 2021-10-01 | 中国科学院自动化研究所 | Individual, group and scene interactive collaborative perception method, system and equipment |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102799873A (en) * | 2012-07-23 | 2012-11-28 | 青岛科技大学 | Human body abnormal behavior recognition method |
CN103077401A (en) * | 2012-12-27 | 2013-05-01 | 深圳市赛为智能股份有限公司 | Method and system for detecting context histogram abnormal behaviors based on light streams |
CN104123544A (en) * | 2014-07-23 | 2014-10-29 | 通号通信信息集团有限公司 | Video analysis based abnormal behavior detection method and system |
CN104700086A (en) * | 2015-03-20 | 2015-06-10 | 清华大学 | Excavating method of topic actions of man-machine interaction for video analysis |
CN104732236A (en) * | 2015-03-23 | 2015-06-24 | 中国民航大学 | Intelligent crowd abnormal behavior detection method based on hierarchical processing |
CN105023019A (en) * | 2014-04-17 | 2015-11-04 | 复旦大学 | Characteristic description method used for monitoring and automatically detecting group abnormity behavior through video |
-
2015
- 2015-07-31 CN CN201510463318.8A patent/CN106446922B/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102799873A (en) * | 2012-07-23 | 2012-11-28 | 青岛科技大学 | Human body abnormal behavior recognition method |
CN103077401A (en) * | 2012-12-27 | 2013-05-01 | 深圳市赛为智能股份有限公司 | Method and system for detecting context histogram abnormal behaviors based on light streams |
CN105023019A (en) * | 2014-04-17 | 2015-11-04 | 复旦大学 | Characteristic description method used for monitoring and automatically detecting group abnormity behavior through video |
CN104123544A (en) * | 2014-07-23 | 2014-10-29 | 通号通信信息集团有限公司 | Video analysis based abnormal behavior detection method and system |
CN104700086A (en) * | 2015-03-20 | 2015-06-10 | 清华大学 | Excavating method of topic actions of man-machine interaction for video analysis |
CN104732236A (en) * | 2015-03-23 | 2015-06-24 | 中国民航大学 | Intelligent crowd abnormal behavior detection method based on hierarchical processing |
Non-Patent Citations (3)
Title |
---|
HIBA H. ALQAYSI.ETC: "Detection of Abnormal behavior in Dynamic Crowded Gatherings", 《2013 IEEE APPLIED IMAGERY PATTERN RECOGNITION WORKSHOP》 * |
周洁等: "基于粒子熵值的异常行为检测", 《无线电子通信技术》 * |
苏理云等: "《SPSS 19统计分析基础与案例应用教程》", 30 November 2012 * |
Cited By (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106874885A (en) * | 2017-03-03 | 2017-06-20 | 燕山大学 | A kind of crowd's method for detecting abnormality based on energy level changes in distribution |
CN106874885B (en) * | 2017-03-03 | 2020-10-16 | 燕山大学 | Crowd abnormity detection method based on energy level distribution change |
CN108363988A (en) * | 2018-03-09 | 2018-08-03 | 燕山大学 | A kind of people counting method of combination characteristics of image and hydrodynamics characteristic |
CN109977856A (en) * | 2019-03-25 | 2019-07-05 | 中国科学技术大学 | Complex behavior knows method for distinguishing in a kind of multisource video |
CN109977856B (en) * | 2019-03-25 | 2023-04-07 | 中国科学技术大学 | Method for identifying complex behaviors in multi-source video |
CN110415277A (en) * | 2019-07-24 | 2019-11-05 | 中国科学院自动化研究所 | Based on light stream and the multi-target tracking method of Kalman filtering, system, device |
CN110415277B (en) * | 2019-07-24 | 2022-03-08 | 中国科学院自动化研究所 | Multi-target tracking method, system and device based on optical flow and Kalman filtering |
CN110837529A (en) * | 2019-11-27 | 2020-02-25 | 王培根 | Big data analysis monitoring method and device, server and readable storage medium |
CN113436458A (en) * | 2020-03-08 | 2021-09-24 | 广东毓秀科技有限公司 | Intelligent bus dispatching method |
CN111401220A (en) * | 2020-03-12 | 2020-07-10 | 重庆特斯联智慧科技股份有限公司 | Crowd aggregation characteristic analysis method and system for intelligent security |
CN111612120A (en) * | 2020-05-11 | 2020-09-01 | 中国电子科技集团公司电子科学研究院 | Group abnormal behavior detection method and device based on fuzzy clustering algorithm |
CN112506908A (en) * | 2020-12-10 | 2021-03-16 | 云南电网有限责任公司玉溪供电局 | Electric energy metering data cleaning method and system |
CN113112528A (en) * | 2021-04-26 | 2021-07-13 | 中南财经政法大学 | Abnormal behavior monitoring method, device, equipment and storage medium |
CN113469080A (en) * | 2021-07-08 | 2021-10-01 | 中国科学院自动化研究所 | Individual, group and scene interactive collaborative perception method, system and equipment |
Also Published As
Publication number | Publication date |
---|---|
CN106446922B (en) | 2019-10-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106446922A (en) | Crowd abnormal behavior analysis method | |
CN108550161B (en) | Scale self-adaptive kernel-dependent filtering rapid target tracking method | |
CN109344736B (en) | Static image crowd counting method based on joint learning | |
CN108216252B (en) | Subway driver vehicle-mounted driving behavior analysis method, vehicle-mounted terminal and system | |
CN106875424B (en) | A kind of urban environment driving vehicle Activity recognition method based on machine vision | |
CN106845621B (en) | Dense population number method of counting and system based on depth convolutional neural networks | |
CN102156880B (en) | Method for detecting abnormal crowd behavior based on improved social force model | |
CN103390278B (en) | A kind of video unusual checking system | |
CN110276264B (en) | Crowd density estimation method based on foreground segmentation graph | |
CN107748873A (en) | A kind of multimodal method for tracking target for merging background information | |
CN102592138B (en) | Object tracking method for intensive scene based on multi-module sparse projection | |
CN103440668B (en) | Method and device for tracing online video target | |
CN107657226A (en) | A kind of Population size estimation method based on deep learning | |
CN103096185B (en) | A kind of video abstraction generating method and device | |
CN108052859A (en) | A kind of anomaly detection method, system and device based on cluster Optical-flow Feature | |
CN103854027A (en) | Crowd behavior identification method | |
CN102799646B (en) | A kind of semantic object segmentation method towards multi-view point video | |
CN109685045A (en) | A kind of Moving Targets Based on Video Streams tracking and system | |
CN105046714A (en) | Unsupervised image segmentation method based on super pixels and target discovering mechanism | |
CN106815563A (en) | A kind of crowd's quantitative forecasting technique based on human body apparent structure | |
CN107832716A (en) | Method for detecting abnormality based on active-passive Gauss on-line study | |
CN102314591B (en) | Method and equipment for detecting static foreground object | |
CN108629327A (en) | A kind of demographic method and device based on image procossing | |
CN108830882A (en) | Video abnormal behaviour real-time detection method | |
CN109684986A (en) | A kind of vehicle analysis method and system based on automobile detecting following |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |