CN103400142B - A kind of pedestrian counting method - Google Patents
A kind of pedestrian counting method Download PDFInfo
- Publication number
- CN103400142B CN103400142B CN201310178122.5A CN201310178122A CN103400142B CN 103400142 B CN103400142 B CN 103400142B CN 201310178122 A CN201310178122 A CN 201310178122A CN 103400142 B CN103400142 B CN 103400142B
- Authority
- CN
- China
- Prior art keywords
- pedestrian
- foreground pixel
- represent
- area
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Landscapes
- Image Analysis (AREA)
Abstract
The present invention discloses the pedestrian counting method of a kind of computer video processing technology field, and step is: monitor video carries out pedestrian's foreground pixel and the extraction of light stream feature; Then the foreground pixel feature extracted is normalized; Carry out pedestrian's occlusion detection simultaneously and block hierarchical estimation; Comprehensive pedestrian's characteristic sum blocks grade, Statistics Bar people's number. The feature that the present invention gets over line pedestrian by statistics carries out people stream counting, thus avoids pedestrian detection process; The ROI region of statistical computation simultaneously around virtual door carries out, and decreases calculated amount; Finally by carrying out pedestrian's occlusion detection and block hierarchical estimation, it is to increase there is being the counting accuracy rate in the situation of blocking.
Description
Technical field
The invention belongs to computer video processing technology field, it is specially a kind of pedestrian counting method, especially design a kind of pedestrian's more line method of counting being suitable for monitoring application.
Background technology
At present, people counting technology plays more and more important effect in monitoring, pedestrian monitor especially in key monitoring object.
People counting based on pedestrian detection and the people counting based on pixels statistics are two kinds of common pedestrian counting methods. But the pedestrian counting method based on pedestrian detection needs all to detect the pedestrian in scene usually, thus carry out counting (see: BoWu, R.Nevatia. " Detectionofmultiple; partiallyoccludedhumansinasingleimagebyBayesiancombinati onofedgeletpartdetectors; " ICCV2005, TenthIEEEInternationalConferenceon, 1:90 97,2005.) thus its calculated amount is bigger, real-time is relatively poor, can not directly apply to real-time monitoring system. The traditional pedestrian counting method based on pixels statistics (see: Lee, G.G., Kim, B.S., Kim, W.Y. " AutomaticEstimationofPedestrianFlow. " ACM/IEEEInternationalConferenceonDistributedSmartCameras, 291 296,2007.) pedestrian number information is obtained by pedestrian's feature is carried out statistical computation, thus avoid pedestrian detection process, decrease the complexity of computing, but it does not consider the situation of blocking, thus causing when there being pedestrian to block generation, the accuracy of counting reduces.
Summary of the invention
It is an object of the invention to overcome above-mentioned the deficiencies in the prior art part, it is proposed to a kind of new pedestrian counting method, the method is under the jurisdiction of the pedestrian counting method based on pixels statistics, avoids pedestrian detection process, decreases calculated amount; Add pedestrian's occlusion detection simultaneously and block hierarchical estimation, block the counting loss caused because of pedestrian for dynamic compensation, it is to increase the accuracy of people counting.
For achieving the above object, the technical solution used in the present invention is: monitor video carries out pedestrian's foreground pixel and the extraction of light stream feature; Then the foreground pixel extracted is normalized; Carry out pedestrian's occlusion detection simultaneously and block hierarchical estimation; Comprehensive pedestrian's characteristic sum blocks grade, Statistics Bar people's number. Confirming through experiment, the present invention has higher accuracy for the people counting under monitoring scene, and real-time meets bayonet socket monitoring device requirement.
The inventive method specifically comprises the following steps:
The first step: monitor video is carried out mixed Gaussian background modeling, obtains pedestrian's prospect image.
2nd step: extract pedestrian's light stream feature.
3rd step: pedestrian's foreground pixel feature normalization.
Concrete steps are: adopt the oval modeling of pedestrian, be mapped to an ellipse according to its area size according to Elliptic Mappings rule by each pedestrian, this ellipse area is considered as pedestrian eiArea in current camera perspective, is designated as area (ei), to each foreground pixel belonging to this pedestrian, its corresponding normalization coefficient wi=1/area(ei)��
4th step, pedestrian's occlusion detection and block hierarchical estimation.
Concrete steps are:
1. pedestrian's occlusion detection and block hierarchical estimation, its method is:
X represents pedestrian's foreground pixel, blobiRepresenting pedestrian foreground pixel UNICOM region, �� (x) represents the shaded coefficient of foreground pixel x, and �� (x) is more big, shows that current scene blocks grade more high. siRepresent that pedestrian's foreground pixel is connected region blobiProjecting length on virtual door, hiRepresent that pedestrian's foreground pixel is connected region blobiIn the projecting length being perpendicular on virtual door, ROI represents area-of-interest selected on image, AROIRepresent the image area of area-of-interest. h0Represent pedestrian's center line average on the image plane, h0iRepresent the h after projection correction0��
2. pedestrian level projection correction, its method is:
Make the projection transform function that f represents between image coordinate system and world's system of coordinates, H0Represent the average pedestrian level under world's system of coordinates, siRepresent that pedestrian's foreground pixel is connected region blobiProjecting length on virtual door, p0Represent siMid point, its two dimensional image coordinate isThree-dimensional world coordinate is (X0,Y0,Z0), the two dimensional image coordinate of order point p isIts world's coordinate is (Xp,Yp,Zp)=(X0,Y0,Z0+H0), then line segmentAt the projection h being perpendicular on virtual door direction0iIt is the pedestrian's center line average after projection correction.
Preferably, pedestrian level projection correction concrete steps are:
(1) calculation level p0Three-dimensional coordinate under world's system of coordinates.
(2) three-dimensional coordinate of calculation level p under world's system of coordinates.
(3) two-dimensional coordinate of calculation level p under image coordinate system.
(4) line segment is calculatedAt the projection h being perpendicular on virtual door direction0i��
5th step: in conjunction with second and third, the normalization characteristic that obtains of four steps and block grade, obtain people's flow amount.
Concrete grammar is:
Wherein, flow (i) represents the more line number of pixels of the i-th frame, and x is the pixel on virtual door Gate, a is fixing constant, for correcting pedestrian's Elliptic Mappings so that ellipse area, closer to true pedestrian, is taken as 0.925 usually, w (x) is then for overcoming pick up camera perspective effect, namely the normalization coefficient obtained in step 3, the prospect that FG (x) is pixel differentiates result, if prospect, it is then 1, otherwise it is 0.For the motion vector modulus value of current pixel, ��vxIt is then the angle of the current pixel virtual door of motion vector sum, by sin (��vx) symbol can judge pedestrian direction. a0For fixing constant, for limiting the peak value scope blocking compensation, usually get the shaded coefficient that 0.5, �� (x) represents the foreground pixel x obtained in step 4.
Compared with prior art, the present invention has following useful effect:
1) the present invention is a kind of pedestrian counting method based on pixels statistics, avoids pedestrian detection process, decreases calculated amount; 2) add pedestrian's occlusion detection and block hierarchical estimation, block the counting loss caused because of pedestrian for dynamic compensation, it is to increase the accuracy of people counting; 3) pedestrian's feature is extracted and is only carried out in specific area-of-interest with demographics, avoids full figure is carried out computing, it is possible to reduce computational complexity further. The people counting that the present invention is particularly useful under monitoring scene.
Accompanying drawing explanation
By reading with reference to the detailed description that non-limiting example is done by the following drawings, the other features, objects and advantages of the present invention will become more obvious:
Fig. 1 is pedestrian counting method overall block flow diagram of the present invention.
Fig. 2 is pedestrian's foreground pixel schematic diagram in the embodiment of the present invention.
Fig. 3 is pedestrian's light stream feature schematic diagram in the embodiment of the present invention.
Fig. 4 is pedestrian's foreground pixel normalization method schematic diagram in the embodiment of the present invention.
Fig. 5 is pedestrian's occlusion detection and block hierarchical estimation schematic diagram in the embodiment of the present invention.
Fig. 6 is pedestrian center line average projection correction schematic diagram.
Fig. 7 is embodiment of the present invention monitoring scene schematic diagram, and camera and horizontal plane angle are less than 90 ��.
Embodiment
Below in conjunction with specific embodiment, the present invention is described in detail. The technician contributing to this area is understood the present invention by following examples further, but does not limit the present invention in any form. It should be appreciated that to those skilled in the art, without departing from the inventive concept of the premise, it is also possible to make some distortion and improvement. These all belong to protection scope of the present invention.
Embodiment
The video sequence that the present embodiment adopts is public security monitoring scene sequence.
The pedestrian counting method that the present embodiment relates to, comprises following concrete steps:
The first step: monitor video is carried out mixed Gaussian background modeling, obtains pedestrian's prospect image, as shown in Figure 2.
2nd step: extract pedestrian's light stream feature, as shown in Figure 3.
3rd step: pedestrian's foreground pixel feature normalization. Concrete steps are: adopt the oval modeling of pedestrian, be mapped to an ellipse according to its area size according to Elliptic Mappings rule by each pedestrian, this ellipse area is considered as pedestrian eiArea in current camera perspective, is designated as area (ei), to each foreground pixel belonging to this pedestrian, its corresponding normalization coefficient wi=1/area(ei), as shown in Figure 4.
4th step, pedestrian's occlusion detection and block hierarchical estimation.
Concrete steps are:
1. pedestrian's occlusion detection and block hierarchical estimation, its method is:
X represents pedestrian's foreground pixel; BlobiRepresent pedestrian foreground pixel UNICOM region, as shown in elliptic region in Fig. 5; �� (x) represents the shaded coefficient of foreground pixel x, and �� (x) is more big, shows that current scene blocks grade more high; As shown in Figure 5, siRepresent that pedestrian's foreground pixel is connected region blobiProjecting length on virtual door, hiRepresent that pedestrian's foreground pixel is connected region blobiIn the projecting length being perpendicular on virtual door, ROI represents area-of-interest selected on image, AROIRepresent the image area of area-of-interest; h0Represent pedestrian's center line average on the image plane, h0iRepresent the h after projection correction0��
2. pedestrian level projection correction, its method is:
Make the projection transform function that f represents between image coordinate system and world's system of coordinates; As shown in Figure 6, H0Represent the average pedestrian level under world's system of coordinates, siRepresent that pedestrian's foreground pixel is connected region blobiProjecting length on virtual door, p0Represent siMid point, its two dimensional image coordinate isThree-dimensional world coordinate is (X0,Y0,Z0), the two dimensional image coordinate of order point p isIts world's coordinate is (Xp,Yp,Zp)=(X0,Y0,Z0+H0), then line segmentAt the projection h being perpendicular on virtual door direction0iIt is the pedestrian's center line average after projection correction. Concrete steps are:
(1) calculation level p0Three-dimensional coordinate under world's system of coordinates.
(2) three-dimensional coordinate of calculation level p under world's system of coordinates.
(3) two-dimensional coordinate of calculation level p under image coordinate system.
(4) line segment is calculatedAt the projection h being perpendicular on virtual door direction0i��
5th step: in conjunction with second and third, the normalization characteristic that obtains of four steps and block grade, calculate people's flow amount. Concrete grammar is:
Wherein, flow (i) represents the more line number of pixels of the i-th frame, and x is the pixel on virtual door Gate, a is fixing constant, for correcting pedestrian's Elliptic Mappings so that ellipse area is closer to true pedestrian, and the present embodiment is taken as 0.925, w (x) is then for overcoming pick up camera perspective effect, namely the normalization coefficient obtained in step 3, the prospect that FG (x) is pixel differentiates result, if prospect, it is then 1, otherwise it is 0.For the motion vector modulus value of current pixel, ��vxIt is then the angle of the current pixel virtual door of motion vector sum, by sin (��vx) symbol can judge pedestrian direction. a0For fixing constant, for limiting the peak value scope blocking compensation, the present embodiment gets the shaded coefficient that 0.5, �� (x) represents the foreground pixel x obtained in step 4.
The present embodiment to comprising the video sequence that 70 positive movement pedestrians and 42 are negative movement pedestrian test, test result is as shown in table 1.
Table 1. people counting result
The feature that the present invention gets over line pedestrian by statistics carries out people stream counting, thus avoids pedestrian detection process; The ROI region of statistical computation simultaneously around virtual door carries out, and decreases calculated amount; Finally by carrying out pedestrian's occlusion detection and block hierarchical estimation, it is to increase there is being the counting accuracy rate in the situation of blocking.
Above specific embodiments of the invention are described. It is understood that the present invention is not limited to above-mentioned particular implementation, those skilled in the art can make various distortion or amendment within the scope of the claims, and this does not affect the flesh and blood of the present invention.
Claims (2)
1. a pedestrian counting method, it is characterised in that, comprise the following steps:
The first step: monitor video is carried out mixed Gaussian background modeling, obtains pedestrian's prospect image;
2nd step: extract pedestrian's light stream feature;
3rd step: pedestrian's foreground pixel feature normalization;
Adopt the oval modeling of pedestrian, it is mapped to an ellipse according to its area size according to Elliptic Mappings rule by each pedestrian, this ellipse area is considered as pedestrian eiArea in current camera perspective, is designated as area (ei), to each foreground pixel belonging to this pedestrian, its corresponding normalization coefficient wi=1/area (ei);
4th step, pedestrian's occlusion detection and block hierarchical estimation;
Described pedestrian's occlusion detection and block hierarchical estimation method and be:
X represents pedestrian's foreground pixel, blobiRepresenting pedestrian foreground pixel UNICOM region, �� (x) represents the shaded coefficient of foreground pixel x, and �� (x) is more big, shows that current scene blocks grade more high; siRepresent that pedestrian's foreground pixel is connected region blobiProjecting length on virtual door, hiRepresent that pedestrian's foreground pixel is connected region blobiIn the projecting length being perpendicular on virtual door, h0Represent pedestrian's center line average on the image plane, h0iRepresent the h after projection correction0, ROI represents area-of-interest selected on image, AROIRepresent the image area of area-of-interest;
In 4th step: the pedestrian center line average h in image plane0Projection correction be: make the projection transform function that f represents between image coordinate system and world's system of coordinates, H0Represent the average pedestrian level under world's system of coordinates, siRepresent that pedestrian's foreground pixel is connected region blobiProjecting length on virtual door, p0Represent siMid point, its two dimensional image coordinate isThree-dimensional world coordinate is (X0,Y0,Z0), the two dimensional image coordinate of order point p isIts world's coordinate is (Xp,Yp,Zp)=(X0,Y0,Z0+H0), then line segmentAt the projection h being perpendicular on virtual door direction0iIt is the pedestrian's center line average after projection correction;
5th step: in conjunction with second and third, the normalization characteristic that obtains of four steps and block grade, obtain people's flow amount; It is specially:
Wherein, flow (i) represents the more line number of pixels of the i-th frame, and x is the pixel on virtual door Gate; A is fixing constant, for correcting pedestrian's Elliptic Mappings so that ellipse area, closer to true pedestrian, is taken as 0.925; W (x) is then for overcoming pick up camera perspective effect, the normalization coefficient that namely the 3rd step is obtained; The prospect that FG (x) is pixel differentiates result, if prospect, is then 1, otherwise is 0;For the motion vector modulus value of current pixel; ��vxIt is then the angle of the current pixel virtual door of motion vector sum, by sin (��vx) symbol decision pedestrian direction; a0For fixing constant, for limiting the peak value scope blocking compensation, get 0.5; �� (x) represents the shaded coefficient of foreground pixel x.
2. pedestrian counting method according to claim 1, is characterized in that: the pedestrian center line average h in image plane0Projection correction, concrete steps are:
1. calculation level p0Three-dimensional coordinate under world's system of coordinates;
2. the three-dimensional coordinate of calculation level p under world's system of coordinates;
3. the two-dimensional coordinate of calculation level p under image coordinate system;
4. line segment is calculatedAt the projection h being perpendicular on virtual door direction0i��
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201310178122.5A CN103400142B (en) | 2013-05-14 | 2013-05-14 | A kind of pedestrian counting method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201310178122.5A CN103400142B (en) | 2013-05-14 | 2013-05-14 | A kind of pedestrian counting method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN103400142A CN103400142A (en) | 2013-11-20 |
CN103400142B true CN103400142B (en) | 2016-06-01 |
Family
ID=49563760
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201310178122.5A Expired - Fee Related CN103400142B (en) | 2013-05-14 | 2013-05-14 | A kind of pedestrian counting method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN103400142B (en) |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6134641B2 (en) * | 2013-12-24 | 2017-05-24 | 株式会社日立製作所 | Elevator with image recognition function |
CN104063879B (en) * | 2014-06-03 | 2017-02-15 | 上海交通大学 | Pedestrian flow estimation method based on flux and shielding coefficient |
CN104794425B (en) * | 2014-12-19 | 2018-05-18 | 长安大学 | A kind of car statistics method based on driving trace |
CN106127292B (en) * | 2016-06-29 | 2019-05-07 | 上海小蚁科技有限公司 | Flow method of counting and equipment |
CN107481255B (en) * | 2017-08-08 | 2019-12-20 | 浙江大华技术股份有限公司 | Method and device for determining number of people |
CN109344746B (en) * | 2018-09-17 | 2022-02-01 | 曜科智能科技(上海)有限公司 | Pedestrian counting method, system, computer device and storage medium |
CN110913212B (en) * | 2019-12-27 | 2021-08-27 | 上海智驾汽车科技有限公司 | Intelligent vehicle-mounted camera shielding monitoring method and device based on optical flow and auxiliary driving system |
CN117037077B (en) * | 2023-10-09 | 2023-12-08 | 成都数智创新精益科技有限公司 | Crowd counting method, device, medium, equipment and product based on image processing |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2012066785A1 (en) * | 2010-11-18 | 2012-05-24 | パナソニック株式会社 | People counting device, people counting method and people counting program |
CN102609688A (en) * | 2012-02-02 | 2012-07-25 | 杭州电子科技大学 | Multidirectional moving population flow estimation method on basis of generalized regression neural network |
CN102930287A (en) * | 2012-09-26 | 2013-02-13 | 上海理工大学 | Overlook-based detection and counting system and method for pedestrians |
CN103049787A (en) * | 2011-10-11 | 2013-04-17 | 汉王科技股份有限公司 | People counting method and system based on head and shoulder features |
CN103077423A (en) * | 2011-10-25 | 2013-05-01 | 中国科学院深圳先进技术研究院 | Crowd quantity estimating, local crowd clustering state and crowd running state detection method based on video stream |
-
2013
- 2013-05-14 CN CN201310178122.5A patent/CN103400142B/en not_active Expired - Fee Related
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2012066785A1 (en) * | 2010-11-18 | 2012-05-24 | パナソニック株式会社 | People counting device, people counting method and people counting program |
CN103049787A (en) * | 2011-10-11 | 2013-04-17 | 汉王科技股份有限公司 | People counting method and system based on head and shoulder features |
CN103077423A (en) * | 2011-10-25 | 2013-05-01 | 中国科学院深圳先进技术研究院 | Crowd quantity estimating, local crowd clustering state and crowd running state detection method based on video stream |
CN102609688A (en) * | 2012-02-02 | 2012-07-25 | 杭州电子科技大学 | Multidirectional moving population flow estimation method on basis of generalized regression neural network |
CN102930287A (en) * | 2012-09-26 | 2013-02-13 | 上海理工大学 | Overlook-based detection and counting system and method for pedestrians |
Non-Patent Citations (1)
Title |
---|
多种人群密度场景下的人群计数;覃勋辉等;《中国图象图形学报》;20130430;392-398 * |
Also Published As
Publication number | Publication date |
---|---|
CN103400142A (en) | 2013-11-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN103400142B (en) | A kind of pedestrian counting method | |
WO2021208275A1 (en) | Traffic video background modelling method and system | |
CN106845415B (en) | Pedestrian fine identification method and device based on deep learning | |
CN103279791B (en) | Based on pedestrian's computing method of multiple features | |
CN110930411B (en) | Human body segmentation method and system based on depth camera | |
CN105069751B (en) | A kind of interpolation method of depth image missing data | |
CN103530599A (en) | Method and system for distinguishing real face and picture face | |
Zhao-Yi et al. | Real-time facial expression recognition based on adaptive canny operator edge detection | |
US10650249B2 (en) | Method and device for counting pedestrians based on identification of head top of human body | |
CN111160291B (en) | Human eye detection method based on depth information and CNN | |
CN102592144B (en) | Multi-camera non-overlapping view field-based pedestrian matching method | |
WO2018076392A1 (en) | Pedestrian statistical method and apparatus based on recognition of parietal region of human body | |
CN105404888A (en) | Saliency object detection method integrated with color and depth information | |
CN104537342B (en) | A kind of express lane line detecting method of combination ridge border detection and Hough transformation | |
CN104050685A (en) | Moving target detection method based on particle filtering visual attention model | |
Yan et al. | Method to Enhance Degraded Image in Dust Environment. | |
CN104778697A (en) | Three-dimensional tracking method and system based on fast positioning of image dimension and area | |
CN103886287B (en) | Perspective-crossing gait recognition method based on 3D projection | |
CN110866453B (en) | Real-time crowd steady state identification method and device based on convolutional neural network | |
Asad et al. | Kinect depth stream pre-processing for hand gesture recognition | |
CN1971615A (en) | Method for generating cartoon portrait based on photo of human face | |
CN114037087B (en) | Model training method and device, depth prediction method and device, equipment and medium | |
WO2022120988A1 (en) | Stereo matching method based on hybrid 2d convolution and pseudo 3d convolution | |
CN104680135A (en) | Three-dimensional human face mark point detection method capable of resisting expression, posture and shielding changes | |
CN104376312A (en) | Face recognition method based on word bag compressed sensing feature extraction |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160601 |
|
CF01 | Termination of patent right due to non-payment of annual fee |