CN112132048A - Community patrol analysis method and system based on computer vision - Google Patents

Community patrol analysis method and system based on computer vision Download PDF

Info

Publication number
CN112132048A
CN112132048A CN202011015096.0A CN202011015096A CN112132048A CN 112132048 A CN112132048 A CN 112132048A CN 202011015096 A CN202011015096 A CN 202011015096A CN 112132048 A CN112132048 A CN 112132048A
Authority
CN
China
Prior art keywords
face
module
cell
shot
picture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011015096.0A
Other languages
Chinese (zh)
Inventor
丁维超
李斌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tianjin Fengwu Technology Co ltd
Original Assignee
Tianjin Fengwu Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tianjin Fengwu Technology Co ltd filed Critical Tianjin Fengwu Technology Co ltd
Priority to CN202011015096.0A priority Critical patent/CN112132048A/en
Publication of CN112132048A publication Critical patent/CN112132048A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • G06V40/165Detection; Localisation; Normalisation using facial parts and geometric relationships
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18Status alarms
    • G08B21/24Reminder alarms, e.g. anti-loss alarms
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30241Trajectory

Abstract

The application provides a community patrol analysis method and system based on computer vision, wherein the method comprises the following steps: establishing a face library, collecting face data of all cell owners and workers and storing the face data into a server; detecting a face, namely detecting a face shot by a camera in a cell to obtain a first face picture; face tracking, namely predicting the moving condition of a face frame through a face tracking algorithm to obtain more face pictures; evaluating the quality of the human face, and screening the shot human face picture; identifying the identities of the persons in the face pictures after the screening according to a face library; and analyzing results, namely analyzing according to the face recognition results to obtain the activity routes and the activity areas of the personnel and judge abnormal information. The system comprises various modules for implementing the method. The method and the device can perform intelligent analysis on the video of the personnel in the community.

Description

Community patrol analysis method and system based on computer vision
Technical Field
The invention relates to the technical field of patrol security, in particular to a community patrol analysis method and system based on computer vision.
Background
In the prior art, with the introduction and popularization of the concept of "smart city", a large number of new engineering fields such as "smart security", "smart medical treatment" and "smart transportation" have gradually become the focus of government and enterprise attention, and "smart security" has been particularly focused as a field closely related to the safety of people's lives and properties. As one of the important components of the intelligent community, the video monitoring system plays an important role in community security.
Along with the gradual improvement of society to the whole scheme requirement of wisdom community, traditional video monitoring system scheme is suitable for the aftertreatment afterwards, in the aspect of community security protection arrangement, mostly adopts the mode of setting up the camera and granting the ID card, but these cameras only accomplish simple shooting and record the function, can't form intelligent unified management to lower and upper. Once a malignant event occurs, the video in the area can be screened manually only afterwards, and since the intelligent screening is not adopted, a large amount of manpower is needed to screen the video, so that effective coordination and cooperation are difficult to perform, advance prevention cannot be performed, and the requirement of social development cannot be met. In order to solve the above problems, people are always seeking an ideal technical solution.
Disclosure of Invention
In view of this, an object of the embodiments of the present application is to provide a method and a system for analyzing a community patrol based on computer vision, which can perform intelligent analysis on videos of people in a community.
In a first aspect, an embodiment of the present application provides a community patrol analysis method based on computer vision, where the method includes:
establishing a face library, collecting face data of all cell owners and workers and storing the face data into a server;
detecting a face, namely detecting a face shot by a camera in a cell to obtain a first face picture;
face tracking, namely predicting the moving condition of a face frame through a face tracking algorithm to obtain more face pictures;
evaluating the quality of the human face, and screening the shot human face picture;
identifying the identities of the persons in the face pictures after the screening according to a face library;
and analyzing results, namely analyzing according to the face recognition results to obtain the activity routes and the activity areas of the personnel and judge abnormal information.
With reference to the first aspect, an embodiment of the present application provides a first possible implementation manner of the first aspect, where in the face detection step, the method includes:
the method comprises the steps of respectively carrying out face detection, face key point detection and face alignment algorithm on video frames shot by a camera in a cell to obtain the position of a face frame and the position of a face key point, mapping the detected face key point and the key point of a standard face, correcting a detected face image through similarity transformation, correcting a side face into a front face, and obtaining a first face image.
With reference to the first aspect, an embodiment of the present application provides a first possible implementation manner of the first aspect, where in the face recognition step, the method includes:
and obtaining the feature vector of the picture by the face recognition algorithm of the screened face picture, and then comparing the feature vector with the face data in the database to judge the identity of the face.
In a second aspect, an embodiment of the present application further provides a computer vision-based community patrol analysis system, configured to implement the method described above, including:
the storage module is used for storing a face library;
the detection module is used for detecting the face shot by the camera in the cell;
the tracking module is in signal connection with the detection module and obtains more face pictures through a face tracking algorithm;
the quality evaluation module is in signal connection with the tracking module and is used for screening the shot face picture;
the face recognition module is in signal connection with the storage module and the quality evaluation module and is used for recognizing the identity of the person in the face picture after the screening according to a face library;
and the result analysis module is in signal connection with the storage module and the face recognition module and is used for comparing the action track of the target pedestrian in the cell with the predetermined track of routing inspection to obtain the activity route and the activity area of the personnel and judge abnormal information.
With reference to the second aspect, the present application provides a first possible implementation manner of the second aspect, where the apparatus further includes an alarm module, which is in signal connection with the result analysis module.
The embodiment of the application provides a community patrol analysis method and system based on computer vision, in an intelligent community, a face recognition system is adopted, the intelligent community has non-replicability, both hands of people coming in and going out can be liberated, more convenient access management is brought, and meanwhile, the intelligent community is more efficient and safer. Meanwhile, an unknown person who sneaks into the cell can be identified through the video deployment and control system adopting face identification, early warning is timely carried out, and the cell safety is guaranteed. In addition, the face recognition system also gives more humanized service to the cell. For example, the special groups such as the elderly living alone and the disabled in the community are concerned. The face recognition system can detect the access information of the people, and once the access information of the people does not exist for a plurality of days, the system can automatically give an early warning to remind property personnel to visit the door in time. The operation cost is reduced, the safety of the region is improved, and the satisfaction of residents is achieved. Especially, under the social background of the aging population at present, the human efficiency is greatly improved, and the social pressure is relieved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained from the drawings without inventive effort.
Fig. 1 shows a flowchart of a community patrol analysis method based on computer vision according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all the embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.
At present, the community patrol analysis method based on computer vision provided by the embodiment of the present application includes:
establishing a face library, collecting face data of all cell owners and workers and storing the face data into a server;
in order to identify people through computer vision, cameras are required to be arranged at important entrances, various paths, intersections and the like of a monitored area for tracking and identifying pedestrians. And high-definition cameras are deployed at a core gateway and a core area to identify human face features, all the cameras are linked to a background server, and camera data are stored in the server. Initializing the faces of the community and establishing a library, and inputting the faces of community owners and community workers into a system for identifying and distinguishing whether the faces are community workers or strangers outside.
Detecting a face, namely detecting a face shot by a camera in a cell to obtain a first face picture;
the video frames are respectively subjected to face detection, face key point detection, face alignment and other algorithms. The method comprises the steps of obtaining the position of a face frame and the position of a face key point by a face detection algorithm for a video frame, mapping the detected face key point and the key point of a standard face, and correcting a detected face image through similarity transformation, namely correcting a side face into a front face, so that the accuracy of face recognition is improved.
Face tracking, namely predicting the moving condition of a face frame through a face tracking algorithm to obtain more face pictures;
because the movement of the human is continuous, after the human face detection algorithm detects a certain human face for the first time, in order to reduce the calculation overhead, the movement condition of the human face frame is predicted through the human face tracking algorithm, and the repeated calling of the detection algorithm is avoided. And the face quality evaluation is carried out by obtaining the face image through the tracking algorithm.
Evaluating the quality of the human face, and screening the shot human face picture;
due to the complex environment in the real scene, even after the faces are aligned, some factors affecting face recognition, such as large-angle side faces, large-area shielding, poor light conditions and the like, still appear, so that the poor-quality pictures can be filtered as much as possible through a face quality evaluation algorithm. Therefore, the probability of recognition errors can be reduced, and the system overhead can be reduced. And the pictures with higher face quality are submitted to a face recognition algorithm for final recognition.
Identifying the identities of the persons in the face pictures after the screening according to a face library;
and obtaining the characteristic vector of the picture by the picture screened by the face quality algorithm through a face recognition algorithm, and then comparing the characteristic vector with face data in a database to judge the identity of the person. The method can be used in occasions such as community entrance guard and the like, and can also be used for early warning the appearance of strangers in a security system.
And analyzing results, namely analyzing according to the face recognition results to obtain the activity routes and the activity areas of the personnel and judge abnormal information.
The activity route and the activity area of the personnel can be obtained through the information obtained through face recognition, and through comparison and analysis, if the old people do not appear in the area appearing at ordinary times for a few days suddenly, a security guard can be informed to go to the door for checking.
Based on the same inventive concept, the embodiment of the present application further provides a computer vision-based community patrol analysis apparatus corresponding to the computer vision-based community patrol analysis method, including: the storage module is used for storing the human face library and the contents shot by the cameras in the cell;
the detection module is used for detecting the face shot by the camera in the cell;
the tracking module is in signal connection with the detection module and obtains more face pictures through a face tracking algorithm;
the quality evaluation module is in signal connection with the tracking module and is used for screening the shot face picture;
the face recognition module is in signal connection with the storage module and the quality evaluation module and is used for recognizing the identity of the person in the face picture after the screening according to a face library;
the result analysis module is in signal connection with the storage module and the face recognition module and is used for comparing the action track of the target pedestrian in the cell with the scheduled track of inspection, acquiring the activity route and the activity area of the personnel and judging abnormal information;
the device also comprises an alarm module which is in signal connection with the result analysis module.
According to the method and the device, the face tracking technology is matched with the face detection, so that the system overhead is reduced, and the recognition speed of the system is improved.
And the face quality evaluation is adopted to filter most invalid face images, so that the reduction of the system overhead is realized, and the identification accuracy is increased.
Modularization and expansibility, and each function of the system is used as an independent module, so that the development efficiency can be improved, and the maintenance cost is saved.
The face recognition system is adopted, the copying performance is realized, the hands of people entering and exiting can be liberated, more convenient entering and exiting management is brought, and meanwhile, the efficiency and the safety are higher. Meanwhile, an unknown person who sneaks into the cell can be identified through the video deployment and control system adopting face identification, early warning is timely carried out, and the cell safety is guaranteed. In addition, the face recognition system also gives more humanized service to the cell. For example, the special groups such as the elderly living alone and the disabled in the community are concerned. The face recognition system can detect the access information of the people, and once the access information of the people does not exist for a plurality of days, the system can automatically give an early warning to remind property personnel to visit the door in time. The operation cost is reduced, the safety of the region is improved, and the satisfaction of residents is achieved. Especially, under the social background of the aging population at present, the human efficiency is greatly improved, and the social pressure is relieved.
Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present application, and are used for illustrating the technical solutions of the present application, but not limiting the same, and the scope of the present application is not limited thereto, and although the present application is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope disclosed in the present application; such modifications, changes or substitutions do not depart from the spirit and scope of the exemplary embodiments of the present application, and are intended to be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (5)

1. A community patrol analysis method based on computer vision is characterized by comprising the following steps:
establishing a face library, collecting face data of all cell owners and workers and storing the face data into a server;
detecting a face, namely detecting a face shot by a camera in a cell to obtain a first face picture;
face tracking, namely predicting the moving condition of a face frame through a face tracking algorithm to obtain more face pictures;
evaluating the quality of the human face, and screening the shot human face picture;
identifying the identities of the persons in the face pictures after the screening according to a face library;
and analyzing results, namely analyzing according to the face recognition results to obtain the activity routes and the activity areas of the personnel and judge abnormal information.
2. The computer vision-based community patrol analysis method according to claim 1, wherein in the face detection step, the method comprises:
the method comprises the steps of respectively carrying out face detection, face key point detection and face alignment algorithm on video frames shot by a camera in a cell to obtain the position of a face frame and the position of a face key point, mapping the detected face key point and the key point of a standard face, correcting a detected face image through similarity transformation, correcting a side face into a front face, and obtaining a first face image.
3. The computer vision-based community patrol analysis method according to claim 2, wherein in the face recognition step, the method comprises:
and obtaining the feature vector of the picture by the face recognition algorithm of the screened face picture, and then comparing the feature vector with the face data in the database to judge the identity of the face.
4. A computer vision based community patrol analysis system for implementing the method of any one of claims 1 to 3, comprising:
the storage module is used for storing the human face library and the contents shot by the cameras in the cell;
the detection module is used for detecting the face shot by the camera in the cell;
the tracking module is in signal connection with the detection module and obtains more face pictures through a face tracking algorithm;
the quality evaluation module is in signal connection with the tracking module and is used for screening the shot face picture;
the face recognition module is in signal connection with the storage module and the quality evaluation module and is used for recognizing the identity of the person in the face picture after the screening according to a face library;
and the result analysis module is in signal connection with the storage module and the face recognition module and is used for comparing the action track of the target pedestrian in the cell with the predetermined track of routing inspection to obtain the activity route and the activity area of the personnel and judge abnormal information.
5. The computer vision based community patrol analysis system according to claim 4, further comprising an alarm module in signal connection with the result analysis module.
CN202011015096.0A 2020-09-24 2020-09-24 Community patrol analysis method and system based on computer vision Pending CN112132048A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011015096.0A CN112132048A (en) 2020-09-24 2020-09-24 Community patrol analysis method and system based on computer vision

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011015096.0A CN112132048A (en) 2020-09-24 2020-09-24 Community patrol analysis method and system based on computer vision

Publications (1)

Publication Number Publication Date
CN112132048A true CN112132048A (en) 2020-12-25

Family

ID=73839601

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011015096.0A Pending CN112132048A (en) 2020-09-24 2020-09-24 Community patrol analysis method and system based on computer vision

Country Status (1)

Country Link
CN (1) CN112132048A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113011378A (en) * 2021-04-06 2021-06-22 南通大学 Intelligent posture and face recognition system for searching lost old people
CN114842527A (en) * 2022-04-01 2022-08-02 武汉虹信技术服务有限责任公司 Smart city-based hierarchical face recognition system and method
CN115984063A (en) * 2022-09-29 2023-04-18 河北数微信息技术有限公司 Community online security monitoring method and device, computer equipment and storage medium
CN117197876A (en) * 2023-11-07 2023-12-08 深圳凯升联合科技有限公司 Face recognition security system and method based on deep learning

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107644204A (en) * 2017-09-12 2018-01-30 南京凌深信息科技有限公司 A kind of human bioequivalence and tracking for safety-protection system
CN108256459A (en) * 2018-01-10 2018-07-06 北京博睿视科技有限责任公司 Library algorithm is built in detector gate recognition of face and face based on multiple-camera fusion automatically
CN109784162A (en) * 2018-12-12 2019-05-21 成都数之联科技有限公司 A kind of identification of pedestrian behavior and trace tracking method
CN110276261A (en) * 2019-05-23 2019-09-24 平安科技(深圳)有限公司 Personnel automatically track monitoring method, device, computer equipment and storage medium
CN110446015A (en) * 2019-08-30 2019-11-12 北京青岳科技有限公司 A kind of abnormal behaviour monitoring method based on computer vision and system
CN110766895A (en) * 2019-09-17 2020-02-07 重庆特斯联智慧科技股份有限公司 Intelligent community abnormity alarm system and method based on target trajectory analysis

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107644204A (en) * 2017-09-12 2018-01-30 南京凌深信息科技有限公司 A kind of human bioequivalence and tracking for safety-protection system
CN108256459A (en) * 2018-01-10 2018-07-06 北京博睿视科技有限责任公司 Library algorithm is built in detector gate recognition of face and face based on multiple-camera fusion automatically
CN109784162A (en) * 2018-12-12 2019-05-21 成都数之联科技有限公司 A kind of identification of pedestrian behavior and trace tracking method
CN110276261A (en) * 2019-05-23 2019-09-24 平安科技(深圳)有限公司 Personnel automatically track monitoring method, device, computer equipment and storage medium
CN110446015A (en) * 2019-08-30 2019-11-12 北京青岳科技有限公司 A kind of abnormal behaviour monitoring method based on computer vision and system
CN110766895A (en) * 2019-09-17 2020-02-07 重庆特斯联智慧科技股份有限公司 Intelligent community abnormity alarm system and method based on target trajectory analysis

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
方红,罗才喜: "基于社区安全的人员运动轨迹智能分析平台的设计构想", 《天津市电子工业协会2020年年会论文集》 *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113011378A (en) * 2021-04-06 2021-06-22 南通大学 Intelligent posture and face recognition system for searching lost old people
CN114842527A (en) * 2022-04-01 2022-08-02 武汉虹信技术服务有限责任公司 Smart city-based hierarchical face recognition system and method
CN115984063A (en) * 2022-09-29 2023-04-18 河北数微信息技术有限公司 Community online security monitoring method and device, computer equipment and storage medium
CN117197876A (en) * 2023-11-07 2023-12-08 深圳凯升联合科技有限公司 Face recognition security system and method based on deep learning
CN117197876B (en) * 2023-11-07 2024-04-09 深圳凯升联合科技有限公司 Face recognition security system and method based on deep learning

Similar Documents

Publication Publication Date Title
CN112132048A (en) Community patrol analysis method and system based on computer vision
CN111582006A (en) Video analysis method and device
CN110689054A (en) Worker violation monitoring method
KR102122859B1 (en) Method for tracking multi target in traffic image-monitoring-system
KR102122850B1 (en) Solution for analysis road and recognition vehicle license plate employing deep-learning
CN112183162A (en) Face automatic registration and recognition system and method in monitoring scene
CN111783530A (en) Safety system and method for monitoring and identifying behaviors in restricted area
CN112132041A (en) Community patrol analysis method and system based on computer vision
CN109410497A (en) A kind of monitoring of bridge opening space safety and alarm system based on deep learning
WO2018037355A1 (en) A system and method for automated vehicle and face detection and their classification
CN116798176A (en) Data management system based on big data and intelligent security
WO2022055023A1 (en) Iot integrated intelligent image analysis platform system capable of smart object recognition
CN112330742A (en) Method and device for recording activity routes of key personnel in public area
KR101407394B1 (en) System for abandoned and stolen object detection
TWI617997B (en) Intelligent object detection assistance system and method
KR20030040434A (en) Vision based method and apparatus for detecting an event requiring assistance or documentation
KR102435435B1 (en) System for searching numbers of vehicle and pedestrian based on artificial intelligence
CN115546737B (en) Machine room monitoring method
CN111325065A (en) Security management method, device, equipment and computer storage medium
CN115730915B (en) Intelligent research and judgment early warning method based on Internet of things big data analysis
Liu et al. Intelligent video analysis system for railway station
CN117238027A (en) Method for identifying and tracking gait in real time
CN117975357A (en) Pedestrian re-identification technology-based site security assessment management system and method
CN116168344A (en) Security monitoring method and device based on array computing vision
Blessy et al. A Robust Digital Image Analyzing Methodology to Prevent Vehicle Theft based on Automatic Number Plate Recognition Principle

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20201225