CN116704390A - Video-based identity recognition method, device and equipment - Google Patents

Video-based identity recognition method, device and equipment Download PDF

Info

Publication number
CN116704390A
CN116704390A CN202210182324.6A CN202210182324A CN116704390A CN 116704390 A CN116704390 A CN 116704390A CN 202210182324 A CN202210182324 A CN 202210182324A CN 116704390 A CN116704390 A CN 116704390A
Authority
CN
China
Prior art keywords
identity
video
humanoid
picture
person
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210182324.6A
Other languages
Chinese (zh)
Inventor
王慧敏
程佳妮
刘源
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xiamen Wuchangshi Education Technology Co ltd
Original Assignee
Xiamen Wuchangshi Education Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xiamen Wuchangshi Education Technology Co ltd filed Critical Xiamen Wuchangshi Education Technology Co ltd
Priority to CN202210182324.6A priority Critical patent/CN116704390A/en
Publication of CN116704390A publication Critical patent/CN116704390A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2455Query execution
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Collating Specific Patterns (AREA)

Abstract

The invention discloses an identity recognition method, device, equipment and storage medium based on video, which comprises the following steps: acquiring video data acquired in monitoring equipment; performing human shape detection on the video frames in the video data according to a human shape detection algorithm to obtain human shape pictures intercepted by a human shape detection frame; labeling the identity of the same person in the human-shaped picture, and judging whether the person in the human-shaped picture has a recognizable face or not; if so, outputting corresponding result information after identity matching is carried out through the identified face, and binding the identity; otherwise, whether the database has the associated record information matched with the humanoid body in the humanoid picture or not is searched, and if so, the corresponding result information is output. The identity recognition of the person can be carried out under different angles and different postures, so that the intelligent application capability of the whole visual recognition under various scenes is improved.

Description

Video-based identity recognition method, device and equipment
Technical Field
The present invention relates to the field of computer vision recognition technologies, and in particular, to a video-based identity recognition method, apparatus, and device.
Background
At present, the visual recognition is applied to the scene (such as schools) of identity recognition such as attendance checking (or passing) mainly to recognize the identity through a face recognition algorithm, and although the face recognition algorithm can ensure the accurate recognition of the identity of an attendance checking person, the situation that some attendance checking persons possibly fall down or the face orientation angle cannot meet the face recognition attendance checking cannot be completely met, and because the face recognition algorithm needs to meet a certain angle (generally, the inclination is not more than 20 degrees) by the face picture of the person to be recognized as a precondition, the face recognition cannot be performed otherwise. Therefore, accurate and rapid noninductive identification cannot be realized on the aspect of identity identification by completely utilizing camera equipment and a face identification algorithm.
Disclosure of Invention
In view of the above, the invention aims to provide a video-based identity recognition method, a video-based identity recognition device and video-based identity recognition equipment, which aim to solve the problem that the conventional identity recognition can accurately perform the identity recognition only by meeting a certain angle based on a human face.
In order to achieve the above object, the present invention provides a video-based identification method, which includes:
acquiring video data acquired in monitoring equipment;
performing human shape detection on the video frames in the video data according to a human shape detection algorithm to obtain human shape pictures intercepted by a human shape detection frame;
labeling the identity of the same person in the human-shaped picture, and judging whether the person in the human-shaped picture has a recognizable face or not;
if so, outputting corresponding result information after identity matching is carried out through the identified face, and binding the identity; otherwise, whether the database has the associated record information matched with the humanoid body in the humanoid picture or not is searched, and if so, the corresponding result information is output.
Preferably, the identifying the same person in the humanoid picture includes:
and (3) assigning a unique temporary label to the same person, and tracking the displacement change of each person according to the temporary label.
Preferably, the step of outputting corresponding result information after the identity matching is performed through the identified face and performing identity binding includes:
binding the identified face with the human body corresponding to the temporary mark to form associated record information and storing the associated record information in the database.
Preferably, the method further comprises:
and inquiring the result information based on the temporary labels, judging whether each temporary label corresponds to different characters under different monitoring devices according to the inquiring result, and if so, correcting by using the associated record information.
Preferably, the result information includes character identity information, time and place.
In order to achieve the above object, the present invention further provides a video-based identification device, which includes:
the acquisition unit is used for acquiring the video data acquired in the monitoring equipment;
the detection unit is used for carrying out humanoid detection on the video frames in the video data according to a humanoid detection algorithm to obtain humanoid pictures intercepted by the humanoid detection frame;
the output unit is used for carrying out identity marking on the same person in the humanoid picture and judging whether the person in the humanoid picture has a recognizable face or not; if so, outputting corresponding result information after identity matching is carried out through the identified face, and binding the identity; otherwise, whether the database has the associated record information matched with the humanoid body in the humanoid picture or not is searched, and if so, the corresponding result information is output.
To achieve the above object, the present invention also proposes an apparatus comprising a processor, a memory and a computer program stored in the memory, the computer program being executed by the processor to implement the steps of a video-based identification method according to the above embodiments.
To achieve the above object, the present invention also proposes a computer-readable storage medium having stored thereon a computer program to be executed by a processor to implement the steps of a video-based identification method as described in the above embodiments.
The beneficial effects are that:
according to the scheme, identity recognition of the person can be performed under different angles and different postures, so that intelligent application capacity of whole visual recognition under various scenes is improved.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a flow chart of a video-based identification method according to an embodiment of the invention.
Fig. 2 is a schematic flow chart of a video-based identification method according to another embodiment of the present invention.
Fig. 3 is a schematic structural diagram of a video-based identification device according to an embodiment of the present invention.
Fig. 4 is a schematic structural diagram of a video-based identification device according to another embodiment of the present invention.
The realization of the object, the functional characteristics and the advantages of the invention will be further described with reference to the accompanying drawings in connection with the embodiments.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments. All other embodiments, based on the embodiments of the invention, which are apparent to those of ordinary skill in the art without inventive faculty, are intended to be within the scope of the invention. Thus, the following detailed description of the embodiments of the invention, as presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, based on the embodiments of the invention, which are apparent to those of ordinary skill in the art without inventive faculty, are intended to be within the scope of the invention.
The following describes the invention in detail with reference to examples.
Referring to fig. 1, a flowchart of a video-based identification method according to an embodiment of the present invention is shown.
A video-based identification method, the method comprising:
s11, acquiring video data acquired in the monitoring equipment.
And S12, performing humanoid detection on the video frames in the video data according to a humanoid detection algorithm to obtain humanoid pictures intercepted by the humanoid detection frame.
In this embodiment, by deriving video data of the NVR video recorder, the video data includes a plurality of video frames, and performing humanoid detection on the video frames in the video data according to a humanoid detection algorithm, outputting humanoid pictures and humanoid azimuth parameters (including front, rear, left and right sides), wherein a picture screening with higher confidence is performed in the outputted plurality of humanoid pictures, and a large-area blocked picture is excluded, so as to improve the recognition result. Further, the human shape detection algorithm mainly includes identifying the location (position, length, width information) and other attributes (such as whether there is shielding) of the human shape in the whole picture with the human shape, and can intercept the picture in the human shape frame or mark the human shape frame in the whole picture based on the location information.
S13, carrying out identity marking on the same person in the humanoid picture, and judging whether the person in the humanoid picture has a recognizable face or not.
The step of labeling the identity of the same person in the humanoid picture comprises the following steps:
and (3) assigning a unique temporary label to the same person, and tracking the displacement change of each person according to the temporary label.
In the embodiment, the intra-lens tracking algorithm is utilized to carry out temporary identity marking on the same person in the humanoid picture, and tracking on the same person in the same lens can be ensured through the identity marking. And detecting whether the humanoid picture has a recognizable face by using a face detection algorithm. Wherein, the in-lens tracking algorithm is that the human shape detection algorithm can determine the action, direction and relative displacement of the same person in a video based on the relative displacement of the human shape detection frame so as to determine that the temporary mark ID is the same person; but the identification of the same identity tracking capability is limited to the same video (camera, device).
S14, if so, outputting corresponding result information after identity matching is carried out through the identified face, and binding the identity; otherwise, whether the database has the associated record information matched with the humanoid body in the humanoid picture or not is searched, and if so, the corresponding result information is output.
The step of outputting corresponding result information after the identity matching is carried out through the identified face and binding the identity comprises the following steps:
binding the identified face with the human body corresponding to the temporary mark to form associated record information and storing the associated record information in the database.
In this embodiment, after determining that the person in the humanoid image has a recognizable face, the formal identity identified by the face identification is bound with the temporary label ID in the humanoid image. And outputting corresponding result information; otherwise, searching and comparing whether records of the front face matched with the human body in the human figure picture exist or not based on the database, and if so, outputting corresponding result information; the result information comprises person identity, time and place, wherein the time information is obtained through the obtained person-shaped picture, and the place information is obtained through the obtained person-shaped picture. Further, the associated record information (including the corresponding humanoid pictures) formed after binding is stored in a database, and the records corresponding to the same temporary mark ID obtained before are covered.
Further, as shown in fig. 3, in another embodiment, the method further includes:
and S15, inquiring the result information based on the temporary labels, judging whether each temporary label corresponds to different people under different monitoring devices according to the inquiry result, and if so, correcting by using the associated record information.
In this embodiment, based on the result information before temporary label ID inquiry, it is determined whether there is a record that whether the same temporary label is recognized and output by the pedestrian re-recognition algorithm and corresponds to different formal identities (different persons), if so, it is corrected, that is, the result of the cross-lens tracking matching is replaced with the result of the front recognition. Thereby, the accuracy of the identification result of the person can be improved. The pedestrian re-recognition algorithm comprises a technology for judging whether a specific pedestrian exists in an image or a video sequence by using a computer vision technology. Widely recognized as a sub-problem of image retrieval. From a given one of the monitored pedestrian images, the pedestrian image is retrieved across devices. The camera is used for making up the visual limitation of the current fixed camera, can be combined with the pedestrian detection/pedestrian tracking technology, and can be widely applied to the fields of intelligent video monitoring, intelligent security and the like.
In order to ensure the specific accuracy of the pedestrian re-recognition algorithm, the human-shaped pictures intercepted by the human-shaped detection algorithm are classified according to different orientations, and human-shaped orientation parameters obtained based on the human-shaped detection algorithm are stored in a database to corresponding orientation libraries (such as a front library, a back library and the like). For the human-shaped pictures to be compared, the azimuth of the human-shaped picture is obtained through a human-shaped detection algorithm, and then the corresponding azimuth library is matched based on azimuth parameters for pedestrian re-recognition algorithm matching (for example, the human-shaped pictures on the left side are compared and matched with the left library). This ensures that the accuracy of the overall matching algorithm is higher than 96%.
In the implementation, when an angle is formed in one lens, the front body can be captured, the formal identity obtained through face recognition is bound with the corresponding temporary mark ID, so that the tracking of the identity of the person in the lens is realized, the person can track how to change angles in the current lens, and the humanoid pictures of all relevant angles are stored for cross-lens identity matching, so that the cross-lens identity recognition is realized. The identity tracking of the whole scene can be realized, and the real identity whole scene tracking can be realized as long as one camera can capture the front body of a plurality of cameras of the whole scene, and the time sequence is not distinguished (namely, the front is seen at the back, and the front record can be changed at the back).
Referring to fig. 3, a schematic structural diagram of a video-based identification device according to an embodiment of the present invention is shown.
In this embodiment, the apparatus 30 includes:
an acquisition unit 31 for acquiring video data acquired in the monitoring device;
the detecting unit 32 is configured to perform human shape detection on the video frame in the video data according to a human shape detection algorithm, so as to obtain a human shape picture intercepted by the human shape detection frame;
an output unit 33, configured to perform identity labeling on the same person in the humanoid picture, and determine whether the person in the humanoid picture has a recognizable face; if so, outputting corresponding result information after identity matching is carried out through the identified face, and binding the identity; otherwise, whether the database has the associated record information matched with the humanoid body in the humanoid picture or not is searched, and if so, the corresponding result information is output.
In the output unit 33, the identifying the same person in the humanoid picture includes:
and (3) assigning a unique temporary label to the same person, and tracking the displacement change of each person according to the temporary label.
Further, in the output unit 33, after the identity matching is performed on the identified face, corresponding result information is output, and identity binding is performed, which includes:
binding the identified face with the human body corresponding to the temporary mark to form associated record information and storing the associated record information in the database.
In another embodiment, as shown in fig. 4, the apparatus 40 further includes:
and the correction unit 41 is configured to query the result information based on the temporary labels, determine whether each temporary label corresponds to a different person under different monitoring devices according to the query result, and if so, correct the temporary labels by using the associated record information.
Wherein the result information includes character identity information, time and place.
The respective unit modules of the apparatus 30/40 may perform the corresponding steps in the above method embodiments, so that detailed descriptions of the respective unit modules are omitted herein.
The embodiment of the present invention further provides an apparatus, where the apparatus includes the video-based identification device, where the video-based identification device may adopt the structure of the embodiment of fig. 3, and correspondingly, may execute the technical scheme of the method embodiment shown in fig. 1, and its implementation principle and technical effects are similar, and details may refer to relevant descriptions in the foregoing embodiments, which are not repeated herein.
The apparatus comprises: a device with a photographing function such as a mobile phone, a digital camera or a tablet computer, or a device with an image processing function, or a device with an image display function. The device may include a memory, a processor, an input unit, a display unit, a power source, and the like.
The memory may be used to store software programs and modules, and the processor executes the software programs and modules stored in the memory to perform various functional applications and data processing. The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program (e.g., an image playing function, etc.) required for at least one function, and the like; the storage data area may store data created according to the use of the device, etc. In addition, the memory may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory may also include a memory controller to provide access to the memory by the processor and the input unit.
The input unit may be used to receive input digital or character or image information and to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control. Specifically, the input unit of the present embodiment may include a touch-sensitive surface (e.g., a touch display screen) and other input devices in addition to the camera.
The display unit may be used to display information entered by a user or provided to a user as well as various graphical user interfaces of the device, which may be composed of graphics, text, icons, video and any combination thereof. The display unit may include a display panel, and alternatively, the display panel may be configured in the form of an LCD (Liquid Crystal Display ), an OLED (Organic Light-Emitting Diode), or the like. Further, the touch-sensitive surface may overlay the display panel, and upon detection of a touch operation thereon or thereabout, the touch-sensitive surface is communicated to the processor to determine the type of touch event, and the processor then provides a corresponding visual output on the display panel based on the type of touch event.
The embodiment of the present invention also provides a computer readable storage medium, which may be a computer readable storage medium contained in the memory in the above embodiment; or may be a computer-readable storage medium, alone, that is not assembled into a device. The computer readable storage medium has stored therein at least one instruction that is loaded and executed by a processor to implement the video-based identification method shown in fig. 1. The computer readable storage medium may be a read-only memory, a magnetic disk or optical disk, etc.
It should be noted that, in the present specification, each embodiment is described in a progressive manner, and each embodiment is mainly described as different from other embodiments, and identical and similar parts between the embodiments are all enough to be referred to each other. For the device embodiments, the apparatus embodiments and the storage medium embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points.
Also, herein, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
While the foregoing description illustrates and describes the preferred embodiments of the present invention, it is to be understood that the invention is not limited to the forms disclosed herein, but is not to be construed as limited to other embodiments, but is capable of use in various other combinations, modifications and environments and is capable of changes or modifications within the scope of the inventive concept, either as described above or as a matter of skill or knowledge in the relevant art. And that modifications and variations which do not depart from the spirit and scope of the invention are intended to be within the scope of the appended claims.

Claims (8)

1. A video-based identification method, the method comprising:
acquiring video data acquired in monitoring equipment;
performing human shape detection on the video frames in the video data according to a human shape detection algorithm to obtain human shape pictures intercepted by a human shape detection frame;
labeling the identity of the same person in the human-shaped picture, and judging whether the person in the human-shaped picture has a recognizable face or not;
if so, outputting corresponding result information after identity matching is carried out through the identified face, and binding the identity; otherwise, whether the database has the associated record information matched with the humanoid body in the humanoid picture or not is searched, and if so, the corresponding result information is output.
2. The video-based identification method of claim 1, wherein the identifying the same person in the humanoid picture comprises:
and (3) assigning a unique temporary label to the same person, and tracking the displacement change of each person according to the temporary label.
3. The video-based identity recognition method according to claim 2, wherein the step of outputting corresponding result information after the identity matching through the recognized face and binding the identity comprises the steps of:
binding the identified face with the human body corresponding to the temporary mark to form associated record information and storing the associated record information in the database.
4. The video-based identification method of claim 2, further comprising:
and inquiring the result information based on the temporary labels, judging whether each temporary label corresponds to different characters under different monitoring devices according to the inquiring result, and if so, correcting by using the associated record information.
5. A video-based identification method according to any one of claims 1 to 4, wherein the result information includes person identity information, time and place.
6. A video-based identification device, the device comprising:
the acquisition unit is used for acquiring the video data acquired in the monitoring equipment;
the detection unit is used for carrying out humanoid detection on the video frames in the video data according to a humanoid detection algorithm to obtain humanoid pictures intercepted by the humanoid detection frame;
the output unit is used for carrying out identity marking on the same person in the humanoid picture and judging whether the person in the humanoid picture has a recognizable face or not; if so, outputting corresponding result information after identity matching is carried out through the identified face, and binding the identity; otherwise, whether the database has the associated record information matched with the humanoid body in the humanoid picture or not is searched, and if so, the corresponding result information is output.
7. An apparatus comprising a processor, a memory, and a computer program stored in the memory, the computer program being executable by the processor to perform the steps of a video-based identification method as claimed in any one of claims 1 to 5.
8. A computer readable storage medium having stored thereon a computer program to be executed by a processor to implement the steps of a video-based identification method as claimed in any one of claims 1 to 5.
CN202210182324.6A 2022-02-25 2022-02-25 Video-based identity recognition method, device and equipment Pending CN116704390A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210182324.6A CN116704390A (en) 2022-02-25 2022-02-25 Video-based identity recognition method, device and equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210182324.6A CN116704390A (en) 2022-02-25 2022-02-25 Video-based identity recognition method, device and equipment

Publications (1)

Publication Number Publication Date
CN116704390A true CN116704390A (en) 2023-09-05

Family

ID=87822698

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210182324.6A Pending CN116704390A (en) 2022-02-25 2022-02-25 Video-based identity recognition method, device and equipment

Country Status (1)

Country Link
CN (1) CN116704390A (en)

Similar Documents

Publication Publication Date Title
CN111160172B (en) Parking space detection method, device, computer equipment and storage medium
JP6425856B1 (en) Video recording method, server, system and storage medium
WO2019218824A1 (en) Method for acquiring motion track and device thereof, storage medium, and terminal
Hampapur et al. Smart video surveillance: exploring the concept of multiscale spatiotemporal tracking
US9639758B2 (en) Method and apparatus for processing image
US10606824B1 (en) Update service in a distributed environment
US9058536B1 (en) Image-based character recognition
US20120075343A1 (en) Augmented reality (ar) system and method for tracking parts and visually cueing a user to identify and locate parts in a scene
US20070052807A1 (en) System and method for user monitoring interface of 3-D video streams from multiple cameras
CN108875730B (en) Deep learning sample collection method, device, equipment and storage medium
CN106295598A (en) A kind of across photographic head method for tracking target and device
CN110706247B (en) Target tracking method, device and system
US9449216B1 (en) Detection of cast members in video content
US20160110885A1 (en) Cloud based video detection and tracking system
CN103198293A (en) System and method for fingerprinting video
US9105101B2 (en) Image tracking device and image tracking method thereof
KR20140090078A (en) Method for processing an image and an electronic device thereof
CN110136091B (en) Image processing method and related product
Tian et al. Scene Text Detection in Video by Learning Locally and Globally.
CN108697934A (en) Guidance information related with target image
Márquez-Neila et al. Speeding-up homography estimation in mobile devices
Xiong et al. Snap angle prediction for 360 panoramas
Yang et al. Robust and real-time pose tracking for augmented reality on mobile devices
RU2703152C1 (en) System and method of displaying objects movement scheme
CN113689475A (en) Cross-border head trajectory tracking method, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination