CN117315914A - Smart city LED display terminal, public security auxiliary method and storage medium - Google Patents

Smart city LED display terminal, public security auxiliary method and storage medium Download PDF

Info

Publication number
CN117315914A
CN117315914A CN202311325914.0A CN202311325914A CN117315914A CN 117315914 A CN117315914 A CN 117315914A CN 202311325914 A CN202311325914 A CN 202311325914A CN 117315914 A CN117315914 A CN 117315914A
Authority
CN
China
Prior art keywords
information
alarm
personnel
dangerous case
audio
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311325914.0A
Other languages
Chinese (zh)
Inventor
郝光军
覃丹
肖学强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tailing Zhixian Technology Shenzhen Co ltd
Original Assignee
Tailing Zhixian Technology Shenzhen Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tailing Zhixian Technology Shenzhen Co ltd filed Critical Tailing Zhixian Technology Shenzhen Co ltd
Priority to CN202311325914.0A priority Critical patent/CN117315914A/en
Publication of CN117315914A publication Critical patent/CN117315914A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09FDISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F27/00Combined visual and audible advertising or displaying, e.g. for public address
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/002Generating a prealarm to the central station
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/01Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B31/00Predictive alarm systems characterised by extrapolation or other computation using updated historic data
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B7/00Signalling systems according to more than one of groups G08B3/00 - G08B6/00; Personal calling systems according to more than one of groups G08B3/00 - G08B6/00
    • G08B7/06Signalling systems according to more than one of groups G08B3/00 - G08B6/00; Personal calling systems according to more than one of groups G08B3/00 - G08B6/00 using electric transmission, e.g. involving audible and visible signalling through the use of sound and light sources

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Multimedia (AREA)
  • Emergency Management (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Computing Systems (AREA)
  • Alarm Systems (AREA)

Abstract

The application relates to the technical field of urban security and discloses a smart city LED display terminal, a public security auxiliary method and a storage medium, wherein the smart city LED display terminal comprises a terminal body, the terminal body comprises a shell, a display assembly, an audio assembly and a controller, the shell is connected with a multidirectional camera assembly, an alarm assembly, a biological information acquisition assembly and a license reading assembly, and the controller is electrically connected with the display assembly, the audio assembly, the multidirectional camera assembly, the alarm assembly, the biological information acquisition assembly and the license reading assembly; the controller includes: the system comprises a monitoring image identification module, a personnel information matching module, a personnel dangerous case information identification module and a dangerous case event alarm module; the method has the effect of improving the popularity of the alarming help-seeking equipment and the accuracy of alarming information.

Description

Smart city LED display terminal, public security auxiliary method and storage medium
Technical Field
The application relates to the technical field of urban security, in particular to a smart urban LED display terminal, a security auxiliary method and a storage medium.
Background
Along with the reduction of the cost of intelligent LED display equipment and the popularization of technologies such as Internet of things, big data and cloud computing, more and more LED display terminals with related functions of a smart city are deployed in cities, and the terminals are commonly used for displaying advertisements and information, and part of the terminals are also provided with cameras, microphones and reading equipment, so that the intelligent LED display equipment has the function of interacting with users, and on the other hand, a plurality of alarming help-seeking rods with a one-key triggering function are deployed in the current city, so that people can send help-seeking signals in time when encountering danger, however, the existing alarming help-seeking rods often have misuse phenomena such as false alarm and the like in daily operation, and the problem of waste of police resources is easily caused.
Disclosure of Invention
In order to improve the popularity of alarming help-seeking equipment and the accuracy of alarming information, the application provides a smart city LED display terminal, a public security auxiliary method and a storage medium.
The first technical scheme adopted by the invention of the application is as follows:
the intelligent city LED display terminal comprises a terminal body, wherein the terminal body comprises a shell, a display assembly, an audio assembly and a controller, the shell is connected with a multidirectional camera assembly, an alarm assembly, a biological information acquisition assembly and a license reading assembly, and the controller is electrically connected with the display assembly, the audio assembly, the multidirectional camera assembly, the alarm assembly, the biological information acquisition assembly and the license reading assembly; the controller includes:
The monitoring image recognition module is used for acquiring a terminal monitoring image, inputting the terminal monitoring image into a preset image recognition model, recognizing non-personnel dangerous information and all personnel images from the terminal monitoring image, and determining face images and action gesture information corresponding to each personnel image;
the personnel information matching module is used for inputting each face image into a preset resident information base and determining the identity information and the health state information corresponding to each personnel image;
the personnel dangerous case information identification module is used for judging corresponding personnel dangerous case information based on the action gesture information and the corresponding health state information of each personnel;
the dangerous case event alarming module is used for judging whether a dangerous case occurs based on non-personnel dangerous case information and personnel dangerous case information, if the dangerous case occurs, determining the dangerous case type, marking the identity information of the related personnel for the dangerous case event, generating corresponding alarming information and sending the corresponding alarming information to the alarm receiving terminal.
By adopting the technical scheme, the terminal body of the smart city LED display terminal comprises a shell for installing and protecting other components, a display component for displaying images, an audio component for recording and playing audio, and a controller for controlling the working state of the smart city LED display terminal; the shell is also connected with a multidirectional camera shooting assembly which is used for acquiring images near the terminal body, including images of users, so as to identify help seekers, and monitor whether public security events, personal and property security damage events occur near the terminal body; the alarm component is convenient for sending an alarm signal when a user needs, the biological information acquisition component is used for acquiring biological information of the user for checking and recording, and the license reading component reads the identification document information of the user so as to identify the identity of the user; the controller comprises a monitoring image recognition module, a personnel information matching module, a personnel dangerous case information recognition module and a dangerous case event alarming module, and is used for acquiring a terminal monitoring head portrait shot by the intelligent city LED display terminal machine so as to judge whether dangerous case events such as personnel dangerous case and non-personnel dangerous case exist or not and sending out alarming signals after the dangerous case event occurs, so that the intelligent city LED display terminal machine has an alarming help seeking function and can confirm alarming help seeking signals of residents, and the popularization degree of alarming help seeking equipment and the accuracy of alarming information are improved.
In a preferred example, the present application: the casing includes frame, protective housing and bracing piece, display module includes two display screens, one side of display screen rotate connect in the top of frame, one side of protective housing rotate connect in the top of frame and be located the top of display screen, the bracing piece is the telescopic link, just the both ends of bracing piece rotate respectively connect in the frame with the protective housing.
Through adopting above-mentioned technical scheme, the casing is including the frame that is used for supporting smart city LED display terminal equipment weight for seal and protection support the inside waterproof protective housing that uses electric components and parts of smart city LED display terminal, one side of the display screen module of display module is rotated and is connected in the frame, and one side of protective housing also rotates and connect with the frame, be convenient for follow-up opening the protective housing, lift up the display screen module, so that other inside spare parts to display screen module or smart city LED display terminal maintain, the bracing piece is used for supporting the protective housing when maintaining the inside spare part to smart city LED display terminal, make the protective housing keep in the open state.
In a preferred example, the present application: the casing is provided with a waterproof shutter, and the inner wall of the casing is provided with a waterproof fan.
By adopting the technical scheme, the shell is provided with the waterproof shutter so as to reduce the possibility of damaging non-waterproof power consumption components caused by rainwater invading the smart city LED display terminal while radiating internal heat for the smart city LED display terminal; waterproof fan is installed to the casing inner wall, is convenient for increase the radiating efficiency of wisdom city LED display terminal machine.
The second object of the present application is achieved by the following technical scheme:
the public security auxiliary method is applied to the smart city LED display terminal set, and comprises the following steps:
acquiring a terminal monitoring image, inputting the terminal monitoring image into a preset image recognition model, recognizing non-personnel dangerous information and all personnel images from the terminal monitoring image, and determining face images and action gesture information corresponding to each personnel image;
inputting each face image into a preset resident information base, and determining identity information and health state information corresponding to each person image;
judging corresponding personnel dangerous case information based on the action gesture information and the corresponding health state information of each personnel;
judging whether a dangerous case event occurs or not based on non-personnel dangerous case information and personnel dangerous case information, if so, determining the dangerous case type, marking the identity information of related personnel for the dangerous case event, generating corresponding alarm information and sending the alarm information to an alarm receiving terminal.
By adopting the technical scheme, the terminal monitoring image shot by the multi-directional shooting component is acquired and input into the preset image recognition model, so that non-personnel dangerous situations, such as dangerous situations of fire, collision among vehicles and the like, of related personnel can not be recognized, and non-personnel dangerous situation information can be determined; simultaneously, identifying all personnel images from the terminal monitoring images, and further identifying face images and action gesture information from the personnel images by using an image identification model; inputting each face image into a preset resident information base so as to determine the identity and the corresponding health state of local residents in a monitoring area, and facilitating the subsequent determination of different distress judgment standards for people in different health states; judging whether the situation of distress of the person exists or not according to the action gesture information and the corresponding health state information of each person, for example, when the person is identified to fall on the ground, determining the criterion for judging distress of the person on the ground according to the health state information of the person on the ground, and further judging whether the person is in distress or not, thereby determining dangerous case information of the person; based on the obtained non-personnel dangerous case information and personnel dangerous case information, judging whether a dangerous case event occurs in the monitoring area, determining the dangerous case type, marking the identity information of related personnel for the dangerous case event, generating alarm information again and generating the alarm information to the alarm receiving terminal, facilitating the alarm receiving personnel to know the condition of the dangerous case event, and improving the disposal efficiency of the alarm receiving personnel on the dangerous case event.
In a preferred example, the present application: judging whether a dangerous case event occurs based on the non-personnel dangerous case information and the personnel dangerous case information, and if the dangerous case event occurs, determining the dangerous case type comprises the following steps:
when the dangerous case type comprises personal injury, acquiring contact information of surrounding residents with medical skills from a resident information base, and sending help seeking request information based on the contact information of the surrounding residents with medical skills;
matching the corresponding needed risk escape resource information based on the risk type;
and acquiring a corresponding resource distribution map based on the risk-free resource information and sending the resource distribution map to the display component.
By adopting the technical scheme, after the dangerous case type of the dangerous case event is determined, if the dangerous case type comprises personal injury, the contact information of surrounding residents with medical skills is acquired from the resident information base so as to send help seeking request information to the surrounding residents, thereby being convenient for improving the possibility of temporary rescue and the rescue quality of people in distress; the dangerous case type is matched with the escape resource information which is used for handling the dangerous case event and corresponds to the needed use, so that the subsequent generation of alarm information based on the escape resource information is facilitated, and the handling efficiency of the dangerous case event is improved; and acquiring a corresponding resource distribution map based on the escape resource information and displaying the map on the intelligent city LED display terminal so that on-site personnel can acquire a way of acquiring the escape resource.
In a preferred example, the present application: the related personnel refer to personnel related to dangerous case events, including distress personnel, responsibility personnel and suspicion personnel;
after the identity information of the associated person is marked for the dangerous case event, the method comprises the following steps:
identifying identity information of a person in danger in a dangerous case, acquiring contact information of a corresponding contact person based on the identity information of the person in danger, and sending dangerous case notification information based on the contact information of the contact person;
identifying identity information of a responsible person and a suspected person in the dangerous case, acquiring contact information of the responsible person and the suspected person based on the identity information of the responsible person and the suspected person, and sending coordination investigation information based on the contact information of the responsible person and the suspected person;
and adding the personnel image of each associated personnel to the alarm information.
By adopting the technical scheme, the identity information of each distress person in the dangerous case is identified, and the contact information of the contact person of the distress person is acquired, so that the distress notification information is sent to the contact person of the distress person, the contact person of the distress person can know the distress condition of the distress person in time, and the contact person of the distress person can arrive at the occurrence site of the dangerous case in time to help the distress person; identifying identity information of a responsible person and a suspected person in the dangerous case, and further acquiring contact information of the responsible person and the suspected person so as to send coordination investigation information to the responsible person and the suspected person, thereby facilitating the personnel who deal with the dangerous case to find out the case; and adding the personnel images of the associated personnel into the alarm information so as to timely identify the personnel on site for handling the dangerous event and rapidly distinguish the identities of the various associated personnel.
In a preferred example, the present application: after generating the corresponding alarm information and sending the alarm information to the alarm receiving terminal, the method comprises the following steps:
searching an audible and visual alarm instruction from the alarm information, and sending the audible and visual alarm instruction to a display component and an audio component;
the audible and visual alarm instruction is used for controlling a display component of the intelligent city LED display terminal to send out an alarm light signal and an audio component to send out an alarm sound signal;
the types of the warning light signals include: warning light images, responsibility person images, suspicion person images, resident evacuation notification images, resident help notification images and alarm state information images;
the types of the warning sound signals comprise: alarm whistle audio, responsibility personnel information declaring audio, suspicion personnel information declaring audio, resident evacuation notice audio, resident help notice audio and alarm state information audio.
Through adopting above-mentioned technical scheme, send alarm information to the receiving alarm terminal after, seek audible and visual alarm instruction from alarm information, if including audible and visual alarm instruction in the alarm information, send audible and visual alarm instruction to display module and audio module to utilize wisdom city LED display terminal machine to send audible and visual alarm signal after alarm personnel successfully triggers alarm function, so as to attract nearby personnel's attention, evacuation nearby personnel or request nearby personnel to assist according to actual demand.
In a preferred example, the present application: further comprises:
receiving alarm control signals in real time, generating pre-alarm signals and sending the pre-alarm signals to a pre-alarm receiving terminal;
acquiring face images of alarm personnel to acquire corresponding identity information and health state information, and storing the face images, the identity information and the health state information of the alarm personnel in a historical alarm information base;
receiving audio and video data of a terminal body in real time, and sending the audio and video data to a preset audio and video dangerous situation identification model and a pre-alarm receiving terminal to generate alarm information;
and receiving alarm receiving feedback information, and if the alarm receiving feedback information is confirmation alarm, sending the alarm information to an alarm receiving terminal.
By adopting the technical scheme, the alarm control signal is received in real time to generate the pre-alarm signal and send the pre-alarm signal to the pre-alarm terminal, so that a worker of the pre-alarm terminal can know that a person triggers the alarm function of the intelligent city LED display terminal; acquiring a face image of a person triggering an alarm function so as to identify identity information, health state information and the like of the alarm person, wherein the face image is convenient for auxiliary judgment of the authenticity of the alarm requirement, and recording a history alarm record of the alarm person so as to be convenient for tracing the behavior of abusing the alarm function; receiving audio and video data of a terminal body in real time, sending the audio and video data to an audio and video dangerous situation recognition model so as to assist in analyzing possible dangerous situations after audio recognition algorithm and image recognition algorithm processing is carried out according to voice of an alarm person, other audio information and video information near the terminal body, and on the other hand, sending the audio and video data to a pre-alarm receiving terminal so as to enable a worker to directly talk with the alarm person when necessary or manually judge the possible dangerous situations at present based on the audio and video data, and generating alarm information according to a result after analysis of the possible dangerous situations; the staff of the pre-alarm terminal determines whether the dangerous situation is necessary to be disposed according to the analysis result of the dangerous situation, so that alarm receiving feedback information is determined, and when alarm receiving feedback information confirming the alarm is received, the alarm information is sent to the alarm receiving terminal, so that the alarm is carried out after the alarm requirement is screened, the accuracy of the alarm information is improved, and the problem of police resource waste caused by false alarm is reduced.
In a preferred example, the present application: the real-time receiving terminal body audio and video data and sending the audio and video data to a preset audio and video dangerous situation identification model and a pre-alarm receiving terminal to generate alarm information, and the method comprises the following steps:
receiving audio and video data in real time, inputting the audio and video data into an audio and video dangerous case identification model, identifying the audio data through an audio identification algorithm and a semantic analysis algorithm, identifying the video data through an image identification algorithm, and obtaining a dangerous case label;
and transmitting the audio and video data and the corresponding dangerous case label to the pre-alarm receiving terminal in real time, and generating alarm information based on the dangerous case label and label modification information transmitted by the pre-alarm receiving terminal.
By adopting the technical scheme, the audio and video data of the terminal body are received in real time and are input into a preset audio and video dangerous situation recognition model, the audio data are processed through an audio recognition algorithm and a semantic recognition algorithm, so that the semantics of the language of alarming personnel or other personnel near the terminal body and the meaning of sound in the nearby environment are determined, the video data are recognized through an image recognition algorithm, so that the dangerous situations possibly occurring near the terminal body are determined, further the dangerous situation label for describing the dangerous situations possibly occurring is determined, and the automation degree for describing the dangerous situation possibly occurring is improved; and sending the audio and video data and the corresponding dangerous case label to the pre-alarm terminal in real time so as to enable staff of the pre-alarm terminal to check the obtained dangerous case label manually and confirm, delete or modify the obtained dangerous case label, thereby generating alarm information, improving the accuracy of the alarm information and facilitating the improvement of the disposal efficiency of subsequent dangerous case events.
The third object of the present application is achieved by the following technical scheme:
a computer readable storage medium storing a computer program which when executed by a processor performs the steps of any of the above-described security assistance methods.
In summary, the present application includes at least one of the following beneficial technical effects:
1. the terminal body of the intelligent city LED display terminal comprises a shell for installing and protecting other components, a display component for displaying images, an audio component for recording and playing audio, and a controller for controlling the working state of the intelligent city LED display terminal; the shell is also connected with a multidirectional camera shooting assembly which is used for acquiring images near the terminal body, including images of users, so as to identify help seekers, and monitor whether public security events, personal and property security damage events occur near the terminal body; the alarm component is convenient for sending an alarm signal when a user needs, the biological information acquisition component is used for acquiring biological information of the user for checking and recording, and the license reading component reads the identification document information of the user so as to identify the identity of the user; the controller comprises a monitoring image recognition module, a personnel information matching module, a personnel dangerous case information recognition module and a dangerous case event alarming module, and is used for acquiring a terminal monitoring head portrait shot by the intelligent city LED display terminal machine so as to judge whether dangerous case events such as personnel dangerous case and non-personnel dangerous case exist or not and sending out alarming signals after the dangerous case event occurs, so that the intelligent city LED display terminal machine has an alarming help seeking function and can confirm alarming help seeking signals of residents, and the popularization degree of alarming help seeking equipment and the accuracy of alarming information are improved.
2. Acquiring a terminal monitoring image shot by a multidirectional shooting assembly and inputting the terminal monitoring image into a preset image recognition model so as to recognize non-personnel dangerous situations, such as dangerous situations of fire, collision between vehicles and the like, in which related personnel cannot be recognized, from the terminal monitoring image, so as to determine non-personnel dangerous situation information; simultaneously, identifying all personnel images from the terminal monitoring images, and further identifying face images and action gesture information from the personnel images by using an image identification model; inputting each face image into a preset resident information base so as to determine the identity and the corresponding health state of local residents in a monitoring area, and facilitating the subsequent determination of different distress judgment standards for people in different health states; judging whether the situation of distress of the person exists or not according to the action gesture information and the corresponding health state information of each person, for example, when the person is identified to fall on the ground, determining the criterion for judging distress of the person on the ground according to the health state information of the person on the ground, and further judging whether the person is in distress or not, thereby determining dangerous case information of the person; based on the obtained non-personnel dangerous case information and personnel dangerous case information, judging whether a dangerous case event occurs in the monitoring area, determining the dangerous case type, marking the identity information of related personnel for the dangerous case event, generating alarm information again and generating the alarm information to the alarm receiving terminal, facilitating the alarm receiving personnel to know the condition of the dangerous case event, and improving the disposal efficiency of the alarm receiving personnel on the dangerous case event.
3. After the dangerous case type of the dangerous case event is determined, if the dangerous case type comprises personal injury, acquiring contact information of surrounding residents with medical skills from a resident information base so as to send help request information to the surrounding residents, so that the possibility of temporary rescue of people in distress and the rescue quality are improved; the dangerous case type is matched with the escape resource information which is used for handling the dangerous case event and corresponds to the needed use, so that the subsequent generation of alarm information based on the escape resource information is facilitated, and the handling efficiency of the dangerous case event is improved; and acquiring a corresponding resource distribution map based on the escape resource information and displaying the map on the intelligent city LED display terminal so that on-site personnel can acquire a way of acquiring the escape resource.
Drawings
Fig. 1 is a schematic structural diagram of an intelligent city LED display terminal according to an embodiment of the present application.
Fig. 2 is a schematic diagram of an internal structure of an intelligent city LED display terminal according to an embodiment of the present application.
Fig. 3 is a schematic side view illustrating an opened state of a protective case of the intelligent city LED display terminal according to the first embodiment of the present application.
Fig. 4 is a perspective view illustrating an opened state of a protective case of the intelligent city LED display terminal according to the first embodiment of the present application.
Fig. 5 is a schematic block diagram of a controller according to one embodiment of the present application.
Fig. 6 is a flowchart of a security assistance method in the second embodiment of the present application.
Fig. 7 is another flowchart of the security assistance method in the second embodiment of the present application.
Fig. 8 is a schematic view of an apparatus in a third embodiment of the present application.
Reference numerals illustrate:
1. a housing; 11. a frame; 12. a protective shell; 121. a front screen housing; 122. a front housing hinge; 123. a rear screen housing; 124. a rear housing hinge; 125. a transparent panel; 126. a panel frame; 13. a support rod; 14. waterproof blinds; 15. a waterproof fan; 2. a display assembly; 21. a front display screen; 22. a front screen hinge; 23. a rear display screen; 24. a rear screen hinge; 25. a display screen module; 26. a module side frame; 27. an angle limiting plate; 3. a multi-directional camera assembly; 31. a side view camera; 32. a top camera; 4. an alarm assembly; 5. a biological information acquisition component; 6. a license reading component; 7. and (5) a base.
Detailed Description
The present application is described in further detail below in conjunction with figures 1 to 8.
Example 1
Referring to fig. 1 and 2, the application discloses a smart city LED display terminal, which comprises a terminal body, wherein the terminal body comprises a casing 1, a display component 2, an audio component (not shown in the figure) and a controller (not shown in the figure), the casing 1 is connected with a multidirectional camera component 3, an alarm component 4, a biological information acquisition component 5 and a license reading component 6, and the controller is electrically connected with the display component 2, the audio component, the multidirectional camera component 3, the alarm component 4, the biological information acquisition component 5 and the license reading component 6; the terminal body is arranged in each area of the city, such as streets, parks, roadways and other areas needing public security protection and monitoring and defense arrangement according to actual demands; the casing 1 is used for installing and protecting other components of the terminal body, the display component 2 is used for displaying images and characters, the audio component is used for recording and playing audio, the multidirectional shooting component 3 is used for shooting and monitoring images around the terminal body, the alarm component 4 is used for sending alarm signals to personnel with alarm requirements, the biological information acquisition component 5 is used for acquiring biological information of a user, and the license reading component 6 is used for reading identification documents provided by the user.
The audio component comprises a loudspeaker and a microphone, wherein the microphone is used for recording the voice of an alarm person, the voice of other persons nearby the terminal body and other sounds nearby the terminal body, such as explosion sound, gunshot sound, collision sound and the like; the speaker is used for broadcasting the audio information that the wisdom city LED display terminal machine needs to demonstrate, can also broadcast audio warning information if necessary simultaneously, like alert flute sound, can also cooperate the microphone in order to supply the user of wisdom city LED display terminal machine to carry out real-time voice communication with police receiving personnel, customer service personnel.
The multidirectional camera assembly 3 comprises a top camera 32 arranged on the top of the front and back sides of the terminal body so as to record, use and read images of people showing contents on the smart city LED display terminal, and can be used for realizing a monitoring function; the multidirectional camera assembly 3 is further arranged on the side view camera 31 on the side of the terminal body and used for achieving the function of monitoring the two sides of the terminal body, and is matched with the top camera 32, so that the omnidirectional monitoring on the periphery of the terminal body is achieved, the monitoring effect of the intelligent city LED display terminal is improved, and meanwhile, the situation that the terminal body is nearby is known in real time by police receiving personnel and customer service personnel is facilitated.
The alarm assembly 4 includes an alarm button for realizing a one-button alarm function, specifically, the alarm assembly 4 may also set an anti-false touch device according to actual requirements or an anti-false touch function realized by a software program, so as to reduce the possibility of false alarm.
The biological information acquisition component 5 is used for acquiring biological information of a person, and may specifically include hardware devices for acquiring one or more of biological information such as a face image, a fingerprint, and the like.
The license reading component 6 may in particular comprise hardware means for reading one or more of the identification documents, including identification cards, drivers license, port australian pass etc., on the one hand for assisting in identifying the user identity information from the user's identification document.
The base 7 is used for placing the terminal body on the ground, and the base 7 in this embodiment is a fixed base 7, and in other embodiments of the present application, the base 7 can be replaced by a movable wheel base 7 according to actual requirements.
Referring to fig. 2 and 3, the casing 1 includes a frame 11, a protection shell 12 and a support bar 13, the bottom of the frame 11 is connected to the base 7 for supporting the equipment weight of the smart city LED display terminal, the protection shell 12 includes a front screen housing 121 and a rear screen housing 123, the frame 11 is connected with a front shell hinge 122 and a rear shell hinge 124, the top of the front screen housing 121 is rotatably connected to the front side of the top of the frame 11 through the front shell hinge 122, the top of the rear screen housing 123 is rotatably connected to the rear side of the top of the frame 11 through the rear shell hinge 124, and the protection shell 12 is used for sealing and protecting the non-waterproof electrical components inside the support smart city LED display terminal.
The display assembly 2 includes a front display 21 and a rear display 23, and preferably, the front display 21 and the rear display 23 may each be a small-pitch display; the frame 11 is connected with front shield hinge 22 and back shield hinge 24, the top of front display screen 21 is rotated through front shield hinge 22 and is connected in frame 11 top front side and is located preceding shell hinge 122 below, the top of back display screen 23 is rotated through back shield hinge 24 and is connected in frame 11 top rear side and is located back shell hinge 124 below, bracing piece 13 is the hydraulic telescoping rod, the one end of corresponding bracing piece 13 of both sides swivelling joint of front shield casing 121 and back shield casing 123, the one end swivelling joint of bracing piece 13 keeping away from front shield casing 121/back shield casing 123 is in frame 11, be convenient for follow-up opening protective housing 12, support protective housing 12 when lifting up the display screen, in order to maintain other inside spare parts of display screen or wisdom city LED display terminal, make protective housing 12 keep in the open state.
Referring to fig. 2 and 4, both the front and rear screen housings 121 and 123 are provided with a transparent panel 125 and a panel frame 126, and the transparent panel 125 is provided so as to protect the display assembly 2 without affecting the display image content of the display assembly 2, and the panel frame 126 is used to mount and support the transparent panel 125, preferably, the transparent panel 125 is made of tempered glass, and may be made of organic glass or other transparent materials according to actual needs.
Waterproof shutter 14 has been seted up to frame 11 lateral wall, and waterproof fan 15 is installed to frame 11 inner wall to reduce the rainwater and invade the possibility that causes non-waterproof power consumption components and parts damage in the smart city LED display terminal machine when dispelling inside heat for smart city LED display terminal machine, be convenient for increase the radiating efficiency of smart city LED display terminal machine simultaneously.
The front display screen 21 and the rear display screen 23 are composed of a plurality of display screen modules 25 and module side frames 26, so that display screens with different sizes can be manufactured based on the same display screen module 25, and the input cost of a production line for producing display screens with different types can be reduced; the bottom of the rear display screen 23 is provided with an angle limiting plate 27 so as to limit the inclination angle of the rear display screen 23 with respect to the horizontal plane.
As shown in fig. 5, the controller includes a monitoring image recognition module, a person information matching module, a person dangerous case information recognition module, and a dangerous case event alarm module. The detailed description of each functional module is as follows:
the monitoring image recognition module is used for acquiring a terminal monitoring image, inputting the terminal monitoring image into a preset image recognition model, recognizing non-personnel dangerous information and all personnel images from the terminal monitoring image, and determining face images and action gesture information corresponding to each personnel image;
The personnel information matching module is used for inputting each face image into a preset resident information base and determining the identity information and the health state information corresponding to each personnel image;
the personnel dangerous case information identification module is used for judging corresponding personnel dangerous case information based on the action gesture information and the corresponding health state information of each personnel;
the dangerous case event alarming module is used for judging whether a dangerous case occurs based on non-personnel dangerous case information and personnel dangerous case information, if the dangerous case occurs, determining the dangerous case type, marking the identity information of the related personnel for the dangerous case event, generating corresponding alarming information and sending the corresponding alarming information to the alarm receiving terminal.
For specific limitations of the controller, reference may be made to the limitation of the security assistance method hereinafter, and no further description is given here; each module in the controller may be implemented in whole or in part by software, hardware, and combinations thereof; the above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.
Example two
Referring to fig. 6, on the basis of the foregoing embodiment, the present application discloses a public security assistance method, which specifically includes the following steps:
s10: acquiring a terminal monitoring image, inputting the terminal monitoring image into a preset image recognition model, recognizing non-personnel dangerous information and all personnel images from the terminal monitoring image, and determining face images and action gesture information corresponding to each personnel image.
In this embodiment, the terminal monitoring image refers to image data captured by the multidirectional camera module 3 of the smart city LED display terminal; the image recognition model is used for carrying out artificial intelligent recognition on whether dangerous case events exist in a terminal monitoring image, an image recognition algorithm which carries out targeted training on the artificial intelligent image recognition on various dangerous case events is arranged in the image recognition model, the identifiable dangerous case events comprise fire disasters, high-altitude falling objects, car accidents, forbidden articles carried by personnel and the like, the image library of the artificial intelligent recognition also comprises photos or portraits of a plurality of wanted persons, and the image library of the artificial intelligent recognition also comprises training images of expressions corresponding to various emotions; the non-personnel dangerous case information refers to information which possibly relates to fire, high-altitude falling objects, car accidents and the like, and dangerous case events in which personnel participate cannot be identified in the images; the personnel image is an image of personnel contained in the terminal monitoring image, the personnel image specifically comprises a face image and a contour image, and the action gesture information is information of the action gesture currently made by the personnel determined after the personnel image is identified.
Specifically, a terminal monitoring image captured by the multi-directional camera assembly 3 is acquired, the terminal monitoring image is input into a preset image recognition model, and non-personnel dangerous situation information is recognized from the terminal monitoring image through an artificial intelligent image recognition algorithm, so that non-personnel dangerous situations, such as dangerous situations of fire, collision between vehicles and the like, occurring nearby the smart city LED display terminal machine cannot be recognized, and the non-personnel dangerous situation information is determined.
Specifically, all personnel images are identified from the terminal monitoring images, and the face images and the action gesture information are further identified from the personnel images by using an image identification model, so that the identity information corresponding to each personnel image, the current expression of the corresponding personnel and the current action gesture of the corresponding personnel can be further identified conveniently, the expressions of the identifiable personnel comprise anger, fear, sadness and the like, and the action gesture information of the identifiable personnel comprises fall, running, movement with injury, attack and the like, so that the identification and judgment accuracy of dangerous events is improved.
S20: and inputting each face image into a preset resident information base, and determining the identity information and the health state information corresponding to each person image.
In this embodiment, the resident information base refers to a database for storing information of residents living in communities near the LED display terminal of the smart city, and specifically stores photos, identity information, age information, contact information, occupation information, skill information, health status information, and relationship information with other residents, such as relatives information, spouse relationship information, and the like; the health status information includes mental health status and physical health status.
Specifically, each face image is input into a preset resident information base so as to determine the identity and the corresponding health state of local residents in a monitoring area, and different distress judgment standards are convenient to determine for personnel in different health states subsequently; for example, when a person is detected to fall, if the falling person is an old person or a person with a history of easily inducing a motion sickness of the person, the alarm information can be sent out when the falling person is detected to not climb up in the person 10S, and if the falling person is a healthy adult, the alarm information can be sent out when the falling person is detected to not climb up in the person 60S, so that the alarm efficiency when people with poor health state are in distress is improved.
S30: and judging corresponding personnel dangerous case information based on the action gesture information and the corresponding health state information of each personnel.
In this embodiment, the personnel dangerous case information refers to information related to a personnel encountering a dangerous case event.
Specifically, according to the action gesture information and the corresponding health state information of each person, judging whether a person is in danger, for example, when the person is identified to fall on the ground, determining the criterion for judging the person in danger on the ground according to the health state information of the person on the ground, and further judging whether the person is in danger or not, thereby determining the dangerous case information of the person.
S40: judging whether a dangerous case event occurs or not based on non-personnel dangerous case information and personnel dangerous case information, if so, determining the dangerous case type, marking the identity information of related personnel for the dangerous case event, generating corresponding alarm information and sending the alarm information to an alarm receiving terminal.
In this embodiment, the dangerous case event refers to an event with an alarm requirement; the dangerous case type refers to the type of the dangerous case event; the alarm information is a message which is generated after the analysis based on the dangerous case event and records the related information of the dangerous case event, and is used for being sent to the alarm receiving terminal so that alarm receiving staff can know the alarm requirement, and preferably, the alarm information can also increase a disposal scheme according to the actual requirement.
Specifically, based on the obtained non-personnel dangerous case information and personnel dangerous case information, judging whether a dangerous case event occurs in a monitoring area, determining the type of the dangerous case, marking the identity information of related personnel for the dangerous case, generating alarm information again and generating the alarm information to an alarm receiving terminal, facilitating the alarm receiving personnel to know the condition of the dangerous case, identifying the identities of the related personnel and the roles in the dangerous case, and improving the disposal efficiency of the alarm receiving personnel on the dangerous case.
Wherein, after the step of determining the dangerous case type if the dangerous case event occurs, the method further comprises the steps of:
s41: when the dangerous case type includes a personal injury, contact information of surrounding residents with medical skills is acquired from a resident information base, and help request information is transmitted based on the contact information of the surrounding residents with medical skills.
In this embodiment, a dangerous case event of a personal injury type refers to a dangerous case event in which there is a personal injury or a personal illness onset condition.
Specifically, after determining the dangerous case type of the dangerous case event, if the dangerous case type comprises personal injury, determining contact information of surrounding residents with corresponding medical skills from resident occupation information and skill information recorded in a resident information base, and sending help request information to the surrounding residents, so that the possibility of temporary rescue and rescue quality of people in danger can be improved; the skill information can be a skill certificate held by residents, and the help request information records the injury type of personnel in the current dangerous case event and the dangerous case occurrence place information, so that the personnel receiving the help request information can judge whether the personnel have rescue conditions and skills.
S42: and matching the corresponding needed risk escape resource information based on the risk type.
In this embodiment, the escape resource information refers to information of resources required for handling the dangerous event, such as location information of fire equipment, location information of AED devices, location information of first-aid kits, and the like.
Specifically, the danger type is matched based on the danger resource information which is used for handling the danger event and corresponds to the needed use, so that the subsequent generation of alarm information based on the danger resource information is facilitated, and the handling efficiency of the police to the danger event after arriving at the scene is improved.
S43: and acquiring a corresponding resource distribution map based on the risk-free resource information and sending the resource distribution map to the display component.
Specifically, a corresponding resource distribution map is obtained based on the escape resource information and is displayed on the smart city LED display terminal, so that on-site personnel can know the way of obtaining the escape resource.
Furthermore, the resource distribution map can be added with a plurality of non-emergency resource distribution maps, such as a public toilet distribution map, a pharmacy distribution map, a 24-hour business shop distribution map and the like, according to actual demands, and business time information is sent to corresponding business places of the escaping resource marks in the time-limited business places.
Further, the dangerous case event alarm module further comprises:
the help request information sending sub-module is used for acquiring contact information of surrounding residents with medical skills from a resident information base when the dangerous case type comprises personal injury, and sending the help request information based on the contact information of the surrounding residents with the medical skills;
the danger escape resource information matching sub-module is used for matching the corresponding needed danger escape resource information based on the dangerous case type;
and the escape resource information display sub-module is used for acquiring a corresponding resource distribution map based on the escape resource information and sending the resource distribution map to the display assembly.
Wherein, after the step of marking the identity information of the associated person for the dangerous event, the method further comprises:
s44: identifying identity information of a person in danger in a dangerous case, acquiring contact information of a corresponding contact person based on the identity information of the person in danger, and sending dangerous case notification information based on the contact information of the contact person.
In this embodiment, the associated personnel refers to personnel related to the dangerous event, including distress personnel, responsibility personnel, suspicion personnel and alarm personnel; wherein a distress person refers to a person with help requirements, such as a victim of a dangerous event; a responsible person refers to a person responsible for the occurrence of a dangerous event, such as an intentional/delinquent/accidental culprit of the dangerous event; suspicions refer to persons who may have intent to exercise or to make dangerous actions, such as persons holding contraband in public places; an alarm person refers to a person triggering the alarm function of the alarm assembly.
Specifically, after the dangerous case event occurs, identifying identity information of each person in danger in the dangerous case event; the contact information of the contact person of the distress person is obtained from the resident information base so as to send distress notification information to the contact person of the distress person, so that the contact person of the distress person can know the distress condition of the distress person in time, and the contact person of the distress person can conveniently arrive at the dangerous event occurrence site in time to assist in rescue the distress person, such as blood donation, signing medical service documents and the like; contacts for a victim include the parent, spouse, or other person with care, support, and care obligations of the victim.
S45: identifying identity information of a responsible person and a suspected person in the dangerous case, acquiring contact information of the responsible person and the suspected person based on the identity information of the responsible person and the suspected person, and sending coordination investigation information based on the contact information of the responsible person and the suspected person.
Specifically, identity information of the responsible person and the suspected person in the dangerous case is identified, contact information of the responsible person and the suspected person is further obtained, and matching investigation information is conveniently sent to the responsible person and the suspected person so as to inform the responsible person and the suspected person of legal obligations, legal consequences and the like, and the responsible person and the suspected person are supervised to arrive at the scene so that the person handling the dangerous case can find out the case.
S46: and adding the personnel image of each associated personnel to the alarm information.
Specifically, the personnel images of all the related personnel are added into the alarm information, so that the identity of personnel appearing on the scene of the dangerous case can be rapidly distinguished by the police receiving personnel or the personnel on the scene of the dangerous case, the personnel in danger can be saved, and the responsible personnel and suspected personnel can be controlled.
Further, the dangerous case event alarm module further comprises:
the dangerous case notification information sending sub-module is used for identifying identity information of persons in danger in a dangerous case event, acquiring contact information of corresponding contacts based on the identity information of the persons in danger, and sending dangerous case notification information based on the contact information of the contacts;
the cooperation investigation information sending sub-module is used for identifying identity information of the responsible person and the suspected person in the dangerous case, acquiring contact information of the responsible person and the suspected person based on the identity information of the responsible person and the suspected person, and sending cooperation investigation information based on the contact information of the responsible person and the suspected person;
and the personnel association sub-module is used for adding the personnel images of the associated personnel to the alarm information.
After the step of generating the corresponding alarm information and sending the alarm information to the alarm receiving terminal, the method further comprises the following steps:
S47: searching an audible and visual alarm instruction from the alarm information, and sending the audible and visual alarm instruction to a display component and an audio component.
In this embodiment, the audible and visual alarm instruction refers to an instruction for controlling a display component of the smart city LED display terminal to emit a warning light signal and an audio component to emit a warning sound signal, where the types of the warning light signal include: the specific playing mode of the warning light signals can be selected from one type of playing, multiple types of combined playing or multiple types of alternate playing of the warning light signals.
The types of warning sound signals include: alarm whistle audio frequency, responsibility personnel information announce audio frequency, suspicion personnel information announce audio frequency, resident evacuation announcement audio frequency, resident help announcement audio frequency, alarm state information audio frequency and legal result announce audio frequency, the play mode of specific warning sound signal can be from above-mentioned warning sound signal kind select one kind broadcast, multiple combination broadcast or multiple broadcast in turn.
Specifically, the alarm lamp image means that the LED lamp beads of the display screen emit light according to the light color and the flicker frequency of the alarm lamp at the maximum power;
The resident evacuation notification image is an image generated according to text information of people nearby, and the specific content can be that XX dangerous cases occur in XX places, people are ordered to evacuate, and people are prevented from going to the places;
the resident help-seeking notification image refers to an image generated according to text information seeking help to nearby people, and the specific content can be that XX dangerous case occurs in XX site, the wounded needs XX rescue, the person with XX skill is required to go to the place for rescue, other people assist in giving out rescue channels, and the staff is thanks to the following-! ";
the alarm state information image refers to an image generated according to the alarm state of the current dangerous case, and the specific content can be 'dangerous case occurrence and alarm'.
Specifically, the resident evacuation notification audio is audio generated according to text information of nearby personnel, and the specific content can be that XX dangerous cases occur in XX places, please evacuate orderly and avoid going to the places;
the resident help-seeking notification audio is audio generated according to the text information seeking help to nearby people, and the specific content can be that XX dangerous case occurs in XX place, the wounded needs XX rescue, the person with XX skill is required to go to the place for rescue, other people assist in giving out rescue channels, and the staff is thanks to the following-! ";
The alarm state information audio is audio generated according to the alarm state of the current dangerous case, and the specific content can be' dangerous case occurred and alarm;
legal consequences declare audio refers to the audio of legal regulations, the documents of community regulatory rules and corresponding consequences that may be violated by the responsible/suspected person in the event of a dangerous situation.
Specifically, after the alarm information is sent to the alarm receiving terminal, an audible and visual alarm instruction is searched from the alarm information, if the alarm information comprises the audible and visual alarm instruction, the audible and visual alarm instruction is sent to the display component and the audio component, so that after an alarm person successfully triggers an alarm function, audible and visual alarm signals sent by the display component and the audio component of the intelligent city LED display terminal are used for attracting the attention of nearby persons, evacuating residents or requesting resident assistance, prompting the responsible person/suspected person to cooperate with the work of dangerous situation disposal personnel, and stopping invasion.
Further, the dangerous case event alarm module further comprises:
and the audible and visual alarm sub-module is used for searching audible and visual alarm instructions from the alarm information and sending the audible and visual alarm instructions to the display component and the audio component.
As shown in fig. 7, the public security assistance method further includes:
S50: and receiving the alarm control signal in real time, generating a pre-alarm signal and sending the pre-alarm signal to the pre-alarm receiving terminal.
In this embodiment, the alarm control signal refers to a signal generated after an alarm person triggers an alarm function of the alarm assembly; the pre-alarm signal is a signal generated after the alarm function is triggered and is used for being sent to the pre-alarm receiving terminal, so that a worker of the pre-alarm receiving terminal can know the condition that someone triggers the alarm function and evaluate whether an alarm requirement exists or not; the alarm signal is a signal generated when the alarm requirement exists after the pre-alarm signal is evaluated by the pre-alarm receiving terminal; the alarm receiving terminal is used for receiving alarm signals and sending alarm information to an alarm receiving person, wherein the alarm receiving terminal and the alarm receiving terminal can be the same terminal or different terminals, and preferably, the alarm receiving terminal is arranged at a community security department and the alarm receiving terminal is arranged at an alarm dispatching office.
Specifically, the alarm control signal is received in real time to generate a pre-alarm signal and send the pre-alarm signal to the pre-alarm terminal, so that a worker of the pre-alarm terminal can know that a person triggers an alarm function of the intelligent city LED display terminal.
S60: and acquiring face images of the alarm personnel to acquire corresponding identity information and health state information, and storing the face images, the identity information and the health state information of the alarm personnel in a historical alarm information base.
Specifically, a face image of a person triggering an alarm function is acquired from a terminal monitoring image, so that identity information, health state information and the like of the alarm person are identified based on the face image or the biological information of the alarm person acquired by the biological information acquisition component, on one hand, the authenticity of the alarm requirement is convenient to judge in an auxiliary mode, on the other hand, the historical alarm record of the alarm person is also convenient to record, and the follow-up action of abusing the alarm function is convenient to trace.
S70: and receiving the audio and video data of the terminal body in real time, and sending the audio and video data to a preset audio and video dangerous situation identification model and a pre-alarm receiving terminal to generate alarm information.
In this embodiment, the audio and video data refers to audio data and video data acquired by a terminal body; the audio/video dangerous case recognition model is a model for recognizing whether a dangerous case event exists based on audio/video data.
Specifically, audio and video data of the terminal body are received in real time, the audio and video data are sent to an audio and video dangerous situation recognition model so as to assist in analyzing dangerous situations which possibly occur after audio recognition algorithm and image recognition algorithm processing are carried out according to voice of an alarm person, other audio information and video information near the terminal body, on the other hand, the audio and video data are sent to a pre-alarm receiving terminal so as to enable a worker to directly talk with the alarm person when necessary or manually judge the dangerous situations which possibly occur at present based on the audio and video data, and alarm information is generated according to the result after the possible dangerous situation analysis.
Wherein, in step S70, it includes:
s71: the method comprises the steps of receiving audio and video data in real time, inputting the audio and video data into an audio and video dangerous case identification model, identifying the audio data through an audio identification algorithm and a semantic analysis algorithm, identifying the video data through an image identification algorithm, and obtaining a dangerous case label.
In this embodiment, the dangerous case tag refers to tag information for classifying or describing a dangerous case event, which is determined based on audio and video data.
Specifically, audio and video data of the terminal body are received in real time and are input into a preset audio and video dangerous case recognition model, the audio data are processed through an audio recognition algorithm and a semantic recognition algorithm, so that the meaning of language of alarming personnel or other personnel nearby the terminal body and the meaning of sound in nearby environments are determined, the video data are recognized through an image recognition algorithm, so that the dangerous case possibly occurring nearby the terminal body is determined, further, dangerous case labels for describing the dangerous case possibly occurring are determined, and the automation degree for describing the dangerous case possibly occurring is improved.
S72: and transmitting the audio and video data and the corresponding dangerous case label to the pre-alarm receiving terminal in real time, and generating alarm information based on the dangerous case label and label modification information transmitted by the pre-alarm receiving terminal.
In this embodiment, the tag modification information refers to an instruction when the staff of the pre-alarm terminal manually modifies the dangerous case tag.
Specifically, the audio and video data and the corresponding dangerous case label are sent to the pre-alarm terminal in real time, so that a worker of the pre-alarm terminal can check the acquired dangerous case label manually and confirm, delete or modify the acquired dangerous case label, and alarm information is generated, so that the accuracy of the alarm information is improved, and the disposal efficiency of subsequent dangerous case events is improved.
S80: and receiving alarm receiving feedback information, and if the alarm receiving feedback information is confirmation alarm, sending the alarm information to an alarm receiving terminal.
In this embodiment, the alarm receiving feedback information refers to information sent by a worker of the pre-alarm receiving terminal after evaluating the alarm information attached to the pre-alarm signal, for determining whether the alarm signal needs to be sent; when the staff of the pre-alarm receiving terminal does not send alarm receiving feedback information within the preset evaluation time (preferably set to 60S), alarm receiving feedback information for confirming that an alarm signal needs to be sent is automatically generated.
Specifically, the staff of the pre-alarm terminal determines whether the dangerous situation is necessary to be disposed according to the analysis result of the dangerous situation, so that alarm receiving feedback information is determined, and when alarm receiving feedback information confirming the alarm is received, the alarm information is sent to the alarm receiving terminal, so that the alarm is carried out after the alarm requirement is screened, the accuracy of the alarm information is improved, and the problem of police resource waste caused by false alarm is reduced.
Further, the controller further includes:
the pre-alarm signal sending module is used for receiving the alarm control signal in real time, generating a pre-alarm signal and sending the pre-alarm signal to the pre-alarm receiving terminal;
the alarm personnel information storage module is used for acquiring face images of alarm personnel so as to acquire corresponding identity information and health state information, and storing the face images, the identity information and the health state information of the alarm personnel in the history alarm information base;
the audio and video data analysis module is used for receiving the audio and video data of the terminal body in real time and sending the audio and video data to a preset audio and video dangerous situation identification model and a pre-alarm receiving terminal to generate alarm information;
the alarm signal sending module is used for receiving alarm receiving feedback information, and sending the alarm information to an alarm receiving terminal if the alarm receiving feedback information is confirmation alarm.
Wherein, audio and video data analysis module still includes:
the dangerous case label acquisition sub-module is used for receiving the audio and video data in real time and inputting the audio and video data into the audio and video dangerous case identification model, identifying the audio data through an audio identification algorithm and a semantic analysis algorithm, identifying the video data through an image identification algorithm and acquiring a dangerous case label;
The alarm information generation sub-module is used for sending the audio and video data and the corresponding dangerous case label to the pre-alarm receiving terminal in real time and generating alarm information based on the dangerous case label and label modification information sent by the pre-alarm receiving terminal.
It should be understood that the sequence number of each step in the foregoing embodiment does not mean that the execution sequence of each process should be determined by the function and the internal logic of each process, and should not limit the implementation process of the embodiment of the present application in any way.
Example III
The controller includes a computer device, which may be a server, the internal structure of which may be as shown in fig. 8. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The database of the computer equipment is used for storing data such as terminal monitoring images, image recognition models, non-personnel dangerous case information, personnel images, face images, action posture information, resident information base, identity information, health state information, personnel dangerous case information, dangerous case type, alarm information and the like. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program when executed by a processor implements a security assistance method.
A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, the processor implementing the following steps when executing the computer program:
s10: acquiring a terminal monitoring image, inputting the terminal monitoring image into a preset image recognition model, recognizing non-personnel dangerous information and all personnel images from the terminal monitoring image, and determining face images and action gesture information corresponding to each personnel image;
s20: inputting each face image into a preset resident information base, and determining identity information and health state information corresponding to each person image;
s30: judging corresponding personnel dangerous case information based on the action gesture information and the corresponding health state information of each personnel;
s40: judging whether a dangerous case event occurs or not based on non-personnel dangerous case information and personnel dangerous case information, if so, determining the dangerous case type, marking the identity information of related personnel for the dangerous case event, generating corresponding alarm information and sending the alarm information to an alarm receiving terminal.
In one embodiment, a computer readable storage medium is provided having a computer program stored thereon, which when executed by a processor, performs the steps of:
S10: acquiring a terminal monitoring image, inputting the terminal monitoring image into a preset image recognition model, recognizing non-personnel dangerous information and all personnel images from the terminal monitoring image, and determining face images and action gesture information corresponding to each personnel image;
s20: inputting each face image into a preset resident information base, and determining identity information and health state information corresponding to each person image;
s30: judging corresponding personnel dangerous case information based on the action gesture information and the corresponding health state information of each personnel;
s40: judging whether a dangerous case event occurs or not based on non-personnel dangerous case information and personnel dangerous case information, if so, determining the dangerous case type, marking the identity information of related personnel for the dangerous case event, generating corresponding alarm information and sending the alarm information to an alarm receiving terminal.
Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the various embodiments provided herein may include non-volatile and/or volatile memory. The nonvolatile memory can include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink), DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), among others.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional units and modules is illustrated, and in practical application, the above-described functional distribution may be performed by different functional units and modules according to needs, i.e. the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-described functions.
The above embodiments are only for illustrating the technical solution of the present application, and are not limiting; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art will understand; the technical scheme described in the foregoing embodiments can be modified or some of the features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present application, and are intended to be included in the scope of the present application.

Claims (10)

1. The intelligent city LED display terminal comprises a terminal body, wherein the terminal body comprises a machine shell (1), a display assembly (2), an audio assembly and a controller, the machine shell (1) is connected with a multidirectional camera assembly (3), an alarm assembly (4), a biological information acquisition assembly (5) and a license reading assembly (6), and the controller is electrically connected with the display assembly (2), the audio assembly, the multidirectional camera assembly (3), the alarm assembly (4), the biological information acquisition assembly (5) and the license reading assembly (6); the controller includes:
The monitoring image recognition module is used for acquiring a terminal monitoring image, inputting the terminal monitoring image into a preset image recognition model, recognizing non-personnel dangerous information and all personnel images from the terminal monitoring image, and determining face images and action gesture information corresponding to each personnel image;
the personnel information matching module is used for inputting each face image into a preset resident information base and determining the identity information and the health state information corresponding to each personnel image;
the personnel dangerous case information identification module is used for judging corresponding personnel dangerous case information based on the action gesture information and the corresponding health state information of each personnel;
the dangerous case event alarming module is used for judging whether a dangerous case occurs based on non-personnel dangerous case information and personnel dangerous case information, if the dangerous case occurs, determining the dangerous case type, marking the identity information of the related personnel for the dangerous case event, generating corresponding alarming information and sending the corresponding alarming information to the alarm receiving terminal.
2. The smart city LED display terminal of claim 1, wherein: the casing (1) comprises a frame (11), a protective shell (12) and a supporting rod (13), the display assembly (2) comprises two display screens, one side of each display screen is rotationally connected to the top of the frame (11), one side of each protective shell (12) is rotationally connected to the top of the frame (11) and located above the display screen, the supporting rod (13) is a telescopic rod, and two ends of the supporting rod (13) are respectively rotationally connected to the frame (11) and the protective shell (12).
3. The smart city LED display terminal of claim 1, wherein: the waterproof shutter (14) is arranged on the shell (1), and the waterproof fan (15) is arranged on the inner wall of the shell (1).
4. A public security assistance method applied to the smart city LED display terminal set according to any one of claims 1 to 3, comprising:
acquiring a terminal monitoring image, inputting the terminal monitoring image into a preset image recognition model, recognizing non-personnel dangerous information and all personnel images from the terminal monitoring image, and determining face images and action gesture information corresponding to each personnel image;
inputting each face image into a preset resident information base, and determining identity information and health state information corresponding to each person image;
judging corresponding personnel dangerous case information based on the action gesture information and the corresponding health state information of each personnel;
judging whether a dangerous case event occurs or not based on non-personnel dangerous case information and personnel dangerous case information, if so, determining the dangerous case type, marking the identity information of related personnel for the dangerous case event, generating corresponding alarm information and sending the alarm information to an alarm receiving terminal.
5. A security assistance method as claimed in claim 4, wherein: based on the non-personnel dangerous case information and the personnel dangerous case information, judging whether a dangerous case event occurs, and if the dangerous case event occurs, determining the dangerous case type, wherein the method further comprises the following steps:
When the dangerous case type comprises personal injury, acquiring contact information of surrounding residents with medical skills from a resident information base, and sending help seeking request information based on the contact information of the surrounding residents with medical skills;
matching the corresponding needed risk escape resource information based on the risk type;
and acquiring a corresponding resource distribution map based on the risk-free resource information and sending the resource distribution map to the display component.
6. A security assistance method as claimed in claim 4, wherein: the related personnel refer to personnel related to dangerous case events, including distress personnel, responsibility personnel and suspicion personnel;
after the identity information of the associated person is marked for the dangerous case event, the method further comprises the following steps:
identifying identity information of a person in danger in a dangerous case, acquiring contact information of a corresponding contact person based on the identity information of the person in danger, and sending dangerous case notification information based on the contact information of the contact person;
identifying identity information of a responsible person and a suspected person in the dangerous case, acquiring contact information of the responsible person and the suspected person based on the identity information of the responsible person and the suspected person, and sending coordination investigation information based on the contact information of the responsible person and the suspected person;
And adding the personnel image of each associated personnel to the alarm information.
7. A security assistance method as claimed in claim 4, wherein: after the corresponding alarm information is generated and sent to the alarm receiving terminal, the method further comprises the steps of:
searching an audible and visual alarm instruction from the alarm information, and sending the audible and visual alarm instruction to a display component and an audio component;
the audible and visual alarm instruction is used for controlling a display component of the intelligent city LED display terminal to send out an alarm light signal and an audio component to send out an alarm sound signal;
the types of the warning light signals include: warning light images, responsibility person images, suspicion person images, resident evacuation notification images, resident help notification images and alarm state information images;
the types of the warning sound signals comprise: alarm whistle audio, responsibility personnel information declaring audio, suspicion personnel information declaring audio, resident evacuation notice audio, resident help notice audio and alarm state information audio.
8. A security assistance method as claimed in claim 4, wherein: the method further comprises the steps of:
receiving alarm control signals in real time, generating pre-alarm signals and sending the pre-alarm signals to a pre-alarm receiving terminal;
Acquiring face images of alarm personnel to acquire corresponding identity information and health state information, and storing the face images, the identity information and the health state information of the alarm personnel in a historical alarm information base;
receiving audio and video data of a terminal body in real time, and sending the audio and video data to a preset audio and video dangerous situation identification model and a pre-alarm receiving terminal to generate alarm information;
and receiving alarm receiving feedback information, and if the alarm receiving feedback information is confirmation alarm, sending the alarm information to an alarm receiving terminal.
9. A security assistance method as claimed in claim 8, wherein: the real-time receiving terminal body audio and video data and sending the audio and video data to a preset audio and video dangerous situation identification model and a pre-alarm receiving terminal to generate alarm information, and the method comprises the following steps:
receiving audio and video data in real time, inputting the audio and video data into an audio and video dangerous case identification model, identifying the audio data through an audio identification algorithm and a semantic analysis algorithm, identifying the video data through an image identification algorithm, and obtaining a dangerous case label;
and transmitting the audio and video data and the corresponding dangerous case label to the pre-alarm receiving terminal in real time, and generating alarm information based on the dangerous case label and label modification information transmitted by the pre-alarm receiving terminal.
10. A computer readable storage medium storing a computer program which when executed by a processor implements the steps of the peace assistance method of any one of claims 4-9.
CN202311325914.0A 2023-10-13 2023-10-13 Smart city LED display terminal, public security auxiliary method and storage medium Pending CN117315914A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311325914.0A CN117315914A (en) 2023-10-13 2023-10-13 Smart city LED display terminal, public security auxiliary method and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311325914.0A CN117315914A (en) 2023-10-13 2023-10-13 Smart city LED display terminal, public security auxiliary method and storage medium

Publications (1)

Publication Number Publication Date
CN117315914A true CN117315914A (en) 2023-12-29

Family

ID=89246149

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311325914.0A Pending CN117315914A (en) 2023-10-13 2023-10-13 Smart city LED display terminal, public security auxiliary method and storage medium

Country Status (1)

Country Link
CN (1) CN117315914A (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109727544A (en) * 2019-01-28 2019-05-07 太龙智显科技(深圳)有限公司 Two-sided intelligent LED terminating machine
CN111285216A (en) * 2020-03-17 2020-06-16 苏州默顿快速电梯有限公司 Intelligent elevator alarm system and action process thereof
CN116246416A (en) * 2023-03-07 2023-06-09 中科计算技术西部研究院 Intelligent analysis early warning platform and method for security protection

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109727544A (en) * 2019-01-28 2019-05-07 太龙智显科技(深圳)有限公司 Two-sided intelligent LED terminating machine
CN111285216A (en) * 2020-03-17 2020-06-16 苏州默顿快速电梯有限公司 Intelligent elevator alarm system and action process thereof
CN116246416A (en) * 2023-03-07 2023-06-09 中科计算技术西部研究院 Intelligent analysis early warning platform and method for security protection

Similar Documents

Publication Publication Date Title
CN109598885B (en) Monitoring system and alarm method thereof
US8606316B2 (en) Portable blind aid device
US8368754B2 (en) Video pattern recognition for automating emergency service incident awareness and response
US7280042B2 (en) Standoff security and real-time vendor verification system and apparatus
CN111815916A (en) Monitoring and early warning method and system for target area and mobile terminal
CN109548408B (en) Autonomous vehicle providing safety zone to person in distress
US8253527B2 (en) Alarm system and method for warning of emergencies
JP6529062B1 (en) DIGITAL ACCURATE SECURITY SYSTEM, METHOD, AND PROGRAM
CN113011833A (en) Safety management method and device for construction site, computer equipment and storage medium
JP2008203985A (en) Emergency notification system having emergency notification function, and the emergency response function
CN111985428A (en) Security detection method and device, electronic equipment and storage medium
CN114170272A (en) Accident reporting and storing method based on sensing sensor in cloud environment
JP6621092B1 (en) Risk determination program and system
JP2011145839A (en) Monitoring system, device, method and program
CN115083089A (en) Night visual monitoring system and method based on unmanned aerial vehicle
CN206863776U (en) A kind of metal detection door for face recognition
CN110222216A (en) Multifunctional intellectual defence system
US9641965B1 (en) Method, system and computer program product for law enforcement
CN117315914A (en) Smart city LED display terminal, public security auxiliary method and storage medium
US11587420B2 (en) Systems and methods of combining RFID and VMS for people tracking and intrusion detection
EP3109837A1 (en) System and method of smart incident analysis in control system using floor maps
JP6739119B6 (en) Risk determination program and system
JP7447626B2 (en) Information processing method, information processing device, program and information processing system
CN114281656A (en) Intelligent central control system
KR102065786B1 (en) BLE communication system for smart city care

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination