CN114701934B - Security control method, device and system for elevator, cloud platform and storage medium - Google Patents
Security control method, device and system for elevator, cloud platform and storage medium Download PDFInfo
- Publication number
- CN114701934B CN114701934B CN202210476495.XA CN202210476495A CN114701934B CN 114701934 B CN114701934 B CN 114701934B CN 202210476495 A CN202210476495 A CN 202210476495A CN 114701934 B CN114701934 B CN 114701934B
- Authority
- CN
- China
- Prior art keywords
- elevator
- abnormal behavior
- identification result
- video information
- behavior identification
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 60
- 206010000117 Abnormal behaviour Diseases 0.000 claims abstract description 144
- 230000008569 process Effects 0.000 claims abstract description 27
- 238000012545 processing Methods 0.000 claims abstract description 25
- 238000013528 artificial neural network Methods 0.000 claims description 25
- 238000001514 detection method Methods 0.000 claims description 11
- 238000007781 pre-processing Methods 0.000 claims description 5
- 230000000903 blocking effect Effects 0.000 claims description 3
- 230000014759 maintenance of location Effects 0.000 claims description 2
- 238000012544 monitoring process Methods 0.000 abstract description 17
- 230000002159 abnormal effect Effects 0.000 abstract description 12
- 230000005856 abnormality Effects 0.000 abstract description 8
- 230000000694 effects Effects 0.000 abstract description 7
- 230000006870 function Effects 0.000 description 15
- 238000004458 analytical method Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 238000003491 array Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 230000006399 behavior Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000004899 motility Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B66—HOISTING; LIFTING; HAULING
- B66B—ELEVATORS; ESCALATORS OR MOVING WALKWAYS
- B66B5/00—Applications of checking, fault-correcting, or safety devices in elevators
- B66B5/0006—Monitoring devices or performance analysers
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02B—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
- Y02B50/00—Energy efficient technologies in elevators, escalators and moving walkways, e.g. energy saving or recuperation technologies
Landscapes
- Indicating And Signalling Devices For Elevators (AREA)
Abstract
The invention discloses a security control method, device and system for an elevator, a cloud platform and a storage medium. The method comprises the following steps: acquiring video information in the running process of the elevator; processing the video information to obtain key feature data, and carrying out abnormal behavior recognition according to the key feature data to obtain an abnormal behavior recognition result; the abnormal behavior identification result is sent to the terminal equipment; and receiving an emergency control instruction determined by the terminal equipment according to the abnormal behavior recognition result, and performing remote emergency control on the elevator according to the emergency control instruction. The method can realize automatic identification of abnormal conditions in the elevator, does not depend on subjective activity of personnel, enables security personnel to synchronously receive identification results after monitoring the abnormality, and remotely controls the elevator.
Description
Technical Field
The invention relates to the technical field of elevators, in particular to a security control method, device and system for an elevator, a cloud platform and a storage medium.
Background
The elevator load acts as a vehicle in the building, and the passengers may be injured by improper behavior during use. In the related art, the security function of the elevator is realized through intelligent hardware locally deployed in elevator equipment or real-time checking of property security through a monitoring screen. However, the security function of the elevator in the related art is that the elevator is managed through intelligent hardware in an elevator car, such as an intelligent camera recognizes an alarm after a battery car, but security personnel cannot be notified after abnormal behaviors are found, and the common camera needs to be replaced by the intelligent camera depending on the intelligent hardware, so that the cost is high, and the elevator is managed through checking a monitoring screen by the security personnel, but depending on responsibility and energy of the personnel, omission easily occurs, and the elevator function can not be remotely controlled in emergency after the abnormal behaviors are found.
Disclosure of Invention
The present invention aims to solve at least one of the technical problems in the related art to some extent. Therefore, a first object of the present invention is to provide a security control method for an elevator, so as to automatically identify abnormal situations in the elevator, and enable security personnel to synchronously receive identification results after monitoring the abnormality without depending on subjective activity of personnel, and remotely control the elevator.
A second object of the present invention is to provide a cloud platform.
A third object of the present invention is to propose a computer readable storage medium.
A fourth object of the present invention is to provide a security control device for an elevator.
A fifth object of the invention is to propose a security control system of an elevator.
To achieve the above objective, an embodiment of a first aspect of the present invention provides a security control method for an elevator, including: acquiring video information in the elevator running process; processing the video information to obtain key characteristic data, and carrying out abnormal behavior recognition according to the key characteristic data to obtain an abnormal behavior recognition result; the abnormal behavior identification result is sent to terminal equipment; and receiving an emergency control instruction determined by the terminal equipment according to the abnormal behavior recognition result, and performing remote emergency control on the elevator according to the emergency control instruction.
An embodiment of the second aspect of the invention provides a cloud platform, which comprises a memory, a processor and a security control program of an elevator, wherein the security control program of the elevator is stored in the memory and can run on the processor, and the security control method of the elevator is realized when the security control program of the elevator is executed by the processor.
An embodiment of the third aspect of the present invention provides a computer readable storage medium, on which a security control program of an elevator is stored, where the security control program of the elevator implements the security control method of the elevator when executed by a processor.
An embodiment of a fourth aspect of the present invention provides a security control apparatus for an elevator, including: the acquisition module is used for acquiring video information in the elevator operation process; the processing module is used for processing the video information to obtain key feature data, and carrying out abnormal behavior recognition according to the key feature data to obtain an abnormal behavior recognition result; the receiving and transmitting module is used for sending the abnormal behavior identification result to the terminal equipment and receiving an emergency control instruction determined by the terminal equipment according to the abnormal behavior identification result; and the control module is used for carrying out remote emergency control on the elevator according to the emergency control instruction.
An embodiment of a fifth aspect of the present invention provides a security control system for an elevator, including an elevator, a cloud platform, and a terminal device, where the elevator is correspondingly provided with a camera, and the camera is used to photograph the elevator running process, so as to obtain video information in the elevator running process, and send the video information to the cloud platform; the cloud platform is used for processing the video information to obtain key feature data, carrying out abnormal behavior recognition according to the key feature data to obtain an abnormal behavior recognition result, and sending the abnormal behavior recognition result to the terminal equipment; the terminal equipment is used for displaying the abnormal behavior identification result, generating an emergency control instruction when receiving an instruction for confirming the abnormal behavior identification result, and sending the emergency control instruction to the cloud platform; the cloud platform is also used for remotely controlling the elevator in an emergency mode when the emergency control instruction is received.
According to the security control method, the security control device, the security control system, the cloud platform and the storage medium of the elevator, firstly, video information in the operation process of the elevator is acquired, secondly, the video information is processed to obtain key feature data, abnormal behavior analysis is carried out according to the key feature data to obtain an abnormal behavior identification result, the abnormal behavior identification result is sent to terminal equipment and an emergency control instruction determined by the terminal equipment according to the abnormal behavior identification result is received, and the elevator is remotely controlled in an emergency mode according to the emergency control instruction, so that the abnormal situation in the elevator can be automatically monitored and automatically identified without depending on subjective activity of personnel, after the abnormality is monitored, the abnormal behavior identification result can be sent to the terminal equipment, so that a user of the terminal equipment can synchronously receive the abnormal behavior identification result, and the elevator can be controlled according to the emergency control instruction, and the elevator can be remotely controlled.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
Fig. 1 is a flowchart of a security control method of an elevator according to an embodiment of the invention;
fig. 2 is a schematic diagram of a security control method of an elevator of one example of the invention;
fig. 3 is a block diagram of the security control apparatus of an elevator according to an embodiment of the present invention;
fig. 4 is a block diagram of the security control system of an elevator according to an embodiment of the present invention.
Detailed Description
Embodiments of the present invention are described in detail below, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to like or similar elements or elements having like or similar functions throughout. The embodiments described below by referring to the drawings are illustrative and intended to explain the present invention and should not be construed as limiting the invention.
The following describes a security control method, a security control device, a security control system, a cloud platform and a storage medium of an elevator according to the embodiment of the invention.
Fig. 1 is a flowchart of a security control method of an elevator according to an embodiment of the present invention.
As shown in fig. 1, the security control method of the elevator includes:
s11, acquiring video information in the elevator running process.
Specifically, the elevator is correspondingly provided with a camera, the camera shoots in the elevator running process, video information in the elevator running process is obtained, and then the video information is sent to the cloud platform, so that the cloud platform calculates the video information by utilizing a cloud computing program in the cloud platform. After capturing the video information in the elevator operation process, the captured video information can be selected to be sent to a video server, the video server classifies and encodes the video information to obtain a video data stream, and the video server sends the video data stream to the cloud platform. The video server may be a locally deployed server.
The cloud computing program in the cloud platform may be a deep neural network trained in advance. As an example, the deep neural network may include a parent deep neural network for judging whether an abnormal behavior specifically occurs or not and a child deep neural network for judging the abnormal behavior specifically occurs, an abnormal behavior standard may be obtained in advance, a plurality of abnormal behavior images or video clips satisfying the abnormal behavior standard may be obtained in advance, key feature data therein may be passenger feature data or article feature data or the like, the parent deep neural network is trained using the key feature data, an output of the parent deep neural network is obtained, and a loss function is obtained according to the output result, thereby training the parent deep neural network according to the loss function; similarly, a plurality of abnormal behavior images or video clips can be obtained in advance, key feature data in the abnormal behavior images or video clips can be obtained, the key feature data are input into the sub-depth neural network, an output result of the sub-depth neural network is obtained, a loss function is obtained according to the output result and the abnormal behavior known in advance, and therefore training is carried out on the sub-depth neural network according to the loss function.
The abnormal behavior standard is determined according to a specific elevator type, specifically, if the elevator is a straight elevator, the abnormal behavior standard is an abnormal behavior standard corresponding to conditions such as car door taking, long-time door blocking, electric car carrying, personnel falling, help calling by hand, pet identification, flatbed and baby carriage identification, and if the elevator is an escalator, the abnormal behavior standard is an abnormal behavior standard corresponding to conditions such as personnel falling, retrograde, entrance and exit article falling, child detention, baby carriage identification, and the like.
Optionally, for the sub-deep neural network, a sub-deep neural network may be set, and the network may be trained to identify different abnormal behaviors, or possible abnormal behaviors may be obtained in advance, and a plurality of sub-deep neural networks may be set, and the sub-deep neural network may be trained, so that each sub-deep neural network correspondingly identifies an abnormal behavior.
S12, processing the video information to obtain key feature data, and carrying out abnormal behavior recognition according to the key feature data to obtain an abnormal behavior recognition result.
Specifically, after obtaining video data, the cloud platform cuts the video data stream to obtain continuous multi-frame images; and identifying the continuous multi-frame images to obtain key feature data. Or, the cloud platform can also cut the video data stream to obtain video clips, and then identify the video clips to obtain key feature data.
After the key feature data is obtained, the key feature data is pre-judged, for example, the key feature data can be input into the parent deep neural network, whether the abnormal behavior standard is met or not is judged, if the abnormal behavior standard is met, the specific abnormal behavior is judged by using the child deep neural network, and if the algorithm detection condition of the child deep neural network is met, the abnormal behavior is confirmed and identified, and an abnormal behavior identification result is obtained.
Optionally, the cloud platform outputs a corresponding alarm instruction according to the abnormal behavior recognition result, and simultaneously, can also pre-control the elevator according to the abnormal behavior recognition result, for example, an abnormal behavior-pre-processing corresponding relation table can be stored in the cloud platform in advance, and after the abnormal behavior recognition result is obtained, a pre-processing mode is obtained according to the relation table, so as to pre-process the elevator.
When the elevator is a straight elevator, the abnormal behavior corresponding to the abnormal behavior identification result comprises the steps of taking off a car door, blocking the door for a long time, carrying an electric car, falling down a person, waving a hand to call for help, identifying a pet, and identifying a flatbed and a baby car; when the elevator is an escalator, the abnormal behaviors corresponding to the abnormal behavior identification result comprise personnel fall, retrograde, entrance and exit article drop, child retention and baby carriage identification.
S13, sending the abnormal behavior identification result to the terminal equipment.
Specifically, after the cloud platform obtains the abnormal behavior identification result, the cloud platform sends the identification result to the terminal device to send an abnormal notification to the terminal device, for example, a corresponding alarm instruction can be output according to the abnormal behavior identification result, so that a user of the terminal device, such as a property security personnel, can check specific abnormal behaviors. The terminal device may be a property management platform, mobile APP (Application, mobile APP) or the like, taking the property management platform as an example, referring to fig. 2, after the cloud platform identifies a specific abnormal behavior and outputs a corresponding alarm instruction, the cloud platform sends a result obtained by calculation to the property management platform, and the cloud platform may also send a specific image or video segment identified as the abnormal behavior to the property management platform, so that a property security personnel may determine according to the specific image or video segment.
S14, receiving an emergency control instruction determined by the terminal equipment according to the abnormal behavior recognition result, and performing remote emergency control on the elevator according to the emergency control instruction.
Specifically, after the terminal device user receives the abnormality notification on the terminal device, the user can check the abnormal behavior transmitted by the cloud platform, and check the site situation through the terminal device, for example, can check the video data, the video clip or the image, so as to confirm the detection result.
And after checking specific abnormal behaviors through the terminal equipment, the terminal equipment user can also judge whether manual intervention is needed, and if so, an emergency control instruction is sent to the elevator control cabinet so as to remotely and emergently control the corresponding elevator through the elevator control cabinet. As an example, after the terminal device user determines that manual intervention is required according to specific abnormal behaviors, the terminal device user can send an emergency control instruction to the elevator control cabinet through the cloud platform and the gateway, so that remote emergency control is performed on the corresponding elevator.
It should be noted that, the cloud platform may also collect accuracy of each detection, and perform processing according to accuracy of a detection result. As an example, when the terminal device user determines that the detection is not correct, the field situation determined by the terminal device user may be obtained, for example, if the terminal device user confirms that the field is not abnormal, and if the cloud platform sends a person falling to the terminal device, the cloud platform may record the recognition error that occurs, and the cloud platform may also obtain the video clip or the image that is obtained this time, and confirm that the situation corresponding to the video clip or the image is not abnormal, and correct the cloud computing program in the cloud platform again based on the situation, for example, train the deep neural network.
The elevator, the cloud platform, the terminal equipment, the elevator controller and the like can be selectively communicated through the IOT (Internet of things, the internet of things).
In summary, the security control method of the elevator of the embodiment of the invention obtains the key characteristic data by firstly obtaining the video information in the operation process of the elevator, secondly processing the video information, analyzing the abnormal behavior according to the key characteristic data to obtain the abnormal behavior identification result, sending the abnormal behavior identification result to the terminal equipment, receiving the emergency control instruction determined by the terminal equipment according to the abnormal behavior identification result, and carrying out remote emergency control on the elevator according to the emergency control instruction, thereby realizing automatic monitoring and automatic identification on the abnormal situation in the elevator, being independent of subjective activity of personnel, sending the abnormal behavior identification result to the terminal equipment after monitoring the abnormality, enabling the user of the terminal equipment to synchronously receive the abnormal behavior identification result, and controlling the elevator according to the emergency control instruction to realize remote control on the elevator. Moreover, because the emergency control instructions which are used for receiving the video information, processing the video information, sending the abnormal behavior identification result to the terminal equipment and determining the receiving terminal equipment according to the abnormal behavior identification result can be all carried out by the cloud platform, the elevator safety protection function can be realized based on the original monitoring equipment without depending on local equipment hardware.
Further, the invention provides a cloud platform.
In the embodiment of the invention, the cloud platform comprises a memory, a processor and a security control program of the elevator, wherein the security control program of the elevator is stored in the memory and can run on the processor, and the security control method of the elevator is realized when the processor executes the security control program of the elevator.
According to the cloud platform, through the implementation of the security control method of the elevator, video information in the operation process of the elevator can be firstly obtained, then the video information is processed to obtain key feature data, abnormal behavior analysis is carried out according to the key feature data to obtain an abnormal behavior identification result, the abnormal behavior identification result is sent to terminal equipment and an emergency control instruction determined by the terminal equipment according to the abnormal behavior identification result is received, and remote emergency control is carried out on the elevator according to the emergency control instruction, so that the abnormal situation in the elevator can be automatically monitored and automatically identified without depending on subjective activity of personnel, after the abnormality is monitored, the abnormal behavior identification result can be sent to the terminal equipment, so that a user of the terminal equipment can synchronously receive the abnormal behavior identification result, and the elevator can be controlled according to the emergency control instruction to realize remote control on the elevator. Moreover, because the emergency control instructions which are used for receiving the video information, processing the video information, sending the abnormal behavior identification result to the terminal equipment and determining the receiving terminal equipment according to the abnormal behavior identification result can be all carried out by the cloud platform, the elevator safety protection function can be realized based on the original monitoring equipment without depending on local equipment hardware.
Further, the present invention proposes a computer-readable storage medium.
In the embodiment of the invention, the computer readable storage medium stores a security control program of the elevator, and the security control method of the elevator is realized when the security control program of the elevator is executed by a processor.
When the security control program of the elevator is executed by the processor, the computer readable storage medium of the embodiment of the invention can firstly acquire video information in the operation process of the elevator, secondly process the video information to acquire key characteristic data, perform abnormal behavior analysis according to the key characteristic data to acquire an abnormal behavior identification result, send the abnormal behavior identification result to the terminal equipment and receive an emergency control instruction determined by the terminal equipment according to the abnormal behavior identification result, and perform remote emergency control on the elevator according to the emergency control instruction, thereby realizing automatic monitoring and automatic identification on the abnormal situation in the elevator, being independent of subjective activity of personnel, and sending the abnormal behavior identification result to the terminal equipment after monitoring the abnormality, so that a user of the terminal equipment can synchronously receive the abnormal behavior identification result, and further control the elevator according to the emergency control instruction to realize remote control on the elevator. Moreover, because the emergency control instructions which are used for receiving the video information, processing the video information, sending the abnormal behavior identification result to the terminal equipment and determining the receiving terminal equipment according to the abnormal behavior identification result can be all carried out by the cloud platform, the elevator safety protection function can be realized based on the original monitoring equipment without depending on local equipment hardware.
Further, the invention provides a security control device of the elevator.
Fig. 3 is a block diagram of the security control apparatus of an elevator according to an embodiment of the present invention.
As shown in fig. 3, the security control apparatus 100 of an elevator includes: an acquisition module 101, a processing module 102, a transceiver module 103 and a control module 104.
Specifically, the acquiring module 101 is configured to acquire video information during an elevator running process; the processing module 102 is used for processing the video information to obtain key feature data, and carrying out abnormal behavior recognition according to the key feature data to obtain an abnormal behavior recognition result; the transceiver module 103 is configured to send an abnormal behavior recognition result to the terminal device, and receive an emergency control instruction determined by the terminal device according to the abnormal behavior recognition result; and the control module 104 is used for remotely controlling the elevator in an emergency mode according to the emergency control instruction.
It should be noted that, other specific embodiments of the security control device for an elevator according to the embodiments of the present invention may refer to the above-mentioned security control method for an elevator.
The security control device for the elevator firstly acquires video information in the operation process of the elevator, secondly processes the video information to acquire key characteristic data, performs abnormal behavior analysis according to the key characteristic data to acquire an abnormal behavior identification result, sends the abnormal behavior identification result to the terminal equipment, receives an emergency control instruction determined by the terminal equipment according to the abnormal behavior identification result, and performs remote emergency control on the elevator according to the emergency control instruction, so that the automatic monitoring and automatic identification of the abnormal situation in the elevator can be realized, the subjective motility of personnel is not relied on, and after the monitoring is abnormal, the abnormal behavior identification result can be sent to the terminal equipment, so that a user of the terminal equipment can synchronously receive the abnormal behavior identification result, and the elevator can be controlled according to the emergency control instruction to realize the remote control on the elevator. Moreover, because the emergency control instructions which are used for receiving the video information, processing the video information, sending the abnormal behavior identification result to the terminal equipment and determining the receiving terminal equipment according to the abnormal behavior identification result can be all carried out by the cloud platform, the elevator safety protection function can be realized based on the original monitoring equipment without depending on local equipment hardware.
Further, the invention provides a security control system of the elevator.
Fig. 4 is a block diagram of the security control system of an elevator according to an embodiment of the present invention.
As shown in fig. 4, the security control system 1000 of an elevator includes: elevator 1001, cloud platform 1002, terminal equipment 1003.
Specifically, the elevator 1001 is correspondingly provided with a camera, and the camera is used for shooting the running process of the elevator 1001 so as to obtain video information in the running process of the elevator 1001 and send the video information to the cloud platform 1002; the cloud platform 1002 is configured to process the video information to obtain key feature data, perform abnormal behavior recognition according to the key feature data, obtain an abnormal behavior recognition result, and send the abnormal behavior recognition result to the terminal device 1003; the terminal device 1003 is configured to display the abnormal behavior recognition result, generate an emergency control instruction when receiving an instruction for confirming the abnormal behavior recognition result, and send the emergency control instruction to the cloud platform 1002; cloud platform 1002 is also used for remote emergency control of elevator 1001 upon receiving an emergency control command.
It should be noted that, other specific embodiments of the security control system for an elevator according to the embodiments of the present invention may refer to the above-mentioned security control method for an elevator.
The security control system of the elevator of the embodiment of the invention firstly acquires video information in the operation process of the elevator, secondly processes the video information to acquire key characteristic data, performs abnormal behavior analysis according to the key characteristic data to acquire an abnormal behavior identification result, sends the abnormal behavior identification result to the terminal equipment, receives an emergency control instruction determined by the terminal equipment according to the abnormal behavior identification result, and performs remote emergency control on the elevator according to the emergency control instruction, thereby realizing automatic monitoring and automatic identification of the abnormal situation in the elevator without depending on subjective activity of personnel, sending the abnormal behavior identification result to the terminal equipment after monitoring abnormality, enabling a user of the terminal equipment to synchronously receive the abnormal behavior identification result, and controlling the elevator according to the emergency control instruction to realize remote control on the elevator. Moreover, because the emergency control instructions which are used for receiving the video information, processing the video information, sending the abnormal behavior identification result to the terminal equipment and determining the receiving terminal equipment according to the abnormal behavior identification result can be all carried out by the cloud platform, the elevator safety protection function can be realized based on the original monitoring equipment without depending on local equipment hardware.
It should be noted that the logic and/or steps represented in the flowcharts or otherwise described herein, for example, may be considered as a ordered listing of executable instructions for implementing logical functions, and may be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). In addition, the computer readable medium may even be paper or other suitable medium on which the program is printed, as the program may be electronically captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory.
It is to be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, the various steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, may be implemented using any one or combination of the following techniques, as is well known in the art: discrete logic circuits having logic gates for implementing logic functions on data signals, application specific integrated circuits having suitable combinational logic gates, programmable Gate Arrays (PGAs), field Programmable Gate Arrays (FPGAs), and the like.
In the description of the present specification, a description referring to terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiments or examples. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", "clockwise", "counterclockwise", "axial", "radial", "circumferential", etc. indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings are merely for convenience in describing the present invention and simplifying the description, and do not indicate or imply that the device or element being referred to must have a specific orientation, be configured and operated in a specific orientation, and therefore should not be construed as limiting the present invention.
Furthermore, the terms "first," "second," and the like, as used in embodiments of the present invention, are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or as implying any particular number of features in the present embodiment. Thus, a feature of an embodiment of the invention that is defined by terms such as "first," "second," etc., may explicitly or implicitly indicate that at least one such feature is included in the embodiment. In the description of the present invention, the word "plurality" means at least two or more, for example, two, three, four, etc., unless explicitly defined otherwise in the embodiments.
In the present invention, unless explicitly stated or limited otherwise in the examples, the terms "mounted," "connected," and "fixed" as used in the examples should be interpreted broadly, e.g., the connection may be a fixed connection, may be a removable connection, or may be integral, and it may be understood that the connection may also be a mechanical connection, an electrical connection, etc.; of course, it may be directly connected, or indirectly connected through an intermediate medium, or may be in communication with each other, or in interaction with each other. The specific meaning of the above terms in the present invention can be understood by those of ordinary skill in the art according to specific embodiments.
In the present invention, unless expressly stated or limited otherwise, a first feature "up" or "down" a second feature may be the first and second features in direct contact, or the first and second features in indirect contact via an intervening medium. Moreover, a first feature being "above," "over" and "on" a second feature may be a first feature being directly above or obliquely above the second feature, or simply indicating that the first feature is level higher than the second feature. The first feature being "under", "below" and "beneath" the second feature may be the first feature being directly under or obliquely below the second feature, or simply indicating that the first feature is less level than the second feature.
While embodiments of the present invention have been shown and described above, it will be understood that the above embodiments are illustrative and not to be construed as limiting the invention, and that variations, modifications, alternatives and variations may be made to the above embodiments by one of ordinary skill in the art within the scope of the invention.
Claims (10)
1. The security control method of the elevator is characterized by comprising the following steps of:
acquiring video information in the elevator running process;
processing the video information to obtain key characteristic data, carrying out abnormal behavior identification according to the key characteristic data, judging whether specific abnormal behaviors occur or not through a parent deep neural network and judging specific abnormal behaviors occurring through a sub-deep neural network, obtaining an abnormal behavior identification result, and pre-controlling the elevator according to the abnormal behavior identification result and a pre-stored abnormal behavior-pre-processing corresponding relation table;
the abnormal behavior identification result is sent to terminal equipment;
receiving an emergency control instruction determined by the terminal equipment according to the abnormal behavior recognition result, and performing remote emergency control on the elevator according to the emergency control instruction;
and collecting the accuracy of each detection, processing according to the accuracy of the detection result, recording the occurrence of the identification error, and correcting based on the acquired video clips or images.
2. The method of claim 1, wherein prior to processing the video information, the method further comprises:
the video information is classified and encoded by a video server to obtain a video data stream.
3. The method of claim 2, wherein processing the video information comprises:
cutting the video data stream to obtain continuous multi-frame images;
and identifying the continuous multi-frame images to obtain passenger characteristic data or article characteristic data.
4. A method according to any one of claims 1-3, characterized in that the remote emergency control of the elevator according to the emergency control instructions comprises:
and sending the emergency control instruction to an elevator control cabinet so as to remotely and emergently control the corresponding elevator through the elevator control cabinet.
5. The method according to any one of claim 1 to 3, wherein,
when the elevator is a straight elevator, the abnormal behavior corresponding to the abnormal behavior identification result comprises the steps of taking off a car door, blocking the door for a long time, carrying an electric vehicle, falling down a person, waving a hand to call for help, identifying pets, and identifying a flatbed and a baby carriage.
6. The method according to any one of claim 1 to 3, wherein,
when the elevator is an escalator, the abnormal behaviors corresponding to the abnormal behavior identification result comprise personnel falling, retrograde, entrance and exit article drop, child retention and baby carriage identification.
7. A cloud platform characterized by comprising a memory, a processor and a security control program of an elevator stored on the memory and capable of running on the processor, wherein the security control method of the elevator according to any one of claims 1-6 is realized when the processor executes the security control program of the elevator.
8. A computer-readable storage medium, characterized in that it has stored thereon a security control program of an elevator, which, when executed by a processor, implements the security control method of an elevator according to any one of claims 1-6.
9. A security control device of an elevator, comprising:
the acquisition module is used for acquiring video information in the elevator operation process;
the processing module is used for processing the video information to obtain key feature data, carrying out abnormal behavior identification according to the key feature data, judging whether specific abnormal behaviors occur or not through a parent deep neural network and judging specific abnormal behaviors occurring through a child deep neural network, obtaining an abnormal behavior identification result, pre-controlling the elevator according to the abnormal behavior identification result and a pre-stored abnormal behavior-pre-processing corresponding relation table, collecting accuracy of detection each time, further carrying out processing according to accuracy of the detection result, recording identification errors, and correcting based on the obtained video clips or images;
the receiving and transmitting module is used for sending the abnormal behavior identification result to the terminal equipment and receiving an emergency control instruction determined by the terminal equipment according to the abnormal behavior identification result;
and the control module is used for carrying out remote emergency control on the elevator according to the emergency control instruction.
10. The security control system of the elevator is characterized by comprising the elevator, a cloud platform and terminal equipment, wherein,
the elevator is correspondingly provided with a camera, and the camera is used for shooting the elevator running process so as to obtain video information in the elevator running process and sending the video information to the cloud platform;
the cloud platform is used for processing the video information to obtain key feature data, carrying out abnormal behavior identification according to the key feature data, judging whether specific abnormal behaviors occur or not through a parent deep neural network and judging specific abnormal behaviors occurring through a child deep neural network, obtaining an abnormal behavior identification result, pre-controlling the elevator according to the abnormal behavior identification result and a pre-stored abnormal behavior-pre-processing corresponding relation table, and sending the abnormal behavior identification result to the terminal equipment;
the terminal equipment is used for displaying the abnormal behavior identification result, generating an emergency control instruction when receiving an instruction for confirming the abnormal behavior identification result, and sending the emergency control instruction to the cloud platform;
the cloud platform is further used for remotely controlling the elevator in an emergency mode when the emergency control instruction is received;
the cloud platform is also used for collecting the accuracy of each detection, processing according to the accuracy of the detection result, recording the occurrence of identification errors, and correcting based on the acquired video clips or images.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210476495.XA CN114701934B (en) | 2022-04-29 | 2022-04-29 | Security control method, device and system for elevator, cloud platform and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210476495.XA CN114701934B (en) | 2022-04-29 | 2022-04-29 | Security control method, device and system for elevator, cloud platform and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114701934A CN114701934A (en) | 2022-07-05 |
| CN114701934B true CN114701934B (en) | 2024-02-23 |
Family
ID=82177474
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210476495.XA Active CN114701934B (en) | 2022-04-29 | 2022-04-29 | Security control method, device and system for elevator, cloud platform and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114701934B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115690897B (en) * | 2022-08-31 | 2023-10-20 | 北京夕阳无忧科技有限公司 | Unexpected behavior processing method, device and equipment for preventing privacy leakage and storage medium |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2017060348A (en) * | 2015-09-18 | 2017-03-23 | 日立オートモティブシステムズ株式会社 | Electronic control device and control method thereof |
| CN206069114U (en) * | 2016-06-20 | 2017-04-05 | 浙江汉腾物联科技有限公司 | Lift management system based on Internet of Things |
| CN106946110A (en) * | 2017-02-20 | 2017-07-14 | 广州广日电梯工业有限公司 | A kind of elevator malfunction failure monitoring system and method |
| CN107473040A (en) * | 2017-09-22 | 2017-12-15 | 阳泉市联宇星信息技术有限公司 | Special safety equipment operation state supervision monitoring method and device based on SAAS and Beacon |
| CN108750854A (en) * | 2018-08-20 | 2018-11-06 | 山东润智能科技有限公司 | Hospital elevator security stereo monitors cloud platform, system and method, elevator device |
| JP2018177395A (en) * | 2017-04-04 | 2018-11-15 | フジテック株式会社 | Remote monitoring system of lifting device |
| CN109867194A (en) * | 2019-03-21 | 2019-06-11 | 清华大学合肥公共安全研究院 | Escalator emergency braking system and braking method based on image processing techniques |
| CN110217660A (en) * | 2019-05-05 | 2019-09-10 | 日立楼宇技术（广州）有限公司 | Detection method, device and the elevator detection system of elevator measurement data |
| CN112381066A (en) * | 2020-12-10 | 2021-02-19 | 杭州西奥电梯有限公司 | Abnormal behavior identification method for elevator riding, monitoring system, computer equipment and storage medium |
| CN112651612A (en) * | 2020-12-18 | 2021-04-13 | 倪慧珍 | Modern urban road running condition real-time online monitoring and early warning management cloud platform based on big data and cloud computing |
| CN113743211A (en) * | 2021-08-02 | 2021-12-03 | 日立楼宇技术（广州）有限公司 | Escalator video monitoring system, method and device and storage medium |
-
2022
- 2022-04-29 CN CN202210476495.XA patent/CN114701934B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2017060348A (en) * | 2015-09-18 | 2017-03-23 | 日立オートモティブシステムズ株式会社 | Electronic control device and control method thereof |
| CN206069114U (en) * | 2016-06-20 | 2017-04-05 | 浙江汉腾物联科技有限公司 | Lift management system based on Internet of Things |
| CN106946110A (en) * | 2017-02-20 | 2017-07-14 | 广州广日电梯工业有限公司 | A kind of elevator malfunction failure monitoring system and method |
| JP2018177395A (en) * | 2017-04-04 | 2018-11-15 | フジテック株式会社 | Remote monitoring system of lifting device |
| CN107473040A (en) * | 2017-09-22 | 2017-12-15 | 阳泉市联宇星信息技术有限公司 | Special safety equipment operation state supervision monitoring method and device based on SAAS and Beacon |
| CN108750854A (en) * | 2018-08-20 | 2018-11-06 | 山东润智能科技有限公司 | Hospital elevator security stereo monitors cloud platform, system and method, elevator device |
| CN109867194A (en) * | 2019-03-21 | 2019-06-11 | 清华大学合肥公共安全研究院 | Escalator emergency braking system and braking method based on image processing techniques |
| CN110217660A (en) * | 2019-05-05 | 2019-09-10 | 日立楼宇技术（广州）有限公司 | Detection method, device and the elevator detection system of elevator measurement data |
| CN112381066A (en) * | 2020-12-10 | 2021-02-19 | 杭州西奥电梯有限公司 | Abnormal behavior identification method for elevator riding, monitoring system, computer equipment and storage medium |
| CN112651612A (en) * | 2020-12-18 | 2021-04-13 | 倪慧珍 | Modern urban road running condition real-time online monitoring and early warning management cloud platform based on big data and cloud computing |
| CN113743211A (en) * | 2021-08-02 | 2021-12-03 | 日立楼宇技术（广州）有限公司 | Escalator video monitoring system, method and device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114701934A (en) | 2022-07-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10688961B2 (en) | In-vehicle smoke detection and reporting system and method for car sharing and ride sharing vehicles | |
| CN115225676A (en) | Driver identity online monitoring method and device and storage medium | |
| KR102477061B1 (en) | Apparatus and method for monitoring vehicle in parking lot | |
| CN109242743A (en) | A kind of net about vehicle traveling service intelligent monitoring system and its method | |
| CN114701934B (en) | Security control method, device and system for elevator, cloud platform and storage medium | |
| CN107464416B (en) | Semi-automatic driving method and system for bus | |
| CN113076856B (en) | Bus safety guarantee system based on face recognition | |
| CN113971782B (en) | Comprehensive monitoring information management method and system | |
| KR20070065480A (en) | A monitoring system for subway platform using stereoscopic video camera | |
| JP4935014B2 (en) | Elevator crime prevention driving apparatus and crime prevention driving setting changing method | |
| CN112017401A (en) | Alarm system for monitoring the safety of persons, corresponding method and storage medium | |
| CN117218787A (en) | Fire alarm method, device, electronic equipment and storage medium | |
| DE102019126208A1 (en) | Emergency system for a vehicle | |
| KR20140056674A (en) | Commnication service system, method and apparatus for supporting process of accident in the system | |
| CN112287313A (en) | Device authentication system and method | |
| JP2007230732A (en) | Operation control device of elevator | |
| CN115257537A (en) | Vehicle leaving-behind reminding device and method, vehicle and storage medium | |
| CN111341133B (en) | Control method and device for automatic driving vehicle, storage medium and processor | |
| CN110126830B (en) | Vehicle starting control method, device, equipment and storage medium | |
| CN116740874A (en) | Intrusion detection method and related device | |
| CN113670360A (en) | Monitoring method, system, device, vehicle, medium and product | |
| CN112158695A (en) | Elevator control method | |
| CN112053526A (en) | Monitoring system and monitoring method | |
| CN112735161A (en) | Traffic accident handling method, vehicle and server | |
| CN110956143A (en) | Abnormal behavior detection method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |