CN111807204A - Intelligent elevator safety monitoring system - Google Patents
Intelligent elevator safety monitoring system Download PDFInfo
- Publication number
- CN111807204A CN111807204A CN202010731409.6A CN202010731409A CN111807204A CN 111807204 A CN111807204 A CN 111807204A CN 202010731409 A CN202010731409 A CN 202010731409A CN 111807204 A CN111807204 A CN 111807204A
- Authority
- CN
- China
- Prior art keywords
- escalator
- binocular vision
- vision sensor
- module
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B66—HOISTING; LIFTING; HAULING
- B66B—ELEVATORS; ESCALATORS OR MOVING WALKWAYS
- B66B29/00—Safety devices of escalators or moving walkways
- B66B29/005—Applications of security monitors
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B66—HOISTING; LIFTING; HAULING
- B66B—ELEVATORS; ESCALATORS OR MOVING WALKWAYS
- B66B25/00—Control of escalators or moving walkways
- B66B25/003—Methods or algorithms therefor
Landscapes
- Escalators And Moving Walkways (AREA)
Abstract
The invention provides an intelligent elevator safety monitoring system which monitors the behavior of a user in the running process of an escalator, actively gives an alarm or degrades the operation and stops the operation according to the behavior characteristics, and further improves the safety of the user. The escalator comprises an escalator body and an escalator controller, wherein a first binocular vision sensor is arranged above an upper guide section of the escalator body, a second binocular vision sensor is arranged above a lower guide section of the escalator body, state recognition processors are arranged inside the first binocular vision sensor and the second binocular vision sensor, various dangerous state postures are preset in the state recognition processors, a vision detection area of the first binocular vision sensor covers the upper guide section and a first oblique guide stepping area below the upper guide section, and a vision detection area of the second binocular vision sensor covers the lower guide section and a second oblique guide stepping area above the lower guide section.
Description
Technical Field
The invention relates to the technical field of elevator safe operation, in particular to an intelligent elevator safety monitoring system.
Background
The existing escalator slowly rises or falls after people enter the escalator, and carries pedestrians upstairs and downstairs, but safety accidents occur during operation of the people in the escalator, and if the people fall down, go backwards and probe abnormal behaviors, the existing escalator cannot be monitored correspondingly, and then subsequent serious safety accidents are caused.
Disclosure of Invention
The invention provides an intelligent elevator safety monitoring system, which monitors the behavior of a user in the running process of an escalator, and actively gives an alarm or degrades the operation and stops the operation according to the behavior characteristics, so that the safety of the user is further improved.
Wisdom elevator safety monitoring system, its characterized in that: the escalator comprises an escalator body and an escalator controller, wherein a first binocular vision sensor is arranged above an upper guide section of the escalator body, a second binocular vision sensor is arranged above a lower guide section of the escalator body, state recognition processors are arranged inside the first binocular vision sensor and the second binocular vision sensor, various dangerous state postures are preset in the state recognition processors, a vision detection area of the first binocular vision sensor covers the upper guide section and a first oblique guide stepping area below the upper guide section, a vision detection area of the second binocular vision sensor covers the lower guide section and a second oblique guide stepping area above the lower guide section, output ends of the first binocular vision sensor and the second binocular vision sensor are respectively connected to a monitoring port of the escalator controller, and the first binocular vision sensor, the second binocular vision sensor, the first binocular vision sensor, the second binocular vision sensor and the monitoring port are respectively connected with the monitoring port of the escalator controller, And when the second binocular vision sensor judges that the personnel is in the corresponding dangerous state posture according to the captured image, the output end of the second binocular vision sensor sends a corresponding code to the monitoring port of the escalator controller, and the escalator controller carries out corresponding safety operation according to the received code.
It is further characterized in that:
when the first binocular vision sensor and the second binocular vision sensor both feed back corresponding signal codes to the escalator controller, and no pedestrian exists in the escalator, the escalator controller drives the escalator to decelerate or stop running, and the escalator controller is in a standby energy-saving state;
after a pedestrian enters the escalator, any binocular sensor outputs a corresponding code to inform the escalator controller, the escalator controller drives the escalator body to start operation, and friendly voice sound is selectively sent out or the escalator body is in a mute state while the operation is started;
when a pedestrian enters the escalator, each binocular sensor monitors a monitoring area where the pedestrian is located in real time, if the pedestrian falls down, walks reversely and the probe is out of the escalator, the corresponding binocular vision sensor returns a signal code corresponding to the escalator controller, the escalator performs degradation and deceleration or immediately stops operating according to an instruction corresponding to the signal code, and transmits a signal to a monitoring room to inform a manager of corresponding processing;
the first binocular vision sensor and the second binocular vision sensor are internally provided with depth image cameras, each depth image camera overlooks from top to bottom to shoot a static image or a continuous video containing depth information of a corresponding area, and senses and tracks a user according to the image or video information until the user is separated from the area covered by monitoring;
the depth image camera comprises a structure light emitting module, a structure light receiving module and a depth information processing module, wherein the structure light emitting module projects a certain specific light pattern onto an object from a known angle to form a projection, the structure light receiving module shoots the projection formed on the object from another known angle, the depth information processing module carries out preprocessing, storage, identification and calculation on the projected image to obtain a depth image, the depth information processing module outputs the depth image to a state identification processor to judge whether a user in a monitoring area is in an abnormal state or not, if the person is in a corresponding dangerous state posture, the output end of the depth information processing module sends a corresponding code to a monitoring port of the escalator controller, and the escalator controller carries out corresponding safety operation according to the received code;
the depth information processing module is a depth information processing system based on structured light, the depth information processing module comprises a preprocessing and storage module, a calculation module and a depth information identification module, the structured light emitting module projects structured light of infrared or visible light to a scene, the structured light receiving module shoots distortion of the structured light with depth information on the surface of the scene and sends the distortion to the preprocessing and storage module, and the preprocessing and storage module preprocesses a video image shot by the structured light receiving module and comprises: a) image distortion correction, which is a geometric transformation process based on an image warping (image warping) algorithm based on a test grid; b) the extraction of the moving foreground image is the extraction processing of the foreground image based on the algorithm of eliminating the reference background; the preprocessing and storage module, the calculation module and the depth information identification module can communicate with each other through various communication protocols such as USB, Ethernet and a wireless protocol 802.11 a/b/g/n; the calculation module 332 adopts a structured light three-dimensional reconstruction algorithm to calculate the image containing the depth information processed by the preprocessing and storage module to obtain the third-dimensional information of the scene, so as to output the depth image of the scene to the state recognition processor; the depth information identification module can accelerate the operation speed of the calculation module through a predefined human body depth information template, and the calculation accuracy is improved.
After the invention is adopted, independent binocular vision sensors are respectively arranged above the upper guide section and the lower guide section of the escalator, the inside of each binocular vision sensor is provided with a state recognition processor, various dangerous state postures are preset in the state recognition processors, the output ends of the binocular vision sensors are respectively connected to the monitoring port of the escalator controller, when the first binocular vision sensor and the second binocular vision sensor judge that a person is in the corresponding dangerous state posture according to the captured images, the output end of the escalator sends a corresponding code to a monitoring port of the escalator controller, the escalator controller carries out corresponding safe operation according to the received code, the escalator carries out 24-hour safe monitoring through two binocular recognition sensors, the elevator is not needed to be watched by special staff during the peak period, the emergency braking or the speed reduction can be automatically realized, and the personal safety of pedestrians is ensured; in the running process of the escalator, the behavior of a user is monitored, and according to the behavior characteristics, the escalator actively gives an alarm or degrades the operation and stops the operation, so that the safety of the user is further improved.
Drawings
FIG. 1 is a schematic block diagram of the arrangement of the present invention;
the names corresponding to the sequence numbers in the figure are as follows:
the escalator comprises an escalator body 1, an upper guide section 101, a lower guide section 102, a first oblique guide stepping area 103, a second oblique guide stepping area 104, an escalator controller 2, a monitoring port 21, a first binocular vision sensor 3 and a second binocular vision sensor 4.
Detailed Description
Wisdom elevator safety monitoring system, see figure 1: the escalator comprises an escalator body 1 and an escalator controller 2, wherein a first visual perception sensor 3 is arranged above an upper guide section 101 of the escalator body 1, a second visual perception sensor 4 is arranged above a lower guide section 102 of the escalator body 1, state recognition processors are arranged inside the first visual perception sensor 3 and the second visual perception sensor 4, various dangerous state postures are preset in the state recognition processors, a visual detection area of the first visual perception sensor 3 covers the upper guide section 101 and a first oblique guiding stepping area 103 below the upper guide section, a visual detection area of the second visual perception sensor 4 covers the lower guide section 102 and a second oblique guiding stepping area 104 above the lower guide section, output ends of the first visual perception sensor 3 and the second visual perception sensor 4 are respectively connected to a monitoring port 21 of the escalator controller 2, when the first binocular vision sensor 3 and the second binocular vision sensor 4 judge that the personnel are in the corresponding dangerous state postures according to the captured images, the output ends of the first binocular vision sensor and the second binocular vision sensor transmit corresponding codes to the monitoring port 21 of the escalator controller 2, and the escalator controller 2 carries out corresponding safe operation according to the received codes.
When the first visual sensor 3 and the second visual sensor 4 both feed back corresponding signal codes to the escalator controller 2, and no pedestrian exists in the escalator, the escalator controller 2 drives the escalator body 1 to decelerate or stop running, and is in a standby energy-saving state;
after a pedestrian enters the escalator body 1, any binocular sensor outputs a corresponding code to inform the escalator controller 2, the escalator controller 2 drives the escalator body 1 to start operation, and friendly voice sound is selectively sent out or the escalator body is in a mute state while the operation is started;
when a pedestrian enters the escalator body 1, each binocular sensor monitors a monitoring area where the pedestrian is located in real time, if the pedestrian falls down, walks reversely and the probe is out of the escalator, the corresponding binocular vision sensor returns a signal code corresponding to the escalator controller 2, the escalator performs degradation and deceleration or immediately stops operation according to an instruction corresponding to the signal code, and transmits a signal to a monitoring room to inform a manager to perform corresponding processing;
the first binocular vision sensor 3 and the second binocular vision sensor 4 are internally provided with depth image cameras, each depth image camera overlooks from top to bottom to shoot a static image or a continuous video containing depth information of a corresponding area, and senses and tracks a user according to the image or video information until the user is separated from the area covered by monitoring;
the depth image camera comprises a structure light emitting module, a structure light receiving module and a depth information processing module, wherein the structure light emitting module projects a certain specific light pattern onto an object from a known angle to form a projection, the structure light receiving module shoots the projection formed on the object from another known angle, the depth information processing module carries out preprocessing, storage, identification and calculation on the projected image to obtain a depth image, the depth information processing module outputs the depth image to a state identification processor to judge whether a user in a monitoring area is in an abnormal state or not, if the person is in a corresponding dangerous state posture, the output end of the depth information processing module sends a corresponding code to a monitoring port of the escalator controller, and the escalator controller carries out corresponding safety operation according to the received code;
the depth information processing module is a depth information processing system based on structured light, the depth information processing module comprises a preprocessing and storage module, a calculation module and a depth information identification module, the structured light emitting module projects structured light of infrared or visible light to a scene, the structured light receiving module shoots distortion with depth information on the surface of the scene of the structured light and sends the distortion into the preprocessing and storage module, and the preprocessing and storage module preprocesses a video image shot by the structured light receiving module and comprises: a) image distortion correction is a geometric variation based on a test grid based image warping algorithm
Changing treatment; b) the extraction of the moving foreground image is the extraction processing of the foreground image based on the algorithm of eliminating the reference background; the preprocessing and storage module, the calculation module and the depth information identification module can communicate with each other through various communication protocols such as USB, Ethernet and a wireless protocol 802.11 a/b/g/n; the calculation module 332 adopts a structured light three-dimensional reconstruction algorithm to calculate the image containing the depth information processed by the preprocessing and storage module to obtain the third-dimensional information of the scene, so as to output the depth image of the scene to the state recognition processor; the depth information identification module can accelerate the operation speed of the calculation module through a predefined human body depth information template, and the calculation accuracy is improved.
In particular, the depth image camera is embodied as a thermal imaging camera or a color visible light camera.
The working principle is as follows: independent binocular vision sensors are respectively arranged above an upper guide section and a lower guide section of the escalator, state recognition processors are arranged in the binocular vision sensors, various dangerous state postures are preset in the state recognition processors, the output ends of the binocular vision sensors are respectively connected to monitoring ports of the escalator controller, when the first binocular vision sensor and the second binocular vision sensor judge that a person is in a corresponding dangerous state posture according to captured images, the output ends of the first binocular vision sensor and the second binocular vision sensor send corresponding codes to the monitoring ports of the escalator controller, the escalator controller carries out corresponding safe operation according to the received codes, the escalator carries out 24-hour safety monitoring through the two binocular vision sensors, a professional person does not need to wait for an elevator in a peak period, emergency braking or deceleration can be automatically realized, and the personal safety of pedestrians is ensured; in the running process of the escalator, the behavior of a user is monitored, and according to the behavior characteristics, the escalator actively gives an alarm or degrades the operation and stops the operation, so that the safety of the user is further improved.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned.
Furthermore, it should be understood that although the present description refers to embodiments, not every embodiment may contain only a single embodiment, and such description is for clarity only, and those skilled in the art should integrate the description, and the embodiments may be combined as appropriate to form other embodiments understood by those skilled in the art.
Claims (7)
1. Wisdom elevator safety monitoring system, its characterized in that: the escalator comprises an escalator body and an escalator controller, wherein a first binocular vision sensor is arranged above an upper guide section of the escalator body, a second binocular vision sensor is arranged above a lower guide section of the escalator body, state recognition processors are arranged inside the first binocular vision sensor and the second binocular vision sensor, various dangerous state postures are preset in the state recognition processors, a vision detection area of the first binocular vision sensor covers the upper guide section and a first oblique guide stepping area below the upper guide section, a vision detection area of the second binocular vision sensor covers the lower guide section and a second oblique guide stepping area above the lower guide section, output ends of the first binocular vision sensor and the second binocular vision sensor are respectively connected to a monitoring port of the escalator controller, and the first binocular vision sensor, the second binocular vision sensor, the first binocular vision sensor, the second binocular vision sensor and the monitoring port are respectively connected with the monitoring port of the escalator controller, And when the second binocular vision sensor judges that the personnel is in the corresponding dangerous state posture according to the captured image, the output end of the second binocular vision sensor sends a corresponding code to the monitoring port of the escalator controller, and the escalator controller carries out corresponding safety operation according to the received code.
2. The intelligent elevator safety monitoring system of claim 1, wherein: when the first binocular vision sensor and the second binocular vision sensor both feed back corresponding signal codes to the escalator controller, and no pedestrian exists in the escalator, the escalator controller drives the escalator to decelerate or stop running, and the escalator is in a standby energy-saving state.
3. The intelligent elevator safety monitoring system of claim 1, wherein: after the pedestrian enters the escalator, any binocular sensor outputs a corresponding code to inform the escalator controller, the escalator controller drives the escalator body to start operation, and friendly voice sound is selectively sent or the escalator is in a mute state while the operation is started.
4. The intelligent elevator safety monitoring system of claim 1, wherein: when a pedestrian enters the escalator, each binocular sensor monitors the monitoring area where the sensor is located in real time, if the pedestrian falls down, walks reversely and the probe is out of the escalator, the corresponding binocular vision sensor returns a signal code corresponding to the escalator controller, the escalator performs degradation and deceleration or stops operation immediately according to an instruction corresponding to the signal code, and transmits the signal to a monitoring room to inform a manager of corresponding processing.
5. The intelligent elevator safety monitoring system of claim 1, wherein: the first binocular vision sensor and the second binocular vision sensor are internally provided with depth image cameras, each depth image camera overlooks from top to bottom to shoot a static image or a continuous video containing depth information of a corresponding area, and senses and tracks a user according to the image or video information until the user is separated from the area covered by monitoring.
6. The intelligent elevator safety monitoring system of claim 5, wherein: the depth image camera comprises a structure light emitting module, a structure light receiving module and a depth information processing module, wherein the structure light emitting module projects a certain specific light pattern onto an object from a known angle to form a projection, the structure light receiving module shoots the projection formed on the object from another known angle, the depth information processing module carries out preprocessing, storage, identification and calculation on the projected image to obtain a depth image, the depth information processing module outputs the depth image to a state identification processor to judge whether a user in a monitoring area is in an abnormal state or not, if the person is in a corresponding dangerous state posture, the output end of the depth information processing module sends a corresponding code to a monitoring port of the escalator controller, and the escalator controller carries out corresponding safety operation according to the received code.
7. The intelligent elevator safety monitoring system of claim 6, wherein: the depth information processing module is a depth information processing system based on structured light, the depth information processing module comprises a preprocessing and storage module, a calculation module and a depth information identification module, the structured light emitting module projects structured light of infrared or visible light to a scene, the structured light receiving module shoots distortion of the structured light with depth information on the surface of the scene and sends the distortion to the preprocessing and storage module, and the preprocessing and storage module preprocesses a video image shot by the structured light receiving module and comprises: a) image distortion correction, which is a geometric transformation process based on an image warping (image warping) algorithm based on a test grid; b) the extraction of the moving foreground image is the extraction processing of the foreground image based on the algorithm of eliminating the reference background; the preprocessing and storage module, the calculation module and the depth information identification module can communicate with each other through various communication protocols such as USB, Ethernet and a wireless protocol 802.11 a/b/g/n; the calculation module 332 adopts a structured light three-dimensional reconstruction algorithm to calculate the image containing the depth information processed by the preprocessing and storage module to obtain the third-dimensional information of the scene, so as to output the depth image of the scene to the state recognition processor; the depth information identification module can accelerate the operation speed of the calculation module through a predefined human body depth information template.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010731409.6A CN111807204A (en) | 2020-07-27 | 2020-07-27 | Intelligent elevator safety monitoring system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010731409.6A CN111807204A (en) | 2020-07-27 | 2020-07-27 | Intelligent elevator safety monitoring system |
Publications (1)
Publication Number | Publication Date |
---|---|
CN111807204A true CN111807204A (en) | 2020-10-23 |
Family
ID=72861327
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010731409.6A Withdrawn CN111807204A (en) | 2020-07-27 | 2020-07-27 | Intelligent elevator safety monitoring system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111807204A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2022134504A1 (en) * | 2020-12-25 | 2022-06-30 | 上海商汤智能科技有限公司 | Image detection method and apparatus, electronic device, and storage medium |
-
2020
- 2020-07-27 CN CN202010731409.6A patent/CN111807204A/en not_active Withdrawn
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2022134504A1 (en) * | 2020-12-25 | 2022-06-30 | 上海商汤智能科技有限公司 | Image detection method and apparatus, electronic device, and storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3115326B1 (en) | Elevator system capable of monitoring children use and control method thereof | |
US10424180B2 (en) | Body fall smart control system and method therefor | |
CN110309782B (en) | Living body face detection method based on infrared and visible light binocular system | |
CN108750899B (en) | Escalator automatic scram device and control method thereof | |
KR20120059647A (en) | Device for acquiring fingerprints on the fly | |
KR100326203B1 (en) | Method and apparatus for face photographing and recognizing by automatic trading a skin color and motion | |
CN211209824U (en) | Intelligent security monitoring system for community | |
JP2009237993A (en) | Image monitoring device | |
CN111807204A (en) | Intelligent elevator safety monitoring system | |
KR20130094489A (en) | System and method for monitoring emergency motion based image | |
CN112381871A (en) | Method for realizing locomotive alertness device based on face recognition | |
CN107527025A (en) | A kind of recognition of face intelligent monitor system | |
JP2005108033A (en) | Driver condition determination device and method | |
KR101219407B1 (en) | escalator monitoring system using image processing technology | |
CN108898056B (en) | Fire control individual soldier equipment and quick matching system of personnel | |
JP3103931B2 (en) | Indoor monitoring device | |
CN111144219B (en) | Iris recognition device and method based on 3D structured light | |
JP2008007272A (en) | Operation controller for passenger conveyor | |
CN110795981A (en) | Face recognition interaction method and system for hyperbaric oxygen chamber | |
CN113291938A (en) | Elevator optimal scheduling system and scheduling method thereof | |
JP6163302B2 (en) | Monitoring system | |
TW201201978A (en) | Avoiding hurt system and method, and shooting apparatus including the avoiding hurt system | |
CN108986407B (en) | Safety detection system and method for solitary old people | |
KR102074802B1 (en) | Escalator management system through intelligent imagery analysis | |
TW201205449A (en) | Video camera and a controlling method thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
WW01 | Invention patent application withdrawn after publication | ||
WW01 | Invention patent application withdrawn after publication |
Application publication date: 20201023 |