CN111807204A - Intelligent elevator safety monitoring system - Google Patents

Intelligent elevator safety monitoring system Download PDF

Info

Publication number
CN111807204A
CN111807204A CN202010731409.6A CN202010731409A CN111807204A CN 111807204 A CN111807204 A CN 111807204A CN 202010731409 A CN202010731409 A CN 202010731409A CN 111807204 A CN111807204 A CN 111807204A
Authority
CN
China
Prior art keywords
escalator
binocular vision
vision sensor
module
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN202010731409.6A
Other languages
Chinese (zh)
Inventor
陈峤
袁鑫
王建强
周超
陈位
严陈
卢仁云
姜久文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Legate Intelligent Equipment Co ltd
Original Assignee
Suzhou Legate Intelligent Equipment Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Legate Intelligent Equipment Co ltd filed Critical Suzhou Legate Intelligent Equipment Co ltd
Priority to CN202010731409.6A priority Critical patent/CN111807204A/en
Publication of CN111807204A publication Critical patent/CN111807204A/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B66HOISTING; LIFTING; HAULING
    • B66BELEVATORS; ESCALATORS OR MOVING WALKWAYS
    • B66B29/00Safety devices of escalators or moving walkways
    • B66B29/005Applications of security monitors
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B66HOISTING; LIFTING; HAULING
    • B66BELEVATORS; ESCALATORS OR MOVING WALKWAYS
    • B66B25/00Control of escalators or moving walkways
    • B66B25/003Methods or algorithms therefor

Landscapes

  • Escalators And Moving Walkways (AREA)

Abstract

The invention provides an intelligent elevator safety monitoring system which monitors the behavior of a user in the running process of an escalator, actively gives an alarm or degrades the operation and stops the operation according to the behavior characteristics, and further improves the safety of the user. The escalator comprises an escalator body and an escalator controller, wherein a first binocular vision sensor is arranged above an upper guide section of the escalator body, a second binocular vision sensor is arranged above a lower guide section of the escalator body, state recognition processors are arranged inside the first binocular vision sensor and the second binocular vision sensor, various dangerous state postures are preset in the state recognition processors, a vision detection area of the first binocular vision sensor covers the upper guide section and a first oblique guide stepping area below the upper guide section, and a vision detection area of the second binocular vision sensor covers the lower guide section and a second oblique guide stepping area above the lower guide section.

Description

Intelligent elevator safety monitoring system
Technical Field
The invention relates to the technical field of elevator safe operation, in particular to an intelligent elevator safety monitoring system.
Background
The existing escalator slowly rises or falls after people enter the escalator, and carries pedestrians upstairs and downstairs, but safety accidents occur during operation of the people in the escalator, and if the people fall down, go backwards and probe abnormal behaviors, the existing escalator cannot be monitored correspondingly, and then subsequent serious safety accidents are caused.
Disclosure of Invention
The invention provides an intelligent elevator safety monitoring system, which monitors the behavior of a user in the running process of an escalator, and actively gives an alarm or degrades the operation and stops the operation according to the behavior characteristics, so that the safety of the user is further improved.
Wisdom elevator safety monitoring system, its characterized in that: the escalator comprises an escalator body and an escalator controller, wherein a first binocular vision sensor is arranged above an upper guide section of the escalator body, a second binocular vision sensor is arranged above a lower guide section of the escalator body, state recognition processors are arranged inside the first binocular vision sensor and the second binocular vision sensor, various dangerous state postures are preset in the state recognition processors, a vision detection area of the first binocular vision sensor covers the upper guide section and a first oblique guide stepping area below the upper guide section, a vision detection area of the second binocular vision sensor covers the lower guide section and a second oblique guide stepping area above the lower guide section, output ends of the first binocular vision sensor and the second binocular vision sensor are respectively connected to a monitoring port of the escalator controller, and the first binocular vision sensor, the second binocular vision sensor, the first binocular vision sensor, the second binocular vision sensor and the monitoring port are respectively connected with the monitoring port of the escalator controller, And when the second binocular vision sensor judges that the personnel is in the corresponding dangerous state posture according to the captured image, the output end of the second binocular vision sensor sends a corresponding code to the monitoring port of the escalator controller, and the escalator controller carries out corresponding safety operation according to the received code.
It is further characterized in that:
when the first binocular vision sensor and the second binocular vision sensor both feed back corresponding signal codes to the escalator controller, and no pedestrian exists in the escalator, the escalator controller drives the escalator to decelerate or stop running, and the escalator controller is in a standby energy-saving state;
after a pedestrian enters the escalator, any binocular sensor outputs a corresponding code to inform the escalator controller, the escalator controller drives the escalator body to start operation, and friendly voice sound is selectively sent out or the escalator body is in a mute state while the operation is started;
when a pedestrian enters the escalator, each binocular sensor monitors a monitoring area where the pedestrian is located in real time, if the pedestrian falls down, walks reversely and the probe is out of the escalator, the corresponding binocular vision sensor returns a signal code corresponding to the escalator controller, the escalator performs degradation and deceleration or immediately stops operating according to an instruction corresponding to the signal code, and transmits a signal to a monitoring room to inform a manager of corresponding processing;
the first binocular vision sensor and the second binocular vision sensor are internally provided with depth image cameras, each depth image camera overlooks from top to bottom to shoot a static image or a continuous video containing depth information of a corresponding area, and senses and tracks a user according to the image or video information until the user is separated from the area covered by monitoring;
the depth image camera comprises a structure light emitting module, a structure light receiving module and a depth information processing module, wherein the structure light emitting module projects a certain specific light pattern onto an object from a known angle to form a projection, the structure light receiving module shoots the projection formed on the object from another known angle, the depth information processing module carries out preprocessing, storage, identification and calculation on the projected image to obtain a depth image, the depth information processing module outputs the depth image to a state identification processor to judge whether a user in a monitoring area is in an abnormal state or not, if the person is in a corresponding dangerous state posture, the output end of the depth information processing module sends a corresponding code to a monitoring port of the escalator controller, and the escalator controller carries out corresponding safety operation according to the received code;
the depth information processing module is a depth information processing system based on structured light, the depth information processing module comprises a preprocessing and storage module, a calculation module and a depth information identification module, the structured light emitting module projects structured light of infrared or visible light to a scene, the structured light receiving module shoots distortion of the structured light with depth information on the surface of the scene and sends the distortion to the preprocessing and storage module, and the preprocessing and storage module preprocesses a video image shot by the structured light receiving module and comprises: a) image distortion correction, which is a geometric transformation process based on an image warping (image warping) algorithm based on a test grid; b) the extraction of the moving foreground image is the extraction processing of the foreground image based on the algorithm of eliminating the reference background; the preprocessing and storage module, the calculation module and the depth information identification module can communicate with each other through various communication protocols such as USB, Ethernet and a wireless protocol 802.11 a/b/g/n; the calculation module 332 adopts a structured light three-dimensional reconstruction algorithm to calculate the image containing the depth information processed by the preprocessing and storage module to obtain the third-dimensional information of the scene, so as to output the depth image of the scene to the state recognition processor; the depth information identification module can accelerate the operation speed of the calculation module through a predefined human body depth information template, and the calculation accuracy is improved.
After the invention is adopted, independent binocular vision sensors are respectively arranged above the upper guide section and the lower guide section of the escalator, the inside of each binocular vision sensor is provided with a state recognition processor, various dangerous state postures are preset in the state recognition processors, the output ends of the binocular vision sensors are respectively connected to the monitoring port of the escalator controller, when the first binocular vision sensor and the second binocular vision sensor judge that a person is in the corresponding dangerous state posture according to the captured images, the output end of the escalator sends a corresponding code to a monitoring port of the escalator controller, the escalator controller carries out corresponding safe operation according to the received code, the escalator carries out 24-hour safe monitoring through two binocular recognition sensors, the elevator is not needed to be watched by special staff during the peak period, the emergency braking or the speed reduction can be automatically realized, and the personal safety of pedestrians is ensured; in the running process of the escalator, the behavior of a user is monitored, and according to the behavior characteristics, the escalator actively gives an alarm or degrades the operation and stops the operation, so that the safety of the user is further improved.
Drawings
FIG. 1 is a schematic block diagram of the arrangement of the present invention;
the names corresponding to the sequence numbers in the figure are as follows:
the escalator comprises an escalator body 1, an upper guide section 101, a lower guide section 102, a first oblique guide stepping area 103, a second oblique guide stepping area 104, an escalator controller 2, a monitoring port 21, a first binocular vision sensor 3 and a second binocular vision sensor 4.
Detailed Description
Wisdom elevator safety monitoring system, see figure 1: the escalator comprises an escalator body 1 and an escalator controller 2, wherein a first visual perception sensor 3 is arranged above an upper guide section 101 of the escalator body 1, a second visual perception sensor 4 is arranged above a lower guide section 102 of the escalator body 1, state recognition processors are arranged inside the first visual perception sensor 3 and the second visual perception sensor 4, various dangerous state postures are preset in the state recognition processors, a visual detection area of the first visual perception sensor 3 covers the upper guide section 101 and a first oblique guiding stepping area 103 below the upper guide section, a visual detection area of the second visual perception sensor 4 covers the lower guide section 102 and a second oblique guiding stepping area 104 above the lower guide section, output ends of the first visual perception sensor 3 and the second visual perception sensor 4 are respectively connected to a monitoring port 21 of the escalator controller 2, when the first binocular vision sensor 3 and the second binocular vision sensor 4 judge that the personnel are in the corresponding dangerous state postures according to the captured images, the output ends of the first binocular vision sensor and the second binocular vision sensor transmit corresponding codes to the monitoring port 21 of the escalator controller 2, and the escalator controller 2 carries out corresponding safe operation according to the received codes.
When the first visual sensor 3 and the second visual sensor 4 both feed back corresponding signal codes to the escalator controller 2, and no pedestrian exists in the escalator, the escalator controller 2 drives the escalator body 1 to decelerate or stop running, and is in a standby energy-saving state;
after a pedestrian enters the escalator body 1, any binocular sensor outputs a corresponding code to inform the escalator controller 2, the escalator controller 2 drives the escalator body 1 to start operation, and friendly voice sound is selectively sent out or the escalator body is in a mute state while the operation is started;
when a pedestrian enters the escalator body 1, each binocular sensor monitors a monitoring area where the pedestrian is located in real time, if the pedestrian falls down, walks reversely and the probe is out of the escalator, the corresponding binocular vision sensor returns a signal code corresponding to the escalator controller 2, the escalator performs degradation and deceleration or immediately stops operation according to an instruction corresponding to the signal code, and transmits a signal to a monitoring room to inform a manager to perform corresponding processing;
the first binocular vision sensor 3 and the second binocular vision sensor 4 are internally provided with depth image cameras, each depth image camera overlooks from top to bottom to shoot a static image or a continuous video containing depth information of a corresponding area, and senses and tracks a user according to the image or video information until the user is separated from the area covered by monitoring;
the depth image camera comprises a structure light emitting module, a structure light receiving module and a depth information processing module, wherein the structure light emitting module projects a certain specific light pattern onto an object from a known angle to form a projection, the structure light receiving module shoots the projection formed on the object from another known angle, the depth information processing module carries out preprocessing, storage, identification and calculation on the projected image to obtain a depth image, the depth information processing module outputs the depth image to a state identification processor to judge whether a user in a monitoring area is in an abnormal state or not, if the person is in a corresponding dangerous state posture, the output end of the depth information processing module sends a corresponding code to a monitoring port of the escalator controller, and the escalator controller carries out corresponding safety operation according to the received code;
the depth information processing module is a depth information processing system based on structured light, the depth information processing module comprises a preprocessing and storage module, a calculation module and a depth information identification module, the structured light emitting module projects structured light of infrared or visible light to a scene, the structured light receiving module shoots distortion with depth information on the surface of the scene of the structured light and sends the distortion into the preprocessing and storage module, and the preprocessing and storage module preprocesses a video image shot by the structured light receiving module and comprises: a) image distortion correction is a geometric variation based on a test grid based image warping algorithm
Changing treatment; b) the extraction of the moving foreground image is the extraction processing of the foreground image based on the algorithm of eliminating the reference background; the preprocessing and storage module, the calculation module and the depth information identification module can communicate with each other through various communication protocols such as USB, Ethernet and a wireless protocol 802.11 a/b/g/n; the calculation module 332 adopts a structured light three-dimensional reconstruction algorithm to calculate the image containing the depth information processed by the preprocessing and storage module to obtain the third-dimensional information of the scene, so as to output the depth image of the scene to the state recognition processor; the depth information identification module can accelerate the operation speed of the calculation module through a predefined human body depth information template, and the calculation accuracy is improved.
In particular, the depth image camera is embodied as a thermal imaging camera or a color visible light camera.
The working principle is as follows: independent binocular vision sensors are respectively arranged above an upper guide section and a lower guide section of the escalator, state recognition processors are arranged in the binocular vision sensors, various dangerous state postures are preset in the state recognition processors, the output ends of the binocular vision sensors are respectively connected to monitoring ports of the escalator controller, when the first binocular vision sensor and the second binocular vision sensor judge that a person is in a corresponding dangerous state posture according to captured images, the output ends of the first binocular vision sensor and the second binocular vision sensor send corresponding codes to the monitoring ports of the escalator controller, the escalator controller carries out corresponding safe operation according to the received codes, the escalator carries out 24-hour safety monitoring through the two binocular vision sensors, a professional person does not need to wait for an elevator in a peak period, emergency braking or deceleration can be automatically realized, and the personal safety of pedestrians is ensured; in the running process of the escalator, the behavior of a user is monitored, and according to the behavior characteristics, the escalator actively gives an alarm or degrades the operation and stops the operation, so that the safety of the user is further improved.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned.
Furthermore, it should be understood that although the present description refers to embodiments, not every embodiment may contain only a single embodiment, and such description is for clarity only, and those skilled in the art should integrate the description, and the embodiments may be combined as appropriate to form other embodiments understood by those skilled in the art.

Claims (7)

1. Wisdom elevator safety monitoring system, its characterized in that: the escalator comprises an escalator body and an escalator controller, wherein a first binocular vision sensor is arranged above an upper guide section of the escalator body, a second binocular vision sensor is arranged above a lower guide section of the escalator body, state recognition processors are arranged inside the first binocular vision sensor and the second binocular vision sensor, various dangerous state postures are preset in the state recognition processors, a vision detection area of the first binocular vision sensor covers the upper guide section and a first oblique guide stepping area below the upper guide section, a vision detection area of the second binocular vision sensor covers the lower guide section and a second oblique guide stepping area above the lower guide section, output ends of the first binocular vision sensor and the second binocular vision sensor are respectively connected to a monitoring port of the escalator controller, and the first binocular vision sensor, the second binocular vision sensor, the first binocular vision sensor, the second binocular vision sensor and the monitoring port are respectively connected with the monitoring port of the escalator controller, And when the second binocular vision sensor judges that the personnel is in the corresponding dangerous state posture according to the captured image, the output end of the second binocular vision sensor sends a corresponding code to the monitoring port of the escalator controller, and the escalator controller carries out corresponding safety operation according to the received code.
2. The intelligent elevator safety monitoring system of claim 1, wherein: when the first binocular vision sensor and the second binocular vision sensor both feed back corresponding signal codes to the escalator controller, and no pedestrian exists in the escalator, the escalator controller drives the escalator to decelerate or stop running, and the escalator is in a standby energy-saving state.
3. The intelligent elevator safety monitoring system of claim 1, wherein: after the pedestrian enters the escalator, any binocular sensor outputs a corresponding code to inform the escalator controller, the escalator controller drives the escalator body to start operation, and friendly voice sound is selectively sent or the escalator is in a mute state while the operation is started.
4. The intelligent elevator safety monitoring system of claim 1, wherein: when a pedestrian enters the escalator, each binocular sensor monitors the monitoring area where the sensor is located in real time, if the pedestrian falls down, walks reversely and the probe is out of the escalator, the corresponding binocular vision sensor returns a signal code corresponding to the escalator controller, the escalator performs degradation and deceleration or stops operation immediately according to an instruction corresponding to the signal code, and transmits the signal to a monitoring room to inform a manager of corresponding processing.
5. The intelligent elevator safety monitoring system of claim 1, wherein: the first binocular vision sensor and the second binocular vision sensor are internally provided with depth image cameras, each depth image camera overlooks from top to bottom to shoot a static image or a continuous video containing depth information of a corresponding area, and senses and tracks a user according to the image or video information until the user is separated from the area covered by monitoring.
6. The intelligent elevator safety monitoring system of claim 5, wherein: the depth image camera comprises a structure light emitting module, a structure light receiving module and a depth information processing module, wherein the structure light emitting module projects a certain specific light pattern onto an object from a known angle to form a projection, the structure light receiving module shoots the projection formed on the object from another known angle, the depth information processing module carries out preprocessing, storage, identification and calculation on the projected image to obtain a depth image, the depth information processing module outputs the depth image to a state identification processor to judge whether a user in a monitoring area is in an abnormal state or not, if the person is in a corresponding dangerous state posture, the output end of the depth information processing module sends a corresponding code to a monitoring port of the escalator controller, and the escalator controller carries out corresponding safety operation according to the received code.
7. The intelligent elevator safety monitoring system of claim 6, wherein: the depth information processing module is a depth information processing system based on structured light, the depth information processing module comprises a preprocessing and storage module, a calculation module and a depth information identification module, the structured light emitting module projects structured light of infrared or visible light to a scene, the structured light receiving module shoots distortion of the structured light with depth information on the surface of the scene and sends the distortion to the preprocessing and storage module, and the preprocessing and storage module preprocesses a video image shot by the structured light receiving module and comprises: a) image distortion correction, which is a geometric transformation process based on an image warping (image warping) algorithm based on a test grid; b) the extraction of the moving foreground image is the extraction processing of the foreground image based on the algorithm of eliminating the reference background; the preprocessing and storage module, the calculation module and the depth information identification module can communicate with each other through various communication protocols such as USB, Ethernet and a wireless protocol 802.11 a/b/g/n; the calculation module 332 adopts a structured light three-dimensional reconstruction algorithm to calculate the image containing the depth information processed by the preprocessing and storage module to obtain the third-dimensional information of the scene, so as to output the depth image of the scene to the state recognition processor; the depth information identification module can accelerate the operation speed of the calculation module through a predefined human body depth information template.
CN202010731409.6A 2020-07-27 2020-07-27 Intelligent elevator safety monitoring system Withdrawn CN111807204A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010731409.6A CN111807204A (en) 2020-07-27 2020-07-27 Intelligent elevator safety monitoring system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010731409.6A CN111807204A (en) 2020-07-27 2020-07-27 Intelligent elevator safety monitoring system

Publications (1)

Publication Number Publication Date
CN111807204A true CN111807204A (en) 2020-10-23

Family

ID=72861327

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010731409.6A Withdrawn CN111807204A (en) 2020-07-27 2020-07-27 Intelligent elevator safety monitoring system

Country Status (1)

Country Link
CN (1) CN111807204A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022134504A1 (en) * 2020-12-25 2022-06-30 上海商汤智能科技有限公司 Image detection method and apparatus, electronic device, and storage medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022134504A1 (en) * 2020-12-25 2022-06-30 上海商汤智能科技有限公司 Image detection method and apparatus, electronic device, and storage medium

Similar Documents

Publication Publication Date Title
EP3115326B1 (en) Elevator system capable of monitoring children use and control method thereof
US10424180B2 (en) Body fall smart control system and method therefor
CN110309782B (en) Living body face detection method based on infrared and visible light binocular system
CN108750899B (en) Escalator automatic scram device and control method thereof
KR20120059647A (en) Device for acquiring fingerprints on the fly
KR100326203B1 (en) Method and apparatus for face photographing and recognizing by automatic trading a skin color and motion
CN211209824U (en) Intelligent security monitoring system for community
JP2009237993A (en) Image monitoring device
CN111807204A (en) Intelligent elevator safety monitoring system
KR20130094489A (en) System and method for monitoring emergency motion based image
CN112381871A (en) Method for realizing locomotive alertness device based on face recognition
CN107527025A (en) A kind of recognition of face intelligent monitor system
JP2005108033A (en) Driver condition determination device and method
KR101219407B1 (en) escalator monitoring system using image processing technology
CN108898056B (en) Fire control individual soldier equipment and quick matching system of personnel
JP3103931B2 (en) Indoor monitoring device
CN111144219B (en) Iris recognition device and method based on 3D structured light
JP2008007272A (en) Operation controller for passenger conveyor
CN110795981A (en) Face recognition interaction method and system for hyperbaric oxygen chamber
CN113291938A (en) Elevator optimal scheduling system and scheduling method thereof
JP6163302B2 (en) Monitoring system
TW201201978A (en) Avoiding hurt system and method, and shooting apparatus including the avoiding hurt system
CN108986407B (en) Safety detection system and method for solitary old people
KR102074802B1 (en) Escalator management system through intelligent imagery analysis
TW201205449A (en) Video camera and a controlling method thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication
WW01 Invention patent application withdrawn after publication

Application publication date: 20201023