CN113888824A - Mine violation border crossing behavior identification and alarm method and device based on topological spatial relationship - Google Patents
Mine violation border crossing behavior identification and alarm method and device based on topological spatial relationship Download PDFInfo
- Publication number
- CN113888824A CN113888824A CN202110735608.9A CN202110735608A CN113888824A CN 113888824 A CN113888824 A CN 113888824A CN 202110735608 A CN202110735608 A CN 202110735608A CN 113888824 A CN113888824 A CN 113888824A
- Authority
- CN
- China
- Prior art keywords
- frame
- sensitive area
- danger
- target person
- mine
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 15
- 238000001514 detection method Methods 0.000 claims abstract description 38
- 230000003993 interaction Effects 0.000 claims description 12
- 238000012544 monitoring process Methods 0.000 claims description 5
- 238000004891 communication Methods 0.000 claims description 3
- 230000006399 behavior Effects 0.000 description 14
- 230000007547 defect Effects 0.000 description 2
- 206010003497 Asphyxia Diseases 0.000 description 1
- 206010017740 Gas poisoning Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000003245 coal Substances 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 231100001261 hazardous Toxicity 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Alarm Systems (AREA)
- Emergency Alarm Devices (AREA)
- Image Analysis (AREA)
Abstract
The invention discloses a method and a device for identifying and alarming mine violation border-crossing behavior based on topological spatial relationship, which comprises the following steps of arranging a camera in a mine, and acquiring a video image of a dangerous sensitive area in real time; defining a dangerous sensitive area in the video image to obtain a dangerous sensitive area defining frame; detecting whether a moving person exists in the video image frame in real time, and marking the target person by using a detection frame if the moving person exists to obtain a target person detection frame; and thirdly, performing spatial topology operation on the positions of the target person detection frame and the danger sensitive area defining frame, and judging whether the target person is in the danger sensitive area. The invention can accurately identify the illegal and boundary-crossing behavior of the mine in time, carry out safety early warning and avoid the occurrence of danger.
Description
Technical Field
The invention belongs to the technical field of mine safety, and particularly relates to a mine violation border crossing behavior identification and alarm method and device based on a topological spatial relationship.
Background
Video surveillance downhole can detect the presence of personnel downhole, but there is no real identification of violations downhole across hazardous areas. In the production of safe mines, personnel violation behaviors with a plurality of uncertain factors exist underground coal mines, wherein crossing dangerous sensitive areas is the most typical underground violation behavior, once workers mistakenly enter the areas, inevitable serious dangerous accidents can be caused, such as blind roadways, roadways with over 6 meters of air not flowing, underground harmful gas is gathered at the positions, when people enter the areas, accidents such as suffocation, gas poisoning and the like easily occur, and the same dangerous areas also have lane lines in transportation, dangerous article placing areas, goafs and the like. Therefore, the illegal and border-crossing behavior of the mine needs to be recognized timely and accurately, a judgment condition is provided for safety early warning, and danger is avoided.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provides a mine violation border crossing behavior identification and alarm method based on a topological spatial relationship. The method is based on the underground video monitoring image, and judges whether the behavior of violation intrusion into the dangerous sensitive area exists in the underground staff according to the spatial topological relation.
The invention is realized by the following technical scheme:
a mine violation border crossing behavior identification and alarm method based on topological spatial relationship comprises the following steps:
laying a camera in a mine, and collecting a video image of a dangerous sensitive area in real time;
defining a dangerous sensitive area in the video image to obtain a dangerous sensitive area defining frame B; detecting whether a moving person exists in the video image frame in real time, and marking the target person by using a detection frame if the moving person exists to obtain a target person detection frame A;
and thirdly, performing spatial topology operation on the positions of the target person detection frame A and the danger sensitive area defining frame B, and judging whether the target person is in the danger sensitive area.
In the technical scheme, in the third step, the upper left corner coordinates (Xa1, Ya1) and the lower right corner coordinates (Xa2, Ya2) of the target person detection frame A are extracted, and the upper left corner coordinates (Xb1, Yb1) and the lower right corner coordinates (Xb2, Yb2) of the danger sensitive area defining frame B are extracted; then, obtaining the coordinates of the central points of the target person detection frame A and the danger sensitive area defining frame B, wherein the coordinates are respectively as follows:
the width and the height of the target person detection frame A are calculated as follows:
Wa＝Xa2-Xa1,Ha＝Ya2-Ya1
calculating the width and the height of a dangerous sensitive area defining frame B respectively as follows:
Wb＝Xb2-Xb1,Hb＝Yb2-Yb1
after the coordinates, the width and the height data of the center points of the target person detection frame A and the danger sensitive area defining frame B are obtained, whether the target person detection frame A and the danger sensitive area defining frame B are intersected or not is judged through the following formula:
|Xb3-Xa3|≤(Wa+Wb)/2 (1)
|Yb3-Ya3|≤(Ha+Hb)/2 (2)
if formula (1) and formula (2) are satisfied simultaneously, that is, the difference between the x-direction coordinates of the center points of the frame A and the frame B is less than half of the width sum of the frame A and the frame B, and the difference between the y-direction coordinates of the center points of the frame A and the frame B is less than half of the height sum of the frame A and the frame B, it is indicated that the frame A and the frame B intersect.
According to the technical scheme, after the target person is judged to enter the danger sensitive area, alarm prompt is carried out.
Another purpose of the present invention is to overcome the defects of the prior art, and to provide a device capable of implementing the method for identifying and alarming mine violation border crossing behavior, which includes the following specific technical contents:
a mine violation border crossing behavior recognition and alarm device comprises:
the camera is used for acquiring video images of the underground dangerous sensitive area in real time;
the local server is arranged underground and connected with the camera, receives video image data acquired by the camera in real time, defines a dangerous sensitive area in the video image to obtain a dangerous sensitive area defining frame B, detects whether moving personnel exist in the video image frame in real time, and marks the target personnel by using a detection frame to obtain a target personnel detection frame A if the moving personnel exist; performing spatial topology operation on the positions of the target person detection frame A and the danger sensitive area defining frame B, and judging whether the target person is in a danger sensitive area;
and the alarm unit is arranged beside the underground danger sensitive area and connected with the local server, and when the local server judges that the target personnel enters the danger sensitive area, the alarm unit sends an instruction to the alarm unit to control the alarm unit to give an alarm.
Further, the remote server is arranged on the mine and serves as a monitoring end, the remote server is connected with a local server in the mine through a communication system to perform data interaction, and the local server sends video image data collected by a camera, judgment data of whether a person enters a dangerous sensitive area or not and alarm information to the remote server to be stored. The remote server is also connected with a human-computer interaction unit (a display, a mouse, a keyboard and the like), and human-computer interaction is realized through the human-computer interaction unit.
The invention has the advantages and beneficial effects that:
the method is based on the underground video monitoring image, judges whether the behavior of violation intrusion into the dangerous sensitive area exists in underground workers according to the spatial topological relation, can accurately recognize the violation border-crossing behavior of the mine in time, carries out safety early warning, and avoids the occurrence of danger.
Drawings
FIG. 1 is a schematic diagram of the position relationship between a target person detection frame A and a danger sensitive area defining frame B.
For a person skilled in the art, other relevant figures can be obtained from the above figures without inventive effort.
Detailed Description
In order to make the technical solution of the present invention better understood, the technical solution of the present invention is further described below with reference to specific examples.
Example one
A mine violation border crossing behavior identification and alarm method based on topological spatial relationship comprises the following steps:
step one, arranging a camera in a mine, and collecting a video image of a dangerous sensitive area in real time.
Defining a dangerous sensitive area in the video image to obtain a dangerous sensitive area defining frame B; and detecting whether a moving person exists in the video image frame in real time, and marking the target person by using a detection frame if the moving person exists to obtain a target person detection frame A.
And thirdly, performing spatial topology operation on the positions of the target person detection frame A and the danger sensitive area defining frame B, and judging whether the target person is in the danger sensitive area.
Judging the relative positions of the target person detection frame A and the danger sensitive area defining frame B based on the center points of the rectangular frames, specifically, referring to the attached drawing 1, firstly extracting the upper left-corner coordinates (Xa1, Ya1) and the lower right-corner coordinates (Xa2, Ya2) of the target person detection frame A, and extracting the upper left-corner coordinates (Xb1, Yb1) and the lower right-corner coordinates (Xb2, Yb2) of the danger sensitive area defining frame B; then, obtaining the coordinates of the central points of the target person detection frame A and the danger sensitive area defining frame B, wherein the coordinates are respectively as follows:
the width and the height of the target person detection frame A are respectively as follows:
Wa＝Xa2-Xa1,Ha＝Ya2-Ya1
the width and the height of the danger sensitive area defining frame B are respectively as follows:
Wb＝Xb2-Xb1,Hb＝Yb2-Yb1
after the coordinates, the width and the height data of the center points of the target person detection frame A and the danger sensitive area defining frame B are obtained, whether the target person detection frame A and the danger sensitive area defining frame B are intersected or not is judged through the following formula:
|Xb3-Xa3|≤(Wa+Wb)/2 (1)
|Yb3-Ya3|≤(Ha+Hb)/2 (2)
if the formula (1) and the formula (2) are met simultaneously, namely the difference between the x-direction coordinates of the center points of the frame A and the frame B is smaller than half of the width sum of the frame A and the frame B, and the difference between the y-direction coordinates of the center points of the frame A and the frame B is smaller than half of the height sum of the frame A and the frame B, the frame A and the frame B are intersected, and at the moment, the target person is judged to enter a danger sensitive area, and a serious alarm prompt is sent out.
Example two
A device capable of realizing the method for identifying and alarming mine illegal border crossing behaviors comprises the following steps:
the camera is used for acquiring video images of the underground dangerous sensitive area in real time;
the local server is arranged underground and connected with the camera, receives video image data acquired by the camera in real time, defines a dangerous sensitive area in the video image to obtain a dangerous sensitive area defining frame B, detects whether moving personnel exist in the video image frame in real time, and marks the target personnel by using a detection frame to obtain a target personnel detection frame A if the moving personnel exist; performing spatial topology operation on the positions of the target person detection frame A and the danger sensitive area defining frame B, and judging whether the target person is in a danger sensitive area;
the alarm unit is arranged beside the underground danger sensitive area and connected with the local server, and when the local server judges that the target personnel enters the danger sensitive area, the alarm unit sends an instruction to the alarm unit to control the alarm unit to give an alarm;
the remote server is arranged on the ground and used as a monitoring end, the remote server is connected with a local server in the ground through a communication system to perform data interaction, and the local server sends video image data acquired by a camera, judgment data for judging whether a person enters a danger sensitive area or not and alarm information to the remote server for storage;
the remote server is also connected with a human-computer interaction unit (a display, a mouse, a keyboard and the like), and human-computer interaction is realized through the human-computer interaction unit.
The invention has been described in an illustrative manner, and it is to be understood that any simple variations, modifications or other equivalent changes which can be made by one skilled in the art without departing from the spirit of the invention fall within the scope of the invention.
Claims (6)
1. A mine violation border crossing behavior identification and alarm method based on topological spatial relationship is characterized in that: the method comprises the following steps:
laying a camera in a mine, and collecting a video image of a dangerous sensitive area in real time;
defining a dangerous sensitive area in the video image to obtain a dangerous sensitive area defining frame B; detecting whether a moving person exists in the video image frame in real time, and marking the target person by using a detection frame if the moving person exists to obtain a target person detection frame A;
and thirdly, performing spatial topology operation on the positions of the target person detection frame A and the danger sensitive area defining frame B, and judging whether the target person is in the danger sensitive area.
2. The mine violation border-crossing behavior identification and alarm method based on topological spatial relationship as claimed in claim 1, wherein: in the third step, the coordinates (Xa1, Ya1) and the coordinates (Xa2, Ya2) of the upper left corner and the coordinates (Xb1, Yb1) of the target person detection frame A and the coordinates (Xb2, Yb2) of the upper left corner and the coordinates (Xb2, Yb2) of the danger sensitive area defining frame B are extracted; then, obtaining the coordinates of the central points of the target person detection frame A and the danger sensitive area defining frame B, wherein the coordinates are respectively as follows:
the width and the height of the target person detection frame A are calculated as follows:
Wa＝Xa2-Xa1,Ha＝Ya2-Ya1
calculating the width and the height of a dangerous sensitive area defining frame B respectively as follows:
Wb＝Xb2-Xb1,Hb＝Yb2-Yb1
after the coordinates, the width and the height data of the center points of the target person detection frame A and the danger sensitive area defining frame B are obtained, whether the target person detection frame A and the danger sensitive area defining frame B are intersected or not is judged through the following formula:
|Xb3-Xa3|≤(Wa+Wb)/2 (1)
|Yb3-Ya3|≤(Ha+Hb)/2 (2)
if formula (1) and formula (2) are satisfied simultaneously, that is, the difference between the x-direction coordinates of the center points of the frame A and the frame B is less than half of the width sum of the frame A and the frame B, and the difference between the y-direction coordinates of the center points of the frame A and the frame B is less than half of the height sum of the frame A and the frame B, it is indicated that the frame A and the frame B intersect.
3. The mine violation border-crossing behavior identification and alarm method based on topological spatial relationship as claimed in claim 1, wherein: and when the target personnel enter the danger sensitive area, carrying out alarm prompt.
4. The utility model provides a mine violation border crossing behavior discernment and alarm device which characterized in that includes:
the camera is used for acquiring video images of the underground dangerous sensitive area in real time;
the local server is arranged underground and connected with the camera, receives video image data acquired by the camera in real time, defines a dangerous sensitive area in the video image to obtain a dangerous sensitive area defining frame B, detects whether moving personnel exist in the video image frame in real time, and marks the target personnel by using a detection frame to obtain a target personnel detection frame A if the moving personnel exist; performing spatial topology operation on the positions of the target person detection frame A and the danger sensitive area defining frame B, and judging whether the target person is in a danger sensitive area;
and the alarm unit is arranged beside the underground danger sensitive area and connected with the local server, and when the local server judges that the target personnel enters the danger sensitive area, the alarm unit sends an instruction to the alarm unit to control the alarm unit to give an alarm.
5. The mine violation border crossing behavior recognition and alarm device according to claim 4, wherein: the remote server is arranged on the ground and serves as a monitoring end, the remote server is connected with a local server in the ground through a communication system to perform data interaction, and the local server sends video image data collected by a camera, judgment data indicating whether a person enters a dangerous sensitive area or not and alarm information to the remote server to be stored.
6. The mine violation border crossing behavior recognition and alarm device according to claim 5, wherein: the remote server is also connected with a human-computer interaction unit, and human-computer interaction is realized through the human-computer interaction unit.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110735608.9A CN113888824A (en) | 2021-06-30 | 2021-06-30 | Mine violation border crossing behavior identification and alarm method and device based on topological spatial relationship |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110735608.9A CN113888824A (en) | 2021-06-30 | 2021-06-30 | Mine violation border crossing behavior identification and alarm method and device based on topological spatial relationship |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113888824A true CN113888824A (en) | 2022-01-04 |
Family
ID=79010726
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110735608.9A Pending CN113888824A (en) | 2021-06-30 | 2021-06-30 | Mine violation border crossing behavior identification and alarm method and device based on topological spatial relationship |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113888824A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114140832A (en) * | 2022-01-30 | 2022-03-04 | 西安华创马科智能控制***有限公司 | Method and device for detecting pedestrian boundary crossing risk in well, electronic equipment and storage medium |
| CN115033740A (en) * | 2022-08-09 | 2022-09-09 | 杭州实在智能科技有限公司 | RPA process video key frame extraction and element positioning method |
| CN116740878A (en) * | 2023-08-15 | 2023-09-12 | 广东威恒输变电工程有限公司 | Positioning early warning method for bidirectional drawing of global area coordinated by multiple cameras |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110995808A (en) * | 2019-11-25 | 2020-04-10 | 国网安徽省电力有限公司建设分公司 | Power grid infrastructure site safety dynamic management and control system based on ubiquitous power Internet of things |
| CN111339901A (en) * | 2020-02-21 | 2020-06-26 | 北京容联易通信息技术有限公司 | Intrusion detection method and device based on image, electronic equipment and storage medium |
| AU2021100619A4 (en) * | 2021-02-01 | 2021-04-15 | Anhui University of Science and Technology | Mine safety monitoring system |
| CN112686872A (en) * | 2020-12-31 | 2021-04-20 | 南京理工大学 | Wood counting method based on deep learning |
-
2021
- 2021-06-30 CN CN202110735608.9A patent/CN113888824A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110995808A (en) * | 2019-11-25 | 2020-04-10 | 国网安徽省电力有限公司建设分公司 | Power grid infrastructure site safety dynamic management and control system based on ubiquitous power Internet of things |
| CN111339901A (en) * | 2020-02-21 | 2020-06-26 | 北京容联易通信息技术有限公司 | Intrusion detection method and device based on image, electronic equipment and storage medium |
| CN112686872A (en) * | 2020-12-31 | 2021-04-20 | 南京理工大学 | Wood counting method based on deep learning |
| AU2021100619A4 (en) * | 2021-02-01 | 2021-04-15 | Anhui University of Science and Technology | Mine safety monitoring system |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114140832A (en) * | 2022-01-30 | 2022-03-04 | 西安华创马科智能控制***有限公司 | Method and device for detecting pedestrian boundary crossing risk in well, electronic equipment and storage medium |
| CN115033740A (en) * | 2022-08-09 | 2022-09-09 | 杭州实在智能科技有限公司 | RPA process video key frame extraction and element positioning method |
| CN116740878A (en) * | 2023-08-15 | 2023-09-12 | 广东威恒输变电工程有限公司 | Positioning early warning method for bidirectional drawing of global area coordinated by multiple cameras |
| CN116740878B (en) * | 2023-08-15 | 2023-12-26 | 广东威恒输变电工程有限公司 | Positioning early warning method for bidirectional drawing of global area coordinated by multiple cameras |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113888824A (en) | Mine violation border crossing behavior identification and alarm method and device based on topological spatial relationship | |
| CN105758450B (en) | Met an urgent need based on multisensor the fire-fighting early warning sensory perceptual system construction method of robot | |
| CN110620906A (en) | Electric power construction safety management system based on thing networking | |
| CN104787084B (en) | A kind of railway foreign body intrusion detecting system and detection method | |
| CN111341068B (en) | Construction method of drilling site dangerous area early warning system based on deep learning | |
| KR101748121B1 (en) | System and method for detecting image in real-time based on object recognition | |
| CN103150549B (en) | A kind of road tunnel fire detection method based on the early stage motion feature of smog | |
| CN104240239A (en) | Method for detecting local road segment hazy weather based on road image | |
| CN104821056A (en) | Intelligent guarding method based on radar and video integration | |
| CN112016528B (en) | Behavior recognition method and device, electronic equipment and readable storage medium | |
| CN109033721A (en) | Construction site Danger source and security protection system based on BIM | |
| CN110796819B (en) | Detection method and system for platform yellow line invasion border crossing personnel | |
| CN104469309A (en) | Tunnel pedestrian intrusion detection device and method | |
| CN111461080B (en) | Intelligent fence building and identifying method based on image | |
| CN113408361B (en) | Mining conveyor belt massive material detection method and system based on deep learning | |
| CN109740412A (en) | A kind of signal lamp failure detection method based on computer vision | |
| CN112738468A (en) | Intelligent park safety early warning method and system | |
| CN112308032B (en) | Intelligent cooperative linkage control method for underground air door through video detection | |
| CN103093192A (en) | High voltage transmission line galloping identification method | |
| CN107888875A (en) | Transformer station's ground safety managing and control system and method based on mobile detection | |
| CN113506416A (en) | Engineering abnormity early warning method and system based on intelligent visual analysis | |
| CN115100813B (en) | Intelligent community system based on digital twins | |
| CN104268548A (en) | Accumulated snow detection method based on road images | |
| CN106980810A (en) | A kind of Overheight Vehicles proximity test method incremental based on sensitizing range image outline | |
| CN116978152B (en) | Noninductive safety monitoring method and system based on radio frequency identification technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220104 |