CN109236298B - VR-based colliery fully mechanized mining equipment collision detection and early warning method - Google Patents

VR-based colliery fully mechanized mining equipment collision detection and early warning method Download PDF

Info

Publication number
CN109236298B
CN109236298B CN201811233674.0A CN201811233674A CN109236298B CN 109236298 B CN109236298 B CN 109236298B CN 201811233674 A CN201811233674 A CN 201811233674A CN 109236298 B CN109236298 B CN 109236298B
Authority
CN
China
Prior art keywords
collision
equipment
early warning
ray
devices
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811233674.0A
Other languages
Chinese (zh)
Other versions
CN109236298A (en
Inventor
张旭辉
王妙云
杜昱阳
张雨萌
张超
赵建勋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xian University of Science and Technology
Original Assignee
Xian University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xian University of Science and Technology filed Critical Xian University of Science and Technology
Priority to CN201811233674.0A priority Critical patent/CN109236298B/en
Publication of CN109236298A publication Critical patent/CN109236298A/en
Application granted granted Critical
Publication of CN109236298B publication Critical patent/CN109236298B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • EFIXED CONSTRUCTIONS
    • E21EARTH OR ROCK DRILLING; MINING
    • E21CMINING OR QUARRYING
    • E21C41/00Methods of underground or surface mining; Layouts therefor
    • E21C41/16Methods of underground mining; Layouts therefor
    • E21C41/18Methods of underground mining; Layouts therefor for brown or hard coal
    • EFIXED CONSTRUCTIONS
    • E21EARTH OR ROCK DRILLING; MINING
    • E21FSAFETY DEVICES, TRANSPORT, FILLING-UP, RESCUE, VENTILATION, OR DRAINING IN OR OF MINES OR TUNNELS
    • E21F17/00Methods or devices for use in mines or tunnels, not covered elsewhere
    • E21F17/18Special adaptations of signalling or alarm devices

Landscapes

  • Engineering & Computer Science (AREA)
  • Mining & Mineral Resources (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Life Sciences & Earth Sciences (AREA)
  • Geochemistry & Mineralogy (AREA)
  • Geology (AREA)
  • Remote Sensing (AREA)
  • Emergency Alarm Devices (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The invention discloses a VR-based colliery fully-mechanized mining equipment collision detection and early warning method, which is characterized in that a collision detection module emits rays to collide with all equipment added with collision bodies in a virtual scene, collision information is returned, the length of the rays between the rays and all the collision bodies is calculated to be the distance D between the equipment, the detected distance D between the equipment is compared with a distance threshold value preset by a system, when the distance D between the equipment is smaller than a certain threshold value, an early warning detection module gives an alarm to remind an operator to take corresponding measures, and the relative position between the equipment is judged according to the prompt of the system, so that the aim of early warning detection is fulfilled. The invention realizes the functions of early warning monitoring and collision detection among equipment by using a virtual ray detection technology in a virtual simulation and remote monitoring platform, and further performs manual intervention through the virtual simulation and remote control platform to achieve the purpose of preventing collision of three-machine equipment.

Description

VR-based colliery fully mechanized mining equipment collision detection and early warning method
Technical Field
The invention relates to a remote control collision detection technology, in particular to a collision early warning detection method for three-machine equipment on a fully mechanized coal mining face.
Background
With the continuous development of coal mining technology, most coal mine enterprises in China have realized automatic and mechanized coal mining. However, in remote control operation of few people and unmanned working faces, the most common hidden dangers are mutual collision among fully mechanized mining devices and phenomena of frame squeezing, frame biting and frame falling of working face supports, so that how to efficiently and accurately detect the collision among the fully mechanized mining devices becomes a core problem of coal mine safety production. Mining conditions are typically monitored using sensors and visual measurements. However, due to fluctuation of external factors and limitation of the installation position of the sensor, the dynamic characteristic and the static characteristic of the sensor can be changed and unstable, so that the sensor cannot achieve the purpose of rapidness and accuracy in practical application of collision detection. With the rapid development of vision sensing technology and image processing technology, vision measurement has become one of the most popular non-contact measurement methods. Compared with other optical measurement methods, the visual measurement method does not need additional optical path auxiliary equipment, only needs the camera device, and can complete corresponding measurement through acquisition and analysis of images, but because underground roadway light is insufficient, and dust content is large, the problems of explosion and the like easily occur, and the information acquisition of the camera device is influenced, so the method is not suitable for complex coal mine environments.
Disclosure of Invention
The invention aims to provide a VR-based colliery fully-mechanized mining equipment collision detection and early warning method, which can quickly and accurately judge whether controlled objects intersect according to the motion tracks and the poses of all equipment in a scene, realize collision early warning detection among fully-mechanized mining face equipment, ensure the normal operation of fully-mechanized mining equipment in the mining process through artificial intervention and automatic obstacle avoidance of the equipment, and meet the requirements of high efficiency and real-time performance of a system.
The technical scheme of the invention is as follows: a colliery comprehensive mining equipment collision detection and early warning method based on VR is provided based on colliery comprehensive mining working face virtual simulation and remote control system, the system mainly comprises a virtual simulation and remote monitoring platform, a remote control platform, a data communication module and lower computer hardware, wherein the virtual simulation and remote monitoring platform is used for simulating the comprehensive mining working face environment and the motion state of three machines of equipment, the platform is constructed by modeling, rendering, assembling and other operations based on Unity3D development software, and is characterized in that the platform is constructed by transmitting rays through a collision detection module to collide with all equipment added with collision bodies in a virtual scene and returning collision information, the detected distance D between the equipment is compared with a distance threshold preset by the system by calculating the ray length between the rays and all the collision bodies as the distance D between the equipment is less than a certain threshold, the early warning detection module sends out an alarm to remind an operator to take corresponding measures, and the relative position between the devices is judged according to the prompt of the system, so that the aim of early warning detection is fulfilled;
setting two distance thresholds D according to working condition safety requirementsmax,DminThe distance D between the devices is divided into three regions: safe area, early warning area and dangerA danger area;
the ray lengths between the ray and all colliders were calculated as follows:
suppose the coordinates of the origin of a ray in space are A (x, y, z) and the coordinates of the center of the sphere of the spherical collision volume are O (x)0,y0,z0) And R represents the radius of the Sphere, the triggering area of the Ray-Sphere collision is as follows:
L=((x,y,z)|(x-x0)2+(y-y0)2+(z-z0)2≤R2the formula (1) is that a, B and c are respectively the length, width and height of a box collision body, any point B (x, y and z) in the space is taken as a ray origin, and the barycentric coordinate of the box body is O (x)0,y0,z0) Then the triggering area of the Ray-Box collision is:
Figure BDA0001837706370000031
if the coordinates of any point on the ray satisfy the constraint conditions L (x, y, z) in the formulas (1) and (2), the ray can be judged to intersect with the collision body, and the length of the ray is determined to be the distance D between the devices by calculating the distance from the starting point of the ray to the intersection point.
The collision detection module is used for emitting virtual rays between devices, and the emitted rays have two conditions: (1) transmitting a Ray along any vector direction at a certain Point, which can be realized by Physics. Raycast static function, (2) transmitting the Ray To a certain fixed Point on a screen, which can be realized by two API functions of Screen Point To Ray or Viewport Point To Ray; these virtual rays resemble an invisible reflected straight line and the device hitting the first collider stops firing and feeds back the detected collision information.
The specific detection process is as follows:
the first step is as follows: adding rigid bodies and collision bodies to all equipment models capable of colliding in a virtual scene, and setting an early warning distance threshold D between each group of rigid bodies easy to collide according to the working condition requirementmax,Dmin
The second step is that: when the fully mechanized mining equipment starts to move, the collision is detectedThe measurement module emits virtual rays between devices, the operation interface displays collision information (collision object and collision distance D) between devices in a GUI window, and meanwhile, the system starts to judge D and Dmax,DminThe positional relationship between:
when D > DmanWhen the distance between the devices is in a safe area, the GUI window does not appear;
when D is presentmax>D>DminWhen the distance D between the devices enters an early warning area, the early warning detection module gives an alarm, the operation interface displays collision information between the devices through a GUI window, an operator is reminded that the devices are about to collide, and the motion state of each device needs to be adjusted through manual intervention, so that the devices are in reasonable positions;
when D is less than DminWhen the distance D between the devices enters a dangerous area, the early warning detection module gives an alarm, the operation interface displays the distance D between the devices through a GUI window, collision detection is needed at the moment, if collision occurs between the devices, the system adopts emergency braking, if collision does not occur, the virtual operation platform reads detection data of various sensors installed on the devices through the database at the moment, the motion poses of the three-computer devices are calculated, the motion states of the devices are adjusted according to the calculation results, the devices are located at reasonable positions, and automatic obstacle avoidance of the fully mechanized mining devices is achieved.
The invention has the beneficial effects that:
aiming at the problem that the collision between the devices cannot be accurately judged by the coal mine fully-mechanized working face virtual simulation and remote control system under the working condition, the collision detection and early warning monitoring of the three devices of the fully-mechanized working face are carried out in real time by transmitting virtual rays on a virtual interaction platform by utilizing the virtual ray detection technology and the sensor detection technology, so that the normal operation of the three devices is ensured. The method can also be popularized and applied to collision detection of other remote control systems.
Drawings
Fig. 1 is a flow chart of the collision warning detection operation of the present invention.
FIG. 2 is a diagram of a virtual simulation scenario of the present invention.
Fig. 3 is a collision detection schematic of the present invention.
Fig. 4 is a collision detection diagram of the present invention.
Fig. 5 is an early warning detection diagram of the present invention.
Detailed Description
As shown in fig. 1, the VR-based colliery fully mechanized mining equipment collision detection and early warning method is characterized in that: the system is provided based on the virtual simulation and remote control system of the coal mine fully mechanized coal mining face, and mainly comprises a virtual simulation and remote monitoring platform, a remote control platform, a data communication module and lower computer hardware. The virtual simulation platform is used for simulating the environment of the fully mechanized coal mining face and the motion state of the three-machine equipment, and the collision detection early warning function of the three-machine equipment is realized through a virtual ray detection technology on the platform.
In a virtual environment, rigid body components and collision components must be added to the target object to produce the collision effect. Rigid body components are added to the target object, so that physical interaction of the target object in a scene can be realized.
And secondly, adding a collision early warning detection module of three-machine equipment for the system, wherein the collision early warning detection module mainly comprises an early warning detection module and a collision detection module. After the system starts virtual ray detection, the collision detection module can detect the distance between each group of collision bodies, and when the distance between the devices is detected to be in an abnormal state, the early warning detection module is started to remind an operator to take corresponding collision avoidance measures.
The early warning detection is the key for guaranteeing the normal operation of the automatic coal mining process, and when the distance D between the devices is smaller than a certain threshold value, the early warning detection module can give an alarm to remind an operator to take corresponding measures. According to the working condition safety requirement, two distance threshold values D are setmax,DminThe distance D between the devices is divided into three regions: and the safety region, the early warning region and the dangerous region judge the relative position of the devices according to the system prompt, so that the early warning detection of the system is realized.
The collision detection module is realized by transmitting virtual rays between devices, and when the rays are transmitted, two conditions are usually adopted, (1) one Ray is transmitted at a certain Point along any vector direction and can be realized by a Physics. Raycast static function, and (2) the rays are transmitted To a certain fixed Point on a Screen and can be realized by two API functions, namely Screen Point To Ray or Viewport Point To Ray; these virtual rays resemble an invisible reflected straight line and the device hitting the first collider stops firing and feeds back the detected collision information. The implementation of the ray detection may be selected according to the actual requirements of the target object.
The method monitors the relative distance between the three devices in the working process, and the specific collision early warning detection process comprises the following steps:
the first step is as follows: adding rigid bodies and collision bodies to a model capable of colliding in virtual equipment and environment, and setting a distance threshold D between each group of rigid bodies easy to collide according to working condition requirementsmax,Dmin
The second step is that: when the fully mechanized mining equipment starts to move, ray detection is started, the distance D between GUI window display equipment appears on an operation interface, and meanwhile, the system starts to judge D and Dmax,DminThe positional relationship between:
when D > DmaxWhen the distance D between the devices is in a safe area, a GUI window does not appear; when D is presentmax>D>DminWhen the distance D between the devices is in the early warning area, the early warning detection module can send out an alarm to prompt an operator to collide, and the motion state of each device needs to be adjusted through manual intervention, so that the devices are in reasonable positions;
when D is less than DminAnd if the collision does not occur, the pose of a collision object needs to be calculated, and the motion state of each device is adjusted according to the calculation result, so that the devices are in reasonable relative positions, and the automatic obstacle avoidance of the fully mechanized mining device is realized.
As shown in fig. 2, in a Unity3D virtual interaction platform, the building of a virtual scene of a fully mechanized mining face in a well and the modeling, rendering and assembling of a virtual three-machine device are completed. In a virtual environment, rigid body components and collision components are added to a target object, so that physical interaction of the object in a scene can be realized. A collision volume is a type of physical component that is added to the target device along with a rigid body to trigger a collision.
As shown in fig. 3, the system adopts a box-shaped collision body to ensure real-time performance and accuracy of collision detection between three machines of equipment, and is a virtual ray collision detection schematic diagram of three machines of equipment on a fully mechanized mining face, wherein a cube surrounding the equipment is a collision body added for different parts of the equipment, and a dotted line represents a virtual ray for detecting a distance between the equipment.
As shown in fig. 4, during the normal movement process of the coal mining machine and the hydraulic support, the virtual environment is detected by virtual rays in real time, and when the equipment is in a safe distance, the rays are dotted lines to show that the movement process is normal.
As shown in fig. 5, when the rocker arm rises to the initially determined early warning area, the roller and the mutual upper may collide, and the virtual ray immediately appears as a dotted line to prompt the operator to adopt corresponding manual control.
It should be emphasized that the embodiments described herein are illustrative rather than restrictive, and thus the present invention is not limited to the embodiments described in the detailed description, and that other embodiments may occur to those skilled in the art based on the teachings herein.

Claims (4)

1. A colliery fully-mechanized mining equipment collision detection and early warning method based on VR is provided based on a colliery fully-mechanized mining working face virtual simulation and remote control system, the system mainly comprises a virtual simulation and remote monitoring platform, a remote control platform, a data communication module and lower computer hardware, wherein the virtual simulation and remote monitoring platform is used for simulating the fully-mechanized mining working face environment and the motion state of three machines of equipment, the platform is constructed based on Unity3D development software for modeling, rendering, assembling and other operations, and is characterized in that the platform is constructed by transmitting rays through a collision detection module to collide with all equipment added with collision bodies in a virtual scene and returning collision information, the detected distance D between the equipment is compared with a distance threshold preset by the system by calculating the ray length between the rays and all the collision bodies as the distance D between the equipment, when the distance D between the devices is smaller than a certain threshold value, the early warning detection module gives an alarm to remind an operator to take corresponding measures, and the relative position between the devices is judged according to the system prompt, so that the purpose of early warning detection is realized;
setting two distance thresholds D according to working condition safety requirementsmax,DminThe distance D between the devices is divided into three regions: a safe area, an early warning area and a dangerous area.
2. The VR-based colliery fully mechanized mining device collision detection and early warning method of claim 1, wherein: the ray lengths between the ray and all colliders were calculated as follows:
suppose the coordinates of the origin of a ray in space are A (x, y, z) and the coordinates of the center of the sphere of the spherical collision volume are O (x)0,y0,z0) And R represents the radius of the Sphere, the triggering area of the Ray-Sphere collision is as follows:
L={(x,y,z)|(x-x0)2+(y-y0)2+(z-z0)2≤R2the formula (1) is that a, B and c are respectively the length, width and height of a box collision body, any point B (x, y and z) in the space is taken as a ray origin, and the barycentric coordinate of the box body is O (x)0,y0,z0) Then the triggering area of the Ray-Box collision is:
Figure FDA0001837706360000021
if the coordinates of any point on the ray satisfy the constraint conditions L (x, y, z) in the formulas (1) and (2), the ray can be judged to intersect with the collision body, and the length of the ray is determined to be the distance D between the devices by calculating the distance from the starting point of the ray to the intersection point.
3. The VR-based colliery fully mechanized mining device collision detection and early warning method of claim 1, wherein: the collision detection module is used for emitting virtual rays between devices, and the emitted rays have two conditions: (1) transmitting a Ray along any vector direction at a certain Point, which can be realized by Physics. Raycast static function, (2) transmitting the Ray To a certain fixed Point on a Screen, which can be realized by two API functions of Screen Point To Ray or Viewport Point To Ray; these virtual rays resemble an invisible reflected straight line and the device hitting the first collider stops firing and feeds back the detected collision information.
4. The VR-based colliery fully mechanized mining device collision detection and early warning method of claim 1, wherein: the specific detection process is as follows:
the first step is as follows: adding rigid bodies and collision bodies to all equipment models capable of colliding in a virtual scene, and setting an early warning distance threshold D between each group of rigid bodies easy to collide according to the working condition requirementmax,Dmin
The second step is that: when the fully mechanized mining equipment starts to move, the collision detection module emits virtual rays between the equipment, the collision information between GUI window display equipment appears on an operation interface, and meanwhile, the system starts to judge D and Dmax,DminThe positional relationship between:
when D > DmaxWhen the distance between the devices is in a safe area, the GUI window does not appear;
when D is presentmax>D>DminWhen the distance D between the devices enters the early warning area, the early warning detection module gives an alarm, the operation interface displays collision information between the devices through a GUI window, an operator is reminded that the devices are about to collide, and the motion state of each device needs to be adjusted, so that the devices are in reasonable positions;
when D is less than DminWhen the distance D between the devices enters a dangerous area, the early warning detection module gives an alarm, the operation interface displays collision information between the devices through a GUI window, collision detection is needed at the moment, and if collision occurs between the devices, the system adopts emergency braking; if the collision does not occur, the virtual operating platform reads the detection data of various sensors installed on the equipment through the database,and calculating the motion poses of the three computer devices, and adjusting the motion state of each device according to the calculation result so as to enable the devices to be in reasonable positions.
CN201811233674.0A 2018-10-23 2018-10-23 VR-based colliery fully mechanized mining equipment collision detection and early warning method Active CN109236298B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811233674.0A CN109236298B (en) 2018-10-23 2018-10-23 VR-based colliery fully mechanized mining equipment collision detection and early warning method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811233674.0A CN109236298B (en) 2018-10-23 2018-10-23 VR-based colliery fully mechanized mining equipment collision detection and early warning method

Publications (2)

Publication Number Publication Date
CN109236298A CN109236298A (en) 2019-01-18
CN109236298B true CN109236298B (en) 2020-04-28

Family

ID=65081149

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811233674.0A Active CN109236298B (en) 2018-10-23 2018-10-23 VR-based colliery fully mechanized mining equipment collision detection and early warning method

Country Status (1)

Country Link
CN (1) CN109236298B (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111383253B (en) * 2020-03-03 2020-12-15 清华大学 Striking accident early warning system for construction site hoisting machinery
CN113781655B (en) * 2020-06-09 2024-06-07 国网新疆电力有限公司建设分公司 Virtual reality simulation construction method, device, equipment and storage medium
CN111921202B (en) * 2020-09-16 2021-01-08 成都完美天智游科技有限公司 Data processing method, device and equipment for virtual scene and readable storage medium
CN112230597B (en) * 2020-10-16 2022-06-07 兖矿能源集团股份有限公司 Coal mine mining machine operation skill training system and method
CN112327739B (en) * 2020-10-16 2022-06-14 兖矿能源集团股份有限公司 Method and system for training operational skills of fully-mechanized excavating machine
CN114495585B (en) * 2020-11-11 2024-05-28 郑州畅想高科股份有限公司 VR simulation training method for maintenance between machines
CN112632686B (en) * 2020-12-30 2022-07-22 天津大学 Early warning method for collision in offshore pile sinking construction process
CN113586156A (en) * 2021-09-01 2021-11-02 四川川煤华荣能源有限责任公司大宝顶煤矿 Control center for intelligent coal mining
CN114545877B (en) * 2022-02-08 2024-04-05 燕山大学 Multi-working-procedure mechanical digital twin on-line monitoring system and method for bulk cargo
CN114648418A (en) * 2022-02-23 2022-06-21 煤炭科学技术研究院有限公司 Underground goaf safety grading early warning monitoring method and system

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101352854B (en) * 2008-07-17 2011-01-26 上海交通大学 Remote operation planar redundant manipulator automated guided intelligent element, system and method
DE102011017439A1 (en) * 2010-07-30 2012-02-23 Tiefenbach Control Systems Gmbh Safety device at mobile mining equipment in a longwall of underground mining
CN102759909A (en) * 2012-06-14 2012-10-31 中国矿业大学 Work state virtual simulation system for electric haulage shearer based on different geological conditions
CN105096660B (en) * 2015-09-09 2017-08-29 河海大学常州校区 A kind of safety of ship method for early warning detected based on crash classification
CN106869929B (en) * 2017-01-20 2018-09-14 中国矿业大学 Hydraulic support based on image and winning machine cutting part interference protection system and method

Also Published As

Publication number Publication date
CN109236298A (en) 2019-01-18

Similar Documents

Publication Publication Date Title
CN109236298B (en) VR-based colliery fully mechanized mining equipment collision detection and early warning method
US10970859B2 (en) Monitoring method and device for mobile target, monitoring system and mobile robot
CN104932502B (en) Short distance barrier-avoiding method based on three dimensional depth video camera and short distance obstacle avoidance system
CN111263921B (en) Collision detection system and computer-implemented method
CN113370911B (en) Pose adjustment method, device, equipment and medium of vehicle-mounted sensor
US10382673B2 (en) Automated guide for image capturing for 3D model creation
TW201539385A (en) Intrusion detection with directional sensing
CN109972674B (en) Unmanned excavation system and method under complex construction environment based on natural interaction
US11773567B2 (en) Engineering machinery equipment, and method, system, and storage medium for safety control thereof
CN105031868B (en) Adaptive extinguishing method based on flame scale
CN112066994B (en) Local autonomous navigation method and system for fire-fighting robot
CN108789500A (en) Man-machine safety guard system and safety protecting method
KR20220026422A (en) Apparatus and method for calibrating camera
CN111177869A (en) Method, device and equipment for determining sensor layout scheme
CN112184914A (en) Method and device for determining three-dimensional position of target object and road side equipment
CN113914407A (en) Excavator excavation tunnel accurate control system based on BIM and machine vision
CN114911221B (en) Robot control method and device and robot
CN114445494A (en) Image acquisition and processing method, image acquisition device and robot
KR101289385B1 (en) Frontal/vertical dual camera based motion detection log data processing system for interactive user-participating contents service
Soetedjo et al. Raspberry Pi based laser spot detection
CN113199484B (en) Robot safe operation method, equipment and storage medium
CN117940650A (en) Method and control node for controlling a mining drilling machine
KR20130067796A (en) Unmanned vehicle remote control apparatus and method using virtual world
CN115345911A (en) Method, device, equipment and medium for early warning collision of aircraft during warehousing and ex-warehouse
CN113888715B (en) Blast furnace burden surface three-dimensional reconstruction method and system based on virtual multi-view endoscope

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant