CN112419799B - Intelligent perception virtual-real interaction practical training system and method for assembled building - Google Patents

Intelligent perception virtual-real interaction practical training system and method for assembled building Download PDF

Info

Publication number
CN112419799B
CN112419799B CN202011567304.8A CN202011567304A CN112419799B CN 112419799 B CN112419799 B CN 112419799B CN 202011567304 A CN202011567304 A CN 202011567304A CN 112419799 B CN112419799 B CN 112419799B
Authority
CN
China
Prior art keywords
training
real
practical training
special
building
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011567304.8A
Other languages
Chinese (zh)
Other versions
CN112419799A (en
Inventor
李帅
王光炎
许林林
石高峰
李昌辉
彭森茂
袁泉
张正
李豪
孙延德
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong Yingxian Information Technology Co ltd
Original Assignee
Shandong Yingxian Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong Yingxian Information Technology Co ltd filed Critical Shandong Yingxian Information Technology Co ltd
Priority to CN202011567304.8A priority Critical patent/CN112419799B/en
Publication of CN112419799A publication Critical patent/CN112419799A/en
Application granted granted Critical
Publication of CN112419799B publication Critical patent/CN112419799B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00—Electrically-operated educational appliances
    • G09B5/02—Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01D—MEASURING NOT SPECIALLY ADAPTED FOR A SPECIFIC VARIABLE; ARRANGEMENTS FOR MEASURING TWO OR MORE VARIABLES NOT COVERED IN A SINGLE OTHER SUBCLASS; TARIFF METERING APPARATUS; MEASURING OR TESTING NOT OTHERWISE PROVIDED FOR
    • G01D21/00—Measuring or testing not otherwise provided for
    • G01D21/02—Measuring two or more variables by means not covered by a single other subclass
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K17/00—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations
    • G06K17/0022—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisious for transferring data to distant stations, e.g. from a sensing device
    • G06K17/0029—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisious for transferring data to distant stations, e.g. from a sensing device the arrangement being specially adapted for wireless interrogation of grouped or bundled articles tagged with wireless record carriers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/10—Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Geometry (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Architecture (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention discloses an intelligent perception virtual-real interaction training system and method for an assembled building, which are used for the field of talent culture of the assembled building profession. The system comprises an assembly type building practical training special component, a tool, practical training special hoisting equipment, a sensing detection module, a virtual reality communication module and a three-dimensional digital virtual reality system. Based on a digital twin concept, by means of a UNITY 3D platform, physical entity scenes of the assembly type building construction training are realized by means of Internet technology, big data, cloud service and the like, real-time synchronous mapping and interaction are realized with a three-dimensional digital virtual scene, real-time synchronous intelligent perception, detection and feedback are realized in a real-time synchronous manner in a real-time training process, teaching, real training and evaluation are integrated, and real training participants synchronously perform theoretical learning and practice in the virtual and real scenes, so that the intelligent, low-cost, risk-free, economical and efficient complete teaching, real training and evaluation are realized.

Description

Intelligent perception virtual-real interaction practical training system and method for assembled building
Technical Field
The invention relates to an intelligent perception virtual-real interaction practical training system for an assembled building, in particular to an intelligent perception virtual-real interaction practical training system for an assembled building and a method thereof.
Background
Compared with the traditional building production organization mode, the assembled building has the advantages that firstly, the cast-in-place operation is greatly reduced, a large number of building component parts are produced by workshops, the labor force is saved, and the engineering progress is less influenced by weather; secondly, adopting building and decoration integrated design and construction; thirdly, the standardization of the design and informatization of the management are realized, the production efficiency is high, and the cost is low; and fourthly, the method meets the requirements of green buildings, has low resource consumption, and is energy-saving and environment-friendly. The development of the fabricated building is a deep revolution in building history, the fabricated building provides higher standards for building construction technology under new situation, the fabricated building is developed greatly, and firstly, the culture of talents of the fabricated building construction profession is enlarged, so that the conversion from peasant industry to industrial workers is realized.
At present, two training modes exist for training the existing assembled building construction professional talents of universities and training institutions in China, one mode is to build an assembled building real site, and real components and tools are adopted. The weight of the component parts is large, potential practical training safety hazards are stored, the operation difficulty of practical training students is large, and the utilization rate of a practical training site is low; when a part of students participate in practical training, other students can only wait, the combination of theoretical learning and practice is not tight, and the practical training efficiency is low; the difficulty of evaluating by teachers is high, whether practical training students really work according to standards or not, the teachers cannot evaluate comprehensively, carefully and accurately, and the practical training is defect in whole and poor in effect. The other is a pure virtual environment training system. The practical training students can learn in a complete virtual environment, cannot actually operate and can only cognize inductively, so that the practical capability is limited, the complex construction technology and the key required in construction cannot be completely mastered, the direct practical construction operation cannot be realized, and the aims of learning and practical training cannot be completely achieved. The two practical training modes have serious defects and drawbacks in aspects of interactivity, practicality, intellectualization, comprehensiveness, high efficiency and the like, and cannot adapt to and meet the requirements of the assembled building on high-level professional talents.
Disclosure of Invention
The invention aims to overcome the defects and drawbacks of the practical training mode of the fabricated building, provides the intelligent perception practical training system and method for the virtual-real interaction of the fabricated building, and based on the digital twin concept, the physical entity scene of the practical training of the fabricated building is realized by comprehensively utilizing intelligent means such as the Internet of things technology, the Internet technology, big data and cloud service and the like based on the UNITY 3D platform, the real-time mapping and interaction with the three-dimensional digital virtual scene, the virtual-real integration interaction and the convergence of abundant fabricated building teaching resources are realized, so that practical training participants can intelligently and interactively perform theoretical learning and practical activities in the virtual scene and the real scene, and the purposes of teaching, practical training and evaluation are realized intelligently, low-cost and risk-free economically and efficiently.
In order to achieve the above purpose, the present invention adopts the following technical scheme:
1. the utility model provides an intelligent perception virtual reality of assembled building is mutual practical training system which characterized in that includes:
(1) Physical entity scene R:
(1) special component A of real standard of assembled building: the device is a set of various components commonly used in the field of assembly type buildings, is made of light-weight high-strength materials, is designed into a hollow structure and is used for carrying out assembly type building construction operation and practical training in a physical entity scene, and various sensing detection devices are arranged in various components;
(2) Practical training special hoisting equipment B: the method comprises the steps of manufacturing a lightweight high-strength material, and internally arranging various sensing detection devices, wherein the sensing detection devices are used for lifting the special component A for the fabricated building practical training from a placement area to an assembly area, and participating in the assembly work of the special component A for the fabricated building practical training in the assembly area;
(3) practical training special tool C: refers to a collection of various tools commonly used in assembled building construction, including a flat shovel, a blower, a wire brush, a hammer, a chisel, a tape measure, an ink duct, a steel bar positioning plate, a steel bar spanner, a level gauge, a guiding ruler, a sealing strip, a traction rope and the like, which are specially customized according to the system requirement and used for the construction operation in practical training, and various tools are internally provided with sensing detection equipment;
(4) sensing detection module D: the real-time sensing and detecting system comprises a real-time sensing and detecting system, a real-time communication module E, a real-time monitoring and detecting system and a real-time monitoring and detecting system, wherein the real-time sensing and detecting system consists of a real-time special component A, a real-time special lifting device B and sensing and detecting equipment which are arranged in an assembled building, and all sensing and detecting equipment which are arranged in the real-time special component A, the real-time lifting device B and the real-time tool C for the assembled building, and is used for synchronously sensing, detecting and judging the states of the distance, displacement, action and the like of the real-time special component A, the real-time lifting device B and the real-time tool C for the assembled building, forming dynamic data and sending the dynamic data to the virtual reality communication module E in real time;
(5) Virtual reality communication module E: the system is used for realizing data processing and transmission between the sensing detection module D and the three-dimensional digital virtual reality system F, and is divided into two parts, namely, intranet communication, an intranet server (W) is built, and the intranet server is respectively connected with a host (M) of the three-dimensional digital virtual reality system F, the sensing detection module D and an extranet interface device, so that the data processing and transmission of the whole system are realized in a wireless transmission mode; the second is that the external network communicates, the intranet server is connected to the cloud service (Y) of the Internet through the interface equipment of the external network, form the external network environment, but PC end and mobile terminal visit the intranet through the Internet, can use, manage, maintain and monitor the intelligent perception virtual reality of the assembled building and exchange the training system in fact remotely;
(6) physical entity scene R layout case: the method comprises the steps of arranging a placement area, an assembly area and an accessory area, orderly arranging an assembly type building practical training special component A in the placement area, building an assembly type building foundation in the assembly area, arranging practical training special hoisting equipment B in the assembly area, arranging practical training special tools C in the accessory area, displaying a large screen S of a virtual scene V, personal protection articles and the like;
(2) Virtual scene V:
(1) three-dimensional digital virtual reality system F: the intelligent training system comprises two large plates, namely, an intelligent training system software G of the assembled building, which sequentially performs class selection, role distribution, component selection, cognitive learning and safe bottoming through login software, and then performs actual assembled building construction training in a physical entity scene R, in the practical training process, the intelligent training system software G of the assembled building and the physical entity scene R synchronously interact in real time, a teaching video aiming at the current construction process and real-time popup window prompting safety information are played, and a virtual-real interaction scene H is displayed, based on UNITY 3D platform design, a 3D model is built for all elements in the physical entity scene R such as an assembled building practical special component A, a practical training special hoisting device B, a practical training special tool C and the like, and a virtual model of all elements in the physical entity scene R such as an assembled building practical training special component model VA, a practical training special hoisting device model VB, a practical training special tool model VC and the like is presented in the virtual-real interaction scene H, so that the physical entity scene H is mapped;
(2) The method comprises the steps that interfaces of an intelligent training system software G of an assembled building and a virtual-real interaction scene H are respectively displayed in left and right areas of a field large screen S, a three-dimensional digital virtual reality system F obtains state information of an assembly type building training special component A, a training special hoisting device B and a training special tool C according to data sent by a virtual reality communication module E, and captures state information such as distance, displacement and action of the physical component parts in a physical entity scene R, so that an assembly type building training special component model VA, a training special hoisting device model VB and a training special tool model VC in the virtual-real interaction scene H can dynamically map and simulate state changes of elements in the physical entity scene R in real time, and digital twinning is achieved.
Further, the sensing detection module D in the physical entity scene R comprises a gyroscope (CG 1), an inclination angle sensor (CG 2), an ultrasonic ranging sensor (CG 3), a laser ranging sensor (CG 4), an RFID tag (CG 5) and an infrared proximity sensor (CG 6);
(1) gyroscope (CG 1): the real-time dynamic angle data of the three axes of the special component A for the fabricated building training in the X, Y, Z direction are sensed, detected and generated, and the real-time dynamic angle data generated by the inclination angle sensor (CG 2) are calculated and averaged to ensure the accuracy of the angle dynamic data for real-time interactive use of the three-dimensional digital virtual reality system F;
(2) Inclination sensor (CG 2): the angle dynamic data of the special component A for the fabricated building training is perceived, detected and generated, and the angle dynamic data generated by the gyroscope (CG 1) is calculated and averaged to ensure the accuracy of the angle dynamic data for real-time interactive use of the three-dimensional digital virtual reality system F;
(3) ultrasonic ranging sensor (CG 3): the device is positioned at the bottom of the special component A for the fabricated building practical training and is used for sensing, detecting, monitoring and generating the height dynamic data of the special component A for the fabricated building practical training for the use of the three-dimensional digital virtual reality system F;
(4) laser ranging sensor (CG 4): firstly, the device is arranged on the top of the practical training special lifting equipment B, a certain fixed wall body is used as a reference object, the whole moving distance of the practical training special lifting equipment B is measured and calculated through laser reflection, and displacement dynamic data of the practical training special lifting equipment B are generated, secondly, the device is arranged on an electric hoist of the practical training special lifting equipment B, laser of the device irradiates to a lifting column at one side, and the moving distance of the electric hoist is judged through laser reflection, so that the displacement dynamic data of the electric hoist are generated; the two groups of displacement dynamic data reflect the real-time movement condition of the practical training special hoisting equipment B in the transverse direction and the longitudinal direction;
(5) RFID tag (CG 5): the three-dimensional digital virtual reality system is arranged in the practical training special tool C, is matched with the RFID tag identification antenna for use, and is used for detecting, sensing and judging the condition that a practical training person uses the practical training special tool C and what operation is carried out at what part of a component, generating corresponding dynamic data for real-time interactive use by the three-dimensional digital virtual reality system F, wherein four paths of RFID tag identification antennas are arranged in the practical training special component A of the fabricated building, two paths of RFID tag identification antennas are positioned at the left side and the right side of the vertical height 50CM of the practical training special component A of the fabricated building, one path of RFID tag identification antennas is positioned at the bottom of the practical training special component A of the fabricated building, and the other path of RFID tag identification antennas is positioned at the middle part of the practical training special component A of the fabricated building;
(6) infrared proximity sensor (CG 6): the device is respectively arranged at the bottom of the special component A for the fabricated building practical training, the inside of the hanging point bolt, the position of the traction rope bolt, the position of the supporting rod bolt and the like, can sense, detect and judge whether the special component A for the fabricated building practical training is positioned on a base of a placement area of a physical entity scene R or is separated from the base, can sense, detect and judge whether each bolt is placed and screwed down, and whether a sleeve at the bottom of the special component A for the fabricated building practical training is opposite to a hole with embedded steel bars, and the generated dynamic data are used by a three-dimensional digital virtual reality system F to be mapped and interacted in a virtual-real interaction scene H.
The intelligent perception virtual-real interaction training method for the fabricated building, which corresponds to the system, comprises the following steps of:
(1) Initializing a system: logging in the intelligent training system G software of the assembled building, selecting a member to be trained in a list, selecting a special training member A of the assembled building corresponding to the selected member in a placement area in a physical entity scene R, checking the special training member A of the assembled building according to data fed back by a sensing detection module D at the end of the intelligent training system G of the assembled building, checking whether abnormal sensing detection equipment exists or not and the like, and performing the next training operation in the physical entity scene R after a training person correctly wears protective articles;
(2) Cleaning, paying off, correcting and adjusting elevation of the steel bars and pasting sealing strips: in the physical entity scene R placement area, a practical trainer sequentially carries out working procedures such as cleaning, paying-off, reinforcing steel bar correction, sealing strip pasting and the like on a selected practical training special component A of the fabricated building, in the physical entity scene R assembly area, the practical trainer carries out working procedures such as basic adjustment elevation, cleaning bonding surface, sealing strip pasting and the like on the fabricated building, tools such as a flat spade, a blower, a steel wire brush, a hammer, a hair pin, a measuring tape, a reinforcing steel bar locating plate, a reinforcing steel bar spanner and the like in the practical training special tool C can be used, when the practical trainer operates by using a specific practical training special tool C, sensing detection equipment built in the selected practical training special component A and the specific practical training tool C can detect the specific working procedures carried out by the practical trainer at present, the dynamic data detected by sensing is synchronously transmitted to a three-dimensional digital virtual reality system F in real time, the corresponding specific practical training tool model VC in the virtual interaction scene H carries out the same operation process in real time at the corresponding position of the practical training special component model VA, and simultaneously, the practical training special tool C carries out the intelligent training window synchronous operation and the intelligent training system is triggered by the sensing detection equipment, and the intelligent training module is driven by the sensing detection equipment to carry out the real-time safety and the safety instruction, and the safety instruction are carried out the working procedures;
(3) Couple and set up haulage rope: when a practical trainer installs a hanging point bolt of an assembled building practical training special component A and sets a traction rope, a sensing detection module D can sense the installation condition of the bolt in real time, dynamic data is sent to a three-dimensional digital virtual reality system F through a virtual reality communication module E, the hanging point on an assembled building practical training special component model VA and the bolt for hanging the traction rope in a virtual-real interaction scene H can synchronously map the operation process of the practical trainer in real time, the bolt model also performs corresponding screwing-in actions, meanwhile, assembled building intelligent practical training system software G synchronously and circularly plays teaching videos of the installation bolt in real time, and simultaneously pops up a safety prompt information window to remind safety matters which are needed to be paid by working procedures in the process, and the sensing detection equipment can sense whether the bolt is fastened and in place or not and issue early warning information in real time;
(4) Lifting and horizontal movement: the method comprises the steps that a hook of a practical training special hoisting device B is hooked into a hoisting point bolt of an assembled building practical training special component A, the component is vertically hoisted to a position of 50CM, the component is determined to continue hoisting to a height of more than 1M without errors, then the component is horizontally moved to an assembling area of a physical entity scene R, the component reaches the upper part of a basic installation part of an assembled building, aiming at the operation and running process of the stage, a sensing detection module D can sense dynamic data of the height, the height change, the horizontal movement and the moving distance of the assembled building practical training special component A and the practical training special hoisting device B, the dynamic data is transmitted to a three-dimensional digital virtual reality system F in real time through a virtual reality communication module E, a hoisting operation teaching video is synchronously played by assembled building intelligent practical training system G software in a virtual scene V in real time, meanwhile, a safety item is prompted by a popup window, and meanwhile, the assembled building practical training special component model VA and the practical training special hoisting device model VB in the virtual real interaction scene H synchronously run in real time along with the visual angle of the assembled building practical training special component A and the practical training special hoisting device B in the physical entity scene R, and the practical training special real interaction scene H changes along with the actual hoisting view angle;
(5) Guiding component lifting: the special component A for the training of the fabricated building is lifted to the upper part of the basic installation part of the fabricated building to fall, when the distance from the installation part is 1.8M, the sensing detection equipment is triggered for the first time in the step, and the height of the traction rope can be touched by a training person; when the vertical falling is 50CM away from the basic installation position of the assembled building, the second time triggering of the sensing detection equipment in the step is that a practical trainer can hold the height of the guide member, dynamic data generated by triggering the sensing detection equipment twice are sequentially sent to the three-dimensional digital virtual reality system F, the real-time synchronous playing of the component guide operation teaching video of the intelligent training system software G of the assembled building in the corresponding virtual scene V, meanwhile, the popup window prompts attention to safety matters, meanwhile, the real-time synchronous mapping of the assembled building special component model VA and the real training special hoisting equipment model VB in the virtual and real interaction scene H is carried out on the guided real-time operation process of the assembled building special component A and the real training special hoisting equipment B in the physical entity scene R, and the visual angle of the virtual and real interaction scene H is changed along with the actual component;
(6) Viewing the alignment hole and adjusting the position: when a practical trainer walks to guide the assembled building practical training special component A to the height of 20CM at the top of the embedded steel bar, on one hand, the practical trainer utilizes a reflector to observe a pair hole, whether the steel bar and the sleeve are in place or not can be inspected, the position of the component can be adjusted from the side surface of the component by using a crowbar or an S hook, the component slowly descends after no error is determined, on the other hand, the sensing detection equipment senses the actions of observing the pair hole and adjusting the position in real time and sends dynamic data to the three-dimensional digital virtual reality system F, so that the assembled building intelligent practical training system software G synchronously plays teaching videos of the lower working procedure in real time, meanwhile, the practical training special tool model VC in the virtual real interaction scene H synchronously maps the real-time running condition of the practical training special tool C used by the practical trainer in the physical entity scene R in real time, and the whole virtual real interaction scene H visual angle changes along with the physical entity scene R;
(7) Mounting support and component adjustment and position detection: after the embedded steel bars are inserted into the sleeves of the special building training components A, installing an inclined support for the special building training components A, adjusting the inclined support according to the perpendicularity of the components to keep the perpendicularity and the levelness of the components, detecting the perpendicularity and the levelness of the special building training components A by using a guiding ruler of the special building training tools C, fine-adjusting the special building training components A until the perpendicularity and the levelness are kept in the X direction and the Y direction according to the detection condition, installing three links of support, component adjustment and position detection, enabling a sensing detection device to sense and form dynamic data in real time and send the dynamic data to a three-dimensional digital virtual reality system F, playing corresponding teaching videos and popup safety information in real time in a virtual scene V, and synchronously mapping the running process of three operation links in real time, wherein the sensing detection device can sense the levelness and the perpendicularity of the special building training components A in the X direction and the Y direction in real time, and sense the positioning condition of a supporting point bolt in real time, and the real time displaying the dynamic data of the levelness and the verticality on a large S synchronously along with the real interaction scene R, and the real interaction scene R changes along with the real interaction scene;
(8) Support locking, precision retesting and unhooking: the sensing detection equipment can sense whether the upper bolt and the lower bolt of the supporting rod of the special component A for the fabricated building practical training are screwed down, whether the locating pin of the middle adjusting area is fixed, whether the angle of the supporting system is correct, whether the supporting system collides with the adjacent supporting or not and the like, and displays all dynamic data on a large screen S in real time;
(9) And (3) finishing material cleaning and training: and restoring the initial state of the physical entity scene R, disassembling and resetting the assembly type building practical training special component A, practical training special hoisting equipment B, practical training special tool C and other physical component parts, and detecting whether the state of the sensing detection module D is normal or not through the three-dimensional digital virtual reality system F, so that the initialization of the physical entity scene R and the virtual scene V is completed.
Further, when the training person performs training operation in the physical entity scene R, the three-dimensional digital virtual reality system F in the virtual scene V can acquire various dynamic data of the training operation in real time, perform tabulation recording on the data, intelligently and comprehensively analyze the data and form a training result report, so that a teacher can review and evaluate the actual operation level of the training person and grasp the theoretical knowledge, and the goal of concurrent training, teaching and evaluation is achieved.
The invention has the beneficial effects that:
based on a digital twin concept and depending on a UNITY 3D platform, the invention realizes the real-time mapping and interaction of the physical entity scene of the fabricated building construction and the three-dimensional digital virtual scene by comprehensively utilizing intelligent means such as the Internet technology, big data, cloud service and the like, integrates virtual and real interactions, and gathers rich fabricated building teaching resources, so that real training participants can intelligently and interactively perform theoretical learning and practical activities in the virtual scene and the real scene, and the purposes of teaching, real training and evaluation are achieved intelligently, low-cost and risk-free economically and efficiently;
(1) based on the digital twin concept, the invention realizes the virtual-real interactivity and the intellectualization of the practical training process by integrating virtual-real mixable interaction, and integrates practical training, teaching and evaluation;
(2) the invention relies on a UNITY 3D platform to ensure that the change process and state of the three-dimensional digital virtual scene are identical to the change process and state of the physical entity scene and each component part, and the practical trainers and other on-site trainees combine the actual scene with the on-site large-screen teaching video and virtual-real interaction scene, thereby not only realizing the theoretical learning, but also realizing the comprehensive practice and realizing the synchronous, efficient and systematic learning of theoretical linkage reality;
(3) The solid component related by the invention has the advantages of light weight and cavity design, repeated use, no safety risk of practical training and low cost.
Drawings
FIG. 1 is a schematic diagram of the workflow and scenario of the system of the present invention;
fig. 2 is a diagram of the architecture of a sensing detection module D and a virtual reality communication module E in a physical entity scene R of the system of the present invention;
FIG. 3 is a flow chart of the training method of the present invention.
The specific embodiment is as follows:
the invention will be further illustrated with reference to the drawings and the detailed description, which are to be regarded as illustrative in nature and not as restrictive.
As shown in fig. 1 and 2, an intelligent perception virtual-real interaction training system for an assembled building comprises:
(1) Physical entity scene R:
(1) special component A of real standard of assembled building: the device is a set of various components commonly used in the field of assembly type buildings, is made of light-weight high-strength materials, is designed into a hollow structure and is used for carrying out assembly type building construction operation and practical training in a physical entity scene, and various sensing detection devices are arranged in various components;
(2) practical training special hoisting equipment B: the method comprises the steps of manufacturing a lightweight high-strength material, and internally arranging various sensing detection devices, wherein the sensing detection devices are used for lifting the special component A for the fabricated building practical training from a placement area to an assembly area, and participating in the assembly work of the special component A for the fabricated building practical training in the assembly area;
(3) Practical training special tool C: refers to a collection of various tools commonly used in assembled building construction, including a flat shovel, a blower, a wire brush, a hammer, a chisel, a tape measure, an ink duct, a steel bar positioning plate, a steel bar spanner, a level gauge, a guiding ruler, a sealing strip, a traction rope and the like, which are specially customized according to the system requirement and used for the construction operation in practical training, and various tools are internally provided with sensing detection equipment;
(4) sensing detection module D: the real-time sensing and detecting system comprises a real-time sensing and detecting system, a real-time communication module E, a real-time monitoring and detecting system and a real-time monitoring and detecting system, wherein the real-time sensing and detecting system consists of a real-time special component A, a real-time special lifting device B and sensing and detecting equipment which are arranged in an assembled building, and all sensing and detecting equipment which are arranged in the real-time special component A, the real-time lifting device B and the real-time tool C for the assembled building, and is used for synchronously sensing, detecting and judging the states of the distance, displacement, action and the like of the real-time special component A, the real-time lifting device B and the real-time tool C for the assembled building, forming dynamic data and sending the dynamic data to the virtual reality communication module E in real time;
(5) virtual reality communication module E: the system is used for realizing data processing and transmission between the sensing detection module D and the three-dimensional digital virtual reality system F, and is divided into two parts, namely, intranet communication, an intranet server (W) is built, and the intranet server is respectively connected with a host (M) of the three-dimensional digital virtual reality system F, the sensing detection module D and an extranet interface device, so that the data processing and transmission of the whole system are realized in a wireless transmission mode; the second is that the external network communicates, the intranet server is connected to the cloud service (Y) of the Internet through the interface equipment of the external network, form the external network environment, but PC end and mobile terminal visit the intranet through the Internet, can use, manage, maintain and monitor the intelligent perception virtual reality of the assembled building and exchange the training system in fact remotely;
(6) Physical entity scene R layout case: the method comprises the steps of arranging a placement area, an assembly area and an accessory area, orderly arranging an assembly type building practical training special component A in the placement area, building an assembly type building foundation in the assembly area, arranging practical training special hoisting equipment B in the assembly area, arranging practical training special tools C in the accessory area, displaying a large screen S of a virtual scene V, personal protection articles and the like;
(2) Virtual scene V:
(1) three-dimensional digital virtual reality system F: the intelligent training system comprises two large plates, namely, an intelligent training system software G of the assembled building, which sequentially performs class selection, role distribution, component selection, cognitive learning and safe bottoming through login software, and then performs actual assembled building construction training in a physical entity scene R, in the practical training process, the intelligent training system software G of the assembled building and the physical entity scene R synchronously interact in real time, a teaching video aiming at the current construction process and real-time popup window prompting safety information are played, and a virtual-real interaction scene H is displayed, based on UNITY 3D platform design, a 3D model is built for all elements in the physical entity scene R such as an assembled building practical special component A, a practical training special hoisting device B, a practical training special tool C and the like, and a virtual model of all elements in the physical entity scene R such as an assembled building practical training special component model VA, a practical training special hoisting device model VB, a practical training special tool model VC and the like is presented in the virtual-real interaction scene H, so that the physical entity scene H is mapped;
(2) The method comprises the steps that interfaces of an intelligent training system software G of an assembled building and a virtual-real interaction scene H are respectively displayed in left and right areas of a field large screen S, a three-dimensional digital virtual reality system F obtains state information of an assembly type building training special component A, a training special hoisting device B and a training special tool C according to data sent by a virtual reality communication module E, and captures state information such as distance, displacement and action of the physical component parts in a physical entity scene R, so that an assembly type building training special component model VA, a training special hoisting device model VB and a training special tool model VC in the virtual-real interaction scene H can dynamically map and simulate state changes of elements in the physical entity scene R in real time, and digital twinning is achieved.
As shown in fig. 2, a sensing detection module D in a physical entity scene R includes a gyroscope (CG 1), an inclination sensor (CG 2), an ultrasonic ranging sensor (CG 3), a laser ranging sensor (CG 4), an RFID tag (CG 5), and an infrared proximity sensor (CG 6);
(1) gyroscope (CG 1): the real-time dynamic angle data of the three axes of the special component A for the fabricated building training in the X, Y, Z direction are sensed, detected and generated, and the real-time dynamic angle data generated by the inclination angle sensor (CG 2) are calculated and averaged to ensure the accuracy of the angle dynamic data for real-time interactive use of the three-dimensional digital virtual reality system F;
(2) Inclination sensor (CG 2): the angle dynamic data of the special component A for the fabricated building training is perceived, detected and generated, and the angle dynamic data generated by the gyroscope (CG 1) is calculated and averaged to ensure the accuracy of the angle dynamic data for real-time interactive use of the three-dimensional digital virtual reality system F;
(3) ultrasonic ranging sensor (CG 3): the device is positioned at the bottom of the special component A for the fabricated building practical training and is used for sensing, detecting, monitoring and generating the height dynamic data of the special component A for the fabricated building practical training for the use of the three-dimensional digital virtual reality system F;
(4) laser ranging sensor (CG 4): firstly, the device is arranged on the top of the practical training special lifting equipment B, a certain fixed wall body is used as a reference object, the whole moving distance of the practical training special lifting equipment B is measured and calculated through laser reflection, and displacement dynamic data of the practical training special lifting equipment B are generated, secondly, the device is arranged on an electric hoist of the practical training special lifting equipment B, laser of the device irradiates to a lifting column at one side, and the moving distance of the electric hoist is judged through laser reflection, so that the displacement dynamic data of the electric hoist are generated; the two groups of displacement dynamic data reflect the real-time movement condition of the practical training special hoisting equipment B in the transverse direction and the longitudinal direction;
(5) RFID tag (CG 5): the three-dimensional digital virtual reality system is arranged in the practical training special tool C, is matched with the RFID tag identification antenna for use, and is used for detecting, sensing and judging the condition that a practical training person uses the practical training special tool C and what operation is carried out at what part of a component, generating corresponding dynamic data for real-time interactive use by the three-dimensional digital virtual reality system F, wherein four paths of RFID tag identification antennas are arranged in the practical training special component A of the fabricated building, two paths of RFID tag identification antennas are positioned at the left side and the right side of the vertical height 50CM of the practical training special component A of the fabricated building, one path of RFID tag identification antennas is positioned at the bottom of the practical training special component A of the fabricated building, and the other path of RFID tag identification antennas is positioned at the middle part of the practical training special component A of the fabricated building;
(6) infrared proximity sensor (CG 6): the device is respectively arranged at the bottom of the special component A for the fabricated building practical training, the inside of the hanging point bolt, the position of the traction rope bolt, the position of the supporting rod bolt and the like, can sense, detect and judge whether the special component A for the fabricated building practical training is positioned on a base of a placement area of a physical entity scene R or is separated from the base, can sense, detect and judge whether each bolt is placed and screwed down, and whether a sleeve at the bottom of the special component A for the fabricated building practical training is opposite to a hole with embedded steel bars, and the generated dynamic data are used by a three-dimensional digital virtual reality system F to be mapped and interacted in a virtual-real interaction scene H.
As shown in fig. 3, an intelligent perception virtual-real interaction training method for an assembled building corresponding to the system comprises the following steps:
(1) Initializing a system: logging in the intelligent training system G software of the assembled building, selecting a member to be trained in a list, selecting a special training member A of the assembled building corresponding to the selected member in a placement area in a physical entity scene R, checking the special training member A of the assembled building according to data fed back by a sensing detection module D at the end of the intelligent training system G of the assembled building, checking whether abnormal sensing detection equipment exists or not and the like, and performing the next training operation in the physical entity scene R after a training person correctly wears protective articles;
(2) Cleaning, paying off, correcting and adjusting elevation of the steel bars and pasting sealing strips: in the physical entity scene R placement area, a practical trainer sequentially carries out working procedures such as cleaning, paying-off, reinforcing steel bar correction, sealing strip pasting and the like on a selected practical training special component A of the fabricated building, in the physical entity scene R assembly area, the practical trainer carries out working procedures such as basic adjustment elevation, cleaning bonding surface, sealing strip pasting and the like on the fabricated building, tools such as a flat spade, a blower, a steel wire brush, a hammer, a hair pin, a measuring tape, a reinforcing steel bar locating plate, a reinforcing steel bar spanner and the like in the practical training special tool C can be used, when the practical trainer operates by using a specific practical training special tool C, sensing detection equipment built in the selected practical training special component A and the specific practical training tool C can detect the specific working procedures carried out by the practical trainer at present, the dynamic data detected by sensing is synchronously transmitted to a three-dimensional digital virtual reality system F in real time, the corresponding specific practical training tool model VC in the virtual interaction scene H carries out the same operation process in real time at the corresponding position of the practical training special component model VA, and simultaneously, the practical training special tool C carries out the intelligent training window synchronous operation and the intelligent training system is triggered by the sensing detection equipment, and the intelligent training module is driven by the sensing detection equipment to carry out the real-time safety and the safety instruction, and the safety instruction are carried out the working procedures;
(3) Couple and set up haulage rope: when a practical trainer installs a hanging point bolt of an assembled building practical training special component A and sets a traction rope, a sensing detection module D can sense the installation condition of the bolt in real time, dynamic data is sent to a three-dimensional digital virtual reality system F through a virtual reality communication module E, the hanging point on an assembled building practical training special component model VA and the bolt for hanging the traction rope in a virtual-real interaction scene H can synchronously map the operation process of the practical trainer in real time, the bolt model also performs corresponding screwing-in actions, meanwhile, assembled building intelligent practical training system software G synchronously and circularly plays teaching videos of the installation bolt in real time, and simultaneously pops up a safety prompt information window to remind safety matters which are needed to be paid by working procedures in the process, and the sensing detection equipment can sense whether the bolt is fastened and in place or not and issue early warning information in real time;
(4) Lifting and horizontal movement: the method comprises the steps that a hook of a practical training special hoisting device B is hooked into a hoisting point bolt of an assembled building practical training special component A, the component is vertically hoisted to a position of 50CM, the component is determined to continue hoisting to a height of more than 1M without errors, then the component is horizontally moved to an assembling area of a physical entity scene R, the component reaches the upper part of a basic installation part of an assembled building, aiming at the operation and running process of the stage, a sensing detection module D can sense dynamic data of the height, the height change, the horizontal movement and the moving distance of the assembled building practical training special component A and the practical training special hoisting device B, the dynamic data is transmitted to a three-dimensional digital virtual reality system F in real time through a virtual reality communication module E, a hoisting operation teaching video is synchronously played by assembled building intelligent practical training system G software in a virtual scene V in real time, meanwhile, a safety item is prompted by a popup window, and meanwhile, the assembled building practical training special component model VA and the practical training special hoisting device model VB in the virtual real interaction scene H synchronously run in real time along with the visual angle of the assembled building practical training special component A and the practical training special hoisting device B in the physical entity scene R, and the practical training special real interaction scene H changes along with the actual hoisting view angle;
(5) Guiding component lifting: the special component A for the training of the fabricated building is lifted to the upper part of the basic installation part of the fabricated building to fall, when the distance from the installation part is 1.8M, the sensing detection equipment is triggered for the first time in the step, and the height of the traction rope can be touched by a training person; when the vertical falling is 50CM away from the basic installation position of the assembled building, the second time triggering of the sensing detection equipment in the step is that a practical trainer can hold the height of the guide member, dynamic data generated by triggering the sensing detection equipment twice are sequentially sent to the three-dimensional digital virtual reality system F, the real-time synchronous playing of the component guide operation teaching video of the intelligent training system software G of the assembled building in the corresponding virtual scene V, meanwhile, the popup window prompts attention to safety matters, meanwhile, the real-time synchronous mapping of the assembled building special component model VA and the real training special hoisting equipment model VB in the virtual and real interaction scene H is carried out on the guided real-time operation process of the assembled building special component A and the real training special hoisting equipment B in the physical entity scene R, and the visual angle of the virtual and real interaction scene H is changed along with the actual component;
(6) Viewing the alignment hole and adjusting the position: when a practical trainer walks to guide the assembled building practical training special component A to the height of 20CM at the top of the embedded steel bar, on one hand, the practical trainer utilizes a reflector to observe a pair hole, whether the steel bar and the sleeve are in place or not can be inspected, the position of the component can be adjusted from the side surface of the component by using a crowbar or an S hook, the component slowly descends after no error is determined, on the other hand, the sensing detection equipment senses the actions of observing the pair hole and adjusting the position in real time and sends dynamic data to the three-dimensional digital virtual reality system F, so that the assembled building intelligent practical training system software G synchronously plays teaching videos of the lower working procedure in real time, meanwhile, the practical training special tool model VC in the virtual real interaction scene H synchronously maps the real-time running condition of the practical training special tool C used by the practical trainer in the physical entity scene R in real time, and the whole virtual real interaction scene H visual angle changes along with the physical entity scene R;
(7) Mounting support and component adjustment and position detection: after the embedded steel bars are inserted into the sleeves of the special building training components A, installing an inclined support for the special building training components A, adjusting the inclined support according to the perpendicularity of the components to keep the perpendicularity and the levelness of the components, detecting the perpendicularity and the levelness of the special building training components A by using a guiding ruler of the special building training tools C, fine-adjusting the special building training components A until the perpendicularity and the levelness are kept in the X direction and the Y direction according to the detection condition, installing three links of support, component adjustment and position detection, enabling a sensing detection device to sense and form dynamic data in real time and send the dynamic data to a three-dimensional digital virtual reality system F, playing corresponding teaching videos and popup safety information in real time in a virtual scene V, and synchronously mapping the running process of three operation links in real time, wherein the sensing detection device can sense the levelness and the perpendicularity of the special building training components A in the X direction and the Y direction in real time, and sense the positioning condition of a supporting point bolt in real time, and the real time displaying the dynamic data of the levelness and the verticality on a large S synchronously along with the real interaction scene R, and the real interaction scene R changes along with the real interaction scene;
(8) Support locking, precision retesting and unhooking: the sensing detection equipment can sense whether the upper bolt and the lower bolt of the supporting rod of the special component A for the fabricated building practical training are screwed down, whether the locating pin of the middle adjusting area is fixed, whether the angle of the supporting system is correct, whether the supporting system collides with the adjacent supporting or not and the like, and displays all dynamic data on a large screen S in real time;
(9) And (3) finishing material cleaning and training: and restoring the initial state of the physical entity scene R, disassembling and resetting the assembly type building practical training special component A, practical training special hoisting equipment B, practical training special tool C and other physical component parts, and detecting whether the state of the sensing detection module D is normal or not through the three-dimensional digital virtual reality system F, so that the initialization of the physical entity scene R and the virtual scene V is completed.
When a practical training person carries out practical training operation in a physical entity scene R, the three-dimensional digital virtual reality system F in the virtual scene V can acquire various dynamic data of the practical training operation in real time, and carry out tabulation recording on the data, and the system intelligently and comprehensively analyzes and forms a practical training achievement report form for a teacher to examine and evaluate the practical operation level of the practical training person and the mastering condition of theoretical knowledge, so that the aims of practical training, teaching and evaluation are achieved.
While the foregoing description of the embodiments of the present invention has been presented with reference to the drawings, it is not intended to limit the scope of the invention, but rather, various modifications or variations can be made by those skilled in the art without the need of inventive effort on the basis of the technical solutions of the present invention.

Claims (2)

1. The utility model provides an intelligent perception virtual reality of assembled building is mutual practical training system which characterized in that includes:
(1) Physical entity scene R:
(1) special component A of real standard of assembled building: the device is a set of various components commonly used in the field of assembly type buildings, is made of light-weight high-strength materials, is designed into a hollow structure and is used for carrying out assembly type building construction operation and practical training in a physical entity scene, and various sensing detection devices are arranged in various components;
(2) practical training special hoisting equipment B: the method comprises the steps of manufacturing a lightweight high-strength material, and internally arranging various sensing detection devices, wherein the sensing detection devices are used for lifting the special component A for the fabricated building practical training from a placement area to an assembly area, and participating in the assembly work of the special component A for the fabricated building practical training in the assembly area;
(3) practical training special tool C: the tool is a set of various tools commonly used in assembled building construction, including a flat shovel, a blower, a wire brush, a hammer, a chisel, a tape measure, an ink duct, a steel bar locating plate, a steel bar spanner, a level gauge, a guiding ruler, a sealing strip and a traction rope, and is specially customized according to the system requirement and used for the construction operation in practical training, and various tools are internally provided with sensing detection equipment;
(4) Sensing detection module D: the real-time sensing and detecting device comprises a real-time sensing and detecting device which is internally arranged in an assembly type building real-training special component A, a real-training special lifting device B and a real-training special tool C, is used for synchronously sensing, detecting and judging the distance, displacement and action state of the assembly type building real-training special component A, the real-training special lifting device B and the real-training special tool C in real time, forms dynamic data and sends the dynamic data to a virtual reality communication module E in real time;
(5) virtual reality communication module E: the system comprises a sensing detection module D, a three-dimensional digital virtual reality system F, an intranet communication server W, a host M, a sensing detection module D and an extranet interface device, wherein the sensing detection module D is used for realizing data processing and transmission between the sensing detection module D and the three-dimensional digital virtual reality system F, the data processing and transmission of the whole system are realized in a wireless transmission mode; the second is that the external network communicates, the intranet server is connected to the cloud service Y of the Internet through the interface device of the external network, form the external network environment, but PC end and mobile terminal visit the intranet through the Internet, can use, manage, maintain and monitor the intelligent perception virtual reality of the assembled building and exchange the training system in fact remotely;
(6) Physical entity scene R layout case: the method comprises the steps of arranging a placement area, an assembly area and an accessory area, orderly arranging an assembly type building practical training special component A in the placement area, building an assembly type building foundation in the assembly area, arranging practical training special hoisting equipment B, arranging practical training special tools C, a large screen S for displaying a virtual scene V and personal protection articles in the accessory area;
(2) Virtual scene V:
(1) three-dimensional digital virtual reality system F: the intelligent training system comprises two large plates, namely, training participants sequentially perform class selection, role distribution, component selection, cognitive learning and safe bottoming through login software, and then perform actual assembly type building construction training in a physical entity scene R, in the practical training process, the intelligent training system software G of the assembly type building and the physical entity scene R synchronously interact in real time, a teaching video aiming at the current construction process and real-time popup window prompt safety information are played, and a virtual-real interaction scene H is displayed, so that the virtual-real interaction scene H is mapped to the physical entity scene R based on a UNITY3D platform design, a 3D model is established for all elements in an assembly type building practical training special component A, a practical training special hoisting device B and a practical training special tool C physical entity scene R, and a virtual model of all elements in the physical entity scene R, which are in one-to-one correspondence in the virtual-real interaction scene H, is displayed in the virtual-real training special component model VA, the practical training special hoisting device model VB and the practical training special tool model VC, so that the physical entity scene R is mapped;
(2) The method comprises the steps that interfaces of an intelligent training system software G of an assembled building and a virtual-real interaction scene H are respectively presented in left and right areas of a field large screen S, a three-dimensional digital virtual reality system F obtains state information of an assembly type building training special component A, a training special hoisting device B and a training special tool C according to data sent by a virtual reality communication module E, distance, displacement and action state information capture of the physical component parts in a physical entity scene R is completed, so that an assembly type building training special component model VA, a training special hoisting device model VB and a training special tool model VC in the virtual-real interaction scene H dynamically map and simulate state changes of elements in the physical entity scene R in real time, and digital twin is realized;
the sensing detection module D in the physical entity scene R comprises a gyroscope CG1, an inclination sensor CG2, an ultrasonic ranging sensor CG3, a laser ranging sensor CG4, an RFID tag CG5 and an infrared proximity sensor CG6;
(1) gyroscope CG1: the real-time dynamic angle data of the three axes of the special component A for the fabricated building training in the X, Y, Z direction are sensed, detected and generated, and the real-time dynamic angle data generated by the inclination sensor CG2 are calculated and averaged to ensure the accuracy of the angle dynamic data for real-time interactive use of the three-dimensional digital virtual reality system F;
(2) Inclination angle sensor CG2: the angle dynamic data of the special component A for the fabricated building training is perceived, detected and generated, and the angle dynamic data is calculated and averaged together with the dynamic angle data generated by the gyroscope CG1 so as to ensure the accuracy of the angle dynamic data and provide real-time interactive use for the three-dimensional digital virtual reality system F;
(3) ultrasonic ranging sensor CG3: the device is positioned at the bottom of the special component A for the fabricated building practical training and is used for sensing, detecting, monitoring and generating the height dynamic data of the special component A for the fabricated building practical training for the use of the three-dimensional digital virtual reality system F;
(4) laser ranging sensor CG4: firstly, the device is arranged on the top of the practical training special lifting equipment B, a certain fixed wall body is used as a reference object, the whole moving distance of the practical training special lifting equipment B is measured and calculated through laser reflection, and displacement dynamic data of the practical training special lifting equipment B are generated, secondly, the device is arranged on an electric hoist of the practical training special lifting equipment B, laser of the device irradiates to a lifting column at one side, and the moving distance of the electric hoist is judged through laser reflection, so that the displacement dynamic data of the electric hoist are generated; the two groups of displacement dynamic data reflect the real-time movement condition of the practical training special hoisting equipment B in the transverse direction and the longitudinal direction;
(5) RFID tag CG5: the three-dimensional digital virtual reality system is arranged in the practical training special tool C, is matched with the RFID tag identification antenna for use, and is used for detecting, sensing and judging the condition that a practical training person uses the practical training special tool C and what operation is carried out at what part of a component, generating corresponding dynamic data for real-time interactive use by the three-dimensional digital virtual reality system F, wherein four paths of RFID tag identification antennas are arranged in the practical training special component A of the fabricated building, two paths of RFID tag identification antennas are positioned at the left side and the right side of the vertical height 50CM of the practical training special component A of the fabricated building, one path of RFID tag identification antennas is positioned at the bottom of the practical training special component A of the fabricated building, and the other path of RFID tag identification antennas is positioned at the middle part of the practical training special component A of the fabricated building;
(6) infrared proximity sensor CG6: the device is respectively arranged at the bottom of the special component A for the fabricated building practical training, the inside of the hanging point bolt, the position of the traction rope bolt and the position of the supporting rod bolt, can sense, detect and judge whether the special component A for the fabricated building practical training is positioned on a base of a placement area of a physical entity scene R or is separated from the base, can sense, detect and judge whether each bolt is placed and screwed down, and whether a sleeve at the bottom of the special component A for the fabricated building practical training is opposite to a hole with embedded bars, and the generated dynamic data is used by a three-dimensional digital virtual reality system F and is mapped and interacted in a virtual-actual interaction scene H;
When a practical training person performs practical training operation in a physical entity scene R, the three-dimensional digital virtual reality system F in the virtual scene V can acquire and summarize various dynamic data of the practical training operation in real time, and perform tabulation recording on the data, and the system intelligently and comprehensively analyzes and forms a practical training result report for a teacher to examine and evaluate the practical operation level of the practical training person and the mastering condition of theoretical knowledge, so that the goal of simultaneous practical training, teaching and evaluation is achieved.
2. The intelligent perception virtual-real interaction training method for the fabricated building corresponding to the system as claimed in claim 1, which is characterized by comprising the following steps:
(1) Initializing a system: logging in the intelligent training system G software of the assembled building, selecting a member to be trained in a list, selecting a special building training member A of an assembled type 2 corresponding to the selected member in a placement area in a physical entity scene R, and checking whether the special building training member A of the assembled building is safe, quality and sensing detection equipment is abnormal or not according to data fed back by a sensing detection module D at the end of the intelligent training system G of the assembled building, wherein a physical entity scene R can be subjected to next training operation after a physical entity wears protective articles correctly;
(2) Cleaning, paying off, correcting and adjusting elevation of the steel bars and pasting sealing strips: in the physical entity scene R placement area, a practical trainer sequentially carries out working procedures of cleaning, paying-off, reinforcing steel bar correction and sealing strip pasting on a selected practical training special component A of the fabricated building, in the physical entity scene R assembly area, the practical trainer carries out working procedures of adjusting elevation, cleaning a joint surface and sealing strip pasting on a foundation of the fabricated building, a flat spade, a blower, a wire brush, a hammer, a hair pin, a tape measure, a reinforcing steel bar locating plate and a reinforcing steel bar spanner tool in the practical training special tool C can be used, when the practical trainer operates by using a certain practical training special tool C, a sensing detection device arranged in the selected practical training special component A and the certain practical training special tool C can detect the specific working procedure carried out by the practical trainer at present, dynamic data detected by sensing is synchronously transmitted to a three-dimensional digital virtual reality system F in real time, a corresponding part of the corresponding practical training special tool model VC in the practical interaction scene H carries out the same operation procedure in real time synchronously, and simultaneously, the practical training special tool C triggers the sensing detection device to carry out the real training window to drive a real-time synchronous video training module to play the sensing detection device, and the real training window to carry out the real-time instruction and the safety and safety information of the teaching system;
(3) Couple and set up haulage rope: when a practical trainer installs a hanging point bolt of an assembled building practical training special component A and sets a traction rope, a sensing detection module D can sense the installation condition of the bolt in real time, dynamic data is sent to a three-dimensional digital virtual reality system F through a virtual reality communication module E, the hanging point on an assembled building practical training special component model VA and the bolt for hanging the traction rope in a virtual-real interaction scene H can synchronously map the operation process of the practical trainer in real time, the bolt model also performs corresponding screwing-in actions, meanwhile, assembled building intelligent practical training system software G synchronously and circularly plays teaching videos of the installation bolt in real time, and simultaneously pops up a safety prompt information window to remind safety matters which are needed to be paid by working procedures in the process, and the sensing detection equipment can sense whether the bolt is fastened and in place or not and issue early warning information in real time;
(4) Lifting and horizontal movement: the method comprises the steps that a hook of a practical training special hoisting device B is hooked into a hoisting point bolt of an assembled building practical training special component A, the component is vertically hoisted to a position of 50CM, the component is determined to continue hoisting to a height of more than 1M without errors, then the component is horizontally moved to an assembling area of a physical entity scene R, the component reaches the upper part of a basic installation part of an assembled building, aiming at the operation and running process of the stage, a sensing detection module D can sense dynamic data of the height, the height change, the horizontal movement and the moving distance of the assembled building practical training special component A and the practical training special hoisting device B, the dynamic data is transmitted to a three-dimensional digital virtual reality system F in real time through a virtual reality communication module E, a hoisting operation teaching video is synchronously played by assembled building intelligent practical training system G software in a virtual scene V in real time, meanwhile, a safety item is prompted by a popup window, and meanwhile, the assembled building practical training special component model VA and the practical training special hoisting device model VB in the virtual real interaction scene H synchronously run in real time along with the visual angle of the assembled building practical training special component A and the practical training special hoisting device B in the physical entity scene R, and the practical training special real interaction scene H changes along with the actual hoisting view angle;
(5) Guiding component lifting: the special component A for the training of the fabricated building is lifted to the upper part of the basic installation part of the fabricated building to fall, when the distance from the installation part is 1.8M, the sensing detection equipment is triggered for the first time in the step, and the height of the traction rope can be touched by a training person; when the vertical falling is 50CM away from the basic installation position of the assembled building, the second time triggering of the sensing detection equipment in the step is that a practical trainer can hold the height of the guide member, dynamic data generated by triggering the sensing detection equipment twice are sequentially sent to the three-dimensional digital virtual reality system F, the real-time synchronous playing of the component guide operation teaching video of the intelligent training system software G of the assembled building in the corresponding virtual scene V, meanwhile, the popup window prompts attention to safety matters, meanwhile, the real-time synchronous mapping of the assembled building special component model VA and the real training special hoisting equipment model VB in the virtual and real interaction scene H is carried out on the guided real-time operation process of the assembled building special component A and the real training special hoisting equipment B in the physical entity scene R, and the visual angle of the virtual and real interaction scene H is changed along with the actual component;
(6) Viewing the alignment hole and adjusting the position: when a practical trainer walks to guide the assembled building practical training special component A to the height of 20CM at the top of the embedded steel bar, on one hand, the practical trainer utilizes a reflector to observe a pair hole, whether the steel bar and the sleeve are in place or not can be inspected, the position of the component can be adjusted from the side surface of the component by using a crowbar or an S hook, the component slowly descends after no error is determined, on the other hand, the sensing detection equipment senses the actions of observing the pair hole and adjusting the position in real time and sends dynamic data to the three-dimensional digital virtual reality system F, so that the assembled building intelligent practical training system software G synchronously plays teaching videos of the lower working procedure in real time, meanwhile, the practical training special tool model VC in the virtual real interaction scene H synchronously maps the real-time running condition of the practical training special tool C used by the practical trainer in the physical entity scene R in real time, and the whole virtual real interaction scene H visual angle changes along with the physical entity scene R;
(7) Mounting support and component adjustment and position detection: after the embedded steel bars are inserted into the sleeves of the special building training components A, installing an inclined support for the special building training components A, adjusting the inclined support according to the perpendicularity of the components to keep the perpendicularity and the levelness of the components, detecting the perpendicularity and the levelness of the special building training components A by using a guiding ruler of the special building training tools C, fine-adjusting the special building training components A until the perpendicularity and the levelness are kept in the X direction and the Y direction according to the detection condition, installing three links of support, component adjustment and position detection, enabling a sensing detection device to sense and form dynamic data in real time and send the dynamic data to a three-dimensional digital virtual reality system F, playing corresponding teaching videos and popup safety information in real time in a virtual scene V, and synchronously mapping the running process of three operation links in real time, wherein the sensing detection device can sense the levelness and the perpendicularity of the special building training components A in the X direction and the Y direction in real time, and sense the positioning condition of a supporting point bolt in real time, and the real time displaying the dynamic data of the levelness and the verticality on a large S synchronously along with the real interaction scene R, and the real interaction scene R changes along with the real interaction scene;
(8) Support locking, precision retesting and unhooking: the sensing detection equipment can sense whether the upper bolt and the lower bolt of the supporting rod of the special component A for the fabricated building practical training are screwed down, whether the locating pin of the middle adjusting area is fixed, whether the angle of the supporting system is correct or not, whether the supporting system collides with the adjacent supporting system or not, and displays each dynamic data on the large screen S in real time;
(9) And (3) finishing material cleaning and training: and restoring the initial state of the physical entity scene R, disassembling and resetting the assembly type building practical training special component A, the practical training special hoisting equipment B and the practical training special tool C practical component parts, and detecting whether the state of the sensing detection module D is normal or not through the three-dimensional digital virtual reality system F so as to finish the initialization of the physical entity scene R and the virtual scene V.
CN202011567304.8A 2020-12-25 2020-12-25 Intelligent perception virtual-real interaction practical training system and method for assembled building Active CN112419799B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011567304.8A CN112419799B (en) 2020-12-25 2020-12-25 Intelligent perception virtual-real interaction practical training system and method for assembled building

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011567304.8A CN112419799B (en) 2020-12-25 2020-12-25 Intelligent perception virtual-real interaction practical training system and method for assembled building

Publications (2)

Publication Number Publication Date
CN112419799A CN112419799A (en) 2021-02-26
CN112419799B true CN112419799B (en) 2023-05-23

Family

ID=74782697

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011567304.8A Active CN112419799B (en) 2020-12-25 2020-12-25 Intelligent perception virtual-real interaction practical training system and method for assembled building

Country Status (1)

Country Link
CN (1) CN112419799B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113538993A (en) * 2021-06-02 2021-10-22 上海贽匠智能科技有限公司 Training all-in-one machine based on digital twin technology
CN113538997A (en) * 2021-07-14 2021-10-22 重庆电子工程职业学院 Equipment predictive maintenance learning system
CN113534279B (en) * 2021-09-16 2021-12-14 武汉恒新动力科技有限公司 Intelligent hook-entering detection method for universal hook
CN113947967B (en) * 2021-12-01 2024-04-26 浙江太学科技集团有限公司 Real standard system of assembled building element installation

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108510866A (en) * 2018-04-04 2018-09-07 广东机电职业技术学院 A kind of integrated practice tutoring system of intelligent Manufacturing Technology
CN111176245A (en) * 2019-10-29 2020-05-19 中国电子科技集团公司第三十八研究所 Multi-terminal industrial equipment inspection monitoring system and method based on digital twin technology
GB202010042D0 (en) * 2020-07-01 2020-08-12 Vrco Ltd Airspace simulator
CN111899630A (en) * 2020-08-10 2020-11-06 天津博诺智创机器人技术有限公司 Industrial robot system operator training and examining platform
CN112002172A (en) * 2020-09-11 2020-11-27 北京金控数据技术股份有限公司 Three-dimensional simulation system of sewage treatment plant

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101900433B1 (en) * 2016-07-22 2018-09-20 남서울대학교 산학협력단 Portable Interactive 3D Education Device for Construction Engineering
WO2019093386A1 (en) * 2017-11-08 2019-05-16 株式会社 東芝 Skill platform system, skill modeling device, and skill dissemination method
US10719092B2 (en) * 2017-11-27 2020-07-21 Current Lighting Solutions, Llc Building energy modeling tool systems and methods
CN108447335B (en) * 2018-05-02 2020-01-21 徐州工业职业技术学院 AR real-scene simulation practical training teaching system for fabricated building
CN108665245B (en) * 2018-05-23 2022-01-25 华北水利水电大学 Assembled prefabricated part information fusion management system and method based on DT-BIM
CN112084550B (en) * 2020-06-24 2024-03-29 北京工业大学 Digital twin modeling method for intelligent hoisting process of prefabricated building components

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108510866A (en) * 2018-04-04 2018-09-07 广东机电职业技术学院 A kind of integrated practice tutoring system of intelligent Manufacturing Technology
CN111176245A (en) * 2019-10-29 2020-05-19 中国电子科技集团公司第三十八研究所 Multi-terminal industrial equipment inspection monitoring system and method based on digital twin technology
GB202010042D0 (en) * 2020-07-01 2020-08-12 Vrco Ltd Airspace simulator
CN111899630A (en) * 2020-08-10 2020-11-06 天津博诺智创机器人技术有限公司 Industrial robot system operator training and examining platform
CN112002172A (en) * 2020-09-11 2020-11-27 北京金控数据技术股份有限公司 Three-dimensional simulation system of sewage treatment plant

Also Published As

Publication number Publication date
CN112419799A (en) 2021-02-26

Similar Documents

Publication Publication Date Title
CN112419799B (en) Intelligent perception virtual-real interaction practical training system and method for assembled building
US10526799B2 (en) Automated drywall cutting and hanging system and method
CA2892974C (en) Simulator for skill-oriented training
CN109506714A (en) A kind of artificial intelligence bridge security detection system
CN112945160B (en) Virtual-real fused relative pose test platform and test method between hydraulic supports
CN108717808B (en) Tunnel construction virtual teaching system and method based on three-dimensional laser scanning modeling
CN106355972B (en) A kind of Training Methodology of boom-type roadheader virtual reality
CN108447335B (en) AR real-scene simulation practical training teaching system for fabricated building
CN104933943A (en) Land drilling rig installation operation simulation system and operation method thereof
CN113124797A (en) Hydraulic support group pose simulation system based on adjustable bottom plate
CN103295235A (en) Soft cable traction video camera position monitoring method
CN104658364A (en) Optical mechanical and electrical online monitoring and control teaching innovation experimental method
CN108594730A (en) A kind of engineering construction Schedule monitoring system and method based on Internet of Things
CN111597618B (en) Bridge monitoring system based on BIM-GIS
Adami et al. An immersive virtual learning environment for worker-robot collaboration on construction sites
Fernández et al. Virtual reality training for occupational risk prevention: Application case in geotechnical drilling works
CN104933942A (en) Ring screen projection system of land drilling rig installation operation simulation system, and image processing method thereof
CN109883638B (en) Masonry structure anti-seismic toughness detection device and detection method
CN116777386A (en) Intelligent manufacturing collaborative platform management system for beam field
CN109872621A (en) A kind of material automatic sorting tutoring system
CN110111639A (en) Helicopter livewire work training system and method
Sun et al. Virtual Reality Interactive Training System of Prefabricated Building Based on Internet of Things Technology
CN206946740U (en) A kind of VR helmets are shown, the drill jumbo analog machine of free degree platform
CN204965893U (en) Rig model of land rig installation operation simulation system
CN204965892U (en) Land rig installation operation simulation system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant