CN115469744A - Machine room equipment inspection operation method based on AR technology - Google Patents
Machine room equipment inspection operation method based on AR technology Download PDFInfo
- Publication number
- CN115469744A CN115469744A CN202211102277.6A CN202211102277A CN115469744A CN 115469744 A CN115469744 A CN 115469744A CN 202211102277 A CN202211102277 A CN 202211102277A CN 115469744 A CN115469744 A CN 115469744A
- Authority
- CN
- China
- Prior art keywords
- equipment
- machine room
- data
- model
- technology
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/20—Administration of product repair or maintenance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/04—Texture mapping
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Computer Graphics (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Human Resources & Organizations (AREA)
- Entrepreneurship & Innovation (AREA)
- Geometry (AREA)
- Human Computer Interaction (AREA)
- Economics (AREA)
- Computer Hardware Design (AREA)
- Marketing (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a machine room equipment inspection operation method based on AR technology, which comprises the following steps: creating a three-dimensional simulation model of the equipment in the machine room; importing the three-dimensional simulation model into a virtual reality platform, and matching operation and maintenance data of real equipment with the three-dimensional simulation model; creating a virtual interactive interface through a virtual reality platform, and overlaying the virtual interactive interface to a real scene by using a viewpoint tracking technology for displaying; the user wears intelligent wearing equipment and then enters the machine room to patrol and examine the equipment, the machine room is identified through the intelligent wearing equipment to wait to patrol and examine the equipment and the virtual interactive interface corresponding to the equipment to be patrolled and examined is displayed in a real scene, man-machine interaction is carried out through the intelligent wearing equipment and the virtual interactive interface, the operation and maintenance data corresponding to the equipment to be patrolled and examined is checked, and whether abnormity or hidden danger exists in the operation of the equipment is judged according to the operation and maintenance data of the equipment.
Description
Technical Field
The invention belongs to the technical field of machine room equipment inspection, and particularly relates to an AR technology-based machine room equipment inspection operation method.
Background
The normal work of the whole electric power communication network system is directly influenced by the parameters and the operation data of the electric power communication machine room equipment, the daily inspection is an important technology and an organization measure for judging whether the operation condition of the communication network equipment is normal, and the operation conditions of a machine room server, an optical transceiver, network equipment and the like are judged through the inspection. Due to the continuous development of the electric power communication network system, the complexity and diversity of electric power communication equipment provide more and higher requirements for inspection precision and accuracy, and daily manual inspection cannot meet the requirements of inspection of electric power communication equipment rooms.
At present, the mode of the electric power telecommunication machine room inspection is mainly based on paper, bar codes and two-dimensional code scanning records, the appearance, vision, touch, smell (operation light, smoke, smell and the like) of equipment are artificially and mainly judged in the inspection process, the physical condition of the equipment can be directly reflected, the system network and the operation condition can not be judged according to the conditions of system data acquisition and analysis such as equipment parameters, operation data and the like, most of the field machine room inspection becomes a passage, and hidden dangers and abnormal conditions of equipment and network operation can not be found in time.
The current phase of the electric power communication machine room inspection mainly has the following problems: various texts, drawings, photos and videos related to equipment cannot be called at any time in the process of polling by operation and maintenance personnel of an information communication machine room, so that polling efficiency is influenced, certain potential safety hazards exist, and on-site bring-in feeling is lacked; the skill improvement of operation and maintenance personnel in the information communication machine room is mainly in teaching modes of texts, drawings, photos and videos, and the operation and maintenance personnel is not visual, abstract and unintelligible, lack of on-site introduction sense and cannot guarantee the service skills of the operation and maintenance personnel.
Disclosure of Invention
The invention aims to provide a machine room equipment inspection operation method based on an AR technology, aiming at the problems in the prior art.
In order to achieve the purpose, the invention adopts the technical scheme that:
according to one aspect of the invention, an AR technology-based machine room equipment inspection operation method is provided, and comprises the following steps:
creating a three-dimensional simulation model of the equipment in the machine room;
importing the three-dimensional simulation model into a virtual reality platform, and matching operation and maintenance data of real equipment with the three-dimensional simulation model;
creating a virtual interactive interface through a virtual reality platform, and overlaying the virtual interactive interface to a real scene by using a viewpoint tracking technology for displaying;
the user wears intelligent wearing equipment and then enters the machine room to patrol and examine the equipment, the machine room is identified through the intelligent wearing equipment to wait to patrol and examine the equipment and the virtual interactive interface corresponding to the equipment to be patrolled and examined is displayed in a real scene, man-machine interaction is carried out through the intelligent wearing equipment and the virtual interactive interface, the operation and maintenance data corresponding to the equipment to be patrolled and examined is checked, and whether abnormity or hidden danger exists in the operation of the equipment is judged according to the operation and maintenance data of the equipment.
According to the invention, through carrying out accurate data acquisition and simulation three-dimensional modeling on the equipment, the attribute data associated with the characteristic points of the equipment is established, so that the virtual three-dimensional model is accurately matched and positioned with a real environment, a virtual visual space can be created for field staff, operation and maintenance data, operation rules, execution animations or operation videos of the equipment can be superposed in the real space in a spatial scene, the field staff can be helped to intuitively know the communication equipment, look up the equipment data and improve the operation and maintenance skills, and both hands can be liberated, so that the working efficiency is improved.
Specifically, the three-dimensional simulation model comprises a basic model and an accurate model;
the basic model comprises the overall shape, parameters, color and material information of the equipment in the machine room;
the accurate model comprises the shape, size, color, material and assembly constraint information of each part in the machine room equipment.
Further, the method for creating the basic model comprises the following steps:
acquiring 3D point cloud data of equipment in a machine room through a scanner, importing 3D Max software, and manufacturing a basic three-dimensional model of the equipment in the machine room;
and mapping the basic three-dimensional model by adopting PhotosShop software.
Further, the method for creating the accurate model comprises the following steps:
acquiring size data of internal parts of the machine room equipment according to field scanning, measurement and an equipment mechanical design drawing;
acquiring assembly relation data of equipment in the machine room according to the field image data;
importing the size data and the assembly relation data of the internal parts of the equipment into SolidWorks software to manufacture an accurate three-dimensional model of the equipment in the machine room;
and mapping the accurate three-dimensional model by adopting PhotosShop software.
Specifically, an environment sensing camera is configured on the intelligent wearable device and used for capturing a real environment image and extracting feature points from the real environment image; and reversely calculating the rotation angle and the generated displacement of the intelligent wearable device by comparing the relative position change between the feature points of the adjacent frame images.
The viewpoint tracking technology mainly realizes accurate positioning and matching of virtual and real three-dimensional environments, characteristic information of field communication equipment is rapidly scanned and identified in an acquired field environment, three-dimensional data information of the scanned equipment is identified timely and accurately, the matched data information is extracted through calculation processing and then is registered, so that a virtual model and a real space environment are superposed, and when a user wears wearable equipment such as AR glasses and the like and works in a machine room, the wearable equipment can move along with certain head freedom according to task needs and scene characteristics, so that the viewpoint visual angle of the user changes, alignment reference is provided for virtual and real fusion by tracking the movement of the viewpoint of the user in real time, and accurate matching and positioning with the real environment by using a complete virtual three-dimensional model is achieved, and operation and maintenance personnel are assisted to overhaul the equipment.
Specifically, the intelligent wearable equipment identifies equipment to be inspected in the machine room through identification code identification or OCR image identification and other feature identification technologies; and inputting the operation and maintenance equipment information and the equipment feature points in a one-to-one relationship, and when the AR end program identifies the equipment, matching the equipment in the system through the feature points and finding out the equipment attribute information in the database.
Specifically, the information displayed on the virtual interactive interface includes: the system comprises an equipment model, a maintenance flow, asset information, historical operation and maintenance data, historical fault data and historical maintenance data, and a user selects an information interface to be checked in an interactive mode through intelligent wearable equipment and a virtual interactive interface.
Further, the form of the virtual interactive interface display information includes:
dynamic process display, for mechanical equipment with dynamic motion, simulating the dynamic operation process of real equipment through model key frame animation and special effect animation; the key frame animation is used for simulating the change process of different key states of the equipment, and the special effect animation is used for simulating animation contents except mechanical motion of the equipment;
the disassembly and assembly process is displayed, the disassembly and assembly process of the equipment is simulated by adopting a key frame animation and special effect animation mode, and voice introduction is carried out on disassembly and assembly key points, disassembly and assembly states and using tools in each step;
and data visualization display is realized by collecting various parameters of the equipment sensor, performing visualization processing on the collected data through a system data processing layer, and performing data visualization display through the intelligent wearable equipment.
Specifically, intelligence wearing equipment includes AR glasses and interactive handle, the interactive operation that interactive handle can carry out the model includes:
moving: selecting moving kinetic energy, clicking the model, not putting the model, and dragging the model;
rotating: the rotation function is selected, and the model can be rotated through sliding, so that each angle of the model can be observed conveniently;
zooming: the scaling function is selected, and the model can be scaled through gestures, so that the whole/details of the model can be observed conveniently;
disassembling and assembling: by selecting the dismounting function, the communication equipment model can be further operated, namely, each part is clicked, and the parts can be dismounted and independently checked. This step is premised on tree layering of the communication equipment model and preservation of its assembly information.
According to another aspect of the present invention, there is provided a machine room equipment inspection work system, including:
the data acquisition equipment is used for acquiring three-dimensional model data and operation and maintenance data of the equipment in the machine room;
the database is used for storing three-dimensional model data of the machine room equipment and corresponding operation and maintenance data;
the database primarily stores model data, user information data, device attribute data, configuration data, and the like. The model data mainly comprises the name, material, assembly relation, spatial position and the like of the model; the user information data mainly comprises user information, authority, personnel information and the like; the equipment attribute data mainly comprises equipment ledgers, basic information, operation and maintenance information, training data and the like; the configuration data comprises configuration files used by the project;
the virtual reality platform is used for creating a virtual interactive interface and overlaying the virtual interactive interface to a real scene for displaying;
and the intelligent wearable device is used for displaying the virtual interaction interface and performing human-computer interaction.
Compared with the prior art, the invention has the beneficial effects that: according to the invention, the equipment is subjected to accurate data acquisition and simulated three-dimensional modeling, the attribute data associated with the characteristic points of the equipment is established, the virtual three-dimensional model is accurately matched and positioned with the real environment, a virtual visual space can be created for field staff, operation and maintenance data, operation rules, execution animations or operation videos of the equipment can be superposed in the real space in the space scene, the field operation and maintenance staff can be helped to intuitively know the communication equipment, look up the equipment data and improve the operation and maintenance skills, and both hands can be liberated, so that the working efficiency is improved.
Drawings
Fig. 1 is a schematic flow chart of a machine room equipment inspection operation method based on an AR technology in an embodiment of the present invention.
Fig. 2 is a schematic diagram of an architecture of an edge-based vSLAM system according to an embodiment of the present invention.
Fig. 3 is a schematic view of a viewpoint positioning result of the edge-based vSLAM system according to the embodiment of the present invention.
Detailed Description
The technical solutions of the present invention will be described clearly and completely with reference to the accompanying drawings, and it is to be understood that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, belong to the protection scope of the present invention.
As shown in fig. 1, the embodiment provides a method for routing inspection work of equipment in a machine room based on an AR technology, which includes:
creating a three-dimensional simulation model of the equipment in the machine room;
importing the three-dimensional simulation model into a virtual reality platform Unity3D, and matching operation and maintenance data of real equipment with the three-dimensional simulation model;
creating a virtual interactive interface through a virtual reality platform, and overlaying the virtual interactive interface to a real scene by using a viewpoint tracking technology for displaying;
the user wears intelligent wearing equipment and then enters the machine room to patrol and examine the equipment, the machine room is identified through the intelligent wearing equipment to wait to patrol and examine the equipment and the virtual interactive interface corresponding to the equipment to be patrolled and examined is displayed in a real scene, man-machine interaction is carried out through the intelligent wearing equipment and the virtual interactive interface, the operation and maintenance data corresponding to the equipment to be patrolled and examined is checked, and whether abnormity or hidden danger exists in the operation of the equipment is judged according to the operation and maintenance data of the equipment.
The operation and maintenance data comprises equipment operation states and historical operation and maintenance information;
the running state of the equipment can be linked with an interface which passes through the equipment monitoring system newly, so that the acquisition of real-time monitoring quantity and the visual monitoring of running real-time data are realized, and the problems of long effective information acquisition time, maintenance delay and the like are solved. Various parameters of the equipment sensor can be collected through the support of a real-time data communication system and a background database, data visualization processing can be carried out by a system data processing layer before front-end display, and visual charts are drawn for simple digital parameters and the like and visually displayed in the forms of three-dimensional thermodynamic diagrams, column diagrams, dynamic charts and the like. The transmission of data information can be effectively accelerated, and the working efficiency is improved.
In the work of routing inspection, operation and maintenance, maintenance and the like of a communication machine room, an operator can go to the site to execute operation step by step according to task items of a task sheet (a work ticket). With the help of intelligent wearing equipment, can at first carry out digitization and save to the cooperative management system with work content according to real operation regulation, treat during operation can by operating personnel when needing to look over correct operation procedure or action step, call out through the mode of handheld terminal clicking and look over, promote the security of work efficiency and operation.
In the operation and maintenance personnel of patrolling and examining the working process of patrolling and examining that the communication computer lab carries out, utilize the relevant operation and maintenance that the AR technique was accomplished to patrol and examine the work back, data and operation and maintenance data upload to the server are patrolled and examined to the relevance, it analyzes and monitors to make things convenient for the background, utilize AR intelligence eyes augmented reality technique can realize patrolling and examining the collection of data to the operation and maintenance, historical data is patrolled and examined to the operation and maintenance also can be looked over simultaneously, through the analysis to the data, the discovery is patrolling and examining the potential operational risk of in-process equipment, finally, provide strong support for the safe operation of communication computer lab.
Specifically, the three-dimensional simulation model comprises a basic model and an accurate model;
the basic model comprises the overall shape, parameters, color and material information of the equipment in the machine room;
the accurate model comprises the shape, size, color, material and assembly constraint information of each part in the machine room equipment.
A3 ds Max modeling tool is adopted to build a three-dimensional model of a communication machine room and a building, then Photoshop is used to map the model, namely colors are added to the model, the truth of the model is increased, the model is exported to a Unity-compatible FBX-format model file, and finally the exported FBX file and the map are imported to a platform simultaneously to build a model base.
Further, the method for creating the basic model comprises the following steps:
acquiring 3D point cloud data of equipment in a machine room through a three-dimensional laser scanner, importing 3D Max software, and manufacturing a basic three-dimensional model of the equipment in the machine room;
adopting PhotosShop software to map the basic three-dimensional model;
and (4) making a static grid body and material of the model, and finally exporting the FBX file.
Further, the method for creating the accurate model comprises the following steps:
acquiring size data of internal parts of the equipment in the machine room according to field scanning, measurement and equipment mechanical design drawings;
acquiring assembly relation data of equipment in the machine room according to the field image data;
importing the size data and the assembly relation data of the internal parts of the equipment into SolidWorks software to manufacture an accurate three-dimensional model of the equipment in the machine room;
setting model parameters and an assembly constraint relation, exporting Wrl data, carrying out lightweight processing on the Wrl data, and importing the Wrl data into a Unity3D platform;
and mapping the accurate three-dimensional model by adopting PhotosShop software.
Data acquisition (surface digitization of samples) is the first step in reverse modeling of products, and design data collection: in engineering implementation, field measurement is a main means for acquiring modeling data, and for building structures and equipment without measurement conditions, collection of relevant drawings, completion data and manufacturer data is particularly important, and the quality and progress of project construction are directly influenced. Through data collection, the type, the number, the position and the corresponding name of the model can be determined, and preparation is made for subsequent modeling, particularly for splitting of the solid parts of the equipment.
Accurate acquisition of spatial data: in the process of establishing three-dimensional models of a communication machine room and main communication equipment, how to accurately measure spatial data of complex building structures and large-scale equipment is a key point of the project. Therefore, in the three-dimensional laser scanning measurement stage, a detailed three-dimensional laser scanning scheme needs to be formulated, a proper scanning route is designed, and the sampling density, the station setting number and the station setting position are determined, so that the spatial data of the complex building and the complex equipment can be accurately, effectively and quickly acquired.
1. Scanning and acquiring point cloud data
Aiming at equipment needing data research on an operation site, namely communication power supply equipment, direct current distribution equipment, ASON transmission equipment, beacon fire 780B transmission equipment, OTN transmission equipment, a dispatching switch, huacheng soft switching, a comprehensive data network, a centralized control data network and a high-definition video conference system in a local communication machine room of a peak-shaving frequency modulation company; UPS power supply equipment, alternating current power distribution equipment, a server, a switch, network security and auxiliary equipment and the like in an information machine room, and a handheld laser scanner is used for scanning from a body to parts (minimum units which cannot be disassembled). Pasting a reflective mark on each part, arranging and starting the three-dimensional laser scanner, and setting system parameters before scanning. System parameters include viewing options (ball diameter, fast target scan mode, auto-photograph), units (including angle units and length units), video mode (scene is real-time or photograph mode), system language (no chinese). After the setting is completed, the three-dimensional laser scanner is used for carrying out all-dimensional scanning on the equipment parts.
Meanwhile, a camera is used for shooting multi-angle photos of all parts, and image data of communication machine room equipment are collected so as to be used as reference contrast of part modeling characteristics and identification of part materials and colors during reverse modeling.
The three-dimensional laser scanner is connected with computer equipment, and the point cloud data of the parts are generated in real time through matched point cloud production software. And establishing a folder, naming and storing the generated point cloud data and the shot image data of the corresponding parts.
2. Point cloud processing
After scanning of a part is finished, firstly, observing point cloud, comparing with a part entity, and observing whether the obtained point cloud data accords with the characteristics of the part, if the scanning point cloud is greatly different from an actual model, giving up the scanning, deleting the scanning data, and carrying out secondary scanning until the scanning point cloud accords with the characteristics of the actual model.
Due to the fact that the complexity of parts is different, the resolution and the scanning times are different during scanning, and the complex model usually needs multi-angle and multi-time omnibearing scanning, the situation that one part has multiple point clouds can be formed. At this time, the point cloud data of the same part needs to be spliced.
Specifically, the intelligent wearable device is provided with a 3D depth camera which is used for scanning unit equipment, an environment sensing camera and a light sensing camera, the environment sensing camera is used for capturing a real environment image and extracting feature points from the real environment image, then the feature points of adjacent frame images are matched, the rotating angle and the generated displacement of the wearable device are reversely pushed out through the change of the relative positions of the feature points, and therefore the movement of a person is calculated. And researching the motion relation of an operator in the space after wearing the intelligent wearable device to design the critical point of superposition of the virtual scene and the real scene.
After the depth information collected by the depth camera, the wearable device carries out three-dimensional reconstruction on the real environment. The principle is that the depth information acquired by the depth camera is utilized to describe the three-dimensional reconstruction, the three-dimensional reconstruction can be analogized to sculpture, and the depth information of a complete cube is utilized to perform continuous carving perfection. And carving the cube at different angles according to the depth information acquired at different angles to enable the cube to be the desired appearance, and completing three-dimensional reconstruction.
The viewpoint tracking technology mainly realizes accurate positioning and matching of virtual and real three-dimensional environments, characteristic information of field communication equipment is rapidly scanned and identified in an acquired field environment, three-dimensional data information of the scanned equipment is identified timely and accurately, the matched data information is extracted through calculation processing and then is registered, so that a virtual model and a real space environment are superposed, and when a user wears wearable equipment such as AR glasses and the like and works in a machine room, the wearable equipment can move along with certain head freedom according to task needs and scene characteristics, so that the viewpoint visual angle of the user changes, alignment reference is provided for virtual and real fusion by tracking the movement of the viewpoint of the user in real time, and accurate matching and positioning with the real environment by using a complete virtual three-dimensional model is achieved, and operation and maintenance personnel are assisted to overhaul the equipment.
When the virtual and real scenes are fused, the AR system needs to adjust the posture, the proportion and other parameters of the virtual object according to the relative relation between the viewpoint visual angle of the user and the real scene, so that the virtual object is correctly superposed on the image of the real scene. Wearable equipment such as AR glasses are worn by a user beside the generator set, the special identification picture is recognized through the AR glasses, and a virtual three-dimensional digital model is generated. The user can select different information to view through the virtual interactive interface.
The current stable viewpoint tracking technology is generally based on characteristic points which can be determined and described, the environmental characteristic texture of part of working scenes is poor, and the scenes are mostly composed of elements of lines and surfaces, so that research needs to be carried out on the on-site environmental viewpoint tracking technology of poor texture characteristics. The embodiment is intended to adopt an edge-based vSLAM (visual Simultaneous Localization and Mapping) technology for viewpoint Localization and environmental perception for the problem of poor texture. The vSLAM can simultaneously calculate three-dimensional map information of image features in a camera visual field and determine the posture position and the motion trail of the vSLAM in the three-dimensional map by tracking and matching the features in the camera video stream image, utilizing a camera imaging optical model and a multi-view geometric constraint relation and applying various numerical optimization algorithms.
Fig. 2 shows an architecture of the vSLAM system, which is composed of three core modules, namely Tracking, mapping and Loop cloning, and is responsible for camera positioning, map building and closed Loop detection respectively. The method comprises the steps that when an edge-based vSLAM system is initialized, a depth map is randomly generated for edge features in a first key frame, then edge feature tracking and matching are carried out on a subsequent common frame based on the depth map, depth map data in the key frame are revised according to a matching result, a rolling optimization mechanism is formed along with reading of the common frame, the depth map data of the key frame tend to a correct value from a random value, and initialization is completed. Fig. 3 is a diagram showing the result of the edge-based vSLAM system, in which the rectangular icon in the middle of the channel represents the viewpoint motion trajectory, and the structures on both sides represent the constructed three-dimensional map.
Specifically, the intelligent wearable equipment identifies equipment to be patrolled and examined in a machine room through identification code identification or OCR image identification and other characteristic identification technologies; and inputting the operation and maintenance equipment information and the equipment feature points in a one-to-one relationship, and when the AR end program identifies the equipment, matching the equipment in the system through the feature points and finding out the equipment attribute information in the database.
The instrument (such as a switch, a meter and the like) to be operated and maintained is identified by utilizing identification codes or OCR (optical character recognition) and other image identification and processing technologies, and corresponding matched visual information can be automatically found out and displayed in a database of the system. Therefore, the digital and visual model display and chart drawing are performed, and the three-dimensional thermodynamic diagram, the bar chart, the dynamic chart and other forms are visually displayed, so that the transmission of data information is greatly improved, and the working efficiency is improved.
Specifically, after the device information and the operation and maintenance information data are successfully imported, the development platform of the AR device needs to perform logic editing, display form setting, and the like in advance. And designing an AR information display interface by combining the equipment model. And after the model and the unit information are integrated into the virtual simulation platform, displaying the model and the unit information through a UI (user interface). The user wears intelligent wearing equipment, after discerning current equipment, can show equipment information at virtual interactive interface, the information that shows on the virtual interactive interface includes: the system comprises an equipment model, a maintenance flow, asset information, historical operation and maintenance data, historical fault data and historical maintenance data, and a user selects an information interface to be checked in an interactive mode through intelligent wearable equipment and a virtual interactive interface.
Further, the form of the virtual interactive interface display information comprises:
dynamic process display, for mechanical equipment with dynamic motion, simulating the dynamic operation process of real equipment through model key frame animation and special effect animation; the key frame animation is used for simulating the change process of different key states of equipment, and the special effect animation is used for simulating animation contents except for mechanical motion of the equipment;
the disassembly and assembly process is displayed, the disassembly and assembly process of the equipment is simulated by adopting a key frame animation and special effect animation mode, and voice introduction is carried out on disassembly and assembly key points, disassembly and assembly states and using tools in each step;
and data visualization display is realized by collecting various parameters of the equipment sensor, performing visualization processing on the collected data through a system data processing layer, and performing data visualization display through the intelligent wearable equipment.
The information data visualization of the equipment mainly comprises equipment information, instruments, meters, equipment, models, unit drawings and the like. For the information data needing to be visualized, corresponding information data preparation is carried out on the basis of three-dimensional models, images, audios and videos, labeling information and the like related to all the information data needing to be displayed, and the prepared information data can be classified according to application scenes and data types. The organized visual information data needs to be imported by taking a development platform of the AR device as a tool, can be transmitted according to the classified categories, and then is stored in a back-end database through a link, so that a foundation is laid for subsequent visual information expansion and visual information iteration.
Specifically, intelligence wearing equipment includes AR glasses and interactive handle, the interactive operation that interactive handle can carry out the model includes:
moving: selecting the moving kinetic energy, clicking the model without putting, and dragging;
rotating: the rotation function is selected, and the model can be rotated through sliding, so that each angle of the model can be observed conveniently;
zooming: the scaling function is selected, and the model can be scaled through gestures, so that the whole/details of the model can be observed conveniently;
disassembling and assembling: by selecting the dismounting function, the communication equipment model can be further operated, namely, each part is clicked, and the parts can be dismounted and independently checked. This step presupposes tree-like layering of the communication equipment model and retention of its assembly information.
This embodiment also provides a computer lab equipment system of patrolling and examining operating, includes:
the data acquisition equipment is used for acquiring three-dimensional model data and operation and maintenance data of the equipment in the machine room;
the database is used for storing three-dimensional model data of the machine room equipment and corresponding operation and maintenance data;
the database primarily stores model data, user information data, device attribute data, configuration data, and the like. The model data mainly comprises the name, material, assembly relation, spatial position and the like of the model; the user information data mainly comprises user information, authority, personnel information and the like; the equipment attribute data mainly comprises equipment ledgers, basic information, operation and maintenance information, training data and the like; the configuration data comprises configuration files used by the project;
the virtual reality platform is used for creating a virtual interactive interface and overlaying the virtual interactive interface to a real scene for displaying;
and the intelligent wearable device is used for displaying the virtual interaction interface and performing human-computer interaction.
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (10)
1. A machine room equipment inspection operation method based on AR technology is characterized by comprising the following steps:
creating a three-dimensional simulation model of the equipment in the machine room;
importing the three-dimensional simulation model into a virtual reality platform, and matching operation and maintenance data of real equipment with the three-dimensional simulation model;
creating a virtual interactive interface through a virtual reality platform, and overlaying the virtual interactive interface to a real scene for displaying by using a viewpoint tracking technology;
the user wears intelligent wearing equipment and then enters the machine room to patrol and examine the equipment, the machine room is identified through the intelligent wearing equipment to wait to patrol and examine the equipment and the virtual interactive interface corresponding to the equipment to be patrolled and examined is displayed in a real scene, man-machine interaction is carried out through the intelligent wearing equipment and the virtual interactive interface, the operation and maintenance data corresponding to the equipment to be patrolled and examined is checked, and whether abnormity or hidden danger exists in the operation of the equipment is judged according to the operation and maintenance data of the equipment.
2. The machine room equipment inspection operation method based on the AR technology, as claimed in claim 1, wherein the three-dimensional simulation model comprises a basic model and an accurate model;
the basic model comprises the overall shape, parameters, color and material information of the equipment in the machine room;
the accurate model comprises the shape, size, color, material and assembly constraint information of each part in the machine room equipment.
3. The machine room equipment inspection operation method based on the AR technology, as claimed in claim 2, wherein the basic model is created by:
acquiring 3D point cloud data of equipment in a machine room through a scanner, importing 3D Max software, and manufacturing a basic three-dimensional model of the equipment in the machine room;
and mapping the basic three-dimensional model by adopting PhotosShop software.
4. The machine room equipment inspection operation method based on the AR technology, as claimed in claim 2, wherein the accurate model is created by:
acquiring size data of internal parts of the equipment in the machine room according to field scanning, measurement and equipment mechanical design drawings;
acquiring assembly relation data of equipment in the machine room according to the field image data;
importing the size data and the assembly relation data of the internal parts of the equipment into SolidWorks software to manufacture an accurate three-dimensional model of the equipment of the machine room;
and mapping the accurate three-dimensional model by adopting PhotosShop software.
5. The machine room equipment inspection operation method based on the AR technology, as claimed in claim 1, wherein an environment-aware camera is configured on the intelligent wearable equipment, and is used for capturing real environment images and extracting feature points from the real environment images; and reversely calculating the rotation angle and the generated displacement of the intelligent wearable device by comparing the relative position change between the characteristic points of the adjacent frame images.
6. The machine room equipment inspection operation method based on the AR technology as claimed in claim 1, wherein the intelligent wearable equipment identifies the equipment to be inspected in the machine room through identification code recognition or OCR image recognition technology.
7. The machine room equipment inspection operation method based on the AR technology as claimed in claim 1, wherein the information displayed on the virtual interactive interface includes: the system comprises an equipment model, an overhaul process, asset information, historical operation and maintenance data, historical fault data and historical overhaul data, wherein a user selects an information interface to be checked in an interactive mode through intelligent wearable equipment and a virtual interactive interface.
8. The machine room equipment inspection operation method based on the AR technology, as claimed in claim 7, wherein the form of the virtual interactive interface display information includes:
dynamic process display, for mechanical equipment with dynamic motion, simulating the dynamic operation process of real equipment through model key frame animation and special effect animation; the key frame animation is used for simulating the change process of different key states of the equipment, and the special effect animation is used for simulating animation contents except mechanical motion of the equipment;
the disassembly and assembly process is displayed, the disassembly and assembly process of the equipment is simulated by adopting a key frame animation and special effect animation mode, and voice introduction is carried out on disassembly and assembly key points, disassembly and assembly states and using tools in each step;
and data visualization display is carried out, various parameters of the equipment sensor are collected, and after the collected data are visually processed by the system data processing layer, the data are visually displayed through the intelligent wearable equipment.
9. The machine room equipment inspection work method based on the AR technology, as claimed in claim 1, wherein the intelligent wearable equipment comprises AR glasses and an interactive handle.
10. An inspection operation system for machine room equipment, which adopts the inspection operation method for machine room equipment based on the AR technology as claimed in any one of claims 1 to 9, and is characterized by comprising:
the data acquisition equipment is used for acquiring three-dimensional model data and operation and maintenance data of the equipment in the machine room;
the database is used for storing three-dimensional model data of the machine room equipment and corresponding operation and maintenance data;
the virtual reality platform is used for creating a virtual interactive interface and overlaying the virtual interactive interface to a real scene for displaying;
and the intelligent wearable device is used for displaying the virtual interaction interface and performing human-computer interaction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211102277.6A CN115469744A (en) | 2022-09-09 | 2022-09-09 | Machine room equipment inspection operation method based on AR technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211102277.6A CN115469744A (en) | 2022-09-09 | 2022-09-09 | Machine room equipment inspection operation method based on AR technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115469744A true CN115469744A (en) | 2022-12-13 |
Family
ID=84370691
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211102277.6A Pending CN115469744A (en) | 2022-09-09 | 2022-09-09 | Machine room equipment inspection operation method based on AR technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115469744A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116071844A (en) * | 2023-01-31 | 2023-05-05 | 广东长盈科技股份有限公司 | Park management and control method and system based on virtual reality processing technology |
| CN117213468A (en) * | 2023-11-02 | 2023-12-12 | 北京亮亮视野科技有限公司 | Method and device for inspecting outside of airplane and electronic equipment |
-
2022
- 2022-09-09 CN CN202211102277.6A patent/CN115469744A/en active Pending
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116071844A (en) * | 2023-01-31 | 2023-05-05 | 广东长盈科技股份有限公司 | Park management and control method and system based on virtual reality processing technology |
| CN117213468A (en) * | 2023-11-02 | 2023-12-12 | 北京亮亮视野科技有限公司 | Method and device for inspecting outside of airplane and electronic equipment |
| CN117213468B (en) * | 2023-11-02 | 2024-04-05 | 北京亮亮视野科技有限公司 | Method and device for inspecting outside of airplane and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN115469744A (en) | Machine room equipment inspection operation method based on AR technology | |
| CN112084556B (en) | Lightweight display method and system for mass data BIM model | |
| CN110322564B (en) | Three-dimensional model construction method suitable for VR/AR transformer substation operation environment | |
| CN111526118B (en) | Remote operation guiding system and method based on mixed reality | |
| CN106127771B (en) | Tunnel orthography system and method is obtained based on laser radar LIDAR point cloud datas | |
| CN109559381B (en) | Transformer substation acceptance method based on AR space measurement technology | |
| CN109064133A (en) | A kind of engineering whole process management system based on BIM+AR | |
| Kim et al. | Improvement of realism of 4D objects using augmented reality objects and actual images of a construction site | |
| CN110765528A (en) | Three-dimensional reconstruction transformer substation implementation method based on virtual simulation technology | |
| CN109064552A (en) | A kind of virtual restorative procedure of historical relic and repair system | |
| CN106294918A (en) | A kind of method for designing of virtual transparence office system | |
| CN111222190B (en) | Ancient building management system | |
| Corneli et al. | Augmented reality and deep learning towards the management of secondary building assets | |
| CN115469745A (en) | Machine room equipment fault processing method and system based on AR technology | |
| CN115082254A (en) | Lean control digital twin system of transformer substation | |
| CN116308185A (en) | Visual progress input and early warning method for constructional engineering | |
| CN117197298A (en) | Automatic generation system and method for digital intelligent collaborative design of 3D modeling | |
| Ren et al. | Future prospects of UAV tilt photogrammetry technology | |
| CN116977586A (en) | Live-action three-dimensional modeling method based on power grid GIS platform | |
| CN113255040A (en) | 5G network VR equipment-based pipeline material rapid digital tracking method | |
| CN105069218B (en) | Underground utilities visualize ground bidirectional transparency adjustable system | |
| Zhang et al. | Application of augmented reality technology in workshop production management | |
| CN115423949B (en) | Three-dimensional engine-based measuring method and system for converting space image into three-dimensional model | |
| Su et al. | 3D Garden Landscape Generation System Based on Machine Learning Technology | |
| Liu et al. | 3D Reconstruction and Virtual Reality Display Technology of Tourism Art Resources CAD Based on NN |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |