CN110442486A - A kind of remote device diagnostics system and method based on mixed reality technology - Google Patents
A kind of remote device diagnostics system and method based on mixed reality technology Download PDFInfo
- Publication number
- CN110442486A CN110442486A CN201910718517.7A CN201910718517A CN110442486A CN 110442486 A CN110442486 A CN 110442486A CN 201910718517 A CN201910718517 A CN 201910718517A CN 110442486 A CN110442486 A CN 110442486A
- Authority
- CN
- China
- Prior art keywords
- mixed reality
- remote device
- intelligent terminal
- device diagnostics
- indicate
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/22—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
- G06F11/2294—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing by remote test
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/141—Setup of application sessions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
- H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Computer Networks & Wireless Communication (AREA)
- Quality & Reliability (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Computer Graphics (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a kind of remote device diagnostics systems based on mixed reality technology, including server, industrial information system, memory and multiple mixed reality intelligent terminals；The industrial information system includes PAAS platform, and the PAAS platform is used for storage industry data, and the industrial data is uploaded to mixed reality intelligent terminal by server；The mixed reality intelligent terminal carries out physical environment modeling, generates physics environmental model, and industrial data is projected in physical environment model, obtain mixed reality scene, carry out row remote device diagnostics for expert for obtaining physical context information.Factory of the present invention is not necessarily to build complicated hardware environment, it is only necessary to which remote device diagnostics can be carried out by wearing mixed reality intelligent terminal, had wireless, mobile feature, greatly reduced time cost.
Description
Technical field
The present invention relates to equipment diagnosis techniques field more particularly to a kind of remote device diagnostics based on mixed reality technology
System and method.
Background technique
Fault point is described by video calling between mobile phone and plate for traditional Remote equipment fault diagnosis, exchanges non-
It is often troublesome, under efficiency.Organizer spends more energy to carry out coordination of attending a meeting, also make participant consume the more time at
This.Personnel participating in the meeting can not watch the content that display is shown jointly.
Summary of the invention
In order to solve the above-mentioned technical problems, the present invention provides a kind of remote device diagnostics systems based on mixed reality technology
System, factory are not necessarily to build complicated hardware environment, it is only necessary to and remote device diagnostics can be carried out by wearing mixed reality intelligent terminal,
Have wireless, mobile feature, greatly reduces time cost.
The present invention specifically provides a kind of remote device diagnostics system based on mixed reality technology, including server, industry
Information system, memory and multiple mixed reality intelligent terminals；
The server is separately connected the industrial information system, memory and multiple mixed reality intelligent terminals；
The industrial information system includes PAAS platform, and the PAAS platform is used for storage industry data, and by the work
Industry data is uploaded to mixed reality intelligent terminal by server；
The mixed reality intelligent terminal carries out physical environment modeling, generates physical rings for obtaining physical context information
Border model, and industrial data is projected in physical environment model, mixed reality scene is obtained, row is carried out for expert and remotely sets
Standby diagnosis；
The memory, which is used to store, to carry out the expert opinion information of remote device diagnostics based on mixed reality scene and sets
Standby repair message.
Optionally, the mixed reality intelligent terminal can consult the industrial data in mixed reality scene, be compiled
It collects, arrange and statisticallys analyze.
Optionally, it is communicated to connect between the mixed reality intelligent terminal, for carrying out audio, view between each wearer
Frequency is linked up and resources sharing.
Optionally, the mixed reality intelligent terminal is mixed reality intelligent glasses, the mixed reality intelligent glasses packet
Include controller and input module connected to the controller, communication module, projection module and output module；
The input module, for inputting the program for controlling mixed reality intelligent glasses；
The controller is used to control the program for executing the control mixed reality intelligent glasses；
The communication module is used for communication connection and mixed reality intelligent glasses between each mixed reality intelligent glasses
Communication connection between server；
The projection module forms mixed reality scene for projecting industrial data in physical environment model；
The output module includes audio output submodule and video output sub-module, be respectively used to output audio signal and
Vision signal.
Optionally, the video output sub-module includes ken design cell and text design cell, the ken design
Unit is used to determine the interface display region of mixed reality scene, and the text design cell is for determining mixed reality scene
Interface text size.
Optionally, the ken design cell is used to determine the interface display region of mixed reality scene, specifically:
Best image region is determined using following formula:
In formula, L indicates distance of the pupil to mixed reality intelligent glasses eyeglass, W1Indicate interface best image width, β1Table
Show horizontal direct field of vision best angle, β2Indicate the horizontal deflectable angle of eyeball, H1Indicate interface best image height, γ1It indicates
Vertical direct field of vision best angle, γ2The expression deflectable angle of vertical, A expression vision correction coefficient, A ∈ [0.5,
1.5]:
Maximum display area is determined using following formula:
In formula, L indicates distance of the pupil to mixed reality intelligent glasses eyeglass, W2Indicate interface maximum display width, β3Table
Show horizontal direct field of vision maximum angle, β2Indicate the horizontal deflectable angle of eyeball, H2Indicate interface best image height, γ3It indicates
Vertical direct field of vision maximum angle, γ2The expression deflectable angle of vertical, A expression vision correction coefficient, A ∈ [0.5,
1.5]。
Optionally, the text design cell is used to determine the interface text size of mixed reality scene, specifically:
Interface text size is determined using following formula:
B=0.05L × C
In formula, B indicates text side length, and L indicates pupil to the distance of mixed reality intelligent glasses eyeglass, C expression text weight
Want property coefficient, C ∈ [1,2].
Optionally, the physical context information includes wall, ground, ceiling, tables and chairs and special identifier.
Optionally, the industrial data includes facility information, personal information, maintenance record, device model and diagnosis report.
The present invention also provides a kind of remote device diagnostics methods based on mixed reality technology, comprising the following steps:
Step 1: setting mixed reality is intelligent in the space where maintenance personal and where the expert of distal end in space at the scene
Terminal, and communication connection is established between each mixed reality intelligent terminal；
Step 2: physical context information locating for each mixed reality intelligent terminal automatic identification wearer, and carry out physical rings
Border modeling, generates physics environmental model；
Step 3: field service personnel connects factory with the mixed reality intelligent terminal in space where the expert of distal end
PAAS platform carries out data and synchronizes, industrial data required for obtaining；
Step 4: mixed reality intelligent terminal projects industrial data in physical environment model in the form of image, raw
At mixed reality scene；
Step 5: field service personnel consults, edits, arranges and counts to industrial data in mixed reality scene
Analysis carries out communication friendship by mixed reality intelligent terminal between Remote and field service personnel in real time or in the form of message
Stream makes distal end expert understand equipment fault details rapidly, carries out remote device diagnostics.
Other features and advantages of the present invention will be illustrated in the following description, also, partly becomes from specification
It obtains it is clear that understand through the implementation of the invention.The objectives and other advantages of the invention can be by specification, right
Specifically noted structure is achieved and obtained in claim and attached drawing.
Detailed description of the invention
The present invention will be further described with reference to the accompanying drawings, but the embodiment in attached drawing is not constituted to any limit of the invention
System, for those of ordinary skill in the art, without creative efforts, can also obtain according to the following drawings
Other attached drawings.
Fig. 1 is the schematic diagram of remote device diagnostics system of the present invention；
Appended drawing reference:
Server 1, industrial information system 2, memory 3, mixed reality intelligent terminal 4.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
Attached drawing, the technical solution of the embodiment of the present invention is clearly and completely described.Obviously, described embodiment is this hair
Bright a part of the embodiment, instead of all the embodiments.Based on described the embodiment of the present invention, ordinary skill
Personnel's every other embodiment obtained under the premise of being not necessarily to creative work, shall fall within the protection scope of the present invention.
In conjunction with Fig. 1, one embodiment of the present of invention provides a kind of remote device diagnostics system based on mixed reality technology,
Including server 1, industrial information system 2, memory 3 and multiple mixed reality intelligent terminals 4；
The server 1 is separately connected the industrial information system 2, memory 3 and multiple mixed reality intelligent terminals 4；
The industrial information system 2 includes PAAS platform, and the PAAS platform is used for storage industry data, and by the work
Industry data is uploaded to mixed reality intelligent terminal 4 by server 1；
The mixed reality intelligent terminal 4 carries out physical environment modeling, generates physical rings for obtaining physical context information
Border model, and industrial data is projected in physical environment model, mixed reality scene is obtained, row is carried out for expert and remotely sets
Standby diagnosis；The memory 3 is connect with mixed reality intelligent terminal 4, expert opinion information and equipment after expert diagnosis
Repair message is transmitted to memory 3, and the expert that the storage of memory 3 carries out remote device diagnostics based on mixed reality scene comments
Valence information and maintenance of equipment information.Memory 3 is connect with server 1, and corresponding information can be transmitted to server 1.
Mixed reality (MR) refers to the new visible environment that merging reality is generated with virtual world.Mixed reality skill
Art (MR) is the further development of virtual reality and augmented reality, and mixed reality technology is virtual by presenting in reality scene
Scene information sets up the information circuits of an interaction feedback between virtual world, real world and user, to enhance user's body
The sense of reality tested.
In the present embodiment, field service personnel is connect using mixed reality intelligent terminal 4 with Remote, field maintenance
Personnel and Remote are to obtain the failure that bigger freedom of correspondence degree and clarity carry out diagnostic device, field service personnel's energy
Enough receive Remote to help and execute task.
Object locating for 4 automatic identification wearer of mixed reality intelligent terminal where the present embodiment field service personnel in space
Environmental information is managed, and carries out physical environment modeling, generates physics environmental model；Mixed reality intelligent terminal 4 will be provided comprising equipment
Industrial data including material is projected in the form of image in physical environment model, generates mixed reality scene；Mixed reality intelligence
Energy 4 wearer of terminal realizes the editing and processing to equipment data by different control modes in mixed reality scene.Factory
Without building complicated hardware environment, it is only necessary to which remote device diagnostics can be carried out by wearing mixed reality intelligent terminal 4.Have simultaneously
The features such as standby wireless, mobile, greatly reduction time cost.Using shadow casting technique, the limitation in space can break through, show more
Effective content avoids expanding more terminal presentation facilities, greatly improves the convenience and high efficiency of remote device diagnostics.
Preferably, the mixed reality intelligent terminal 4 can consult the industrial data in mixed reality scene, be compiled
It collects, arrange and statisticallys analyze.Industrial data in mixed reality scene is consulted, edits, arranges and statisticallyd analyze can
Realized by multiple control modes, control mode include walk about, eye gaze, gesture operation and voice command.By a variety of more
The control mode that sample is easily achieved realizes the interaction of field service personnel and mixed reality scene, serves maintenance of equipment.
Preferably, communicated to connect between the mixed reality intelligent terminal 4, for carry out between each wearer audio,
Video is linked up and resources sharing.Whether field service personnel or Remote or other personnel, as long as wearing mixing
Real intelligent terminal 4, so that it may obtain mixed reality scene, carry out information sharing with exchange.
Preferably, the mixed reality intelligent terminal 4 is mixed reality intelligent glasses, the mixed reality intelligent glasses packet
Include controller and input module connected to the controller, communication module, projection module and output module；
The input module, for inputting the program for controlling mixed reality intelligent glasses；
The controller is used to control the program for executing the control mixed reality intelligent glasses；
The communication module is used for communication connection and mixed reality intelligent glasses between each mixed reality intelligent glasses
Communication connection between server；
The projection module forms mixed reality scene for projecting industrial data in physical environment model；Projection
Module is projected by the way of line holographic projections in physical environment model, and more life-like image effect can be obtained.
The output module includes audio output submodule and video output sub-module, be respectively used to output audio signal and
Vision signal.Audio output submodule exports audio signal by loudspeaker, and video output sub-module then leads to vision signal
Cross the output of mixed reality intelligent glasses eyeglass.
The mixed reality intelligent glasses can also include operation module, for obtaining the shape of mixed reality intelligent glasses
State, the state of the surrounding of mixed reality intelligent glasses, the state and motion information of mixed reality intelligent glasses wearer, and
And the information that will acquire is sent to controller.Controller executes corresponding movement according to the information and control program that receive.
Since video output sub-module then exports vision signal to intelligent glasses eyeglass, then the interface of video output can be right
Wearer generates direct influence, influences the effect of mixed reality scene, and then influence the accuracy of remote device diagnostics.
To solve the above problems, the video output sub-module includes ken design cell and text design cell, the ken design
Unit is used to determine the interface display region of mixed reality scene, and the text design cell is for determining mixed reality scene
Interface text size.
Preferably, the ken design cell is used to determine the interface display region of mixed reality scene, specifically:
Best image region is determined using following formula:
In formula, L indicates distance of the pupil to mixed reality intelligent glasses eyeglass, W1Indicate interface best image width, β1Table
Show horizontal direct field of vision best angle, β2Indicate the horizontal deflectable angle of eyeball, H1Indicate interface best image height, γ1It indicates
Vertical direct field of vision best angle, γ2The expression deflectable angle of vertical, A expression vision correction coefficient, A ∈ [0.5,
1.5]:
Horizontal direct field of vision best angle is that eyeball is motionless, and optimal viewing angle of the people in level observation takes 30 degree, vertical straight
Connecing visual field best angle is that eyeball is motionless, and optimal viewing angle of the people in level observation takes 20 degree；Vision correction coefficient is set, such as
Fruit wearer be myopia, then A ∈ (1,1.5], near-sighted is more severe, then vision correction coefficient value is bigger, A=1+X/200,
X indicates the degree of myopia；If wearer be farsightedness, A ∈ [0.5,1), long sight it is more severe, then vision correction coefficient takes
It is worth smaller, A=1-Y/200, Y indicates the degree of long sight；
Maximum display area is determined using following formula:
In formula, L indicates distance of the pupil to mixed reality intelligent glasses eyeglass, W2Indicate interface maximum display width, β3Table
Show horizontal direct field of vision maximum angle, β2Indicate the horizontal deflectable angle of eyeball, H2Indicate interface best image height, γ3It indicates
Vertical direct field of vision maximum angle, γ2The expression deflectable angle of vertical, A expression vision correction coefficient, A ∈ [0.5,
1.5]。
Horizontal direct field of vision maximum angle is that eyeball is motionless, and maximum visual angle of the people in level observation takes 160 degree, vertically
Direct field of vision maximum angle is that eyeball is motionless, and maximum visual angle of the people in level observation takes 100 degree；Vision correction coefficient is set,
If wearer be myopia, A ∈ (1,1.5], near-sighted is more severe, then vision correction coefficient value is bigger, A=1+X/
200, X indicate the degree of myopia；If wearer is farsightedness, and A ∈ [0.5,1), more severe, the then vision correction system of long sight
Number value is smaller, and A=1-Y/200, Y indicate the degree of long sight；
It is two parts by boundary division, wherein size W by determining best image region and maximum display area1
×H1Best image region it is centrally-disposed, for showing important content, promote wearing experience and the note of wearer
Meaning power, and unessential content is shown that in size be W2×H2Maximum display area, by determining best image region and most
Big display area not only allows a wearer to obtain effective information, but also can obtain good immersion experience.
Preferably, the text design cell is used to determine the interface text size of mixed reality scene, specifically:
Interface text size is determined using following formula:
B=0.05L × C
In formula, B indicates text side length, and L indicates pupil to the distance of mixed reality intelligent glasses eyeglass, C expression text weight
Property coefficient is wanted, C ∈ [1,2], text is more important, then important coefficient is bigger.By the way that text important coefficient is arranged, to important
The amplification display of text type, can give top priority to what is the most important, obtain important information rapidly convenient for wearer.
Preferably, the physical context information includes wall, ground, ceiling, tables and chairs and special identifier.
Preferably, the industrial data includes facility information, personal information, maintenance record, device model and diagnosis report.
Preferably, it is communicated to connect by establishing mobile phone, tablet computer and mixed reality intelligent terminal 4, hand may be implemented
File-sharing between machine, tablet computer and mixed reality intelligent terminal 4, audio/video communication and long-range mark.
Another embodiment of the present invention provides a kind of remote device diagnostics methods based on mixed reality technology, including with
Lower step:
Step 1: setting mixed reality is intelligent in the space where maintenance personal and where the expert of distal end in space at the scene
Terminal 4, and communication connection is established between each mixed reality intelligent terminal 4；
Step 2: physical context information locating for each 4 automatic identification wearer of mixed reality intelligent terminal, and carry out physical rings
Border modeling, generates physics environmental model；
Step 3: the mixed reality intelligent terminal 4 in field service personnel and distal end expert place space connects factory
PAAS platform carries out data and synchronizes, industrial data required for obtaining；
Step 4: mixed reality intelligent terminal 4 projects industrial data in physical environment model in the form of image, raw
At mixed reality scene；It further, can be by the way of line holographic projections；
Step 5: field service personnel consults, edits, arranges and counts to industrial data in mixed reality scene
Analysis is linked up in real time or in the form of message between Remote and field service personnel by mixed reality intelligent terminal 4
Exchange makes distal end expert understand equipment fault details rapidly, carries out remote device diagnostics.
Further, Remote can sort out data, statistics, analysis, after lookup data the detailed of equipment fault
Thin information and diagnostic result establish ocular connection, find out more effective maintenance program.
Further, field service personnel consults, edits, arranges and unites to industrial data in mixed reality scene
Meter analysis realized by multiple control modes, control mode including walking about, eye gaze, gesture operation and voice command.Pass through
Varied control mode being easily achieved realizes the interaction of field service personnel and mixed reality scene, serves equipment dimension
It repairs.
Further, to the access of industrial data, editor, arrangement and statistical analysis form include browse various information, general
In the information category set needed, mobile rotation scaling data, copy backup data, mark data of punctuating, collection sharing data and
Screenshotss video recording recording.
Further, the visual angle of other coupled intelligent terminals can be presented in the mixed reality intelligent terminal 4,
Its intelligent terminal has mobile phone, tablet computer etc..During remote assistance, field service personnel, by wearing mixed reality intelligence
Energy terminal 4, checks device-dependent real time data during maintenance of equipment, and can be presented to Remote, carries out with expert
Exchange in real time.
Further, mixed reality intelligent terminal 4 is connected with memory 3, expert opinion opinion, equipment maintenance record, dimension
It builds view and opinion is stored in memory 3.
Further, the mixed reality scene that multiple mixed reality intelligent terminals 4 in the same space are seen is automatic
The synchronous merging of data is carried out, the mixed reality scene that each wearer sees on sense organ is identical.Realize mixed reality scene
Consistency avoids a variety of mixed reality scenes from bringing interference and influence to expert judgments.
The diagnostic method of the present embodiment, factory are not necessarily to build complicated hardware environment, and cost is greatly controlled, and is mixed
Real intelligent terminal 4 is highly integrated on hardware, avoids compatibility issue caused by various hardware interactions are run, reduces simultaneously
Maintenance cost.
Mixed reality intelligent terminal 4 has the features such as wireless, mobile, makes the field maintenance people for participating in equipment fault diagnosis
Member and Remote are carried out the work whenever and wherever possible, are greatly reduced time cost, are improved efficiency.Meanwhile field service personnel and remote
Cheng expert need to only wear mixed reality intelligent terminal 4 and line, can facial diagnosis exchange, field service personnel and distal end expert can be with
Shared picture, and mutually exchange.
It using line holographic projections technology, makes Remote on the spot in person, more intuitively carries out equipment fault diagnosis, breach sky
Between limitation, show more effective contents, avoid expanding more terminal presentation facilities.
Remote can carry out fault diagnosis whenever and wherever possible, and exchange instruction in time；
When maintenance of equipment, after Field Force wears mixed reality intelligent terminal 4, Remote observable field condition, and
Field Force's then hand-free, takes more effective maintenance measures.
Through the above description of the embodiments, those skilled in the art can be understood that it should be appreciated that can
To realize the embodiments described herein with hardware, software, firmware, middleware, code or its any appropriate combination.For hardware
It realizes, processor can be realized in one or more the following units: specific integrated circuit (ASIC), digital signal processor
(DSP), digital signal processing appts (DSPD), programmable logic device (PLD), field programmable gate array (FPGA), processing
Device, controller, microcontroller, microprocessor, other electronic units designed for realizing functions described herein or combinations thereof.
For software implementations, some or all of embodiment process can instruct relevant hardware to complete by computer program.
When realization, above procedure can be stored in computer-readable medium or as the one or more on computer-readable medium
Instruction or code are transmitted.Computer-readable medium includes computer storage media and communication media, wherein communication media packet
It includes convenient for from a place to any medium of another place transmission computer program.Storage medium can be computer can
Any usable medium of access.Computer-readable medium can include but is not limited to RAM, ROM, EEPROM, CD-ROM or other
Optical disc storage, magnetic disk storage medium or other magnetic storage apparatus or can be used in carry or store have instruction or data
The desired program code of structure type simultaneously can be by any other medium of computer access.
Finally it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention, rather than the present invention is protected
The limitation for protecting range, although being explained in detail referring to preferred embodiment to the present invention, the ordinary skill destination of this field
It should be appreciated that can be with modification or equivalent replacement of the technical solution of the present invention are made, without departing from technical solution of the present invention
Spirit and scope.
Claims (10)
1. a kind of remote device diagnostics system based on mixed reality technology, which is characterized in that including server, industrial information system
System, memory and multiple mixed reality intelligent terminals；
The server is separately connected the industrial information system, memory and multiple mixed reality intelligent terminals；
The industrial information system includes PAAS platform, and the PAAS platform is used for storage industry data, and the industry is provided
Material is uploaded to mixed reality intelligent terminal by server；
The mixed reality intelligent terminal carries out physical environment modeling, generates physical environment mould for obtaining physical context information
Type, and industrial data is projected in physical environment model, mixed reality scene is obtained, row remote equipment is carried out for expert and examines
It is disconnected；
The memory is used to store the expert opinion information and equipment dimension that remote device diagnostics are carried out based on mixed reality scene
Repair information.
2. the remote device diagnostics system according to claim 1 based on mixed reality technology, which is characterized in that described mixed
Closing real intelligent terminal can be consulted, is edited, arranged and be statisticallyd analyze to the industrial data in mixed reality scene.
3. the remote device diagnostics system according to claim 1 based on mixed reality technology, which is characterized in that described mixed
It closes and is communicated to connect between real intelligent terminal, audio, video is linked up and resources sharing for carrying out between each wearer.
4. the remote device diagnostics system according to claim 1 based on mixed reality technology, which is characterized in that described mixed
Closing real intelligent terminal is mixed reality intelligent glasses, and the mixed reality intelligent glasses include controller and connect with controller
Input module, communication module, projection module and output module；
The input module, for inputting the program for controlling mixed reality intelligent glasses；
The controller is used to control the program for executing the control mixed reality intelligent glasses；
The communication module is for the communication connection and mixed reality intelligent glasses between each mixed reality intelligent glasses and takes
Communication connection between business device；
The projection module forms mixed reality scene for projecting industrial data in physical environment model；
The output module includes audio output submodule and video output sub-module, is respectively used to output audio signal and video
Signal.
5. the remote device diagnostics system according to claim 4 based on mixed reality technology, which is characterized in that the view
Frequency output sub-module includes ken design cell and text design cell, and the ken design cell is for determining mixed reality field
The interface display region of scape, the text design cell are used to determine the interface text size of mixed reality scene.
6. the remote device diagnostics system according to claim 5 based on mixed reality technology, which is characterized in that the view
Domain design cell is used to determine the interface display region of mixed reality scene, specifically:
Best image region is determined using following formula:
In formula, L indicates distance of the pupil to mixed reality intelligent glasses eyeglass, W1Indicate interface best image width, β1Indicate water
Flat direct field of vision best angle, β2Indicate the horizontal deflectable angle of eyeball, H1Indicate interface best image height, γ1Indicate vertical
Direct field of vision best angle, γ2Indicate the deflectable angle of vertical, A indicates vision correction coefficient, A ∈ [0.5,1.5]:
Maximum display area is determined using following formula:
In formula, L indicates distance of the pupil to mixed reality intelligent glasses eyeglass, W2Indicate interface maximum display width, β3Indicate water
Flat direct field of vision maximum angle, β2Indicate the horizontal deflectable angle of eyeball, H2Indicate interface best image height, γ3Indicate vertical
Direct field of vision maximum angle, γ2Indicate the deflectable angle of vertical, A indicates vision correction coefficient, A ∈ [0.5,1.5].
7. the remote device diagnostics system according to claim 6 based on mixed reality technology, which is characterized in that the text
Word design cell is used to determine the interface text size of mixed reality scene, specifically:
Interface text size is determined using following formula:
B=0.05L × C
In formula, B indicates text side length, and L indicates pupil to the distance of mixed reality intelligent glasses eyeglass, C expression text importance
Coefficient, C ∈ [1,2].
8. the remote device diagnostics method according to claim 1 based on mixed reality technology, which is characterized in that the object
Managing environmental information includes wall, ground, ceiling, tables and chairs and special identifier.
9. the remote device diagnostics method according to claim 1 based on mixed reality technology, which is characterized in that the work
Industry data includes facility information, personal information, maintenance record, device model and diagnosis report.
10. a kind of remote device diagnostics method based on mixed reality technology, which comprises the following steps:
Step 1: setting mixed reality intelligence is whole in the space where maintenance personal and where the expert of distal end in space at the scene
End, and communication connection is established between each mixed reality intelligent terminal；
Step 2: physical context information locating for each mixed reality intelligent terminal automatic identification wearer, and carry out physical environment and build
Mould generates physics environmental model；
Step 3: the PAAS that field service personnel connects factory with the mixed reality intelligent terminal in space where the expert of distal end is flat
Platform carries out data and synchronizes, industrial data required for obtaining；
Step 4: mixed reality intelligent terminal projects industrial data in physical environment model in the form of image, generates mixed
Close reality scene；
Step 5: field service personnel consults in mixed reality scene industrial data, edits, arranging and statistical
Analysis carries out communication friendship by mixed reality intelligent terminal between Remote and field service personnel in real time or in the form of message
Stream makes distal end expert understand equipment fault details rapidly, carries out remote device diagnostics.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910718517.7A CN110442486A (en) | 2019-08-05 | 2019-08-05 | A kind of remote device diagnostics system and method based on mixed reality technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910718517.7A CN110442486A (en) | 2019-08-05 | 2019-08-05 | A kind of remote device diagnostics system and method based on mixed reality technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110442486A true CN110442486A (en) | 2019-11-12 |
Family
ID=68433313
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910718517.7A Pending CN110442486A (en) | 2019-08-05 | 2019-08-05 | A kind of remote device diagnostics system and method based on mixed reality technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110442486A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111428961A (en) * | 2020-02-14 | 2020-07-17 | 中国石油天然气集团有限公司 | Petrochemical equipment major risk remote diagnosis system and method based on mixed reality |
| CN111679740A (en) * | 2020-06-06 | 2020-09-18 | 西安热工研究院有限公司 | Method for carrying out remote intelligent diagnosis on power station equipment by using Augmented Reality (AR) technology |
| CN111815000A (en) * | 2020-07-10 | 2020-10-23 | 国网上海市电力公司 | Method and system for reproducing power scene and computer readable storage medium |
| CN111882676A (en) * | 2020-08-04 | 2020-11-03 | 杭州东方通信软件技术有限公司 | Remote monitoring support system and monitoring support method |
| CN111987630A (en) * | 2020-07-10 | 2020-11-24 | 国网上海市电力公司 | Visual equipment system for electric power Internet of things maintenance |
| CN112130666A (en) * | 2020-09-16 | 2020-12-25 | 博彦科技（上海）有限公司 | Data processing method and system |
| WO2021179399A1 (en) * | 2019-10-29 | 2021-09-16 | 南京翱翔信息物理融合创新研究院有限公司 | Mixed reality-based remote operation guidance system and method |
| CN118014537A (en) * | 2024-04-08 | 2024-05-10 | 北京工业大学 | BIM model review method and system based on MR technology |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106845120A (en) * | 2017-01-19 | 2017-06-13 | 杭州古珀医疗科技有限公司 | A kind of Telemedicine System and its operating method based on mixed reality technology |
| CN109086726A (en) * | 2018-08-10 | 2018-12-25 | 陈涛 | A kind of topography's recognition methods and system based on AR intelligent glasses |
| US20180374268A1 (en) * | 2017-06-21 | 2018-12-27 | Number 9, LLC | Interactive mixed reality system for a real-world event |
| CN109696953A (en) * | 2017-10-19 | 2019-04-30 | 华为技术有限公司 | The method, apparatus and virtual reality device of virtual reality text importing |
| CN110062007A (en) * | 2019-05-17 | 2019-07-26 | 中车资阳机车有限公司 | A kind of Locomotive remote maintenance service system and method based on mixed reality technology |
-
2019
- 2019-08-05 CN CN201910718517.7A patent/CN110442486A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106845120A (en) * | 2017-01-19 | 2017-06-13 | 杭州古珀医疗科技有限公司 | A kind of Telemedicine System and its operating method based on mixed reality technology |
| US20180374268A1 (en) * | 2017-06-21 | 2018-12-27 | Number 9, LLC | Interactive mixed reality system for a real-world event |
| CN109696953A (en) * | 2017-10-19 | 2019-04-30 | 华为技术有限公司 | The method, apparatus and virtual reality device of virtual reality text importing |
| CN109086726A (en) * | 2018-08-10 | 2018-12-25 | 陈涛 | A kind of topography's recognition methods and system based on AR intelligent glasses |
| CN110062007A (en) * | 2019-05-17 | 2019-07-26 | 中车资阳机车有限公司 | A kind of Locomotive remote maintenance service system and method based on mixed reality technology |
Non-Patent Citations (1)
| Title |
|---|
| 马广韬 等: ""基于商场购物行为对增强现实设备的人机界面设计研究"", 《设计》 * |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021179399A1 (en) * | 2019-10-29 | 2021-09-16 | 南京翱翔信息物理融合创新研究院有限公司 | Mixed reality-based remote operation guidance system and method |
| CN111428961A (en) * | 2020-02-14 | 2020-07-17 | 中国石油天然气集团有限公司 | Petrochemical equipment major risk remote diagnosis system and method based on mixed reality |
| CN111679740A (en) * | 2020-06-06 | 2020-09-18 | 西安热工研究院有限公司 | Method for carrying out remote intelligent diagnosis on power station equipment by using Augmented Reality (AR) technology |
| CN111815000A (en) * | 2020-07-10 | 2020-10-23 | 国网上海市电力公司 | Method and system for reproducing power scene and computer readable storage medium |
| CN111987630A (en) * | 2020-07-10 | 2020-11-24 | 国网上海市电力公司 | Visual equipment system for electric power Internet of things maintenance |
| CN111882676A (en) * | 2020-08-04 | 2020-11-03 | 杭州东方通信软件技术有限公司 | Remote monitoring support system and monitoring support method |
| CN112130666A (en) * | 2020-09-16 | 2020-12-25 | 博彦科技（上海）有限公司 | Data processing method and system |
| CN118014537A (en) * | 2024-04-08 | 2024-05-10 | 北京工业大学 | BIM model review method and system based on MR technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110442486A (en) | A kind of remote device diagnostics system and method based on mixed reality technology | |
| CN107924584B (en) | Augmented reality | |
| CN105009124B (en) | Analogue system, simulator and description of commodity householder method | |
| EP1949174B1 (en) | Ophthalmic lens simulation system and method | |
| US20170053445A1 (en) | Augmented Reality | |
| JP2019535156A (en) | Virtual reality, augmented reality, and mixed reality systems and methods | |
| CN114365197A (en) | Placing virtual content in an environment with multiple physical participants | |
| CN104811687A (en) | Circuit system of virtual reality helmet and virtual reality helmet | |
| CN202230635U (en) | Transformer substation inspection robot simulation system based on virtual reality technology | |
| CN105607263A (en) | Head mounted electronic equipment | |
| CN107610044A (en) | Image processing method, computer-readable recording medium and virtual reality helmet | |
| CN110427227B (en) | Virtual scene generation method and device, electronic equipment and storage medium | |
| CN108962254A (en) | For assisting the methods, devices and systems and augmented reality glasses of hearing-impaired people | |
| CN108037826A (en) | Information processing method and the program for making the computer-implemented information processing method | |
| CN104281335A (en) | Multi-point touch control interactive large screen system and control method of multi-point touch control interactive large screen system | |
| CN109618056A (en) | Mobile terminal and its control method of screen light on and off, computer storage medium | |
| US20210037063A1 (en) | Information processing device, information processing method, and computer program | |
| Lichtman | What is Telehresence? | |
| CN113014960B (en) | Method, device and storage medium for online video production | |
| CN202443687U (en) | Multimedia orthographic projection digital model interactive integrated system | |
| CN204517985U (en) | A kind of Circuits System of virtual implementing helmet and virtual implementing helmet | |
| CN102737567B (en) | Multimedia orthographic projection digital model interactive integration system | |
| WO2021026955A1 (en) | Cloud vr learning system and method with vision protection function | |
| CN111031555A (en) | Online teaching control method and device, electronic equipment and medium | |
| CN108877407A (en) | Methods, devices and systems and augmented reality glasses for supplementary AC |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |