CN109300112A - Instrument maintaining method and device based on AR - Google Patents

Instrument maintaining method and device based on AR Download PDF

Info

Publication number
CN109300112A
CN109300112A CN201810980615.3A CN201810980615A CN109300112A CN 109300112 A CN109300112 A CN 109300112A CN 201810980615 A CN201810980615 A CN 201810980615A CN 109300112 A CN109300112 A CN 109300112A
Authority
CN
China
Prior art keywords
image data
instrument
target instrument
target
presented
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810980615.3A
Other languages
Chinese (zh)
Inventor
张岩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Baidu Online Network Technology Beijing Co Ltd
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN201810980615.3A priority Critical patent/CN109300112A/en
Publication of CN109300112A publication Critical patent/CN109300112A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/20Administration of product repair or maintenance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0004Industrial image inspection
    • G06T7/001Industrial image inspection using an image reference approach
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30108Industrial image inspection
    • G06T2207/30164Workpiece; Machine component
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30204Marker

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Quality & Reliability (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • Operations Research (AREA)
  • General Business, Economics & Management (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Economics (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present invention provides a kind of instrument maintaining method and device based on AR, and wherein method includes: to obtain the first image data of target instrument, and the first image data include the video or image of the target instrument;First image data of the target instrument is sent to maintain equipment, to make the to maintain equipment that the first image data be presented in a manner of AR.A kind of instrument maintaining method and device based on AR provided by the invention, even if enabling to the maintenance personnel of instrument not at instrument scene, also the first image data that can be presented in a manner of AR by maintain equipment can be appreciated that the fault condition of object machine tool to safeguard to target instrument, to reduce the time cost and human cost of instrument maintenance, and improve the efficiency of instrument maintenance.

Description

Instrument maintaining method and device based on AR
Technical field
The present invention relates to augmented reality (Augmented Reality, AR) technical fields more particularly to a kind of based on AR's Instrument maintaining method and device.
Background technique
Currently, usually first treating the target of maintenance at the scene by diagnostic personnel when the instrument of engineering field is safeguarded Instrument is explored, and informs scene behind the position for determining specific failure and failure, then in place of instrument is needed to safeguard Maintenance personnel so that maintenance personnel safeguards instrument according to the guidance of diagnostic personnel.
However, according to above-mentioned technical proposal in the prior art, being tieed up in instrument as the demand that instrument is safeguarded is more and more When shield, it is often necessary to which the maintenance personnel of experienced instrument diagnostic personnel and related equipment shows up simultaneously, so just improves It is relatively high in the time cost and human cost of the maintenance of engineering instrument, to cause the low efficiency of instrument maintenance.
Summary of the invention
The present invention provides a kind of instrument maintaining method and device based on AR, to reduce time cost and the people of instrument maintenance Power cost, and improve the efficiency of instrument maintenance.
First aspect present invention provides a kind of instrument maintaining method based on AR, comprising:
Obtain target instrument the first image data, the first image data include the target instrument video or Image;
First image data of the target instrument is sent to maintain equipment, to make the to maintain equipment be in a manner of AR Existing the first image data.
In one embodiment of first aspect present invention, further includes:
The second image data that the to maintain equipment is sent is received, second image data includes maintenance personnel according to institute State the fault message of the target instrument of the first image data mark;
Second image data is presented in a manner of AR.
It is described that second image data is presented in a manner of AR in one embodiment of first aspect present invention, comprising:
The abort situation of the target instrument is determined according to second image data;
When second image data being presented in a manner of AR, in virtual scene to the abort situation of the target instrument into Rower note.
It is described that second image data is presented in a manner of AR in one embodiment of first aspect present invention, comprising:
The abort situation of the target instrument is determined according to second image data;
The third image data of the target instrument is obtained, the third image data includes the video of the target instrument Or image, the first image data are different from the third image data;
When the third image data being presented in a manner of AR, in virtual scene to the abort situation of the target instrument into Rower note.
In one embodiment of first aspect present invention, further includes: before first image data for obtaining target instrument, Further include:
The instruction that the to maintain equipment is sent is received, described instruction is used to indicate the first image for obtaining the target instrument Data;
The first image data of the target instrument is obtained according to described instruction.
Second aspect of the present invention provides a kind of instrument maintaining method based on AR, comprising:
The first image data of the target instrument that detection device is sent is received, the first image data include object machine tool Video or image;
The first image data are presented in a manner of AR.
In one embodiment of second aspect of the present invention, further includes:
According to the operation of maintenance personnel, the second image data of the target instrument, the second image data packet are obtained Include the fault message for the target instrument that the maintenance personnel marks according to the first image data;
Second image data of the target instrument is sent to the detection device.
In one embodiment of second aspect of the present invention, the operation according to maintenance personnel obtains the target instrument Second image data, comprising:
Obtain the fault message of the target instrument of maintenance personnel's input;
Location of fault existing for the target instrument is marked in the first image data according to the fault message Obtain second image data.
It is described that the first image data are presented in a manner of AR in one embodiment of second aspect of the present invention, comprising:
It is compared according to the first image data with pre-set image data, the pre-set image data are the target Video or image when the predeterminated position of instrument breaks down;
Part identical with pre-set image comparing in the first image data is presented in a manner of AR.
Third aspect present invention provides a kind of instrument maintenance device based on AR, comprising:
Camera, for obtaining the first image data of target instrument, the first image data include the object machine The video or image of tool;
Transmitter, for the first image data of the target instrument to be sent to maintain equipment, so that the maintenance is set It is standby that the first image data are presented in a manner of AR.
In one embodiment of third aspect present invention, further includes:
Receiver, the second image data sent for receiving the to maintain equipment, second image data include dimension The fault message for the target instrument that shield personnel mark according to the first image data;
Display, for second image data to be presented in a manner of AR.
In one embodiment of third aspect present invention, further include,
Processor, for determining the abort situation of the target instrument according to second image data;
The display is specifically used for, when second image data being presented in a manner of AR, to described in virtual scene The abort situation of target instrument is labeled.
In one embodiment of third aspect present invention, further includes:
Processor, for determining the abort situation of the target instrument according to second image data;
The camera is also used to, and obtains the third image data of the target instrument, and the third image data includes The video or image of the target instrument, the first image data are different from the third image data;
The display is specifically used for, when the third image data being presented in a manner of AR, to described in virtual scene The abort situation of target instrument is labeled.
In one embodiment of third aspect present invention, the receiver is also used to, and receives the finger that the to maintain equipment is sent It enables, described instruction is used to indicate the first image data for obtaining the target instrument;
The camera is specifically used for, and the first image data of the target instrument is obtained according to described instruction.
Fourth aspect present invention provides a kind of instrument maintenance device based on AR, comprising:
Receiver, the first image data of the target instrument for receiving detection device transmission, the first image data Video or image including target instrument;
Display, for the first image data to be presented in a manner of AR.
In one embodiment of fourth aspect present invention, further includes:
Processor obtains the second image data of the target instrument for the operation according to maintenance personnel, and described second Image data includes the fault message for the target instrument that the maintenance personnel marks according to the first image data;
Transmitter, for the second image data of the target instrument to be sent to the detection device.
In one embodiment of fourth aspect present invention, the processor is specifically used for,
Obtain the fault message of the target instrument of maintenance personnel's input;
Location of fault existing for the target instrument is marked in the first image data according to the fault message Obtain second image data.
In one embodiment of fourth aspect present invention, the processor is also used to,
It is compared according to the first image data with pre-set image data, the pre-set image data are the target Video or image when the predeterminated position of instrument breaks down;
The display is specifically used for presenting in a manner of AR in the first image data and pre-set image comparing phase Same part.
5th aspect, the embodiment of the present application provide a kind of instrument maintenance device based on AR, comprising: processor and storage Device;The memory, for storing program;The processor, the program for calling the memory to be stored, to execute sheet Apply for any method in first aspect.
6th aspect, the embodiment of the present application provide a kind of instrument maintenance device based on AR, comprising: processor and storage Device;The memory, for storing program;The processor, the program for calling the memory to be stored, to execute sheet Apply for any method in second aspect.
7th aspect, the embodiment of the present application provide a kind of computer readable storage medium, the computer-readable storage medium Matter stores program code, when said program code is performed, to execute the method as described in the application first aspect is any.
Eighth aspect, the embodiment of the present application provide a kind of computer readable storage medium, the computer-readable storage medium Matter stores program code, when said program code is performed, to execute the method as described in the application second aspect is any.
To sum up, the present invention provides a kind of instrument maintaining method and device based on AR, and wherein method includes: acquisition object machine First image data of tool, the first image data include the video or image of the target instrument;By the object machine First image data of tool is sent to maintain equipment, to make the to maintain equipment that the first image data be presented in a manner of AR. A kind of instrument maintaining method and device based on AR provided by the invention, even if enabling to the maintenance personnel of instrument not in instrument Scene, the first image data that can be also presented in a manner of AR by maintain equipment can be appreciated that the fault condition of object machine tool with right Target instrument is safeguarded, to reduce the time cost and human cost of instrument maintenance, and improves the effect of instrument maintenance Rate.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this Some embodiments of invention without any creative labor, may be used also for those of ordinary skill in the art To obtain other drawings based on these drawings.
Fig. 1 is that the present invention is based on the flow diagrams of one embodiment of instrument maintaining method of AR;
Fig. 2 is that the present invention is based on the application schematic diagrams of one embodiment of instrument maintaining method of AR;
Fig. 3 is that the present invention is based on the flow diagrams of one embodiment of instrument maintaining method of AR;
Fig. 4 is that the present invention is based on the application schematic diagrams of one embodiment of instrument maintaining method of AR;
Fig. 5 is that the present invention is based on the flow diagrams of one embodiment of instrument maintaining method of AR;
Fig. 6 is that the present invention is based on the application schematic diagrams of one embodiment of instrument maintaining method of AR;
Fig. 7 is that the present invention is based on the flow diagrams of one embodiment of instrument maintaining method of AR;
Fig. 8 is that the present invention is based on the application schematic diagrams of one embodiment of instrument maintaining method of AR;
Fig. 9 is that the present invention is based on the flow diagrams of one embodiment of instrument maintaining method of AR;
Figure 10 is that the present invention is based on the application schematic diagrams of one embodiment of instrument maintaining method of AR;
Figure 11 is that the present invention is based on the structural schematic diagrams of one embodiment of instrument maintenance device of AR;
Figure 12 is that the present invention is based on the structural schematic diagrams of one embodiment of instrument maintenance device of AR;
Figure 13 is that the present invention is based on the structural schematic diagrams of one embodiment of instrument maintenance device of AR;
Figure 14 is that the present invention is based on the structural schematic diagrams of one embodiment of instrument maintenance device of AR;
Figure 15 is that the present invention is based on the structural schematic diagrams of one embodiment of instrument maintenance device of AR;
Figure 16 is that the present invention is based on the structural schematic diagrams of one embodiment of instrument maintenance device of AR;
Figure 17 is that the present invention is based on the structural schematic diagrams of one embodiment of instrument maintenance device of AR;
Figure 18 is that the present invention is based on the structural schematic diagrams of one embodiment of instrument maintenance device of AR.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment shall fall within the protection scope of the present invention.
Description and claims of this specification and term " first ", " second ", " third ", " in above-mentioned attached drawing The (if present)s such as four " are to be used to distinguish similar objects, without being used to describe a particular order or precedence order.It should manage The data that solution uses in this way are interchangeable under appropriate circumstances, so that the embodiment of the present invention described herein for example can be to remove Sequence other than those of illustrating or describe herein is implemented.In addition, term " includes " and " having " and theirs is any Deformation, it is intended that cover it is non-exclusive include, for example, containing the process, method of a series of steps or units, system, production Product or equipment those of are not necessarily limited to be clearly listed step or unit, but may include be not clearly listed or for this A little process, methods, the other step or units of product or equipment inherently.
Technical solution of the present invention is described in detail with specifically embodiment below.These specific implementations below Example can be combined with each other, and the same or similar concept or process may be repeated no more in some embodiments.
Fig. 1 is that the present invention is based on the flow diagrams of one embodiment of instrument maintaining method of AR.As shown in Figure 1, this implementation Example provide the instrument maintaining method based on AR include:
S101: the first image data of detection device acquisition target instrument, wherein the first image data includes target instrument Video or image.
S102: the first image data of target instrument is sent to maintain equipment by detection device, and to maintain equipment receives detection First image data of the target instrument that equipment is sent.
S103: the first image data is presented in maintain equipment in a manner of AR.
Specifically, Fig. 2 is that the present invention is based on the application schematic diagrams of one embodiment of instrument maintaining method of AR.Below with Fig. 2 In application for, the instrument maintaining method as shown in Figure 1 based on AR is illustrated.
As shown in Fig. 2, the instrument maintaining method in the present embodiment based on AR is safeguarded by following two based on the instrument of AR Device is realized: detection device 1 and to maintain equipment 2.Wherein, detection device 1 is arranged in around target instrument to be safeguarded, is used for The relevant operation that testing staff 11 safeguards target instrument 3 according to detection device 1;The setting of to maintain equipment 2 and target instrument 3 Different position or region are set, for maintenance personnel 21 according to the content shown in maintain equipment 2 to target instrument 3 into The diagnosis of row failure.
Optionally, dotted line is example to the division on detection device 1 and the progress of to maintain equipment 2 spatial position, detection in figure It is communicated to connect between equipment 1 and to maintain equipment 2, specific connection type can be communication or wire communication side Formula, and may also pass through communication device such as router, wireless base station or service between detection device 1 and to maintain equipment 2 The connection of device is not not shown in the figure, but also in the range of communication connection described herein.
Optionally, the detection device 1 in the present embodiment and to maintain equipment 2, which can be, any has image processing function and energy The electronic equipment being enough communicatively coupled, such as mobile phone (Mobile Phone), tablet computer (Pad), band radio transmission-receiving function Computer, the electronic equipment of augmented reality (Augmented Reality, AR) etc..
When then the instrument maintaining method shown in FIG. 1 based on AR executes step S101 in schematic diagram as shown in Figure 2, position Detection device 1 at target instrument 3 obtains the first image data of target instrument, wherein the first image data includes target The video or image of instrument 3.Specifically, detection device 1 can obtain mesh to be safeguarded by the ability by object identification Mark the first image data of instrument 3.Here the ability of object identification can refer to camera possessed by detection device 1 to target The function that instrument 3 is shot.Meanwhile the first image data here can be the mesh that detection device 1 is shot by camera An at least image for the target instrument 3 that the video or detection device 1 for marking instrument 3 are shot by camera.Alternatively, detection is set Standby 1 can also obtain target instrument 3 captured by the device dedicated for shooting image that other are arranged in around target instrument 3 The first image data.
Detection device 1 is got in the S102 after the first image data of target instrument 3 in S101, detection device 1 First image data is sent to maintain equipment by its communication connection between to maintain equipment 2.
Optionally, in S101, detection device 1 can execute under preset time or preset condition obtains target instrument 3 the first image data;Or detection device 1 obtains the first image data under the operation of testing staff 11, then passes through First image data is sent to maintain equipment 2 by S102;Or after detection device 1 receives the instruction that maintain equipment is sent, root The first image data of target instrument 3 is obtained according to the instruction, wherein the instruction can be maintenance personnel 21 and need to mesh When mark instrument 3 is safeguarded, operation maintenance equipment 2 is sent to detection device 1, can not be occurred in this scene as in Fig. 2 Shown in testing staff 11, the case where target instrument 3 unilaterally is understood by maintenance personnel 21.
Then, in S103, to maintain equipment 2 is by the first image data received in S102 to maintenance personnel in a manner of AR 21 are presented.Such as: to maintain equipment 2 is obtained after being handled according to the first image data of target instrument 3 comprising target instrument 3 AR content-data, and the AR content-data is presented to maintenance personnel 21.That is, maintenance personnel 21 can pass through to maintain equipment 2 The mode of AR sees target instrument 3, is in so as to just can determine according to the first image data presented in maintain equipment 2 The instrument situation of the target instrument 3 of different location, and can according to the AR content seen in maintain equipment 2 to target instrument 3 into The diagnosis of row maintenance aspect, judges 3 problem of target instrument.
Optionally, in an embodiment as illustrated in figure 2, a kind of structure of target instrument 3 is illustratively given to this Step is illustrated, and the structure of other target instruments can also be applied to the present embodiment, subsequent to repeat no more.Such as: target Instrument 3 can be a kind of automatic picking instrument shown in Fig. 2, which includes motor 31, wire dispenser 32 and picking device 33, when Motor 31 can operate the releasing preset length of wire dispenser 32 line when rotating is reached at preset kinds of goods 34 with controlling picking device 33 Carry out picking.The first image data that then detection device 1 obtains after shooting to above-mentioned target instrument 3 is sent to maintain equipment 2, to maintain equipment 2 is presented captured by detection device 1 on its display device such as display screen to maintenance personal 21 in a manner of AR First image data 41.
Therefore, to sum up, the instrument maintaining method provided in this embodiment based on AR, enables to the maintenance personnel of instrument i.e. Make not at instrument scene, the first image data that can be also presented in a manner of AR by maintain equipment can be appreciated that the event of object machine tool Hinder situation to safeguard to target instrument, to reduce the time cost and human cost of instrument maintenance, and improves device The efficiency of tool maintenance.
Fig. 3 is that the present invention is based on the flow diagrams of one embodiment of instrument maintaining method of AR.Embodiment as shown in Figure 3 After S103 on the basis of embodiment as shown in Figure 1 further include:
S201: to maintain equipment obtains the second image data of target instrument according to the operation of maintenance personnel, wherein the second figure As data include the fault message for the target instrument that maintenance personnel marks according to the first image data.
S202: the second image data of target instrument is sent to detection device by maintain equipment, and detection device receives maintenance The second image data that equipment is sent.
S203: the second image data is presented in detection device in a manner of AR.
Specifically, Fig. 4 is that the present invention is based on the application schematic diagrams of one embodiment of instrument maintaining method of AR.Below with Fig. 4 In application for, the instrument maintaining method as shown in Figure 3 based on AR is illustrated.
In embodiment as shown in Figure 4, in the example shown in fig. 2, to maintain equipment 2 is in a manner of AR to maintenance personal 21 After the first AR image data is presented, the of target instrument 3 is obtained according to the operation of maintenance personnel 21 by maintain equipment 2 in S201 Two image datas, wherein the second image data includes the failure for the target instrument that maintenance personnel marks according to the first image data Information.Specifically, example as shown in Figure 4 China, the second image data 42 includes: the failure on the basis of the first image data 41 Label 43, failure letter of the fault flag 43 for indicating to obtain after maintenance personnel 21 judges according to the first image data 41 Abort situation where ceasing.Such as after the fault message that maintenance personnel 21 is judged is input to maintain equipment 2, to maintain equipment 2 are labeled position of the fault flag 43 to identify guilty culprit according to fault message in the first image data 41.For example, The display device of to maintain equipment 2 is to touch screen, then maintenance personnel 21 draws fault flag 43 by touch screen.Alternatively, maintenance Personnel 21 input in maintain equipment 2 or select " wire dispenser failure ", then to maintain equipment 2 passes through figure according to " wire dispenser failure " Position of the wire dispenser 43 in the first image data 41 is determined otherwise as knowing, and fault flag 43 is added to wire dispenser.I.e. As shown in figure 4, the first image data 41 is exactly the second image data 42 signified in the present embodiment plus fault flag 43.
After to maintain equipment 2 determines the second image data, the second image data is equally passed through into itself and detection in S202 Communication connection between equipment 1 is sent to detection device 1.
Then, in S203, detection device 1 is by the second image data received in S202 to testing staff in a manner of AR 11 are presented.Such as: detection device 1 is obtained after being handled according to the second image data of target instrument 3 comprising target instrument 3 AR content-data, and the AR content-data is presented to testing staff 11.That is, testing staff 11 can pass through from detection device 1 The mode of AR sees the fault flag 43 for the target instrument 3 that maintenance personnel 21 indicates in the second image data, so as to true Set the goal the abort situation of instrument 3, and can be according to the AR content seen on detection device 1 to the abort situation of target instrument 3 43 carry out relevant maintenance or attended operation.Such as: it is previous embodiment with target instrument 3 in example as shown in Figure 4 In automatic picking instrument 3, it is that automatic picking instrument 3 being put that maintenance personnel 21, which marks out abort situation 43 by maintain equipment 2, Line device 32 is used as the second image data.Then when detection device 1 in a manner of AR to testing staff 11 present the second image data when, So that testing staff 11 can be with the position at 43 place of failure mark shown in control test equipment 1, with actual automatic picking Judgement is compared in instrument 3, so that it is determined that 32 failure of wire dispenser of automatic picking instrument 3, and wire dispenser 32 is repaired or Maintenance.
Optionally, in the examples described above, maintenance personnel 21 carries out except through failure of the to maintain equipment 2 to target instrument 3 Fault flag can also provide the repair message of some failures, and detection device 1 is sent to together with the second image data, or By some simple tip of the text additions in the second image data, so that testing staff 11 can also be according to detection device 2 The repair message of the failure of upper prompt repair or safeguard more accurately to target instrument 3.
Therefore, to sum up, the instrument maintaining method provided in this embodiment based on AR, enables to the maintenance personnel of instrument i.e. Make not at instrument scene, the first image data that can be also presented in a manner of AR by maintain equipment can be appreciated that the event of object machine tool Hinder situation to safeguard to target instrument.When the second image data is sent to detection device by the maintenance personnel of instrument, so that Testing staff can compare the target instrument at scene by the second image data that detection device is presented in a manner of AR, to scene Target instrument repairs, and without maintenance personnel and testing staff simultaneously all in target instrument location, can be achieved with The cooperation instrument maintenance work of more people, realizes more people's remote collaborations, thus reduce instrument maintenance time cost and manpower at This, and improve the efficiency of instrument maintenance.
Fig. 5 is that the present invention is based on the flow diagrams of one embodiment of instrument maintaining method of AR.Embodiment as shown in Figure 5 Provide a kind of S203 in an embodiment as illustrated in figure 2: the second image data, a kind of possibility is presented in maintain equipment in a manner of AR Implementation, specifically, S103 includes the following steps:
S301: detection device determines the abort situation of target instrument according to the second image data.
S302: when the second image data is presented in detection device in a manner of AR, to the failure of target instrument in virtual scene Position is labeled.
Specifically, Fig. 6 is that the present invention is based on the application schematic diagrams of one embodiment of instrument maintaining method of AR.Below with Fig. 6 In application for, the instrument maintaining method as shown in Figure 5 based on AR is illustrated.
In embodiment as shown in FIG. 6, when detection device 1 receives the second image data of the transmission of to maintain equipment 2, root The abort situation of target instrument 3 is determined according to the second image data.For example, can directly include target instrument in the second image data 3 failure mark 43, alternatively, carrying the fault message " wire dispenser failure " of target instrument 3 in the second image data, needs to detect Equipment 1 determines that the abort situation of target instrument 3 is at wire dispenser 32 according to the fault message.Then when detection device 1 determines target After the abort situation of instrument 3, when the second image data is presented in a manner of AR in detection device 1, to object machine in virtual scene The abort situation of tool 3 is labeled.Wherein, virtual scene refers to that the second image data is presented in detection device 1 in a manner of AR When, virtual scene generated, testing staff 11 can see the abort situation of target instrument 3 from the virtual scene.For example, With the second image data 42 as an example, testing staff 1 can be from second in detection device 1 in embodiment as shown in FIG. 6 The failure mark 43 at the abort situation of target instrument 3 is seen in image data 42, so as to according to the marked content and inspection After the actual target instrument 3 in the left side of measurement equipment 1 is compared, the abort situation for determining target instrument 3 is wire dispenser 32 and right Wire dispenser 32 carries out relevant maintenance and maintenance.
Further, Fig. 7 is that the present invention is based on the flow diagrams of one embodiment of instrument maintaining method of AR.Such as Fig. 7 institute The embodiment shown provides a kind of S203 in an embodiment as illustrated in figure 2: the second picture number is presented in maintain equipment in a manner of AR According to a kind of, possible implementation, embodiment shown in fig. 7 and embodiment illustrated in fig. 5 scheme arranged side by side, the two each other or Relationship, the two can select one and be executed, and specifically, S203 includes the following steps:
S401: the abort situation of target instrument is determined according to the second image data.
S402: the third image data of target instrument is obtained, third image data includes the video or figure of target instrument Picture, the first image data are different from third image data.
S403: when third image data being presented in a manner of AR, the abort situation of target instrument is carried out in virtual scene Mark.
Specifically, Fig. 8 is that the present invention is based on the application schematic diagrams of one embodiment of instrument maintaining method of AR.Below with Fig. 8 In application for, the instrument maintaining method as shown in Figure 7 based on AR is illustrated.
As shown in figure 8, when detection device 1 receives the second image data of the transmission of to maintain equipment 2, according to above-mentioned implementation Same the second image data of mode determines the abort situation of target instrument 3 in example, such as determines the abort situation of target instrument 3 For wire dispenser 32.But detection device 1 obtains target instrument in the front of target instrument 3 in an embodiment as illustrated in figure 2 First image data is simultaneously sent to maintain equipment 2, the second image data that maintain equipment 2 is also obtained according to the first image data, Second image data is also the positive image of target instrument 3 when being presented to detection user 11.And in embodiment as shown in Figure 8 In, the right side at such as visual angle Fig. 3 of target instrument 3 is arranged in detection device 1 at this time, therefore the second figure directly cannot be presented to user As data.But need after the abort situation for determining target instrument according to the second image data, obtain detection device 1 at this time Third image data, wherein and obtained in S101 the first image data method it is identical as principle, third image data also includes The video or image of target instrument 3.Specifically, detection device 1 can also be shot by camera and obtain target to be safeguarded The third image data of instrument 3.Then, when third image data is presented in detection device 1 in a manner of AR, to mesh in virtual scene The abort situation of mark instrument 3 is labeled.Wherein, virtual scene refers to that third image is presented in detection device 1 in a manner of AR When data, virtual scene generated, testing staff 11 can see the abort situation of target instrument 3 from the virtual scene. Such as in the embodiment shown in fig. 8, detection device 1 determines that the abort situation of target instrument is to put according to the second image data 32 failure of line device, and according in detection device at this time the third image data at visual angle determine wire dispenser 32 position after, with AR When third image data 44 is presented in mode, the wire dispenser 32 of target instrument 3 in third image data 44 is passed through into failure mark 34 It irises out, so that testing staff 11 determines that the abort situation of target instrument is wire dispenser according to the third image data presented 32。
Further, in the above-described embodiments, detection device 1 as shown in FIG. 6 and detection device as shown in Figure 8 can be with It is same or different detection device.Wherein,
For identical detection device, detection device 1 can be the electronic equipment of 11 hand-held of testing staff, in such as Fig. 4 Shown in front angle target instrument 3 is shot after obtaining the first image data and being sent to maintain equipment 2, maintenance personnel Determine after failure that the second image data is sent to detection device 1 by maintain equipment 2.Testing staff 11 has held detection and has set at this time Standby 1 reaches the right side of target instrument 3 as shown in Figure 8, then detection device needs to determine event according to the second image data at this time After hindering position, further according to the obtained third image data in the visual angle of detection device 1 at this time, the failure of abort situation is marked 43 It is added in the third image data at visual angle at this time, to prompt to be now placed in 11 object machine of testing staff on 3 right side of target instrument The abort situation of tool.
For different detection devices, detection device 1 as shown in Figure 4 is different with detection device 1 as shown in Figure 8 The front of target instrument 3 is arranged in detection device, the detection device in Fig. 4, and the detection device in Fig. 8 is arranged in target instrument 3 Right side.Then two set detection devices can obtain simultaneously be sent to after the first image data of target instrument it is same In to maintain equipment 2, to maintain equipment 2 according to obtained two the first image datas jointly to maintenance personnel in a manner of AR to dimension Target instrument is presented in shield personnel 21, and is sent to two simultaneously to the second image data after the first image data addition failure mark In a detection device.Two detection devices obtain the third image data at respective visual angle, and failure mark is added to this and is set It is shown in a manner of AR in the third image data at standby visual angle.So that user in two set detection devices each In detection device, it can be seen that the failure in the image data at the visual angle marks under the visual angle.
Optionally, the number of different detection devices can be it is multiple, implementation and principle with it is above-mentioned two The embodiment of detection device is identical, and only quantitative superposition repeats no more.Optionally, multiple detection devices can be by detecting Personnel or maintenance personnel are arranged around target instrument according to the apparatus structure of target instrument, and the purpose of setting is to use Optimal view target instrument.Such as in Fig. 4 and Fig. 8 detection device front and the right side visual angle be example, this two A visual angle can more comprehensively be observed target instrument.
Fig. 9 is that the present invention is based on the flow diagrams of one embodiment of instrument maintaining method of AR.Embodiment as shown in Figure 9 Provide a kind of S103 in the embodiment shown in fig. 1: the first image data, a kind of possibility is presented in detection device in a manner of AR Implementation.Specifically, S103 includes the following steps:
S501: being compared according to the first image data with pre-set image data, and pre-set image data are target instrument Video or image when predeterminated position breaks down.
S502: part identical with pre-set image comparing in the first image data is presented in a manner of AR.
Specifically, Figure 10 is that the present invention is based on the application schematic diagrams of one embodiment of instrument maintaining method of AR.Below to scheme For application in 10, the instrument maintaining method as shown in Figure 9 based on AR is illustrated.
As shown in Figure 10, after to maintain equipment 2 receives the first image data of the transmission of detection device 1, by the first image Data are compared with preset image data, wherein preset image data for example has 31 fault picture data of motor, unwrapping wire 33 fault picture data of 32 fault picture data of device and picking device, by the first image data and above-mentioned three kinds of pre-set image data into After row compares, determine that the first image data is identical as 32 fault picture data of wire dispenser.Then to maintain equipment 2 is only presented in a manner of AR The image of 32 part of wire dispenser is only presented in part 45 identical with pre-set image comparing in first image data, so that Maintenance personnel 21 can focus more on the case where target instrument 3 actually goes wrong, by more before maintenance personnel 21 judges Intelligentized automatic comparison mode determines the abort situation of target instrument, to improve the working efficiency of maintenance personnel 21.Alternatively, Maintenance personnel 21 can also only carry out confirmation work in the present embodiment, i.e., after to maintain equipment 2 determines that 32 part of wire dispenser is faulty, After maintenance personnel 21 determines the information, to maintain equipment 2 will be sent to detection device comprising the second image data that failure marks again 1.Alternatively, above-mentioned maintenance personnel can also be not present in the present embodiment, by maintain equipment 2 individually according to the first image data to mesh The failure of mark instrument is judged that maintain equipment 2 at this time can be understood as the database on backstage.
Figure 11 is that the present invention is based on the structural schematic diagrams of one embodiment of instrument maintenance device of AR.As shown in figure 11, this reality The instrument maintenance device based on AR for applying example offer includes: to obtain module 1101 and sending module 1102.Wherein,
The first image data that module 1101 is used to obtain target instrument is obtained, the first image data includes target instrument Video or image;
Sending module 1102 is used to the first image data of target instrument being sent to maintain equipment so as to maintain equipment with The first image data is presented in AR mode.
Instrument maintenance device provided in this embodiment based on AR can be used as detection device for executing base as shown in Figure 1 In the instrument maintaining method of AR, specific implementation is identical as principle, repeats no more.
Figure 12 is that the present invention is based on the structural schematic diagrams of one embodiment of instrument maintenance device of AR.It is as shown in figure 12 based on The instrument maintenance device of AR is on the basis of embodiment as shown in figure 11, further includes: receiving module 1201 and display module 1202. Wherein,
Receiving module 1201 is used to receive the second image data of to maintain equipment transmission, and the second image data includes maintenance people The fault message for the target instrument that member marks according to the first image data;
Display module 1202 in a manner of AR for being presented the second image data.
Instrument maintenance device provided in this embodiment based on AR can be used as detection device for executing base as shown in Figure 3 In the instrument maintaining method of AR, specific implementation is identical as principle, repeats no more.
Optionally, in the above-described embodiments, further includes: processing module 1203;Wherein,
Processing module 1203 is used to determine the abort situation of target instrument according to the second image data;
Display module 1202 is specifically used for, when the second image data being presented in a manner of AR, to object machine in virtual scene The abort situation of tool is labeled.
Instrument maintenance device provided in this embodiment based on AR can be used for executing shown in previous embodiment based on AR's Instrument maintaining method, specific implementation is identical as principle, repeats no more.
Optionally, in the above-described embodiments, further includes: processing module 1203;Wherein,
Processing module 1203 is used to determine the abort situation of target instrument according to the second image data;
The third image data that module 1101 is also used to obtain target instrument is obtained, third image data includes target instrument Video or image, the first image data is different from third image data;
Display module 1202 is specifically used for, when third image data being presented in a manner of AR, to object machine in virtual scene The abort situation of tool is labeled.
Instrument maintenance device provided in this embodiment based on AR can be used for executing shown in previous embodiment based on AR's Instrument maintaining method, specific implementation is identical as principle, repeats no more.
Optionally, in the above-described embodiments,
Receiving module 1201 is also used to, and receives the instruction that maintain equipment is sent, and instruction, which is used to indicate, obtains target instrument First image data;
Obtain the first image data that module 1101 is also used to obtain target instrument according to instruction.
Instrument maintenance device provided in this embodiment based on AR can be used for executing shown in previous embodiment based on AR's Instrument maintaining method, specific implementation is identical as principle, repeats no more.
Figure 13 is that the present invention is based on the structural schematic diagrams of one embodiment of instrument maintenance device of AR.As shown in figure 13, this reality The instrument maintenance device based on AR for applying example offer includes: receiving module 1301 and display module 1302.Wherein,
Receiving module 1301 is used to receive the first image data of the target instrument of detection device transmission, the first image data Video or image including target instrument;
Display module 1302 in a manner of AR for being presented the first image data.
Instrument maintenance device provided in this embodiment based on AR can be used as to maintain equipment for executing base as shown in Figure 1 In the instrument maintaining method of AR, specific implementation is identical as principle, repeats no more.
Figure 14 is that the present invention is based on the structural schematic diagrams of one embodiment of instrument maintenance device of AR.It is as shown in figure 14 based on The instrument maintenance device of AR is on the basis of embodiment as shown in figure 13, further includes: processing module 1401 and sending module 1402. Wherein,
Processing module 1401 is used for the operation according to maintenance personnel, obtains the second image data of target instrument, the second figure As data include the fault message for the target instrument that maintenance personnel marks according to the first image data;
Sending module 1402 is used to the second image data of target instrument being sent to detection device.
Instrument maintenance device provided in this embodiment based on AR can be used as to maintain equipment for executing base as shown in Figure 3 In the instrument maintaining method of AR, specific implementation is identical as principle, repeats no more.
Optionally, in the above-described embodiments, processing module 1401 is specifically used for,
Obtain the fault message of the target instrument of maintenance personnel's input;
The second image is obtained according to location of fault existing for fault message label target instrument in the first image data Data.
Instrument maintenance device provided in this embodiment based on AR can be used for executing shown in previous embodiment based on AR's Instrument maintaining method, specific implementation is identical as principle, repeats no more.
Optionally, in the above-described embodiments, processing module 1401 is also used to,
It is compared according to the first image data with pre-set image data, pre-set image data are the default position of target instrument Set the video or image when failure;
Display is specifically used for that part identical with pre-set image comparing in the first image data is presented in a manner of AR.
Instrument maintenance device provided in this embodiment based on AR can be used for executing shown in previous embodiment based on AR's Instrument maintaining method, specific implementation is identical as principle, repeats no more.
It should be noted that being schematical, only a kind of logic function to the division of module in the embodiment of the present application It divides, there may be another division manner in actual implementation.Each functional module in embodiments herein can integrate In one processing module, it is also possible to modules and physically exists alone, one can also be integrated in two or more modules In a module.Above-mentioned integrated module both can take the form of hardware realization, can also use the form of software function module It realizes.
If the integrated module is realized in the form of software function module and sells or use as independent product When, it can store in a computer readable storage medium.Based on this understanding, the technical solution of the application is substantially The all or part of the part that contributes to existing technology or the technical solution can be in the form of software products in other words It embodies, which is stored in a storage medium, including some instructions are used so that a computer It is each that equipment (can be personal computer, server or the network equipment etc.) or processor (processor) execute the application The all or part of the steps of embodiment the method.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic or disk Etc. the various media that can store program code.
In the above-described embodiments, can come wholly or partly by software, hardware, firmware or any combination thereof real It is existing.When implemented in software, it can entirely or partly realize in the form of a computer program product.The computer program Product includes one or more computer instructions.When loading on computers and executing the computer program instructions, all or It partly generates according to process or function described in the embodiment of the present application.The computer can be general purpose computer, dedicated meter Calculation machine, computer network or other programmable devices.The computer instruction can store in computer readable storage medium In, or from a computer readable storage medium to the transmission of another computer readable storage medium, for example, the computer Instruction can pass through wired (such as coaxial cable, optical fiber, number from a web-site, computer, server or data center User's line (DSL)) or wireless (such as infrared, wireless, microwave etc.) mode to another web-site, computer, server or Data center is transmitted.The computer readable storage medium can be any usable medium that computer can access or It is comprising data storage devices such as one or more usable mediums integrated server, data centers.The usable medium can be with It is magnetic medium, (for example, floppy disk, hard disk, tape), optical medium (for example, DVD) or semiconductor medium (such as solid state hard disk Solid State Disk (SSD)) etc..
Figure 15 is that the present invention is based on the structural schematic diagrams of one embodiment of instrument maintenance device of AR.As shown in figure 15, this reality The instrument maintenance device based on AR for applying example offer includes: camera 1501 and transmitter 1502.Wherein,
Camera 1501 is used to obtain the first image data of target instrument, and the first image data includes the view of target instrument Frequency or image;
Transmitter 1502 is used to the first image data of target instrument being sent to maintain equipment, so as to maintain equipment is with AR The first image data is presented in mode.
Instrument maintenance device provided in this embodiment based on AR can be used as detection device for executing base as shown in Figure 1 In the instrument maintaining method of AR, specific implementation is identical as principle, repeats no more.
Figure 16 is that the present invention is based on the structural schematic diagrams of one embodiment of instrument maintenance device of AR.It is as shown in figure 16 based on The instrument maintenance device of AR is on the basis of embodiment as shown in figure 15, further includes: receiver 1503 and display 1504.Its In,
Receiver 1503 is used to receive the second image data of to maintain equipment transmission, and the second image data includes maintenance personnel According to the fault message of the target instrument of the first image data mark;
Display 1504 in a manner of AR for being presented the second image data.
Instrument maintenance device provided in this embodiment based on AR can be used as detection device for executing base as shown in Figure 3 In the instrument maintaining method of AR, specific implementation is identical as principle, repeats no more.
Optionally, in the above-described embodiments, further includes: processor 1505;Wherein,
Processor 1505 is used to determine the abort situation of target instrument according to the second image data;
Display 1504 is specifically used for, when the second image data being presented in a manner of AR, to target instrument in virtual scene Abort situation be labeled.
Instrument maintenance device provided in this embodiment based on AR can be used for executing shown in previous embodiment based on AR's Instrument maintaining method, specific implementation is identical as principle, repeats no more.
Optionally, in the above-described embodiments, further includes: processor 1505;Wherein,
Processor 1505 is used to determine the abort situation of target instrument according to the second image data;
Camera 1501 is also used to obtain the third image data of target instrument, and third image data includes target instrument Video or image, the first image data are different from third image data;
Display 1504 is specifically used for, when third image data being presented in a manner of AR, to target instrument in virtual scene Abort situation be labeled.
Instrument maintenance device provided in this embodiment based on AR can be used for executing shown in previous embodiment based on AR's Instrument maintaining method, specific implementation is identical as principle, repeats no more.
Optionally, in the above-described embodiments,
Receiver 1503 is also used to, and receives the instruction that maintain equipment is sent, and instruction, which is used to indicate, obtains the of target instrument One image data;
Camera 1501 is also used to obtain the first image data of target instrument according to instruction.
Instrument maintenance device provided in this embodiment based on AR can be used for executing shown in previous embodiment based on AR's Instrument maintaining method, specific implementation is identical as principle, repeats no more.
Figure 17 is that the present invention is based on the structural schematic diagrams of one embodiment of instrument maintenance device of AR.As shown in figure 17, this reality The instrument maintenance device based on AR for applying example offer includes: receiver 1701 and display 1702.Wherein,
Receiver 1701 is used to receive the first image data of the target instrument of detection device transmission, the first image data packet Include the video or image of target instrument;
Display 1702 in a manner of AR for being presented the first image data.
Instrument maintenance device provided in this embodiment based on AR can be used as to maintain equipment for executing base as shown in Figure 1 In the instrument maintaining method of AR, specific implementation is identical as principle, repeats no more.
Figure 18 is that the present invention is based on the structural schematic diagrams of one embodiment of instrument maintenance device of AR.It is as shown in figure 18 based on The instrument maintenance device of AR is on the basis of embodiment as shown in figure 17, further includes: processor 1703 and transmitter 1704.Its In,
Processor 1703 is used for the operation according to maintenance personnel, obtains the second image data of target instrument, the second image Data include the fault message for the target instrument that maintenance personnel marks according to the first image data;
Transmitter 1704 is used to the second image data of target instrument being sent to detection device.
Instrument maintenance device provided in this embodiment based on AR can be used as to maintain equipment for executing base as shown in Figure 3 In the instrument maintaining method of AR, specific implementation is identical as principle, repeats no more.
Optionally, in the above-described embodiments, processor 1703 is specifically used for,
Obtain the fault message of the target instrument of maintenance personnel's input;
The second image is obtained according to location of fault existing for fault message label target instrument in the first image data Data.
Instrument maintenance device provided in this embodiment based on AR can be used for executing shown in previous embodiment based on AR's Instrument maintaining method, specific implementation is identical as principle, repeats no more.
Optionally, in the above-described embodiments, processor 1703 is also used to,
It is compared according to the first image data with pre-set image data, pre-set image data are the default position of target instrument Set the video or image when failure;
Display is specifically used for that part identical with pre-set image comparing in the first image data is presented in a manner of AR.
Instrument maintenance device provided in this embodiment based on AR can be used for executing shown in previous embodiment based on AR's Instrument maintaining method, specific implementation is identical as principle, repeats no more.
The present invention also proposes a kind of electronic equipment readable storage medium storing program for executing, including program, when it runs on an electronic device, So that electronic equipment executes the instrument maintaining method described in any of the above-described embodiment based on AR.
One embodiment of the invention also provides a kind of electronic equipment, comprising: processor;And memory, it is handled for storage The executable instruction of device;Wherein, processor is configured to execute in any of the above-described embodiment via executable instruction is executed Instrument maintaining method based on AR.
It invents an embodiment and a kind of program product is also provided, which includes: computer program (executing instruction), The computer program is stored in readable storage medium storing program for executing.At least one processor of encoding device can be read from readable storage medium storing program for executing The computer program is taken, at least one processor executes the computer program and encoding device is made to implement various embodiment party above-mentioned The instrument maintaining method based on AR that formula provides.
The above described is only a preferred embodiment of the present invention, be not intended to limit the present invention in any form, according to According to technical spirit any simple modification, equivalent change and modification to the above embodiments of the invention, this hair is still fallen within In the range of bright technical solution.
Those of ordinary skill in the art will appreciate that: realize that all or part of the steps of above-mentioned each method embodiment can lead to The relevant hardware of program instruction is crossed to complete.Program above-mentioned can be stored in a computer readable storage medium.The journey When being executed, execution includes the steps that above-mentioned each method embodiment to sequence;And storage medium above-mentioned include: ROM, RAM, magnetic disk or The various media that can store program code such as person's CD.
Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention., rather than its limitations;To the greatest extent Pipe present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: its according to So be possible to modify the technical solutions described in the foregoing embodiments, or to some or all of the technical features into Row equivalent replacement;And these are modified or replaceed, various embodiments of the present invention technology that it does not separate the essence of the corresponding technical solution The range of scheme.

Claims (20)

1. a kind of instrument maintaining method based on augmented reality AR characterized by comprising
The first image data of target instrument is obtained, the first image data include the video or figure of the target instrument Picture;
First image data of the target instrument is sent to maintain equipment, to make the to maintain equipment that institute be presented in a manner of AR State the first image data.
2. the method according to claim 1, wherein further include:
Receive the second image data that the to maintain equipment is sent, second image data includes maintenance personnel according to described the The fault message of the target instrument of one image data mark;
Second image data is presented in a manner of AR.
3. according to the method described in claim 2, it is characterized in that, described be presented second image data, packet in a manner of AR It includes:
The abort situation of the target instrument is determined according to second image data;
When second image data being presented in a manner of AR, the abort situation of the target instrument is marked in virtual scene Note.
4. according to the method described in claim 2, it is characterized in that, described be presented second image data, packet in a manner of AR It includes:
The abort situation of the target instrument is determined according to second image data;
Obtain the third image data of the target instrument, the third image data include the target instrument video or Image, the first image data are different from the third image data;
When the third image data being presented in a manner of AR, the abort situation of the target instrument is marked in virtual scene Note.
5. the method according to claim 3 or 4, which is characterized in that further include: first image for obtaining target instrument Before data, further includes:
The instruction that the to maintain equipment is sent is received, described instruction is used to indicate the first picture number for obtaining the target instrument According to;
The first image data of the target instrument is obtained according to described instruction.
6. a kind of instrument maintaining method based on augmented reality AR characterized by comprising
The first image data of the target instrument that detection device is sent is received, the first image data include the view of object machine tool Frequency or image;
The first image data are presented in a manner of AR.
7. according to the method described in claim 6, it is characterized by further comprising:
According to the operation of maintenance personnel, the second image data of the target instrument is obtained, second image data includes institute State the fault message for the target instrument that maintenance personnel marks according to the first image data;
Second image data of the target instrument is sent to the detection device.
8. the method according to the description of claim 7 is characterized in that the operation according to maintenance personnel, obtains the target Second image data of instrument, comprising:
Obtain the fault message of the target instrument of maintenance personnel's input;
Location of fault existing for the target instrument is marked in the first image data according to the fault message to obtain Second image data.
9. according to the method described in claim 8, it is characterized in that, described be presented the first image data, packet in a manner of AR It includes:
It is compared according to the first image data with pre-set image data, the pre-set image data are the target instrument Predeterminated position break down when video or image;
Part identical with pre-set image comparing in the first image data is presented in a manner of AR.
10. a kind of instrument maintenance device based on AR characterized by comprising
Camera, for obtaining the first image data of target instrument, the first image data include the target instrument Video or image;
Transmitter, for the first image data of the target instrument to be sent to maintain equipment so that the to maintain equipment with The first image data are presented in AR mode.
11. device according to claim 10, which is characterized in that further include:
Receiver, the second image data sent for receiving the to maintain equipment, second image data include maintenance people The fault message for the target instrument that member marks according to the first image data;
Display, for second image data to be presented in a manner of AR.
12. device according to claim 11, which is characterized in that further include,
Processor, for determining the abort situation of the target instrument according to second image data;
The display is specifically used for, when second image data being presented in a manner of AR, to the target in virtual scene The abort situation of instrument is labeled.
13. device according to claim 11, which is characterized in that further include:
Processor, for determining the abort situation of the target instrument according to second image data;
The camera is also used to, and obtains the third image data of the target instrument, and the third image data includes described The video or image of target instrument, the first image data are different from the third image data;
The display is specifically used for, when the third image data being presented in a manner of AR, to the target in virtual scene The abort situation of instrument is labeled.
14. device according to claim 12 or 13, which is characterized in that
The receiver is also used to, and receives the instruction that the to maintain equipment is sent, and described instruction, which is used to indicate, obtains the target First image data of instrument;
The camera is specifically used for, and the first image data of the target instrument is obtained according to described instruction.
15. a kind of instrument maintenance device based on augmented reality AR characterized by comprising
Receiver, the first image data of the target instrument for receiving detection device transmission, the first image data include The video or image of target instrument;
Display, for the first image data to be presented in a manner of AR.
16. device according to claim 15, which is characterized in that further include:
Processor obtains the second image data of the target instrument, second image for the operation according to maintenance personnel Data include the fault message for the target instrument that the maintenance personnel marks according to the first image data;
Transmitter, for the second image data of the target instrument to be sent to the detection device.
17. device according to claim 16, which is characterized in that the processor is specifically used for,
Obtain the fault message of the target instrument of maintenance personnel's input;
Location of fault existing for the target instrument is marked in the first image data according to the fault message to obtain Second image data.
18. device according to claim 17, which is characterized in that the processor is also used to,
It is compared according to the first image data with pre-set image data, the pre-set image data are the target instrument Predeterminated position break down when video or image;
The display is specifically used for presenting in a manner of AR identical with pre-set image comparing in the first image data Part.
19. a kind of instrument maintenance device based on AR characterized by comprising
Processor, memory and computer program;Wherein, the computer program is stored in the memory, and It is configured as being executed by the processor, the computer program includes for executing as claim 1-9 is described in any item The instruction of method.
20. a kind of computer readable storage medium, which is characterized in that the computer-readable recording medium storage has computer journey Sequence, the computer program make server perform claim require the described in any item methods of 1-9.
CN201810980615.3A 2018-08-27 2018-08-27 Instrument maintaining method and device based on AR Pending CN109300112A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810980615.3A CN109300112A (en) 2018-08-27 2018-08-27 Instrument maintaining method and device based on AR

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810980615.3A CN109300112A (en) 2018-08-27 2018-08-27 Instrument maintaining method and device based on AR

Publications (1)

Publication Number Publication Date
CN109300112A true CN109300112A (en) 2019-02-01

Family

ID=65165420

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810980615.3A Pending CN109300112A (en) 2018-08-27 2018-08-27 Instrument maintaining method and device based on AR

Country Status (1)

Country Link
CN (1) CN109300112A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112101056A (en) * 2020-09-29 2020-12-18 重庆市华驰交通科技有限公司 Electromechanical equipment identification and information acquisition method and system based on wearable equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105491416A (en) * 2015-11-25 2016-04-13 腾讯科技(深圳)有限公司 Augmented reality information transmission method and device
CN106341621A (en) * 2016-10-24 2017-01-18 福建北极光虚拟视觉展示科技有限公司 Method, system and device for augmented reality interaction
CN106339094A (en) * 2016-09-05 2017-01-18 山东万腾电子科技有限公司 Interactive remote expert cooperation maintenance system and method based on augmented reality technology
CN107645651A (en) * 2017-10-12 2018-01-30 北京临近空间飞艇技术开发有限公司 A kind of remote guide method and system of augmented reality
CN207264613U (en) * 2017-07-14 2018-04-20 福建铁工机智能机器人有限公司 A kind of equipment that remote guide scene investigation failure is realized using AR

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105491416A (en) * 2015-11-25 2016-04-13 腾讯科技(深圳)有限公司 Augmented reality information transmission method and device
CN106339094A (en) * 2016-09-05 2017-01-18 山东万腾电子科技有限公司 Interactive remote expert cooperation maintenance system and method based on augmented reality technology
CN106341621A (en) * 2016-10-24 2017-01-18 福建北极光虚拟视觉展示科技有限公司 Method, system and device for augmented reality interaction
CN207264613U (en) * 2017-07-14 2018-04-20 福建铁工机智能机器人有限公司 A kind of equipment that remote guide scene investigation failure is realized using AR
CN107645651A (en) * 2017-10-12 2018-01-30 北京临近空间飞艇技术开发有限公司 A kind of remote guide method and system of augmented reality

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112101056A (en) * 2020-09-29 2020-12-18 重庆市华驰交通科技有限公司 Electromechanical equipment identification and information acquisition method and system based on wearable equipment

Similar Documents

Publication Publication Date Title
CN109690570B (en) Computer room management method and dynamic loop system
US8834176B2 (en) Method and system for plant management by augmentation reality
CN105378810A (en) Remote sharing of measurement data
CN106272550B (en) Configuration controls information processing method and device
TWI618939B (en) A system and a method for detecting industrial equipment
US9716971B2 (en) Inspecting equipment of a power system
JP2014238819A5 (en)
CN104508576A (en) Object inspection in an industrial plant
EP2535781A1 (en) Collecting data in an industrial plant
CN110579191A (en) target object inspection method, device and equipment
CN108875857B (en) Inspection method, device and system
CN106998265A (en) A kind of monitoring method and its device
CN101789160A (en) Spacing false-entering prevention system for intelligent video transformer substation
US20160343215A1 (en) Physical layer system with support for multiple active work orders and/or multiple active technicians
JP5772128B2 (en) Method and apparatus for providing industrial plant information
CN110962128B (en) Substation inspection and stationing method and inspection robot control method
CN106681942B (en) Information system and method for providing installation information of connectable device and electrical device
KR20150044449A (en) Plant management support system
CN110138637A (en) Test data processing method, device, computer equipment and storage medium
CN109300112A (en) Instrument maintaining method and device based on AR
JP2013117812A (en) Plant monitoring information display system, plant monitoring information display device, and plant monitoring information display method
CN115576315A (en) Abnormity inspection method and device of inspection unit and electronic equipment
CN113206977B (en) Inspection monitoring method and device for gas station and storage medium
CN106296856A (en) Indoor polling path Display Technique based on RFID Yu GIS technology
JP2021002140A5 (en)

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190201

RJ01 Rejection of invention patent application after publication