CN102929391B - The dcs human-computer interaction device of augmented reality and method - Google Patents
The dcs human-computer interaction device of augmented reality and method Download PDFInfo
- Publication number
- CN102929391B CN102929391B CN201210407753.5A CN201210407753A CN102929391B CN 102929391 B CN102929391 B CN 102929391B CN 201210407753 A CN201210407753 A CN 201210407753A CN 102929391 B CN102929391 B CN 102929391B
- Authority
- CN
- China
- Prior art keywords
- chip microcomputer
- data
- card
- information
- dcs
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a kind of dcs human-computer interaction device based on augmented reality, it comprises the helmet mounted display device for augmented reality with explosion prevention function, pictorial symbolization card, server, radio transmission apparatus, described helmet mounted display device comprises display unit and single-chip microcomputer.Human-computer interaction device provided by the invention is for solving traditional dcs man-machine interaction mode underaction, data display and controlling to depart from on-the-spot problem, there is provided a sensory effects true for field staff and intuitively can browse and directly actuated brand-new working environment real time data, finally reaching and the object improving Yu strengthen is carried out to distributed control means man-machine interaction mode.
Description
Technical field
The invention belongs to virtual reality technology and safety engineering field, particularly based on the dcs human-computer interaction device of augmented reality.
Background technology
Virtual reality (Virtual Reality, VR) technique functions comes from the eighties in 20th century, in essence, it is the computer user interface technology of a kind of advanced person, by give user provide simultaneously such as depending on, listen, say, the various real-time perception interactive means directly perceived and natural such as to touch, user friendly operation to greatest extent, thus alleviate the burden of user, improve the work efficiency of whole system.Augmented reality (AugmentedReality, AR), as an important branch of virtual reality technology, is a kind ofly the dummy object of Practical computer teaching or out of Memory to be added in real scene, thus realizes the technology of reality being carried out to " enhancing ".
Traditional virtual reality technology comprises three features: feeling of immersion, interactivity, independence, emphasizes the Flow experience in Full-virtualization environment, and emphasizes that people can carry out interactive operation with the object in natural way and virtual world.Augmented reality is then devoted to the dummy object of Practical computer teaching or information superposition on real-world scene, thus non-existent virtual objects in generation actual environment, again by sensing technology by virtual objects accurately " placement " in true environment, and by display device, virtual objects and true environment are combined together, finally present to the real new environment of user's sensory effects.Therefore, augmented reality has the new feature of actual situation combination, real-time, interactive, three-dimensional registration.
DCS is the english abbreviation (Distributed Control System) of dcs, its implication utilizes single-chip microcomputer or Microcomputer Technology to manage concentratedly and decentralised control production run, that a kind of what be made up of process control level and process monitoring level take communication network as the multi-level computer system of tie, combine computing machine (Computer), communication (Communication), the 4C technology such as display (CRT) and control (Control), its basic thought is decentralised control, centralized operation, differentiated control, flexible configuration, configuration is convenient.
Since dcs was come out from 1975, experienced by the development course of two more than ten years, it inherits the advantage of conventional simulation blind controller system and centralized computer control system, overcome the dangerous high concentration of single Control System of Microcomputer and conventional instrument controlling functions single, the shortcoming of man-machine interface difference, production control and the operation control of commercial plant can be applied to easily, very universal in the application in the process automation fields such as chemical industry, electric power, metallurgy.But from the angle of terminal user's flexible Application, still there is following shortcoming and defect in current dcs in man-machine interaction:
1, dcs display terminal is mostly arranged in the independent housing interior (as Central Control Room) away from scene, and by indoor display screen, monitoring and management is carried out to operating performance of plant by full-time staff, this mode must cause scene to operate on the spot monitoring with house data being separated from each other, thus causes occurrence of a problem:
1) in Daily Round Check process, in the face of hundreds and thousands of data monitoring points, unless field staff's tirelessly cross-question and Indoor Video personnel have enough patience to answer one by one, otherwise he directly can not obtain real time data, most field staff can only with depending on, touch, the subjective experience such as to smell to judge work on the spot state, often easily ignore some critical minor fluctuations and change, thus hide some dangers for for safety in production.
2) when Indoor Video personnel find that fluctuating and needing to carry out manual handle by field staff appears in a certain critical data, information communication between the two just becomes particularly important, goes wrong, then must affect normal work strip once link up.
3) when device has an accident, for floor manager and rescue personnel, in time, accurately and grasp on-the-spot real-time status all sidedly and critical data most important, as whether the temperature of adjacent domain of catching fire, pressure can cause secondary disaster, whether rescue region has poisonous gas leaks, whether there is explosion danger etc., above-mentioned data and information often fast changing at the rescue site of complexity.Therefore, require that the Indoor Video personnel departing from the scene of the accident in time, accurately and comprehensively report that real time data seems and do not gear to actual circumstances.
2, dcs terminal demonstration interface often shows in the mode such as process flow diagram, schematic diagram, and data monitoring personnel only can see schematic identification data and cannot data and site environment and actual position thereof be linked together intuitively.
The existence part reason of the problems referred to above is the man-machine interaction mode underaction in dcs, and data display departs from scene with control, if a kind of improving one's methods can be taked to strengthen the dirigibility of man-machine interaction, then the problem above will be readily solved.
Summary of the invention
The present invention will solve man-machine interaction mode underaction in traditional distributed control system, and data display departs from on-the-spot problem with control.
For solving the problems of the technologies described above, the invention provides a kind of dcs human-computer interaction device based on augmented reality, it comprises the helmet mounted display device for augmented reality with explosion prevention function, pictorial symbolization card, server, radio transmission apparatus, described helmet mounted display device comprises display unit and single-chip microcomputer;
Described display unit comprises video camera, display and reflective mirror;
Described video camera is used for catching pictorial symbolization card graphical information and field staff's gesture information, and is transferred on single-chip microcomputer, in the identification of described single-chip microcomputer enterprising row labels card;
Described display is for receiving the virtual real time data played up through single-chip microcomputer and the virtual image obtained projected to combiner;
Described reflective mirror, then while reflex in the eye of user by the virtual image of display, allows the light in around true environment shine in, thus in the user visual field, present the lively image that actual situation combines.
Wherein, described single-chip microcomputer is provided with image identification system, graphics rendering system and the first wireless transmitting system;
Described graphics rendering system is used for playing up and drafting of simple two, three-dimensional picture or word;
The graphical information of described image identification system both for marking pictorial symbolization card carries out identifying fast, efficiently and accurately, also for identifying the image information of trainee's gesture;
Described first wireless transmitting system is used for the numerical information after image identification system identification being changed and is transferred to server and the real time data of reception server feedback or information.
Wherein, described server is provided with the second wireless transmitting system, data management and control system and aid decision-making system;
Described second wireless transmitting system for receiving the data of far-end single-chip microcomputer process, and passes the real time data after process on described server or information back far-end single-chip microcomputer;
Described data management and control system are after receiving remote data, it is processed, when data are manipulation information, described data management and control system are by the process control network transmission of dcs and perform to manipulate and order, otherwise described data management and control system retrieve real time data from procedural information net;
The current state of described aid decision-making system to real time data judges, for site operation personnel provides technical support and Operating Guideline, meanwhile, for preventing the maloperation of automatic control order, aid decision-making system is also responsible for carrying out screening to automatic control order and judging.
For solving the problems of the technologies described above, present invention also offers a kind of dcs human-computer interaction device based on augmented reality, it comprises the helmet mounted display device for augmented reality with explosion prevention function, pictorial symbolization card, server, radio transmission apparatus, described helmet mounted display device comprises display unit and single-chip microcomputer;
Described display unit comprises video camera, display and reflective mirror;
Described video camera is used for catching pictorial symbolization card graphical information and field staff's gesture information, and is transferred on single-chip microcomputer, in the identification of described single-chip microcomputer enterprising row labels card;
Described display is for receiving the virtual real time data played up through single-chip microcomputer and the virtual image obtained projected to combiner;
Described reflective mirror, then while reflex in the eye of user by the virtual image of display, allows the light in around true environment shine in, thus in the user visual field, present the lively image that actual situation combines;
Described single-chip microcomputer is provided with image identification system, graphics rendering system and the first wireless transmitting system;
Described graphics rendering system is used for playing up and drafting of simple two, three-dimensional picture or word;
The graphical information of described image identification system both for marking pictorial symbolization card carries out identifying fast, efficiently and accurately, also for identifying the image information of trainee's gesture;
Described first wireless transmitting system is used for the numerical information after recognition system identification being changed and is transferred to server and the real time data of reception server feedback or information;
Described server is provided with the second wireless transmitting system, data management and control system and aid decision-making system;
Described second wireless transmitting system for receiving the data of far-end single-chip microcomputer process, and passes the real time data after process on described server or information back far-end single-chip microcomputer;
Described data management and control system are after receiving remote data, it is processed, when data are manipulation information, described data management and control system are by the process control network transmission of dcs and perform to manipulate and order, otherwise described data management and control system retrieve real time data from procedural information net;
The current state of described aid decision-making system to real time data judges, for field staff provides technical support and Operating Guideline, meanwhile, for preventing the maloperation of automatic control order, aid decision-making system is also responsible for carrying out screening to automatic control order and judging;
Described pictorial symbolization card is drawn and has eye-catching indicia patterns, accurately identified by image identification system by video camera fast Acquisition indicia patterns.
Present invention also offers a kind of dcs, it comprises above-mentioned human-computer interaction device.
Wherein, described dcs further comprises procedural information net.
For solving the problems of the technologies described above, present invention also offers the method adopting above-mentioned human-computer interaction device to carry out man-machine interaction, it comprises:
The first step, the unique pictorial symbolization card of each the data monitoring Point matching for dcs;
Second step, is positioned on the position corresponding to factory site chemical plant monitoring point by pictorial symbolization card;
3rd step, operating personnel wear the helmet mounted display device with explosion prevention function and carry out patrolling and examining or dealing with an urgent situation, when there is pictorial symbolization card within sweep of the eye, camera is automatically caught all indicia patterns and is transferred to single-chip microcomputer, graphical information is converted to numerical information by the image identification system on single-chip microcomputer, server is transferred to again by the first wireless transmitting system on single-chip microcomputer, after server processes data, read related data by the procedural information net of dcs and sent back on-the-spot single-chip microcomputer by the second wireless transmitting system on server, by the graphics rendering system on single-chip microcomputer, data are graphically played up in pictorial symbolization card putting position again, by the display on helmet mounted display device and combiner virtual objects and true environment combined together subsequently and show, thus provide a sensory effects real brand-new operating environment for field staff.
Described man-machine interaction method also comprises further: when operating personnel need to carry out interactive operation, operational motion is responsible for catching by video camera and is transferred to the image identification system on single-chip microcomputer, simple operations is responded by single-chip microcomputer, first the operation relating to automatic control aspect then identifies through image identification system, by wireless transmitting system, the data after identification are transferred to server again, receive data by server and send automatic control order by the process control network of dcs again after process, completing corresponding automatic operation.
Present invention also offers above-mentioned human-computer interaction device and the application of above-mentioned dcs in Safe production of chemical industry.
The technique effect that the present invention is useful is:
This patent is for solving traditional dcs man-machine interaction mode underaction, data display departs from on-the-spot problem with control, on the basis not changing process units dcs general frame, with the augmented reality of advanced person, image recognition technology, based on network technology and singlechip technology, by superposing the virtual information of real time data in device on-site data monitoring point physical location, and by display device, virtual objects and true environment are combined together, thus provide a sensory effects true for field staff and intuitively can browse and directly actuated brand-new working environment real time data, finally reach and the object improving Yu strengthen is carried out to distributed control means man-machine interaction mode.
Accompanying drawing explanation
Fig. 1 the present invention comprises the overall frame structure figure of the dcs of human-computer interaction device;
Fig. 2 the present invention comprises the dcs schematic network structure of human-computer interaction device;
The on-the-spot schematic diagram of Fig. 3 human-computer interaction device's principle of work for dcs provided by the invention;
Fig. 4 human-computer interaction device's workflow diagram provided by the invention;
Reference numeral is as follows: 1-helmet mounted display device; 2-video camera; 3-display; 4-reflective mirror; 5-single-chip microcomputer; 6-virtual scene; 7-real scene.
Embodiment
The present invention is on the basis not changing traditional distributed control system overall architecture, by augmented reality is introduced dcs, real scene and virtual real time data are superimposed, thus allow site operation personnel can accurately, vividly and comprehensively understand process units actual working state in chemical industry factory, realize improvement and the enhancing of dcs man-machine interaction mode.
Dcs human-computer interaction device based on augmented reality of the present invention comprises the helmet mounted display device for augmented reality with explosion prevention function, pictorial symbolization card, server, radio transmission apparatus, described helmet mounted display device comprises display unit and single-chip microcomputer.
Further, described human-computer interaction device is only made up of above-mentioned parts.
Described display unit comprises video camera, display and combiner;
Described video camera is used for catching pictorial symbolization card graphical information and field staff's gesture information, and is transferred on single-chip microcomputer, utilizes the image identification system that single-chip microcomputer is arranged to carry out badge card identification;
Described display is for receiving the virtual real time data played up by the graphics rendering system be arranged on single-chip microcomputer and the virtual image obtained projected to combiner;
Described combiner, then while reflex in the eye of user by the real-time imaging of display, allows the light in around true environment shine in, thus in the user visual field, present the lively image that actual situation combines.
Further, described display device is only made up of video camera, display and combiner.
Described single-chip microcomputer is provided with image identification system, graphics rendering system and the first wireless transmitting system;
Described graphics rendering system is used for playing up and drafting of simple two, three-dimensional picture or word;
Described image identification system adopts ripe video identification technology, and the graphical information both for marking pictorial symbolization card carries out identifying fast, efficiently and accurately, also for identifying the image information of trainee's gesture;
Described first wireless transmitting system adopts ripe Radio Transmission Technology, is transferred to server and the real time data of reception server feedback or information for the numerical information after image identification system identification being changed.
Described single-chip microcomputer is specially singlechip chip.
Described server is provided with the second wireless transmitting system, data management and control system and aid decision-making system;
Described second wireless transmitting system for receiving the data of far-end single-chip microcomputer process, and passes the real time data after process on described server or information back far-end single-chip microcomputer;
Described data management and control system are after receiving remote data, it is processed, when data are manipulation information, described data management and control system are by the process control network transmission of dcs and perform to manipulate and order, otherwise described data management and control system retrieve real time data from procedural information net;
The current state of described aid decision-making system to real time data judges, for field staff provides technical support and Operating Guideline, meanwhile, for preventing the maloperation of automatic control order, aid decision-making system is also responsible for carrying out screening to automatic control order and judging.
Single-chip microcomputer in the present invention is also called Single Chip Microcomputer (SCM) system, and it comprises central processor CPU, memory RAM, read only memory ROM, I/O interface, interrupt system, timer etc., is a microcomputer not having display.The volume of single-chip microcomputer is very little, and so just can be embedded in safety helmet, trainee has on the safety helmet that single-chip microcomputer is housed and walks everywhere, could carry out image procossing to seen scene.Information after single-chip microcomputer process, the server be in away from scene in fixing room is transferred to by wireless system, further process is done by server, information after server process returns the safety helmet that Single Chip Microcomputer (SCM) system is housed again by wireless transmission, the Main Function of radio processing system is Single Chip Microcomputer (SCM) system in movement and transmission information between fixing server.
Described display is specifically as follows optical perspective helmet display device (S-HMD).
Described combiner is specifically as follows reflective mirror.
Data monitoring point unique match in pictorial symbolization card described in each and a dcs, and pictorial symbolization card is positioned in the factory site physical location of described data monitoring point, described pictorial symbolization card is drawn and has eye-catching indicia patterns, accurately identified by image identification system by video camera fast Acquisition indicia patterns.
Present invention also offers a kind of dcs human-computer interaction device based on augmented reality, it comprises the helmet mounted display device for augmented reality with explosion prevention function, pictorial symbolization card, server, radio transmission apparatus, described helmet mounted display device comprises display unit and single-chip microcomputer;
Described display unit comprises video camera, display and combiner;
Described video camera is used for catching pictorial symbolization card graphical information and field staff's gesture information, and is transferred to the image identification system be positioned on single-chip microcomputer;
Described display is for receiving the virtual real time data played up by the graphics rendering system be arranged on single-chip microcomputer and the virtual image obtained projected to combiner;
Described combiner, then while reflex in the eye of user by the image of display, allows the light in around true environment shine in, thus in the user visual field, present the lively image that actual situation combines;
Described single-chip microcomputer is provided with image identification system, graphics rendering system and the first wireless transmitting system;
Described graphics rendering system is used for playing up and drafting of simple two, three-dimensional picture or word;
Described image identification system adopts ripe video identification technology, and the graphical information both for marking pictorial symbolization card carries out identifying fast, efficiently and accurately, also for identifying the image information of trainee's gesture;
Described first wireless transmitting system adopts ripe Radio Transmission Technology, is transferred to server and the real time data of reception server feedback or information for the numerical information after recognition system identification being changed;
Described server is provided with the second wireless transmitting system, data management and control system and aid decision-making system;
Described second wireless transmitting system for receiving the data of far-end single-chip microcomputer process, and passes the real time data after process on described server or information back far-end single-chip microcomputer;
Described data management and control system are after receiving remote data, it is processed, when data are manipulation information, described data management and control system are by the process control network transmission of dcs and perform to manipulate and order, otherwise described data management and control system retrieve real time data from procedural information net;
The current state of described aid decision-making system to real time data judges, for field staff provides technical support and Operating Guideline, meanwhile, for preventing the maloperation of automatic control order, aid decision-making system is also responsible for carrying out screening to automatic control order and judging;
Described pictorial symbolization card is drawn and has eye-catching indicia patterns, accurately identified by image identification system by video camera fast Acquisition indicia patterns.
Further, described human-computer interaction device is only by above-mentioned parts and System's composition.
Present invention also offers a kind of dcs, this system comprises above-mentioned human-computer interaction device.
Further, dcs provided by the invention also comprises the conventional equipment that traditional dcs has, as procedural information net.
Present invention also offers the method adopting above-mentioned human-computer interaction device to carry out man-machine interaction, it comprises:
The first step, the unique pictorial symbolization card of each the data monitoring Point matching for dcs;
Second step, is positioned on the position corresponding to factory site chemical plant monitoring point by pictorial symbolization card;
3rd step, operating personnel wear the helmet mounted display device with explosion prevention function and carry out patrolling and examining or dealing with an urgent situation, when there is pictorial symbolization card within sweep of the eye, camera is automatically caught all indicia patterns and is transferred to single-chip microcomputer, graphical information is converted to numerical information by the image identification system on single-chip microcomputer, server is transferred to again by the first wireless transmitting system on single-chip microcomputer, after server processes data, read related data by the procedural information net of dcs and sent back on-the-spot single-chip microcomputer by the second wireless transmitting system on server, by the graphics rendering system on single-chip microcomputer, data are graphically played up in pictorial symbolization card putting position again, by the display on helmet mounted display device and combiner virtual objects and true environment combined together subsequently and show, thus provide a sensory effects real brand-new operating environment for field staff.
Described man-machine interaction method also comprises further: when operating personnel need to carry out interactive operation, operational motion is responsible for catching by video camera and is transferred to the image identification system on single-chip microcomputer, simple operations is responded by single-chip microcomputer, first the operation relating to automatic control aspect then identifies through image identification system, by wireless transmitting system, the data after identification are transferred to server again, receive data by server and send automatic control order by the process control network of dcs again after process.
Described simple operations refers to the operation not relating to automatic control aspect, and this simple operations is directly undertaken processing by " Single Chip Microcomputer (SCM) system " does not need data to transmit back server.
Human-computer interaction device of the present invention uses the helmet mounted display device with the portable augmented reality of explosion prevention function, make it scene of being convenient to carry and the basic demand meeting safety in production, select explosion-proof, anticorrosion, antistatic material, make figure badge card, described material is specifically as follows epoxy resin or urethane resin, for marking the key position of shop equipment, simultaneously, based on efficient video processing technique, exploitation badge card system for rapidly identifying, for identifying fast and matched indicia card information, with optical perspective helmet display device (S-HMD) for reference device, utilize existing mature technology, realize efficient video combiner, the exploitation of display and video camera, true environment and virtual information are perfectly merged and is presented on display unit, based on singlechip technology, exploitation has Image Rendering, wireless transmission, the microprocessing systems of the functions such as figure identification, based on existing wireless interconnection technology, and when ensureing chemical plant installations safety in production, realize the efficient wireless transmission of dcs real time data.
Present invention also offers above-mentioned dcs and the application of human-computer interaction device in Safe production of chemical industry process.
Describe embodiments of the present invention in detail below with reference to drawings and Examples, to the present invention, how application technology means solve technical matters whereby, and the implementation procedure reaching technique effect can fully understand and implement according to this.
As shown in Figure 3, helmet mounted display device 1 comprises the display device and single-chip microcomputer 5 that video camera 2, display 3 and the half-mirror 4 as combiner form, and display 3 is for receiving the virtual real time data played up by the graphics rendering system be arranged on single-chip microcomputer 5 and the virtual image 6 obtained projected to half-mirror 4; Described half-mirror 4, while reflex in the eye of user by the virtual image 6 of display 3, allows the light in around real scene 7 shine in, thus in the user visual field, present the lively image that actual situation combines.
As depicted in figs. 1 and 2, the helmet mounted display device 1 comprising Fig. 3 display for the human-computer interaction device in dcs of the present invention, pictorial symbolization card, server, radio transmission apparatus, pictorial symbolization card (the E-51 epoxy resin (product type 618) produced by science, industry and trade company limited in Qingdao City is made), helmet mounted display device 4 comprises display unit and single-chip microcomputer, described display unit comprises the video camera 2 of Fig. 3 display, display 3 and the reflective mirror 4 as combiner, single-chip microcomputer 5 is provided with image identification system, graphics rendering system and the first wireless transmitting system, described graphics rendering system is used for simple two, playing up and drafting of three-dimensional picture or word, the graphical information of described image identification system both for marking pictorial symbolization card is carried out fast, efficiently and accurately identify, also for identifying the image information of trainee's gesture, described first wireless transmitting system is used for the numerical information after image identification system identification being changed and is transferred to server and the real time data of reception server feedback or information, described server is provided with the second wireless transmitting system, data management and control system and aid decision-making system, described second wireless transmitting system is for receiving the data of far-end single-chip microcomputer process, and pass the real time data after process on described server or information back far-end single-chip microcomputer, described data management and control system are after receiving remote data, it is processed, when data are manipulation information, described data management and control system are by the process control network transmission of dcs and perform to manipulate and order, otherwise, described data management and control system retrieve real time data from procedural information net, the current state of described aid decision-making system to real time data judges, for site operation personnel provides technical support and Operating Guideline, simultaneously, for preventing the maloperation of automatic control order, aid decision-making system is also responsible for carrying out screening to automatic control order and judging.
As shown in Figure 4, the principle of work of described human-computer interaction device is as follows: for dcs number each according to monitoring point Matching Uninqueness pictorial symbolization card, pictorial symbolization card is positioned on the position corresponding to factory site chemical plant monitoring point, operating personnel wear the helmet mounted display device with explosion prevention function and carry out patrolling and examining or dealing with an urgent situation, when there is pictorial symbolization card within sweep of the eye, camera is automatically caught all indicia patterns and is transferred to single-chip microcomputer, graphical information is converted to numerical information by the image identification system on single-chip microcomputer, server is transferred to again by the first wireless transmitting system on single-chip microcomputer, data management on described server and control system are after receiving remote data, it is processed, when data are manipulation information, described data management and control system are by the process control network transmission of dcs and perform to manipulate and order, otherwise, described data management and control system retrieve real time data from procedural information net, judged by the current state of the aid decision-making system on described server to real time data again, for site operation personnel provides technical support and Operating Guideline, simultaneously, for preventing the maloperation of automatic control order, aid decision-making system is also responsible for carrying out screening to automatic control order and judging, after server processes data, read related data by the procedural information net of dcs and sent back on-the-spot single-chip microcomputer by the second wireless transmitting system on server, by the graphics rendering system on single-chip microcomputer, data are graphically played up in pictorial symbolization card putting position again, by the display on helmet mounted display device and combiner virtual objects and true environment combined together subsequently and show, thus provide a sensory effects real brand-new operating environment for field staff, and when operating personnel need to carry out interactive operation, operational motion is responsible for catching by video camera and is transferred to the image identification system on single-chip microcomputer, simple operations is responded by single-chip microcomputer, first the operation relating to automatic control aspect then identifies through image identification system, by wireless transmitting system, the data after identification are transferred to server again, receive data by server and send automatic control order by the process control network of dcs again after process.
All above-mentioned this intellecture properties of primary enforcement, not setting restriction this new product of other forms of enforcement and/or new method.Those skilled in the art will utilize this important information, and foregoing is revised, to realize similar implementation status.But all modifications or transformation belong to the right of reservation based on new product of the present invention.
The above is only preferred embodiment of the present invention, and be not restriction the present invention being made to other form, any those skilled in the art may utilize the technology contents of above-mentioned announcement to be changed or be modified as the Equivalent embodiments of equivalent variations.But everyly do not depart from technical solution of the present invention content, any simple modification, equivalent variations and the remodeling done above embodiment according to technical spirit of the present invention, still belong to the protection domain of technical solution of the present invention.
Claims (8)
1. based on the dcs human-computer interaction device of augmented reality, it is characterized in that: by the helmet mounted display device for augmented reality with explosion prevention function, pictorial symbolization card, server, radio transmission apparatus is formed, and described helmet mounted display device comprises display unit and single-chip microcomputer;
Described display unit comprises video camera, display and combiner;
Described video camera is used for catching pictorial symbolization card graphical information and field staff's gesture information, and is transferred on single-chip microcomputer, in the identification of described single-chip microcomputer enterprising row labels card;
Described display is for receiving the virtual real time data played up through single-chip microcomputer and the virtual image obtained projected to combiner;
Described combiner, then while reflex in the eye of user by the virtual image of display, allows the light in around true environment shine in, thus in the user visual field, present the lively image that actual situation combines;
Data monitoring point unique match in pictorial symbolization card described in each and a dcs, and pictorial symbolization card is positioned in the factory site physical location of described data monitoring point, described pictorial symbolization card is drawn and has eye-catching indicia patterns, accurately identified by image identification system by video camera fast Acquisition indicia patterns.
2. human-computer interaction device as claimed in claim 1, is characterized in that: described single-chip microcomputer is provided with image identification system, graphics rendering system and the first wireless transmitting system;
Described graphics rendering system is used for playing up and drafting of simple two, three-dimensional picture or word;
The graphical information of described image identification system both for marking pictorial symbolization card carries out identifying fast, efficiently and accurately, also for identifying the image information of trainee's gesture;
Described first wireless transmitting system is used for the numerical information after image identification system identification being changed and is transferred to server and the real time data of reception server feedback or information.
3. human-computer interaction device as claimed in claim 1 or 2, is characterized in that: on described server, be provided with the second wireless transmitting system, data management and control system and aid decision-making system;
Described second wireless transmitting system for receiving the data of far-end single-chip microcomputer process, and passes the real time data after process on described server or information back far-end single-chip microcomputer;
Described data management and control system are after receiving remote data, it is processed, when data are manipulation information, described data management and control system are by the process control network transmission of dcs and perform to manipulate and order, otherwise described data management and control system retrieve real time data from procedural information net;
The current state of described aid decision-making system to real time data judges, for site operation personnel provides technical support and Operating Guideline, meanwhile, for preventing the maloperation of automatic control order, aid decision-making system is also responsible for carrying out screening to automatic control order and judging.
4., based on the dcs human-computer interaction device of augmented reality, it is characterized in that: by the helmet mounted display device for augmented reality with explosion prevention function, pictorial symbolization card, server, radio transmission apparatus, described helmet mounted display device comprises display unit and single-chip microcomputer is formed;
Described display unit comprises video camera, display and combiner;
Described video camera is used for catching pictorial symbolization card graphical information and field staff's gesture information, and is transferred on single-chip microcomputer, in the identification of described single-chip microcomputer enterprising row labels card;
Described display is for receiving the virtual real time data played up through single-chip microcomputer and the virtual image obtained projected to combiner;
Described combiner, then while reflex in the eye of user by the virtual image of display, allows the light in around true environment shine in, thus in the user visual field, present the lively image that actual situation combines;
Data monitoring point unique match in pictorial symbolization card described in each and a dcs, and pictorial symbolization card is positioned in the factory site physical location of described data monitoring point, described pictorial symbolization card is drawn and has eye-catching indicia patterns, accurately identified by image identification system by video camera fast Acquisition indicia patterns;
Described single-chip microcomputer is provided with image identification system, graphics rendering system and the first wireless transmitting system;
Described graphics rendering system is used for playing up and drafting of simple two, three-dimensional picture or word;
The graphical information of described image identification system both for marking pictorial symbolization card carries out identifying fast, efficiently and accurately, also for identifying the image information of trainee's gesture;
Described first wireless transmitting system is used for the numerical information after recognition system identification being changed and is transferred to server and the real time data of reception server feedback or information;
Described server is provided with the second wireless transmitting system, data management and control system and aid decision-making system;
Described second wireless transmitting system for receiving the data of far-end single-chip microcomputer process, and passes the real time data after process on described server or information back far-end single-chip microcomputer;
Described data management and control system are after receiving remote data, it is processed, when data are manipulation information, described data management and control system are by the process control network transmission of dcs and perform to manipulate and order, otherwise described data management and control system retrieve real time data from procedural information net;
The current state of described aid decision-making system to real time data judges, for field staff provides technical support and Operating Guideline, meanwhile, for preventing the maloperation of automatic control order, aid decision-making system is also responsible for carrying out screening to automatic control order and judging;
Described pictorial symbolization card is drawn and has eye-catching indicia patterns, accurately identified by image identification system by video camera fast Acquisition indicia patterns.
5. dcs, is characterized in that, comprising: the human-computer interaction device described in claim 1 or 2.
6. dcs as claimed in claim 5, is characterized in that: described dcs further comprises procedural information net.
7. adopt the human-computer interaction device described in claim 1 or 2 to carry out the method for man-machine interaction, it is characterized in that, comprising:
The first step, the unique pictorial symbolization card of each the data monitoring Point matching for dcs;
Second step, is positioned on the position corresponding to factory site chemical plant monitoring point by pictorial symbolization card;
3rd step, operating personnel wear the helmet mounted display device with explosion prevention function and carry out patrolling and examining or dealing with an urgent situation, when there is pictorial symbolization card within sweep of the eye, camera is automatically caught all indicia patterns and is transferred to single-chip microcomputer, graphical information is converted to numerical information by the image identification system on single-chip microcomputer, server is transferred to again by the first wireless transmitting system on single-chip microcomputer, after server processes data, read related data by the procedural information net of dcs and sent back on-the-spot single-chip microcomputer by the second wireless transmitting system on server, by the graphics rendering system on single-chip microcomputer, data are graphically played up in pictorial symbolization card putting position again, by the display on helmet mounted display device and combiner virtual objects and true environment combined together subsequently and show, thus provide a sensory effects real brand-new operating environment for field staff.
8. man-machine interaction method as claimed in claim 7, it is characterized in that: when operating personnel need to carry out interactive operation, operational motion is responsible for catching by video camera and is transferred to the image identification system on single-chip microcomputer, simple operations is responded by single-chip microcomputer, first the operation relating to automatic control aspect then identifies through image identification system, by wireless transmitting system, the data after identification are transferred to server again, receive data by server and send automatic control order by the process control network of dcs again after process, complete corresponding automatic operation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210407753.5A CN102929391B (en) | 2012-10-23 | 2012-10-23 | The dcs human-computer interaction device of augmented reality and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210407753.5A CN102929391B (en) | 2012-10-23 | 2012-10-23 | The dcs human-computer interaction device of augmented reality and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102929391A CN102929391A (en) | 2013-02-13 |
| CN102929391B true CN102929391B (en) | 2015-11-04 |
Family
ID=47644216
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210407753.5A Active CN102929391B (en) | 2012-10-23 | 2012-10-23 | The dcs human-computer interaction device of augmented reality and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102929391B (en) |
Families Citing this family (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10109075B2 (en) * | 2013-03-15 | 2018-10-23 | Elwha Llc | Temporal element restoration in augmented reality systems |
| US9245388B2 (en) | 2013-05-13 | 2016-01-26 | Microsoft Technology Licensing, Llc | Interactions of virtual objects with surfaces |
| US10509533B2 (en) * | 2013-05-14 | 2019-12-17 | Qualcomm Incorporated | Systems and methods of generating augmented reality (AR) objects |
| CN103310045B (en) * | 2013-05-28 | 2015-12-23 | 山东师范大学 | One utilizes augmented reality to carry out the large molecule three-dimensional visualization method of crystal |
| US20150092040A1 (en) * | 2013-10-01 | 2015-04-02 | Broadcom Corporation | Gesture-Based Industrial Monitoring |
| JP6344311B2 (en) * | 2015-05-26 | 2018-06-20 | ソニー株式会社 | Display device, information processing system, and control method |
| WO2017079910A1 (en) * | 2015-11-11 | 2017-05-18 | 周谆 | Gesture-based virtual reality human-machine interaction method and system |
| CN105446481A (en) * | 2015-11-11 | 2016-03-30 | 周谆 | Gesture based virtual reality human-machine interaction method and system |
| CN106572353A (en) * | 2016-10-21 | 2017-04-19 | 上海拆名晃信息科技有限公司 | Wireless transmission method and wireless transmission device for virtual reality, terminal, and head-mounted display equipment |
| CN106657368B (en) * | 2016-12-31 | 2019-12-27 | 山东汇佳软件科技股份有限公司 | Server management method and system based on augmented reality |
| CN107610269A (en) * | 2017-09-12 | 2018-01-19 | 国网上海市电力公司 | A kind of power network big data intelligent inspection system and its intelligent polling method based on AR |
| CN107644457B (en) * | 2017-09-14 | 2021-02-12 | 中国航空工业集团公司沈阳空气动力研究所 | Monitoring method applied to industrial site |
| CN109947052B (en) * | 2017-12-20 | 2022-02-08 | 中国科学院沈阳自动化研究所 | Virtual factory manufacturing execution system and method based on digital AR technology |
| CN111415431A (en) * | 2020-02-26 | 2020-07-14 | 国网宁夏电力有限公司电力科学研究院 | Inspection method and system for transformer substation, control platform and wearable device |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1522895A (en) * | 2003-09-11 | 2004-08-25 | 辰 丁 | Multifunctional vehicle real-time monitoring system (GSM/GPRS) |
| CN1854460A (en) * | 2005-04-25 | 2006-11-01 | 王宁 | Oil-well realtime monitoring system and its controlling method |
| CN101214178A (en) * | 2007-12-26 | 2008-07-09 | 北京理工大学 | Video frequency reinforcing reality auxiliary operation welding protection helmet |
| CN101349903A (en) * | 2008-08-06 | 2009-01-21 | 兖矿国泰化工有限公司 | Safety production early-warning system of coal chemical engineering enterprise |
| CN101917489A (en) * | 2010-08-26 | 2010-12-15 | 中国石油集团川庆钻探工程有限公司 | Well site information remote transmission and network publishing method |
| CN201673267U (en) * | 2010-05-18 | 2010-12-15 | 山东师范大学 | Life detection and rescue system based on augmented reality |
| CN201813483U (en) * | 2010-09-01 | 2011-04-27 | 黑龙江圣亚科技发展有限公司 | Mobile safety-production monitor terminal based on wireless sensor network |
| CN102314165A (en) * | 2010-07-05 | 2012-01-11 | 上海盛锐软件技术有限公司 | PLM (programmable logic matrix)-based RFID (radio frequency identification device) control system for industrial production line and method |
| CN102735100A (en) * | 2012-06-08 | 2012-10-17 | 重庆邮电大学 | Individual light weapon shooting training method and system by using augmented reality technology |
| CN102739872A (en) * | 2012-07-13 | 2012-10-17 | 苏州梦想人软件科技有限公司 | Mobile terminal, and augmented reality method used for mobile terminal |
-
2012
- 2012-10-23 CN CN201210407753.5A patent/CN102929391B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1522895A (en) * | 2003-09-11 | 2004-08-25 | 辰 丁 | Multifunctional vehicle real-time monitoring system (GSM/GPRS) |
| CN1854460A (en) * | 2005-04-25 | 2006-11-01 | 王宁 | Oil-well realtime monitoring system and its controlling method |
| CN101214178A (en) * | 2007-12-26 | 2008-07-09 | 北京理工大学 | Video frequency reinforcing reality auxiliary operation welding protection helmet |
| CN101349903A (en) * | 2008-08-06 | 2009-01-21 | 兖矿国泰化工有限公司 | Safety production early-warning system of coal chemical engineering enterprise |
| CN201673267U (en) * | 2010-05-18 | 2010-12-15 | 山东师范大学 | Life detection and rescue system based on augmented reality |
| CN102314165A (en) * | 2010-07-05 | 2012-01-11 | 上海盛锐软件技术有限公司 | PLM (programmable logic matrix)-based RFID (radio frequency identification device) control system for industrial production line and method |
| CN101917489A (en) * | 2010-08-26 | 2010-12-15 | 中国石油集团川庆钻探工程有限公司 | Well site information remote transmission and network publishing method |
| CN201813483U (en) * | 2010-09-01 | 2011-04-27 | 黑龙江圣亚科技发展有限公司 | Mobile safety-production monitor terminal based on wireless sensor network |
| CN102735100A (en) * | 2012-06-08 | 2012-10-17 | 重庆邮电大学 | Individual light weapon shooting training method and system by using augmented reality technology |
| CN102739872A (en) * | 2012-07-13 | 2012-10-17 | 苏州梦想人软件科技有限公司 | Mobile terminal, and augmented reality method used for mobile terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102929391A (en) | 2013-02-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102929391B (en) | The dcs human-computer interaction device of augmented reality and method | |
| US20210343182A1 (en) | Virtual-reality-based personal protective equipment training system | |
| US20110029897A1 (en) | Virtual World Building Operations Center | |
| CN102930753A (en) | Gas station virtual training system and application | |
| CN112130478A (en) | Building integrated comprehensive management and control platform system based on BIM and management and control method thereof | |
| CN107256652A (en) | Training on electric power Comprehensive Control experience system | |
| CN102968915A (en) | Chemical device training management device, device knowledge base and training management system | |
| CN103716324B (en) | Virtual mine risk-taking behavior implementation system and method based on multiple agents | |
| CN109102731A (en) | VR-based transformer substation simulation platform and method | |
| CN110311468A (en) | Substation's three-dimensional live abnormality monitoring method, system, device and storage medium | |
| CN112578907A (en) | Method and device for realizing remote guidance operation based on AR | |
| CN111127974A (en) | Virtual reality and augmented reality three-dimensional application service platform for transformer substation operation | |
| CN110471804A (en) | Apparatus debugging method, device and electronic equipment | |
| CN203259968U (en) | Man-machine interaction device capable of augmenting reality and distributed control device with same | |
| CN110363118A (en) | Behavior monitoring method, apparatus, system and the storage medium of target object | |
| CN104506388A (en) | IDC (internet data center) monitoring method and system combined with AR (augmented reality) technology | |
| CN112306233A (en) | Inspection method, inspection system and inspection management platform | |
| CN107591038A (en) | A kind of pole transformer stops the simulated operation interactive system of multiple labour | |
| CN112991857A (en) | Electric power emergency rescue training system and method | |
| CN106952529B (en) | The safe drilling method of transformer station's crane operation, device and system | |
| CN115793673B (en) | VR technology-based natural gas station robot inspection method and device | |
| CN113128716A (en) | Operation guidance interaction method and system | |
| CN111754834A (en) | Electric power training method based on virtual reality | |
| CN115797824A (en) | Unmanned aerial vehicle power construction violation identification method and device based on artificial intelligence | |
| CN115346414A (en) | Fire-fighting training and practicing evaluation method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |