CN102929391A - Reality augmented distributed control system human-computer interactive equipment and method - Google Patents
Reality augmented distributed control system human-computer interactive equipment and method Download PDFInfo
- Publication number
- CN102929391A CN102929391A CN2012104077535A CN201210407753A CN102929391A CN 102929391 A CN102929391 A CN 102929391A CN 2012104077535 A CN2012104077535 A CN 2012104077535A CN 201210407753 A CN201210407753 A CN 201210407753A CN 102929391 A CN102929391 A CN 102929391A
- Authority
- CN
- China
- Prior art keywords
- chip microcomputer
- data
- information
- server
- card
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses augmented reality-based distributed control system human-computer interactive equipment. The equipment comprises a helmet display device which has an explosion-proof function and is used for augmenting reality, a graph making card, a server and wireless transmission equipment, wherein the helmet display device comprises a display component and a singlechip. The human-computer interactive equipment provided by the invention is used for solving the problems that the conventional distributed control system human-computer interactive mode is not flexible enough, and data display and data control are separated from a field; a brand new work environment which provides a true sensory effect and in which real-time data can be intuitively browsed and directly controlled is provided for field staff; and finally, the aims of improving and augmenting the distributed control system human-computer interactive mode are fulfilled.
Description
Technical field
The invention belongs to virtual reality technology and safety engineering field, particularly based on the dcs human-computer interaction device of augmented reality.
Background technology
Virtual reality (Virtual Reality, VR) technique functions comes from the eighties in 20th century, in essence, it is a kind of advanced person's computer user interface technology, by providing simultaneously such as various directly perceived and natural real-time perception interactive meanses such as looking, listen, say, touch for the user, to greatest extent user friendly operation, thus user's burden alleviated, improve the work efficiency of whole system.Augmented reality (Augmented Reality, AR) is as an important branch of virtual reality technology, is that a kind of dummy object that computing machine is generated or out of Memory are added in the real scene, thereby realizes technology that reality is carried out " enhancing ".
Traditional virtual reality technology comprises three characteristics: feeling of immersion, interactivity, independence, and emphasize the Flow experience in the Full-virtualization environment, and emphasize that the people can carry out interactive operation with the object in natural way and the virtual world.Augmented reality then is devoted to dummy object that computing machine is generated or information and is added on the real scenery, thereby non-existent virtual objects in the generation actual environment, again by sensing technology with virtual objects accurately " placement " in true environment, and by display device virtual objects and true environment are combined together, finally present to the real new environment of sensory effects of user.Therefore, augmented reality has the new feature of actual situation combination, real-time, interactive, three-dimensional registration.
DCS is the english abbreviation (Distributed Control System) of dcs, its implication is to utilize single-chip microcomputer or Microcomputer Technology that production run is managed concentratedly and decentralised control, it is a kind of multi-level computer system take communication network as tie that is formed by process control level and process monitoring level, combine computing machine (Computer), communication (Communication), show (CRT) and control 4C technology such as (Control), its basic thought is decentralised control, centralized operation, differentiated control, flexible configuration, configuration is convenient.
Dcs is since 1975 come out, experienced the development course of two more than ten years, it has inherited the advantage of conventional simulation blind controller system and computing machine centralized control system, the dangerous high concentration of single Control System of Microcomputer and conventional instrument control function singleness have been overcome, the shortcoming that man-machine interface is poor, can be applied to easily production control and the operation control of commercial plant, very universal in the application in the process automation fields such as chemical industry, electric power, metallurgy.Yet from the angle of terminal user's flexible Application, still there is following shortcoming and defect in current dcs aspect man-machine interaction:
1, the dcs display terminal mostly is arranged in away from interior (such as Central Control Room) between the independent housing at scene, and operating performance of plant is monitored and managed by indoor display screen by the full-time staff, this mode must cause the scene to operate with indoor data monitoring on the spot being separated from each other, thereby causes occurrence of a problem:
1) in the Daily Round Check process, in the face of hundreds and thousands of data monitoring points, unless field staff tirelessly cross-question and Indoor Video personnel has enough patience to answer one by one, otherwise he can not directly obtain real time data, most field staff can only judge the work on the spot state with subjective experiences such as looking, touch, smell, often easily ignore some critical minor fluctuations and variation, thereby hide some dangers for for keeping the safety in production.
2) when the Indoor Video personnel found that a certain critical data fluctuation occurs and need to carry out manual handle by the field staff, it is particularly important that information communication between the two just becomes, and goes wrong in case link up, and then must bring impact to normal operation.
3) have an accident when device, for floor manager and rescue personnel, in time, accurately and all sidedly grasp on-the-spot real-time status and critical data most important, as whether the temperature of the adjacent domain of catching fire, pressure can cause secondary disaster, whether the rescue zone has poisonous gas leaks, whether have explosion danger etc., above-mentioned data and information are often fast changing at the rescue site of complexity.Therefore, the Indoor Video personnel that require to break away from the scene of the accident report in time, accurately and comprehensively that real time data seems and do not gear to actual circumstances.
2, dcs terminal display interface often shows in modes such as process flow diagram, schematic diagram, and the data monitoring personnel only can see schematic identification data and can't be intuitively data and site environment and actual position thereof be linked together.
The existence part reason of the problems referred to above is the man-machine interaction mode underaction in the dcs, and data demonstration and control break away from on-the-spot, if can take a kind of dirigibility of the enhancing man-machine interaction of improving one's methods, then top problem will be readily solved.
Summary of the invention
The present invention will solve man-machine interaction mode underaction in the traditional distributed control system, and data show the problem that breaks away from the scene with control.
For solving the problems of the technologies described above, the invention provides a kind of dcs human-computer interaction device based on augmented reality, it comprises the helmet mounted display device that is used for augmented reality with explosion prevention function, the pictorial symbolization card, server, radio transmission apparatus, described helmet mounted display device comprises display unit and single-chip microcomputer;
Described display unit comprises video camera, display and reflective mirror;
Described video camera is used for catching pictorial symbolization card graphical information and field staff's gesture information, and it is transferred on the single-chip microcomputer, in the enterprising row labels card identification of described single-chip microcomputer;
Described display be used for to receive the virtual real time data of playing up through single-chip microcomputer and the virtual image that obtains and it is projected to combiner;
Described reflective mirror then reflexes to the virtual image of display in user's the eye on one side, Yi Bian allow the light in the true environment on every side shine in, thus in the user visual field, present the lively image of actual situation combination.
Wherein, be provided with image identification system, graphic plotting system and the first wireless transmitting system on the described single-chip microcomputer;
That described graphic plotting system is used for is simple two, the playing up and drawing of three-dimensional picture or literal;
Described image identification system both had been used for the graphical information of pictorial symbolization card institute mark is carried out fast, efficiently and accurately identified, and also was used for the image information of identification trainee gesture;
Described the first wireless transmitting system is used for the numerical information after the image identification system identification conversion is transferred to real time data or the information of server and reception server feedback.
Wherein, be provided with the second wireless transmitting system, data management and control system and aid decision-making system at described server;
Described the second wireless transmitting system is used for receiving the data that the far-end single-chip microcomputer was processed, and passes real time data or information after described server is processed back the far-end single-chip microcomputer;
Described data management and control system are after receiving remote data, it is processed, when data when controlling information, described data management and control system are controlled order by process control network transmission and the execution of dcs, otherwise described data management and control system are from procedural information net retrieval real time data;
Described aid decision-making system judges the current state of real time data, and for the site operation personnel provides technical support and Operating Guideline, simultaneously, for preventing the maloperation of automatic control order, aid decision-making system also is responsible for the automatic control order is screened and judged.
For solving the problems of the technologies described above, the present invention also provides a kind of dcs human-computer interaction device based on augmented reality, it comprises the helmet mounted display device that is used for augmented reality with explosion prevention function, the pictorial symbolization card, server, radio transmission apparatus, described helmet mounted display device comprises display unit and single-chip microcomputer;
Described display unit comprises video camera, display and reflective mirror;
Described video camera is used for catching pictorial symbolization card graphical information and field staff's gesture information, and it is transferred on the single-chip microcomputer, in the enterprising row labels card identification of described single-chip microcomputer;
Described display be used for to receive the virtual real time data of playing up through single-chip microcomputer and the virtual image that obtains and it is projected to combiner;
Described reflective mirror then reflexes to the virtual image of display in user's the eye on one side, Yi Bian allow the light in the true environment on every side shine in, thus in the user visual field, present the lively image of actual situation combination;
Be provided with image identification system, graphic plotting system and the first wireless transmitting system on the described single-chip microcomputer;
That described graphic plotting system is used for is simple two, the playing up and drawing of three-dimensional picture or literal;
Described image identification system both had been used for the graphical information of pictorial symbolization card institute mark is carried out fast, efficiently and accurately identified, and also was used for the image information of identification trainee gesture;
Described the first wireless transmitting system is used for the numerical information after the recognition system identification conversion is transferred to real time data or the information of server and reception server feedback;
Be provided with the second wireless transmitting system, data management and control system and aid decision-making system at described server;
Described the second wireless transmitting system is used for receiving the data that the far-end single-chip microcomputer was processed, and passes real time data or information after described server is processed back the far-end single-chip microcomputer;
Described data management and control system are after receiving remote data, it is processed, when data when controlling information, described data management and control system are controlled order by process control network transmission and the execution of dcs, otherwise described data management and control system are from procedural information net retrieval real time data;
Described aid decision-making system judges the current state of real time data, and for the field staff provides technical support and Operating Guideline, simultaneously, for preventing the maloperation of automatic control order, aid decision-making system also is responsible for the automatic control order is screened and judged;
In described pictorial symbolization card drafting eye-catching indicia patterns is arranged, accurately identify by video camera fast Acquisition indicia patterns and by image identification system.
The present invention also provides a kind of dcs, and it comprises above-mentioned human-computer interaction device.
Wherein, described dcs further comprises the procedural information net.
For solving the problems of the technologies described above, the present invention also provides the method that adopts above-mentioned human-computer interaction device to carry out man-machine interaction, and it comprises:
The first step is the unique pictorial symbolization card of each data monitoring point coupling of dcs;
Second step is positioned over the pictorial symbolization card on the corresponding position, factory scene construction equipment monitoring point;
The 3rd step, operating personnel wear the helmet mounted display device with explosion prevention function and patrol and examine or deal with an urgent situation, when having within sweep of the eye the pictorial symbolization card, camera is automatically caught all indicia patterns and it is transferred to single-chip microcomputer, image identification system on the single-chip microcomputer is converted to numerical information with graphical information, by the first wireless transmitting system on the single-chip microcomputer it is transferred to server again, after server is processed data, procedural information net by dcs reads related data and by the second wireless transmitting system on the server it is sent back on-the-spot single-chip microcomputer, by the graphic plotting system on the single-chip microcomputer data are played up in pictorial symbolization card putting position in the mode of figure again, by the display on the helmet mounted display device and combiner virtual objects and true environment are combined together subsequently and show, thereby provide a sensory effects real brand-new operating environment for the field staff.
Described man-machine interaction method also further comprises: when operating personnel need to carry out interactive operation, operational motion is responsible for catching and be transferred to image identification system on the single-chip microcomputer by video camera, responded by single-chip microcomputer for simple operations, the operation that relates to automatic control aspect is then at first identified through image identification system, data transmission after will being identified by wireless transmitting system again is to server, by the server receive data and after processing again the process control network by dcs send the automatic control order, finish corresponding automatic operation.
The present invention also provides above-mentioned human-computer interaction device and the above-mentioned application of dcs in Safe production of chemical industry.
The technique effect that the present invention is useful is:
This patent is used for solving traditional dcs man-machine interaction mode underaction, data show the problem that breaks away from the scene with control, on the basis that does not change process units dcs general frame, augmented reality with the advanced person, image recognition technology, network technology and singlechip technology are the basis, by the virtual information in device on-site data monitoring point physical location stack real time data, and by display device virtual objects and true environment are combined together, thereby a sensory effects is true also can intuitively be browsed and directly actuated brand-new working environment real time data for the field staff provides, and finally reaches distributed control means man-machine interaction mode is improved and the purpose that strengthens.
Description of drawings
Fig. 1 the present invention comprises the overall frame structure figure of human-computer interaction device's dcs;
Fig. 2 the present invention comprises human-computer interaction device's dcs schematic network structure;
The on-the-spot schematic diagram of Fig. 3 human-computer interaction device's principle of work for dcs provided by the invention;
Fig. 4 human-computer interaction device's workflow diagram provided by the invention;
Reference numeral is as follows: the 1-helmet mounted display device; The 2-video camera; The 3-display; The 4-reflective mirror; The 5-single-chip microcomputer; The 6-virtual scene; The 7-real scene.
Embodiment
The present invention is on the basis that does not change traditional distributed control system overall architecture, by augmented reality is introduced dcs, real scene and virtual real time data are superimposed, thereby allow the site operation personnel can accurately, vividly and comprehensively understand process units actual working state in the chemical industry factory, realize improvement and the enhancing of dcs man-machine interaction mode.
Dcs human-computer interaction device based on augmented reality of the present invention comprises the helmet mounted display device that is used for augmented reality with explosion prevention function, the pictorial symbolization card, server, radio transmission apparatus, described helmet mounted display device comprises display unit and single-chip microcomputer.
Further, described human-computer interaction device only is made of above-mentioned parts.
Described display unit comprises video camera, display and combiner;
Described video camera is used for catching pictorial symbolization card graphical information and field staff's gesture information, and it is transferred on the single-chip microcomputer, utilizes the image identification system that arranges on the single-chip microcomputer to carry out badge card identification;
Described display be used for to receive the virtual real time data of being played up by the graphic plotting system that is arranged on the single-chip microcomputer and the virtual image that obtains and it is projected to combiner;
Described combiner then reflexes to the real-time imaging of display in user's the eye on one side, Yi Bian allow the light in the true environment on every side shine in, thus in the user visual field, present the lively image of actual situation combination.
Further, described display device only is made of video camera, display and combiner.
Be provided with image identification system, graphic plotting system and the first wireless transmitting system on the described single-chip microcomputer;
That described graphic plotting system is used for is simple two, the playing up and drawing of three-dimensional picture or literal;
Described image identification system adopts ripe video identification technology, both is used for the graphical information of pictorial symbolization card institute mark is carried out fast, efficiently and accurately identified, and also is used for the image information of identification trainee gesture;
Described the first wireless transmitting system adopts ripe Radio Transmission Technology, is used for the numerical information after the image identification system identification conversion is transferred to real time data or the information of server and reception server feedback.
Described single-chip microcomputer is specially singlechip chip.
Be provided with the second wireless transmitting system, data management and control system and aid decision-making system at described server;
Described the second wireless transmitting system is used for receiving the data that the far-end single-chip microcomputer was processed, and passes real time data or information after described server is processed back the far-end single-chip microcomputer;
Described data management and control system are after receiving remote data, it is processed, when data when controlling information, described data management and control system are controlled order by process control network transmission and the execution of dcs, otherwise described data management and control system are from procedural information net retrieval real time data;
Described aid decision-making system judges the current state of real time data, and for the field staff provides technical support and Operating Guideline, simultaneously, for preventing the maloperation of automatic control order, aid decision-making system also is responsible for the automatic control order is screened and judged.
Single-chip microcomputer among the present invention is called again Single Chip Microcomputer (SCM) system, and it comprises central processor CPU, memory RAM, read only memory ROM, I/O interface, interrupt system, timer etc., is a microcomputer that does not have display.The volume of single-chip microcomputer is very little, so just can be embedded in the safety helmet, and the trainee has on the safety helmet that single-chip microcomputer is housed and walks everywhere, could carry out image to the scene of seeing and process.Information after single-chip microcomputer is processed, be transferred to away from the scene by wireless system and be in server in the fixing room, do further processing by server, information after the server process is returned the safety helmet that Single Chip Microcomputer (SCM) system is housed by wireless transmission again, and the Main Function of radio processing system is transmission information between Single Chip Microcomputer (SCM) system in movement and the fixing server.
Described display specifically can be optical perspective helmet display device (S-HMD).
Described combiner is specifically as follows reflective mirror.
Data monitoring in each described pictorial symbolization card and the dcs is put unique coupling, and the pictorial symbolization card is positioned on the on-the-spot physical location of factory of described data monitoring point, in described pictorial symbolization card drafting eye-catching indicia patterns is arranged, accurately identify by video camera fast Acquisition indicia patterns and by image identification system.
The present invention also provides a kind of dcs human-computer interaction device based on augmented reality, it comprises the helmet mounted display device that is used for augmented reality with explosion prevention function, pictorial symbolization card, server, radio transmission apparatus, described helmet mounted display device comprises display unit and single-chip microcomputer;
Described display unit comprises video camera, display and combiner;
Described video camera is used for catching pictorial symbolization card graphical information and field staff's gesture information, and it is transferred to the image identification system that is positioned on the single-chip microcomputer;
Described display be used for to receive the virtual real time data of being played up by the graphic plotting system that is arranged on the single-chip microcomputer and the virtual image that obtains and it is projected to combiner;
Described combiner then reflexes to the image of display in user's the eye on one side, Yi Bian allow the light in the true environment on every side shine in, thus in the user visual field, present the lively image of actual situation combination;
Be provided with image identification system, graphic plotting system and the first wireless transmitting system on the described single-chip microcomputer;
That described graphic plotting system is used for is simple two, the playing up and drawing of three-dimensional picture or literal;
Described image identification system adopts ripe video identification technology, both is used for the graphical information of pictorial symbolization card institute mark is carried out fast, efficiently and accurately identified, and also is used for the image information of identification trainee gesture;
Described the first wireless transmitting system adopts ripe Radio Transmission Technology, is used for the numerical information after the recognition system identification conversion is transferred to real time data or the information of server and reception server feedback;
Be provided with the second wireless transmitting system, data management and control system and aid decision-making system at described server;
Described the second wireless transmitting system is used for receiving the data that the far-end single-chip microcomputer was processed, and passes real time data or information after described server is processed back the far-end single-chip microcomputer;
Described data management and control system are after receiving remote data, it is processed, when data when controlling information, described data management and control system are controlled order by process control network transmission and the execution of dcs, otherwise described data management and control system are from procedural information net retrieval real time data;
Described aid decision-making system judges the current state of real time data, and for the field staff provides technical support and Operating Guideline, simultaneously, for preventing the maloperation of automatic control order, aid decision-making system also is responsible for the automatic control order is screened and judged;
In described pictorial symbolization card drafting eye-catching indicia patterns is arranged, accurately identify by video camera fast Acquisition indicia patterns and by image identification system.
Further, described human-computer interaction device only is made of above-mentioned parts and system.
The present invention also provides a kind of dcs, and this system comprises above-mentioned human-computer interaction device.
Further, dcs provided by the invention also comprises the conventional equipment that traditional dcs has, such as the procedural information net.
The present invention also provides the method that adopts above-mentioned human-computer interaction device to carry out man-machine interaction, and it comprises:
The first step is the unique pictorial symbolization card of each data monitoring point coupling of dcs;
Second step is positioned over the pictorial symbolization card on the corresponding position, factory scene construction equipment monitoring point;
The 3rd step, operating personnel wear the helmet mounted display device with explosion prevention function and patrol and examine or deal with an urgent situation, when having within sweep of the eye the pictorial symbolization card, camera is automatically caught all indicia patterns and it is transferred to single-chip microcomputer, image identification system on the single-chip microcomputer is converted to numerical information with graphical information, by the first wireless transmitting system on the single-chip microcomputer it is transferred to server again, after server is processed data, procedural information net by dcs reads related data and by the second wireless transmitting system on the server it is sent back on-the-spot single-chip microcomputer, by the graphic plotting system on the single-chip microcomputer data are played up in pictorial symbolization card putting position in the mode of figure again, by the display on the helmet mounted display device and combiner virtual objects and true environment are combined together subsequently and show, thereby provide a sensory effects real brand-new operating environment for the field staff.
Described man-machine interaction method also further comprises: when operating personnel need to carry out interactive operation, operational motion is responsible for catching and be transferred to image identification system on the single-chip microcomputer by video camera, responded by single-chip microcomputer for simple operations, the operation that relates to automatic control aspect is then at first identified through image identification system, data transmission after will being identified by wireless transmitting system again is to server, by the server receive data and after processing again the process control network by dcs send the automatic control order.
Described simple operations refers to not relate to the operation of automatic control aspect, and this simple operations is directly processed by " Single Chip Microcomputer (SCM) system " not to be needed data transmission is returned server.
Human-computer interaction device of the present invention uses the helmet mounted display device of the portable augmented reality with explosion prevention function, make it that the scene of being convenient to is carried and satisfy the basic demand of safety in production, select explosion-proof, anticorrosion, antistatic material, make the figure badge card, described material is specifically as follows epoxy resin or urethane resin, the key position that is used for the mark shop equipment, simultaneously, based on efficient video processing technique, exploitation badge card system for rapidly identifying, be used for fast identification and matched indicia card information, take optical perspective helmet display device (S-HMD) as reference device, utilize existing mature technology, realize the efficient video combiner, the exploitation of display and video camera, true environment and virtual information are perfectly merged and be presented on the display unit, based on singlechip technology, exploitation has Image Rendering, wireless transmission, the microprocessing systems of the functions such as figure identification, based on existing wireless interconnection technology, and in the situation that guarantee the chemical plant installations safety in production, the efficient wireless transmission of realization dcs real time data.
The present invention also provides above-mentioned dcs and the application of human-computer interaction device in the Safe production of chemical industry process.
Describe embodiments of the present invention in detail below with reference to drawings and Examples, how the application technology means solve technical matters to the present invention whereby, and the implementation procedure of reaching technique effect can fully understand and implements according to this.
As shown in Figure 3, helmet mounted display device 1 comprises video camera 2, display 3 and the display device and the single-chip microcomputer 5 that consist of as the half-mirror 4 of combiner, and display 3 is used for receiving the virtual real time data of being played up by the graphic plotting system that is arranged on the single-chip microcomputer 5 and the virtual image 6 that obtains and it is projected to half-mirror 4; 4 one side of described half-mirror reflex to the virtual image 6 of display 3 in user's the eye, Yi Bian allow the light in the real scene 7 on every side shine in, thus in the user visual field, present the lively image of actual situation combination.
As depicted in figs. 1 and 2, human-computer interaction device for dcs of the present invention comprises the helmet mounted display device 1 that Fig. 3 shows, the pictorial symbolization card, server, radio transmission apparatus, pictorial symbolization card (being made by the E-51 epoxy resin (product type 618) that science, industry and trade company limited in the Qingdao City produces), helmet mounted display device 4 comprises display unit and single-chip microcomputer, described display unit comprises the video camera 2 that Fig. 3 shows, display 3 and as the reflective mirror 4 of combiner, be provided with image identification system on the single-chip microcomputer 5, graphic plotting system and the first wireless transmitting system, described graphic plotting system is used for simple two, the playing up and drawing of three-dimensional picture or literal, described image identification system both had been used for the graphical information of pictorial symbolization card institute mark is carried out fast, efficiently and accurately identification, the image information that also is used for identification trainee gesture, described the first wireless transmitting system is used for the numerical information after the image identification system identification conversion is transferred to real time data or the information of server and reception server feedback, be provided with the second wireless transmitting system at described server, data management and control system and aid decision-making system, described the second wireless transmitting system is used for receiving the data that the far-end single-chip microcomputer was processed, and pass real time data or information after processing at described server back the far-end single-chip microcomputer, described data management and control system are after receiving remote data, it is processed, when data when controlling information, described data management and control system are controlled order by process control network transmission and the execution of dcs, otherwise, described data management and control system are from procedural information net retrieval real time data, described aid decision-making system is judged the current state of real time data, for the site operation personnel provides technical support and Operating Guideline, simultaneously, for preventing the maloperation of automatic control order, aid decision-making system also is responsible for the automatic control order is screened and judged.
As shown in Figure 4, described human-computer interaction device's principle of work is as follows: each mates a unique pictorial symbolization card according to the monitoring point for the number of dcs; The pictorial symbolization card is positioned on the corresponding position, factory scene construction equipment monitoring point; Operating personnel wear the helmet mounted display device with explosion prevention function and patrol and examine or deal with an urgent situation, when having within sweep of the eye the pictorial symbolization card, camera is automatically caught all indicia patterns and it is transferred to single-chip microcomputer, image identification system on the single-chip microcomputer is converted to numerical information with graphical information, by the first wireless transmitting system on the single-chip microcomputer it is transferred to server again, data management on the described server and control system are after receiving remote data, it is processed, when data when controlling information, described data management and control system are controlled order by process control network transmission and the execution of dcs, otherwise, described data management and control system are from procedural information net retrieval real time data, by the aid decision-making system on the described server current state of real time data is judged again, for the site operation personnel provides technical support and Operating Guideline, simultaneously, for preventing the maloperation of automatic control order, aid decision-making system also is responsible for the automatic control order is screened and judged; After server is processed data, procedural information net by dcs reads related data and by the second wireless transmitting system on the server it is sent back on-the-spot single-chip microcomputer, by the graphic plotting system on the single-chip microcomputer data are played up in pictorial symbolization card putting position in the mode of figure again, by the display on the helmet mounted display device and combiner virtual objects and true environment are combined together subsequently and show, thereby for the field staff provides a sensory effects real brand-new operating environment, and when operating personnel need to carry out interactive operation, operational motion is responsible for catching and be transferred to image identification system on the single-chip microcomputer by video camera, responded by single-chip microcomputer for simple operations, the operation that relates to automatic control aspect is then at first identified through image identification system, data transmission after will being identified by wireless transmitting system again is to server, by the server receive data and after processing again the process control network by dcs send the automatic control order.
This intellecture property of primary enforcement that all are above-mentioned is not set restriction this new product of other forms of enforcement and/or new method.Those skilled in the art will utilize this important information, and foregoing is revised, to realize similar implementation status.But all modifications or transformation belong to the right of reservation based on new product of the present invention.
The above only is preferred embodiment of the present invention, is not to be the restriction of the present invention being made other form, and any those skilled in the art may utilize the technology contents of above-mentioned announcement to be changed or be modified as the equivalent embodiment of equivalent variations.But every technical solution of the present invention content that do not break away to any simple modification, equivalent variations and remodeling that above embodiment does, still belongs to the protection domain of technical solution of the present invention according to technical spirit of the present invention.
Claims (10)
1. based on the dcs human-computer interaction device of augmented reality, it is characterized in that, comprising: the helmet mounted display device that is used for augmented reality with explosion prevention function, the pictorial symbolization card, server, radio transmission apparatus, described helmet mounted display device comprises display unit and single-chip microcomputer;
Described display unit comprises video camera, display and reflective mirror;
Described video camera is used for catching pictorial symbolization card graphical information and field staff's gesture information, and it is transferred on the single-chip microcomputer, in the enterprising row labels card identification of described single-chip microcomputer;
Described display be used for to receive the virtual real time data of playing up through single-chip microcomputer and the virtual image that obtains and it is projected to combiner;
Described reflective mirror then reflexes to the virtual image of display in user's the eye on one side, Yi Bian allow the light in the true environment on every side shine in, thus in the user visual field, present the lively image of actual situation combination.
2. human-computer interaction device as claimed in claim 1 is characterized in that: be provided with image identification system, graphic plotting system and the first wireless transmitting system on the described single-chip microcomputer;
That described graphic plotting system is used for is simple two, the playing up and drawing of three-dimensional picture or literal;
Described image identification system both had been used for the graphical information of pictorial symbolization card institute mark is carried out fast, efficiently and accurately identified, and also was used for the image information of identification trainee gesture;
Described the first wireless transmitting system is used for the numerical information after the image identification system identification conversion is transferred to real time data or the information of server and reception server feedback.
3. human-computer interaction device as claimed in claim 1 or 2 is characterized in that: be provided with the second wireless transmitting system, data management and control system and aid decision-making system at described server;
Described the second wireless transmitting system is used for receiving the data that the far-end single-chip microcomputer was processed, and passes real time data or information after described server is processed back the far-end single-chip microcomputer;
Described data management and control system are after receiving remote data, it is processed, when data when controlling information, described data management and control system are controlled order by process control network transmission and the execution of dcs, otherwise described data management and control system are from procedural information net retrieval real time data;
Described aid decision-making system judges the current state of real time data, and for the site operation personnel provides technical support and Operating Guideline, simultaneously, for preventing the maloperation of automatic control order, aid decision-making system also is responsible for the automatic control order is screened and judged.
4. based on the dcs human-computer interaction device of augmented reality, it is characterized in that, comprising: the helmet mounted display device that is used for augmented reality with explosion prevention function, the pictorial symbolization card, server, radio transmission apparatus, described helmet mounted display device comprises display unit and single-chip microcomputer;
Described display unit comprises video camera, display and reflective mirror;
Described video camera is used for catching pictorial symbolization card graphical information and field staff's gesture information, and it is transferred on the single-chip microcomputer, in the enterprising row labels card identification of described single-chip microcomputer;
Described display be used for to receive the virtual real time data of playing up through single-chip microcomputer and the virtual image that obtains and it is projected to combiner;
Described reflective mirror then reflexes to the virtual image of display in user's the eye on one side, Yi Bian allow the light in the true environment on every side shine in, thus in the user visual field, present the lively image of actual situation combination;
Be provided with image identification system, graphic plotting system and the first wireless transmitting system on the described single-chip microcomputer;
That described graphic plotting system is used for is simple two, the playing up and drawing of three-dimensional picture or literal;
Described image identification system both had been used for the graphical information of pictorial symbolization card institute mark is carried out fast, efficiently and accurately identified, and also was used for the image information of identification trainee gesture;
Described the first wireless transmitting system is used for the numerical information after the recognition system identification conversion is transferred to real time data or the information of server and reception server feedback;
Be provided with the second wireless transmitting system, data management and control system and aid decision-making system at described server;
Described the second wireless transmitting system is used for receiving the data that the far-end single-chip microcomputer was processed, and passes real time data or information after described server is processed back the far-end single-chip microcomputer;
Described data management and control system are after receiving remote data, it is processed, when data when controlling information, described data management and control system are controlled order by process control network transmission and the execution of dcs, otherwise described data management and control system are from procedural information net retrieval real time data;
Described aid decision-making system judges the current state of real time data, and for the field staff provides technical support and Operating Guideline, simultaneously, for preventing the maloperation of automatic control order, aid decision-making system also is responsible for the automatic control order is screened and judged;
In described pictorial symbolization card drafting eye-catching indicia patterns is arranged, accurately identify by video camera fast Acquisition indicia patterns and by image identification system.
5. dcs is characterized in that, comprising: the described human-computer interaction device of claim 1 to 4.
6. dcs as claimed in claim 5, it is characterized in that: described dcs further comprises the procedural information net.
7. the method that adopts the described human-computer interaction device of claim 1 to 4 to carry out man-machine interaction is characterized in that, comprising:
The first step is the unique pictorial symbolization card of each data monitoring point coupling of dcs;
Second step is positioned over the pictorial symbolization card on the corresponding position, factory scene construction equipment monitoring point;
The 3rd step, operating personnel wear the helmet mounted display device with explosion prevention function and patrol and examine or deal with an urgent situation, when having within sweep of the eye the pictorial symbolization card, camera is automatically caught all indicia patterns and it is transferred to single-chip microcomputer, image identification system on the single-chip microcomputer is converted to numerical information with graphical information, by the first wireless transmitting system on the single-chip microcomputer it is transferred to server again, after server is processed data, procedural information net by dcs reads related data and by the second wireless transmitting system on the server it is sent back on-the-spot single-chip microcomputer, by the graphic plotting system on the single-chip microcomputer data are played up in pictorial symbolization card putting position in the mode of figure again, by the display on the helmet mounted display device and combiner virtual objects and true environment are combined together subsequently and show, thereby provide a sensory effects real brand-new operating environment for the field staff.
8. man-machine interaction method as claimed in claim 7, operating personnel it is characterized in that: when need to carry out interactive operation, operational motion is responsible for catching and be transferred to image identification system on the single-chip microcomputer by video camera, responded by single-chip microcomputer for simple operations, the operation that relates to automatic control aspect is then at first identified through image identification system, data transmission after will being identified by wireless transmitting system again is to server, by the server receive data and after processing again the process control network by dcs send the automatic control order, finish corresponding automatic operation.
9. the application of the described human-computer interaction device of claim 1 to 4 in Safe production of chemical industry.
10. claim 5 or 6 application of described dcs in Safe production of chemical industry.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210407753.5A CN102929391B (en) | 2012-10-23 | 2012-10-23 | The dcs human-computer interaction device of augmented reality and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210407753.5A CN102929391B (en) | 2012-10-23 | 2012-10-23 | The dcs human-computer interaction device of augmented reality and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102929391A true CN102929391A (en) | 2013-02-13 |
| CN102929391B CN102929391B (en) | 2015-11-04 |
Family
ID=47644216
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210407753.5A Active CN102929391B (en) | 2012-10-23 | 2012-10-23 | The dcs human-computer interaction device of augmented reality and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102929391B (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103310045A (en) * | 2013-05-28 | 2013-09-18 | 山东师范大学 | Method for carrying out crystal macromolecule three-dimensional visualization by adopting augmented reality technology |
| CN105210117A (en) * | 2013-05-14 | 2015-12-30 | 高通股份有限公司 | Augmented reality (AR) capture & play |
| CN105264461A (en) * | 2013-05-13 | 2016-01-20 | 微软技术许可有限责任公司 | Interactions of virtual objects with surfaces |
| CN105283834A (en) * | 2013-03-15 | 2016-01-27 | 埃尔瓦有限公司 | Temporal element restoration in augmented reality systems |
| CN105446481A (en) * | 2015-11-11 | 2016-03-30 | 周谆 | Gesture based virtual reality human-machine interaction method and system |
| CN106657368A (en) * | 2016-12-31 | 2017-05-10 | 佛山市幻云科技有限公司 | Server management method and system based on augmented reality |
| WO2017079910A1 (en) * | 2015-11-11 | 2017-05-18 | 周谆 | Gesture-based virtual reality human-machine interaction method and system |
| CN107615227A (en) * | 2015-05-26 | 2018-01-19 | 索尼公司 | display device, information processing system and control method |
| CN107610269A (en) * | 2017-09-12 | 2018-01-19 | 国网上海市电力公司 | A kind of power network big data intelligent inspection system and its intelligent polling method based on AR |
| CN107644457A (en) * | 2017-09-14 | 2018-01-30 | 中国航空工业集团公司沈阳空气动力研究所 | A kind of monitoring method applied to industry spot |
| WO2018072337A1 (en) * | 2016-10-21 | 2018-04-26 | 上海拆名晃信息科技有限公司 | Wireless transmission method, device, terminal and head-mounted display device for virtual reality |
| CN109358577A (en) * | 2013-10-01 | 2019-02-19 | 安华高科技股份有限公司 | Industrial monitoring based on posture |
| CN109947052A (en) * | 2017-12-20 | 2019-06-28 | 中国科学院沈阳自动化研究所 | A kind of virtual factory manufacturing execution system based on digitlization AR technology |
| CN111415431A (en) * | 2020-02-26 | 2020-07-14 | 国网宁夏电力有限公司电力科学研究院 | Inspection method and system for transformer substation, control platform and wearable device |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1522895A (en) * | 2003-09-11 | 2004-08-25 | 辰 丁 | Multifunctional vehicle real-time monitoring system (GSM/GPRS) |
| CN1854460A (en) * | 2005-04-25 | 2006-11-01 | 王宁 | Oil-well realtime monitoring system and its controlling method |
| CN101214178A (en) * | 2007-12-26 | 2008-07-09 | 北京理工大学 | Video frequency reinforcing reality auxiliary operation welding protection helmet |
| CN101349903A (en) * | 2008-08-06 | 2009-01-21 | 兖矿国泰化工有限公司 | Safety production early-warning system of coal chemical engineering enterprise |
| CN101917489A (en) * | 2010-08-26 | 2010-12-15 | 中国石油集团川庆钻探工程有限公司 | Remote transmission and network publishing method of well field information |
| CN201673267U (en) * | 2010-05-18 | 2010-12-15 | 山东师范大学 | Life detection and rescue system based on augmented reality |
| CN201813483U (en) * | 2010-09-01 | 2011-04-27 | 黑龙江圣亚科技发展有限公司 | Mobile safety-production monitor terminal based on wireless sensor network |
| CN102314165A (en) * | 2010-07-05 | 2012-01-11 | 上海盛锐软件技术有限公司 | PLM (programmable logic matrix)-based RFID (radio frequency identification device) control system for industrial production line and method |
| CN102735100A (en) * | 2012-06-08 | 2012-10-17 | 重庆邮电大学 | Individual light weapon shooting training method and system by using augmented reality technology |
| CN102739872A (en) * | 2012-07-13 | 2012-10-17 | 苏州梦想人软件科技有限公司 | Mobile terminal, and augmented reality method used for mobile terminal |
-
2012
- 2012-10-23 CN CN201210407753.5A patent/CN102929391B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1522895A (en) * | 2003-09-11 | 2004-08-25 | 辰 丁 | Multifunctional vehicle real-time monitoring system (GSM/GPRS) |
| CN1854460A (en) * | 2005-04-25 | 2006-11-01 | 王宁 | Oil-well realtime monitoring system and its controlling method |
| CN101214178A (en) * | 2007-12-26 | 2008-07-09 | 北京理工大学 | Video frequency reinforcing reality auxiliary operation welding protection helmet |
| CN101349903A (en) * | 2008-08-06 | 2009-01-21 | 兖矿国泰化工有限公司 | Safety production early-warning system of coal chemical engineering enterprise |
| CN201673267U (en) * | 2010-05-18 | 2010-12-15 | 山东师范大学 | Life detection and rescue system based on augmented reality |
| CN102314165A (en) * | 2010-07-05 | 2012-01-11 | 上海盛锐软件技术有限公司 | PLM (programmable logic matrix)-based RFID (radio frequency identification device) control system for industrial production line and method |
| CN101917489A (en) * | 2010-08-26 | 2010-12-15 | 中国石油集团川庆钻探工程有限公司 | Remote transmission and network publishing method of well field information |
| CN201813483U (en) * | 2010-09-01 | 2011-04-27 | 黑龙江圣亚科技发展有限公司 | Mobile safety-production monitor terminal based on wireless sensor network |
| CN102735100A (en) * | 2012-06-08 | 2012-10-17 | 重庆邮电大学 | Individual light weapon shooting training method and system by using augmented reality technology |
| CN102739872A (en) * | 2012-07-13 | 2012-10-17 | 苏州梦想人软件科技有限公司 | Mobile terminal, and augmented reality method used for mobile terminal |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105283834A (en) * | 2013-03-15 | 2016-01-27 | 埃尔瓦有限公司 | Temporal element restoration in augmented reality systems |
| CN105283834B (en) * | 2013-03-15 | 2019-09-20 | 埃尔瓦有限公司 | Interim element in augmented reality system is restored |
| US10008044B2 (en) | 2013-05-13 | 2018-06-26 | Microsoft Technology Licensing, Llc | Interactions of virtual objects with surfaces |
| CN105264461A (en) * | 2013-05-13 | 2016-01-20 | 微软技术许可有限责任公司 | Interactions of virtual objects with surfaces |
| CN105264461B (en) * | 2013-05-13 | 2018-09-18 | 微软技术许可有限责任公司 | The interaction of virtual objects and surface |
| US11880541B2 (en) | 2013-05-14 | 2024-01-23 | Qualcomm Incorporated | Systems and methods of generating augmented reality (AR) objects |
| CN105210117A (en) * | 2013-05-14 | 2015-12-30 | 高通股份有限公司 | Augmented reality (AR) capture & play |
| US10509533B2 (en) | 2013-05-14 | 2019-12-17 | Qualcomm Incorporated | Systems and methods of generating augmented reality (AR) objects |
| US11112934B2 (en) | 2013-05-14 | 2021-09-07 | Qualcomm Incorporated | Systems and methods of generating augmented reality (AR) objects |
| CN103310045A (en) * | 2013-05-28 | 2013-09-18 | 山东师范大学 | Method for carrying out crystal macromolecule three-dimensional visualization by adopting augmented reality technology |
| CN103310045B (en) * | 2013-05-28 | 2015-12-23 | 山东师范大学 | One utilizes augmented reality to carry out the large molecule three-dimensional visualization method of crystal |
| CN109358577A (en) * | 2013-10-01 | 2019-02-19 | 安华高科技股份有限公司 | Industrial monitoring based on posture |
| CN107615227A (en) * | 2015-05-26 | 2018-01-19 | 索尼公司 | display device, information processing system and control method |
| WO2017079910A1 (en) * | 2015-11-11 | 2017-05-18 | 周谆 | Gesture-based virtual reality human-machine interaction method and system |
| CN105446481A (en) * | 2015-11-11 | 2016-03-30 | 周谆 | Gesture based virtual reality human-machine interaction method and system |
| WO2018072337A1 (en) * | 2016-10-21 | 2018-04-26 | 上海拆名晃信息科技有限公司 | Wireless transmission method, device, terminal and head-mounted display device for virtual reality |
| CN106657368A (en) * | 2016-12-31 | 2017-05-10 | 佛山市幻云科技有限公司 | Server management method and system based on augmented reality |
| CN106657368B (en) * | 2016-12-31 | 2019-12-27 | 山东汇佳软件科技股份有限公司 | Server management method and system based on augmented reality |
| CN107610269A (en) * | 2017-09-12 | 2018-01-19 | 国网上海市电力公司 | A kind of power network big data intelligent inspection system and its intelligent polling method based on AR |
| CN107644457B (en) * | 2017-09-14 | 2021-02-12 | 中国航空工业集团公司沈阳空气动力研究所 | Monitoring method applied to industrial site |
| CN107644457A (en) * | 2017-09-14 | 2018-01-30 | 中国航空工业集团公司沈阳空气动力研究所 | A kind of monitoring method applied to industry spot |
| CN109947052A (en) * | 2017-12-20 | 2019-06-28 | 中国科学院沈阳自动化研究所 | A kind of virtual factory manufacturing execution system based on digitlization AR technology |
| CN109947052B (en) * | 2017-12-20 | 2022-02-08 | 中国科学院沈阳自动化研究所 | Virtual factory manufacturing execution system and method based on digital AR technology |
| CN111415431A (en) * | 2020-02-26 | 2020-07-14 | 国网宁夏电力有限公司电力科学研究院 | Inspection method and system for transformer substation, control platform and wearable device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102929391B (en) | 2015-11-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102929391B (en) | The dcs human-computer interaction device of augmented reality and method | |
| CN102497568B (en) | Interactive three-dimensional virtual scene and visualized information integrating system | |
| CN102930753B (en) | Gas station virtual training system and application | |
| CN112130478A (en) | Building integrated comprehensive management and control platform system based on BIM and management and control method thereof | |
| US20210343182A1 (en) | Virtual-reality-based personal protective equipment training system | |
| WO2011014718A1 (en) | Virtual world building operations center | |
| CN103716324B (en) | Virtual mine risk-taking behavior implementation system and method based on multiple agents | |
| CN203259968U (en) | Man-machine interaction device capable of augmenting reality and distributed control device with same | |
| CN110311468A (en) | Substation's three-dimensional live abnormality monitoring method, system, device and storage medium | |
| CN211454286U (en) | Building integrated comprehensive control platform system based on BIM | |
| CN110363118A (en) | Behavior monitoring method, apparatus, system and the storage medium of target object | |
| CN108922302A (en) | A kind of electric shock accidents analogue system | |
| CN104506388A (en) | IDC (internet data center) monitoring method and system combined with AR (augmented reality) technology | |
| CN103500422A (en) | Modularization table top drills virtual training system and training method thereof | |
| CN112306233A (en) | Inspection method, inspection system and inspection management platform | |
| CN107591038A (en) | A kind of pole transformer stops the simulated operation interactive system of multiple labour | |
| CN104319906A (en) | Power grid disaster-prevention control system | |
| CN112991857A (en) | Electric power emergency rescue training system and method | |
| CN111311973A (en) | Simulation examination system for distribution network uninterrupted operation | |
| CN207115474U (en) | Visualization emergency evacuation command system based on wireless aps | |
| CN114092279A (en) | Full-service ubiquitous visual intelligent power operation and maintenance system | |
| CN114386780A (en) | Intelligent work ticket operation ticket system | |
| CN111754834A (en) | Electric power training method based on virtual reality | |
| CN117289797A (en) | Transformer substation inspection information interaction method and system based on meta-universe technology | |
| CN115793673B (en) | VR technology-based natural gas station robot inspection method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |