CN106019592A - Augmented reality optical transmission-type helmet mounted display pre-circuit and control method thereof - Google Patents
Augmented reality optical transmission-type helmet mounted display pre-circuit and control method thereof Download PDFInfo
- Publication number
- CN106019592A CN106019592A CN201610557750.8A CN201610557750A CN106019592A CN 106019592 A CN106019592 A CN 106019592A CN 201610557750 A CN201610557750 A CN 201610557750A CN 106019592 A CN106019592 A CN 106019592A
- Authority
- CN
- China
- Prior art keywords
- module
- gesture
- display
- ambient light
- microcontroller
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0149—Head-up displays characterised by mechanical features
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0149—Head-up displays characterised by mechanical features
- G02B2027/0161—Head-up displays characterised by mechanical features characterised by the relative positioning of the constitutive elements
- G02B2027/0163—Electric or electronic control thereof
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Engineering & Computer Science (AREA)
- Computer Hardware Design (AREA)
- Theoretical Computer Science (AREA)
- Controls And Circuits For Display Device (AREA)
- Control Of El Displays (AREA)
Abstract
The invention relates to an augmented reality optical transmission-type helmet mounted display pre-circuit and a control method thereof. The helmet mounted display pre-circuit comprises an inertial navigation module and GPS integrated module, an environmental light detection and infrared gesture recognition integrated module, a speaker-independent voice password recognition module, a camera module, a display module, a microcontroller and a power supply module. The brightness of an OLED display screen can be adjusted according to the environmental light, and according to the gesture, the password and the position information obtained by the infrared gesture recognition by the environmental light detection and infrared gesture recognition integrated module, the speaker-independent voice password recognition module and the inertial navigation and GPS integrated module, a post-computer makes corresponding adjustment on the display video. Thus, demands on multi-sensor information by the augmented reality optical transmission-type helmet mounted display can be met, the main-control computer and a battery can be post arranged, the weight of the pre part is reduced, and the use is more comfortable.
Description
Technical field
The present invention relates to the helmet mounted display device of a kind of augmented reality, specifically a kind of augmented reality Light Transmission helmet display front end circuit and control method thereof.
Background technology
Augmented reality is a kind of real world information and the new technique of virtual world information Seamless integration-.Not only presenting the information of real world, and virtual information shown simultaneously, two kinds of information complements each other, superposition.And in the augmented reality of visualization, user utilizes Helmet Mounted Display, it is synthesized together multiple to real world and computer graphic, for strengthening the visual immersion of user.
The helmet shows (Helmet Mounted Display, HMD), is a kind of helmet mounted display device comprising microdrawing image source and respective optical system.The features such as HMD has light weight, and volume is little, and power consumption is little, have a wide range of applications in fields such as aviation, medical treatment, amusements.Along with the development of embedded computer, mini computer function is more and more lower with power consumption from strength to strength, and the integrated design for HMD is provided convenience, and its hardware circuit will be divided into preposition display driving and sensor circuit and rearmounted mini computer two parts.Therefore significant for augmented reality OST-HMD front end circuit and control method research thereof.
Summary of the invention
An object of the present invention is just to provide a kind of augmented reality Light Transmission helmet display front end circuit, the problem that the preamble part weight shown to solve the existing augmented reality Light Transmission helmet causes more greatly wearing comfort difference.
The two of the purpose of the present invention are just to provide the control method of a kind of augmented reality OST-HMD front end circuit, show the use needs to multi-sensor information meeting the augmented reality Light Transmission helmet.
An object of the present invention is achieved in that a kind of augmented reality Light Transmission helmet display front end circuit, including:
Inertial navigation module and GPS integrated module, be integrated with gyroscope, accelerometer, geomagnetic field sensors, GPS, filter circuit and voltage stabilizing circuit；Described inertial navigation module connects with microcontroller with GPS integrated module, is used for providing user of service's head pose and personnel's spatial positional information；
Ambient light detection and infrared gesture identification integrated module, including ambient light sensor, data converter, gesture sensor and the first data buffer FIFO, described ambient light sensor is used for detecting environment illumination intensity, described data converter for being converted into the corresponding data information of red, green, blue and transparency by the environment illumination intensity of detection, described gesture sensor is used for sensing gesture motion, and described first data buffer FIFO is used for storing illumination and gesture data；The detection of described ambient light passes through I with infrared gesture identification integrated module2C bus connects with microcontroller, completes the communication between microcontroller；
Unspecified person verbal instructions identification module, including microphone interface, A/D converter, voice recognition processing unit, the second data buffer FIFO, SPI interface, D/A converter, power amplifier and sound output interface；Described unspecified person verbal instructions identification module connects with microcontroller, is used for identifying unspecified person verbal instructions；
Camera module, its lead up to connect USB Hub extension mouth connect rearmounted computer, USB Slave interface of separately leading up to connects with microcontroller；Described camera module is used for obtaining scene video, and video information sends to rearmounted computer；
Display module, including HDMI receiver and OLED display；Described HDMI receiver and described OLED display pass through I respectively2C bus connects with microcontroller, the communication being used between microcontroller；Described HDMI receiver is connected with OLED display by video drive interface, is used for showing scene video；
Microcontroller, connect with infrared gesture identification integrated module, described unspecified person verbal instructions identification module and described display module with GPS integrated module, the detection of described ambient light with described inertial navigation module respectively, control for completing the initialization operation to each operational module, complete described HDMI receiver and the control to described OLED display；And
Power module, provides working power for system.
The two of the purpose of the present invention are achieved in that the control method of a kind of augmented reality Light Transmission helmet display front end circuit, including control, inertial navigation module and the control of GPS integrated module, ambient light detection and the control of infrared gesture identification integrated module, the control of unspecified person verbal instructions identification module, the control of HDMI receiver and the control of OLED display of microcontroller.
A, the control mode of described microcontroller be:
A-1, pass through I2C interface carries out initialization operation control to the HDMI receiver in display module and OLED display, and HDMI receiver is filled EDIF information, arranges the original intensity of OLED display；
A-2, according to detection environment illumination intensity, the brightness to OLED display is adjusted；
A-3, reading inertial navigation and GPS information, be sent to rearmounted computer, and rearmounted computer is according to the information accepted, the region that location human eye is interested；
A-4, response interruptive command, read gesture identification and verbal instructions identification information, and transfer information to rearmounted computer, and display video, according to gesture identification and voice command, is done and changes accordingly, advances, falls back, zooms in or out control by rearmounted computer.
B, inertial navigation module with the control mode of GPS integrated module be:
B-1, module initialization；Inertial navigation module is calibrated with the gyroscope in GPS integrated module, accelerometer and geomagnetic field sensors, the position zero of GPS；
B-2, according to back information amount, arrange passback speed, this module communication baud rate, I2C interface address and GPS connect baud rate；
B-3, reading acceleration export, angular velocity exports, angle exports, magnetic field exports, air pressure exports, highly export, longitude and latitude exports, ground velocity exports；
B-4, according to output data calculate desired data, for display module.
With the control mode of infrared gesture identification integrated module, the detection of c, ambient light includes that ambient light detection controls and gesture identification controls.
The control mode of c-1, ambient light detection is:
Ambient light detection starts to RGBC from photodiode detection RGBC to terminate 16 bit data register, after environment illumination intensity deviation threshold value arrives and sets duration, is i.e. adjusted backlight illumination.
C-2, the control mode of gesture identification be:
Utilize the infrared energy of four directional lighting diode perceived reflection, then convert this data to physical motion information, including speed, direction and distance；In transformation process, definition calculates entrance vector and calculates outlet point vector respectively, by to the comparative result calculating entrance vector calculating outlet point vector, distinguish and judge six kinds of directions of gesture motion, including gesture up and down, about upper under gesture, gesture, the right left side of gesture, gesture draw near and gesture from the close-by examples to those far off.
D, the control mode of unspecified person verbal instructions identification module be:
D-1, module initialization, and each depositor in module is carried out Initialize installation；
D-2, write recognized list: by phrase write recognized list to be identified；The rule of recognized list is, the corresponding numbering of each identification entry, stays interval, a space between each two character；Numbering numerical value is less than 256；
D-3, start identify, according to getting out interrupt response function, open interrupt enable bit；
D-4, response are interrupted: whenever mike collects sound, in spite of identifying normal outcome, all producing an interrupt signal, interrupt routine is according to the value analysis result of depositor；Reading matching value depositor, the answer obtained is most probable correct option.
E, the control mode of described HDMI receiver be:
E-1, by microcontroller, HDMI receiver is initialized, and viewing area and display pattern are configured；
E-2, by a frame video data good for rearmounted computer disposal to HDMI receiver export, incoming data are converted into 24 888 RGB data by HDMI receiver, and be input in pattern data memory buffer, it is then output in OLED display prepare display.
F, the control mode of described OLED display be:
OLED display receives 24 rgb signals that HDMI receiver produces, the ambient light detection read further according to microcontroller and the light conditions of infrared gesture identification integrated module, by in OLED display, numeral gamma is corrected, color saturation adjusts and grey scale mapping mode, display brightness is adjusted.
The concrete control mode that the detection of described ambient light controls is:
C-1-1, reference normal ambient light intensity arrange the duration threshold after intensity of illumination change threshold and intensity of illumination change；
C-1-2, ambient light sensor is utilized to pass through different damping material detection intensity of illumination, through ambient light detection and data converter output red (R), green (G) in infrared gesture identification integrated module, blue (B) and 16 bit data of transparency (C)；
C-1-3,16 bit data according to RGBC, it is judged that the change of intensity of illumination whether in the range of intensity of illumination change threshold, if, then the persistent period adds one, and forwards step c-1-4 to；If not existing, then the persistent period resets, and returns step c-1-2 and re-start detection；
C-1-4, judging whether the persistent period that intensity of illumination changes exceedes setting time threshold, if exceeding, then producing interrupt signal；If being less than, then the persistent period resets, and returns step c-1-2 and re-start detection.
Electrical connection interface between front end circuit of the present invention and rearmounted computer has HDMI and USB two ways, for receiving the display content of rearmounted computer and sending sensor information to computer.Microcontroller complete the initialization to each sensor assembly in addition to camera module and data acquisition, to the control of display module and with the function such as communicate of rearmounted computer, be the control core of front end circuit.
Pass through the present invention, the brightness of OLED display screen can be adjusted according to ambient light, and rearmounted computer is according to ambient light detection and the infrared gesture identification in infrared gesture identification integrated module and unspecified person verbal instructions identification module, and the gesture that obtains with GPS integrated module of inertial navigation and password command and positional information, display video is adjusted accordingly.So can meet the augmented reality Light Transmission helmet and show the needs to multi-sensor information, the weight of preamble part can be reduced by rearmounted to main control computer and battery again, use more comfortable.
Accompanying drawing explanation
Fig. 1 is the circuit structure block diagram of the helmet of the present invention display front end circuit.
Fig. 2 is the circuit structure block diagram of unspecified person verbal instructions identification module.
Fig. 3 is the control flow chart of the helmet of the present invention display front end circuit.
Detailed description of the invention
Embodiment 1, a kind of augmented reality Light Transmission helmet display front end circuit.
As it is shown in figure 1, the present invention includes inertial navigation module and GPS integrated module 1, ambient light detection and infrared gesture identification integrated module 2, unspecified person voice command recognition module 3, camera module 4, display module 5, microcontroller 6, USB HUB extension mouth 71, USB Slave interface 72 and power module 8.
Inertial navigation module and the integrated high-precision gyroscope of GPS integrated module 1, accelerometer, geomagnetic field sensors and GPS and filter circuit and voltage stabilizing circuit, it is provided that user of service's head pose and personnel's spatial positional information.This inside modules carries voltage stable circuit, running voltage 3 ~ 6V, and the embedded system of pin level compatibility 3.3V/5V is easy to connect；Supporting serial digital interface, serial ports speed is adjustable at 2400bps ~ 921600bps, retains four road ECP Extended Capabilities Ports, can be respectively configured as the functions such as simulation input, numeral input, numeral output and PWM output.
Ambient light detection includes ambient light sensor, data converter, gesture sensor and the first data buffer FIFO with infrared gesture identification integrated module 2；Ambient light sensor can detect intensity of illumination by multiple damping material under multiple illumination condition, the 16 bit data information that data converter output red (R), green (G) in module, blue (B) and transparency (C) are corresponding.Gesture sensor utilizes four orientation diodes, integrated with visible ray blocking filter, can sense gesture exactly upper and lower, under gesture on, about gesture, the right left side of gesture, gesture draws near and gesture six kinds of common gesture motion the most totally.The first data buffer FIFO of 32 × 4 of this module is used for storing intensity of illumination and gesture data information.This module also has and I2The interface that C interface is compatible, completes the communication between microcontroller 6.
As in figure 2 it is shown, unspecified person verbal instructions identification module 3 includes the second data buffer FIFO 34, power amplifier 35, SPI interface 36, microphone interface 37 and the sound output interface 38 of voice recognition processing unit 32,16 D/A converters of 31,16 A/D converters 33,32 × 4.Microphone interface 37 External microphone, voice output interface 38 external loudspeaker.The output of microphone interface 37 is 20mW, and the output of voice output interface 38 is 550mW, can produce the loudest sound.
In Fig. 1,4 points of two-way of camera module, its lead up to connect USB Hub extension mouth 71 connect rearmounted computer 9, USB Slave interface 72 of separately leading up to connects with microcontroller 6.Camera module 4 is used for obtaining scene video, and video information sends to rearmounted computer 9.
Display module 5 includes that HDMI receiver 51 and OLED display 52, OLED display 52 are miniscope.HDMI receiver 51 and OLED display 52 pass through I respectively2C bus connects with microcontroller 6, the communication being used between microcontroller.The video drive interface of HDMI receiver 51 connects OLED display 52.
Microcontroller 6 have USB Slave UART SPI the interface such as I2C；UART interface connects inertial navigation module and GPS integrated module 1；I2C interface JA(junction ambient) optical detection and infrared gesture identification integrated module 2；SPI interface connects unspecified person verbal instructions identification module 3.Microcontroller 6 has been used for the reading of initialization, control or the data of above-mentioned each operational module.Microcontroller 6 is also by I2C bus connects HDMI receiver 51 and OLED minitype displayer 52 respectively, is controlled OLED minitype displayer 52 and HDMI receiver 51.
Power module 8 is that each operational module of system is powered.The USB interface of rearmounted computer 9 provides input voltage value for Voltage stabilizing module, and it is output as the size of each operational module required voltage value.
Embodiment 2: a kind of augmented reality Light Transmission helmet display front end circuit control method.
The control method of the augmented reality Light Transmission helmet of the present invention display front end circuit includes the control of microcontroller, inertial navigation module and the control of GPS integrated module, ambient light detection and the control of infrared gesture identification integrated module, the control of unspecified person verbal instructions identification module, the control of HDMI receiver and the control of OLED display.
Referring to Fig. 3, above-mentioned each control mode is described below.
1, the control mode of microcontroller.
1-1, pass through I2C interface carries out initialization operation control to the HDMI receiver 51 in display module 5 and OLED display 52, and HDMI receiver 51 is filled EDIF information, arranges the original intensity of OLED display 52.
1-2, according to detection environment illumination intensity, the brightness to OLED display 52 is adjusted.
1-3, reading inertial navigation and GPS information from inertial navigation module and GPS integrated module 1, be sent to rearmounted computer 9, rearmounted computer 9 is according to the information accepted, the region that location human eye is interested.
1-4, response interruptive command, gesture recognition information is read with infrared gesture identification integrated module 2 from ambient light detection, verbal instructions identification information is obtained from unspecified person verbal instructions identification module 3, and gesture recognition information and verbal instructions identification information are sent to rearmounted computer 9, the display video of display module 5 according to gesture identification and voice command, is done and changes accordingly, advances, falls back, the different control such as zooms in or out by rearmounted computer 9.
Microcontroller 6 is the control core of augmented reality Light Transmission helmet display front end circuit, complete the initialization to each sensor assembly in addition to camera module 4 and data acquisition, to the control of display module and with the function such as communicate of rearmounted computer.
2, inertial navigation module and the control mode of GPS integrated module.
2-1, module initialization.To inertial navigation module and the gyroscope in GPS integrated module 1, accelerometer, geomagnetic field sensors calibration, the position zero of GPS.
2-2, according to back information amount, passback speed is set, communication baud rate is set, I is set2C interface address, arranges GPS and connects baud rate.
2-3, reading acceleration output, angular velocity output, angle output, magnetic field output, air pressure, height output, longitude and latitude output, ground velocity output etc..
2-4, according to output data calculate corresponding desired data, for display module 5.
3, with the control mode of infrared gesture identification integrated module, ambient light detection includes that ambient light detection controls and gesture identification controls.
The control mode of 3-1, ambient light detection is: ambient light detection starts to RGBC from photodiode detection RGBC to terminate 16 bit data register.In order to avoid changing brightness degree too quickly in control, when the instantaneous variation of light intensity (such as a fan window open or moment has the light beam inswept), it is to avoid backlight illumination occurs unnecessary change, and user will not be allowed to do not feel like oneself.Further, longer response time additionally aids the minimizing microcontroller detection number of times to optical sensor, such that it is able to discharge certain microcontroller resource.So after only having light intensity deviation particular range certain time in the controlling, just backlight illumination being adjusted.Such as, if normal light intensity is 200lux, only may can drop to below 180lux in light intensity or rise to more than 220lux, and the persistent period exceed the several seconds in the case of just can carry out brightness regulation.
The concrete control mode that ambient light detection controls is:
3-1-1, reference normal ambient light intensity arrange the duration threshold after intensity of illumination change threshold and intensity of illumination change；Such as, if normal light intensity is 200lux, only just OLED may can need to be shown when light intensity drops to below 180lux or rises to more than 220lux and exceed duration threshold and be adjusted.
3-1-2, ambient light sensor is utilized to pass through different damping material detection intensity of illumination, through ambient light detection and data converter output red (R), green (G) in infrared gesture identification integrated module, blue (B) and 16 bit data of transparency (C).
3-1-3,16 bit data according to RGBC, it is judged that the change of intensity of illumination whether in the range of intensity of illumination change threshold, if, then the persistent period adds one, and forwards step 3-1-4 to；If not existing, then the persistent period resets, and returns step 3-1-2 and re-start detection.
3-1-4, judging whether the persistent period that intensity of illumination changes exceedes setting time threshold, if exceeding, then producing interrupt signal；If being less than, then the persistent period resets, and returns step 3-1-2 and re-start detection.
3-2, the control mode of gesture identification be: gestures detection function utilizes the infrared energy of four directional lighting diode perceived reflection, then converts this data to physical motion information, including speed, direction and distance；In transformation process, definition calculates entrance vector and calculates outlet point vector respectively, by to the comparative result calculating entrance vector calculating outlet point vector, distinguish and judge six kinds of directions of gesture motion, including gesture up and down, about upper under gesture, gesture, the right left side of gesture, gesture draw near and gesture from the close-by examples to those far off.
4, the control mode of unspecified person verbal instructions identification module is:
4-1, module initialization, in this step, carry out Initialize installation to each depositor in each module.
4-2, write recognized list.Verbal instructions identification is a verbal instructions identification based on dictionary, should be by phrase write recognized list to be identified.The rule of list is, the corresponding specific numbering (1 byte) of each identification entry, the numbering of different identification entries can be identical, and need not be continuous.Could support up 50 and identify entry, each identification entry is the Chinese phonetic alphabet (small letter) of standard mandarin, stays interval, a space between every 2 characters.Numbering can be identical, can be discontinuous, but numerical value is less than 256(00H ~ FFH).
4-3, start identify, according to ready interrupt response function, open interrupt enable bit.
4-4, response are interrupted: if mike collects sound, in spite of identifying normal outcome, all can produce an interrupt signal, and interrupt routine will be according to the value analysis result of depositor.Read matching value depositor, to obtain most probable correct option.
5, the control mode of HDMI receiver is:
5-1, by microcontroller 6, HDMI receiver 51 is initialized, and viewing area and display pattern are configured.
5-2, will be processed by rearmounted computer 9 after a frame video data export to HDMI receiver 51, then incoming data are converted, it is output as 24 888 RGB data, is entered in pattern data memory and buffers, be then output in OLED display 52 show.
6, OLED display 52 receives 24 rgb signals that HDMI receiver 51 produces, the ambient light detection read further according to microcontroller 6 and the light conditions of infrared gesture identification integrated module 2, by in OLED display, numeral gamma is corrected, color saturation adjusts and grey scale mapping mode, display brightness is adjusted.
Microcontroller 6 realizes the communication between rearmounted computer by USB Slave interface, by the gesture received, verbal instructions information and obtain positional information by inertial navigation and GPS module and pass to rearmounted computer.Display video is made corresponding change according to its information by rearmounted computer.
Claims (3)
1. an augmented reality Light Transmission helmet display front end circuit, is characterized in that, including:
Inertial navigation module and GPS integrated module, be integrated with gyroscope, accelerometer, geomagnetic field sensors, GPS, filter circuit and voltage stabilizing circuit；Described inertial navigation module connects with microcontroller with GPS integrated module, is used for providing user of service's head pose and personnel's spatial positional information；
Ambient light detection and infrared gesture identification integrated module, including ambient light sensor, data converter, gesture sensor and the first data buffer FIFO, described ambient light sensor is used for detecting environment illumination intensity, described data converter for being converted into the corresponding data information of red, green, blue and transparency by the environment illumination intensity of detection, described gesture sensor is used for sensing gesture motion, and described first data buffer FIFO is used for storing illumination and gesture data；The detection of described ambient light passes through I with infrared gesture identification integrated module2C bus connects with microcontroller, completes the communication between microcontroller；
Unspecified person verbal instructions identification module, including microphone interface, A/D converter, voice recognition processing unit, the second data buffer FIFO, SPI interface, D/A converter, power amplifier and sound output interface；Described unspecified person verbal instructions identification module connects with microcontroller, is used for identifying unspecified person verbal instructions；
Camera module, it is leaded up to and meets USB
Hub extension mouth connects rearmounted computer, and USB Slave interface of separately leading up to connects with microcontroller；Described camera module is used for obtaining scene video, and video information sends to rearmounted computer；
Display module, including HDMI receiver and OLED display；Described HDMI receiver and described OLED display pass through I respectively2C bus connects with microcontroller, the communication being used between microcontroller；Described HDMI receiver is connected with OLED display by video drive interface, is used for showing scene video；
Microcontroller, connect with infrared gesture identification integrated module, described unspecified person verbal instructions identification module and described display module with GPS integrated module, the detection of described ambient light with described inertial navigation module respectively, control for completing the initialization operation to each operational module, complete described HDMI receiver and the control to described OLED display；And
Power module, provides working power for system.
2. the control method of an augmented reality Light Transmission helmet display front end circuit, it is characterized in that, including control, inertial navigation module and the control of GPS integrated module, ambient light detection and the control of infrared gesture identification integrated module, the control of unspecified person verbal instructions identification module, the control of HDMI receiver and the control of OLED display of microcontroller；
A, the control mode of microcontroller be:
A-1, pass through I2C interface carries out initialization operation control to the HDMI receiver in display module and OLED display, and HDMI receiver is filled EDIF information, arranges the original intensity of OLED display；
A-2, according to detection environment illumination intensity, the brightness to OLED display is adjusted；
A-3, reading inertial navigation and GPS information, be sent to rearmounted computer, and rearmounted computer is according to the information accepted, the region that location human eye is interested；
A-4, response interruptive command, read gesture identification and verbal instructions identification information, and transfer information to rearmounted computer, and display video, according to gesture identification and voice command, is done and changes accordingly, advances, falls back, zooms in or out control by rearmounted computer；
B, inertial navigation module with the control mode of GPS integrated module be:
B-1, module initialization；Inertial navigation module is calibrated with the gyroscope in GPS integrated module, accelerometer and geomagnetic field sensors, the position zero of GPS；
B-2, according to back information amount, arrange passback speed, this module communication baud rate, I2C interface address and GPS connect baud rate；
B-3, reading acceleration export, angular velocity exports, angle exports, magnetic field exports, air pressure exports, highly export, longitude and latitude exports, ground velocity exports；
B-4, according to output data calculate desired data, for display module；
With the control mode of infrared gesture identification integrated module, the detection of c, ambient light includes that ambient light detection controls and gesture identification controls；
The control mode of c-1, ambient light detection is:
Ambient light detection starts to RGBC from photodiode detection RGBC to terminate 16 bit data register, after environment illumination intensity deviation threshold value arrives and sets duration, is i.e. adjusted backlight illumination；
C-2, the control mode of gesture identification be:
Utilize the infrared energy of four directional lighting diode perceived reflection, then convert this data to physical motion information, including speed, direction and distance；In transformation process, definition calculates entrance vector and calculates outlet point vector respectively, by to the comparative result calculating entrance vector calculating outlet point vector, distinguish and judge six kinds of directions of gesture motion, including gesture up and down, about upper under gesture, gesture, the right left side of gesture, gesture draw near and gesture from the close-by examples to those far off；
D, the control mode of unspecified person verbal instructions identification module be:
D-1, module initialization, and each depositor in module is carried out Initialize installation；
D-2, write recognized list: by phrase write recognized list to be identified；The rule of recognized list is, the corresponding numbering of each identification entry, stays interval, a space between each two character；Numbering numerical value is less than 256；
D-3, start identify, according to getting out interrupt response function, open interrupt enable bit；
D-4, response are interrupted: whenever mike collects sound, in spite of identifying normal outcome, all producing an interrupt signal, interrupt routine is according to the value analysis result of depositor；Reading matching value depositor, the answer obtained is most probable correct option；
E, the control mode of described HDMI receiver be:
E-1, by microcontroller, HDMI receiver is initialized, and viewing area and display pattern is configured；
E-2, by a frame video data good for rearmounted computer disposal to HDMI receiver export, incoming data are converted into 24 888 RGB data by HDMI receiver, and be input in pattern data memory buffer, it is then output in OLED display prepare display；
F, the control mode of described OLED display be:
OLED display receives 24 rgb signals that HDMI receiver produces, the ambient light detection read further according to microcontroller and the light conditions of infrared gesture identification integrated module, by in OLED display, numeral gamma is corrected, color saturation adjusts and grey scale mapping mode, display brightness is adjusted.
The control method of the augmented reality Light Transmission helmet the most according to claim 2 display front end circuit, is characterized in that, the concrete control mode that the detection of described ambient light controls is:
C-1-1, reference normal ambient light intensity arrange the duration threshold after intensity of illumination change threshold and intensity of illumination change；
C-1-2, ambient light sensor is utilized to pass through different damping material detection intensity of illumination, through ambient light detection and data converter output red (R), green (G) in infrared gesture identification integrated module, blue (B) and 16 bit data of transparency (C)；
C-1-3,16 bit data according to RGBC, it is judged that the change of intensity of illumination whether in the range of intensity of illumination change threshold, if, then the persistent period adds one, and forwards step c-1-4 to；If not existing, then the persistent period resets, and returns step c-1-2 and re-start detection；
C-1-4, judging whether the persistent period that intensity of illumination changes exceedes setting time threshold, if exceeding, then producing interrupt signal；If being less than, then the persistent period resets, and returns step c-1-2 and re-start detection.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610557750.8A CN106019592A (en) | 2016-07-15 | 2016-07-15 | Augmented reality optical transmission-type helmet mounted display pre-circuit and control method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610557750.8A CN106019592A (en) | 2016-07-15 | 2016-07-15 | Augmented reality optical transmission-type helmet mounted display pre-circuit and control method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106019592A true CN106019592A (en) | 2016-10-12 |
Family
ID=57119019
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610557750.8A Pending CN106019592A (en) | 2016-07-15 | 2016-07-15 | Augmented reality optical transmission-type helmet mounted display pre-circuit and control method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106019592A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106950692A (en) * | 2017-02-23 | 2017-07-14 | 腾讯科技（深圳）有限公司 | The manufacture method of wear-type virtual reality device and its circuit board |
| CN107230478A (en) * | 2017-05-03 | 2017-10-03 | 上海斐讯数据通信技术有限公司 | A kind of voice information processing method and system |
| CN107749289A (en) * | 2017-10-20 | 2018-03-02 | 广东虚拟现实科技有限公司 | Brightness adjusting method, device, brightness control system and augmented reality equipment |
| CN107884942A (en) * | 2017-12-18 | 2018-04-06 | 国网浙江省电力公司培训中心 | A kind of augmented reality display device |
| CN110865704A (en) * | 2019-10-21 | 2020-03-06 | 浙江大学 | Gesture interaction device and method for 360-degree suspended light field three-dimensional display system |
| CN113031265A (en) * | 2021-02-05 | 2021-06-25 | 杭州小派智能科技有限公司 | Split AR display device and display method |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101419339A (en) * | 2008-11-24 | 2009-04-29 | 电子科技大学 | Head-mounted display |
| CN101539804A (en) * | 2009-03-11 | 2009-09-23 | 上海大学 | Real time human-machine interaction method and system based on augmented virtual reality and anomalous screen |
| CN104281266A (en) * | 2014-10-17 | 2015-01-14 | 栾林林 | Head-mounted display equipment |
| CN104618712A (en) * | 2015-02-13 | 2015-05-13 | 北京维阿时代科技有限公司 | Head wearing type virtual reality equipment and virtual reality system comprising equipment |
| CN104811687A (en) * | 2015-04-24 | 2015-07-29 | 小鸟科技有限公司 | Circuit system of virtual reality helmet and virtual reality helmet |
| CN205958841U (en) * | 2016-07-15 | 2017-02-15 | 中国人民解放军63908部队 | Augmented reality optical transmission formula helmet mounted display front end circuit |
-
2016
- 2016-07-15 CN CN201610557750.8A patent/CN106019592A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101419339A (en) * | 2008-11-24 | 2009-04-29 | 电子科技大学 | Head-mounted display |
| CN101539804A (en) * | 2009-03-11 | 2009-09-23 | 上海大学 | Real time human-machine interaction method and system based on augmented virtual reality and anomalous screen |
| CN104281266A (en) * | 2014-10-17 | 2015-01-14 | 栾林林 | Head-mounted display equipment |
| CN104618712A (en) * | 2015-02-13 | 2015-05-13 | 北京维阿时代科技有限公司 | Head wearing type virtual reality equipment and virtual reality system comprising equipment |
| CN104811687A (en) * | 2015-04-24 | 2015-07-29 | 小鸟科技有限公司 | Circuit system of virtual reality helmet and virtual reality helmet |
| CN205958841U (en) * | 2016-07-15 | 2017-02-15 | 中国人民解放军63908部队 | Augmented reality optical transmission formula helmet mounted display front end circuit |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106950692A (en) * | 2017-02-23 | 2017-07-14 | 腾讯科技（深圳）有限公司 | The manufacture method of wear-type virtual reality device and its circuit board |
| CN107230478A (en) * | 2017-05-03 | 2017-10-03 | 上海斐讯数据通信技术有限公司 | A kind of voice information processing method and system |
| CN107749289A (en) * | 2017-10-20 | 2018-03-02 | 广东虚拟现实科技有限公司 | Brightness adjusting method, device, brightness control system and augmented reality equipment |
| CN107749289B (en) * | 2017-10-20 | 2024-04-26 | 广东虚拟现实科技有限公司 | Brightness adjusting method and device, brightness adjusting system and augmented reality equipment |
| CN107884942A (en) * | 2017-12-18 | 2018-04-06 | 国网浙江省电力公司培训中心 | A kind of augmented reality display device |
| CN110865704A (en) * | 2019-10-21 | 2020-03-06 | 浙江大学 | Gesture interaction device and method for 360-degree suspended light field three-dimensional display system |
| CN113031265A (en) * | 2021-02-05 | 2021-06-25 | 杭州小派智能科技有限公司 | Split AR display device and display method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106019592A (en) | Augmented reality optical transmission-type helmet mounted display pre-circuit and control method thereof | |
| US20220188539A1 (en) | Eyewear including sign language to speech translation | |
| CN108227914B (en) | Transparent display device, control method using the same, and controller thereof | |
| US8855719B2 (en) | Wireless hands-free computing headset with detachable accessories controllable by motion, body gesture and/or vocal commands | |
| WO2019216491A1 (en) | A method of analyzing objects in images recorded by a camera of a head mounted device | |
| US9678349B2 (en) | Transparent type near-eye display device | |
| US20160041388A1 (en) | Head mounted display, information system, control method for head mounted display, and computer program | |
| CN102812417B (en) | The wireless hands-free with the detachable accessory that can be controlled by motion, body gesture and/or verbal order calculates headset | |
| US10303435B2 (en) | Head-mounted display device, method of controlling head-mounted display device, and computer program | |
| US9134793B2 (en) | Headset computer with head tracking input used for inertial control | |
| WO2016077508A1 (en) | System for automatic eye tracking calibration of head mounted display device | |
| CN105934730A (en) | Automated content scrolling | |
| CN104036270B (en) | A kind of instant automatic translation device and method | |
| KR20150011577A (en) | Device, method and computer readable recording medium for displaying a wallpaper on an electronic device | |
| WO2016010200A1 (en) | Wearable display device and control method thereof | |
| US10761694B2 (en) | Extended reality content exclusion | |
| WO2022006116A1 (en) | Augmented reality eyewear with speech bubbles and translation | |
| US9640199B2 (en) | Location tracking from natural speech | |
| US20210390882A1 (en) | Blind assist eyewear with geometric hazard detection | |
| US11551688B1 (en) | Wearable speech input-based vision to audio interpreter | |
| CN205958841U (en) | Augmented reality optical transmission formula helmet mounted display front end circuit | |
| JP2016130985A (en) | Head-mounted type display device, method of controlling head-mounted type display device, and computer program | |
| US11455796B1 (en) | Blindness assist glasses | |
| CN110208946A (en) | A kind of wearable device and the exchange method based on wearable device | |
| US20160091717A1 (en) | Head-mounted display system and operation method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20161012 |
|
| RJ01 | Rejection of invention patent application after publication |