CN205485920U - Show controlling means and display control system - Google Patents
Show controlling means and display control system Download PDFInfo
- Publication number
- CN205485920U CN205485920U CN201620061471.8U CN201620061471U CN205485920U CN 205485920 U CN205485920 U CN 205485920U CN 201620061471 U CN201620061471 U CN 201620061471U CN 205485920 U CN205485920 U CN 205485920U
- Authority
- CN
- China
- Prior art keywords
- brain wave
- image
- display
- current
- attentively
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Eye Examination Apparatus (AREA)
Abstract
The embodiment of the utility model provides a show controlling means and display control system relates to and shows technical field, can improve the convenience that the user used display device. Display control system, its characterized in that includes: display device, wearable equipment, controller, display device is used for display image, as current display image, wearable equipment is used for acquireing eyes when watching current display image attentively on the display image watches the position attentively to and acquire eyes and watch attentively current brain wave during current display image, the controller is used for working as the feature parameter of current brain wave satisfies when predetermineeing the condition, according to current brain wave is confirmed the control command that current brain wave corresponds, according to control command is right the display image who watches the position attentively carries out corresponding operation.
Description
Technical field
This utility model relates to Display Technique field, particularly relates to a kind of display control unit and shows
Show control system.
Background technology
Along with the development of Display Technique, display device such as TV, computer and mobile phone etc.
Electronic product is increasingly becoming the necessary in people's daily life.But, user is above-mentioned in use
Typically require during display device by some auxiliary device so that display device is manipulated, such as
When user is when playing game, need by game paddle, it is achieved the location or more in display picture
Replacing equipments etc. operate.Or, during user watches picture or film, need by distant
Control device controls the content that display picture shows.So, use display device is reduced just
Profit.
Utility model content
Embodiment of the present utility model provides a kind of display control unit and display control program, energy
Enough improve user and use the convenience of display device.
For reaching above-mentioned purpose, embodiment of the present utility model adopts the following technical scheme that
The one side of this utility model embodiment, it is provided that a kind of display control program, including: aobvious
Show equipment, wearable device, controller；Described display device is used for showing image, as working as
Front display image；Display when described wearable device is used for obtaining eye gaze currently displaying image
Watch position attentively on image, and work as forebrain when obtaining currently displaying image described in eye gaze
Electric wave；Described controller is for meeting pre-conditioned when the characteristic parameter of described current brain wave
Time, determine, according to described current brain wave, the control instruction that described current brain wave is corresponding；According to
Described control instruction performs corresponding operation to the described display image watching position attentively.
Preferably, described display device is arranged with described wearable device separate type, and by having
Line or wireless mode connect, and mutual for information, described controller is arranged on described display device
In.
Preferably, described wearable device includes wearing support, described in wear and be provided with on support
For gathering the acquiring brain waves loop of current brain wave, adopting for gathering the image of eyes imaging
Storage, and be used for determining that eyes are at display image according to the image that described image acquisition device gathers
On the processor watching position attentively；Described processor is additionally operable to described current brain wave and described
Watch position attentively to send to described display device.
Preferably, described wearable device includes wearing support, described in wear and be integrated with on support
Described display device and described controller.
Preferably, wear described in be provided with on support and adopt for the brain wave gathering current brain wave
Collection loop, for gathering the image acquisition device of eyes imaging, and for adopting according to described image
The image of storage collection determines the eyes processor watching position attentively on display image；Described place
Reason device is additionally operable to described current brain wave and described watch position attentively and send to described display device.
Preferably, described acquiring brain waves loop is passed by forehead sensor and at least one ear-lobe
Sensor is constituted.
Preferably, described image acquisition device is ccd image sensor or cmos image sensing
Device.
It is further preferred that be provided with infrared light on described image acquisition device and described display device
Light source.
The another aspect of this utility model embodiment, it is provided that a kind of display control unit, including:
Acquisition module, fixation position when being used for obtaining the currently displaying image of eye gaze, on display image
Put, and current brain wave when watching described currently displaying image attentively；Determine module, for working as
When the characteristic parameter of described current brain wave meets pre-conditioned, true according to described current brain wave
The control instruction that fixed described current brain wave is corresponding；Perform module, for referring to according to described control
Order, performs corresponding operation to the described display image watching position attentively.
Preferably, also include memory module, described acquisition module include for obtain described currently
The acquiring brain waves submodule of brain wave, described determine module include characteristic parameter obtain submodule
And instruction compilation submodule；Described characteristic parameter obtains submodule and connects described acquiring brain waves
Submodule, for determining described current brain wave and the characteristic parameter of default brain wave；Described finger
Order compilation submodule connects described characteristic parameter and obtains submodule, is used for setting up brain wave data
Collection, described brain wave data collection prestores the characteristic parameter of default brain wave and the right of control instruction
Should be related to；Described memory module connects described characteristic parameter and obtains submodule and described instruction compilation
Submodule, is used for storing described control instruction, described characteristic parameter and described brain wave data
Collection.
Determine that module also includes characteristic matching submodule it is further preferred that described；Described feature
Matched sub-block connects described characteristic parameter and obtains submodule and described memory module, for by institute
State characteristic parameter and obtain the characteristic parameter of the current brain wave that submodule gets and described storage
In module, the characteristic parameter of the default brain wave that brain wave data is concentrated mates.
Determine that module also includes that instruction obtains submodule, with described spy it is further preferred that described
Levy matched sub-block to be connected with described memory module, for when the feature of described current brain wave
When the characteristic parameter of parameter and described default brain wave matches, obtain from described memory module
The control instruction corresponding to default brain wave matched.
Preferably, described acquisition module includes: eyes image gathers submodule, sight line determines son
Module, position calculation element submodule；Described eyes image gathers submodule and is used for obtaining eye
Image, determines pupil position；Described sight line determines that submodule gathers submodule with described eyes image
Block is connected, and is used for calculating direction of visual lines；Described position calculation submodule is true with described sight line
Stator modules is connected, for closing according to the mapping of described direction of visual lines with described display image
System, show that described eyes watch position attentively at described display image.
This utility model embodiment provides a kind of display control unit and display control program, described
Display when wearable device is used for obtaining eye gaze currently displaying image in display control program
Watch position attentively on image, and work as forebrain when obtaining currently displaying image described in eye gaze
Electric wave；Controller is when the characteristic parameter of described current brain wave meets pre-conditioned, according to institute
State the control instruction that current brain wave determines that described current brain wave is corresponding；Refer to according to described control
Make and the described display image watching position attentively is performed corresponding operation.Without manually just realizing
Man-machine interaction, such that it is able to improve the convenience of user operation wearable device.
Accompanying drawing explanation
In order to be illustrated more clearly that this utility model embodiment or technical scheme of the prior art, below
The accompanying drawing used required in embodiment or description of the prior art will be briefly described, it is clear that
Ground, the accompanying drawing in describing below is only embodiments more of the present utility model, common for this area
From the point of view of technical staff, on the premise of not paying creative work, it is also possible to obtain according to these accompanying drawings
Other accompanying drawing.
The display image signal of the display control unit that Fig. 1 a provides for this utility model embodiment
Figure；
Fig. 1 b is the schematic diagram that after brain wave is affected by electromyogram, peak value changes；
Fig. 2 a is a kind of schematic diagram that pupil position determines；
Fig. 2 b is the another kind of schematic diagram that pupil position determines；
Fig. 2 c is another schematic diagram that pupil position determines；
The flow process of the another kind of display control method that Fig. 3 a provides for this utility model embodiment
Figure；
Fig. 3 b is a kind of schematic diagram that shows image corresponding with Fig. 3 a；
Fig. 3 c is the schematic diagram of the another kind of display image corresponding with Fig. 3 a；
The structural representation of a kind of display control unit that Fig. 4 provides for this utility model embodiment
Figure；
Fig. 5 is the connected mode schematic diagram of concrete parts in the display control unit shown in Fig. 4；
The structural representation of a kind of display control program that Fig. 6 provides for this utility model embodiment
Figure；
Fig. 7 is the concrete structure schematic diagram of display control program in Fig. 6；
A kind of acquiring brain waves circuit diagram that Fig. 8 provides for this utility model embodiment；
Fig. 9 shows for the structure of the another kind of display control program that this utility model embodiment provides
It is intended to.
Reference:
100-shows image；101-image main contents；102-handle icon；110-wears support；
10-display floater；The imaging in human eye of the image on 11-display floater；12-pupil；120-
Infrared light supply；121-hot spot；13-eyeball；The virtual point of fixation of 103-；130-sector of fire；131-
Manipulation region；01-acquisition module；02-determines module；03-performs module；04-memory module；
201-acquiring brain waves submodule；202-characteristic parameter obtains submodule；203-instruction compilation
Module；204-characteristic matching submodule；205-instruction obtains submodule；206-eyes image is adopted
Collection submodule；207-sight line determines submodule；208-position calculation submodule；20-display device；
30-wearable device；40-controller；111-acquiring brain waves loop；112-forehead sensor；
113-ear-lobe sensor；114-image acquisition device；115-infrared light light source；T-acquisition phase；
The a certain moment in S-acquisition phase；The brain wave that G1-peak value is not undergone mutation；G2-electromyogram；
The overlaid waveforms figure of G3-G1 Yu G2.
Detailed description of the invention
At present, either common display or virtual reality show, all refer to user and set with display
Standby is mutual, to realize the operation to display image or control.At present, user and display device
By peripheral hardware or touch screen interaction, such user operation convenience is not high enough.
A kind of display control program of this utility model embodiment offer, as shown in Figure 6, including:
Display device 20, wearable device 30, controller 40.
Concrete, display device 20 is used for showing image 100, as currently displaying image.
Wearable device 30 is used for when obtaining the currently displaying image of eye gaze showing image 100
On watch position attentively, and current brain wave when obtaining the currently displaying image of eye gaze.
Controller 40 is used for when the characteristic parameter of current brain wave meets pre-conditioned, according to
Current brain wave determines the control instruction that current brain wave is corresponding；According to control instruction to fixation position
The display image 100 put performs to operate accordingly.
So, utilize wearable device that eye-gaze position is obtained, so that
To display device, user can show that the operating position on image selects by eyes
Select, and user can send different brain waves under different thinking caps, so can also profit
The current brain wave watched user attentively during currently displaying image with above-mentioned wearable device obtains
Take.The most really controller can go to judge to use according to the current brain wave that wearable device gets
Family is the need of performing the above-mentioned corresponding operating watching position attentively, if user needs to perform above-mentioned behaviour
Make, then controller can perform corresponding operation to the display image watching position attentively.Therefore above-mentioned
Without manually corresponding operating just can be realized during control, such that it is able to improve wearable device
Convenience.
It should be noted that display device 20 and wearable device 30 can be arranged with separate type,
And connected by wired or wireless mode, mutual for information, controller 40 is arranged on display
In equipment 20.Concrete, above-mentioned display device 20 can be mobile phone, computer, TV etc..
Wherein, this display device 20 includes display floater, and described display floater can be liquid crystal display
Panel, or OLED (English full name: Organic Light Emitting Diode, Chinese complete
Claim: Organic Light Emitting Diode) display floater.Wherein, above-mentioned wearable device 30 can be
Wear-type wearable device, wearable device includes the head for being worn on head in the case
Wear support.
Additionally, controller noted above 40 is integrated in mobile phone, computer or television, be used for receiving,
Send and process data message.
Or, above-mentioned wearable device 30 can be wear-type wearable device, in this situation
Lower wearable device includes can including as shown in Figure 7 wearing support 110.Described wear support
Display device 20 and controller 40 it is integrated with on 110.
In the case of above-mentioned wearable device includes wearing support 110, as a example by Fig. 7, on
State and wear the brain wave for gathering current brain wave being provided with on support 110 as shown in Figure 8
Acquisition circuit 111, as shown in Figure 7 for gathering the image acquisition device 114 of eyes imaging,
And the image for gathering according to image acquisition device 114 determines that eyes are on display image
Watch the processor (not shown) of position attentively.Processor is additionally operable to current brain wave and note
Apparent place sends to display device 20.
Concrete, above-mentioned acquiring brain waves loop 111, as shown in Figure 8 by forehead sensor 112,
At least one ear-lobe sensor 113 is constituted.Wherein, above-mentioned forehead sensor 112, at least
Individual ear-lobe sensor 113 can be as it is shown in fig. 7, be fixed on and wear on support 110, this external
Can be arranged in connection forehead sensor 112, the circuit of at least one ear-lobe sensor 113
Wear in support 110.Under normal circumstances, at least one ear-lobe sensor 113 includes being attached at
The ear-lobe sensor 113 of left ear ear-lobe and be attached at the ear-lobe sensor 113 of auris dextra ear-lobe.
Additionally, above-mentioned image acquisition device 114 is ccd image sensor or cmos image biography
Sensor.In the case, in order to use corneal reflex pattern that sight line is tracked, Ke Yi
On display device 20, the such as both sides of display device 20 are provided with infrared light light source 115, and
Image acquisition device 114 is also provided with the infrared light light source (infrared light on image acquisition device 114
Not shown in light source figure).
Or, above-mentioned support 110 of wearing can be illustrated in figure 9 the mirror holder of glasses, and shows
Equipment 20 can be installed at picture frame, and controller 40 is arranged between adjacent two picture frames.
Below in conjunction with the accompanying drawing in this utility model embodiment, in this utility model embodiment
Technical scheme be clearly and completely described.
For example, it is assumed that display device is the computer (e.g., controller is CPU) with controller.
Wearable device is wear-type wearable device.Then, user need to mutual with display device time, wear
Wear described wear-type wearable device, and watch the currently displaying image that computer shows attentively.
In the case, when user wears described wear-type wearable device, and it is aobvious to watch computer attentively
During the currently displaying image shown, wear-type wearable device can obtain user watch attentively position and
Current brain wave, and provide above-mentioned to computer and watch position and current brain wave attentively, so that computer
Can get and above-mentioned watch position and current brain wave attentively.
Assume that computer display image is for showing image 100, this display image bag as shown in Figure 1a
Include image main contents 101, and handle icon 102, such as three handle icon 102 in Fig. 1 a
It is followed successively by from left to right and minimizes icon, reduction icon or close icon etc..If user needs to close
When closing the image main contents 101 in display image 100, closedown icon can be watched attentively, wearable set
Standby brain wave when watching position attentively and watch attentively that eyes of user just can be detected, will watch position attentively
It is sent to display device by wirelessly or non-wirelessly mode with brain wave.
Additionally, the characteristic parameter of brain wave can be at least in the frequency of brain wave, amplitude
Kind.Described control instruction can be the instruction corresponding with handle icon 102, such as with close,
Preserve, minimize, maximize, determine, the control instruction that icon is corresponding such as choose.Concrete,
The instruction corresponding with closing icon can be out code.
Explanation as a example by the characteristic parameter of brain wave is as frequency.Watch position attentively when getting and watch attentively
Time brain wave time, it is judged that whether the frequency of current brain wave meets pre-conditioned, the most then
Determine, according to current brain wave, the control instruction that current brain wave is corresponding, otherwise, do nothing
Or report an error.
In the case, if the frequency of current brain wave is the brain wave frequency being absorbed in state,
Then think user watch attentively for wish to carry out certain operation watch attentively, and fixation position be set to as figure
During the closedown icon of 1a, determine, according to current brain wave, the control instruction that current brain wave is corresponding
For out code.Determine when control instruction is out code, perform to close display image 100
Operation.
It should be noted that the described display image that user watches attentively can be to show on display device
True picture, it is also possible to be the virtual image that shown by projection device of wearable device, tool
Body, the true of display device is shown the image projection retina people, vision by projection device
Effect is to have a virtual image in human eye field range.
Above-mentioned pre-conditioned be relevant to brain wave characteristic parameter pre-conditioned, different brain electricity
Wave parameter, pre-conditioned also different, calling of the most pre-conditioned corresponding control instruction is the poorest
Different.
Concrete, if during frequency that features described above parameter is brain wave, described pre-conditioned be
One frequency threshold.
More specifically, the usual user focus when watching image main contents 101 is the most relatively held
The focus of row aforesaid operations icon 102 is low.Therefore user is when watching image main contents 101
Above-mentioned alpha wave (8～12Hz) can be sent, and perform aforesaid operations icon 102 at needs
Time can send above-mentioned β brain wave (12～30Hz).Said frequencies threshold value can be 12Hz.
I.e. when the frequency of current brain wave is less than 12Hz, illustrate that user is simply at viewing image main contents
101, it is not carried out the purpose of handle icon 102.And be more than or equal in the frequency of current brain wave
During 12Hz, illustrate that user needs to perform handle icon 102.
In the case, corresponding with deserving front brain wave control instruction performs this handle icon
102, such as click closedown icon.So, when the frequency of the current brain wave collected
During more than said frequencies threshold value (12Hz), determine that user needs single-click operation icon 102.
It follows that single-click operation can be performed in the handle icon 102 that user is watched attentively position.When
When the frequency of the current brain wave collected is less than said frequencies threshold value (12Hz), will be to operation
Icon 102 does not carry out any operation.
If when the frequency that features described above parameter is brain wave and amplitude.Described pre-conditioned include one
Whether the peak value of frequency threshold and current brain wave waveform is in acquisition phase T as shown in Figure 1 b
Undergo mutation.
Concrete, owing to the contraction of eye muscle also can produce certain electric wave, i.e. electromyogram
G2 (as shown in Figure 1 b).Wherein, the contraction of eye muscle can be caused by nictation.Thus
The peak value that can make brain wave G1 amplitude was undergone mutation in the S moment of above-mentioned acquisition phase T.
Wherein, the waveform that waveform G1 is the brain wave that amplitude peak is not undergone mutation in Fig. 1 b.
Wherein, the above-mentioned S moment is the brain wave G1 waveform that electromyogram G2 does not undergos mutation with peak value
The moment of superposition.
Based on this, when the frequency of the current brain wave collected is more than or equal to said frequencies threshold value
(being 12HZ with embodiment one), i.e. user are in the clear-headed state being absorbed in, and need to hold
Row handle icon 102.It follows that need to judge handle icon 102 is clicked or double
Hit. now, there occurs bigger change in the current brain wave amplitude peak in the S moment, then
Illustrating that user blinks when viewing display image 100, before now deserving, brain wave is corresponding
Control instruction is double click operation icon 102.And at the amplitude of current brain wave in gatherer process
All do not change, then explanation user does not blinks when viewing display image 100, now deserves
The control instruction that front brain wave is corresponding can be single-click operation icon 102.Additionally, when collecting
Current brain wave frequency less than said frequencies threshold value (12Hz) time, will be to handle icon
102 do not carry out any operation.
If during the amplitude that features described above parameter is brain wave, the most described pre-conditioned including works as forebrain
Whether the peak value of electric wave waveform undergos mutation in acquisition phase T as shown in Figure 1 b.
Concrete, when user does not sees image 101, it will usually eyes are narrowed thus same
Sample can the contraction of therefore eye muscle so that the peak value of brain wave G1 amplitude is on above-mentioned collection rank
The S moment of section T undergos mutation.
Based on this, the amplitude peak at current brain wave there occurs bigger change in the S moment
Time, then explanation user narrows and has in mind at viewing display image 100, brain wave pair before now deserving
The control instruction answered can be to amplify display image 100.Amplitude at current brain wave does not occurs
During change, can not carry out any operation to amplifying display image 100.
From the foregoing, it is corresponding with control instruction to be previously stored some at wearable device
Characteristic parameter.Such as frequency is the control instruction clicked of β brain wave correspondence of 12～30Hz.So
And when the frequency of above-mentioned current brain wave is in 12～30Hz, it is merely able to get the control of single-click operation
System instruction.Such as double click operation or amplifieroperation are instructed for other, is required to combine eye muscle
Shrink or expand the electromyogram obtained the impact of the amplitude generation of current brain wave is realized.Add
Obtain the complexity of control instruction.In order to solve the problems referred to above, this utility model can also include many
Individual control instruction.For current brain wave and the default brain wave being previously stored whether this pre-conditioned
Coupling.
According to current brain wave, concrete determines that the control instruction that current brain wave is corresponding can be
First determine the characteristic parameter of current brain wave, then by the characteristic parameter of current brain wave and brain electricity
The characteristic parameter of the default brain wave that wave datum is concentrated mates.Wherein, this brain wave data
Collection prestores the characteristic parameter of default brain wave and the corresponding relation of control instruction.Need explanation
It is that the characteristic parameter of current brain wave and the characteristic parameter of two brain waves match and refer to, currently
Difference between characteristic parameter and the characteristic parameter of two brain waves of brain wave is in the error allowed
Within the scope of.This error can be determined by the precision of wearable device.This utility model is to this not
Limit.Finally, in the characteristic parameter phase of characteristic parameter and default brain wave of current brain wave
During coupling, obtain the control instruction corresponding to default brain wave matched.
It should be noted that presetting brain wave is or to initialize before this wearable device dispatches from the factory
Time, it is stored in the brain wave in this wearable device in advance.
Concrete, can when wearable device dispatches from the factory or initial phase to user clear-headed
And under the state being absorbed in, the difference sent when being in different thinking activities states is preset brain wave and is carried out
Gather.Such as, although user can be in the frequency of β brain wave that is clear-headed and that send when being absorbed in
12～30Hz.But, different thinking activitiess can make the frequency of the brain wave in the range of 12～30Hz
Between there is subtle difference.Such as user needs to carry out presetting brain electricity during single-click operation control instruction
The frequency of ripple is 12～15 Hz, and the frequency presetting brain wave during double click operation control instruction is
18～21Hz, the frequency presetting brain wave during shutoff operation control instruction is 25～30Hz.In this situation
Under, above-mentioned current brain wave can be obtained, then by frequency and the brain wave data of current brain wave
The frequency of the default brain wave concentrated is mated.The such as frequency at current brain wave exists
Time in the range of 25～30Hz, then the current frequency of brain wave matches with the frequency of default brain wave,
Such that it is able to obtain the shutoff operation control instruction corresponding to default brain wave matched.And
When the frequency of current brain wave is in 12～15 Hz, then the frequency of current brain wave and default brain electricity
The frequency of ripple matches, and clicks behaviour such that it is able to obtain corresponding to the default brain wave that matches
Make control instruction.If additionally, when the frequency of current brain wave is in 16～17Hz, then when
The frequency of front brain wave cannot concentrate the frequency of any one default brain wave with brain wave data
Match, therefore cannot realize the acquisition of control instruction.
Certainly, the frequency of the default brain wave that above-mentioned different control instruction is corresponding is only illustrated
Bright, it is not the restriction of the control instruction corresponding to default brain wave.
So, by prestoring the characteristic parameter of default brain wave and the corresponding of control instruction
The brain wave data collection of relation, so that the corresponding multiple controls of all brain waves in 12～30Hz
Instruction, and without the motion by eye muscle.
On this basis, before obtaining above-mentioned current brain wave, it is also possible to determine default brain electricity
The characteristic parameter of ripple, and store.Set up the characteristic parameter including presetting brain wave and control afterwards
The brain wave data collection of corresponding relation of instruction, i.e. set up out the characteristic parameter of default brain wave with
Mapping relations between control instruction.It is thus possible to the spy of current brain wave Yu default brain wave
When levying match parameters, it is possible to call by the way of default brain wave utilizes addressing access and be in
This default brain wave has the control instruction of mapping relations.
Next the determination to using corneal reflex pattern to realize direction of visual lines illustrates.
Concrete, first on the display floater 10 as shown in Figure 2 a of wearable device respectively
Three infrared light supplies 120 being positioned at diverse location, the light that this infrared light supply 120 sends are set
Reflections of high brightness point, i.e. hot spot 121 can be formed on eyes of user cornea.Owing to eyeball is near
Like spheroid, in the case of head position is fixing, hot spot 121 is not affected by oculogyral,
It does not changes.Wherein, in Fig. 2 a, dotted rectangle represents the image on display floater 10
Imaging 11 in human eye.
In the case, the image acquisition device in wearable device can collect such as Fig. 2 b institute
The eyes image shown, by processing eyes image, can identify in this eyes image
Three hot spots 121 and pupil 12.Wherein, as shown in Figure 2 a, the center of pupil 12
The P point that position is determined by cross represents.Additionally, due to above three hot spot 121 be three not
The infrared light supply 120 of co-located is radiated on cornea the highlight reflection point formed, therefore Fig. 2 c
Shown in, by distance H between position and user and the screen of above three hot spot 121,
Coordinate (the X of the center of curvature O point of user's eyeball 13 can be obtainedO、YO, ZO) and use
The radius of curvature R of family eyeball 13.
Based on this, can close and extract pupil 12 as shown in Figure 2 a by the method for image procossing
Boundary sample point, then by the ellipse fitting method of least square, these sample points are carried out
Ellipse fitting, permissible, such that it is able to obtain the coordinate (X of the pupil 12 center P of through holeP,
YP).Concrete, above-mentioned elliptic equation is:
x2+Axy+By2+ Cx+Dy+E=0
Can be tried to achieve by the ellipse fitting of least square 5 parameters A in above-mentioned equation, B, C, D and
E, such that it is able to obtain above-mentioned elliptical center point, the coordinate (X of pupil 12 center PP, YP):
And pupil 12 center P is at the coordinate Z of Z axisPIt is approximately center of curvature O point at Z
The coordinate Z of axleODifference with the radius of curvature R of user's eyeball 13.Finally draw in pupil 12
Coordinate (the X of heart position PP, YP, ZP), thus complete the determination of pupil 12 position.
It follows that above-mentioned steps S302 includes the coordinate (X of pupil 12 center PP,
YP, ZP), the coordinate (X of the center of curvature O point of eyeball 13O、YO, ZO) can be true
Make angle γ as shown in Figure 2 c, thus complete the determination of direction of visual lines.
Finally, according to above-mentioned direction of visual lines, i.e. angle γ, and combine direction of visual lines and display figure
As the mapping relations of 100, such as, distance H between user and screen is utilized to show that eyes exist
The position of point of fixation B on display image 100.
It should be noted that above-mentioned Eye-controlling focus mode is the center of curvature O point with eyeball 13
Coordinate on the basis of, by side, pupil 12 position is calculated direction of visual lines.Additionally, also
Can watch on display floater 10 before the display image 100 of display user, user is permissible
Watch the center of display floater 10 attentively, now the position of the pupil 12 of user be acquired,
And as datum mark, thus complete the focusing of pupil 12.Display image is watched afterwards as user
During 100, the position of the pupil 12 rotated can be acquired, and more than
Stating the datum mark obtained in focus process is reference, and then draws the direction of sight line.Certainly, on
Stating the illustration only to Eye-controlling focus process, the determination mode of other direction of visual lines is at this
Repeat the most one by one.
Below as a example by user plays, the use process of above-mentioned wearable device is carried out in detail
Thin explanation.This process is as shown in Figure 3 a:
First, operation is started.User only needs to wear wearable device, and this wearable device just collects
The display device become, now wearable device is worn at family, and wearable device is opened.
Next, display image 100.Concrete, that this wearable device shows display image
100 as shown in Figure 3 b.This display image 100 can be divided into sector of fire 130 and manipulation
Region 131.Wherein sector of fire 130 shows the image main contents 101 of building sample, and
Manipulation region 131 shows handle icon 102.
Next, obtain display image 100 on watch position attentively.Such as when user to equip into
Row select time, obtain eyes display image 100 on watch position attentively, wherein so that
User's more intuitive understanding self watch position attentively, this display image 100 also includes with use
The virtual point of fixation 103 that position is corresponding is watched at family attentively.Wherein, the virtual note of sector of fire 130
Viewpoint 103 can use target pattern, and the virtual point of fixation 103 manipulating region 131 is permissible
Use arrow pattern.
Concrete, when user needs to select equipment, obtain the behaviour that eye gaze selects to equipment
Making on icon 102, the most virtual point of fixation 103 is positioned at the handle icon 102 that this equipment selects
On.
Next the current brain wave of user, is obtained.Concrete, when virtual point of fixation 103
Be positioned at this equipment select handle icon 102 on time, can obtain user now when forebrain electricity
Ripple
Next, judge whether to need clicking operation icon 102.
Concrete can be according to the current brain wave obtained, it may be judged whether need clicking operation icon
102.Such as when the frequency of above-mentioned current brain wave is more than a frequency threshold, it can be determined that go out
User needs clicking operation icon 102.
Next the order of handle icon 102 correspondence, is performed.
Concrete, when above-mentioned judged result be user need clicking operation icon 102 time, permissible
Watch position attentively in conjunction with what step determined, virtual point of fixation 103 place is equipped selection
Handle icon 102 is clicked on, and performs the order of handle icon 102 correspondence.
It should be noted that when, after the order performing equipment selection handle icon 102, display is schemed
As the content shown in 100 as shown in Figure 3 c.In the case, user can perform again
State process, equipment one, equipment two or equipment three are selected, or selects return icon.
Concrete mode is same as above, and here is omitted.Additionally, after equipment is selected by user,
Above-mentioned steps is equally used to determine the image main contents of building sample in sector of fire 130
The firing point of 101, and control whether to need to perform firing operation eventually through brain wave.
Finally, end operation.
Additionally, when above-mentioned judged result is no, i.e. user need not clicking operation icon 102
Time, can directly perform end operation.
Wherein, what above-mentioned end operation represented be in addition to the step beyond end operation has performed
Finishing, now do not limit the state of wearable device, this wearable device is in shutdown or treats
Machine state or perform other operation state.
A kind of display control unit of this utility model embodiment offer, as shown in Figure 4, including:
Acquisition module 01, when being used for obtaining the currently displaying image 100 of eye gaze, shows image 100
On watch position attentively, and obtain current brain wave when watching currently displaying image 100 attentively.
Concrete, acquisition module can be signaling interface, such as wired or wireless signal interface, and can
To communicate with wearable device, obtain wearable device watches position acquisition module and brain attentively
What electric wave acquisition module obtained watches position and current brain wave attentively.
Determine module 02, the feature ginseng of the current brain wave for getting when acquisition module 01
When number meets pre-conditioned, determine that the control that current brain wave is corresponding refers to according to current brain wave
Order.
Concrete, described determine that module can be comparator, described comparator is used for working as forebrain
Characteristic parameter and the default characteristic parameter of electric wave compare, when more than described default characteristic parameter,
From the control instruction that memory look-up is corresponding with described current brain wave.
Perform module 03, for according to the control instruction determining that module 02 determines, to fixation position
The display image put performs corresponding operation.
Described execution module can be specifically drive circuit, drive circuit control instruction is exported to
Image element circuit so that image element circuit performs corresponding operation.
So, utilize acquisition module that eye-gaze position is obtained, so that use
Operating position on display image can be selected by family by eyes, and user thinks in difference
Examine and different brain waves under state, can be sent, thus can also utilize above-mentioned acquisition module to
Current brain wave when currently displaying image is watched at family attentively obtains.Next determine that module can root
The current brain wave got according to acquisition module goes to judge that user watches attentively the need of execution is above-mentioned
The corresponding operating of position, if user needs to perform, performs aforesaid operations, and performing module can be right
The display image watching position attentively performs corresponding operation.Therefore without hands during above-mentioned control
Move and just can realize corresponding operating, such that it is able to improve the convenience of wearable device.
But, the brain wave under user is in absorbed state, i.e. the frequency of β brain wave is
12～30Hz.Therefore the frequency current brain wave in 12～30Hz be merely able to get single such as
The control instruction of single-click operation.Such as double click operation or amplifieroperation are instructed for other, is required to
Shrink or expand the impact that the amplitude of current brain wave is produced by the electromyogram obtained in conjunction with eye muscle
Realize.Add the complexity obtaining control instruction.
In order to solve the problems referred to above, this display control unit, as it is shown in figure 5, also include storage
Module 04, acquisition module 01 includes the acquiring brain waves submodule for obtaining current brain wave
201, determine that module 02 can include that characteristic parameter obtains submodule 202 and instruction compilation
Module 203.
Wherein, characteristic parameter obtains submodule 202 and connects acquiring brain waves submodule 201, uses
In determining current brain wave and the characteristic parameter of default brain wave.Wherein, this feature parameter is permissible
For the frequency of brain wave, amplitude at least one.
Additionally, instruction compilation submodule 203 connection features parameter acquiring submodule 202, it is used for
Set up brain wave data collection, this brain wave data collection prestore the characteristic parameter of default brain wave with
The corresponding relation of control instruction.
Memory module 04 connection features parameter acquiring submodule 202 and acquiring brain waves submodule
201, for control store instruction, characteristic parameter and brain wave data collection.
So, can when wearable device dispatches from the factory or initial phase to user clearly
Under the state waken up and be absorbed in, the difference sent when being in different thinking activities states presets brain electricity
Ripple, obtains submodule 202 by characteristic parameter and is acquired.Concrete, although user is clearly
The frequency of the β brain wave sent under the state waken up and be absorbed in can be 12～30Hz.But, different
Thinking activities can make to have between the frequency of the brain wave in the range of 12～30Hz trickle
Difference.Such as user needs the frequency carrying out presetting brain wave during single-click operation control instruction to be
12～15Hz, the frequency presetting brain wave during double click operation control instruction is 18～21Hz, closes
The frequency presetting brain wave during operation control instruction is 25～30Hz.
On this basis, determine that module 02 also includes characteristic matching submodule 204.This feature
Matched sub-block 204 connection features parameter acquiring submodule 202 and memory module 04, be used for
Characteristic parameter is obtained characteristic parameter and the storage of the current brain wave that submodule 202 gets
In module 04, the characteristic parameter of the default brain wave that brain wave data is concentrated mates.
It should be noted that this feature matched sub-block 204 can be comparator or comparison electric
Road.Refer to additionally, the current characteristic parameter of brain wave and the characteristic parameter of two brain waves match,
Difference between characteristic parameter and the characteristic parameter of two brain waves of current brain wave is in permission
Within range of error.This error can be determined by the precision of wearable device.This utility model pair
This does not limits.
So, submodule 202 can be obtained by characteristic parameter and obtain above-mentioned when forebrain electricity
Ripple, the frequency of the default the brain wave then frequency of current brain wave concentrated with brain wave data
Mate.Such as when the frequency of current brain wave is in the range of 25～30Hz, the most currently
The frequency of brain wave matches with the frequency of default brain wave, such that it is able to obtain match pre-
If the shutoff operation control instruction corresponding to brain wave.And exist in the frequency of current brain wave
Time in 12～15Hz, then the current frequency of brain wave matches with the frequency of default brain wave,
Such that it is able to obtain the single-click operation control instruction corresponding to default brain wave matched.This
Outward, if when the frequency of current brain wave is in 16～17Hz, then the frequency of current brain wave
Rate cannot concentrate the frequency of any one default brain wave to match with brain wave data, therefore without
Method realizes the acquisition of control instruction.
Certainly, the frequency of the default brain wave that above-mentioned different control instruction is corresponding is only illustrated
Bright, it is not the restriction of the control instruction corresponding to default brain wave.
In sum, by prestoring the characteristic parameter of default brain wave and the corresponding of control instruction
The brain wave data collection of relation, so that all brain wave correspondences in 12～30Hz are multiple
Control instruction, and without the motion by eye muscle.
Further, it is determined that module 02 also includes that instruction obtains submodule 205, with feature
Sub module 204 is connected with memory module 04, for the characteristic parameter at current brain wave
When matching with the characteristic parameter of default brain wave, from memory module 04, acquisition matches
Preset the control instruction corresponding to brain wave.
Further, acquisition module 01 includes as shown in Figure 5: eyes image gathers submodule
206, sight line determines submodule 207, position calculation submodule 208.
Concrete, eyes image gathers submodule 206 and is used for obtaining eyes image, determines pupil
Position.It can be ccd image sensor or COMS that this eyes image gathers submodule 206
Imageing sensor.
For example, it is possible to the light sent by infrared light supply 120 is formed on eyes of user cornea
Reflections of high brightness point, i.e. hot spot 121.In this case, it is possible to sensed by ccd image
Device or COMS imageing sensor collect eyes image as shown in Figure 2 b, by eye
Portion's image processes, and can identify the hot spot 121 in this eyes image and pupil 12,
And then determine the position of pupil 12.
Sight line determines that submodule 207 and eyes image gather submodule 206 and be connected, by based on
Calculate direction of visual lines.
Position calculation submodule 208 determines that with sight line submodule 207 is connected, for according to
State the mapping relations of direction of visual lines and display image 100, show that eyes are at display image 100
Watch position attentively.
Wherein, above-mentioned to watch method for determining position attentively same as above, and here is omitted.
So, when watching attentively after position determines, above-mentioned execution module 03 can be according to acquisition
What module 01 obtained watches position attentively, and the control that execution instruction acquisition submodule 205 gets refers to
Order.
The above, detailed description of the invention the most of the present utility model, but guarantor of the present utility model
The scope of protecting is not limited thereto, and any those familiar with the art is at this utility model
In the technical scope disclosed, change can be readily occurred in or replace, all should contain at this utility model
Protection domain within.Therefore, protection domain of the present utility model should be with described claim
Protection domain is as the criterion.
Claims (8)
1. a display control program, it is characterised in that including: display device, wearable device, controller；
Described display device is used for showing image, as currently displaying image；
Described wearable device for obtain eye gaze currently displaying image time show on image position of watching attentively, and acquisition eye gaze described in currently displaying image time current brain wave；
Described controller, for when the characteristic parameter of described current brain wave meets pre-conditioned, determines, according to described current brain wave, the control instruction that described current brain wave is corresponding；According to described control instruction, the described display image watching position attentively is performed corresponding operation.
Display control program the most according to claim 1, it is characterised in that described display device is arranged with described wearable device separate type, and is connected by wired or wireless mode, mutual for information, described controller is arranged in described display device.
Display control program the most according to claim 1, it is characterized in that, described wearable device includes wearing support, described wear be provided with on support for gathering current brain wave acquiring brain waves loop, for gathering the image acquisition device of eyes imaging, and the image for gathering according to described image acquisition device determines the eyes processor watching position attentively on display image；Described processor is additionally operable to described current brain wave and described watch position attentively and send to described display device.
Display control program the most according to claim 1, it is characterised in that described wearable device includes wearing support, described in wear and on support, be integrated with described display device and described controller.
Display control program the most according to claim 4, it is characterized in that, described wear be provided with on support for gathering current brain wave acquiring brain waves loop, for gathering the image acquisition device of eyes imaging, and the image for gathering according to described image acquisition device determines the eyes processor watching position attentively on display image；Described processor is additionally operable to described current brain wave and described watch position attentively and send to described display device.
6. according to the display control program described in claim 3 or 5, it is characterised in that described acquiring brain waves loop is made up of forehead sensor and at least one ear-lobe sensor.
7. according to the display control program described in claim 3 or 5, it is characterised in that described image acquisition device is ccd image sensor or cmos image sensor.
Display control program the most according to claim 7, it is characterised in that be provided with infrared light light source on described image acquisition device and described display device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201620061471.8U CN205485920U (en) | 2016-01-21 | 2016-01-21 | Show controlling means and display control system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201620061471.8U CN205485920U (en) | 2016-01-21 | 2016-01-21 | Show controlling means and display control system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN205485920U true CN205485920U (en) | 2016-08-17 |
Family
ID=56639014
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201620061471.8U Active CN205485920U (en) | 2016-01-21 | 2016-01-21 | Show controlling means and display control system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN205485920U (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108415560A (en) * | 2018-02-11 | 2018-08-17 | 广东欧珀移动通信有限公司 | Electronic device, method of controlling operation thereof and Related product |
| WO2018196311A1 (en) * | 2017-04-28 | 2018-11-01 | 京东方科技集团股份有限公司 | Brain-controlled wearable display device and brain-controlled display method |
| CN110178102A (en) * | 2017-03-21 | 2019-08-27 | 惠普发展公司，有限责任合伙企业 | Estimation in display |
| TWI680309B (en) * | 2018-02-12 | 2019-12-21 | 大陸商北京七鑫易維信息技術有限公司 | Method and device for coupling light source with light spot |
| CN113589532A (en) * | 2021-07-30 | 2021-11-02 | 歌尔光学科技有限公司 | Display calibration method and device of head-mounted equipment, head-mounted equipment and storage medium |
-
2016
- 2016-01-21 CN CN201620061471.8U patent/CN205485920U/en active Active
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110178102A (en) * | 2017-03-21 | 2019-08-27 | 惠普发展公司，有限责任合伙企业 | Estimation in display |
| WO2018196311A1 (en) * | 2017-04-28 | 2018-11-01 | 京东方科技集团股份有限公司 | Brain-controlled wearable display device and brain-controlled display method |
| CN108803863A (en) * | 2017-04-28 | 2018-11-13 | 京东方科技集团股份有限公司 | A kind of brain control wearing display device and brain control display methods |
| CN108803863B (en) * | 2017-04-28 | 2020-12-01 | 京东方科技集团股份有限公司 | Brain control wearable display device and brain control display method |
| EP3617844A4 (en) * | 2017-04-28 | 2021-02-24 | BOE Technology Group Co., Ltd. | Brain-controlled wearable display device and brain-controlled display method |
| US11099646B2 (en) | 2017-04-28 | 2021-08-24 | Boe Technology Group Co., Ltd. | Brain-controlled wearable display device and brain-controlled display method |
| CN108415560A (en) * | 2018-02-11 | 2018-08-17 | 广东欧珀移动通信有限公司 | Electronic device, method of controlling operation thereof and Related product |
| CN108415560B (en) * | 2018-02-11 | 2020-12-04 | Oppo广东移动通信有限公司 | Electronic device, operation control method and related product |
| TWI680309B (en) * | 2018-02-12 | 2019-12-21 | 大陸商北京七鑫易維信息技術有限公司 | Method and device for coupling light source with light spot |
| CN113589532A (en) * | 2021-07-30 | 2021-11-02 | 歌尔光学科技有限公司 | Display calibration method and device of head-mounted equipment, head-mounted equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10488925B2 (en) | Display control device, control method thereof, and display control system | |
| CN205485920U (en) | Show controlling means and display control system | |
| US10429941B2 (en) | Control device of head mounted display, operation method and operation program thereof, and image display system | |
| US10271042B2 (en) | Calibration of a head mounted eye tracking system | |
| KR102571818B1 (en) | Head mounted type electronic device | |
| KR101988110B1 (en) | Virtual Reality Education System and Method based on Bio Sensors | |
| US20190235624A1 (en) | Systems and methods for predictive visual rendering | |
| US20220397959A1 (en) | Methods and Systems for Enabling the Remote Testing of Vision and Diagnosis of Vision-Related Issues | |
| CN108463789B (en) | Information processing apparatus, information processing method, and program | |
| US20190317608A1 (en) | Transmissive head-mounted display apparatus, display control method, and computer program | |
| JPH0749744A (en) | Head mounting type display input device | |
| KR20180045278A (en) | Virtual Reality Recognition Rehabilitation System based on Bio Sensors | |
| KR20220148921A (en) | Eyewear that uses muscle sensors to determine facial expressions | |
| KR101203921B1 (en) | Information providing apparatus using an eye tracking and local based service | |
| CN104994776A (en) | Network of devices for performing optical/optometric/ophthalmological tests, and method for controlling said network of devices | |
| JP6036291B2 (en) | Display device, display system, and display device control method | |
| CN110140166A (en) | For providing the system for exempting to manually enter to computer | |
| US20160321786A1 (en) | Display device and picture display method | |
| US20090245572A1 (en) | Control apparatus and method | |
| CN103713387A (en) | Electronic device and acquisition method | |
| CN102467230A (en) | Method and system for operating and controlling vernier by human body | |
| EP1811493B1 (en) | Video display | |
| CN111882365B (en) | Intelligent commodity recommendation system and method for efficient self-service vending machine | |
| CN206003051U (en) | Display device and system | |
| Stefanov | Webcam-based eye gaze tracking under natural head movement |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |