CN103565399B - Pupil detector - Google Patents
Pupil detector Download PDFInfo
- Publication number
- CN103565399B CN103565399B CN201210265459.5A CN201210265459A CN103565399B CN 103565399 B CN103565399 B CN 103565399B CN 201210265459 A CN201210265459 A CN 201210265459A CN 103565399 B CN103565399 B CN 103565399B
- Authority
- CN
- China
- Prior art keywords
- pupil
- image
- identified
- processing unit
- resolution
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Eye Examination Apparatus (AREA)
Abstract
A kind of pupil detector, comprises active light source, imageing sensor and processing unit.This active light source is luminous towards eyeball.This imageing sensor obtains this eyeball at least one picture frame with a resolution is using as image to be identified.This processing unit calculates the minimum gray scale value in this image to be identified, and the multiple pixels of the grey decision-making enclosed on weekly duty for this minimum gray scale within the scope of a grey decision-making are identified as pupil region.
Description
Technical field
The invention relates to a kind of interaction systems, particularly about a kind of pupil detector.
Background technology
The control mode that Interactive control mechanism can provide user more humane, because being widely used in various multimedia system, especially can be applicable to the image display system comprising display screen.
The remote controller that use can obtain image is a kind of conventional means as interactive man-machine interface, and this remote controller can be made into various stage property, such as bat, racket, club etc.Another kind of interactive man-machine interface does not then need to use any hand-held device to carry out, and such as pupil tracing device can carry out interactive operation according to the sight line change of user.
With reference to shown in Figure 1A and 1B, Figure 1A shows a kind of known pupil tracing system, and it is in order to carry out the pupil tracing of human eye 9; Figure 1B shows the schematic diagram of the eye image that known pupil tracing system obtains.This pupil tracing system comprises image display device 81, light source 82, imageing sensor 83 and processing unit 84.This light source 82 in order to towards this human eye 9 polishing, to produce light source image I in this human eye 9
82(as Figure 1B).This imageing sensor 83 comprises pupil 91 and this light source image I in order to obtain
82eye image, this processing unit 84 calculates this pupil 91 and this light source image I in this eye image
82the change of relative distance D to follow the trail of this pupil 91, and the action of vernier 811 on this image display device 81 of relation control according to this.But, if having other light source (not shown) in environment simultaneously and in this eye image soil boy structure light source image I
0, when carrying out pupil tracing, then may there is the situation of mistake.
Given this, the present invention proposes a kind of pupil detector, and it eliminates the impact of environment light source by calculating difference image, use the correctness improving pupil tracing.
Summary of the invention
Object of the present invention is providing a kind of pupil detector, and it has higher setting accuracy.
The invention provides a kind of pupil detector, comprise active light source, imageing sensor and processing unit.This active light source is luminous towards eyeball.This imageing sensor obtains this eyeball at least one picture frame with a resolution is using as image to be identified.This processing unit calculates the minimum gray scale value in this image to be identified, and the multiple pixels of the grey decision-making enclosed on weekly duty for this minimum gray scale within the scope of a grey decision-making are identified as pupil region.
The present invention also provides a kind of pupil detector, comprises at least one active light source, two imageing sensors and processing unit.This at least one active light source is luminous with left eye or the right eye of throwing light on.At least one picture frame of this left eye or this right eye that these two imageing sensors obtain the illumination of this at least one active light source with a resolution is using as the first image to be identified and the second image to be identified.This processing unit calculates the minimum gray scale value in this first image to be identified and this second image to be identified respectively, and the grey decision-making enclosed on weekly duty for this minimum gray scale is identified as pupil region in multiple pixels of a grey decision-making scope.
The present invention also provides a kind of pupil detector, comprises two active light sources, two imageing sensors and processing unit.These two active light sources are luminous with left eye and the right eye of throwing light on respectively.These two imageing sensors obtain this left eye and this right eye respectively at least one picture frame with a resolution is using as the first image to be identified and the second image to be identified.This processing unit calculates the minimum gray scale value in this first image to be identified and this second image to be identified respectively, and the multiple pixels of the grey decision-making enclosed on weekly duty for this minimum gray scale within the scope of a grey decision-making are identified as pupil region.
In one embodiment, this pupil detector also comprises display unit in order to show image.
In one embodiment, this pupil detector also has blink detection function.
In one embodiment, this pupil detector also has sleepy detection and measuring ability of diverting one's attention.
In one embodiment, this pupil detector also has frequency of wink and detects and xerophthalmia measuring ability.
In one embodiment, this pupil detector also has gesture recognition (gesture recognition) function.
In pupil detector of the present invention, by the multiple pixels of the grey decision-making enclosed on weekly duty for minimum gray scale within the scope of a grey decision-making are identified as pupil region, the impact of environment light source can be eliminated and improve setting accuracy.
In pupil detector of the present invention, described active light source is in turn with the first brightness and the second Intensity LEDs; This imageing sensor obtains the first picture frame of this first brightness and the second picture frame of this second brightness relatively relatively; The difference image that this processing unit calculates this first picture frame and this second picture frame is using as this image to be identified.By this, by calculating this difference image to eliminate the impact of environment light source and to improve setting accuracy.
Accompanying drawing explanation
Figure 1A shows the schematic diagram of known pupil tracing system;
Figure 1B shows the schematic diagram of the eye image that known pupil tracing system obtains;
Fig. 2 display is according to the running schematic diagram of the pupil detector of the embodiment of the present invention;
Fig. 3 A-3C shows according in the pupil detector of the embodiment of the present invention, the schematic diagram of Image Acquisition and light source igniting;
The schematic diagram of pupil detection is carried out in Fig. 4 display according to the image to be identified that the pupil detector of the embodiment of the present invention obtains;
Fig. 5 A shows the running schematic diagram of pupil detector according to another embodiment of the present invention; And
Fig. 5 B shows the running schematic diagram of pupil detector according to another embodiment of the present invention.
Description of reference numerals
1 pupil tracing device 11,11 ' active light source
12,12 ', 83 imageing sensor 13,84 processing units
14 mnemon 2 wear-type accessories
81 image display device 811 verniers
82 light source 9 human eyes
90 eyeball 91 pupils
92 iris 93 white of the eye regions
9L left eye 9R right eye
F, F ' image I82 light source image to be identified
I
0environment light source image P
1minimum gray scale value
P
2pupil position PA pupil region
F1 first picture frame f2 second picture frame
F picture frame L(x, y), R(x, y) pupil coordinate.
Detailed description of the invention
More obviously, hereafter can will coordinate appended diagram, be described in detail below to allow above and other objects of the present invention, feature and advantage.In explanation of the present invention, identical component represents with identical symbol, first chats bright in this conjunction.
With reference to shown in Fig. 2, the running schematic diagram of the pupil detector 1 of its display embodiment of the present invention, it also exports the pupil coordinate of this pupil position relatively in order to the pupil position detecting eyeball 90.This pupil detector 1 comprises active light source 11, imageing sensor 12 and processing unit 13.Generally speaking, when this eyeball 90 is looked down, upper eyelid meeting shaded portions eyeball 90, if therefore this pupil detector 1 is arranged at wear-type accessory 2, the setting position of this imageing sensor 12 is better for this eyeball 90.Such as, in Fig. 2, when this pupil detector 1 is arranged at glasses or protective eye lens, this pupil detector 1 is better to be arranged near underframe, situation eyeball 90 can being avoided to look down (pupil down time) cause detecting pupil.
This active light source 11 such as can be infrared light light source, and such as infrared light emitting diodes affects sight line during to avoid lighting.This active light source 11 is luminous towards this eyeball 90.Should be noted that, this active light source 11 can be arranged by single light source or multiple light source and form.
This imageing sensor 12 such as can be the optical sensor in order to sensor light energy such as ccd image sensor, cmos image sensor, and its at least one picture frame obtaining this eyeball 90 with a resolution is using as image to be identified (image to be identified).
Such as with reference to shown in Fig. 3 A-3C and 4, Fig. 3 A-3C shows the schematic diagram of the Image Acquisition of this imageing sensor 12 in the present embodiment and the light source igniting of this active light source 11; The schematic diagram of pupil detection is carried out in Fig. 4 display according to the image to be identified that this imageing sensor 12 obtains.This imageing sensor 12 obtains this eyeball 90 picture frame with a frame rate is using as image F to be identified.In one embodiment, this active light source 11 with the Image Acquisition luminescence (Fig. 3 B) of fixing brightness this imageing sensor 12 relatively, this imageing sensor 12 can sequentially output map picture frame f using as this image F(and F=f to be identified); This image F to be identified comprises pupil 91, iris 92 and white of the eye region 93.In another embodiment, this active light source 11 is in turn with the first brightness and the second Intensity LEDs, this imageing sensor 12 obtains relatively the first picture frame f1 of this first brightness and one second picture frame f2(Fig. 3 C of this second brightness relatively), the difference image (f1-f2) that this processing unit 13 calculates this first picture frame f1 and this second picture frame f2 is using as this image F(and F=f1-f2 to be identified).Should be noted that, this first brightness is different from this second brightness, and all non-vanishing brightness.By this, this processing unit 13 is by calculating this difference image (f1-f2) to eliminate the impact of environment light source.
This processing unit 13 such as can be a digital processing unit (DSP), in order to calculate minimum gray scale value P in this image F to be identified
1, and by this minimum gray scale value P
1the multiple pixels of grey decision-making in a grey decision-making scope Rg are around identified as pupil region PA(as shown in Figure 4).When this active light source 11 is lighted, the brightness of this pupil 91 is minimum, and the highest and brightness of this iris 92 of the brightness in this white of the eye region 93 is usually between this pupil 91 and this white of the eye region 93, therefore this minimum gray scale value P
1there will be in this pupil 91.Therefore, this minimum gray scale value P
1neighbouring pixel region then can be regarded as this pupil region PA, and this minimum gray scale value P
1neighbouring pixel region such as can utilize the mode of image packets (image grouping) that the pixel region interrelated is regarded as same target, it such as can refer to transference to No. 20110176733rd, the U.S. Patent Publication of common assignee of the present invention, title is " image-recognizing method ", in disclosed.In addition, the setting of this grey decision-making scope Rg can adjust according to the operating environment of this pupil detector 1, and such as different grey decision-making scope Rg can be designed respectively from indoor in open air.Moreover for avoiding noise jamming, this processing unit 13 also can determine whether to belong to environment light source image according to characteristics such as the size of this pupil region PA and shapes, such as, when size is too little or the circular person of non-genus may be then environment light source, can be got rid of.
Then, this processing unit 13 can calculate the center of gravity of this pupil region PA or center using as pupil position P
2, and export this pupil position P
2a relevant pupil coordinate (x, y).This processing unit 13 such as can according to the action of the vernier 811 of this pupil coordinate (x, y) relation control image display device 81.Scrutable, this pupil position P
2this minimum gray scale value P can be not equal to
1position.
In addition; because this pupil detector 1 can in order to control electronic installation; under some situation, comparatively Canon enough identifies that user identity is to increase practicality or to carry out secret protection, and therefore this processing unit 13 can carry out iris identification (iris recognition) according to this image F to be identified.Now, this pupil detector 1 also can comprise mnemon 14 in order to store the iris information of different users.In addition, the image resolution ratio that pupil region identification can be lower due to needs higher image resolution ratio (image resolution) during iris identification is carried out.Therefore in the embodiment of the present invention, the resolution of this imageing sensor 12 and frame rate (frame rate) adjustable, such as when this processing unit 13 carries out iris identification (the second pattern), this imageing sensor 12 obtains image with first resolution and the first frame rate; When this processing unit 13 carries out pupil region identification (first mode), this imageing sensor 12 obtains image with second resolution and the second frame rate; Wherein, this first resolution higher than this second resolution this first frame rate lower than this second frame rate.In the present embodiment, the adjustable range of this image resolution ratio such as between 640 × 480-160 × 120 adjustable range of this frame rate such as at 30FPS-480FPS(frame/second) between, but not as limit.
In the present embodiment, because this processing unit 13 utilizes the region of minimum gray scale value in eyeball image to carry out pupil detection, therefore the impact (grey decision-making of environment light source is higher) of environment light source can be got rid of; In addition, also by calculating difference image to eliminate environment light source image further.
In another embodiment, this pupil detector 1 can comprise two or more imageing sensor in order to obtain the image of same eyeball, and calculate three-dimensional pupil position according to this and contain larger detection range (that is, the distance between two imageing sensors obtaining same eyeball can keep a distance).
Shown in Fig. 5 A, the schematic diagram of the pupil detector 1 of its display another embodiment of the present invention.This pupil detector 1 is shown as to be arranged on glasses, but not as limit.This pupil detector 1 comprises at least one active light source 11, two imageing sensor 12,12' and processing units 13.Should be noted that, the present embodiment also can utilize multiple active light source 11 to increase brightness of illumination (such as this active light source 11 can be arranged by multiple light source and form); The number of described imageing sensor 12,12' is not also limited with two, if comprise three, four ... imageing sensor, the running of each imageing sensor is same as described imageing sensor 12,12', and only setting position is different, but its setting position is better still lower than this human eye 9.In addition, although this pupil detector 1 arranges relative to left eye 9L in Fig. 5 A, it also can be arranged relative to right eye 9R.That is, if this pupil detector 1 is arranged at wear-type accessory 2; The setting position of these two imageing sensors 12,12' is better for left eye 9L or right eye 9R.
This at least one active light source 11 luminescence is with the left eye 9L or right eye 9R that throws light on.At least one picture frame of this left eye 9L or this right eye 9R that this two imageing sensor 12,12' obtain the illumination of this at least one active light source 11 with a resolution is using as the first image F to be identified and the second image F' to be identified; Wherein, this two imageing sensor 12,12' can simultaneously or timesharing carry out picture frame acquisition.This processing unit 13 calculates minimum gray scale value P in this first image F to be identified and this second image F' to be identified respectively
1, and by this minimum gray scale value P
1around grey decision-making is identified as pupil region PA in multiple pixels of a grey decision-making scope Rg; After this pupil region PA calculates, this processing unit 13 calculates the center of gravity of this pupil region PA or center using as pupil position P
2(as shown in Figure 4), and export pupil of left eye coordinate L(x, y) and pupil of right eye coordinate R(x, y).Because the present embodiment utilizes two image F, F' to be identified to detect pupil simultaneously, this processing unit 13 can according to this pupil position P in this first image F to be identified and this second image F' to be identified
2calculate three-dimensional pupil position.Such as, these two imageing sensors 12,12' can be arranged at the both sides of the centrage of this human eye 9 respectively, and this processing unit 13 can calculate this three-dimensional pupil position according to two image F, F' to be identified.
As previously mentioned, in order to eliminate ambient-light images, this processing unit 13 can first calculate after difference image respectively again according to this pupil region PA of this difference image identification.Now, this at least one active light source 11 is in turn with the first brightness and the second Intensity LEDs; These two imageing sensors 12,12' obtain the second picture frame f2(of the first picture frame f1 of this first brightness and this second brightness relatively relatively as Fig. 3 C); This processing unit 13 calculates a difference image (f1-f2) of this first picture frame f1 and this second picture frame f2 using as this first image F to be identified and this second image F' to be identified.
In like manner, in the present embodiment, this processing unit 13 can carry out iris identification according to this first image F to be identified and/or this second image F' to be identified.When this processing unit 13 carries out iris identification, this imageing sensor 12 obtains image with first resolution and the first frame rate; When this processing unit 13 carries out pupil region identification, this imageing sensor 12 obtains image with second resolution and the second frame rate; Wherein, this first resolution higher than this second resolution this first frame rate lower than this second frame rate.
In another embodiment, this pupil detector 1 can comprise two or more imageing sensor in order to obtain the image of different eyeball respectively, so can export the testing result of left eye and/or right eye according to different situation.
Shown in Fig. 5 B, the schematic diagram of the pupil detector 1 of its display another embodiment of the present invention.This pupil detector 1 is shown as to be arranged on protective eye lens, but not as limit.This pupil detector 1 comprises two active light sources 11,11', two imageing sensor 12,12' and processing units 13.Should be noted that, more than one active light source can be comprised to increase brightness of illumination relative to every human eye; Multiple imageing sensor (as shown in Figure 5A) can be comprised relative to every human eye.In like manner, if this pupil detector 1 is arranged on wear-type accessory 2, the setting position of these two imageing sensors 12,12 is respectively lower than left eye 9L and right eye 9R.
These two active light sources 11,11' are luminous with the left eye 9L and right eye 9R that throws light on respectively.These two imageing sensors 12,12' obtain this left eye 9L and this right eye 9R respectively at least one picture frame with a resolution is using as the first image F to be identified and the second image F' to be identified.This processing unit 13 calculates this first image F to be identified and middle minimum gray scale value P of this second image F ' to be identified respectively
1, and by this minimum gray scale value P
1around grey decision-making is identified as pupil region PA in multiple pixels of a grey decision-making scope Rg; After this pupil region PA calculates, this processing unit 13 calculates the center of gravity of this pupil region PA or center using as pupil position P
2(as shown in Figure 4), and export pupil of left eye coordinate L(x, y) and pupil of right eye coordinate R(x, y).Because the present embodiment utilizes different image F, F' to be identified to detect two eye pupil holes respectively, therefore can calculate two oculopupillary pupil coordinates respectively, and export different pupil coordinates for different situations.Such as when human eye eyes right, this left eye 9L may be subject to the bridge of the nose and covers and can't see right object, and now this processing unit 13 only can calculate pupil of right eye coordinate R(x, the y of this right eye 9R relatively according to this pupil position); Such as when human eye eyes left, this right eye 9R may be subject to the bridge of the nose and covers and can't see left object, and now this processing unit 13 only can calculate pupil of left eye coordinate L(x, the y of this left eye 9L relatively according to this pupil position); Under other situation, this processing unit 13 such as can calculate the average pupil coordinate of this left eye 9L and this right eye 9R relatively according to this pupil position, but does not limit with this.
In another embodiment, also can according to left pupil coordinate L(x, y) with pupil of right eye coordinate R(x, y) relativeness estimates direction or the far and near distance that user watches personage attentively.
Again in an embodiment, if this left eye 9L and this right eye 9R arranges plural imageing sensor respectively relatively, then can try to achieve the three-dimensional pupil position of this left eye 9L and this right eye 9R respectively.
As previously mentioned, in order to eliminate ambient-light images, this processing unit 13 can first calculate after difference image respectively again according to this pupil region PA of this difference image identification.Now, these two active light sources 11,11 ' are in turn with the first brightness and the second Intensity LEDs; These two imageing sensors obtain the second picture frame f2(of the first picture frame f1 of this first brightness and this second brightness relatively relatively as Fig. 3 C); This processing unit 13 calculates the difference image (f1-f2) of this first picture frame f1 and this second picture frame f2 using as this first image F to be identified and this second image F' to be identified.
In like manner, in the present embodiment, this processing unit 13 can carry out iris identification according to this first image F to be identified and/or this second image F' to be identified.When this processing unit 13 carries out iris identification, this imageing sensor 12,12' obtain image with first resolution and the first frame rate; When this processing unit 13 carries out pupil region identification, described imageing sensor 12,12' obtain image with second resolution and the second frame rate; Wherein, this first resolution higher than this second resolution this first frame rate lower than this second frame rate.
In addition, the pupil detector 1 of various embodiments of the present invention can arrange in pairs or groups display unit to show image, and this display unit such as also can be arranged on wear-type accessory 2, such as glasses or protective eye lens etc.
The pupil detector 1 of various embodiments of the present invention can also have blink detection function.Such as this processing unit 13 can record respectively detect with can't detect pupil during, use identify nictation action.
The pupil detector 1 of various embodiments of the present invention also can have sleepy detection and measuring ability of diverting one's attention.Such as when this pupil detector 1 is applied to Vehicular device, can whether there is sleepiness in order to detect to drive or be absorbed in front, and propose warning in appropriate time.Detection sleepiness is such as opened the ratio of entire time by detection eyes and is realized; Detect and divert one's attention such as to realize by detecting the direction of gaze driven.
The pupil detector 1 of various embodiments of the present invention also can have frequency of wink and xerophthalmia measuring ability.Specifically, processing unit 13 instead according to detected frequency of wink can push away the dry and astringent probability of current eyes and degree, and then reminds user to blink.
The pupil detector 1 of various embodiments of the present invention also can have gesture recognition (gesturerecognition) function.Now described gesture recognition such as can be identify pupil towards predetermined direction with pre-determined number to change position, and itself and default posture are compared, the running performing specific function can be reached by this, its similar known other object utilized beyond pupil, the gesture identification that such as hands or finger carry out.
The pupil detector 1 of various embodiments of the present invention also can have electricity-saving function, and the image change amount that such as can't detect pupil or image to be identified in Preset Time is too small, then can enter battery saving mode.
Should be noted that, the pupil detector 1 of various embodiments of the present invention can directly be made into wear-type pupil detector, or is fixed on wear-type accessory, such as glasses, protective eye lens, marginal ridge etc. by coupling unit combination.In other embodiment, the pupil detector 1 of various embodiments of the present invention also can be arranged at other position to carry out pupil detection, and be such as arranged near user eyes place in car, such as Back mirror etc., as long as be arranged at the position can detecting human eye 9.
In sum, because getting rid of the impact of environment light source, thus may there is the situation detecting mistake in known pupil detector.The present invention also proposes a kind of pupil detector (Fig. 2,5A and 5B), and it can be eliminated the impact of environment light source and have higher detection degree of accuracy.
Although the present invention is open with previous embodiment, so itself and be not used to limit the present invention, any persond having ordinary knowledge in the technical field of the present invention, without departing from the spirit and scope of the present invention, when making various changes or modifications.Therefore protection scope of the present invention is when being as the criterion depending on the accompanying claim person of defining.
Claims (14)
1. a pupil detector, this pupil detector comprises:
Active light source, luminous towards eyeball;
Imageing sensor, at least one picture frame obtaining described eyeball with a resolution is using as image to be identified; And
Processing unit, this processing unit is used for:
Calculate the minimum gray scale value in described image to be identified, and the multiple pixels of the grey decision-making enclosed on weekly duty for this minimum gray scale within the scope of a grey decision-making are identified as pupil region; And
Iris identification is carried out according to described image to be identified,
Wherein, when described processing unit carries out described iris identification, described imageing sensor obtains image with first resolution; When described processing unit carries out described pupil region identification, described imageing sensor obtains image with second resolution; Described first resolution is higher than described second resolution.
2. pupil detector according to claim 1, wherein said active light source is in turn with the first brightness and the second Intensity LEDs; Described imageing sensor obtains relative to the first picture frame of described first brightness and the second picture frame relative to described second brightness; The difference image that described processing unit also calculates described first picture frame and described second picture frame is using as described image to be identified.
3. pupil detector according to claim 1 and 2, wherein said processing unit also calculates the center of gravity of described pupil region or center using as pupil position, and exports the pupil coordinate relevant to this pupil position.
4. pupil detector according to claim 1 and 2, wherein said pupil detector is arranged on wear-type accessory, and the setting position of described imageing sensor is lower than described eyeball.
5. a pupil detector, this pupil detector comprises:
At least one active light source, luminous with left eye or the right eye of throwing light on;
Two imageing sensors, obtain the described left eye of at least one active light source described illumination or at least one picture frame of described right eye using as the first image to be identified and the second image to be identified with a resolution; And
Processing unit, this processing unit is used for:
Calculate the minimum gray scale value in described first image to be identified and described second image to be identified respectively, and the multiple pixels of the grey decision-making enclosed on weekly duty for this minimum gray scale within the scope of a grey decision-making are identified as pupil region; And
According to described first image to be identified and described second image to be identified at least one of them carries out iris identification,
Wherein, when described processing unit carries out described iris identification, described imageing sensor obtains image with first resolution; When described processing unit carries out described pupil region identification, described imageing sensor obtains image with second resolution; Described first resolution is higher than described second resolution.
6. pupil detector according to claim 5, at least one active light source wherein said is in turn with the first brightness and the second Intensity LEDs; Described two imageing sensors obtain the first picture frame of relatively described first brightness and the second picture frame of relatively described second brightness; The difference image that described processing unit also calculates described first picture frame and described second picture frame is using as described first image to be identified and described second image to be identified.
7. the pupil detector according to claim 5 or 6, wherein said processing unit also calculates the center of gravity of described pupil region or center using as pupil position.
8. pupil detector according to claim 7, wherein said processing unit also calculates three-dimensional pupil position according to the described pupil position in described first image to be identified and described second image to be identified.
9. the pupil detector according to claim 5 or 6, wherein said pupil detector is arranged on wear-type accessory, and the setting position of described two imageing sensors is lower than described left eye or described right eye.
10. a pupil detector, this pupil detector comprises:
Two active light sources, luminous with left eye and the right eye of throwing light on respectively;
Two imageing sensors, at least one picture frame obtaining described left eye and described right eye with a resolution is respectively using as the first image to be identified and the second image to be identified; And
Processing unit, this processing unit is used for:
Calculate the minimum gray scale value in described first image to be identified and described second image to be identified respectively, and the multiple pixels of the grey decision-making enclosed on weekly duty for this minimum gray scale within the scope of a grey decision-making are identified as pupil region; And
According to described first image to be identified and described second image to be identified at least one of them carries out iris identification,
Wherein, when described processing unit carries out described iris identification, described two imageing sensors obtain image with first resolution; When described processing unit carries out described pupil region identification, described two imageing sensors obtain image with second resolution; Described first resolution is higher than described second resolution.
11. pupil detectors according to claim 10, wherein said two active light sources are in turn with the first brightness and the second Intensity LEDs; Described two imageing sensors obtain the first picture frame of relatively described first brightness and the second picture frame of relatively described second brightness; The difference image that described processing unit also calculates described first picture frame and described second picture frame is using as described first image to be identified and described second image to be identified.
12. pupil detectors according to claim 10 or 11, wherein said processing unit also calculates the center of gravity of described pupil region or center using as pupil position.
13. pupil detectors according to claim 12, described processing unit also according to described pupil position only calculate relative to described left eye pupil of left eye coordinate, only calculate pupil of right eye coordinate relative to described right eye or the average pupil coordinate that calculates relative to described left eye and described right eye.
14. pupil detectors according to claim 10 or 11, wherein said pupil detector is arranged on wear-type accessory, and the setting position of described two imageing sensors is respectively lower than described left eye and described right eye.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210265459.5A CN103565399B (en) | 2012-07-27 | 2012-07-27 | Pupil detector |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210265459.5A CN103565399B (en) | 2012-07-27 | 2012-07-27 | Pupil detector |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103565399A CN103565399A (en) | 2014-02-12 |
| CN103565399B true CN103565399B (en) | 2015-09-30 |
Family
ID=50038741
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210265459.5A Active CN103565399B (en) | 2012-07-27 | 2012-07-27 | Pupil detector |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103565399B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108460316A (en) * | 2017-02-22 | 2018-08-28 | 瑞昱半导体股份有限公司 | Iris video capturing device, iris image identification devices and methods therefor |
| CN109840449A (en) * | 2017-11-27 | 2019-06-04 | 上海聚虹光电科技有限公司 | It eliminates the pupil that environment shadow is rung and scales emotion judgment method |
| CN109839742A (en) * | 2017-11-29 | 2019-06-04 | 深圳市掌网科技股份有限公司 | A kind of augmented reality device based on Eye-controlling focus |
| CN111301689A (en) * | 2020-02-12 | 2020-06-19 | 中国商用飞机有限责任公司 | System and method for intelligently adjusting eye position of pilot |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5956124A (en) * | 1997-10-23 | 1999-09-21 | Dan; Jacob | Automated threshold-related objective perimetry |
| TW530623U (en) * | 2002-03-19 | 2003-05-01 | Chung Shan Inst Of Science | Device for detecting locus of eyeball with multiple linear image grabbing component |
| CN1584917A (en) * | 2004-06-11 | 2005-02-23 | 清华大学 | Living body iris patterns collecting method and collector |
| US7357507B2 (en) * | 2006-04-05 | 2008-04-15 | Visionetx, Inc. | Image-based system to observe and document eye responses |
| CN101788848A (en) * | 2009-09-29 | 2010-07-28 | 北京科技大学 | Eye characteristic parameter detecting method for sight line tracking system |
| CN101861118A (en) * | 2007-11-16 | 2010-10-13 | 视瑞尔技术公司 | Method and device for finding and tracking pairs of eyes |
| US7963652B2 (en) * | 2003-11-14 | 2011-06-21 | Queen's University At Kingston | Method and apparatus for calibration-free eye tracking |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1271559C (en) * | 2004-06-15 | 2006-08-23 | 沈阳工业大学 | Human iris identifying method |
| CN1924886A (en) * | 2005-08-31 | 2007-03-07 | 上海乐金广电电子有限公司 | Iris recognition system using visible light and identification method thereof |
| WO2008007781A1 (en) * | 2006-07-14 | 2008-01-17 | Panasonic Corporation | Visual axis direction detection device and visual line direction detection method |
| US20090216092A1 (en) * | 2008-02-26 | 2009-08-27 | Acunetx, Inc. | System for analyzing eye responses to accurately detect deception |
| US20110085135A1 (en) * | 2008-08-11 | 2011-04-14 | Eugene Robert Bertolli | Free space hands free ocular observation camera mount |
| CN201477518U (en) * | 2009-08-31 | 2010-05-19 | 北京科技大学 | Sight line tracking unit based on pupilla-cornea reflection method |
-
2012
- 2012-07-27 CN CN201210265459.5A patent/CN103565399B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5956124A (en) * | 1997-10-23 | 1999-09-21 | Dan; Jacob | Automated threshold-related objective perimetry |
| TW530623U (en) * | 2002-03-19 | 2003-05-01 | Chung Shan Inst Of Science | Device for detecting locus of eyeball with multiple linear image grabbing component |
| US7963652B2 (en) * | 2003-11-14 | 2011-06-21 | Queen's University At Kingston | Method and apparatus for calibration-free eye tracking |
| CN1584917A (en) * | 2004-06-11 | 2005-02-23 | 清华大学 | Living body iris patterns collecting method and collector |
| US7357507B2 (en) * | 2006-04-05 | 2008-04-15 | Visionetx, Inc. | Image-based system to observe and document eye responses |
| CN101861118A (en) * | 2007-11-16 | 2010-10-13 | 视瑞尔技术公司 | Method and device for finding and tracking pairs of eyes |
| CN101788848A (en) * | 2009-09-29 | 2010-07-28 | 北京科技大学 | Eye characteristic parameter detecting method for sight line tracking system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103565399A (en) | 2014-02-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20180160079A1 (en) | Pupil detection device | |
| US11616906B2 (en) | Electronic system with eye protection in response to user distance | |
| US10747995B2 (en) | Pupil tracking device | |
| RU2729045C2 (en) | Adaptive lighting system for mirror component and method for controlling adaptive lighting system | |
| JP6308940B2 (en) | System and method for identifying eye tracking scene reference position | |
| CN103677270B (en) | A kind of man-machine interaction method based on eye-tracking | |
| JP2988178B2 (en) | Gaze direction measuring device | |
| CN105659200A (en) | Method, apparatus, and system for displaying graphical user interface | |
| WO2007023798A9 (en) | Pupil detection device and pupil detection method | |
| CN103565399B (en) | Pupil detector | |
| CN103793045B (en) | Pupil tracing device | |
| JP2013528406A (en) | System and method for tracking observer's line of sight | |
| CN102918480A (en) | Active pointer attribute determination by demodulating image frames | |
| JP2917953B2 (en) | View point position detection device | |
| CN102830583A (en) | Eye shield projection method | |
| WO2022095605A1 (en) | Handle control tracker | |
| US20130089236A1 (en) | Iris Recognition Systems | |
| CN104434022A (en) | optical array system and method for performing pupil tracking using retro-reflectivity | |
| WO2018164104A1 (en) | Eye image processing device | |
| WO2019185136A1 (en) | Method and system for controlling illuminators | |
| US10928894B2 (en) | Eye tracking | |
| JP2018190213A (en) | Face recognition device and sight line detection device | |
| JP2018181025A (en) | Sight line detecting device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |