JP3194790B2 - Gaze direction detection device - Google Patents
Gaze direction detection deviceInfo
- Publication number
- JP3194790B2 JP3194790B2 JP15799092A JP15799092A JP3194790B2 JP 3194790 B2 JP3194790 B2 JP 3194790B2 JP 15799092 A JP15799092 A JP 15799092A JP 15799092 A JP15799092 A JP 15799092A JP 3194790 B2 JP3194790 B2 JP 3194790B2
- Authority
- JP
- Japan
- Prior art keywords
- light
- eyeball
- cornea
- line
- center
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B2213/00—Viewfinders; Focusing aids for cameras; Means for focusing for cameras; Autofocus systems for cameras
- G03B2213/02—Viewfinders
- G03B2213/025—Sightline detection
Landscapes
- Focusing (AREA)
- Automatic Focus Adjustment (AREA)
- Eye Examination Apparatus (AREA)
Description
【０００１】[0001]
【産業上の利用分野】本発明は、視線の方向を検出する
視線方向検出装置に関する。BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a gaze direction detecting device for detecting a gaze direction.
【０００２】[0002]
【従来の技術】近時、生体の視線方向を検出し、その視
線方向に応じて各種の制御が行なわれるようになってき
ている。2. Description of the Related Art Recently, the gaze direction of a living body has been detected, and various controls have been performed in accordance with the gaze direction.
【０００３】たとえば、自動焦点カメラでは、ファイン
ダー内に複数の合焦ゾーンを設け、被写体のファインダ
ー内での被写体の位置に対応して、合焦ゾーンを選択す
ることにより、構図に制限を受けることなく、目的とす
る被写体に焦点を合わせて撮影できるようにしている。
このような場合、合焦ゾーンの選択切換に当たって、フ
ァイダー内における撮影者の視線方向を検出して、その
視線が向いた合焦ゾーンを選択すれば、手動による切換
操作を要することなく、撮影対象の被写体に対応した合
焦ゾーンを自動的に選択することができる。For example, in an autofocus camera, the composition is restricted by providing a plurality of focusing zones in a viewfinder and selecting a focusing zone according to the position of the subject in the viewfinder. Instead, it is possible to focus on the target subject and shoot.
In such a case, when the selection of the focusing zone is switched, the direction of the line of sight of the photographer in the viewfinder is detected, and the focusing zone to which the line of sight is directed is selected. The focus zone corresponding to the subject can be automatically selected.
【０００４】このような用途に用いられる従来の視線方
向検出装置としては、たとえば図５で示すように、赤外
光を発するＬＥＤ等の発光素子11により、眼球の虹彩12
と鞏膜13との境界部である虹彩輪部12a を照明し、反射
光を２つの光検出素子14a ，14b で捕らえ、これら両光
検出素子14a ，14b からの出力信号の強度差に基づいて
水平方向の視線方向検出を行なうものがある。As a conventional gaze direction detecting device used for such an application, for example, as shown in FIG. 5, an iris 12 of an eyeball is formed by a light emitting element 11 such as an LED emitting infrared light.
The iris 12a, which is the boundary between the iris and the sclera 13, is illuminated, the reflected light is captured by the two photodetectors 14a and 14b, and the reflected light is leveled based on the intensity difference between the output signals from the two photodetectors 14a and 14b. There is one that detects the direction of the line of sight.
【０００５】この図５に示す視線方向検出装置は、虹彩
12と鞏膜13との光反射率の違いを利用したものであり、
図５のように視線が概ね正面にあれば、２つの光検出素
子14a ，14b の出力強度はほぼ等しく、また、たとえば
図６に示すように視線が左方向を向いている場合は、光
検出素子14a の出力が光検出素子14b より大きくなり、
さらに視線が右を向いた場合は、反対に、光検出素子14
b の出力が光検出素子14a より大きくなる。すなわち、
両光検出素子14a ，14b の出力差を検出することにより
水平方向の視線方向検出を行なっている。The gaze direction detecting device shown in FIG.
It utilizes the difference in light reflectance between 12 and sclera 13,
When the line of sight is substantially in front as shown in FIG. 5, the output intensities of the two photodetectors 14a and 14b are substantially equal. For example, when the line of sight is directed to the left as shown in FIG. The output of the element 14a becomes larger than that of the photodetector 14b,
If the line of sight further turns right, on the contrary,
The output of b becomes larger than that of the photodetector 14a. That is,
The detection of the horizontal line-of-sight direction is performed by detecting the output difference between the two light detection elements 14a and 14b.
【０００６】しかし、両光検出素子14a ，14b の出力差
を検出するには、前述のように虹彩輪部12a を照明する
必要があるため、ある程度広い範囲を照明しなければな
らない。このため、眼の瞼や睫の影響を受けてしまい、
十分に精度良く反射光の強度差検出を行なうことができ
ない。However, in order to detect the output difference between the two photodetectors 14a and 14b, it is necessary to illuminate the iris ring portion 12a as described above. For this reason, it is affected by eyelids and eyelashes,
It is not possible to detect the intensity difference of the reflected light with sufficient accuracy.
【０００７】また、他の従来技術としてはたとえば特開
昭６１−１７２５５２号公報で示すように、眼球の一部
を平行光で照明し、平行光によって発生する角膜前面か
らの反射像である第１プルキンエ像と瞳中心の位置とか
ら、視線方向を検出するものや、たとえば特開平２−５
号公報で示すように、第１プルキンエ像と目の眼底から
の反射光との受光出力から視線方向を検出するもの等が
知られている。As another prior art, for example, as disclosed in Japanese Patent Application Laid-Open No. Sho 61-172552, a part of an eyeball is illuminated with parallel light and a reflected image generated from the front surface of the cornea generated by the parallel light. One that detects the direction of the line of sight from one Purkinje image and the position of the center of the pupil;
As disclosed in Japanese Unexamined Patent Application Publication No. H11-107, there is known an apparatus that detects a line-of-sight direction from a light reception output of a first Purkinje image and light reflected from the fundus of the eye.
【０００８】以下、角膜からの反射像である第１プルキ
ンエ像について説明する。通常、凸面鏡を平行光で照明
すると、光学的に無限の距離にある光学像が凸面鏡の表
面とその曲率中心との中点に光点となって現れる。目の
角膜においても平行光線を照射すると、角膜の形状およ
び角膜表面の鏡面反射により、同様に光点を形成する。
そして、この光点が第１プルキンエ像である。Hereinafter, the first Purkinje image which is a reflection image from the cornea will be described. Normally, when a convex mirror is illuminated with parallel light, an optical image at an optically infinite distance appears as a light spot at the midpoint between the surface of the convex mirror and its center of curvature. When the cornea of the eye is irradiated with parallel rays, a light spot is similarly formed due to the shape of the cornea and the specular reflection of the corneal surface.
This light spot is the first Purkinje image.
【０００９】この関係を図７により説明する。図７にお
いて16は角膜で、この角膜16の曲率中心をCcとする。ま
た、17は眼球で、この眼球17の回転中心をCrとする。ま
た、これら角膜16の曲率中心Ccと眼球17の回転中心Crと
の距離をdcとする。そして、図７において、破線は視線
が正面にあるときの角膜16および眼球17の状態を示し、
実線は視線が右に角度θ傾いたときの角膜16および眼球
17の状態を示している。This relationship will be described with reference to FIG. In FIG. 7, reference numeral 16 denotes a cornea, and the center of curvature of the cornea 16 is denoted by Cc. Reference numeral 17 denotes an eyeball, and the center of rotation of the eyeball 17 is Cr. The distance between the center of curvature Cc of the cornea 16 and the center of rotation Cr of the eyeball 17 is defined as dc. And, in FIG. 7, the broken line indicates the state of the cornea 16 and the eyeball 17 when the line of sight is in front,
The solid lines show the cornea 16 and the eyeball when the line of sight is inclined to the right by the angle θ.
17 state is shown.
【００１０】ここで、眼球17の正面に位置する図示しな
い基準光源からの平行光は、視線が正面を向いている場
合は、角膜16の曲率中心Ccと角膜16表面の反射点Icとを
結ぶ直線の中点PIに第１プルキンエ像18が観測される。
これに対し、前述のように眼球17が角度θだけ右に回転
すると、角膜16の曲率中心CcはCc1 の位置に移動し、角
膜16の表面の入射平行光線の反射点Ic1 との中点PI1 に
第１プルキンエ像18が移動する。すなわち、第１プルキ
ンエ像18は、眼球17の回転方向と同じ方向に移動するこ
ととなる。Here, the parallel light from the reference light source (not shown) located in front of the eyeball 17 connects the center of curvature Cc of the cornea 16 and the reflection point Ic on the surface of the cornea 16 when the line of sight is facing the front. The first Purkinje image 18 is observed at the midpoint PI of the straight line.
In contrast, when the eye 17 as described above is rotated to the right by the angle theta, the center of curvature Cc of the cornea 16 is moved to the position of Cc 1, in a reflecting point Ic 1 of incident parallel light rays on the surface of the cornea 16 the first Purkinje image 18 is moved to the point PI 1. That is, the first Purkinje image 18 moves in the same direction as the rotation direction of the eyeball 17.
【００１１】一方、眼球17を正面から見たときの第１プ
ルキンエ像18の水平方向の移動距離L1は次式で得られ
る。On the other hand, the horizontal movement distance L1 of the first Purkinje image 18 when the eyeball 17 is viewed from the front is obtained by the following equation.
【００１２】[0012]
【式１】 このように、眼球17の角膜16を平行光で照明し、この照
明によって生じる第１プルキンエ像18の位置の変化を検
出すれば、視線の方向を検出することができる。しか
し、実際には、角膜16の曲率中心Ccと眼球17の回転中心
Crの距離dcそのものが僅かであることから、視軸の角度
変化に対する第１プルキンエ像18の移動量は、式１から
明らかなように極僅かであり、頭の僅かな移動等がある
と、頭の僅かな移動と視線方向の移動とを判別がするこ
とができない。(Equation 1) Thus, by illuminating the cornea 16 of the eyeball 17 with parallel light and detecting a change in the position of the first Purkinje image 18 caused by the illumination, the direction of the line of sight can be detected. However, in practice, the center of curvature Cc of the cornea 16 and the center of rotation of the eyeball 17
Since the distance dc of Cr itself is small, the amount of movement of the first Purkinje image 18 with respect to the change in the visual axis angle is extremely small as is apparent from Equation 1, and if there is a slight movement of the head, A slight movement of the head and a movement in the line of sight cannot be distinguished.
【００１３】そこで、このような問題を解決すべく、特
開昭６１−１７２５５２号公報記載の構成では、瞳孔中
心位置を検出し、また、特開平２−５号公報記載の構成
では、目の眼底からの反射光を測定している。In order to solve such a problem, the configuration described in Japanese Patent Application Laid-Open No. 61-172552 detects the center of the pupil, and the configuration described in Japanese Patent Application Laid-Open No. The reflected light from the fundus is measured.
【００１４】しかし、特開昭６１−１７２５５２号公報
および特開平２−５号公報記載の構成では、それぞれ角
膜16からの反射像である第１プルキンエ像18を利用して
いるため、照明光として瞳をカバーできるような広いビ
ーム径の平行光が必要となる。このため、照明光学系と
してレンズを含む複雑な光学部品が必要となる。また、
反射像である第１プルキンエ像18を光検出器上に結像さ
せる必要があるため、検出光学系が必要となり、装置全
体の小型化および軽量化が困難である。また、前述した
ように、もともと第１プルキンエ像18の視線方向変化に
対する位置変化量が僅かであるため、特開昭６１−１７
２５５２号公報および特開平２−５号公報記載の構成で
説明したような構成としても、十分な精度を得ることは
難しい。However, in the configurations described in Japanese Patent Application Laid-Open Nos. 61-172552 and 2-5, since the first Purkinje image 18 which is a reflection image from the cornea 16 is used, illumination light is used. Parallel light with a wide beam diameter that can cover the pupil is required. For this reason, a complicated optical component including a lens is required as an illumination optical system. Also,
Since it is necessary to form the first Purkinje image 18 as a reflection image on the photodetector, a detection optical system is required, and it is difficult to reduce the size and weight of the entire apparatus. Also, as described above, since the amount of change in the position of the first Purkinje image 18 with respect to the line-of-sight direction is originally small,
It is difficult to obtain sufficient accuracy even with the configuration described in Japanese Patent Application Laid-Open No. 2552 and Japanese Patent Application Laid-Open No. 2-5-5.
【００１５】[0015]
【発明が解決しようとする課題】このように、虹彩12と
鞏膜13との光反射率の違いを利用して視線方向を検出す
るものは、眼の瞼や睫の影響により、十分に精度良く検
出を行なうことができず、また、第１プルキンエ像18を
利用するものでは、装置全体の小型化および軽量化が困
難であるとともに十分な精度を得難い等の問題点を有し
ている。As described above, the method of detecting the direction of the line of sight using the difference in the light reflectance between the iris 12 and the sclera 13 is sufficiently accurate due to the influence of the eyelids and eyelashes. In the case where detection cannot be performed and the first Purkinje image 18 is used, there are problems that it is difficult to reduce the size and weight of the entire apparatus and to obtain sufficient accuracy.
【００１６】本発明の目的は、複雑な光学系を必要とせ
ず小型軽量に構成でき、しかも高い検出精度を得ること
ができる視線方向検出装置を提供することにある。An object of the present invention is to provide a line-of-sight direction detecting device which can be made compact and lightweight without requiring a complicated optical system, and which can obtain high detection accuracy.
【００１７】[0017]
【課題を解決するための手段】本発明による視線方向検
出装置は、眼球の中心部に向かって、前記眼球の瞳の大
きさに比して十分に細い概平行光線を発する光源装置
と、前記概平行光線の前記眼球の角膜からの反射光を受
光し、前記眼球の中心部に対する受光位置の関係を２次
元で検出する光検出装置と、この光検出装置の受光位置
を基に角膜からの反射角を求める制御回路とを備えたも
のである。A gaze direction detecting apparatus according to the present invention comprises: a light source device for emitting substantially parallel light rays toward a center of an eyeball, the light being sufficiently thin compared to the size of a pupil of the eyeball; The reflected light from the cornea of the eyeball of the substantially parallel light ray is received, and the relation of the light receiving position with respect to the center of the eyeball is quadratic.
Photodetector to detect the light source and the light receiving position of this photodetector
And a control circuit for calculating the angle of reflection from the cornea based on the
【００１８】[0018]
【作用】本発明では、眼球の中心部に対して細い光束の
概平行光線を照射し、眼球の角膜表面からの反射光を受
光し、この反射光の受光位置を２次元で測定し、制御回
路でこの受光位置から反射角を検出する。この角膜表面
の反射角と眼球の回転角、すなわち視線の方向とは所定
の関係が成り立つので、この反射角から視線方向を検出
する。In the present invention, by irradiating the approximate parallel light of a narrow light beam with respect to the center of the eye, receiving light reflected from the corneal surface of the eye, measuring the receiving position of the reflected light in two dimensions, the control Times
The reflection angle is detected from the light receiving position on the road . Since a predetermined relationship is established between the angle of reflection of the corneal surface and the angle of rotation of the eyeball, that is, the direction of the line of sight, the line of sight is detected from the angle of reflection.
【００１９】[0019]
【実施例】以下、本発明の視線方向検出装置の一実施例
を図面を参照して説明する。DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the gaze direction detecting apparatus according to the present invention will be described below with reference to the drawings.
【００２０】図１ないし図４において、21は光源装置
で、この光源装置21は眼球17の中心部に向かって、眼球
17の瞳の大きさに比して十分に細い概平行光線Ｂを発す
る。この光源装置21は、赤外光を照射するＬＥＤ等によ
る光源22を有し、この光源22の前面側には光源22からの
光を概平行光線Ｂにするためのレンズ23が設けられてい
る。また、このレンズ23の出射側にはスリット板24が、
眼球17の瞳の大きさに比して十分に細い概平行光線を得
るように設けられている。In FIGS. 1 to 4, reference numeral 21 denotes a light source device.
It emits a substantially parallel light beam B which is sufficiently thin compared to the size of the pupil of the seventeen. The light source device 21 has a light source 22 such as an LED that irradiates infrared light, and a lens 23 for converting light from the light source 22 into a substantially parallel light beam B is provided on the front side of the light source 22. . Further, a slit plate 24 is provided on the emission side of the lens 23,
It is provided so as to obtain a substantially parallel light beam which is sufficiently thin compared to the size of the pupil of the eyeball 17.
【００２１】そして、視線の水平方向であるＸ方向およ
び垂直方向であるＹ方向の変化を捕えるべく、Ｘ方向用
のスリット24X およびＹ方向用のスリット24Y が形成さ
れている。また、これら各スリット24X ，24Y の幅寸法
は、瞳の大きさに比して十分に細い値に設定されてい
る。したがって、この光源装置21は、光源22からの光を
レンズ23で概平行光線Ｂとした後、スリット板24のスリ
ット24X ，24Y により、眼球17の瞳の大きさに比して十
分に細いＸ方向用およびＹ方向用のスリット状の平行な
光線となり、眼球17の中心部に向かって照射される。A slit 24X for the X direction and a slit 24Y for the Y direction are formed to capture changes in the X direction, which is the horizontal direction of the line of sight, and the Y direction, which is the vertical direction. Further, the width dimension of each of the slits 24X and 24Y is set to a value sufficiently smaller than the size of the pupil. Therefore, in the light source device 21, after the light from the light source 22 is converted into the substantially parallel light beam B by the lens 23, the X, which is sufficiently smaller than the size of the pupil of the eyeball 17, is formed by the slits 24X and 24Y of the slit plate 24. It becomes a slit-shaped parallel light beam for the direction and for the Y direction, and is emitted toward the center of the eyeball 17.
【００２２】また、26は光検出装置で、この光検出装置
26は、光源装置21により眼球17の中心部に向かって発せ
られ、眼球17の角膜16の表面で反射されたスリット光な
どの概平行光線Ｂを受光し、眼球17の中心部に対する受
光位置関係を検出する。そして、この光検出装置26は、
Ｘ方向の受光位置を検出する光位置検出装置としてのＰ
ＳＤ26X と、Ｙ方向の受光位置を検出する光位置検出装
置としてのＰＳＤ26Yとで構成される。Reference numeral 26 denotes a light detecting device.
26 receives the substantially parallel light rays B such as slit light emitted from the light source device 21 toward the center of the eyeball 17 and reflected on the surface of the cornea 16 of the eyeball 17, and receives light relative to the center of the eyeball 17. Is detected. And this light detection device 26
P as a light position detecting device for detecting a light receiving position in the X direction
It comprises an SD 26X and a PSD 26Y as an optical position detecting device for detecting a light receiving position in the Y direction.
【００２３】一方、制御回路は図２に示すように、光源
22は、ＬＥＤドライバ31に接続され、このＬＥＤドライ
バ31により発光制御される。また、Ｘ方向用ＰＳＤ26X
およびＹ方向用ＰＳＤ26Y は切換スイッチ32に接続さ
れ、Ｘ方向用ＰＳＤ26X およびＹ方向用ＰＳＤ26Y の出
力はこの切換スイッチ32により時分割に切換えるように
して、後続回路を１組にしている。すなわち、Ｘ方向用
ＰＳＤ26X およびＹ方向用ＰＳＤ26Y の出力は、切換ス
イッチ32により時分割に切換えられ、切換スイッチ32に
接続された信号処理回路33を経て、さらにこの信号処理
回路33に接続された角度検出回路34に入力され、受光位
置を基に角膜16からの反射角αを求める。On the other hand, as shown in FIG.
The LED 22 is connected to an LED driver 31, and the LED driver 31 controls light emission. Also, PSD26X for X direction
The PSD 26Y for the Y direction and the PSD 26Y for the Y direction are connected to a switch 32, and the outputs of the PSD 26X for the X direction and the PSD 26Y for the Y direction are switched in a time division manner by the switch 32, thereby forming a set of subsequent circuits. That is, the outputs of the X-direction PSD 26X and the Y-direction PSD 26Y are time-divisionally switched by the changeover switch 32, passed through the signal processing circuit 33 connected to the changeover switch 32, and further connected to the signal processing circuit 33. Input to the detection circuit 34, the reflection angle α from the cornea 16 is obtained based on the light receiving position.
【００２４】ここで、眼球17の回転中心Crに対して細い
概平行光線Ｂを照射した場合、眼球17がたとえば図３に
示す実線で示すように右に角度θ回転していると、細い
概平行光線Ｂの一部は角膜16の表面の反射点Rpにおい
て、眼球17の回転方向とは反対方向に角度αで反射す
る。そして、回転角θでの角膜16の曲率中心をCc1 、こ
の曲率中心Cc1 と眼球17の回転中心Crとの距離をdc、回
転角θでの角膜16の曲率中心Cc1 と反射点Rpとの距離を
rcとし、正弦定理を適用すると、視線方向である眼球17
の回転角θと反射角αとの間には、以下に示す式２に基
づき式３の関係が成り立つ。Here, in the case where the thin approximately parallel ray B is applied to the rotation center Cr of the eyeball 17, if the eyeball 17 is rotated to the right by an angle θ as shown by a solid line in FIG. A part of the parallel light beam B is reflected at a reflection point Rp on the surface of the cornea 16 at an angle α in a direction opposite to the rotation direction of the eyeball 17. The center of curvature of the cornea 16 at the rotation angle θ is Cc1, the distance between the center of curvature Cc1 and the center of rotation Cr of the eyeball 17 is dc, and the distance between the center of curvature Cc1 of the cornea 16 at the rotation angle θ and the reflection point Rp. To
rc and applying the sine theorem, the eyeball 17
The relationship of Expression 3 is established between the rotation angle θ and the reflection angle α based on Expression 2 shown below.
【００２５】[0025]
【式２】 (Equation 2)
【００２６】[0026]
【式３】 したがって、反射角αを検出することにより、式３の関
係から、視線の方向の角度θを求めることができる。(Equation 3) Therefore, by detecting the reflection angle α, the angle θ in the direction of the line of sight can be obtained from the relationship of Expression 3.
【００２７】そして、たとえば図３に示すように、光源
装置21により眼球17の中心部に向かって発せられた、十
分に細いＸ方向およびＹ方向のスリット状の概平行光線
Ｂは、眼球17の角膜16の表面で反射される。そして、反
射光は光検出装置26のＸ方向用ＰＳＤ26X およびＹ方向
用ＰＳＤ26Y により受光され、眼球17の中心部に対する
Ｘ方向およびＹ方向の受光位置が検出される。そして、
図３の破線で示すように、視線が正面を向いていれば、
反射光の受光位置は、ＰＳＤ26X およびＰＳＤ26Y の各
中心位置となる。これに対し、図３の実線で示すよう
に、視線が右に角度θ向いていると、反射光は左方向に
反射角αで反射されるため、受光位置はＸ方向用ＰＳＤ
26X の左位置となる。したがって、この受光位置を検出
することにより反射角αが求められ、さらに、この反射
角αから式３の関係により視線の方向θが求められる。For example, as shown in FIG. 3, a sufficiently narrow slit-like substantially parallel light beam B in the X and Y directions emitted from the light source device 21 toward the center of the eyeball 17 The light is reflected by the surface of the cornea 16. The reflected light is received by the PSD 26X for the X direction and the PSD 26Y for the Y direction of the photodetector 26, and the light receiving position in the X direction and the Y direction with respect to the center of the eyeball 17 is detected. And
As shown by the broken line in FIG. 3, if the line of sight is facing the front,
The light receiving position of the reflected light is the central position of PSD26X and PSD26Y. On the other hand, as shown by the solid line in FIG. 3, when the line of sight is directed to the right angle θ, the reflected light is reflected to the left at the reflection angle α, so that the light receiving position is the X-direction PSD.
26X left position. Accordingly, by detecting the light receiving position, the reflection angle α is obtained, and further, the direction of the line of sight θ is obtained from the reflection angle α by the relationship of Expression 3.
【００２８】なお、水平方向であるＸ方向について説明
したが、垂直方向であるＹ方向についても同様であり、
Ｙ方向用ＰＳＤ26Y への受光位置により角膜16からの反
射角が求まり、この反射角から視線方向が求まる。Although the description has been given of the X direction which is the horizontal direction, the same applies to the Y direction which is the vertical direction.
The reflection angle from the cornea 16 is determined by the light receiving position on the Y-direction PSD 26Y, and the line-of-sight direction is determined from the reflection angle.
【００２９】ここで、図１に示す視線方向検出装置は、
眼球17の角膜16の表面からの反射光を受光し、その受光
位置から反射角αを求め、この反射角αから視線方向θ
を検出するようにしたので、従来のように反射像を結像
させる必要はなく、結像光学系のような複雑な構成が不
要となり、装置全体を小型軽量化することができる。ま
た、入射方向と反射方向との成す角度の変化は、たとえ
ば視線方向θの５°の変化に対して反射角αは、およそ
８°となり、変化幅が拡大する。すなわち、従来の第１
プルキンエ像を用いた場合のように僅かな変化を検出す
るのではなく、拡大された十分大きな変化幅を検出する
ので検出精度は大幅に向上する。Here, the gaze direction detecting device shown in FIG.
The reflected light from the surface of the cornea 16 of the eyeball 17 is received, the reflection angle α is obtained from the light receiving position, and the line-of-sight direction θ is obtained from the reflection angle α.
Is detected, it is not necessary to form a reflected image as in the related art, and a complicated configuration such as an imaging optical system is not required, and the entire apparatus can be reduced in size and weight. In addition, the change in the angle between the incident direction and the reflection direction is, for example, a change in the line-of-sight direction θ of 5 °, the reflection angle α is about 8 °, and the change width is increased. That is, the conventional first
Rather than detecting a small change as in the case of using a Purkinje image, the detection accuracy is greatly improved because an enlarged and sufficiently large change width is detected.
【００３０】また、眼球17への照射光として十分に細い
スリット状平行光線を用いているので、瞼や睫等による
影響を避けることができ、確実な視線方向検出を行なう
ことができる。Further, since a sufficiently narrow slit-like parallel light beam is used as the irradiation light to the eyeball 17, the influence of the eyelids, eyelashes and the like can be avoided, and the gaze direction can be reliably detected.
【００３１】次に、図４を参照して、３５mmコンパクト
カメラあるいは小型ビデオムービーカメラ等のファィン
ダーへの応用を考えて構成したものを説明する。Next, with reference to FIG. 4, a description will be given of an image pickup apparatus designed for application to a finder such as a 35 mm compact camera or a small video movie camera.
【００３２】この図４に示す装置は、スリット板24を経
たスリット光である概平行光線Ｂをハーフミラー28によ
り眼球17の角膜16に導いている。この場合、Ｘ方向用の
ＰＳＤ26X およびＹ方向用ＰＳＤ26Y からなる光検出装
置26は、ハーフミラー28と角膜16との間に設置すること
ができる。The device shown in FIG. 4 guides a substantially parallel light beam B, which is a slit light beam passing through a slit plate 24, to a cornea 16 of an eyeball 17 by a half mirror 28. In this case, the light detecting device 26 including the PSD 26X for the X direction and the PSD 26Y for the Y direction can be installed between the half mirror 28 and the cornea 16.
【００３３】このように構成しても、十分に細いＸ方向
およびＹ方向の概平行光線Ｂは、ハフミラー28を介して
眼球17の中心部に向かって発せられる。そして、この概
平行光線Ｂは、眼球17の角膜16表面で反射され、反射光
は、ハーフミラー28との間に設けられた光検出装置26の
Ｘ方向用ＰＳＤ26X およびＹ方向用ＰＳＤ26Y により受
光され、眼球17の中心部に対するＸ方向およびＹ方向の
受光位置が検出される。したがって、この受光位置から
反射角αが求められ、さらに、この反射角αから視線の
方向θが求められる。Even with such a configuration, substantially parallel light beams B in the X and Y directions which are sufficiently thin are emitted toward the center of the eyeball 17 via the Hough mirror 28. The substantially parallel light beam B is reflected on the surface of the cornea 16 of the eyeball 17, and the reflected light is received by the X-direction PSD 26X and the Y-direction PSD 26Y of the photodetector 26 provided between the half mirror 28. The light receiving positions in the X and Y directions with respect to the center of the eyeball 17 are detected. Therefore, the reflection angle α is determined from the light receiving position, and the line-of-sight direction θ is determined from the reflection angle α.
【００３４】なお、上記実施例では、光源22としてＬＥ
Ｄを示したが、ＬＥＤの他の光源を用いてもよい。In the above embodiment, the light source 22 is LE
Although D is shown, other light sources of LEDs may be used.
【００３５】また、Ｘ方向およびＹ方向の双方を検出す
るようにしているが、どちらか一方の方向を検出するよ
うにしてもよい。Although both the X direction and the Y direction are detected, either one of the directions may be detected.
【００３６】さらに、スリット板24には、ＸおよびＹ方
向用の互いに直交する２つのスリット24X ，24Y を形成
したが、斜め方向の１本のスリット等を用いて両方向の
検出を行なってもよい。また、スリット板24の代りに、
複数のピンホールを有するピンホール板を用いてもよ
い。Further, the slit plate 24 is formed with two slits 24X and 24Y orthogonal to each other for the X and Y directions, but the detection in both directions may be performed by using one diagonal slit or the like. . Also, instead of slit plate 24,
A pinhole plate having a plurality of pinholes may be used.
【００３７】またさらに、光検出装置26として用いられ
る光位置検出装置はＰＳＤに限らず、ＣＣＤラインセン
サやフォトセルアレイ、ＣＣＤ撮像素子等の２次元のセ
ンサを用いてもよい。Further, the light position detecting device used as the light detecting device 26 is not limited to the PSD, but may be a two-dimensional sensor such as a CCD line sensor, a photocell array, or a CCD image pickup device.
【００３８】[0038]
【発明の効果】本発明の視線方向検出装置によれば、角
膜表面での反射角から視線方向を２次元で検出するよう
にしたので、光の位置を検出する１次元のセンサを組合
せあるいは２次元のセンサを設ければ良く、従来のよう
に反射像を結像させる結像光学系のような複雑な構成が
不要となり、装置全体を小型軽量化することができる。
また、入射方向と反射方向との成す角度の変化について
は、視線方向の変化に対して反射角は変化幅が拡大する
ため、従来の第１プルキンエ像を用いた場合のように僅
かな変化を検出するのではなく、拡大された十分大きな
変化幅を検出することが可能になり検出精度は大幅に向
上する。According to the gaze direction detecting device of the present invention, the gaze direction is detected two-dimensionally from the angle of reflection on the corneal surface, so that a one-dimensional sensor for detecting the position of light is combined.
Or a two-dimensional sensor may be provided, and a complicated configuration such as an imaging optical system for forming a reflected image as in the related art is not required, and the entire apparatus can be reduced in size and weight.
Also, the change in the angle between the incident direction and the reflected direction
Changes the range of reflection angle with respect to changes in the line of sight
Therefore, instead of detecting the small changes as in the case of using the conventional first Purkinje image, the detection accuracy becomes possible to detect that expanded sufficiently large change width is greatly improved.
【図１】本発明の視線方向検出装置の一実施例を示す斜
視図である。FIG. 1 is a perspective view showing an embodiment of a gaze direction detecting device according to the present invention.
【図２】同上回路構成を示すブロック図である。FIG. 2 is a block diagram showing a circuit configuration of the same.
【図３】同上動作原理を示す説明図である。FIG. 3 is an explanatory diagram showing an operation principle of the embodiment.
【図４】他の実施例の視線方向検出装置を示す説明図で
ある。FIG. 4 is an explanatory diagram showing a gaze direction detecting device according to another embodiment.
【図５】従来の視線方向検出装置の一状態を示す説明図
である。FIG. 5 is an explanatory diagram showing one state of a conventional gaze direction detecting device.
【図６】同上別の状態を示す説明図である。FIG. 6 is an explanatory diagram showing another state of the above.
【図７】従来の第１プルキンエ像を用いた場合の検出原
理を示す説明図である。FIG. 7 is an explanatory diagram showing a detection principle when a conventional first Purkinje image is used.
16 角膜 17 眼球 21 光源装置 26 光検出装置33 制御回路を構成する信号処理回路 34 光検出装置を構成する角度検出回路 16 Cornea 17 Eyeball 21 Light source device 26 Light detection device 33 Signal processing circuit constituting control circuit 34 Angle detection circuit constituting light detection device
───────────────────────────────────────────────────── フロントページの続き (58)調査した分野(Int.Cl.7，ＤＢ名) A61B 3/113 G02B 7/28 ──────────────────────────────────────────────────続 き Continued on front page (58) Field surveyed (Int.Cl. 7 , DB name) A61B 3/113 G02B 7/28
Claims (1)
の大きさに比して十分に細い概平行光線を発する光源装
置と、 前記概平行光線の前記眼球の角膜からの反射光を受光
し、前記眼球の中心部に対する受光位置の関係を２次元
で検出する光検出装置と、 この光検出装置の受光位置を基に角膜からの反射角を求
める制御回路と を備えたことを特徴とする視線方向検出
装置。1. A light source device that emits substantially parallel light rays, which are sufficiently thin compared to the size of the pupil of the eyeball, toward the center of the eyeball, and reflects the reflected light of the substantially parallel light rays from the cornea of the eyeball. The two-dimensional relationship between the light receiving position and the center of the eyeball
A light detecting device, the angle of reflection from the cornea based on the light receiving position of the photodetector determined for detecting in
Gaze direction detecting apparatus characterized by comprising a Mel control circuit.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP15799092A JP3194790B2 (en) | 1992-06-17 | 1992-06-17 | Gaze direction detection device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP15799092A JP3194790B2 (en) | 1992-06-17 | 1992-06-17 | Gaze direction detection device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| JPH05344954A JPH05344954A (en) | 1993-12-27 |
| JP3194790B2 true JP3194790B2 (en) | 2001-08-06 |
Family
ID=15661837
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP15799092A Expired - Fee Related JP3194790B2 (en) | 1992-06-17 | 1992-06-17 | Gaze direction detection device |
Country Status (1)
| Country | Link |
|---|---|
| JP (1) | JP3194790B2 (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102227284B1 (en) | 2014-01-16 | 2021-03-12 | 삼성전자주식회사 | Dispaly apparatus and controlling method thereof |
| JP2019215305A (en) | 2018-06-14 | 2019-12-19 | ソニー株式会社 | Eyeball detection apparatus and image display device |
| CN112869701B (en) * | 2021-01-11 | 2024-03-29 | 上海微创医疗机器人（集团）股份有限公司 | Sight line detection method, surgical robot system, control method, and storage medium |
-
1992
- 1992-06-17 JP JP15799092A patent/JP3194790B2/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| JPH05344954A (en) | 1993-12-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US5225862A (en) | Visual axis detector using plural reflected image of a light source | |
| US7533990B2 (en) | Ophthalmologic apparatus | |
| US4974010A (en) | Focus control system | |
| JPH0566133B2 (en) | ||
| JPH04240438A (en) | Line of sight detector | |
| US20080151189A1 (en) | Ophthalmologic apparatus | |
| JPH06505657A (en) | Target movement compensation for laser surgical systems | |
| US20040165099A1 (en) | Digital camera autofocus using eye focus measurement | |
| EP0392742B1 (en) | Ophthalmological measurement method and apparatus | |
| US5469234A (en) | Method of detecting eye component information for determining sight axis direction, and sight axis direction detection apparatus | |
| BR9408338A (en) | Equipment for examining the fundus of an eye and for detecting an ocular light pattern reflected by the fund Equipment for positionalizing the fundus of an eye for examination and detection of an ocular light pattern reflected by the fund visual axis method for positioning the bottom of an eye having a visual axis for examination by a radiation beam using equipment to focus an image of an object through a lens on a focal plane having the | |
| JP2676870B2 (en) | Optical device having gazing point detection means | |
| US6304723B1 (en) | Retinal camera | |
| US4494868A (en) | Rangefinder device with focused elongated light source | |
| JP2939988B2 (en) | Eye gaze detection device | |
| JP3194790B2 (en) | Gaze direction detection device | |
| JP2000116602A (en) | Retinal camera | |
| JPH06230271A (en) | Line of sight detector | |
| JP2812421B2 (en) | Corneal cell imaging device | |
| JPH0975308A (en) | Corneal endothelial cell photographing device | |
| JP2754663B2 (en) | Gaze detection method and gaze detection device | |
| JPH0984760A (en) | Positioning detection device for ophthalmic equipment | |
| JP2939982B2 (en) | Eye gaze detection device | |
| JPS6260645B2 (en) | ||
| JPH0643893B2 (en) | Distance measuring device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20120601 Year of fee payment: 11 |
|
| S111 | Request for change of ownership or part of ownership |
Free format text: JAPANESE INTERMEDIATE CODE: R313113 |
|
| S533 | Written request for registration of change of name |
Free format text: JAPANESE INTERMEDIATE CODE: R313533 |
|
| S111 | Request for change of ownership or part of ownership |
Free format text: JAPANESE INTERMEDIATE CODE: R313113 |
|
| S533 | Written request for registration of change of name |
Free format text: JAPANESE INTERMEDIATE CODE: R313533 |
|
| R350 | Written notification of registration of transfer |
Free format text: JAPANESE INTERMEDIATE CODE: R350 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20120601 Year of fee payment: 11 |
|
| R360 | Written notification for declining of transfer of rights |
Free format text: JAPANESE INTERMEDIATE CODE: R360 |
|
| R360 | Written notification for declining of transfer of rights |
Free format text: JAPANESE INTERMEDIATE CODE: R360 |
|
| R371 | Transfer withdrawn |
Free format text: JAPANESE INTERMEDIATE CODE: R371 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20120601 Year of fee payment: 11 |
|
| S111 | Request for change of ownership or part of ownership |
Free format text: JAPANESE INTERMEDIATE CODE: R313113 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20120601 Year of fee payment: 11 |
|
| R350 | Written notification of registration of transfer |
Free format text: JAPANESE INTERMEDIATE CODE: R350 |
|
| LAPS | Cancellation because of no payment of annual fees |