WO2006019028A1 - 瞳孔検出装置およびそれを備えた画像表示装置 - Google Patents
瞳孔検出装置およびそれを備えた画像表示装置 Download PDFInfo
- Publication number
- WO2006019028A1 WO2006019028A1 PCT/JP2005/014719 JP2005014719W WO2006019028A1 WO 2006019028 A1 WO2006019028 A1 WO 2006019028A1 JP 2005014719 W JP2005014719 W JP 2005014719W WO 2006019028 A1 WO2006019028 A1 WO 2006019028A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- pupil
- scanning
- light
- light beam
- eyeball
- Prior art date
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/02—Subjective types, i.e. testing apparatus requiring the active assistance of the patient
Definitions
- Pupil detection device and image display device including the same
- the present invention relates to a technique for detecting the position of a pupil in an eyeball by irradiating the eyeball with light and using reflected light from the eyeball.
- the position sensing diode is connected to an eye tracker to detect the position of the pupil.
- the position of the pupil is detected using the image display light for displaying the image in the first place.
- the eye tracker includes an infrared light source.
- the infrared light source directly or indirectly irradiates the surface of the eyeball with low-intensity infrared light exclusively to detect the position of the pupil.
- the surface of the eyeball is confirmed as a two-dimensional image through the coupler, lens, and CCD sensor.
- a CCD sensor is configured as a two-dimensional array of a large number of light receiving elements, and these light receiving elements form a two-dimensional array of a large number of pixels.
- a signal from the CCD sensor is processed by a pupil position processor.
- the pupil position processor performs image processing on the signal from the CCD sensor, thereby detecting the position of the pupil.
- the image processing generally detects the center position of the pupil from the center or outline of the image captured by the CCD sensor. It is done by the method to issue.
- infrared rays are irradiated to the eyeball along a path different from the path through which the image display light enters the pupil.
- the reference light to be referred to for detecting the position of the pupil is the light reflected from the surface of the eyeball among the image display light. If the brightness of the display light changes, the brightness of the reference light also changes accordingly. Therefore, in this conventional example, the detection accuracy of the pupil position has to depend on the brightness of the image display light. When the brightness of the image display light is low, the detection of the pupil position is caused by the insufficient light quantity of the reference light. There was a possibility that accuracy would be lowered.
- the pupil position processor in order to detect the position of the pupil, the pupil position processor must perform image processing based on the signal of the CCD sensor. Therefore, in this conventional example, a high-speed image processing capability is required for the pupil position processor, which may increase the cost of the apparatus.
- the present invention has an object to improve the technique for detecting the position of the pupil in the eyeball by irradiating the eyeball with light and using the reflected light from the eyeball. It was made.
- a pupil detection device that detects the position of the pupil in the eyeball by irradiating the eyeball with light and using reflected light of the eyeball power
- the light beam emitted from the emission part is scanned two-dimensionally in the main scanning direction and in the sub-scanning direction intersecting with the main scanning method, thereby forming a plurality of scanning lines extending in parallel with each other on the eyeball.
- a scanning unit
- a detection unit that detects the intensity of the light beam reflected on the surface of the eyeball among the light beam incident on the surface of the eyeball as an intensity signal of the reflected light beam
- the detection unit force a processing unit for determining the position of the pupil based on the intensity change of the reflected light beam represented by the output intensity signal;
- the present inventor irradiates the surface of the eyeball with a light beam and scans the light beam on the surface of the eyeball two-dimensionally in the main scanning direction and the sub-scanning direction intersecting the main light direction. I noticed that the intensity of the reflected light flux changed spatially. Furthermore, the present inventor has also noticed that there is a certain relationship between the characteristics of the change and the actual position of the pupil.
- the intensity of the light beam reflected on the surface of the eyeball out of the light beam incident on the surface of the eyeball is detected by the detection unit. And an intensity signal representing the intensity of the detected reflected light beam is output. Further, the position of the pupil is obtained by the processing unit based on the intensity change of the reflected light beam represented by the intensity signal output from the detection unit.
- this pupil detection device it is possible to detect the position of the pupil without performing complicated image processing on the signal output from the detection unit. Furthermore, the detection unit detects the intensity of the reflected light beam based on the narrow incident area rather than detecting the position where the reflected light beam from the surface of the eyeball is incident two-dimensionally based on the wide incident area. Therefore, it is easy to reduce the size and cost of the detection unit.
- the "detection unit" in this section includes, for example, a condenser (for example, a convex lens) that collects a reflected light beam having a surface force of the eyeball, and receives the reflected light beam that has been collected.
- Luminous flux A sensor for example, a photodiode that detects a signal representing the intensity of the signal as a binary signal or a multi-value signal can be included.
- the "light beam” in this section is preferably an invisible light beam when it is necessary to detect the pupil position without being noticed by the observer, but when it is not necessary
- the processing unit responds to a change of the intensity of the reflected light beam represented by the intensity signal output from the detection unit according to a position on each scanning line and a position of each scanning line.
- the pupil detection device according to (1), wherein the position of the pupil is two-dimensionally detected based on the change.
- the inventor irradiates the surface of the eyeball with a light beam, and scans the light beam on the surface of the eyeball two-dimensionally in the main scanning direction and the sub-scanning direction intersecting the main light direction. It was noticed that the intensity of the reflected light beam reflected from the surface of the eye showed a change corresponding to the position on each scanning line and a change corresponding to the position of each scanning line on the eyeball. Furthermore, the present inventor has also noticed that there is a certain relationship between the characteristics of these changes and the actual position of the pupil.
- the intensity of the light beam reflected on the surface of the eyeball out of the light beam incident on the surface of the eyeball is measured on each scanning line.
- the position of the pupil is two-dimensionally detected based on the change corresponding to the position and the change corresponding to the position of each scanning line.
- the light beam is irradiated onto the eyeball so that the light beam is scanned two-dimensionally in a scanning region set on the surface of the eyeball so as to have a larger area including the pupil.
- the pupil detection device according to (1) or (2).
- the reflectance of the surface of the eyeball is not uniformly distributed over the entire surface.
- the reflectance is unevenly distributed so that it is high in the other regions that are high in the iris located around the pupil. Is distributed. Therefore, in order to accurately detect the pupil position by utilizing the distribution characteristic of the reflectance on the eyeball surface, the light flux to be irradiated on the eyeball surface
- the eyeball surface has a larger area including the pupil. It is desirable to scan two-dimensionally in the scanning area set above. Based on this knowledge The pupil detection device according to this section has been proposed.
- the scanning unit emits scanning light in response to the incidence of the light flux, and the emitted scanning light is on an optical axis assumed between the scanning unit and the retina.
- the pupil detection device according to (3) wherein the eyeball is irradiated so as to converge at a position away from the pupil by a set distance.
- the cross-sectional force of the scanning light at the position of the eyeball surface corresponds to a two-dimensional scanning region set on the eyeball surface.
- the larger the cross section the larger the scanning area.
- the scanning light converges at a position away from the pupil on the optical axis assumed between the scanning unit and the retina in the eyeball at the position of the pupil, It is larger than the case of convergence.
- the pupil detection device of this section it is easy to set a scanning region in which the surface of the eyeball is scanned two-dimensionally with a light flux so as to have a larger area including the pupil. Become.
- the processing unit for each of the scanning lines, when the number of high-level parts representing that the intensity of the reflected light beam S exceeds the value of the signal is 2,
- the pupil detection device according to any one of (1) and (4), which detects the position of the pupil based on the two high-level portions.
- each scanning line on the eyeball surface is set so that the scanning region on the eyeball surface has a larger area including the pupil, the pupil and the iris located around the pupil Pass through.
- the surface of the eyeball is observed along each scanning line, irises having higher reflectivity than that of the pupil are located on both sides of the pupil. Therefore, when the eyeball surface is scanned so that the light beam passes through the pupil surface along such a scanning line, the intensity of the reflected light beam from the eyeball surface is high.
- the signal from the detection unit is generated so that the high level part sandwiches the low level part which is not so much from both sides.
- the center position between the two high-level portions in the generated signal reflects the center position of the pupil in the direction parallel to the plurality of scanning lines. Also, multiple runs The position of the scanning line corresponding to the signal having the maximum interval between the two high-level portions among the plurality of signals respectively acquired for the shoreline is in the direction intersecting with the plurality of scanning lines. Reflects the center position of the pupil.
- the pupil detection device for each scanning line, a signal indicating that the intensity of the reflected light beam exceeds the threshold among the signals output from the detection unit.
- the position of the pupil is detected based on these two level parts.
- the processing unit includes a main scanning direction position detecting unit that detects a position of the pupil in the main scanning direction based on a central position between the two high level portions in the signal ( The pupil detection device according to item 5).
- the center position between the two high-level portions in the signal of the detection unit force reflects the center position of the pupil in the direction parallel to the plurality of scanning lines. Based on such knowledge, in the pupil detection device according to this section, the position of the pupil in the main scanning direction is detected based on the center position between the two high-level portions in the signal of the detection unit force.
- the processing unit may be configured so that, in the sub-scanning direction, the processing unit is based on a position of the plurality of scanning lines in which the interval between the two high-level units in the signal is substantially maximum.
- the pupil detection device according to item (5) or (6), including sub-scanning direction position detection means for detecting the position of the pupil.
- the position of the scanning line corresponding to the signal having the maximum interval between the two high-level parts among the plurality of signals respectively acquired by the detection unit for the plurality of scanning lines is: Reflects the center position of the pupil in the direction intersecting the plurality of scanning lines. Based on such knowledge, in the pupil detection device according to this section, among the plurality of scanning lines, the position between the two high-level portions in the detection unit force signal is substantially maximum. Based on this, the position of the pupil in the sub-scanning direction is detected.
- An image display device that projects an image directly on the retina by irradiating the retina with a visible light beam representing the image through the pupil of the observer
- a detection emitting unit that emits a non-visible light beam different from the visible light beam toward the eyeball,
- a combining unit that combines the visible light beam and the invisible light beam respectively emitted from the display emission unit and the detection emission unit into a combined light beam
- the synthesized combined light beam is scanned two-dimensionally in a main scanning direction and a sub-scanning direction intersecting the main scanning direction, thereby forming a plurality of parallel scanning lines on the eyeball.
- a guiding unit that guides the combined light beam scanned by the scanning unit toward the pupil; and an invisible light beam reflected on the surface of the eyeball out of the invisible light beam incident on the surface of the eyeball, an intensity signal of the reflected light beam
- a detection unit for detecting as,
- a control unit that controls the optical axis to follow the actual position of the pupil
- An image display device An image display device.
- the image display device in the same manner as the pupil detection device according to the above item (1), of the light beams incident on the surface of the eyeball by the detection unit, The intensity is detected as the intensity of the reflected light beam, and the position of the pupil is obtained by the control unit based on the change in the intensity of the detected reflected light beam.
- the detection unit detects the intensity of the reflected light beam based on the narrow incident area rather than detecting the position where the reflected light beam from the surface of the eyeball is incident two-dimensionally based on the wide incident area. Therefore, it is easy to reduce the size and cost of the detection unit.
- the control unit further causes the optical axis along which the visible light beam travels toward the eyeball to follow the actual position of the pupil based on the detected position of the pupil. To be controlled. Therefore, according to this image display device, the visible light emitted from the scanning unit is visible because it is necessary to reduce the inertia of the movable unit of the scanning unit to increase the scanning speed. Even in a situation where the diameter of the light beam cannot be made sufficiently large and the visible light beam is likely to be out of the pupil force, it is easy to maintain a state where the visible light beam always passes through the pupil and reaches the retina.
- a visible light beam is irradiated to the eyeball for image display, while an invisible light beam is irradiated to the eyeball for pupil position detection. Therefore, in this image display device, it is possible to detect a pupil position that is not noticed by the observer.
- a scanning unit and a guide unit are provided in common for the visible light beam and the invisible light beam.
- the optical path from the scanning section to the eyeball through the guiding section is shared by the visible and non-visible light beams, so that a dedicated light path must be used for each of these two types of light fluxes. Compared to the above, it is easy to reduce the size, simplicity and cost of the image display device.
- the image display apparatus according to this section can be implemented in combination with the pupil detection apparatus according to any one of (2) to (7).
- the control unit responds to a change in the intensity of the reflected light beam represented by the intensity signal output from the detection unit according to a position on each scanning line and a position of each scanning line. Based on the change, the position of the pupil is two-dimensionally detected, and based on the detected position of the pupil, the optical axis along which the visible light beam travels toward the eyeball follows the actual position of the pupil.
- the image display device according to item (8), which is controlled so as to.
- the intensity of the light beam reflected on the surface of the eyeball out of the light beam incident on the surface of the eyeball is reflected light beam.
- the intensity of the reflected reflected light is detected in a three-dimensional manner based on the change in the intensity of the detected reflected light beam according to the position on each scan line and the change in accordance with the position of each scan line. .
- the scanning unit emits invisible scanning light in response to the incidence of the invisible light beam, and the image display device further transmits the emitted invisible scanning light to the scanning unit. At a position away from the pupil by a set distance on the optical axis assumed between the retina and the retina.
- the image display device according to (8) or (9), further including a convergence position setting unit that sets a convergence position of the invisible scanning light so as to converge.
- the convergence position setting unit is disposed downstream of the scanning unit, the convergence position setting unit is more visible than when the scanning unit is disposed upstream of the scanning unit. It becomes easy to reduce the possibility of adversely affecting the luminous flux.
- the convergence position setting unit is arranged in the downstream portion of the guiding unit, the same guiding unit except for the downstream side or on the upstream side of the portion. It is easier to reduce the possibility that this convergence position setting unit will adversely affect the visible light beam than the case where it is arranged.
- the convergence position setting unit includes at least one of a lens made of a glass material having wavelength dispersion and a diffraction element.
- the direction of the emitted light beam of the optical element force is changed between the visible light beam and the invisible light beam. It is possible to make them different from each other. As a result, it is possible to vary the convergence position of each scanning light in the eyeball between the scanning light by the visible light beam and the scanning light by the invisible light beam.
- the control unit is arranged downstream of the scanning unit, according to any of items (8) to (14).
- An image display device according to any one of the above.
- the control unit controls the portion of the optical axis of the visible light beam between the control unit and the eyeball. Of these, it is easy to avoid reaching the scanning part and the part located upstream from it.
- control unit emits visible scanning light with respect to incidence of the visible light beam
- control unit includes a deflector that is installed at an imaging position of the emitted visible scanning light and deflects an optical axis along which the visible scanning light travels.
- the control unit emits visible scanning light with respect to incidence of the visible light beam
- control unit includes a translator that translates an optical axis along which the emitted visible scanning light travels in a direction perpendicular to the optical axis.
- the control unit performs one-dimensional detection in one direction for detection of the position of the pupil and control of the position of the optical axis
- a cross-sectional shape of the combined light beam is a flat shape flattened in a direction perpendicular to the one direction.
- the dimension of the longest portion (for example, the length of the major axis of an ellipse or an ellipse) in the flat cross-sectional shape of the combined light beam is set to be equal to or larger than the diameter of the pupil. It is possible to implement it.
- the scanning unit in order to draw an image, the scanning unit
- the combined luminous flux is one-dimensionally moved in a direction perpendicular to the direction in which the longest part extends.
- the detection of the position of the pupil and the tracking control for controlling the optical axis of the visible light beam traveling toward the eyeball so as to follow the actual position of the pupil are both one-dimensional. It is sufficient to perform in the scanning direction.
- pupil position detection and tracking control are performed two-dimensionally. It becomes easier to simplify and speed up than when it is necessary.
- FIG. 1 is a system diagram showing a retinal scanning display device according to a first embodiment of the present invention.
- FIG. 2 shows the retinal scanning display device shown in FIG. 1, in which the light passes through the galvanomirror 150 and the relay optical system 160, and the pupil 12 is directed toward the observer's eye 10 facing the front.
- FIG. 1 shows the retinal scanning display device shown in FIG. 1, in which the light passes through the galvanomirror 150 and the relay optical system 160, and the pupil 12 is directed toward the observer's eye 10 facing the front.
- FIG. 2 shows the retinal scanning display device shown in FIG. 1, in which the light passes through the galvanomirror 150 and the relay optical system 160, and the pupil 12 is directed toward the observer's eye 10 facing the front.
- FIG. 3 is a side sectional view showing the variable prism 190 in FIG.
- FIG. 4 shows the optical path of the retinal scanning display device shown in FIG. 1 in which the light passes through the galvanomirror 150 and the relay optical system 160, and the pupil 12 faces obliquely upward to the eye 10 of the observer.
- FIG. 4 shows the optical path of the retinal scanning display device shown in FIG. 1 in which the light passes through the galvanomirror 150 and the relay optical system 160, and the pupil 12 faces obliquely upward to the eye 10 of the observer.
- FIG. 5 is a flowchart conceptually showing the contents of an optical axis tracking control program executed by the computer of pupil position determining circuit 180 in FIG.
- FIG. 6 is drawn on the surface of the eye 10 of the observer by scanning with infrared light to explain the mechanism by which the position of the pupil 12 is detected by executing the optical axis tracking control program of FIG. FIG.
- FIG. 7 is a graph showing the relationship between the intensity of the return light detection signal captured by the execution of S3 in FIG. 5 and the scanning line number.
- FIG. 8 is a graph illustrating the return light detection signal shown in FIG. 7 and a diagram for explaining the position of the pupil 12 in association with the waveform characteristics of the return light detection signal.
- FIG. 9 is a graph for explaining how the elapsed time tc and the separation time td in FIG. 8 change with the scanning line number.
- FIG. 10 is an optical path diagram for explaining the mechanism by which the optical axis is changed in the retinal scanning display device according to the second embodiment of the present invention.
- FIG. 11 is an optical path diagram for explaining the mechanism by which the optical axis is changed in the retinal scanning display device according to the third embodiment of the present invention.
- FIG. 1 systematically represents a retinal scanning display (hereinafter abbreviated as “RSD”) according to the first embodiment of the present invention.
- This RSD is an image display device of a type in which a laser beam is projected onto the retina 14 through the pupil 12 of the eyeball 10, that is, the pupil 10 of the eyeball 10, thereby allowing the observer to visually recognize the display target as a virtual image.
- this RSD forms an image of the laser beam on the retina 14 through the pupil 12 while appropriately modulating the wavefront and intensity of the laser beam, and two-dimensionally scanning the laser beam on the retina 14. By doing so, the image is projected directly onto the retina 14.
- this RSD includes a light source unit 20, and a wavefront modulation optical system 22 and a scanning device 24 are arranged in that order between the light source unit 20 and an observer's eye 10. I have.
- the RSD further includes a pupil detection unit 30 that detects the position of the pupil 12 (for example, the center position), and a follow-up unit 32 that tracks the irradiation light beam to the detected position of the pupil 12.
- the follower 32 performs the direction of the scanning light of the scanning device 24 (that is, the final output light of the RSD) (or the eye of the eye) for tracking drawing in which retinal scanning drawing is performed while tracking the actual position of the pupil 12. It is a device that adaptively controls the position (incident on the surface of 10).
- the light source unit 20 focuses three laser beams having three primary colors (RGB) into one laser beam to display a laser beam of any color.
- display light an R laser 40 that emits a red laser beam
- G laser 42 that emits a green laser beam
- B laser 44 that emits a blue laser beam.
- This light source unit further emits an infrared laser beam (hereinafter also referred to as “infrared light”) that is irradiated to the eye 10 in order to detect the position of the pupil 12 with reference to the position of the RS D.
- a laser 46 is provided.
- Each laser 40, 42, 44, 46 can be configured as a semiconductor laser, for example.
- the red, green, and blue laser beams are examples of visible light beams irradiated to the eye 10 for image display, whereas infrared light is This is an example of an invisible light beam applied to the eye 10 in order to detect the position of the pupil 12.
- the laser beams emitted from the lasers 40, 42, 44, and 46 are combined to synthesize them. After being collimated by each collimating optical system 50, 52, 54, 56, it is made incident on each dichroic mirror 60, 62, 64, 66 having wavelength dependency, so that each laser beam has a wavelength. With respect to selective reflection and transmission.
- the red laser beam emitted from the R laser 40 is collimated by the collimating optical system 50 and then incident on the dichroic mirror 60.
- the green laser beam emitted from the G laser 42 is incident on the dichroic mirror 62 through the collimating optical system 52.
- the blue laser beam emitted from the B laser 44 is incident on the dichroic mirror 64 through the collimating optical system 54.
- Infrared light emitted from the IR laser 46 is incident on a dichroic mirror 66 through a collimating optical system 56.
- the display light (that is, the three primary color laser beams) and the infrared light incident on the four dichroic mirrors 60, 62, 64, 66 respectively are converted into the four dichroic mirrors 60, 62, The light finally enters and converges on one dichroic mirror 60 representing 64 and 66, and is then collected by the coupling optical system 70.
- the light source unit 20 includes a signal processing circuit 80.
- the signal processing circuit 80 is configured to perform signal processing for driving the lasers 40, 42, and 44 based on video signals supplied from the outside, signal processing for modulating the wavefront of the laser beam, which will be described later, It is designed to perform signal processing for laser beam scanning.
- the signal processing circuit 80 generates (extracts) signal components corresponding to the lasers 40, 42, and 4 4 (R light, G light, and B light) based on video signals supplied from the outside, and outputs each color component. On the basis of the signal components, necessary drive signals are supplied to the lasers 40, 42, 44 via the laser drivers 90, 92, 94, respectively. As a result, the image is projected and displayed on the retina 14 so as to have an appropriate color and intensity according to the video signal supplied with the external force.
- the signal processing device 80 also generates (extracts) a synchronization signal serving as a reference for the laser beam or infrared light based on the video signal and supplies it to the scanning device 24. Based on the depth information included in the signal, a depth signal for controlling a wavefront curvature modulator 110 described later is also supplied to the wavefront modulation optical system 22.
- the IR laser 46 is driven so as to always emit infrared light with a constant intensity.
- the signal processing circuit 80 supplies a drive signal for emitting infrared light with a constant intensity to the IR laser 46 via the IR laser driver 96.
- infrared light is always incident on the eye 10 with a constant light quantity regardless of the content of the display image.
- the IR laser 46 emits infrared light during an image display period during a period excluding the scanning blanking period (a period excluding the horizontal scanning blanking period and the vertical scanning blanking period). Is driven to emit light. The reason for selecting the infrared light emission period in this way will be described in detail later.
- the light source unit 20 described above emits display light and infrared light from the same position in the coupling optical system 70.
- the display light and the infrared light are combined and condensed by the coupling optical system 70, and then the optical fiber 100 as an optical transmission medium and a laser beam emitted from the rear end of the optical fiber 100 are parallel to each other.
- the light is incident on the wavefront modulation optical system 22 through the collimating optical system 104 to be converted into light in that order.
- the wavefront modulation optical system 22 is an optical system that modulates the wavefront curvature of the laser beam emitted from the light source unit 20 and includes a wavefront curvature modulator 110.
- the wavefront curvature modulator 110 if conceptually described, is mainly composed of a combination of a converging lens and a mirror that can be displaced on its optical axis.
- the wavefront curvature modulator 110 includes a beam splitter 112 on which display light and infrared light that have also exited the collimating optical system 104 are incident, and its beam splitter. And a converging lens 114 that condenses the display light emitted from 112, and further includes a movable mirror 116 for modulating the wavefront curvature of the display light emitted from the converging lens 114.
- the wavefront curvature modulator 110 further includes an actuator 118 that changes the position of the movable mirror 116 on the optical axis.
- An example of the actuator 118 is a type using a piezoelectric element.
- the actuator 118 moves the position of the movable mirror 116 in accordance with the depth signal (Z signal) input from the signal processing circuit 80, thereby Curvature modulator 110 modulates the wavefront curvature of the display light emitted from 110.
- the display light is reflected by the movable mirror 116, passes through the converging lens 114, and then passes through the beam splitter 112 toward the scanning device 24.
- a dichroic mirror 120 that selectively reflects infrared light is provided between the beam splitter 112 and the converging lens 114. Therefore, the infrared light incident from the beam splitter 112 is reflected by the dichroic mirror 120 so as to return to the incident side, passes through the beam splitter 112 again, and travels toward the scanning device 24. As a result, the wavefront curvature of infrared light is not modulated during image display, and as a result, infrared light is always applied to the surface of the eye 10 in the same area. As a result, it is possible to suppress a decrease in detection accuracy of the pupil position due to a change in the incident area.
- the display light and infrared light emitted from the wavefront modulation optical system 22 configured as described above are incident on the scanning device 24 described above.
- the scanning device 24 includes a horizontal scanning system 130 and a vertical scanning system 132.
- the horizontal scanning system 130 is an optical system that performs horizontal scanning in which each laser beam is raster-scanned horizontally along a plurality of horizontal scanning lines for each frame of an image to be displayed.
- the vertical scanning system 132 is an optical system that performs vertical scanning in which each laser beam is scanned vertically from the first scanning line to the last scanning line for each frame of an image to be displayed.
- the horizontal scanning system 130 includes a polygon mirror 134 as a unidirectional rotating mirror that performs mechanical deflection.
- the polygon mirror 134 is rotated at a high speed by a motor (not shown) around a rotation axis that intersects the optical axis of each laser beam incident thereon.
- the rotation of the polygon mirror 134 is controlled based on the horizontal synchronization signal supplied from the signal processing circuit 80.
- the polygon mirror 134 includes a plurality of reflecting surfaces 136 arranged around the rotation axis, and each laser beam force S is deflected once every time it passes through one reflecting surface 136. Each deflected laser beam is transmitted to the vertical scanning system 132 by the relay optical system 140.
- the relay optical system 140 includes a plurality of optical elements 142 and 144 arranged side by side on the optical path.
- the vertical scanning system 132 includes the galvano mirror 150 as a swinging mirror that performs mechanical deflection. The laser beams emitted from the horizontal scanning system 130 are collected by the relay optical system 140 and enter the galvanometer mirror 150.
- the galvanometer mirror 150 is swung around a rotation axis intersecting with the optical axis of each laser beam incident thereon.
- the start timing and rotation speed of the galvanometer mirror 150 are controlled based on the vertical synchronization signal supplied from the signal processing circuit 80.
- the combined light of the display light and the infrared light is two-dimensionally scanned, and the combined light thus scanned is the relay optical system 160. After that, the light enters the observer's eye 10.
- the relay optical system 160 includes an optical element 162 and an optical element 164 on the upstream side and downstream side of the optical path, respectively. Each optical element 162, 164 is typically configured as a lens.
- the display light and the infrared light are combined and collected by the coupling optical system 70, and then the wavefront modulation optical system 22, the scanning device 24, the relay optical system 160, Enter the observer's eye 10 in that order. At that time, the display light and the infrared light pass through the same optical path between the coupling optical system 70 and the eye 10.
- infrared light is injected into the eye 10 in order to detect the pupil position, but an optical path through which the infrared light exits from the light source unit 20 and enters the eye 10. Is the same as the display light, so that the number of parts that need to be added and changed from the standard configuration of this RSD to detect the pupil position is as small as possible. is there.
- this RSD includes the pupil detection unit 30.
- the pupil detection unit 30 reflects the reflected light from the infrared half mirror 170 disposed between the two optical elements 162 and 164 and the infrared half mirror 170.
- the light incident on the photodiode 174 is reflected light on the surface of the eye 10 out of the infrared light incident on the eye 10 and returns to the incident side (an example of the “reflected light flux”). ).
- the return light detection signal output from the photodiode 174 in accordance with the intensity of the return light is a time-series signal that represents a change over time in the intensity of the return light.
- the IR laser 46 is in red during the image display during the period excluding the scanning blanking period (the period excluding the horizontal scanning blanking period and the vertical scanning blanking period). Emits external light. Therefore, in this embodiment, the infrared light is V on the surface of the eye 10 and a plurality of effective horizontal scanning lines (a plurality of horizontal scanning lines that are visible to an observer if visible light is used). ) Is scanned only along. As a result, the return light detection signal output from the photodiode 174 is acquired on a time scale common to each of the plurality of effective horizontal scanning lines in association with each other.
- the effective horizontal scanning line is compared with the erased horizontal scanning return line, the scanning speed is different from each other, and the pupil position is determined based on the return light detection signal despite the presence of such a difference in scanning speed. If detected, a detection error due to the difference in time scale is caused.
- the infrared light half mirror 170 described above allows display light and infrared light incident together from the upstream side thereof to pass toward the downstream side, while passing on the surface of the eye 10.
- the infrared light that is reflected and incident as the infrared scattered light from the downstream side of the infrared light half mirror 170 is reflected toward the lens 172.
- the pupil detection unit 30 further determines the position of the pupil 12 using the intensity of infrared light reflected from the eye 10 of the observer based on the return light detection signal output from the photodiode 174.
- a pupil position determining circuit 180 is provided. The function of the pupil position determination circuit 180 will be described in detail later.
- the optical element 162 is a first-stage lens
- the optical element 164 is a final-stage lens.
- the final lens 164 has wavelength dispersion (a property in which the refractive index and refractive power depend on the wavelength of incident light), and the refractive index and refractive power is selectively reduced at long wavelengths, that is, infrared wavelengths.
- An optical element made of a glass material.
- the final lens 164 is designed so that the display light converges at the position of the pupil 12 (lens), while the infrared light is slightly behind the position of the pupil 12 (lens) (side closer to the retina). ) To converge. Thereby, on the surface of the eye 10, the infrared light is scanned in a wider area than the display light. Below is this Further details will be described.
- the light beam is scattered by the vertical scanning system 132 with the maximum scanning angle as the deflection angle.
- the scanning light beam scanned by the vertical scanning system 132 that is, the beam emitted from the vertical scanning system 132 at each moment
- the first lens 162 the last lens 164 and pupil 12 travel along a straight line and enter 14 retinas.
- the scanning light beam since the scanning light beam has a cross-sectional area, it is converged by the first stage lens 162 to form an image, and then restored to a parallel light beam by the last stage lens 164.
- the parallel light beam passes through the pupil 12 and forms an image on the retina 14.
- the scanning light beam by the vertical scanning system 132 (that is, the beam emitted from the vertical scanning system 132 at each moment) has the maximum scanning angle, is the scanning light beam a display light or an infrared light? Regardless of whether or not, the light travels along the same optical path bent at each of the lenses 162 and 164 and enters the eye 10.
- the center of the scanning light beam is ideal. , It passes through the center of the pupil 12 (the center of the lens) and reaches the retina 14.
- the center of the luminous flux of the scanning display light (visible scanning light) emitted from the vertical scanning system 132 is ideally It converges at the position P of the pupil 12.
- the center of the light beam of the scanning infrared light (invisible scanning light) emitted from the vertical scanning system 132 ie, the invisible scanning light
- the trajectory drawn so that the deflected beam has a deflection angle during vertical scanning converges at a position Q behind the position of the pupil 12.
- the scanned infrared light is irradiated on the surface of the eye 10 in a wide area including the pupil 12 and the iris 182.
- the wavelength of the final stage lens 164 is displayed even though the display light and the infrared light pass through a common optical path between the light source unit 20 and the eye 10 of the observer. Due to the selectivity, the infrared light is within a two-dimensional scanning region set on the surface of the eye 10 so as to include the pupil 12 and the iris 182 without adversely affecting the position where the display light converges inside the eye 10. Then, it is scanned. [0104] As described above, this RSD further includes a follower 32.
- the follower 32 includes a variable prism 190 that is an example of an optical axis changer, an actuator 192 that changes the shape of the variable prism 190, and a drive circuit 194 that drives the actuator 192.
- the drive circuit 194 is connected to the pupil position determination circuit 180 in the pupil detection unit 30 described above.
- the follower 32 uses the variable prism 190, the actuator 192, and the drive circuit 194, and refers to the signal from the pupil position determination circuit 180, thereby changing the optical axis of the display light.
- the optical axis is made to follow the actual position of the pupil 12 by changing two-dimensionally in the scanning direction and the sub-scanning direction.
- variable prism 190 is disposed between the two lenses 162 and 164 at the imaging position of the light emitted from the first lens 162.
- the variable prism 190 being disposed at the image forming position, even if the light from the first stage lens 162 passes through the variable prism 190, the wavefront curvature of the light does not change.
- the variable prism 190 includes two plate glasses 200 and 200 that face each other in the thickness direction with a gap therebetween.
- the glass plates 200 and 200 are joined at their peripheral edges by a flexible bellows 202 (for example, a bellows made of synthetic resin in the form of a film), thereby forming a sealed space between the glass plates 200 and 200.
- a flexible bellows 202 for example, a bellows made of synthetic resin in the form of a film
- the sealed space is filled with a high refractive index liquid 204.
- FIG. 4 shows an example in which the optical axis of the display light is changed following the position of the pupil 12 when the pupil 12 is oriented slightly upward from the frontal viewing direction. It is shown.
- display light passes through the pupil 12 and forms an image on the retina 14 regardless of the actual position of the pupil 12.
- the pupil position determination circuit 180 is configured to change the intensity of the return light according to the position on each scanning line and the change according to the position of each scanning line. Based on this, the position of the pupil 12 is detected two-dimensionally. Meanwhile, the position of the pupil 12 is determined based on the intensity of the return light, and the intensity of the return light changes based on the position of the pupil 12 and the infrared light. Since the optical axis of the infrared light is the same as the optical axis of the display light, if the optical axis of the display light is changed, the optical axis of the infrared light is also changed accordingly. Therefore, the position of the pupil 12 is eventually determined relative to the two-dimensional position of the optical axis immediately before the change.
- pupil 12 is a round hole in the center of iris 182 that expands and contracts in an annular fashion.
- the iris 182 plays a role of increasing or decreasing the diameter of the pupil 12 by contracting and expanding in accordance with the amount of light incident on the eye 10.
- This iris 182 has the property of reflecting incident light thereon with a higher reflectivity than the pupil 12.
- Observer Power With this RSD, infrared light is scanned along each scan line on the surface of the eye 10 of the observer. As described above, the scanning region is set so as to have a larger area including the pupil 12, and thus each scanning line passes through the pupil 12 and the iris 182 located around the pupil 12. Can do. As is clear from the above description, infrared light is strongly reflected by the iris 182, but hardly reflected by the pupil 12!
- the return light detection signal output from the photodiode 174 exhibits a relatively flat waveform, and the intensity (eg, voltage) of the return light detection signal is distributed over the entire area of the scanning line. That's a low level.
- the infrared light is scanned along a scanning line that passes through the iris 182 but does not pass through the pupil 12
- the return light power of the surface force of the eye 10 The area passing through the iris 182 is strong, while the other areas are weak. Therefore, in this case, the intensity of the return light detection signal output from the photodiode 174 has a high level portion only in the region of the scanning line that passes through the iris 182. That is, in this case, the return light detection signal corresponding to one scanning line has a signal waveform having only one high-level portion and a unimodal peak.
- the infrared light is scanned along a scanning line that passes through both the pupil 12 and the iris 182, the return light force of the surface force of the eye 10 out of the scanning line, the iris 182
- the region passing through the pupil is strong, while the region passing through the pupil 12 is weak. Therefore, in this case, the strength of the return light detection signal output from the photodiode 174 has a low level portion only in two discrete regions of the scanning line. That is, in this case, a signal waveform having two high-level portions of the return light detection signal power corresponding to one scanning line and having a bimodal peak is shown.
- a scanning line in which the corresponding return light detection signal has two high-level portions has one low-level portion between the high-level portions.
- the position of the signal reflects the position of the pupil 12 in the main scanning direction, that is, in the horizontal direction.
- the return light detection signal corresponding to one of the plurality of scanning lines that passes through or is sufficiently close to one diameter of the pupil 12 has the longest low level portion.
- the position in the sub-scanning direction, that is, the vertical direction can be determined. Therefore, among the plurality of scanning lines, the number of the scanning line having the longest mouth level portion corresponding to the return light detection signal reflects the position of the pupil 12 in the sub-scanning direction, that is, the vertical direction.
- the pupil position determination circuit 180 receives the time-series signal from the photodiode 174 in association with the scanning line number n, and based on this signal, this pupil position is determined. The determination circuit 180 determines the position of the pupil 12 two-dimensionally based on this RSD.
- the pupil position determination circuit 180 compares the position of the pupil 12 acquired when the pupil 12 is facing the front and the position of the pupil 12 acquired when the pupil 12 is not facing the front. It can be designed to determine the direction of the line of sight during non-frontal viewing.
- this pupil position determination circuit 180 also has an optical axis tracking function that causes the optical axis of display light to track the pupil position.
- this pupil position determination circuit 180 includes a computer having a CPU, a ROM, and a RAM (not shown), and an optical axis tracking control program stored in the ROM is executed by the CPU. Is done.
- FIG. 5 conceptually shows a flowchart of the contents of the optical axis tracking control program.
- This optical axis tracking control program is repeatedly executed by the computer. At the time of each execution, first, in step S1 (hereinafter simply expressed as “S1”, the same applies to other steps), first, whether or not vertical scanning has started for the current image frame, that is, It is determined whether or not the force at which the horizontal scanning is started for the first scanning line in the current image frame. If the current vertical scanning has not yet started, the determination is NO, and one execution of this optical axis tracking control program is immediately terminated. On the other hand, when the vertical scanning is started for the current image frame, the determination is YES, and the process proceeds to S2.
- step S1 hereinafter simply expressed as “S1”, the same applies to other steps
- the scanning line number n is set to “1”. Thereafter, in S3, it is taken in from the return light detection signal power photodiode 174, which is a time series signal, in association with the current scanning line number n.
- the scan line is indicated by the scan line number “n-2” in FIG.
- the return light detection signal has one high-level portion as indicated by the scanning line number “n ⁇ 2” in FIG.
- the scan line passes through both the pupil 12 and the iris 182 as indicated by the scan line number "n” in FIG. In this state, the return light detection signal has two high-level portions as indicated by the scanning line number “n” in FIG.
- each of the two high-level parts is shown in Fig. 8 (a).
- the center time tml of the time width of the first high level section and the center time tm2 of the last high level section are measured.
- the separation time td between the two high-level parts is obtained as the difference between the central times tml and tm2.
- the value of the separation time td is stored in the RAM in association with the scanning line number n at that time.
- Fig. 8 (a) if the half time of the separation time td between the two high-level parts is added to the center time tml of the first one of the two high-level parts, they 2 The elapsed time from the start time of the corresponding return light detection signal at the intermediate time between the high-level parts is obtained.
- the elapsed time tc reflects the distance LHc from the horizontal scanning start point of the scanning line corresponding to the corresponding return light detection signal at the pupil center C, as shown in FIG.
- the number np of the plurality of scanning lines having the maximum value tdmax among the plurality of interval times td respectively acquired for them is indicated by the pupil center C as shown in Fig. 8 (b).
- the distance LVc from the vertical scanning start point of the current image frame is reflected.
- FIG. 9 is a graph showing the relationship between scan line number n, elapsed time tc, and separation time td. Is shown. As the scanning line number n increases, the separation time td tends to be convex upward, while the elapsed time tc is almost stable. The separation time td changes so as to have the maximum value tdmax, and the number n of the plurality of scanning lines corresponding to the maximum value tdmax is the number np. If this number np is known, the vertical position of the pupil center C is known.
- the maximum value of the plurality of interval times td stored in the RAM in S9 is the maximum value tdmax. Is done.
- the elapsed time tc is obtained as the sum of the half value of the maximum value tdmax and the central time tml.
- the obtained elapsed time tc reflects the horizontal position of the pupil center C.
- the scanning line number n associated with the maximum value tdmax is set as the scanning line number np.
- the scan line number np reflects the vertical position of the pupil center C.
- the shape of the variable prism 190 is changed so that the optical axis of the display light follows the pupil center C based on the elapsed time tc and the scanning line number np acquired in S12 and S13.
- the control amount of the actuator 192 necessary for making it to be determined is determined. This control amount is a control amount that is required to be realized by the actuator 192 in order to change the current position of the optical axis of the display light so as to coincide with the pupil center C.
- a signal necessary for realizing the determined control amount is supplied to the actuator 192 via the drive circuit 194.
- the IR laser 46, the scanning device 24, the infrared light half mirror 170, the lens 230, the photodiode 174, and the pupil position determination circuit. 180 cooperates with each other to form an example of “pupil detection device” according to the above item (1), and RSD forms an example of “image display device” according to the above item (8).
- the IR laser 46 constitutes an example of the “emitter” in the above item (1) and the “emitter for detection” in the aforementioned item (8), and the R laser 40,
- Each of the G laser 42 and the B laser 44 constitutes one example of the “display emission part” in the above item (8).
- infrared light constitutes an example of “invisible light beam” in the items (1) and (8)
- the display light is “visible light beam” in the item (8).
- the coupling optical system 70 constitutes an example of the “combining part” in the item (8).
- the scanning device 24 constitutes an example of the “scanning unit” in the above (1) and (8), and the relay optical system 160 is in the above (8).
- the “induction part” is constituted, and in particular, the photodiode 174 constitutes an example of the “detection part” in the items (1) and (8).
- variable prism 190 particularly constitutes an example of the "deflector” in the item (14), and the pupil position determination circuit 180 having the computer includes the " “Processing unit” and “control unit” in the above section (8) are configured as examples, and final lens 164 is configured as an example of “convergence position setting unit” in each of (10) and (13). It is doing.
- the portion of the computer that executes S1 to S12 in FIG. 5 in the optical axis tracking control program is the “main scanning direction position detecting means” in the section (6).
- the part that executes S 1 to SI 1 and S 13 in FIG. 5 of the optical axis tracking control program constitutes an example of the “sub-scanning direction position detecting means” in the above (7). That's it.
- variable prism 190 is employed as an example of the “deflector” in the above (14) in this embodiment, but a variable diffraction element may be employed instead. Is possible.
- An example of the variable diffraction element is an acousto-optic deflection element AOD. When this acousto-optic deflection element AOD is adopted, its installation position is the same as that of the variable prism 190.
- the combined light of the display light and the detection light has a circular light beam cross section as usual, so that a two-dimensional image is drawn.
- the combined light beam is scanned two-dimensionally.
- the combined light (at least the display light) of the display light and the detection light has a major axis extending in the vertical direction and a minor axis extending in the horizontal direction.
- the present embodiment is changed to have a light beam cross section that forms a vertically long ellipse.
- the minor axis of the ellipse substantially coincides with the diameter of the circle described above, but the major axis of the ellipse is longer than the diameter of the pupil 12 when irradiated on the surface of the eye 10.
- a cylindrical lens is inserted at a position where the light beam travels substantially in parallel before entering the horizontal scanning system 130, or horizontal scanning is performed. It is possible to insert a toroidal lens between the system 130 and the vertical scanning system 132 at a position where the light beams travel substantially in parallel.
- the scanning device 24 is modified from the present embodiment so as to scan the combined light beam one-dimensionally in the horizontal direction.
- the pupil detection unit 30 is similarly changed to detect the actual position of the pupil 12 in a one-dimensional manner in the horizontal direction
- the tracking unit 32 similarly changes the optical axis of the combined light in the horizontal direction. Is changed to change one-dimensionally.
- the pupil detection unit 30 and the tracking unit 32 that have been changed together constitute an example of the “control unit” in the above item (20), and the horizontal direction is It is an example of “one direction”, and an ellipse is an example of “flat shape” in the same term.
- the wavefront curvature of the display light is modulated in order to draw an image, whereby the depth of the display image can be changed. Is not essential for practicing the present invention.
- the position of the display light incident on the eye 10 is controlled to coincide with the pupil 12 by changing the direction of the optical axis of the display light by the variable prism 190.
- the display light is changed by changing the tilt angle of the movable mirror 220 that is tilted around two axes perpendicular to the optical axis of the display light.
- the direction of the optical axis is changed.
- An example of the movable mirror 220 is a two-dimensional Lubano mirror.
- the first-stage lens 222 and the last-stage lens 224 are arranged so that their optical axes are orthogonal to each other.
- a half mirror 226 is disposed at a position where the two optical axes of the lenses 222 and 224 are orthogonal to each other.
- the noise mirror 226 reflects the light incident from the first stage lens 222 in a direction away from the final stage lens 224 force.
- the reflected light enters the movable mirror 220.
- the center position of the movable mirror 220 coincides with the imaging position of the light incident from the half mirror 226. Light incident on the movable mirror 220 is reflected by the movable mirror 220 and returns to the half mirror 226, and then passes straight through the half mirror 226 and enters the final lens 224.
- movable mirror 220 If movable mirror 220 is tilted around two orthogonal axes that pass through its center position, the reflected light from movable mirror 220 is deflected, and as a result, the optical axis of the display light is changed.
- a lens 230 that is an optical element for condensing infrared light reflected on the surface of the eye 10 and
- the photodiode 232 and the force half mirror 226 are installed on the opposite side of the first stage lens 222.
- the half mirror 226 reflects the reflected light from the surface of the eye 10 toward the lens 230.
- one half mirror 226 has a function of guiding display light and infrared light from the scanning device 24 to the movable mirror 220 as an optical axis changer, and from the surface of the eye 10. It also has the function of guiding the reflected light to the photodiode 232.
- the photodiode 232 supplies the pupil position determination circuit 240 with a signal corresponding to the intensity of the return light that is incident light on the photodiode 232.
- the pupil position determination circuit 240 controls the direction of the movable mirror 220 around two axes via the drive circuit 242 and the actuator 244 based on the supplied signal, as in the first embodiment. With this control, the optical axis of the display light follows the actual position of the pupil 12.
- the movable mirror 220 constitutes an example of the “deflector” in the above (16) and the “oscillating mirror” in the above (17). ing.
- the movable mirror 220 constitutes an example of the “deflector” in the above (16) and the “oscillating mirror” in the above (17). ing.
- the movable mirror 220 constitutes an example of the “deflector” in the above (16) and the “oscillating mirror” in the above (17). ing.
- the direction of the optical axis of the display light is changed by the variable prism 190, thereby changing the position where the display light is irradiated to the eye 10.
- the optical axis of the display light is translated by translating the movable mirror inclined with respect to the optical axis of the display light in a direction perpendicular to the optical axis. The position where the display light is irradiated to the eye 10 is changed.
- the first and fourth mirrors 250a, 250b, 250c, and 250d force W are also tilted 45 degrees with respect to the optical axis of the display light.
- the optical axis of the display light and the infrared light is bent 90 degrees each time they enter the mirrors 250a, 250b, 250c, and 250d.
- the first mirror 250a on which light is first incident from the vertical scanning system 132 enters the fixed force 2 and the mirror 4b 250b, 250c, 250di3 ⁇ 4, and the deviation is It can be translated in a direction perpendicular to the vertical direction (for example, vertical direction or horizontal direction).
- the last incident fourth mirror 250d the mirror immediately before the relay optical system 160
- the position at which the display light is applied to the observer's eye 10 is changed.
- the optical path length of the display light between the vertical scanning system 132 and the first stage lens 162 changes.
- the second and third mirrors are aligned in the same direction as the fourth mirror 250d.
- the mirror 250d is translated by a movement amount Y1 equal to half of the translation amount Y2 of the mirror 250d.
- the position at which the display light is applied to the eye 10 of the observer is changed by changing the optical path length of the display light by the parallel movement of the second to fourth mirrors 250d. It is possible to change.
- the fourth mirror 250d is provided in front. This constitutes an example of the “translator” in section (18) and the “movable mirror” in section (19).
Landscapes
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Heart & Thoracic Surgery (AREA)
- Surgery (AREA)
- Ophthalmology & Optometry (AREA)
- Biomedical Technology (AREA)
- Human Computer Interaction (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Biophysics (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Eye Examination Apparatus (AREA)
Abstract
Description
Claims
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/705,471 US7637615B2 (en) | 2004-08-19 | 2007-02-13 | Device for tracking pupil of eyeball using intensity changes of reflected light from eyeball and image display using the same |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2004-238994 | 2004-08-19 | ||
JP2004238994A JP4608996B2 (ja) | 2004-08-19 | 2004-08-19 | 瞳孔検出装置およびそれを備えた画像表示装置 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/705,471 Continuation-In-Part US7637615B2 (en) | 2004-08-19 | 2007-02-13 | Device for tracking pupil of eyeball using intensity changes of reflected light from eyeball and image display using the same |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2006019028A1 true WO2006019028A1 (ja) | 2006-02-23 |
Family
ID=35907416
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2005/014719 WO2006019028A1 (ja) | 2004-08-19 | 2005-08-11 | 瞳孔検出装置およびそれを備えた画像表示装置 |
Country Status (3)
Country | Link |
---|---|
US (1) | US7637615B2 (ja) |
JP (1) | JP4608996B2 (ja) |
WO (1) | WO2006019028A1 (ja) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2017515161A (ja) * | 2014-03-03 | 2017-06-08 | アイウェイ ビジョン エルティーディー. | 目用投影システム |
WO2017110370A1 (ja) * | 2015-12-22 | 2017-06-29 | 株式会社Qdレーザ | 画像投影装置 |
WO2019052498A1 (zh) * | 2017-09-18 | 2019-03-21 | 成都理想境界科技有限公司 | 光纤扫描成像***、设备及其畸变检测与矫正*** |
EP3660576A1 (en) * | 2018-11-29 | 2020-06-03 | Ricoh Company, Ltd. | Optical device, retinal projection display, head-mounted display, and input device |
US11054639B2 (en) | 2014-03-03 | 2021-07-06 | Eyeway Vision Ltd. | Eye projection system |
CN114077061A (zh) * | 2020-08-19 | 2022-02-22 | 宏达国际电子股份有限公司 | 头戴式显示设备以及眼球追踪装置 |
Families Citing this family (52)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4747635B2 (ja) * | 2005-03-30 | 2011-08-17 | ブラザー工業株式会社 | 画像表示装置 |
JP2008046253A (ja) * | 2006-08-11 | 2008-02-28 | Canon Inc | 画像表示装置 |
JP4829765B2 (ja) * | 2006-12-08 | 2011-12-07 | キヤノン株式会社 | 画像表示装置及び画像表示システム |
CN101589327B (zh) | 2007-09-26 | 2012-09-26 | 松下电器产业株式会社 | 光束扫描式显示装置、显示方法以及集成电路 |
JP4720844B2 (ja) * | 2008-03-31 | 2011-07-13 | ブラザー工業株式会社 | 画像表示装置 |
JP4582179B2 (ja) * | 2008-03-31 | 2010-11-17 | ブラザー工業株式会社 | 画像表示装置 |
JP5649324B2 (ja) * | 2010-04-15 | 2015-01-07 | キヤノン株式会社 | 眼科装置及び眼科装置の制御方法 |
CN202152072U (zh) * | 2010-12-02 | 2012-02-29 | 顾曙红 | 变形皮卡吉普车 |
EP2581034B1 (en) * | 2011-10-11 | 2016-02-17 | Tobii AB | Eye-tracker illumination |
WO2013076350A1 (en) * | 2011-11-23 | 2013-05-30 | Nokia Corporation | Optical image stabilization |
JP5919885B2 (ja) * | 2012-02-28 | 2016-05-18 | セイコーエプソン株式会社 | 虚像表示装置 |
US9612656B2 (en) | 2012-11-27 | 2017-04-04 | Facebook, Inc. | Systems and methods of eye tracking control on mobile device |
US9699433B2 (en) * | 2013-01-24 | 2017-07-04 | Yuchen Zhou | Method and apparatus to produce re-focusable vision with detecting re-focusing event from human eye |
JP6111864B2 (ja) * | 2013-05-24 | 2017-04-12 | 富士通株式会社 | 画像表示装置及び画像表示方法 |
CN106062665B (zh) | 2013-09-11 | 2019-05-17 | 深圳市汇顶科技股份有限公司 | 基于用户的眼睛运动和位置的光学感测和跟踪的用户界面 |
KR101847756B1 (ko) | 2013-11-09 | 2018-04-10 | 선전 구딕스 테크놀로지 컴퍼니, 리미티드 | 광학 눈 추적 |
WO2015081325A1 (en) | 2013-11-27 | 2015-06-04 | Shenzhen Huiding Technology Co., Ltd. | Eye tracking and user reaction detection |
EP3086703B1 (en) * | 2013-12-27 | 2021-03-10 | University Of Washington Through Its Center For Commercialization | Adaptive control of a fiber scanner with piezoelectric sensing |
KR20160025316A (ko) | 2014-08-27 | 2016-03-08 | 현대자동차주식회사 | 동공 검출 시스템 및 그 방법 |
US10213105B2 (en) | 2014-12-11 | 2019-02-26 | AdHawk Microsystems | Eye-tracking system and method therefor |
US10317672B2 (en) * | 2014-12-11 | 2019-06-11 | AdHawk Microsystems | Eye-tracking system and method therefor |
US9633626B2 (en) * | 2015-03-12 | 2017-04-25 | Visteon Global Technologies, Inc. | Adjusting an electronic display based on gaze tracking |
WO2016208266A1 (ja) * | 2015-06-25 | 2016-12-29 | 株式会社Qdレーザ | 画像投影装置 |
JP6231541B2 (ja) | 2015-06-25 | 2017-11-15 | 株式会社Qdレーザ | 画像投影装置 |
US10338451B2 (en) | 2015-08-03 | 2019-07-02 | Facebook Technologies, Llc | Devices and methods for removing zeroth order leakage in beam steering devices |
US9989765B2 (en) | 2015-08-03 | 2018-06-05 | Oculus Vr, Llc | Tile array for near-ocular display |
US10552676B2 (en) | 2015-08-03 | 2020-02-04 | Facebook Technologies, Llc | Methods and devices for eye tracking based on depth sensing |
US10459305B2 (en) | 2015-08-03 | 2019-10-29 | Facebook Technologies, Llc | Time-domain adjustment of phase retardation in a liquid crystal grating for a color display |
IL241033B (en) * | 2015-09-02 | 2021-12-01 | Eyeway Vision Ltd | Projector system and method for ocular projection |
US9904051B2 (en) | 2015-10-23 | 2018-02-27 | Thalmic Labs Inc. | Systems, devices, and methods for laser eye tracking |
US10416454B2 (en) | 2015-10-25 | 2019-09-17 | Facebook Technologies, Llc | Combination prism array for focusing light |
US10247858B2 (en) | 2015-10-25 | 2019-04-02 | Facebook Technologies, Llc | Liquid crystal half-wave plate lens |
US10203566B2 (en) | 2015-12-21 | 2019-02-12 | Facebook Technologies, Llc | Enhanced spatial resolution using a segmented electrode array |
JP6231585B2 (ja) * | 2016-01-05 | 2017-11-15 | 株式会社Qdレーザ | 画像投影装置 |
US10303246B2 (en) * | 2016-01-20 | 2019-05-28 | North Inc. | Systems, devices, and methods for proximity-based eye tracking |
US10459220B2 (en) * | 2016-11-30 | 2019-10-29 | North Inc. | Systems, devices, and methods for laser eye tracking in wearable heads-up displays |
US10761602B1 (en) | 2017-03-14 | 2020-09-01 | Facebook Technologies, Llc | Full field retinal imaging system for characterization of eye trackers |
TWI746805B (zh) * | 2017-04-04 | 2021-11-21 | 國立大學法人福井大學 | 映像生成裝置及映像生成方法 |
US11617509B2 (en) * | 2017-08-14 | 2023-04-04 | Optos Plc | Ophthalmic device |
CN107515466B (zh) * | 2017-08-14 | 2019-11-26 | 华为技术有限公司 | 一种眼球追踪***和眼球追踪方法 |
JP6993722B2 (ja) * | 2017-10-05 | 2022-01-14 | 株式会社Qdレーザ | 視覚検査装置 |
JP6966075B2 (ja) * | 2018-02-13 | 2021-11-10 | 国立大学法人福井大学 | 画像投影装置 |
JP7302592B2 (ja) * | 2018-03-26 | 2023-07-04 | ソニーグループ株式会社 | 情報検出装置、映像投影装置、情報検出方法、及び映像投影方法 |
JP2019215305A (ja) | 2018-06-14 | 2019-12-19 | ソニー株式会社 | 眼球検出装置、および画像表示装置 |
CN114365026A (zh) * | 2019-07-01 | 2022-04-15 | Pcms控股公司 | 用于基于光束转向对3d显示器进行连续校准的方法和*** |
FR3106740A1 (fr) * | 2020-02-03 | 2021-08-06 | Imagine Eyes | Procédés et systèmes de contrôle de l’alignement de l’œil dans un appareil d’imagerie ophtalmologique |
DE102020206451A1 (de) | 2020-05-25 | 2021-11-25 | Robert Bosch Gesellschaft mit beschränkter Haftung | Optische Anordnung einer Datenbrille |
DE102020206822A1 (de) | 2020-06-02 | 2021-12-02 | Robert Bosch Gesellschaft mit beschränkter Haftung | Verfahren zum Betreiben einer Datenbrille |
DE102020127594A1 (de) | 2020-10-20 | 2022-04-21 | Robert Bosch Gesellschaft mit beschränkter Haftung | Optische anordnung einer datenbrille |
WO2022140671A1 (en) * | 2020-12-23 | 2022-06-30 | Eyetech Digital Systems, Inc. | Systems and methods for acquiring and analyzing high-speed eye movement data |
DE102022101727A1 (de) | 2022-01-25 | 2023-07-27 | OSRAM Opto Semiconductors Gesellschaft mit beschränkter Haftung | Optische baugruppe zur detektion einer vom auge reflektierten strahlung eines retinaprojektors |
KR102631122B1 (ko) * | 2022-12-28 | 2024-01-30 | 한국전자기술연구원 | 홀로그래픽 근안 디스플레이의 지연 시간을 줄이기 위한 방법 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH08502372A (ja) * | 1992-10-22 | 1996-03-12 | ボード オブ リージェンツ オブ ザ ユニバーシティ オブ ワシントン | 仮想網膜表示装置 |
JPH08205052A (ja) * | 1995-01-23 | 1996-08-09 | Kinseki Ltd | 網膜直接表示装置及びそれを用いたテレビジョン受信機 |
JPH08206079A (ja) * | 1995-01-31 | 1996-08-13 | Canon Inc | 眼科装置 |
JP2004191962A (ja) * | 2002-11-29 | 2004-07-08 | Brother Ind Ltd | 画像表示装置 |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6008781A (en) | 1992-10-22 | 1999-12-28 | Board Of Regents Of The University Of Washington | Virtual retinal display |
US5596339A (en) | 1992-10-22 | 1997-01-21 | University Of Washington | Virtual retinal display with fiber optic point source |
US7374287B2 (en) * | 1999-11-01 | 2008-05-20 | Jozef F. Van de Velde | Relaxed confocal catadioptric scanning laser ophthalmoscope |
US6967781B2 (en) | 2002-11-29 | 2005-11-22 | Brother Kogyo Kabushiki Kaisha | Image display apparatus for displaying image in variable direction relative to viewer |
-
2004
- 2004-08-19 JP JP2004238994A patent/JP4608996B2/ja not_active Expired - Fee Related
-
2005
- 2005-08-11 WO PCT/JP2005/014719 patent/WO2006019028A1/ja active Application Filing
-
2007
- 2007-02-13 US US11/705,471 patent/US7637615B2/en not_active Expired - Fee Related
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH08502372A (ja) * | 1992-10-22 | 1996-03-12 | ボード オブ リージェンツ オブ ザ ユニバーシティ オブ ワシントン | 仮想網膜表示装置 |
JPH08205052A (ja) * | 1995-01-23 | 1996-08-09 | Kinseki Ltd | 網膜直接表示装置及びそれを用いたテレビジョン受信機 |
JPH08206079A (ja) * | 1995-01-31 | 1996-08-13 | Canon Inc | 眼科装置 |
JP2004191962A (ja) * | 2002-11-29 | 2004-07-08 | Brother Ind Ltd | 画像表示装置 |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2017515161A (ja) * | 2014-03-03 | 2017-06-08 | アイウェイ ビジョン エルティーディー. | 目用投影システム |
US10042161B2 (en) | 2014-03-03 | 2018-08-07 | Eyeway Vision Ltd. | Eye projection system |
US10539789B2 (en) | 2014-03-03 | 2020-01-21 | Eyeway Vision Ltd. | Eye projection system |
US11054639B2 (en) | 2014-03-03 | 2021-07-06 | Eyeway Vision Ltd. | Eye projection system |
WO2017110370A1 (ja) * | 2015-12-22 | 2017-06-29 | 株式会社Qdレーザ | 画像投影装置 |
JP2017116669A (ja) * | 2015-12-22 | 2017-06-29 | 株式会社Qdレーザ | 画像投影装置 |
US10634904B2 (en) | 2015-12-22 | 2020-04-28 | Qd Laser, Inc. | Image projection device |
WO2019052498A1 (zh) * | 2017-09-18 | 2019-03-21 | 成都理想境界科技有限公司 | 光纤扫描成像***、设备及其畸变检测与矫正*** |
EP3660576A1 (en) * | 2018-11-29 | 2020-06-03 | Ricoh Company, Ltd. | Optical device, retinal projection display, head-mounted display, and input device |
US11334153B2 (en) | 2018-11-29 | 2022-05-17 | Ricoh Company, Ltd. | Optical device, retinal projection display, head-mounted display, and input device |
CN114077061A (zh) * | 2020-08-19 | 2022-02-22 | 宏达国际电子股份有限公司 | 头戴式显示设备以及眼球追踪装置 |
Also Published As
Publication number | Publication date |
---|---|
US20070159599A1 (en) | 2007-07-12 |
US7637615B2 (en) | 2009-12-29 |
JP2006058505A (ja) | 2006-03-02 |
JP4608996B2 (ja) | 2011-01-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP4608996B2 (ja) | 瞳孔検出装置およびそれを備えた画像表示装置 | |
JP4829765B2 (ja) | 画像表示装置及び画像表示システム | |
JP4582179B2 (ja) | 画像表示装置 | |
JP5316346B2 (ja) | 網膜走査型画像表示装置 | |
JP5925389B2 (ja) | 画像投影装置 | |
JP2008176096A (ja) | 画像表示装置 | |
WO2004049037A1 (ja) | 画像表示装置 | |
JP2011075957A (ja) | 画像表示装置 | |
JP2010091944A (ja) | 画像表示装置及び画像表示システム | |
US11187899B2 (en) | Light source device, optical scanner, display system, and mobile object | |
JP5163166B2 (ja) | 画像表示装置 | |
JP2005107038A (ja) | 網膜走査表示装置 | |
JP3373482B2 (ja) | 網膜ディスプレー装置 | |
JP6569318B2 (ja) | 光走査装置 | |
JP4453296B2 (ja) | 画像表示装置 | |
JP4423936B2 (ja) | 画像表示装置 | |
WO2019163656A1 (ja) | レーザー光出力制御装置およびレーザー走査型表示装置 | |
JP3105662B2 (ja) | 網膜ディスプレー装置 | |
JP6668711B2 (ja) | 光源装置、画像表示装置及び物体装置 | |
JP4380258B2 (ja) | 画像表示装置 | |
JP2020154111A (ja) | 光走査装置、表示システム、および移動体 | |
JP2016053680A (ja) | 画像表示再生装置および射出瞳拡大方法 | |
JP2020122858A (ja) | 光走査装置、表示システムおよび移動体 | |
WO2013145153A1 (ja) | 画像描画装置 | |
JP3248697B2 (ja) | 網膜ディスプレー装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS KE KG KM KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU LV MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 11705471 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWP | Wipo information: published in national office |
Ref document number: 11705471 Country of ref document: US |
|
122 | Ep: pct application non-entry in european phase |