TWI634869B - Image display device with pupil tracking function and pupil tracking device thereof - Google Patents
Image display device with pupil tracking function and pupil tracking device thereof Download PDFInfo
- Publication number
- TWI634869B TWI634869B TW106109958A TW106109958A TWI634869B TW I634869 B TWI634869 B TW I634869B TW 106109958 A TW106109958 A TW 106109958A TW 106109958 A TW106109958 A TW 106109958A TW I634869 B TWI634869 B TW I634869B
- Authority
- TW
- Taiwan
- Prior art keywords
- light source
- module
- pupil
- micromirror
- sensing
- Prior art date
Links
Landscapes
- Eye Examination Apparatus (AREA)
Abstract
本發明公開一種具有瞳孔追蹤功能的影像投影裝置及其瞳孔位置追蹤裝置。瞳孔位置追蹤裝置包括一光源模組、一微鏡模組、一光學模組、一感測模組以及一控制模組。控制模組電性連接於微鏡模組與感測模組，且光源模組、微鏡模組、光學模組以及感測模組沿著一預定光學路徑佈置。光源模組所提供的一點光源通過微鏡模組的反射以形成一面光源。面光源通過光學模組的反射以形成投向眼球表面的一偵測光源，且眼球表面具有瞳孔表面以及圍繞瞳孔表面的非瞳孔表面。藉此，偵測光源能通過瞳孔表面的反射以形成投向感測模組的一反射光源，且感測模組能依據反射光源以傳送瞳孔位置訊號至控制模組。 The invention discloses an image projection device with a pupil tracking function and a pupil position tracking device thereof. The pupil position tracking device comprises a light source module, a micro mirror module, an optical module, a sensing module and a control module. The control module is electrically connected to the micromirror module and the sensing module, and the light source module, the micromirror module, the optical module and the sensing module are arranged along a predetermined optical path. The light source provided by the light source module passes through the reflection of the micromirror module to form a light source. The surface light source is reflected by the optical module to form a detection light source that is directed toward the surface of the eyeball, and the surface of the eyeball has a pupil surface and a non-porous surface surrounding the pupil surface. Thereby, the detecting light source can reflect through the surface of the pupil to form a reflecting light source directed to the sensing module, and the sensing module can transmit the pupil position signal to the control module according to the reflected light source.
Description
本發明涉及一種影像投影裝置及其位置追蹤裝置，特別是涉及一種具有瞳孔追蹤功能的影像投影裝置及其瞳孔位置追蹤裝置。 The invention relates to an image projection device and a position tracking device thereof, in particular to an image projection device with a pupil tracking function and a pupil position tracking device thereof.
將虛擬實境及/或擴增虛擬實境應用於使用者的頭戴式或穿戴式影像投影系統的技術是目前的大勢所趨。當使用者使用頭戴式或穿戴式影像投影系統(通常是眼鏡)時，虛擬實境影像或視訊會透過投影裝置投射至使用者的眼睛以呈像。同時，為了達到較佳的虛擬實境體驗感受，會在投影系統中另增設追蹤裝置以追蹤使用者的頭部與眼睛的位置以及移動。 The application of virtual reality and/or augmented virtual reality to a user's head-mounted or wearable image projection system is currently the trend. When a user uses a head-mounted or wearable image projection system (usually glasses), the virtual reality image or video is projected through the projection device to the user's eyes for imagery. At the same time, in order to achieve a better virtual reality experience, a tracking device is added to the projection system to track the position and movement of the user's head and eyes.
現有技術中的虛擬實境裝置中，是透過偵測目前眼睛位置並預測頭部和眼睛的下一個位置來分析並結合影像至下一個位置的使用者聚焦區域，以達成凝視追蹤的效果。然而，使用者各眼所感知的實像(於視網膜的成像)實際上是聚焦在離眼睛固定距離(焦距)的實像或虛像平面。一般來說，人腦的視神經會自主地根據所感知的實像而欲調整眼睛對焦在所感知的元件/物件上，但是在虛擬實境裝置中，眼睛的焦距調整會跟已經固定距離的實像的焦距距離抵觸。如此一來，會使大腦無法成功協調視覺感知系統以及本體感覺，容易產生疲勞以及頭暈。 In the virtual reality device of the prior art, the user's focus area is analyzed and combined with the image to the next position by detecting the current eye position and predicting the next position of the head and the eye to achieve the effect of gaze tracking. However, the real image perceived by each eye of the user (imaging of the retina) is actually a real or virtual image plane that is focused at a fixed distance (focal length) from the eye. In general, the optic nerve of the human brain will autonomously adjust the eye to focus on the perceived component/object according to the perceived real image, but in the virtual reality device, the focal length adjustment of the eye will be compared with the real image with a fixed distance. The focal length is in conflict. As a result, the brain can not successfully coordinate the visual perception system and the proprioception, which is prone to fatigue and dizziness.
故，現有技術虛擬實境裝置中的凝視追蹤系統與虛擬影像投 射仍具有改善空間。 Therefore, the gaze tracking system and the virtual image projection in the prior art virtual reality device The shot still has room for improvement.
本發明所要解決的技術問題在於，針對現有技術的不足提供一種可具有瞳孔追蹤功能的影像投影裝置以及可即時反饋瞳孔位置資訊的瞳孔位置追蹤裝置。 The technical problem to be solved by the present invention is to provide an image projection device capable of having a pupil tracking function and a pupil position tracking device capable of promptly feeding back pupil position information, in view of the deficiencies of the prior art.
為了解決上述的技術問題，本發明所採用的其中一技術方案是，提供一種具有瞳孔追蹤功能的影像投影裝置，其包括：一光源模組、一微鏡模組、一光學模組、一感測模組以及一控制模組，所述控制模組電性連接於所述微鏡模組與所述感測模組，且所述光源模組、所述微鏡模組、所述光學模組以及所述感測模組沿著一預定光學路徑佈置。其中，所述光源模組所提供的一第一點光源通過所述微鏡模組的反射以形成一第一面光源，所述第一面光源通過所述光學模組的反射以形成一投向一眼球表面的偵測光源，且所述眼球表面具有一瞳孔表面以及一圍繞所述瞳孔表面的非瞳孔表面。其中，所述偵測光源通過所述瞳孔表面的反射以形成投向所述感測模組的一第一反射光源，且所述感測模組依據所述第一反射光源以傳送一瞳孔位置訊號至所述控制模組。其中，所述控制模組依據所述瞳孔位置訊號以調整所述微鏡模組，所述光源模組所提供的一第二點光源通過調整後的所述微鏡模組的反射以形成一第二面光源，且所述第二面光源通過所述光學模組的反射以形成一準確地投向所述瞳孔表面的影像光源。 In order to solve the above technical problem, one of the technical solutions adopted by the present invention is to provide an image projection device having a pupil tracking function, comprising: a light source module, a micro mirror module, an optical module, and a sense a test module and a control module, the control module is electrically connected to the micromirror module and the sensing module, and the light source module, the micromirror module, and the optical module The set and the sensing module are arranged along a predetermined optical path. The first point light source provided by the light source module is reflected by the micro mirror module to form a first surface light source, and the first surface light source is reflected by the optical module to form a heading. A detection light source on the surface of the eye, and the surface of the eyeball has a pupil surface and a non-pupil surface surrounding the pupil surface. The detecting light source is reflected by the surface of the pupil to form a first reflective light source that is directed to the sensing module, and the sensing module transmits a pupil position signal according to the first reflective light source. To the control module. The control module adjusts the micromirror module according to the pupil position signal, and a second point light source provided by the light source module passes through the adjusted reflection of the micromirror module to form a a second surface light source, and the second surface light source is reflected by the optical module to form an image light source that is accurately projected onto the pupil surface.
為了解決上述的技術問題，本發明所採用的另外一技術方案是，提供一種瞳孔位置追蹤裝置，其包括：一光源模組、一微鏡模組、一光學模組、一感測模組以及一控制模組，所述控制模組電性連接於所述微鏡模組與所述感測模組，且所述光源模組、所述微鏡模組、所述光學模組以及所述感測模組沿著一預定光學路徑佈置。其中，所述光源模組所提供的一點光源通過所述微鏡模組的反射以形成一面光源，所述面光源通過所述光學模組的反射 以形成一投向一眼球表面的偵測光源，且所述眼球表面具有一瞳孔表面以及一圍繞所述瞳孔表面的非瞳孔表面。其中，所述偵測光源通過所述瞳孔表面的反射以形成投向所述感測模組的一第一反射光源，且所述感測模組依據所述第一反射光源以傳送一瞳孔位置訊號至所述控制模組。 In order to solve the above technical problem, another technical solution adopted by the present invention is to provide a pupil position tracking device, which includes: a light source module, a micro mirror module, an optical module, a sensing module, and a control module, the control module is electrically connected to the micro mirror module and the sensing module, and the light source module, the micro mirror module, the optical module, and the The sensing modules are arranged along a predetermined optical path. The light source provided by the light source module passes through the reflection of the micromirror module to form a light source, and the surface light source reflects through the optical module. To form a detection light source that is directed toward the surface of the eyeball, and the surface of the eyeball has a pupil surface and a non-porous surface surrounding the pupil surface. The detecting light source is reflected by the surface of the pupil to form a first reflective light source that is directed to the sensing module, and the sensing module transmits a pupil position signal according to the first reflective light source. To the control module.
本發明的有益效果在於，本發明技術方案所提供的具有瞳孔追蹤功能的影像投影裝置及其瞳孔位置追蹤裝置，其能通過“所述光源模組所提供的第一點光源通過所述微鏡模組的反射以形成第一面光源，所述第一面光源通過所述光學模組的反射以形成投向一眼球表面的偵測光源”以及“所述偵測光源通過所述瞳孔表面的反射以形成投向所述感測模組的第一反射光源”的技術特徵，以使感測模組依據第一反射光源傳送瞳孔位置訊號至控制模組，並使控制模組依據瞳孔位置訊號以調整微鏡模組，使得第二點光源形成準確地投向所述瞳孔表面的一影像光源。 The image projection device with the pupil tracking function and the pupil position tracking device provided by the technical solution of the present invention can pass the micro-mirror through the first point light source provided by the light source module. Reflecting the module to form a first surface light source, the first surface light source is reflected by the optical module to form a detection light source that is directed toward an eye surface, and "the detection light source reflects through the pupil surface The technical feature of forming the first reflective light source directed to the sensing module is such that the sensing module transmits the pupil position signal to the control module according to the first reflective light source, and the control module adjusts according to the pupil position signal. The micromirror module is such that the second point source forms an image source that is accurately directed toward the pupil surface.
為使能更進一步瞭解本發明的特徵及技術內容，請參閱以下有關本發明的詳細說明與附圖，然而所提供的附圖僅用於提供參考與說明，並非用來對本發明加以限制。 For a better understanding of the features and technical aspects of the present invention, reference should be made to the accompanying drawings.
D‧‧‧影像投影裝置 D‧‧‧Image projection device
1‧‧‧光源模組 1‧‧‧Light source module
2‧‧‧微鏡模組 2‧‧‧Micromirror module
3‧‧‧光學模組 3‧‧‧Optical module
4‧‧‧眼球表面 4‧‧‧ eye surface
41‧‧‧瞳孔表面 41‧‧‧ pupil surface
42‧‧‧非瞳孔表面 42‧‧‧ Non-porous surface
5‧‧‧感測模組 5‧‧‧Sensing module
6‧‧‧控制模組 6‧‧‧Control module
L‧‧‧預定光學路徑 L‧‧‧Predetermined optical path
L1‧‧‧第一點光源 L1‧‧‧ first point light source
L11‧‧‧第一面光源 L11‧‧‧ first surface light source
L12‧‧‧偵測光源 L12‧‧‧Detecting light source
L2‧‧‧第二點光源 L2‧‧‧second point light source
L21‧‧‧第二面光源 L21‧‧‧second surface light source
L22‧‧‧影像光源 L22‧‧‧ image source
R1‧‧‧第一反射光源 R1‧‧‧first reflected light source
R2‧‧‧第二反射光源 R2‧‧‧second reflected light source
圖1為本發明實施例的具有瞳孔追蹤功能的影像投影裝置沿預定光學路徑佈置的示意圖。 FIG. 1 is a schematic diagram of an image projection apparatus having a pupil tracking function disposed along a predetermined optical path according to an embodiment of the present invention.
圖2為本發明實施例的具有瞳孔追蹤功能的影像投影裝置的其中一影像投影光學路徑示意圖。 2 is a schematic diagram of an image projection optical path of an image projection apparatus having a pupil tracking function according to an embodiment of the present invention.
圖3為本發明實施例的具有瞳孔追蹤功能的影像投影裝置的瞳孔位置追蹤光學路徑的示意圖。 FIG. 3 is a schematic diagram of a pupil position tracking optical path of an image projection apparatus having a pupil tracking function according to an embodiment of the present invention.
圖4為本發明實施例的具有瞳孔追蹤功能的影像投影裝置的另外一影像投影光學路徑示意圖。 4 is a schematic diagram of another image projection optical path of an image projection apparatus having a pupil tracking function according to an embodiment of the present invention.
以下是通過特定的具體實施例來說明本發明所公開有關“具 有瞳孔追蹤功能的影像投影裝置及其瞳孔位置追蹤裝置”的實施方式，本領域技術人員可由本說明書所公開的內容瞭解本發明的優點與效果。本發明可通過其他不同的具體實施例加以施行或應用，本說明書中的各項細節也可基於不同觀點與應用，在不悖離本發明的精神下進行各種修飾與變更。另外，本發明的附圖僅為簡單示意說明，並非依實際尺寸的描繪，事先聲明。以下的實施方式將進一步詳細說明本發明的相關技術內容，但所公開的內容並非用以限制本發明的保護範圍。 The following is a description of the disclosure of the present invention by way of specific embodiments. An embodiment of an image projection device having a pupil tracking function and a pupil position tracking device thereof can be understood by those skilled in the art from the disclosure of the present specification. The present invention can be implemented by other different embodiments. The details of the present invention can be variously modified and changed without departing from the spirit and scope of the invention. The following description of the related art will further explain the related technical content of the present invention, but the disclosure is not intended to limit the scope of the present invention.
請參閱圖1，其為本發明實施例的具有瞳孔追蹤功能的影像投影裝置的佈置示意圖。本發明提供一種具有瞳孔追蹤功能的影像投影裝置D，其包括一光源模組1、一微鏡模組2、一光學模組3、一感測模組5以及一控制模組6。控制模組6電性連接於微鏡模組2與感測模組5。同時，光源模組1、微鏡模組2、光學模組3以及感測模組5沿著一預定光學路徑L佈置。 Please refer to FIG. 1 , which is a schematic diagram of the arrangement of an image projection apparatus with a pupil tracking function according to an embodiment of the invention. The present invention provides an image projection device D having a pupil tracking function, which includes a light source module 1, a micro mirror module 2, an optical module 3, a sensing module 5, and a control module 6. The control module 6 is electrically connected to the micromirror module 2 and the sensing module 5. At the same time, the light source module 1, the micromirror module 2, the optical module 3 and the sensing module 5 are arranged along a predetermined optical path L.
本發明的預定光學路徑L是藉由光入射及反射的原理來行進的可預測路徑，因此預定光學路徑的佈置可依照基本光學原理進行配置。 The predetermined optical path L of the present invention is a predictable path that travels by the principle of light incidence and reflection, and thus the arrangement of the predetermined optical paths can be configured in accordance with basic optical principles.
再者，如圖1所示，本發明的具有瞳孔追蹤功能的影像投影裝置D，其光源模組1可提供至少一點光源。至少一點光源可通過微鏡模組2的反射以形成至少一面光源。至少一面光源再通過光學模組3的反射以形成偵測光源以及/或是影像光源。 Furthermore, as shown in FIG. 1, the image projection device D having the pupil tracking function of the present invention can provide at least one light source for the light source module 1. At least one light source can be reflected by the micromirror module 2 to form at least one light source. At least one light source is then reflected by the optical module 3 to form a detection light source and/or an image light source.
舉例來說，在本發明的實施例中，具有瞳孔追蹤功能的影像投影裝置D的光源模組1可同時提供第一點光源以及第二點光源，且第一點光源與第二點光源之光波波長不同。此外，第一點光源是用以形成偵測光源；第二點光源是用以形成影像光源。進一步，第一點光源可以是非可見光光束；而第二點光源是可形成影像的影像光束。 For example, in the embodiment of the present invention, the light source module 1 of the image projection device D having the pupil tracking function can simultaneously provide the first point source and the second point source, and the first point source and the second point source The wavelength of the light wave is different. In addition, the first point source is used to form the detection source; and the second point source is used to form the image source. Further, the first point source may be a non-visible beam; and the second point source is an image beam capable of forming an image.
其中，光源模組1可具有兩個光源投射單元，其分別提供光 波波長不同的第一點光源與第二點光源。例如，光源模組1可包括可見光投射單元以及非可見光投射單元，其分別提供非可見光光束的第一點光源以及影像光束的第二點光源。 Wherein, the light source module 1 can have two light source projection units, respectively providing light The first point source and the second point source having different wavelengths of the wave. For example, the light source module 1 may include a visible light projection unit and a non-visible light projection unit that respectively provide a first point light source of the invisible light beam and a second point light source of the image light beam.
承上所述，在本發明實施例中，光源模組1所提供的第一點光源可通過微鏡模組2的反射以形成第一面光源，第一面光源可通過光學模組3的反射以形成偵測光源。偵測光源是投向眼球表面，而眼球表面具有瞳孔表面以及圍繞瞳孔表面的非瞳孔表面。因為光源會經瞳孔進入眼球中，所以通過瞳孔表面反射的反射光源的強度會小於通過非瞳孔表面反射的光源的強度。 As described above, in the embodiment of the present invention, the first point light source provided by the light source module 1 can be reflected by the micro mirror module 2 to form a first surface light source, and the first surface light source can pass through the optical module 3 Reflect to form a detection source. The detection source is directed onto the surface of the eye, and the surface of the eye has a pupil surface and a non-pupil surface surrounding the pupil surface. Because the light source enters the eyeball through the pupil, the intensity of the reflected source reflected through the pupil surface will be less than the intensity of the light source reflected through the non-porous surface.
接著，在本發明的具有瞳孔追蹤功能的影像投影裝置中，還包括僅特定波長的光源所偵測的感測模組5。在本發明中，感測模組5僅接受非可見光波長的光，因此感測模組5感測第一面光源形成的偵測光源，而不受到第二面光源反射形成的影像光源的影響。其中，偵測光源通過瞳孔表面的反射以形成投向感測模組5的第一反射光源，偵測光源通過非瞳孔表面的反射以形成投向感測模組5的第二反射光源。第一反射光源的強度小於第二反射光源的強度，如此一來，感測模組5可依據第一反射光源以傳送瞳孔位置訊號至控制模組6。 Next, in the image projection device with the pupil tracking function of the present invention, the sensing module 5 detected by the light source of only a specific wavelength is further included. In the present invention, the sensing module 5 only receives the light of the non-visible wavelength, so the sensing module 5 senses the detecting light source formed by the first surface light source, and is not affected by the image light source formed by the reflection of the second surface light source. . The detection light source is reflected by the surface of the pupil to form a first reflective light source that is directed to the sensing module 5, and the light source is reflected by the non-boring surface to form a second reflective light source that is directed to the sensing module 5. The intensity of the first reflective light source is less than the intensity of the second reflective light source. In this manner, the sensing module 5 can transmit the pupil position signal to the control module 6 according to the first reflective light source.
再者，控制模組6依據瞳孔位置訊號以調整微鏡模組2，同時，光源模組1所提供的第二點光源通過調整後的微鏡模組2的反射以形成第二面光源，且第二面光源亦通過光學模組3的反射以形成準確地投向瞳孔表面的影像光源。 Furthermore, the control module 6 adjusts the micromirror module 2 according to the pupil position signal, and the second point light source provided by the light source module 1 passes through the reflection of the adjusted micromirror module 2 to form a second surface light source. And the second surface light source is also reflected by the optical module 3 to form an image light source that is accurately projected to the pupil surface.
以下將根據實際操作之態樣依序詳細說明本發明具有瞳孔追蹤功能的影像投影裝置D的各元件的操作以達成瞳孔追蹤的功能。 Hereinafter, the operation of each component of the image projecting device D having the pupil tracking function of the present invention will be sequentially described in detail in accordance with the actual operation to achieve the function of pupil tracking.
請參閱圖1以及圖2，圖具有瞳孔追蹤功能的影像投影裝置D的其中一影像投影光學路徑示意圖。如圖2所示，本發明實施例提供一種具有瞳孔追蹤功能的影像投影裝置D，其包括光源模組 1、微鏡模組2、光學模組3、感測模組5以及控制模組6。控制模組6電性連接於微鏡模組2以及感測模組5。此外，如前所述，光源模組1、微鏡模組2、光學模組3以及感測模組5是沿著一預定光學路徑L佈置。在影像投影的模式(圖2)下，光源模組1根據一預定光學路徑提供第二點光源L2。光源模組1可透過可見光投射單元提供第二點光源L2。 Please refer to FIG. 1 and FIG. 2 , which are schematic diagrams showing an optical projection optical path of an image projection device D having a pupil tracking function. As shown in FIG. 2, an embodiment of the present invention provides an image projection device D having a pupil tracking function, which includes a light source module. 1. Micromirror module 2, optical module 3, sensing module 5, and control module 6. The control module 6 is electrically connected to the micromirror module 2 and the sensing module 5 . In addition, as described above, the light source module 1, the micromirror module 2, the optical module 3, and the sensing module 5 are arranged along a predetermined optical path L. In the mode of image projection (Fig. 2), the light source module 1 provides a second point source L2 according to a predetermined optical path. The light source module 1 can provide the second point light source L2 through the visible light projection unit.
首先，光源模組1提供第二點光源L2至微鏡模組2，經微鏡模組2反射後形成第二面光源L21。第二面光源L21通過光學模組3的反射以形成影像光源L22。 First, the light source module 1 provides the second point light source L2 to the micro mirror module 2, and is reflected by the micro mirror module 2 to form a second surface light source L21. The second surface light source L21 is reflected by the optical module 3 to form an image light source L22.
詳細說明之，第二點光源L2是可傳送影像的可見光光束。換句話說，第二點光源L2是可形成影像的影像光束。在本發明實施例中，第二點光源L2可為RGB雷射發光模組，其包括一個紅色雷射光源、一藍色雷射光源以及一綠色雷射光源(在此以RGB表示)。光源模組1將RGB雷射光源在短時間內瞬時投射在微鏡模組2的每個微鏡單元(可為微鏡片)上。接著，RGB雷射光源經微鏡模組2反射後形成一幀第二面光源L21，投射至光學模組3。第二面光源L21再經光學模組3的反射以形成影像光源L22。 In detail, the second point light source L2 is a visible light beam that can transmit an image. In other words, the second point source L2 is an image beam that can form an image. In the embodiment of the present invention, the second point light source L2 may be an RGB laser light emitting module including a red laser light source, a blue laser light source, and a green laser light source (indicated here by RGB). The light source module 1 instantaneously projects the RGB laser light source on each micromirror unit (which may be a microlens) of the micromirror module 2 in a short time. Then, the RGB laser light source is reflected by the micromirror module 2 to form a frame of the second surface light source L21, which is projected to the optical module 3. The second surface light source L21 is further reflected by the optical module 3 to form an image light source L22.
值得一提的是，除了前述單一RGB雷射光源之外，本發明的第二點光源L2也可以是RGGB雷射光源。也就是說，第二點光源L2可以是一個紅色雷射光源、兩個綠色雷射光源以及一個藍色雷射光源。同理可證，第二點光源L2還可以是RRGGB雷射光源，其具有兩個紅色雷射光源、兩個綠色雷射光源以及一個藍色雷射光源。 It is worth mentioning that, in addition to the aforementioned single RGB laser light source, the second point light source L2 of the present invention may also be an RGGB laser light source. That is, the second point source L2 may be a red laser source, two green laser sources, and a blue laser source. Similarly, the second point source L2 can also be an RRGGB laser source having two red laser sources, two green laser sources, and a blue laser source.
需注意的是，光學模組3可以為，舉例來說但不限於：凹面反射鏡、平面反射鏡、凸透鏡。在本發明實施例，光學模組3為凹面反射鏡，但本發明不限於此。此外，光學模組3可為固定式或可調式。在本發明實施例中，光學模組3為固定式。 It should be noted that the optical module 3 can be, for example but not limited to, a concave mirror, a plane mirror, and a convex lens. In the embodiment of the invention, the optical module 3 is a concave mirror, but the invention is not limited thereto. In addition, the optical module 3 can be fixed or adjustable. In the embodiment of the invention, the optical module 3 is of a fixed type.
承上所述，如圖2所示，影像光源L22經光學模組3反射並 準確地投向使用者的眼球表面4的瞳孔表面41。根據本實施例，經微鏡模組2反射的第二面光源L21經過是凹面反射鏡的光學模組3反射之後，形成影像光源L22，該影像光源L22通過瞳孔表面41之後，聚焦在使用者的眼球，最終以在視網膜成像。是故，從光源模組1發射出的第二點光源L2最終可形成在使用者眼球中成像的影像光源L22。 As described above, as shown in FIG. 2, the image light source L22 is reflected by the optical module 3 and The pupil surface 41 of the eyeball surface 4 of the user is accurately projected. According to the embodiment, after the second surface light source L21 reflected by the micromirror module 2 is reflected by the optical module 3 which is a concave mirror, the image light source L22 is formed, and the image light source L22 is focused on the user after passing through the pupil surface 41. The eyeball is ultimately imaged in the retina. Therefore, the second point light source L2 emitted from the light source module 1 can finally form the image light source L22 imaged in the user's eyeball.
接著，請參閱圖1及圖3，其為具有瞳孔追蹤功能的影像投影裝置D的瞳孔位置追蹤光學路徑的示意圖。如同圖3所示，本發明實施例的具有瞳孔追蹤功能的影像投影裝置D包括沿著預定光學路徑L佈置的光源模組1、微鏡模組2、光學模組3、感測模組5以及控制模組6。根據圖3顯示，光源模組1根據預定光學路徑提供第一點光源L1，此時具有瞳孔追蹤功能的影像投影裝置D具有瞳孔位置追蹤光學路徑的模式。 Next, please refer to FIG. 1 and FIG. 3 , which are schematic diagrams of the pupil position tracking optical path of the image projection device D having the pupil tracking function. As shown in FIG. 3, the image projection device D having the pupil tracking function according to the embodiment of the present invention includes a light source module 1, a micromirror module 2, an optical module 3, and a sensing module 5 arranged along a predetermined optical path L. And a control module 6. According to FIG. 3, the light source module 1 provides a first point light source L1 according to a predetermined optical path, and at this time, the image projecting device D having a pupil tracking function has a mode in which the pupil position is tracked by the optical path.
與前述影像投影模式相似，首先，光源模組1透過其非可見光投射單元提供第一點光源L1至微鏡模組2，經微鏡模組2反射後形成第一面光源L11，第一面光源L11經光學模組3的反射形成投向瞳孔表面的偵測光源L12。 Similar to the image projection mode, first, the light source module 1 provides the first point light source L1 to the micro mirror module 2 through the non-visible light projection unit, and is reflected by the micro mirror module 2 to form the first surface light source L11, the first surface The light source L11 is reflected by the optical module 3 to form a detecting light source L12 that is directed toward the pupil surface.
詳細說明之，第一點光源L1是非可見光光束。舉例來說，本發明實施例的第一點光源L1可以是光波長為760nm至1000nm之間的紅外光。 In detail, the first point light source L1 is a non-visible light beam. For example, the first point light source L1 of the embodiment of the present invention may be infrared light having a wavelength of light between 760 nm and 1000 nm.
承上所述，第一點光源L1可以以單一光束射出，亦可以複數個光束以形成一發射範圍射出。在本發明實施例中，第一點光源L1是以單一光束射出。光源模組1提供紅外光在短時間內瞬時投射在微鏡模組2的每個微鏡單元(可為微鏡片)上。接著，紅外光經微鏡模組2反射後形成一幀第一面光源L11，投射至光學模組3。第一面光源L11再經光學模組3的反射以形成具有一投射範圍的偵測光源L12。 As described above, the first point source L1 can be emitted as a single beam, or a plurality of beams can be formed to form a range of emission. In the embodiment of the invention, the first point source L1 is emitted as a single beam. The light source module 1 provides infrared light to be instantaneously projected on each micromirror unit (which may be a microlens) of the micromirror module 2 in a short time. Then, the infrared light is reflected by the micromirror module 2 to form a frame of the first surface light source L11, which is projected to the optical module 3. The first surface light source L11 is further reflected by the optical module 3 to form a detection light source L12 having a projection range.
再次說明，在本實施例，光學模組3為固定式凹面反射鏡， 但本發明不限於此。 Again, in the present embodiment, the optical module 3 is a fixed concave mirror. However, the invention is not limited thereto.
承上所述，如圖3所示，第一面光源L11經光學模組3反射並投向使用者的眼球表面4。值得一提的是，根據本發明實施例，眼球表面4具有瞳孔表面41以及圍繞瞳孔表面41的非瞳孔表面42。投向眼球表面4的偵測光源L12的涵蓋面積包括瞳孔表面41以及非瞳孔表面42的範圍。具體來說，投向眼球表面4的偵測光源L12的面積可為大於或等於眼球表面4的面積。在本發明實施例中，偵測光源L12的面積是等於眼球表面4的面積。 As described above, as shown in FIG. 3, the first surface light source L11 is reflected by the optical module 3 and is projected to the eyeball surface 4 of the user. It is worth mentioning that the eyeball surface 4 has a pupil surface 41 and a non-pupil surface 42 surrounding the pupil surface 41, in accordance with an embodiment of the present invention. The coverage area of the detection light source L12 that is directed to the surface 4 of the eye includes the range of the pupil surface 41 and the non-pupil surface 42. Specifically, the area of the detection light source L12 that is directed to the surface 4 of the eyeball may be greater than or equal to the area of the surface 4 of the eyeball. In the embodiment of the present invention, the area of the detecting light source L12 is equal to the area of the eyeball surface 4.
承上所述，偵測光源L12通過瞳孔表面41的反射形成第一反射光源R1；偵測光源L12通過非瞳孔表面42的反射形成第二反射光源R2。第一反射光源R1可被感測模組5偵測，感測模組5可依據第一反射光源R1傳送瞳孔位置訊號到控制模組6。由於瞳孔表面41的透光性大於非瞳孔表面42的透光性。投向瞳孔表面41的偵測光源L12會有部分穿過瞳孔進入眼球，因此第一反射光源R1的強度會比全反射的第二反射光源R2的強度較小。如此，感測模組5可藉此判斷瞳孔的位置，並得到一瞳孔位置訊號，並將該瞳孔位置訊號傳送至控制模組6。 As described above, the detection light source L12 forms the first reflection light source R1 through the reflection of the pupil surface 41; the detection light source L12 forms the second reflection light source R2 through the reflection of the non-pupil surface 42. The first reflective light source R1 can be detected by the sensing module 5, and the sensing module 5 can transmit the pupil position signal to the control module 6 according to the first reflective light source R1. The light transmission of the pupil surface 41 is greater than the light transmission of the non-pupil surface 42. The detecting light source L12 that is directed toward the pupil surface 41 partially enters the eyeball through the pupil, so that the intensity of the first reflected light source R1 is smaller than the intensity of the totally reflected second reflected light source R2. In this way, the sensing module 5 can determine the position of the pupil and obtain a pupil position signal, and transmit the pupil position signal to the control module 6.
從圖3可看出，眼球轉動使得瞳孔位置從垂直正中間偏移至右側，瞳孔表面41仍在偵測光源L12的面積之內。因此，偵測光源L12內的部分紅外光光束會通過偏移後的瞳孔表面41反射較小強度的第一反射光源R1，而其餘從非瞳孔表面42反射的第二反射光源R2之強度不變。進而感測模組5通過反射至感測模組的第一反射光源R1以及第二反射光源R2的強弱，便可判斷出瞳孔位置。如此，當使用者的眼球轉動時，感測模組5均可即時追蹤該使用者的眼球瞳孔位置，並即時輸出瞳孔的瞳孔位置訊號。 As can be seen from Fig. 3, the rotation of the eyeball causes the pupil position to shift from the vertical center to the right side, and the pupil surface 41 is still within the area of the detection light source L12. Therefore, part of the infrared light beam in the detecting light source L12 reflects the first reflecting light source R1 of less intensity through the offset pupil surface 41, while the intensity of the second reflecting light source R2 reflected from the non-boring surface 42 remains unchanged. . Further, the sensing module 5 can determine the pupil position by the intensity of the first reflective light source R1 and the second reflective light source R2 reflected to the sensing module. In this way, when the user's eyeball rotates, the sensing module 5 can instantly track the position of the eyeball pupil of the user, and immediately output the pupil position signal of the pupil.
接著請參閱圖4，其為具有瞳孔追蹤功能的影像投影裝置D的另外一影像投影光學路徑示意圖。詳言之，承前所述，感測模組5輸出瞳孔的瞳孔位置訊號至控制模組6，控制模組6根據該瞳 孔位置訊號調整微鏡模組2。根據圖4，控制模組6依據瞳孔位置訊號調整微鏡模組2，使得光源模組1所提供的第二點光源L2在經過調整後的微鏡模組2的反射形成調整後的第二面光源L21，且調整後的第二面光源L21通過光學模組3的反射形成調整後影像光源L22。調整後的影像光源L22準確地投向(偏移後的)瞳孔表面，以重新在使用者的眼球中成像。具體而言，微鏡模組2可包括多個微鏡片，而控制模組6可通過瞳孔位置訊號來調整每一個微鏡片的反射角度。如此一來可改變預定光學路徑，使得第二點光源L2依序通過微鏡模組2以及光學模組3的反射所形成的影像光源L22可準確即時地投向瞳孔表面。 Next, please refer to FIG. 4 , which is a schematic diagram of another image projection optical path of the image projection device D having the pupil tracking function. In detail, as described above, the sensing module 5 outputs the pupil position signal of the pupil to the control module 6, and the control module 6 according to the The hole position signal adjusts the micromirror module 2. According to FIG. 4, the control module 6 adjusts the micromirror module 2 according to the pupil position signal, so that the second point light source L2 provided by the light source module 1 forms an adjusted second after the adjustment of the adjusted micromirror module 2 The surface light source L21 and the adjusted second surface light source L21 are formed by the reflection of the optical module 3 to form the adjusted image light source L22. The adjusted image light source L22 is accurately projected onto the (offset) pupil surface to re-image in the user's eyeball. Specifically, the micromirror module 2 can include a plurality of microlenses, and the control module 6 can adjust the reflection angle of each microlens through the pupil position signal. In this way, the predetermined optical path can be changed, so that the image light source L22 formed by the second point light source L2 sequentially passing through the reflection of the micromirror module 2 and the optical module 3 can be accurately and immediately projected to the pupil surface.
需注意的是，前述偵測光源L12通過眼球表面反射不同強度的第一反射光源R1與第二反射光源R2以使感測模組5判斷瞳孔位置的作動，與控制模組6調整微鏡模組2以使影像光源L22準確地投向瞳孔表面的作動，是幾乎同時發生。如此，具有瞳孔追蹤功能的影像投影裝置D同時提供第一點光源L1與第二點光源L2，第一點光源L1形成偵測光源L12並通過眼球表面4反射出不同強度的反射光源，感測模組5通過反射光源判斷瞳孔位置並傳送瞳孔位置訊號給控制模組6。同時，控制模組6即時地調整微鏡模組2以改變第二點光源L2的光學路徑以準確地在使用者的眼球中成像。如此一來，本發明最終可達成具有瞳孔追蹤功能的影像投影裝置。 It should be noted that the detecting light source L12 reflects the first reflecting light source R1 and the second reflecting light source R2 of different intensities through the surface of the eyeball to cause the sensing module 5 to determine the operation of the pupil position, and the control module 6 adjusts the micro mirror mode. The operation of the group 2 to accurately project the image light source L22 toward the pupil surface occurs almost simultaneously. In this way, the image projection device D having the pupil tracking function simultaneously provides the first point light source L1 and the second point light source L2. The first point source L1 forms the detecting light source L12 and reflects the reflected light source of different intensity through the eyeball surface 4, and senses The module 5 determines the pupil position by the reflected light source and transmits the pupil position signal to the control module 6. At the same time, the control module 6 instantly adjusts the micromirror module 2 to change the optical path of the second point source L2 to accurately image in the user's eye. In this way, the present invention can finally achieve an image projection device having a pupil tracking function.
[實施例的有益效果] [Advantageous Effects of Embodiments]
本發明的有益效果在於，本發明技術方案所提供的具有瞳孔追蹤功能的影像投影裝置及其瞳孔位置追蹤裝置，其能通過“光源模組1所提供的第一點光源L1通過微鏡模組2的反射以形成第一面光源L11，第一面光源L11通過光學模組3的反射以形成投向眼球表面4的偵測光源L12”以及“偵測光源L12通過瞳孔表 面41的反射以形成投向感測模組5的第一反射光源R1”的技術特徵，以使感測模組5依據第一反射光源R1傳送瞳孔位置訊號至控制模組6，並使控制模組6依據瞳孔位置訊號以調整微鏡模組2，使得第二點光源L2形成準確地投向瞳孔表面41的影像光源L22。 The invention has the beneficial effects of the image projection device with the pupil tracking function and the pupil position tracking device provided by the technical solution of the present invention, which can pass the micro-mirror module through the first point light source L1 provided by the light source module 1 2 reflection to form a first surface light source L11, the first surface light source L11 is reflected by the optical module 3 to form a detection light source L12" toward the eyeball surface 4, and "detecting the light source L12 through the pupil table The reflection of the surface 41 forms a technical feature of the first reflective light source R1" that is directed to the sensing module 5, so that the sensing module 5 transmits the pupil position signal to the control module 6 according to the first reflective light source R1, and the control module is The group 6 adjusts the micromirror module 2 according to the pupil position signal such that the second point source L2 forms an image light source L22 that is accurately projected toward the pupil surface 41.
以上所公開的內容僅為本發明的優選可行實施例，並非因此侷限本發明的申請專利範圍，所以凡是運用本發明說明書及附圖內容所做的等效技術變化，均包含於本發明的申請專利範圍內。 The above disclosure is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Therefore, any equivalent technical changes made by using the present specification and the contents of the drawings are included in the application of the present invention. Within the scope of the patent.
Claims (8)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW106109958A TWI634869B (en) | 2017-03-24 | 2017-03-24 | Image display device with pupil tracking function and pupil tracking device thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW106109958A TWI634869B (en) | 2017-03-24 | 2017-03-24 | Image display device with pupil tracking function and pupil tracking device thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| TWI634869B true TWI634869B (en) | 2018-09-11 |
| TW201834607A TW201834607A (en) | 2018-10-01 |
Family
ID=64452693
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW106109958A TWI634869B (en) | 2017-03-24 | 2017-03-24 | Image display device with pupil tracking function and pupil tracking device thereof |
Country Status (1)
| Country | Link |
|---|---|
| TW (1) | TWI634869B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200521480A (en) * | 2003-12-18 | 2005-07-01 | Agilent Technologies Inc | Method and system for wavelength-dependent imaging and detection using a hybrid filter |
| US20050185138A1 (en) * | 2004-02-19 | 2005-08-25 | Visx, Incorporated | Methods and systems for differentiating left and right eye images |
| CN101427153A (en) * | 2006-04-20 | 2009-05-06 | 法罗技术股份有限公司 | Camera based six degree-of-freedom target measuring and target tracking device |
| CN102955255A (en) * | 2011-09-26 | 2013-03-06 | 微软公司 | Integrated eye tracking and display system |
| TWM547127U (en) * | 2017-03-24 | 2017-08-11 | Ultimems Inc | Image projection device with pupil-tracking function and pupil position-tracking device thereof |
-
2017
- 2017-03-24 TW TW106109958A patent/TWI634869B/en active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200521480A (en) * | 2003-12-18 | 2005-07-01 | Agilent Technologies Inc | Method and system for wavelength-dependent imaging and detection using a hybrid filter |
| US20050185138A1 (en) * | 2004-02-19 | 2005-08-25 | Visx, Incorporated | Methods and systems for differentiating left and right eye images |
| CN101427153A (en) * | 2006-04-20 | 2009-05-06 | 法罗技术股份有限公司 | Camera based six degree-of-freedom target measuring and target tracking device |
| CN102955255A (en) * | 2011-09-26 | 2013-03-06 | 微软公司 | Integrated eye tracking and display system |
| TWM547127U (en) * | 2017-03-24 | 2017-08-11 | Ultimems Inc | Image projection device with pupil-tracking function and pupil position-tracking device thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| TW201834607A (en) | 2018-10-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9916005B2 (en) | Gaze tracking with projector | |
| TWI569040B (en) | Autofocus head mounted display device | |
| US9606354B2 (en) | Heads-up display with integrated display and imaging system | |
| TW201831953A (en) | Eye tracker based on retinal imaging via light-guide optical element | |
| TW201712371A (en) | Projection device for data eyeglasses, data eyeglasses, and process to operate a projection device for data eyeglasses enabling a user to have projected image on their data eyeglasses | |
| US9662014B2 (en) | Methods and apparatus for visual cues for eye alignment | |
| US10634904B2 (en) | Image projection device | |
| JP2016517036A5 (en) | ||
| TWI716968B (en) | Head-mounted display apparatus and eye-tracking system thereof | |
| EP3899639A1 (en) | Holographic in-field illuminator | |
| US10725292B2 (en) | Gaze-tracking system and aperture device | |
| JP7302592B2 (en) | Information detection device, video projection device, information detection method, and video projection method | |
| CN206696529U (en) | Imaing projector and its pupil position follow-up mechanism with pupil tracing function | |
| US11892634B2 (en) | Multi-plane projection with laser beam scanning in augmented reality displays | |
| TWM547127U (en) | Image projection device with pupil-tracking function and pupil position-tracking device thereof | |
| CN108663806A (en) | Imaing projector with pupil tracing function and its pupil position follow-up mechanism | |
| JP4764664B2 (en) | Ophthalmic examination equipment | |
| TWI634869B (en) | Image display device with pupil tracking function and pupil tracking device thereof | |
| JP2002510407A (en) | How to improve visual perception by modifying retinal images | |
| CN216485801U (en) | Optical imaging system, image display device and augmented reality display equipment | |
| TWI614524B (en) | Head mounted display | |
| JP7163230B2 (en) | Line-of-sight detection device, line-of-sight detection method, and display device | |
| JP2000214408A (en) | Picture display device | |
| US10534156B2 (en) | Devices and methods for lens alignment based on encoded color patterns | |
| JP7163950B2 (en) | Retinal scanning projection device, image light emitting method and combiner |