TWI715242B - Virtual reality device and contorl method thereof - Google Patents

Virtual reality device and contorl method thereof Download PDF

Info

Publication number
TWI715242B
TWI715242B TW108136858A TW108136858A TWI715242B TW I715242 B TWI715242 B TW I715242B TW 108136858 A TW108136858 A TW 108136858A TW 108136858 A TW108136858 A TW 108136858A TW I715242 B TWI715242 B TW I715242B
Authority
TW
Taiwan
Prior art keywords
display panel
flexible display
distance
image imaging
virtual reality
Prior art date
Application number
TW108136858A
Other languages
Chinese (zh)
Other versions
TW202116065A (en
Inventor
陳瑞麟
何吉泰
Original Assignee
宏碁股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 宏碁股份有限公司 filed Critical 宏碁股份有限公司
Priority to TW108136858A priority Critical patent/TWI715242B/en
Application granted granted Critical
Publication of TWI715242B publication Critical patent/TWI715242B/en
Publication of TW202116065A publication Critical patent/TW202116065A/en

Links

Images

Abstract

A virtual reality device and control method thereof are provided. The VR device includes a flexible display panel, arranged in a body of the VR device; an image detecting part, arranged in the body of the VR device and at positions capable of detecting an interpupillary distance of a user; and a control part, changing a curvature of the flexible display panel.

Description

虛擬實境裝置及其控制方法 Virtual reality device and its control method

本發明是有關於一種虛擬實境裝置及其控制方法,且特別是有關於一種可以調整成像距離之虛擬實境裝置及其控制方法。 The present invention relates to a virtual reality device and a control method thereof, and particularly relates to a virtual reality device and a control method thereof that can adjust the imaging distance.

過去,虛擬實境(Virtual Reality,VR)之頭戴式裝置受到硬體設計的限制,面板及鏡片是非一體成型的架構,故這種架構較難因應不同人之人眼的狀況調整眼距(interpupillary distance,IPD)。受到人眼IPD與虛像成像距離影響,成像的虛像會因人眼兩眼間的距離差異(即IPD)產生不同的夾角、焦距的影像於實像後方。這種情形會讓人眼產生壓迫感。 In the past, Virtual Reality (VR) head-mounted devices were limited by hardware design. The panel and lens were non-integrated structures. Therefore, it was difficult for this structure to adjust the eye distance according to different people's eye conditions ( interpupillary distance, IPD). Affected by the imaging distance between the human eye IPD and the virtual image, the imaged virtual image will produce images with different angles and focal lengths behind the real image due to the distance between the human eyes (ie IPD). This situation makes the human eye feel oppressed.

然而,在頭戴式VR裝置的架構中成像焦距的缺點,卻因各個使用者之眼距IPD的不同,而較難對此問題進行改善。加上觀看到的影像是由面板所控制,因而造成使用者產生暈眩現象。儘管後續也有廠牌推出手動旋鈕的方式調整眼距IPD,但對使用者來說極其不便。 However, the shortcomings of the imaging focal length in the architecture of the head-mounted VR device are difficult to improve due to the difference of the IPD of each user's eye distance. In addition, the viewed image is controlled by the panel, which causes dizziness to the user. Although some brands introduced manual knobs to adjust eye distance IPD, it is extremely inconvenient for users.

根據本發明一實施例,提供一種虛擬實境裝置,其包括:可撓式顯示面板,配設在虛擬實境裝置的本體內;影像偵測部,配設在虛擬實境裝置的本體內,且能對使用者的眼距進行偵測的位置;以及控制部,依據使用者的眼距,以改變可撓式顯示面板的曲度。 According to an embodiment of the present invention, a virtual reality device is provided, which includes: a flexible display panel arranged in the main body of the virtual reality device; an image detection unit arranged in the main body of the virtual reality device, And can detect the position of the user's eye distance; and the control part, according to the user's eye distance, to change the curvature of the flexible display panel.

在一實施例中,上述虛擬實境裝置之述控制部更依據使用者的眼距,以虛像成像距離大於等於最小虛像成像距離的方式,改變可撓式顯示面板的曲度,其中最小虛像成像距離與眼距相對應。 In one embodiment, the control part of the aforementioned virtual reality device further changes the curvature of the flexible display panel in such a way that the virtual image imaging distance is greater than or equal to the minimum virtual image imaging distance according to the user's eye distance. The distance corresponds to the distance between the eyes.

在一實施例中,虛擬實境裝置更包括調整機構,其耦接至可撓式顯示面板。控制部依據使用者的眼距,控制調整機構來調整可撓式顯示面板的彎曲度。此外,在一實施例中,調整機構更包括馬達與拉伸機構,其中馬達受控於控制部,以使拉伸機構拉伸可撓式顯示面板。此外,在一實施例中,調整機構耦接至可撓式顯示面板之長度方向的中線位置。 In one embodiment, the virtual reality device further includes an adjustment mechanism, which is coupled to the flexible display panel. The control part controls the adjustment mechanism to adjust the curvature of the flexible display panel according to the distance between the eyes of the user. In addition, in one embodiment, the adjustment mechanism further includes a motor and a stretching mechanism, wherein the motor is controlled by the control part, so that the stretching mechanism stretches the flexible display panel. In addition, in one embodiment, the adjustment mechanism is coupled to the midline position of the flexible display panel in the longitudinal direction.

在一實施例中,控制部依據眼距以及與眼距相對應的實像成像距離,在可撓式顯示面板之長邊方向的兩側邊加上黑屏,並調整可撓式顯示面板的解析度。此外,在一實施例中,黑屏的寬度基於每一個實像成像距離來設定。 In one embodiment, the control unit adds black screens on both sides of the long side direction of the flexible display panel according to the eye distance and the real image imaging distance corresponding to the eye distance, and adjusts the resolution of the flexible display panel . In addition, in an embodiment, the width of the black screen is set based on each real image imaging distance.

在一實施例中,影像偵測部更包括第一偵測部與第二偵測部,分別偵測使用者的兩眼位置,以產生眼距。此外,在一實 施例中,第一偵測部與第二偵測部為紅外線攝影機。 In one embodiment, the image detecting part further includes a first detecting part and a second detecting part, which respectively detect the positions of the two eyes of the user to generate eye distance. In addition, a real In an embodiment, the first detecting part and the second detecting part are infrared cameras.

在一實施例中,可撓式顯示面板可以是可撓式液晶顯示面板。 In an embodiment, the flexible display panel may be a flexible liquid crystal display panel.

根據本發明另一實施例,提供一種虛擬實境裝置的控制方法,該虛擬實境裝置配設有可撓式顯示面板。此控制方法包括:偵測使用者的眼距;以及依據眼距,改變所述可撓式顯示面板的曲度。 According to another embodiment of the present invention, a method for controlling a virtual reality device is provided, and the virtual reality device is equipped with a flexible display panel. The control method includes: detecting the eye distance of the user; and changing the curvature of the flexible display panel according to the eye distance.

在一實施例中,此控制方法更包括:依據眼距,產生與眼距對應的最小虛像成像距離;產生與最小虛像成像距離相對應的實像成像距離;依據實像成像距離,調整可撓式顯示面板的曲度,使虛像成像距離大於等於最小虛像成像距離。 In one embodiment, the control method further includes: generating a minimum virtual image imaging distance corresponding to the eye distance according to the eye distance; generating a real image imaging distance corresponding to the minimum virtual image imaging distance; and adjusting the flexible display according to the real image imaging distance The curvature of the panel makes the virtual image imaging distance greater than or equal to the minimum virtual image imaging distance.

在一實施例中,控制方法更包括:依據眼距以及與眼距相對應的實像成像距離,在可撓式顯示面板之長邊方向的兩側邊形成黑屏。在一實施例中,更包括當實像成像距離大於臨界值時,才在可撓式顯示面板之長邊方向的兩側邊形成黑屏。此外,在一實施例中,控制方法更包括調整可撓式顯示面板的解析度,使影像呈現在可撓式顯示面板兩側的所述黑屏之間的顯示區域。此外,在一實施例中,黑屏的寬度基於每一個實像成像距離來設定。此外,在一實施例中,當實像成像距離越大,所要形成之黑屏寬度就越寬。 In an embodiment, the control method further includes: forming a black screen on both sides of the long-side direction of the flexible display panel according to the eye distance and the real image imaging distance corresponding to the eye distance. In one embodiment, it further includes that when the real image imaging distance is greater than the critical value, a black screen is formed on both sides of the long side direction of the flexible display panel. In addition, in an embodiment, the control method further includes adjusting the resolution of the flexible display panel so that the image is presented in the display area between the black screens on both sides of the flexible display panel. In addition, in an embodiment, the width of the black screen is set based on each real image imaging distance. In addition, in one embodiment, the larger the real image imaging distance, the wider the width of the black screen to be formed.

在一實施例中,可撓式顯示面板可以是可撓式液晶顯示面板。 In an embodiment, the flexible display panel may be a flexible liquid crystal display panel.

通過本實施例,本發明的虛擬實境裝置及其控制方法能夠結合可撓式顯示面板之頭戴式VR裝置,其透過例如IR攝影機等偵測使用者之眼距(IPD),並找出相對應的最小虛像成像距離。藉此,可讓使用者獲得較舒適的觀賞品質。 Through this embodiment, the virtual reality device and control method of the present invention can be combined with a head-mounted VR device with a flexible display panel, which detects the user’s eye distance (IPD) through, for example, an IR camera, and finds out The corresponding minimum virtual image imaging distance. In this way, the user can obtain a more comfortable viewing quality.

10:VR裝置 10: VR device

11:本體 11: body

12:可撓式顯示面板 12: Flexible display panel

12a:可視區域 12a: Viewable area

14:影像偵測部 14: Image Detection Department

14a、14b:第一與第二偵測部 14a, 14b: the first and second detection parts

16:調整機構 16: adjustment mechanism

18:馬達 18: Motor

19:拉伸機構 19: Stretching mechanism

20:控制部 20: Control Department

30:黑屏 30: black screen

40:不可視區域 40: Invisible area

IPD:眼距 IPD: Eye distance

E:人眼 E: Human eye

A:拉伸方向 A: Stretching direction

P1~P5:調整機構之刻度 P1~P5: Scale of adjustment mechanism

圖1繪示VR裝置的實像與虛像之成像位置的說明圖。 FIG. 1 is an explanatory diagram of the imaging position of the real image and the virtual image of the VR device.

圖2是依照本發明實施例所繪示的VR裝置的結構示意圖。 Fig. 2 is a schematic structural diagram of a VR device according to an embodiment of the present invention.

圖3繪示本發明實施例之VR裝置的使用狀態示意圖。 FIG. 3 is a schematic diagram of the use state of the VR device according to the embodiment of the present invention.

圖4A、4B繪示本發明實施例之VR裝置的可視視角調整示意圖。 4A and 4B show schematic diagrams of adjusting the visual angle of the VR device according to an embodiment of the present invention.

圖5繪示本發明實施例之VR裝置的控制方法的流程示意圖。 FIG. 5 is a schematic flowchart of a control method of a VR device according to an embodiment of the present invention.

圖6繪示本發明實施例之VR裝置的電路方塊示意圖。 FIG. 6 is a schematic block diagram of a circuit of a VR device according to an embodiment of the present invention.

圖1繪示VR裝置的實像與虛像之成像位置的說明圖。如圖1所示,受到人眼IPD與虛像成像距離影響,VR裝置之實際影像位置介於人兩眼夾角β度的位置,但成像的虛像會因人眼兩眼間的距離差異(即IPD)產生不同的夾角(α度)、焦距的影像於實際影像後方(α≠β)。因此,這種情形會讓人眼產生壓迫感。當夾角α越大,虛像離人眼越貼近。 FIG. 1 is an explanatory diagram of the imaging position of the real image and the virtual image of the VR device. As shown in Figure 1, the actual image position of the VR device is affected by the distance between the human eye’s IPD and the virtual image imaging distance. The actual image position of the VR device is between the human eye’s β degree position, but the imaged virtual image will vary due to the distance between the human eye’s eyes (ie IPD ) Generate images with different included angles (α degrees) and focal lengths behind the actual image (α≠β). Therefore, this situation can make the human eye feel oppressed. The larger the angle α, the closer the virtual image is to the human eye.

一般而言,當使用者之眼距IPD越寬時,最小虛像成像距離Min D view 要離人眼越遠,才能減少人眼的壓迫感,以避免暈眩狀況的發生。表一為眼距IPD(mm)的數據及其對應的最小虛像成像距離(Min D view )的關係列表。此外,由表一可以看出,當眼距IPD增加時,最小虛像成像距離的增加倍率並不會很大。 Generally speaking, when the user's eyes are wider from the IPD, the minimum virtual image imaging distance Min D view must be farther away from the human eye in order to reduce the pressure on the human eye to avoid dizziness. Table 1 is a list of the data of eye distance IPD (mm) and its corresponding minimum virtual image imaging distance (Min D view ). In addition, as can be seen from Table 1, when the eye distance IPD increases, the increase in the minimum virtual image imaging distance will not be very large.

Figure 108136858-A0305-02-0007-1
Figure 108136858-A0305-02-0007-1

此外,依據物理原理,可以列出在圖1所示狀況下,實像成像距離D point 、虛像成像距離D view 、相位差θ(=α-β)以及眼距IPD等之間的關係。此關係可由下面的數式(1)來表示:

Figure 108136858-A0305-02-0007-2
In addition, based on physical principles, the relationship between the real image imaging distance D point , the virtual image imaging distance D view , the phase difference θ (=α-β), and the eye distance IPD under the conditions shown in FIG. 1 can be listed. This relationship can be expressed by the following formula (1):
Figure 108136858-A0305-02-0007-2

D point 、為無窮遠,

Figure 108136858-A0305-02-0007-3
When D point is infinity,
Figure 108136858-A0305-02-0007-3

Figure 108136858-A0305-02-0007-4
Figure 108136858-A0305-02-0007-4

Figure 108136858-A0305-02-0007-5
Figure 108136858-A0305-02-0007-5

Figure 108136858-A0305-02-0007-6
Figure 108136858-A0305-02-0007-6

透過上述數式(1),可以知道實像成像距離、虛像成像距離與人眼IPD之間的對應關係。當IPD/D view 等於θ,實像成像距離D point 會接近無窮遠,若虛像成像距離D view 亦能趨近無窮遠,則對人眼的壓迫感會降到最低。由此得知,當虛像成像距離相對使用者之眼距IPD的夾角α越小時,虛像 成像距離D view 便會增加。因此,在固定的眼距IPD下,若夾角α減少,虛像成像距離D view 增加,便需要增加實像成像距離D point 來達到對等關係。 Through the above formula (1), we can know the correspondence between the real image imaging distance, the virtual image imaging distance and the human eye IPD. When IPD/ D view is equal to θ, the real image imaging distance D point will be close to infinity. If the virtual image imaging distance D view can also approach infinity, the pressure on the human eye will be minimized. From this, it can be seen that when the virtual image imaging distance is smaller than the angle α between the user's eyes and the IPD, the virtual image imaging distance D view will increase. Therefore, under a fixed eye distance IPD, if the included angle α decreases and the virtual image imaging distance D view increases, it is necessary to increase the real image imaging distance D point to achieve a reciprocal relationship.

如上述,本實施例基於上述原理,VR裝置10會採用調整可撓式顯示面板(例如,可撓式LCD)之曲度來控制實像成像距離D point 。由於θ非常小(可忽略),即代表實像成像距離D point 與虛像成像距離D view 正相關且成等比例增加。 As described above, in this embodiment, based on the above principle, the VR device 10 will adjust the curvature of a flexible display panel (for example, a flexible LCD) to control the real image imaging distance D point . Since θ is very small (negligible), it means that the real image imaging distance D point and the virtual image imaging distance D view are positively correlated and increase proportionally.

此外,依照表一所示,最小虛像成像距離Min D view 增加倍率極微小,增加些微實像成像距離D point 即能滿足最小虛像成像距離MinD view 的需求,也無需考慮可撓式顯示面板在受到彎曲控制時是否會受損。 In addition, as shown in Table 1, the minimum virtual image imaging distance Min D view increases the magnification very slightly, and a slight increase in the real image imaging distance D point can meet the minimum virtual image imaging distance Min D view requirements, and there is no need to consider the flexible display panel. Whether it will be damaged during bending control.

接著,將說明實現上述技術方案的VR裝置的結構,以下的說明僅為一種實施方式的範例,故關於實際上的具體結構,只要可以達到個部分的功能,本技術領域者可以進行任何適當的變更、修改或設計。 Next, the structure of the VR device that implements the above technical solution will be described. The following description is only an example of an embodiment, so as to the actual specific structure, as long as the functions of each part can be achieved, those skilled in the art can perform any appropriate Change, modify or design.

圖2是依照本發明實施例所繪示的VR裝置的結構示意圖。如圖2所示,本實施例之虛擬實境(VR)裝置10,至少包括可撓式顯示面板12、影像偵測部14、控制部20。可撓式顯示面板12是可彎曲地配設在虛擬實境裝置10的本體11內,做為一個例子可撓式顯示面板12可以是可撓式液晶顯示面板或其他任何可應用於VR裝置10的顯示面板。 Fig. 2 is a schematic structural diagram of a VR device according to an embodiment of the present invention. As shown in FIG. 2, the virtual reality (VR) device 10 of this embodiment at least includes a flexible display panel 12, an image detection unit 14, and a control unit 20. The flexible display panel 12 is flexibly arranged in the body 11 of the virtual reality device 10. As an example, the flexible display panel 12 may be a flexible liquid crystal display panel or any other applicable VR device 10. Display panel.

此外,影像偵測部14配置在VR裝置的本體11內,且能對使用者的眼距IPD進行偵測的位置。一般而言,在使用上,影像偵測部14可以對使用者的眼睛E的瞳孔進行偵測,此外影像偵測部14之其他一般性的功能在本實施例便不特別詳述。在此實施例中, 影像偵測部14主要是用來偵測使用者兩個眼睛E之間的眼距IPD。影像偵測部14可以包括第一影像偵測部14a和第一影像偵測部14b。例如,眼距IPD可以透過第一影像偵測部14a和第一影像偵測部14b分別對眼睛進行拍攝,再去計算出兩眼E之間的眼距IPD。此外,第一影像偵測部14a和第一影像偵測部14b可以是紅外線攝影機(IR camera)。 In addition, the image detection unit 14 is disposed in the body 11 of the VR device, and can detect the position of the IPD of the user's eye distance. Generally speaking, in use, the image detection unit 14 can detect the pupils of the user's eye E. In addition, other general functions of the image detection unit 14 are not specifically described in this embodiment. In this embodiment, The image detection unit 14 is mainly used to detect the eye distance IPD between the two eyes E of the user. The image detection unit 14 may include a first image detection unit 14a and a first image detection unit 14b. For example, the eye distance IPD can be captured by the first image detection unit 14a and the first image detection unit 14b respectively, and then the eye distance IPD between the two eyes E can be calculated. In addition, the first image detecting portion 14a and the first image detecting portion 14b may be infrared cameras (IR cameras).

控制部20依據所述使用者的眼距IPD,對可撓式顯示面板12的曲度進行控制,藉此可以改變可撓式顯示面板12之實像成像距離D point ,而如所述,虛像成像距離(成像平面位置)D view 也會對應的改變。圖2所示的控制部20的位置僅為示意圖,本技術領域者可以將控制部20依據所需配置在VR裝置10內的任意位置。此外,在本實施例中,為了方便說明,控制部20簡化成用來控制可撓式顯示面板12的彎曲度、解析度與本案相關的動作與功能等,但是此控制部20也可以是用來控制整個VR裝置10的所有動作與功能。在此,並不特別限制此控制部20所具有的功能。 The control unit 20 controls the curvature of the flexible display panel 12 according to the user’s eye distance IPD, so as to change the real image imaging distance D point of the flexible display panel 12, and as described, the virtual image imaging The distance (position of the imaging plane) D view will change accordingly. The position of the control unit 20 shown in FIG. 2 is only a schematic diagram, and those skilled in the art can arrange the control unit 20 at any position in the VR device 10 as required. In addition, in this embodiment, for the convenience of description, the control unit 20 is simplified to control the bending degree and resolution of the flexible display panel 12 and the actions and functions related to the present case. However, the control unit 20 can also be used To control all actions and functions of the entire VR device 10. Here, the functions of the control unit 20 are not particularly limited.

此外,依據本發明實施例,VR裝置10更包括調整機構16。拉伸機構16主要用來對可撓式顯示面板12的曲度進行改變。調整機構16受控於控制部20,可基於眼距IPD來調整可撓式顯示面板12的曲度。 In addition, according to the embodiment of the present invention, the VR device 10 further includes an adjustment mechanism 16. The stretching mechanism 16 is mainly used to change the curvature of the flexible display panel 12. The adjustment mechanism 16 is controlled by the control unit 20 and can adjust the curvature of the flexible display panel 12 based on the eye distance IPD.

根據一實施例,調整機構16更包括馬達(驅動機構的例子)18與拉伸機構19。馬達18受控於控制部20,馬達20可以控制拉伸機構19之拉伸動作。拉伸機構19耦接到可撓式顯示面板12的 長邊方向的中心線(見圖2),用以拉伸可撓式顯示面板12,藉此來改變可撓式顯示面板12的曲度。 According to an embodiment, the adjustment mechanism 16 further includes a motor (an example of a driving mechanism) 18 and a stretching mechanism 19. The motor 18 is controlled by the control part 20, and the motor 20 can control the stretching action of the stretching mechanism 19. The stretching mechanism 19 is coupled to the flexible display panel 12 The center line in the longitudinal direction (see FIG. 2) is used to stretch the flexible display panel 12, thereby changing the curvature of the flexible display panel 12.

在本實施例,如圖2所示,調整機構16之拉伸機構19的伸縮軸上具有5個刻度位置P1、P2、...、P5,每一個刻度都對應一個實像成像距離D point 。此外,如前面的說明,由於相位差θ非常小,也就是說可忽略,所以代表實像成像距離D point 與虛像成像距離D view 為相關且成等比例,也就是說約略成正比關係。因此,刻度位置P1、P2、...、P5也可以是分別代表相應的虛像成像距離D view 。此外,刻度位置P1、P2、...、P5的數量並沒有特別限制,可以依據所需來做適當地改變。 In this embodiment, as shown in FIG. 2, there are five scale positions P1, P2, ..., P5 on the telescopic shaft of the stretching mechanism 19 of the adjustment mechanism 16, and each scale corresponds to a real image imaging distance D point . In addition, as described above, since the phase difference θ is very small, that is to say, negligible, it means that the real image imaging distance D point and the virtual image imaging distance D view are related and proportional, that is, approximately proportional. Therefore, the scale positions P1, P2, ..., P5 may also represent the corresponding virtual image imaging distance D view respectively . In addition, the number of scale positions P1, P2, ..., P5 is not particularly limited, and can be appropriately changed as required.

圖3繪示本發明實施例之VR裝置的使用狀態示意圖。在圖3,省去VR裝置10,僅繪出可撓式顯示面板12與拉伸機構16之示意圖。如前所述,控制部20可以依據偵測到的眼距IPD,透過例如查表的方式,找出對應之最小虛像成像距離Min D view ,進而得到對應的實像成像距離D point 。此時,控制部20便可以控制拉伸機構16到適當的刻度檔位P1、P2、...、P5,藉此對應地改變可撓式顯示面板12的曲度。 FIG. 3 is a schematic diagram of the use state of the VR device according to the embodiment of the present invention. In FIG. 3, the VR device 10 is omitted, and only a schematic diagram of the flexible display panel 12 and the stretching mechanism 16 is drawn. As mentioned above, the control unit 20 can find the corresponding minimum virtual image imaging distance Min D view based on the detected eye distance IPD, for example, by looking up a table, and then obtain the corresponding real image imaging distance D point . At this time, the control unit 20 can control the stretching mechanism 16 to the appropriate scale positions P1, P2, ..., P5, thereby correspondingly changing the curvature of the flexible display panel 12.

圖4A、4B繪示本發明實施例之VR裝置的可視視角調整示意圖。如圖4A所示,當先前技術採用的兩片式LCD替換成可撓式顯示器12後,由於人眼E的視角關係,在進行曲度控制後,可能在可撓式顯示器12的兩側形成的人眼E無法觀看的狀況;亦即,在可撓式顯示器12彎曲到一定程度時,人眼E在觀看可撓式顯示器12時會產生死角,亦即不可視區域(或不易觀看的區域)40。 4A and 4B show schematic diagrams of adjusting the visual angle of the VR device according to an embodiment of the present invention. As shown in FIG. 4A, when the two-piece LCD used in the prior art is replaced with a flexible display 12, due to the viewing angle of the human eye E, after the curvature is controlled, there may be formed on both sides of the flexible display 12 A situation in which the human eye E cannot see; that is, when the flexible display 12 is bent to a certain extent, the human eye E will have a blind spot when viewing the flexible display 12, that is, an invisible area (or an area that is not easy to see) 40 .

根據本實施例,為了解決此問題,如圖4B所示,可以在可撓式顯示面板12之長邊方向的最外兩側形成黑屏(黑邊)30。此黑屏30之寬度d基本上是對應於圖4A所示之對應人眼E之不可視區域區30。此外,VR裝置10之控制部20並調整可撓式顯示面板12之解析度,使影像都可以呈現在使用者的雙眼E的可視區域12a內。通過此調整,即使可撓式顯示器12因為曲度改變,也不會造成無法觀看整個畫面的問題。 According to this embodiment, in order to solve this problem, as shown in FIG. 4B, black screens (black borders) 30 may be formed on the outermost two sides in the longitudinal direction of the flexible display panel 12. The width d of the black screen 30 basically corresponds to the invisible area 30 of the human eye E shown in FIG. 4A. In addition, the control unit 20 of the VR device 10 also adjusts the resolution of the flexible display panel 12 so that images can be presented in the visible area 12a of the eyes E of the user. Through this adjustment, even if the curvature of the flexible display 12 changes, it will not cause the problem of not being able to view the entire screen.

,因此在虛像成像距離D view 調整後,依照不同的虛像成像距離D view 狀況下,在可撓式顯示面板12之畫面兩側分別加入黑屏來調整影像的解析度。藉此,可以避免使用者無法看清楚完整影像及邊緣的影像亮度可能會反射至相對面板的問題。 Therefore, after the virtual image imaging distance D view is adjusted, according to different virtual image imaging distance D view conditions, black screens are added to both sides of the screen of the flexible display panel 12 to adjust the image resolution. In this way, the problem that the user cannot see the complete image clearly and the image brightness at the edge may be reflected to the opposite panel can be avoided.

表二呈現出不同的實像成像距離D point 位置,邊緣補償要如何設定。例如,當實像成像距離D point 位置調整在刻度P1,由圖2可以知道刻度P1對應到對可撓式顯示面板12之區度為最大,故對於使用者不可視區域40的範圍也會比較寬,故在表二黑屏的寬度d為0.02。反之,當實像成像距離D point 位置調整在刻度P5,由圖2可以知道刻度P5對應到對可撓式顯示面板12之區度為最小,故對於使用者不可視區域40的範圍也會比較小,故在表二之作為邊緣補償之黑屏的寬度d僅為0.002。表二所呈現的邊緣補償(黑屏)的數據是單邊的寬度。此外,表二所列的邊緣補償表並沒有顯示出與眼距IPD之關係。表二僅為一個例子,實際上在控制部20中可以針對不同的眼距IPD,儲存不同的補償表,以作為進行邊緣補償程序時的查詢之用。 Table 2 presents different real image imaging distance D point positions and how to set edge compensation. For example, when the real image imaging distance D point is adjusted to the scale P1, it can be known from FIG. 2 that the scale P1 corresponds to the maximum extent of the flexible display panel 12, so the invisible area 40 for the user will be wider. Therefore, the width d of the black screen in Table 2 is 0.02. Conversely, when the real image imaging distance D point is adjusted to the scale P5, it can be seen from Fig. 2 that the scale P5 corresponds to the minimum area for the flexible display panel 12, so the invisible area 40 for the user will be smaller. Therefore, the width d of the black screen used as edge compensation in Table 2 is only 0.002. The data of edge compensation (black screen) presented in Table 2 is the width of one side. In addition, the edge compensation table listed in Table 2 does not show the relationship with the eye distance IPD. Table 2 is only an example. In fact, the control unit 20 can store different compensation tables for different eye distance IPDs for querying when performing edge compensation procedures.

[表二]

Figure 108136858-A0305-02-0012-7
[Table II]
Figure 108136858-A0305-02-0012-7

圖5繪示本發明實施例之VR裝置的控制方法的流程示意圖。以下將配合圖6與圖2來說明。首先,在步驟S100,此VR裝置10將進行啟動。接著,在步驟S102,當使用者戴上VR裝置後,檢測使用者的眼距IPD,例如透過上述的影像偵測部(IR攝影機)與控制部來進行。 FIG. 5 is a schematic flowchart of a control method of a VR device according to an embodiment of the present invention. The following will be described in conjunction with FIG. 6 and FIG. First, in step S100, the VR device 10 will be activated. Next, in step S102, after the user wears the VR device, the user's eye distance IPD is detected, for example, through the aforementioned image detection unit (IR camera) and control unit.

接著,在步驟S104,產生與IPD對應的最小虛像成像距離Min D view 。並且,在步驟S106,基於步驟S104產生的最小虛像成像距離Min D view ,產生對應的實像成像距離D point 。接著,在步驟S108,基於步驟S106產生實像成像距離D point 來改變可撓式顯示面板的曲度。在此,眼距IPD與最小虛像成像距離Min D view 之對應關係以及最小虛像成像距離Min D view 與實像成像距離D point 之間的關係,例如可以透過查詢表的方式來進行。 Next, in step S104, a minimum virtual image imaging distance Min D view corresponding to the IPD is generated. And, in step S106, based on the minimum virtual image imaging distance Min D view generated in step S104, a corresponding real image imaging distance D point is generated. Next, in step S108, the curvature of the flexible display panel is changed based on the real image imaging distance D point generated in step S106. Here, the corresponding relationship between the eye distance IPD and the minimum virtual image imaging distance Min D view and the relationship between the minimum virtual image imaging distance Min D view and the real image imaging distance D point can be performed through a lookup table, for example.

此外,關於步驟S110,其為一選擇性步驟。當可撓式顯示面板12的曲度變得較大,此時會產生如圖4A所示的情況,使用者可能無法觀賞可撓式顯示面板12的兩側邊緣影像(如圖4A之不可視區域40)。此時,在步驟S110,將依據產生的實像成像距離D point ,在可撓式顯示面板12的兩側邊上形成黑屏30(如圖4B所示)。此外,步驟S110更進一步調整可撓式顯示面板12的解析度,使影像可以呈現在可撓式顯示面板12之的兩側黑屏30之間的顯示區域12a。使用者便可以完整地觀賞VR裝置10所呈現 的影像。 In addition, regarding step S110, it is an optional step. When the curvature of the flexible display panel 12 becomes larger, a situation as shown in FIG. 4A will occur at this time, and the user may not be able to view the images on both sides of the flexible display panel 12 (the invisible area in FIG. 4A). 40). At this time, in step S110, black screens 30 will be formed on both sides of the flexible display panel 12 according to the generated real image imaging distance D point (as shown in FIG. 4B). In addition, step S110 further adjusts the resolution of the flexible display panel 12 so that the image can be presented in the display area 12 a between the black screens 30 on both sides of the flexible display panel 12. The user can then fully watch the image presented by the VR device 10.

此外,關於是否加上黑屏,一種可實施的方式例如是將實像成像距離D point ,與一臨界值D th 做比較,當D point >D th ,表示可撓式顯示面板12有可能受到較大的彎折,故需要進行加黑屏(黑邊)與調整解析度的程序。 In addition, with regard to whether to add a black screen, an implementable way is to compare the real image imaging distance D point with a threshold value D th . When D point > D th , it means that the flexible display panel 12 may be more affected. It is necessary to add black screen (black border) and adjust the resolution program.

圖6繪示本發明實施例之VR裝置的電路方塊示意圖。在本實施例中,控制部20與影像偵測部14耦接,影像偵測部14更包括第一偵測部14a和第二偵測部14b。在本實施例中,第一偵測部14a和第二偵測部14a是用來對使用者的眼睛進行偵測、拍攝等動作,當然也可執行VR裝置10的其他需要擷取影像的功能。控制部20更耦接可撓式顯示面板12和調整機構16,調整機構16則更進一步耦接到可撓式顯示面板12。 FIG. 6 is a schematic block diagram of a circuit of a VR device according to an embodiment of the present invention. In this embodiment, the control part 20 is coupled to the image detection part 14, and the image detection part 14 further includes a first detection part 14a and a second detection part 14b. In this embodiment, the first detecting portion 14a and the second detecting portion 14a are used to detect and photograph the user's eyes. Of course, other functions of the VR device 10 that need to capture images can also be performed. . The control part 20 is further coupled to the flexible display panel 12 and the adjustment mechanism 16, and the adjustment mechanism 16 is further coupled to the flexible display panel 12.

如圖2與圖6所示,在上述的架構下,當使用者戴上VR裝置10並且啟動後,第一偵測部14a與第二偵測部14b(在此實施例為IR攝影機)便會分別對使用者的兩眼拍照,產生影像資料。控制部20會依據此影像資料來計算並產生使用者的眼距IPD。接著,控制部20產生與該眼距IPD相對應的最小虛像成像距離Min D view ,此最小虛像成像距離Min D view 。此最小虛像成像距離Min D view 是可以讓使用者在使用VR裝置時,眼睛最為舒適而部會疲憊的虛像成像距離。根據一實施例,最小虛像成像距離Min D view 的產生可以利用查表的方法,例如在控制部20內設置如上面表一的查詢表(lookup table)。 As shown in FIGS. 2 and 6, under the above-mentioned architecture, when the user puts on the VR device 10 and starts it, the first detecting portion 14a and the second detecting portion 14b (in this embodiment are IR cameras) The two eyes of the user will be taken separately to generate image data. The control unit 20 calculates and generates the user's eye distance IPD based on the image data. Next, the control unit 20 generates a minimum virtual image imaging distance Min D view corresponding to the eye distance IPD, and this minimum virtual image imaging distance Min D view . This minimum virtual image imaging distance Min D view is the virtual image imaging distance that allows the user to use the VR device with the most comfortable eyes and fatigue. According to an embodiment, the generation of the minimum virtual image imaging distance Min D view may use a lookup table method, for example, a lookup table as shown in Table 1 above is set in the control unit 20.

接著,控制部20可以依據最小虛像成像距離Min D view 。與實像成像距離D point 的對應關係,產生對應的實像成像距離D point 。這也可以利用在控制部內建查詢表來達成。接著,控制部20依據上述對應的實像成像距 離D point ,產生控制訊號給調整機構16,亦或給馬達18。此時,馬達18可以基於控制訊號,來驅動拉伸機構19之伸縮軸,使拉伸機構19被拉伸到與上述實像成像距離D point 相應的刻度,亦即刻度P1~P5的其中之一。藉此,可撓式顯示面板12透過被拉伸,而改變其曲度。 Then, the control unit 20 can be based on the minimum virtual image imaging distance Min D view . The corresponding relationship with the real image imaging distance D point produces a corresponding real image imaging distance D point . This can also be achieved by building a lookup table in the control unit. Then, the control unit 20 generates a control signal to the adjusting mechanism 16 or the motor 18 according to the corresponding real image imaging distance D point . At this time, the motor 18 can drive the telescopic shaft of the stretching mechanism 19 based on the control signal, so that the stretching mechanism 19 is stretched to the scale corresponding to the above-mentioned real image imaging distance D point , that is, one of the scales P1~P5 . In this way, the flexible display panel 12 is stretched to change its curvature.

如上所述,當曲度改變後,實像成像距離D point 的也會跟著改變,進行虛像成像距離D view 也會跟著改變。改變後的虛像成像距離D view 也將大於或等於最小虛像成像距離Min D view ,亦即使用者將在最佳的條件下觀賞VR裝置10提供的影像,而不會容易產生暈眩或疲憊。 As mentioned above, when the curvature changes, the real image imaging distance D point will also change, and the virtual image imaging distance D view will also change accordingly. The changed virtual image imaging distance D view will also be greater than or equal to the minimum virtual image imaging distance Min D view , that is, the user will view the image provided by the VR device 10 under the best conditions without being prone to dizziness or fatigue.

此外,當實像成像距離D point 增大到一個程度,而使可撓式顯示面板12的曲度變得較大,此時會產生如圖4A所示的情況,亦即對於使用者而言,可撓式顯示面板12的兩側邊緣影像可能無法觀賞,亦即不可視區域40。此時,控制部20將依據產生的實像成像距離D point ,在可撓式顯示面板12的兩側邊上形成黑屏30,如上述表二與圖4B所示。此外,控制部20還會相對應地調整可撓式顯示面板12的解析度。藉此,影像可以呈現在可撓式顯示面板12之的兩側黑屏30之間的顯示區域12a,使用者便可以完整地觀賞VR裝置10所呈現的影像,不會受到過度彎曲可撓式顯示面板12而產生不可視區域30的影響。 In addition, when the real image imaging distance D point is increased to a certain extent, and the curvature of the flexible display panel 12 becomes larger, the situation shown in FIG. 4A will occur at this time, that is, for the user, The images on both sides of the flexible display panel 12 may not be viewed, that is, the invisible area 40. At this time, the control unit 20 will form a black screen 30 on both sides of the flexible display panel 12 according to the generated real image imaging distance D point , as shown in Table 2 above and FIG. 4B. In addition, the control unit 20 also adjusts the resolution of the flexible display panel 12 accordingly. In this way, the image can be presented in the display area 12a between the black screens 30 on both sides of the flexible display panel 12, and the user can fully watch the image presented by the VR device 10 without being excessively bent. The panel 12 is affected by the invisible area 30.

通過本實施例,本發明的虛擬實境裝置及其控制方法能夠結合可撓式顯示面板之頭戴式VR裝置,其透過例如IR攝影機等偵測使用者之眼距(IPD),並找出相對應的最小虛像成像距離。藉此,可讓使用者獲得較舒適的觀賞品質。 Through this embodiment, the virtual reality device and control method of the present invention can be combined with a head-mounted VR device with a flexible display panel, which detects the user’s eye distance (IPD) through, for example, an IR camera, and finds out The corresponding minimum virtual image imaging distance. In this way, the user can obtain a more comfortable viewing quality.

10:VR裝置 10: VR device

11:本體 11: body

12:可撓式液晶顯示面板 12: Flexible LCD panel

14:影像偵測部 14: Image Detection Department

14a、14b:第一與第二偵測部 14a, 14b: the first and second detection parts

16:調整機構 16: adjustment mechanism

18:馬達 18: Motor

19:拉伸機構 19: Stretching mechanism

20:控制部 20: Control Department

IPD:眼距 IPD: Eye distance

E:人眼 E: Human eye

A:拉伸方向 A: Stretching direction

P1~P5:調整機構之刻度 P1~P5: Scale of adjustment mechanism

Claims (16)

一種虛擬實境裝置,包括:可撓式顯示面板,配設在所述虛擬實境裝置的本體內;影像偵測部,配設在所述虛擬實境裝置的所述本體內,且能對使用者的眼距進行偵測的位置;以及控制部,依據所述使用者的所述眼距,以改變所述可撓式顯示面板的曲度,其中所述控制部依據所述使用者的所述眼距,以虛像成像距離大於等於最小虛像成像距離的方式,改變所述可撓式顯示面板的所述曲度,其中所述最小虛像成像距離與所述眼距相對應。 A virtual reality device includes: a flexible display panel arranged in the main body of the virtual reality device; an image detection unit arranged in the main body of the virtual reality device and capable of The position at which the user’s eye distance is detected; and a control unit that changes the curvature of the flexible display panel according to the user’s eye distance, wherein the control unit is based on the user’s The eye distance changes the curvature of the flexible display panel in such a way that the virtual image imaging distance is greater than or equal to the minimum virtual image imaging distance, wherein the minimum virtual image imaging distance corresponds to the eye distance. 如申請專利範圍第1項所述的虛擬實境裝置,更包括調整機構,耦接至所述可撓式顯示面板,所述控制部依據所述使用者的所述眼距,控制所述調整機構來調整所述可撓式顯示面板的彎曲度。 The virtual reality device described in item 1 of the scope of patent application further includes an adjustment mechanism coupled to the flexible display panel, and the control unit controls the adjustment according to the eye distance of the user Mechanism to adjust the curvature of the flexible display panel. 如申請專利範圍第3項所述的虛擬實境裝置,其中所述調整機構更包括馬達與拉伸機構,其中所述馬達受控於所述控制部,以使所述拉伸機構拉伸所述可撓式顯示面板。 As described in item 3 of the scope of patent application, the adjustment mechanism further includes a motor and a stretching mechanism, wherein the motor is controlled by the control part to make the stretching mechanism stretch The flexible display panel. 如申請專利範圍第4項所述的虛擬實境裝置,其中所述調整機構耦接至所述可撓式顯示面板之長度方向的中線位置。 The virtual reality device described in claim 4, wherein the adjustment mechanism is coupled to a centerline position of the flexible display panel in the longitudinal direction. 如申請專利範圍第1項所述的虛擬實境裝置,所述控制部依據所述眼距以及與所述眼距相對應的實像成像距離,在所述 可撓式顯示面板之長邊方向的兩側邊加上黑屏,並調整所述可撓式顯示面板的解析度。 For the virtual reality device described in item 1 of the scope of the patent application, the control unit determines the distance between the eyes and the real image imaging distance corresponding to the eye distance. Black screens are added to both sides of the long side direction of the flexible display panel, and the resolution of the flexible display panel is adjusted. 如申請專利範圍第6項所述的虛擬實境裝置,其中所述黑屏的寬度基於每一個所述實像成像距離來設定。 The virtual reality device according to item 6 of the scope of patent application, wherein the width of the black screen is set based on each real image imaging distance. 如申請專利範圍第1項所述的虛擬實境裝置,其中該影像偵測部更包括第一偵測部與第二偵測部,分別偵測所述使用者的兩眼位置,以產生所述眼距。 For the virtual reality device described in claim 1, wherein the image detection unit further includes a first detection unit and a second detection unit, which respectively detect the positions of the eyes of the user to generate all State the eye distance. 如申請專利範圍第1項所述的虛擬實境裝置,其中所述第一偵測部與所述第二偵測部為紅外線攝影機。 The virtual reality device according to the first item of the scope of patent application, wherein the first detection unit and the second detection unit are infrared cameras. 如申請專利範圍第1項所述的虛擬實境裝置,其中所述可撓式顯示面板為可撓式液晶顯示面板。 In the virtual reality device described in item 1 of the scope of patent application, the flexible display panel is a flexible liquid crystal display panel. 一種虛擬實境裝置的控制方法,所述虛擬實境裝置配設有可撓式顯示面板,所述控制方法包括:偵測使用者的眼距;依據所述眼距,產生與所述眼距對應的最小虛像成像距離;產生與所述最小虛像成像距離相對應的實像成像距離;以及依據所述實像成像距離,調整所述可撓式顯示面板的所述曲度,使虛像成像距離大於等於所述最小虛像成像距離。 A control method of a virtual reality device, the virtual reality device is equipped with a flexible display panel, the control method includes: detecting a user's eye distance; according to the eye distance, generating a distance to the eye Corresponding minimum virtual image imaging distance; generating a real image imaging distance corresponding to the minimum virtual image imaging distance; and adjusting the curvature of the flexible display panel according to the real image imaging distance so that the virtual image imaging distance is greater than or equal to The minimum virtual image imaging distance. 如申請專利範圍第12項所述的虛擬實境裝置的控制方法,更包括:依據所述眼距以及與所述眼距相對應的所述實像成像距離,在所述可撓式顯示面板之長邊方向的兩側邊形成黑屏。 As described in item 12 of the scope of the patent application, the control method of the virtual reality device further includes: according to the eye distance and the real image imaging distance corresponding to the eye distance, setting between the flexible display panel Black screens are formed on both sides in the longitudinal direction. 如申請專利範圍第13項所述的虛擬實境裝置的控制方法,更包括當所述實像成像距離大於臨界值時,在所述可撓式顯示面板之長邊方向的兩側邊形成所述黑屏。 As described in item 13 of the scope of patent application, the control method of the virtual reality device further includes forming the two sides of the flexible display panel on both sides of the long-side direction when the real image imaging distance is greater than a critical value. Black screen. 如申請專利範圍第13項所述的虛擬實境裝置的控制方法,更包括調整所述可撓式顯示面板的解析度,使影像呈現在所述可撓式顯示面板兩側的所述黑屏之間的顯示區域。 As described in item 13 of the scope of patent application, the control method of the virtual reality device further includes adjusting the resolution of the flexible display panel so that images appear on one of the black screens on both sides of the flexible display panel. Between the display area. 如申請專利範圍第13項所述的虛擬實境裝置的控制方法,其中所述黑屏的寬度基於每一個所述實像成像距離來設定。 The control method of the virtual reality device as described in the scope of patent application, wherein the width of the black screen is set based on each real image imaging distance. 如申請專利範圍第15項所述的虛擬實境裝置的控制方法,其中所述實像成像距離越大,所述黑屏的寬度越寬。 According to the control method of the virtual reality device described in the scope of patent application, the greater the real image imaging distance, the wider the width of the black screen. 如申請專利範圍第15項所述的虛擬實境裝置的控制方法,其中所述可撓式顯示面板為可撓式液晶顯示面板。 According to the control method of the virtual reality device described in item 15 of the scope of patent application, the flexible display panel is a flexible liquid crystal display panel.
TW108136858A 2019-10-14 2019-10-14 Virtual reality device and contorl method thereof TWI715242B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW108136858A TWI715242B (en) 2019-10-14 2019-10-14 Virtual reality device and contorl method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW108136858A TWI715242B (en) 2019-10-14 2019-10-14 Virtual reality device and contorl method thereof

Publications (2)

Publication Number Publication Date
TWI715242B true TWI715242B (en) 2021-01-01
TW202116065A TW202116065A (en) 2021-04-16

Family

ID=75237280

Family Applications (1)

Application Number Title Priority Date Filing Date
TW108136858A TWI715242B (en) 2019-10-14 2019-10-14 Virtual reality device and contorl method thereof

Country Status (1)

Country Link
TW (1) TWI715242B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102340636A (en) * 2010-07-14 2012-02-01 深圳Tcl新技术有限公司 Stereoscopic picture self-adaptive display method
CN104407461A (en) * 2014-11-26 2015-03-11 深圳市华星光电技术有限公司 Curved surface liquid crystal display device
US20160100158A1 (en) * 2014-10-07 2016-04-07 Top Victory Investments Ltd. Display Device with Curved Display Function
CN108337497A (en) * 2018-02-07 2018-07-27 刘智勇 A kind of virtual reality video/image format and shooting, processing, playing method and device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102340636A (en) * 2010-07-14 2012-02-01 深圳Tcl新技术有限公司 Stereoscopic picture self-adaptive display method
US20160100158A1 (en) * 2014-10-07 2016-04-07 Top Victory Investments Ltd. Display Device with Curved Display Function
CN104407461A (en) * 2014-11-26 2015-03-11 深圳市华星光电技术有限公司 Curved surface liquid crystal display device
CN108337497A (en) * 2018-02-07 2018-07-27 刘智勇 A kind of virtual reality video/image format and shooting, processing, playing method and device

Also Published As

Publication number Publication date
TW202116065A (en) 2021-04-16

Similar Documents

Publication Publication Date Title
TWI413979B (en) Method for adjusting displayed frame, electronic device, and computer program product thereof
TWI697692B (en) Near eye display system and operation method thereof
TWI661226B (en) Method for reducing motion blur and head mounted display apparatus
TWI486631B (en) Head mounted display and control method thereof
US20190138092A1 (en) Display apparatus
US9310614B2 (en) Head mounted display and imaging method thereof
US9360936B2 (en) Head mounted display apparatus
TWI507729B (en) Eye-accommodation-aware head mounted visual assistant system and imaging method thereof
CN107650799A (en) A kind of head-up display, head-up display system and its display methods, automobile
TW201208345A (en) Viewing glasses, 3D display system and image beam adjustment method thereof
JP4951751B2 (en) Pointing apparatus and method based on pupil detection
CN110140077A (en) Vision auxiliary equipment
CN106792180A (en) Control method capable of adjusting curvature of curved surface display
JPH08166557A (en) Head mounted display device
JP2013148599A (en) Display device
TWI715242B (en) Virtual reality device and contorl method thereof
TWI683134B (en) Image display method of head-mounted display apparatus and head-mounted display apparatus
CN110794590A (en) Virtual reality display system and display method thereof
JP2017146373A (en) Image display device
CN211786414U (en) Virtual reality display system
TWI725574B (en) Head mounted display and a display method for an eye-tracking cursor
JP3325323B2 (en) Display device
TW201830217A (en) Display adjustment method and electronic device
TW202213994A (en) Augmented reality system and display brightness adjusting method thereof
Hwang et al. 23.4: Augmented Edge Enhancement for Vision Impairment using Google Glas