US20200278551A1 - Head-mounted personal multimedia systems and visual assistance devices thereof - Google Patents
Head-mounted personal multimedia systems and visual assistance devices thereof Download PDFInfo
- Publication number
- US20200278551A1 US20200278551A1 US16/874,679 US202016874679A US2020278551A1 US 20200278551 A1 US20200278551 A1 US 20200278551A1 US 202016874679 A US202016874679 A US 202016874679A US 2020278551 A1 US2020278551 A1 US 2020278551A1
- Authority
- US
- United States
- Prior art keywords
- diopter
- user
- unit
- head
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 230000000007 visual effect Effects 0.000 title claims abstract description 55
- 210000001508 eye Anatomy 0.000 claims abstract description 69
- 230000004044 response Effects 0.000 claims abstract description 7
- 238000001514 detection method Methods 0.000 claims description 34
- 230000004886 head movement Effects 0.000 claims description 3
- 208000003464 asthenopia Diseases 0.000 abstract description 10
- 230000004308 accommodation Effects 0.000 abstract description 7
- 210000000695 crystalline len Anatomy 0.000 description 45
- 239000011521 glass Substances 0.000 description 28
- 230000002350 accommodative effect Effects 0.000 description 26
- 238000010586 diagram Methods 0.000 description 18
- 230000008859 change Effects 0.000 description 16
- 238000000034 method Methods 0.000 description 16
- 230000007613 environmental effect Effects 0.000 description 15
- 230000006870 function Effects 0.000 description 14
- 230000008901 benefit Effects 0.000 description 11
- 238000004590 computer program Methods 0.000 description 10
- 238000012937 correction Methods 0.000 description 10
- 208000001491 myopia Diseases 0.000 description 9
- 230000004379 myopia Effects 0.000 description 9
- 230000003287 optical effect Effects 0.000 description 8
- 230000000694 effects Effects 0.000 description 7
- 238000012545 processing Methods 0.000 description 7
- 101100268671 Caenorhabditis elegans acc-4 gene Proteins 0.000 description 6
- 206010020675 Hypermetropia Diseases 0.000 description 6
- 201000006318 hyperopia Diseases 0.000 description 6
- 230000004305 hyperopia Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 238000003860 storage Methods 0.000 description 5
- 210000003128 head Anatomy 0.000 description 4
- 230000001771 impaired effect Effects 0.000 description 4
- 238000010079 rubber tapping Methods 0.000 description 4
- 238000013459 approach Methods 0.000 description 3
- 239000013256 coordination polymer Substances 0.000 description 3
- 230000007423 decrease Effects 0.000 description 3
- 230000005489 elastic deformation Effects 0.000 description 3
- 230000036316 preload Effects 0.000 description 3
- 201000010041 presbyopia Diseases 0.000 description 3
- 230000035945 sensitivity Effects 0.000 description 3
- 230000004304 visual acuity Effects 0.000 description 3
- 206010013082 Discomfort Diseases 0.000 description 2
- 208000004350 Strabismus Diseases 0.000 description 2
- 201000009310 astigmatism Diseases 0.000 description 2
- 210000005252 bulbus oculi Anatomy 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 230000004438 eyesight Effects 0.000 description 2
- 238000005286 illumination Methods 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 239000000123 paper Substances 0.000 description 2
- 201000009487 Amblyopia Diseases 0.000 description 1
- 208000002177 Cataract Diseases 0.000 description 1
- 206010010356 Congenital anomaly Diseases 0.000 description 1
- 206010047513 Vision blurred Diseases 0.000 description 1
- 230000032683 aging Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 206010002537 anisometropia Diseases 0.000 description 1
- 230000003466 anti-cipated effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000001886 ciliary effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000008602 contraction Effects 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 231100000040 eye damage Toxicity 0.000 description 1
- 208000030533 eye disease Diseases 0.000 description 1
- 210000000887 face Anatomy 0.000 description 1
- 230000004907 flux Effects 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 238000002513 implantation Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000005304 joining Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 239000012528 membrane Substances 0.000 description 1
- 210000003205 muscle Anatomy 0.000 description 1
- 239000011664 nicotinic acid Substances 0.000 description 1
- 230000008506 pathogenesis Effects 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 230000002250 progressing effect Effects 0.000 description 1
- 230000000644 propagated effect Effects 0.000 description 1
- 210000001747 pupil Anatomy 0.000 description 1
- 208000014733 refractive error Diseases 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000004382 visual function Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0179—Display position adjusting means not related to the information to be displayed
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0179—Display position adjusting means not related to the information to be displayed
- G02B2027/0185—Displaying image at variable distance
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0179—Display position adjusting means not related to the information to be displayed
- G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
Definitions
- the present invention relates in general to a head-mounted personal multimedia system and a visual assistance device, and more particularly, to a head-mounted personal multimedia system and a visual assistance device featuring a diopter adjustment unit to induce eyes of a user to perform physiological accommodation movements to alleviate eye fatigue, for example.
- Head-mounted personal multimedia systems may be referred from Oculus Rift or HTC Vive.
- modular products such as Google Cardboard, which may be manually assembled with other accessories (e.g., a mobile phone) into a head-mounted personal multimedia system.
- CN205038406 U or CN205103492 U discloses a similar solution, which features an optical focal adjustment portion for adjusting a focus to replace glasses of a user, so as to adapt to applications of different visually impaired individuals.
- one targeted technical issue and a corresponding solution brought up in the CN205038406 U or CN205103492 U of the prior art are that, when a user applies a current head-mounted personal multimedia system, assuming that the level of physiological accommodation movements of the user's eyes is restricted (e.g., due to myopia or hyperopia), if an image still cannot be clearly seen after performing physiological accommodation movements to the extremes, the user may again clearly see the image through an auxiliary refractive power provided by adjusting the optical focal adjustment portion that adjusts a focal length.
- VFE variable focus element
- a VFE device disposed outside a body causes an issue of a variable spectacle magnification as a focal length changes; that is, an image perceived by human eyes suddenly becomes big and suddenly becomes small. This causes obvious discomforts, or even leads to an issue of anisometropia.
- a head-mounted personal multimedia system and a visual assistance device are provided according to an aspect of the present invention.
- the present invention further considers, in a head-mounted multimedia system, although the above conventional technical solutions do assist a visually impaired user to clearly view an image, the crystalline lenses of the eyes of the user usually do not need to perform elastic deformation movements to adjust the focal length once the user is able to clearly view the image. In other words, the crystalline lens at this point is kept at a fixed focal length.
- the crystalline lens is also kept at a fixed focal length over an extended period of time, hence leading to eye fatigue or even eye damage. This problem aggravates when a head-mounted personal multimedia system is used because the viewing distance is closer to that for reading.
- the present invention provides a solution, one feature of which being that, the crystalline lens is prevented from being kept at a fixed focal length given that a user is able to clearly view an image.
- a diopter adjustment unit is disposed between the eyes and the image to provide the eyes with diopter.
- the crystalline lens is induced to perform physiological accommodation movements to adjust its focal length (i.e., the diopter) to thereby alleviate eye fatigue.
- the diopter provided by the diopter adjustment unit is correspondingly changed according to a change in a region of interest (ROI) of the user in an image.
- the diopter of the eyes also changes with a change in the gaze direction of the user, as if viewing objects in the real world, with the objects located close and distant.
- the disposed diopter adjustment unit may provide a greater diopter to provide a greater focusing capability, such that the eyes are caused to adjust to a lower diopter, as if the eyes are viewing a distant scene in the real world.
- the disposed diopter adjustment unit may provide a lower diopter to provide a smaller focusing capability, such that the eyes are caused to adjust to a greater diopter, as if the eyes are viewing a near scene in the real world.
- the diopter provided by the diopter adjustment unit may be further changed according to luminance information of the image. For example, for a brighter image (e.g., a scene showing the daylight), the disposed diopter adjustment unit may provide a greater diopter to provide a greater focusing capability, such that the eyes are caused to adjust to a lower diopter, as if viewing the daylight in the real world.
- the diopter adjustment unit may provide a lower diopter to cause the eyes to adjust to a greater diopter, as if the eyes are viewing the nighttime in the real world.
- the diopter provided by the diopter adjustment unit is further configured according to user data.
- the diopter adjustment unit provides, for example, a user with normal vision and a myopic user, an elderly and an infant, or even a left eye and a right eye of a user, preferably with different diopters, and so the method and magnitude of the adjustment may also be different.
- the sensitivity and magnitude of the diopter adjustment unit may be limited.
- the diopter adjustment unit is inclined to dynamic qualitative adjustment instead of quantitative adjustment, based on different individuals.
- the present invention provides outstanding effects on public hygiene. For young and teenager users who are not myopic but are prone to myopic conditions, the present invention reduces crystalline lens fatigue and hence the probability of myopic pathogenesis. Further, it should be noted that, although being different from the foregoing disclosures of CN205038406 U and CN205103492 U, the present invention and the above disclosures are not mutually exclusive, and may even be integrated with one another.
- the diopter adjustment unit may also make up the shortage in the diopter through the diopter adjustment unit when the user cannot clearly see the image or a related scene due to, for example, myopia; that is, an effect similar to wearing correction glasses is achieved—such adjustment is quantitative.
- a visually impaired (e.g., myopic) user preventing the crystalline lens from kept at a fixed focal length is even more needed. Therefore, the present invention provides more substantial benefits on this issue as opposed to the prior art.
- the present invention is applicable to VR, AR and MR systems.
- a user needs to view an image or information that the system provides at a close distance as well as an outside scene at a far distance.
- the diopter adjustment unit may dynamically adjust the diopter to prevent eye fatigue; when the user views an outside scene at a far distance, the diopter adjustment unit may make up the shortage in the diopter to allow the user to clearly see the scene at a far distance.
- the present invention further considers the issue that a spectacle magnification in a head-mounted personal multimedia system changes with the change in the focusing capability caused from adjusting the diopter.
- a viewable area of the image in the head-mounted personal multimedia system is correspondingly adjusted in response to the diopter that the diopter adjustment unit provides to counteract the issue of the change in the spectacle magnification.
- a distance between a display surface of the image in the head-mounted personal multimedia system and the eyes of the user is correspondingly adjusted in response to the diopter that the diopter adjustment unit provides to counteract the issue of the change in the spectacle magnification.
- FIG. 1 is showing a perspective schematic view of an embodiment of the invention
- FIG. 2 is showing a perspective view of an embodiment of the invention
- FIG. 3 is showing a default and modified visual accommodative compensation value curve diagram view of an embodiment of the invention
- FIG. 4 is showing a default and modified visual accommodative compensation value curve diagram view of an embodiment of the invention
- FIG. 5 is showing a curve's relationship adjustment amount the accommodative compensation value and object distance diagram view of an embodiment of the invention
- FIG. 6 is showing a curve's relationship adjustment time of the accommodative compensation value and object distance diagram view of an embodiment of the invention
- FIG. 7 is showing a default curve in relate focal length and age diagram view of an embodiment of the invention.
- FIG. 8 is showing another perspective schematic view of an embodiment of the invention.
- FIG. 9 is showing a head-mounted personal multimedia system according to an embodiment of the present invention.
- FIGS. 11 a and 11 b are showing a visual assistance device according to an embodiment of the present invention.
- FIG. 12 is showing a function block diagram of a head-mounted personal multimedia system according to an embodiment of the present invention.
- FIGS. 13 a and 13 b are showing images having different luminance presented by a head-mounted personal multimedia system according to an embodiment of the present invention.
- the computer-usable or computer-readable medium may be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium.
- the computer-readable medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a transmission media such as those supporting the Internet or an intranet, or a magnetic storage device.
- RAM random access memory
- ROM read-only memory
- EPROM or Flash memory erasable programmable read-only memory
- CD-ROM compact disc read-only memory
- CD-ROM compact disc read-only memory
- a transmission media such as those supporting the Internet or an intranet, or a magnetic storage device.
- a computer-usable or computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted, or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory.
- a computer-usable or computer-readable medium may be any medium that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
- the computer-usable medium may include a propagated data signal with the computer-usable program code embodied therewith, either in baseband or as part of a carrier wave.
- the computer usable program code may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc.
- These computer program instructions may also be stored in a computer-readable medium that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable medium produce an article of manufacture including instruction means which implement the function/act specified in the flowchart and/or block diagram block or blocks.
- the computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
- each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures.
- an exemplary auto-focus glasses with visual accommodative compensation system is to provide a better visual experience for everyone in needs under various viewing scenario.
- the environmental sensor is constantly detecting and gathering information of viewing objects' distance, light intensity and surrounding environment. All these data are sent to processor modular for analyzing and comparing with default visual accommodative compensation values or personal settings from autodidactic modular, and regulator modular automatically adjusts the focus accordingly. If current adjustment dose not match current user's request, the user can activate the learning mode to amend until optimum setting is satisfied, and the new data is added to the system.
- the exemplary embodiment is constructed into a glass frame, which has a lens modular and a regulator modular embed on the each side of the glasses frame.
- power connector modular that connecting with regulator modular for focus adjustment
- environmental sensor modular which obtain the brightness of the light source and the distance between the target object and glasses. All data are sent to processor modular for analyzing.
- the processor modular calculates various optimum real-time personal focal length as ACVs, accommodative compensation values, and adjustment feedback values send to the regulator modular for focal adjustment.
- the default ACVs data which stored in the memory modular for processor modular to verify during analyzing, have been created based on age, object distance, environmental brightness and refractive power.
- FIG. 1 there are a glasses frame 1 and a pair of lens space 10 . Inside each of the lens space 10 , there are a regulator modular 11 and a lens modular 12 .
- Lens modular 12 contains with a custom-made lens to correct the basic refractive error such as myopia, hyperopia, astigmatism and strabismus. Since there are many methods of lens construction, lens modular 12 could be, but not limited to, made by referring to the U.S. Pat. No. 7,934,831, which is used here as applicability description.
- This embodiment further contains an electrical connection between power source 13 and regulator modular 11 in the glasses frame 1 ; the regulator modular 11 holds the focal adjustment for lens modular 12 .
- the power source 13 can be charged up with mini-USB or other forms of wireless or wire connector.
- Environmental sensor 2 at glasses frame 1 , detects and sends target object distance and surrounding brightness values to processor modular 3 for analyzing.
- Processor modular 3 calculates focal length from ACC 4 , and sends to regulator modular 11 for the movement position of lens modular 12 , in order to obtain the optimum visual clarity.
- the default ACC 4 has been created to match with age and eye examination, as seen in FIG. 7 , and stored in memory modular 5 for processor modular 3 to verify in the course. Furthermore, the default ACC 4 was set according to different age group, gender, race and ophthalmological parameters.
- User data is modified with default ACC, including environmental brightness, object distance and refractive power from processor module's 3 algorithm; these data will be uploaded to the cloud data center for big data analysis. As the result, the system can be more accurate as more users joining to the cloud data.
- the cloud data is updated by wireless connections.
- the processor modular 3 can predict the usage scenario and to pre-calculate the adjustment values in real-time, according to various living scenario, environmental brightness and personal health.
- processor modular 3 and memory modular 5 can link with wireless device 5 or personal portable device 4 , such as mobile phone, and interact with cloud database.
- other portable or wearable device which is able to detect image or brightness of the user's surrounding, can be a sharing extension, providing various reference information for lens modular 12 movement. By doing this, it can be not only saving energy, but also reducing the calculation payload to the processor.
- the autodidactic modular 16 inside the glasses frame 1 , is connected to processor modular 3 as well.
- the autodidactic modular 16 can activate processor module's 3 learning mode, which gathers the current object distance, environmental brightness and modified focal value for the user to memory modular 5 , by tapping on the frame.
- processor module's 3 learning mode which gathers the current object distance, environmental brightness and modified focal value for the user to memory modular 5 , by tapping on the frame.
- the learning mode there are predict and manual mode can be selected from the numbers of tapping on the fame. After few seconds of operation, the learning mode will automatically turn off to save power.
- the system adjusts lens modular 12 to decrease or increase the focal length and to raise or reduce the refractive power from the current feedback.
- the processor modular 3 will record new focal length and current brightness to that specific object distance to memory modular 5 and turn off the learning mode. In future use, when user faces similar condition, the system will automatically recognize and adjust to user's preferable personal ACVs settings.
- the system will detect the changing distance between object and glasses. At certain distance, 27 cm, and brightness, 275Lux (illumination units: square meters of area ratio of luminous flux Im/m 2 ), ACV system provided +2.75 D focal adjustment for the presbyopia user, but the user did not like with the default settings.
- the user can activate the learning mode and move his/her head or the object closer for certain distance, i.e. 2 cm.
- the environmental sensor 2 will detect the difference and showing user's original status of tendency toward hyperopia.
- the increase in brightness can cause pupil contraction, and the visual depth of field and focal adjustment sensitivity will increase. Therefore, in the same distance of 27 cm and the brightness of 650 lux, the refractive power will be reduced to +2.25 D, as [27 cm, +2.25 D, 650 lux].
- Accommodative compensation values 4 can be in table or graphic form.
- the database of visual ACC was built on several factors in various living condition and age. Under different viewing distance, environmental brightness and user's habit, the focal adjustment change can be as accurate as ⁇ 0.10 diopter unit precisely.
- the big data of visual ACVs contains many user groups' characteristic data.
- Visual ACC 4 comes from the preset values of the database. Each characteristic data can be pre-stored in memory modular 5 or downloaded from the cloud server 5 , corresponding to optometry parameters, eyeball structure measure or age.
- the processor modular 3 will analysis incoming sound, light or electromagnetic waves to decide focal adjustment corresponding to the environmental brightness and viewing distance; this process can release the natural crystalline lens' burden while accommodation, as FIG. 5 and FIG. 6 .
- a head-mounted personal multimedia system 100 shown in the embodiment in FIG. 9 is a modular product.
- the head-mounted personal multimedia system 100 includes a frame 102 for accommodating or disposing various required modular units.
- the frame 102 may accommodate, for example but not limited to, a mobile phone 300 having a display screen 150 , e.g., an Apple iPhone.
- the mobile phone 300 may serve as a multimedia player of the head-mounted personal multimedia system 100 to display images or play videos
- the display screen 150 may serve as a display unit of the head-mounted personal multimedia system 100 to display images to a user.
- the frame 102 may include a conductive wire (not shown) connected to an input/output (I/O) port of the mobile phone 300 to allow other modular units to signally communicate with the mobile phone 300 .
- the signal communication between other modular units on the frame and the mobile phone 300 may also be performed directly or indirectly through wireless signals (e.g., Bluetooth).
- the head-mounted personal multimedia system 100 includes a gaze detection unit 110 disposed on the frame 102 .
- implementation details of the gaze detection unit 110 may be referred from those disclosed in U.S. Pat. No. 8,487,838 B2 or U.S. Pat. No. 6,456,262B1, but are not limited thereto. These details are omitted herein.
- the gaze detection unit 110 may be implemented on the mobile phone 300 , i.e., shared with the mobile phone 300 . Associated details may be referred from AMAZON FIRE PHONE by AMAZON.
- the above function units may all be individually detachably disposed on the frame 102 .
- the gaze detection unit 110 , the diopter adjustment unit 104 and the control unit 106 are pre-assembled into a visual assistance device 160 , which includes a storage housing 162 in form of a cartridge that can be inserted onto or removed from the frame 102 by the user as desired, as shown in FIG. 10 . That is, the mobile phone 300 in FIG. 9 may be insertingly disposed on the frame 102 and be later removed as desired.
- a visual assistance device 170 which similarly includes a storage housing 172 similar to a cartridge, as shown in FIG. 11 b .
- the visual assistance device 170 may be further assembled onto the frame 102 or removed from the frame 102 by the user.
- the visual assistance device 160 or the visual assistance device 170 does not necessarily include a thin-type storage housing in form of a cartridge, and the present invention may include other shape designs and implementation methods in addition to the above.
- a position for installing the visual assistance device 160 or the visual assistance device 170 needs to locate the diopter adjustment unit 104 between the image and the eyes of the user to allow the diopter adjustment unit 104 to fully exercise its effect.
- the head-mounted personal multimedia system 100 selectively further includes a user data unit 108 , which has a memory for storing one or multiple sets of user data.
- the user data unit 108 first indexes user names or user identities (IDs). For each user, the corresponding user data that the user data unit 108 stores for this user may include age, gender, eye disease data (e.g., the degree of myopia) and/or user preferences. It is understood that, similar to the control unit 106 , the user data unit 108 may be implemented at a local end or at a remote end. In one embodiment, the user data unit 108 may be integrated in the control unit 106 .
- the head-mounted personal multimedia system 100 further includes a user ID identification unit 109 , which, for example, identifies the name or ID of the user through fingerprints of the user or requesting the user to enter a password.
- the user data unit 108 or the user ID identification unit 109 may also be implemented through the mobile phone 300 .
- Corresponding details may be referred from Touch ID used on Apple iPhone. It is understood that, a fingerprint recognition device 109 similar to Touch ID may also be directly disposed on the frame 102 , as shown in FIG. 10 .
- the ID of the user is first identified by the user ID identification unit 109 , and the user data unit 108 verifies the user data corresponding to the user according to the ID of the user and provides the user data to the control unit 106 .
- the control unit 106 selects an appropriate control profile, e.g., a control file CP 1 , from multiple pre-loaded control profiles CP 1 to CPn.
- the control unit 106 determines the diopter that it is to control the diopter adjustment unit 104 to provide from the control profile (e.g., implemented by a look-up table (LUT)) according to data currently being accessed (e.g., data fed in by the gaze detection unit 110 or the luminance detection 120 , with associated details to be given shortly). It is anticipated that, the diopter the diopter adjustment unit 104 provides dynamically changes as the data the control unit 106 obtains differs or changes.
- the control profile e.g., implemented by a look-up table (LUT)
- data currently being accessed e.g., data fed in by the gaze detection unit 110 or the luminance detection 120 , with associated details to be given shortly. It is anticipated that, the diopter the diopter adjustment unit 104 provides dynamically changes as the data the control unit 106 obtains differs or changes.
- control unit 106 may pre-load data of distribution statuses and corresponding depths of image elements in an image that the user views.
- the control unit 106 may determine which image elements in the image that the user focuses on—associated details may be referred from the U.S. Pat. No. 6,456,262B1.
- the control unit 106 may selectively pre-load image histogram data of pixels of an image the user views as luminance data of the image, or as luminance data of particular regions in the image.
- images shown in FIG. 13 a and FIG. 13 b are similar, both having an object A and an object B.
- FIG. 13 a shows a daylight scene, i.e., the average luminance of the image is higher.
- FIG. 13 b shows a nighttime scene, i.e., the average luminance of the image is lower.
- images shown in FIG. 13 a and FIG. 13 b may be digital photographs (e.g., a panoramic photograph) or a frame of a video.
- FIG. 13 a is to be first described.
- the object A and the object B are present, with the depth of the object A set to be greater than the depth of the object B.
- the object A is set as a far scene and the object B is set as a near scene, relatively speaking.
- the control unit 106 further performs scene recognition on the image to generate the depth information of the object A and the object B in the image.
- the object A is recognized as a mountain and thus is automatically set as a far scene and assigned a greater depth accordingly.
- control unit 106 determines the diopter, e.g., 2.5 D, it is to control the diopter adjustment unit 104 to provide according to the control profile CP 1 .
- the control unit 106 determines the diopter, e.g., 1.25 D, it is to control the diopter adjustment unit 104 to provide according to the control profile CP 1 .
- respective distances from the object A and the object B to the eyes of the user i.e., a distance from the display surface to the eyes of the user, are substantially the same.
- the diopter 2.5 D provided by the diopter adjustment unit 104 allows the user to clearly see the object A
- the user is theoretically also able to clearly see the object B without having to adjust the diopter to 1.25 D.
- the focal length of the crystalline lens is kept the same focal length.
- the eyes when the user focuses on the object A set as a far scene, the eyes are caused to adjust to a lower diopter because the diopter adjustment unit 104 provides a diopter having a greater focusing capability, as if the eyes are viewing a far scene in the real world.
- the eyes when the user focuses on the object B set as a near scene, the eyes are caused to adjust to a greater diopter because the diopter adjustment unit 104 provides a diopter having a smaller focusing capability, as if the eyes are viewing a near scene in the real world.
- the diopter provided by the diopter adjustment unit 104 also changes, and so the focal length of the crystalline lens is also caused to change instead of being kept at a constant focal length, thereby alleviating eye fatigue.
- the diopter may be a positive or negative value—a positive value of the diopter indicates the presence of a focusing capability, and a negative value of the diopter indicates an opposite effect, i.e., a dispersing capability.
- the focusing capability corresponding to a diopter +6.00 D is greater than the focusing capability corresponding to a diopter +3.00 D
- the focusing capability corresponding to a diopter +2.00 D is greater than the focusing capability corresponding to a diopter ⁇ 3.00 D
- the focusing capability corresponding to a diopter ⁇ 3.00 D is greater than the focusing capability corresponding to a diopter ⁇ 5.00 D.
- FIG. 13 b is similar to FIG. 13 a , and the same repeated details are omitted herein. One difference between them is that, the image of FIG. 13 b has a lower luminance, and so the diopter adjustment unit provides a diopter having a smaller focusing capability to cause the eyes to adjust to a diopter having a greater focusing capability, as if the eyes are viewing at the nighttime of the real world.
- control unit 106 when the control unit 106 similarly determines that the user focuses on the object A set as a far scene, the control unit 106 at this point determines the diopter, e.g., 1.5 D, it is to control the diopter adjustment unit 104 to provide according to the control profile CP 1 , with the focusing capability of the diopter 1.5 D being lower than that of the diopter 2.5 D provided when the user focuses on the object A in FIG. 13 a (of the daylight).
- the diopter e.g. 1.5 D
- control unit 106 When the control unit 106 similarly determines that the user focuses on the object B set as a near scene in the image, the control unit 106 at this point determines the diopter, e.g., 0.25 D, it is to control the diopter adjustment unit 104 to provide according to the control profile CP 1 , with the focusing capability of the diopter 0.25 D being lower than that of the diopter 1.25 D provided when the user focuses on the object A in FIG. 13 a (of the daylight).
- the diopter e.g. 0.25 D
- the control unit 106 may select different control profiles, e.g., a control profile CP 2 .
- a control profile CP 2 For example, when it is similarly determined that another user focuses on the object A set as a far scene in the image in FIG. 13 a , the control unit 106 determines the diopter, e.g., 3D instead of 2.5 D in the foregoing example, it is to control the diopter adjustment unit 104 to provide according to the control profile CP 2 .
- the control unit 106 determines that the user focuses on the object B set as a near scene in the image in FIG. 13 a
- the control unit 106 determines the diopter, e.g., 1.5 D instead of 1.25 D in the foregoing example, it is to control the diopter adjustment unit 104 to provide according to the control profile CP 2 .
- the control unit 106 determines the diopter it is to control the diopter adjustment unit 104 to provide according to the average luminance of the entire image.
- the control unit 106 may determine a region in the image that the user focuses on (i.e., a region of interest (ROI)) according to the detection result of the gaze detection unit 110 .
- ROI region of interest
- the control unit 106 may also determine the diopter it is to control the diopter adjustment unit 104 to provide according to the average luminance of the ROI (instead of the entire image).
- control unit 106 does not pre-load the luminance information of the image.
- control unit 106 may be connected to the luminance detection unit 120 , and generate luminance data according to a metering result of the luminance detection unit 120 .
- Such method is beneficial for application scenarios of AR or MR because the eyes of the user further sense external ambient light beams in addition to the luminance of the image.
- the luminance detection unit 120 may target at parts in the display surface that are closer to the eyes to perform metering.
- each of the control profiles CP 1 -CPn may specify a variable range and a variance sensitivity (the magnitude that the diopter increases or decreases per unit time) of the diopter.
- a variance sensitivity the magnitude that the diopter increases or decreases per unit time
- the diopter that the diopter adjustment unit 104 provides according to the control profile CP 1 may be set to vary within a range between +0 D and +9.00 D, and the variance magnitude may be set to not exceed 1 D per second.
- the diopter that the diopter adjustment unit 104 provides according to the control profile CP 2 may be set to vary within a range between +0.25 D and +8.00 D, and the variance magnitude may be set to not exceed 0.75 D per second.
- a moderate variance is preferably set for presbyopia of the elderly.
- values of the parameters in each of the control profiles CP 1 -CPn may be designed with consideration of hardware restrictions of the diopter adjustment unit 104 as well as user needs and preferences, or may be designed according to optometry and correction results, and are not limited by the present invention. Further, in an embodiment where the diopter adjustment unit 104 individually adjusts for left and right eyes, each of the parameters in each of the control profiles CP 1 -CPn may be include different setting values for left and right eyes—such approach is preferred because degrees of myopia for left and right eyes of a user are usually different, for example.
- the diopter that the diopter adjustment unit 104 provides may be designed to vary within a range between ⁇ 3.00 D and +6.00 D.
- basic myopic degrees may be corrected at the same time to allow the user to apply the head-mounted personal multimedia system 100 without wearing glasses.
- the diopter that the diopter adjustment unit 104 provides is still set to vary within a range between 0 D and +9.00 D.
- the head-mounted personal multimedia system 100 may additionally provide a correction lens (not shown) that can be inserted or removed as desired on an optical path to provide a diopter, e.g., ⁇ 3.00 D.
- the total diopter that the diopter adjustment unit 104 and the correction lens (when inserted in an optical path) jointly provide varies within a range between ⁇ 3.00 D and +6.00 D.
- the diopter a correction lens provides is usually a constant value, whereas the diopter adjustment unit 104 may provide a dynamically changing diopter.
- an approach of the CN205038406 U or CN 205103492 U may also be referred and applied to correct a basic degree of myopia.
- the head-mounted personal multimedia system 100 further includes a position tracking unit 130 .
- the position tracking unit 130 may detect head movements of the user, particularly but not limited to, forward and backward head movements of the user.
- Implementation details of the position tracking unit 130 may be referred from Oculus Rift or HTC Vive, or US20090237355, and are not limited by the present invention.
- the movement data detected by the position tracking unit 130 is also fed to the control unit 106 as parameters for the control unit 106 control the diopter adjustment unit 104 .
- the position tracking unit 130 primarily assists the gaze detection unit 110 .
- the control unit 106 is capable of more accurately determine the object that the user focuses on to determine a more appropriate diopter. For example, assuming that the position tracking unit 130 detects that the head of the user is tilted forward, the control unit 106 may accordingly determine that the user wishes to more carefully view the object as a near scene in the image; assuming that the position tracking unit 130 detects that the user continues walking towards a front-left direction, the control unit 106 may accordingly determine that the user is interested in the object at the left in the image.
- the depth of the object in the image originally set may be correspondingly changed according to the direction and distance of the user detected by the position tracking unit 130 ; that is, an object originally set as a far scene may gradually get “close to” the user to become a near scene.
- the diopter the diopter adjustment unit 104 provides may be correspondingly adjusted and reduced (i.e., the eyes are caused to adjust to a diopter having a greater focusing capability).
- the control unit 106 may further appropriately control the variance magnitude of the diopter the diopter adjustment unit 104 provides according to a moving speed of the user.
- control unit 106 is further signally connected to and controls the display screen 150 .
- the control unit 106 controls the diopter adjustment unit 104 to provide different diopters, in response to the issue of a spectacle magnification change, it at the same time controls the display screen 150 to zoom in or zoom out the image provided to the user by different display regions.
- the control unit 106 initially determines that the user focuses on the object B set as a near scene in the image, and controls the diopter adjustment unit 104 to provide a diopter, e.g., ⁇ 2.5 D.
- the control unit 106 When the control unit 106 later determines that the user switches to focus on the object A set as a far scene in the image, it controls the diopter adjustment unit 104 to provide a diopter, e.g., 3.5 D. However, compared to a diopter ⁇ 2.5 D, the control unit 106 at this point also controls the display screen 150 to provide the user with a smaller image (e.g., by turning off (or displaying black by) the pixels at an outer periphery of the display screen 150 and displaying the image by only central pixels, or decreasing the viewable area of the image through other methods) to counteract an enlarging effect caused by the increased diopter. In general, a 1 D change in the diopter produces 1.5% magnification change.
- the display screen 150 further includes a stepping motor (not shown) to fine tune the distance between the display surface and the eyes of the user.
- a stepping motor not shown to fine tune the distance between the display surface and the eyes of the user.
- FIG. 13 a when the user views the object B (with the diopter set as ⁇ 2.5 D) set as a near scene and suddenly views the object A (with the diopter set as 3.5 D) set as a far scene, a variance of 6 D is resulted. Without any adjustment, the image perceived by the user is suddenly enlarged by 9%.
- the control unit 106 further controls the display screen 150 to increase the distance between its display surface and the eyes of the user (e.g., by 1 cm) to counteract such enlarging effect.
- the level of magnification change caused by the diopter differs based on individuals and the devices applied, and so the scaling (zooming in/out) ratio actually performed on the image on the screen is only accurate through personalized correction.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
Abstract
Disclosed are head-mounted personal multimedia systems and visual assistance devices thereof, which are featured with a diopter adjustment unit to configurably provide various diopters for the user's eye(s) to watch. In order to watch clearly the picture displayed by a fixed-range display surface, the user's eyes can perform physiological accommodation movements in response to the diopters dynamically configured by the diopter adjustment unit, so that the eye fatigue could be prevented.
Description
- This application is a continuation of U.S. patent application Ser. No. 16/621,852, filed Jun. 13, 2017; which claims the priority of Taiwan Patent Application 105118695, filed on Jun. 15, 2016 and Taiwan Patent Application 105128987, filed on Sep. 7, 2016. The subject matter of these applications is incorporated herein by reference.
- The present invention relates in general to a head-mounted personal multimedia system and a visual assistance device, and more particularly, to a head-mounted personal multimedia system and a visual assistance device featuring a diopter adjustment unit to induce eyes of a user to perform physiological accommodation movements to alleviate eye fatigue, for example.
- Head-mounted personal multimedia systems may be referred from Oculus Rift or HTC Vive. In additional to the above packaged products, there are modular products, such as Google Cardboard, which may be manually assembled with other accessories (e.g., a mobile phone) into a head-mounted personal multimedia system.
- Technologies of head-mounted personal multimedia systems are currently constantly progressing. For example, for a visually impaired person, e.g., a person with myopia or hyperopia, glasses cannot be worn while using a current head-mounted personal multimedia system such as Oculus Rift. In response, the CN205038406 U or CN205103492 U discloses a similar solution, which features an optical focal adjustment portion for adjusting a focus to replace glasses of a user, so as to adapt to applications of different visually impaired individuals.
- It should be noted that, one targeted technical issue and a corresponding solution brought up in the CN205038406 U or CN205103492 U of the prior art are that, when a user applies a current head-mounted personal multimedia system, assuming that the level of physiological accommodation movements of the user's eyes is restricted (e.g., due to myopia or hyperopia), if an image still cannot be clearly seen after performing physiological accommodation movements to the extremes, the user may again clearly see the image through an auxiliary refractive power provided by adjusting the optical focal adjustment portion that adjusts a focal length. Similarly, “Near-eye light field displays.” ACM Transactions on Graphics (TOG) 32.6 (2013): 220, by Lanman, Douglas and David Luebke, also handles the issue of being unable to focus when an image in a head-mounted personal multimedia system is located too close to the eyes.
- Further, for example, the US 20150235439 A1 discloses various solutions including a variable focus element (VFE).
- Meanwhile, it should be noted that, a VFE device disposed outside a body causes an issue of a variable spectacle magnification as a focal length changes; that is, an image perceived by human eyes suddenly becomes big and suddenly becomes small. This causes obvious discomforts, or even leads to an issue of anisometropia.
- A head-mounted personal multimedia system and a visual assistance device are provided according to an aspect of the present invention.
- In general, when a person views an object, a focal length needs to be accordingly switched as the viewed object becomes close or distant. One principle behind is that, as light beams pass the crystalline lens in the eyeball, the ciliary muscle causes the crystalline lens to perform elastic deformation movements to adjust the focal length. In response, the present invention further considers, in a head-mounted multimedia system, although the above conventional technical solutions do assist a visually impaired user to clearly view an image, the crystalline lenses of the eyes of the user usually do not need to perform elastic deformation movements to adjust the focal length once the user is able to clearly view the image. In other words, the crystalline lens at this point is kept at a fixed focal length. However, when reading or watching television for an extended period of time, the crystalline lens is also kept at a fixed focal length over an extended period of time, hence leading to eye fatigue or even eye damage. This problem aggravates when a head-mounted personal multimedia system is used because the viewing distance is closer to that for reading.
- In view of the above, the present invention provides a solution, one feature of which being that, the crystalline lens is prevented from being kept at a fixed focal length given that a user is able to clearly view an image. For example, a diopter adjustment unit is disposed between the eyes and the image to provide the eyes with diopter. Through the dynamically adjusted diopter provided, in order to have the eyes of the user clearly see the image, the crystalline lens is induced to perform physiological accommodation movements to adjust its focal length (i.e., the diopter) to thereby alleviate eye fatigue.
- In other words, even if a myopic user wears contact lenses and does not need the conventional solution disclosed by the CN205038406 U or CN205103492 U, the user may again encounter the issue of eye fatigue caused by keeping the crystalline lens at a fixed focal length for an extended period of time when the user uses the head-mounted personal multimedia system. Therefore, the user may still enjoy the benefits the present invention provides.
- Particularly, in the present invention, the diopter provided by the diopter adjustment unit is correspondingly changed according to a change in a region of interest (ROI) of the user in an image. In other words, the diopter of the eyes also changes with a change in the gaze direction of the user, as if viewing objects in the real world, with the objects located close and distant. For example, when the ROI of the user in the image is a distant scene, the disposed diopter adjustment unit may provide a greater diopter to provide a greater focusing capability, such that the eyes are caused to adjust to a lower diopter, as if the eyes are viewing a distant scene in the real world. In contrast, when the ROI of the user in the image is a near scene (e.g., a portrait), the disposed diopter adjustment unit may provide a lower diopter to provide a smaller focusing capability, such that the eyes are caused to adjust to a greater diopter, as if the eyes are viewing a near scene in the real world.
- Further, to allow the eyes of the user to perform elastic deformation movements as when viewing objects in the real world while the user wears a head-mounted personal multimedia system, in another embodiment of the present invention, apart from or in addition to according to the gaze direction of the user or the ROI of the user in the image, the diopter provided by the diopter adjustment unit may be further changed according to luminance information of the image. For example, for a brighter image (e.g., a scene showing the daylight), the disposed diopter adjustment unit may provide a greater diopter to provide a greater focusing capability, such that the eyes are caused to adjust to a lower diopter, as if viewing the daylight in the real world. In contrast, for a dimmer image (e.g., a scene showing the nighttime), the diopter adjustment unit may provide a lower diopter to cause the eyes to adjust to a greater diopter, as if the eyes are viewing the nighttime in the real world.
- On the other hand, due to different eye conditions of users, in another embodiment of the present invention, the diopter provided by the diopter adjustment unit is further configured according to user data. It is understandable that, the diopter adjustment unit provides, for example, a user with normal vision and a myopic user, an elderly and an infant, or even a left eye and a right eye of a user, preferably with different diopters, and so the method and magnitude of the adjustment may also be different. Particularly, in one embodiment, to prevent drastic physiological accommodation movements of the crystalline lens, the sensitivity and magnitude of the diopter adjustment unit may be limited. In other word, in this embodiment, the diopter adjustment unit is inclined to dynamic qualitative adjustment instead of quantitative adjustment, based on different individuals.
- The present invention provides outstanding effects on public hygiene. For young and teenager users who are not myopic but are prone to myopic conditions, the present invention reduces crystalline lens fatigue and hence the probability of myopic pathogenesis. Further, it should be noted that, although being different from the foregoing disclosures of CN205038406 U and CN205103492 U, the present invention and the above disclosures are not mutually exclusive, and may even be integrated with one another. For example, in one embodiment, in addition to continuously dynamically adjusting the diopter provided to prevent eye fatigue, the diopter adjustment unit may also make up the shortage in the diopter through the diopter adjustment unit when the user cannot clearly see the image or a related scene due to, for example, myopia; that is, an effect similar to wearing correction glasses is achieved—such adjustment is quantitative. Particularly, for a visually impaired (e.g., myopic) user, preventing the crystalline lens from kept at a fixed focal length is even more needed. Therefore, the present invention provides more substantial benefits on this issue as opposed to the prior art.
- Also based on the above factor, the present invention is applicable to VR, AR and MR systems. Especially in see-through systems such as AR and MR systems, a user needs to view an image or information that the system provides at a close distance as well as an outside scene at a far distance. With the present invention, for example, when the user views the image the system provides at a close distance, the diopter adjustment unit may dynamically adjust the diopter to prevent eye fatigue; when the user views an outside scene at a far distance, the diopter adjustment unit may make up the shortage in the diopter to allow the user to clearly see the scene at a far distance.
- In addition, the present invention further considers the issue that a spectacle magnification in a head-mounted personal multimedia system changes with the change in the focusing capability caused from adjusting the diopter. In one embodiment, a viewable area of the image in the head-mounted personal multimedia system is correspondingly adjusted in response to the diopter that the diopter adjustment unit provides to counteract the issue of the change in the spectacle magnification. In another embodiment, a distance between a display surface of the image in the head-mounted personal multimedia system and the eyes of the user is correspondingly adjusted in response to the diopter that the diopter adjustment unit provides to counteract the issue of the change in the spectacle magnification.
- Reference throughout this specification to features, advantages, or similar language does not imply that all of the features and advantages that may be realized with the present invention should be or are in any single embodiment of the invention. Rather, language referring to the features and advantages is understood to mean that a specific feature, advantage, or characteristic described in connection with an embodiment is included in at least one embodiment of the present invention. Thus, discussion of the features and advantages, and similar language, throughout this specification may, but do not necessarily, refer to the same embodiment.
- Furthermore, the described features, advantages, and characteristics of the invention may be combined in any suitable manner in one or more embodiments. One skilled in the relevant art will recognize that the invention may be practiced without one or more of the specific features or advantages of a particular embodiment. In other instances, additional features and advantages may be recognized in certain embodiments that may not be present in all embodiments of the invention.
- The following description, the appended claims, and the embodiments of the present invention further illustrate the features and advantages of the present invention.
-
FIG. 1 is showing a perspective schematic view of an embodiment of the invention; -
FIG. 2 is showing a perspective view of an embodiment of the invention; -
FIG. 3 is showing a default and modified visual accommodative compensation value curve diagram view of an embodiment of the invention; -
FIG. 4 is showing a default and modified visual accommodative compensation value curve diagram view of an embodiment of the invention; -
FIG. 5 is showing a curve's relationship adjustment amount the accommodative compensation value and object distance diagram view of an embodiment of the invention; -
FIG. 6 is showing a curve's relationship adjustment time of the accommodative compensation value and object distance diagram view of an embodiment of the invention; -
FIG. 7 is showing a default curve in relate focal length and age diagram view of an embodiment of the invention; -
FIG. 8 is showing another perspective schematic view of an embodiment of the invention; -
FIG. 9 is showing a head-mounted personal multimedia system according to an embodiment of the present invention; -
FIG. 10 is showing a head-mounted personal multimedia system according to an embodiment of the present invention; -
FIGS. 11a and 11b are showing a visual assistance device according to an embodiment of the present invention; -
FIG. 12 is showing a function block diagram of a head-mounted personal multimedia system according to an embodiment of the present invention; and -
FIGS. 13a and 13b are showing images having different luminance presented by a head-mounted personal multimedia system according to an embodiment of the present invention. - Reference throughout this specification to “one embodiment,” “an embodiment,” or similar language means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, appearances of the phrases “in one embodiment,” “in an embodiment,” and similar language throughout this specification may, but do not necessarily, all refer to the same embodiment.
- As will be appreciated by one skilled in the art, the present invention may be embodied as a computer system/device, a method or a computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a “circuit,” “module” or “system.” Furthermore, the present invention may take the form of a computer program product embodied in any tangible medium of expression having computer-usable program code embodied in the medium.
- Any combination of one or more computer usable or computer readable medium(s) may be utilized. The computer-usable or computer-readable medium may be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a transmission media such as those supporting the Internet or an intranet, or a magnetic storage device. Note that the computer-usable or computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted, or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory. In the context of this document, a computer-usable or computer-readable medium may be any medium that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. The computer-usable medium may include a propagated data signal with the computer-usable program code embodied therewith, either in baseband or as part of a carrier wave. The computer usable program code may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc.
- Computer program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the “C” programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer or server may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
- The present invention is described below with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
- These computer program instructions may also be stored in a computer-readable medium that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable medium produce an article of manufacture including instruction means which implement the function/act specified in the flowchart and/or block diagram block or blocks.
- The computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
- Referring now to
FIG. 1 throughFIG. 13b , computer systems/devices, methods, and computer program products are illustrated as structural or functional block diagrams or process flowcharts according to various embodiments of the present invention. The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. - <Auto-Focus Glasses with Visual Accommodative Compensation System>
- Referring to
FIGS. 1 to 8 , an exemplary auto-focus glasses with visual accommodative compensation system, is to provide a better visual experience for everyone in needs under various viewing scenario. The environmental sensor is constantly detecting and gathering information of viewing objects' distance, light intensity and surrounding environment. All these data are sent to processor modular for analyzing and comparing with default visual accommodative compensation values or personal settings from autodidactic modular, and regulator modular automatically adjusts the focus accordingly. If current adjustment dose not match current user's request, the user can activate the learning mode to amend until optimum setting is satisfied, and the new data is added to the system. In addition, the system will create a custom assisted-refractive-power values as the accommodative compensation values (ACVs) in physiological visual accommodative compensation, which is going to increase the focusing adjustment speed in future use. Therefore, the user will have a faster, accurate and comfortable assisted visual experience, and it can reduce the requirement of accommodative movement from the natural crystalline lens. Moreover, this embodiment can be used not only on the myopia prevention, but also for visual training in strabismus and amblyopia. Also, patients, who have undergone the cataract removal and intraocular lens implantation, can be benefited as well. - To meet the object above, the exemplary embodiment is constructed into a glass frame, which has a lens modular and a regulator modular embed on the each side of the glasses frame. Inside the glasses frame, there are power connector modular, that connecting with regulator modular for focus adjustment, and environmental sensor modular, which obtain the brightness of the light source and the distance between the target object and glasses. All data are sent to processor modular for analyzing. The processor modular calculates various optimum real-time personal focal length as ACVs, accommodative compensation values, and adjustment feedback values send to the regulator modular for focal adjustment. The default ACVs data, which stored in the memory modular for processor modular to verify during analyzing, have been created based on age, object distance, environmental brightness and refractive power. Hence, from the time of use, the system in the autodidactic modular, which creates an optimum customized ACVs through recording and analyzing, can provide individual user the most comfortable focal length in varies environmental scenarios. The processor modular and the memory modular, which could be embedded in the glasses frame, can interact with the cloud device or personal portable device thought the wireless connection embedded in the glasses frame.
- In
FIG. 1 , there are a glasses frame 1 and a pair oflens space 10. Inside each of thelens space 10, there are a regulator modular 11 and a lens modular 12. Lens modular 12 contains with a custom-made lens to correct the basic refractive error such as myopia, hyperopia, astigmatism and strabismus. Since there are many methods of lens construction, lens modular 12 could be, but not limited to, made by referring to the U.S. Pat. No. 7,934,831, which is used here as applicability description. - This embodiment further contains an electrical connection between
power source 13 and regulator modular 11 in the glasses frame 1; the regulator modular 11 holds the focal adjustment for lens modular 12. Thepower source 13 can be charged up with mini-USB or other forms of wireless or wire connector.Environmental sensor 2, at glasses frame 1, detects and sends target object distance and surrounding brightness values to processor modular 3 for analyzing. Processor modular 3 calculates focal length from ACC 4, and sends to regulator modular 11 for the movement position of lens modular 12, in order to obtain the optimum visual clarity. - The default ACC 4 has been created to match with age and eye examination, as seen in
FIG. 7 , and stored in memory modular 5 for processor modular 3 to verify in the course. Furthermore, the default ACC 4 was set according to different age group, gender, race and ophthalmological parameters. User data is modified with default ACC, including environmental brightness, object distance and refractive power from processor module's 3 algorithm; these data will be uploaded to the cloud data center for big data analysis. As the result, the system can be more accurate as more users joining to the cloud data. The cloud data is updated by wireless connections. In addition, another major point of this embodiment is the processor modular 3 can predict the usage scenario and to pre-calculate the adjustment values in real-time, according to various living scenario, environmental brightness and personal health. - In the glasses frame 1, processor modular 3 and memory modular 5 can link with
wireless device 5 or personal portable device 4, such as mobile phone, and interact with cloud database. Moreover, other portable or wearable device, which is able to detect image or brightness of the user's surrounding, can be a sharing extension, providing various reference information for lens modular 12 movement. By doing this, it can be not only saving energy, but also reducing the calculation payload to the processor. - The autodidactic modular 16, inside the glasses frame 1, is connected to processor modular 3 as well. The autodidactic modular 16 can activate processor module's 3 learning mode, which gathers the current object distance, environmental brightness and modified focal value for the user to memory modular 5, by tapping on the frame. In the learning mode, there are predict and manual mode can be selected from the numbers of tapping on the fame. After few seconds of operation, the learning mode will automatically turn off to save power.
- The
environmental sensor 2 can detect surroundings, and the system will synchronal adjust the focal length appropriately. Furthermore, if a presbyopia user requires 5.0 D focal adjustment under certain brightness and distance, the processor modular 3 will activate regulator modular 11 to drive the focal length changes of lens modular 12. However, if the user's vision dose not satisfied with the default setting, the user can activate the learning mode by tapping on the glasses frame to make a correction. During the correction process, the regulator modular 11 will stop the current adjustment, and the user can move the object or head position to obtain the best subjective viewing distance. Also, theenvironmental sensor 2 will detect the distance differences and transmit data to processor modular 3 for customizing ACVs from default ACVs. Then the system adjusts lens modular 12 to decrease or increase the focal length and to raise or reduce the refractive power from the current feedback. Hence, the processor modular 3 will record new focal length and current brightness to that specific object distance to memory modular 5 and turn off the learning mode. In future use, when user faces similar condition, the system will automatically recognize and adjust to user's preferable personal ACVs settings. - For example, in learning mode, the system will detect the changing distance between object and glasses. At certain distance, 27 cm, and brightness, 275Lux (illumination units: square meters of area ratio of luminous flux Im/m2), ACV system provided +2.75 D focal adjustment for the presbyopia user, but the user did not like with the default settings. The user can activate the learning mode and move his/her head or the object closer for certain distance, i.e. 2 cm. At user's best visual clarity, for instance movement pause for few seconds, the
environmental sensor 2 will detect the difference and showing user's original status of tendency toward hyperopia. The processor modular 3 will keep the new record of +2.75 D focal adjustment with new distance (27 cm-2 cm=25 cm) at 275Lux for future use, as [25 cm, +2.75 D, 275 lux]. Moreover, the processor modular 3 will calculate and reduce the focus length to increase the positive refractive power, such as reducing 0.25 D, to +2.50 D under the current corresponding distance, 27 cm, and brightness, 275Lux. Hence, next time, when specific distance, 27 cm, and brightness, 275Lux, occur, ACV system will provide +2.50 D focal adjustment instead of +2.75 for user, as [27 cm, +2.50 D, 275 lux]. Therefore, the ACV system will learn at least two new coordinates and adjustment values through one process, each time. Furthermore, the increase in brightness can cause pupil contraction, and the visual depth of field and focal adjustment sensitivity will increase. Therefore, in the same distance of 27 cm and the brightness of 650 lux, the refractive power will be reduced to +2.25 D, as [27 cm, +2.25 D, 650 lux]. - This embodiment gradually gains the accurate accommodative compensation values 4 feedback from everyday use.
- Even without visual ACC, user is able to directly adjust lens modular 12 through autodidactic modular 16 for the best visual acuity by sliding forward touching on the glasses frame 1; the lens modular 12 will reduce the focal length to increase the positive reflective power, and vice versa. After the best visual acuity is set, by tapping on the glasses frame 1 again, processor modular 3 will save the setting to memory modular 5 and turn off the learning mode. The memory modular 5 will record the current brightness, distance and focal length values for automatic feedback on the next similar scenario. Above description is for explanatory purpose only, but not limit to specific method. As the result, this embodiment has autodidactic ability. The relation for before and after adjustment is presented as
FIG. 3 andFIG. 4 . - The
environmental sensor 2 detects object distance, light intensity and surrounding information. All these information are sent to processor modular 3 for analyzing and comparing with default visual accommodative compensation data 4 or personal settings from the autodidactic modular 16, and regulator modular 11 automatically adjusts the focus accordingly. If current adjustment dose not match current user's need, the user can activate the learning mode to amend until optimum setting is satisfied, and the new data is added to the system in memory modular 5. In addition, the system will create a costumed assisted-refractive-power values in physiological visual accommodative compensation, which is going to significantly increase the focusing adjustment speed in future use. Moreover, the learning mode can dynamically adjust focal value, and it can provide better visual reaction for elder or user, who has fatigue eye or congenital focal adjustment difficulty. - Accommodative compensation values 4 can be in table or graphic form. The database of visual ACC was built on several factors in various living condition and age. Under different viewing distance, environmental brightness and user's habit, the focal adjustment change can be as accurate as ±0.10 diopter unit precisely. The big data of visual ACVs contains many user groups' characteristic data. Visual ACC 4 comes from the preset values of the database. Each characteristic data can be pre-stored in memory modular 5 or downloaded from the
cloud server 5, corresponding to optometry parameters, eyeball structure measure or age. The processor modular 3 will analysis incoming sound, light or electromagnetic waves to decide focal adjustment corresponding to the environmental brightness and viewing distance; this process can release the natural crystalline lens' burden while accommodation, asFIG. 5 andFIG. 6 . - The accommodative amplitude is the change range of reflective power in visual function. For example, 5.0 D means the crystalline lens lose the adjustment ability at certain range permanently or in a period of time, due to fatigue, aging, or various reasons. This causes hyperopia to have difficulty to see closer object. Therefore, the regulator modular 11, a motor or other modular in glasses frame 1, can work as coordinator slowly or instantly adjust as processor modular 3 required. Processor modular 3 can embed in the glasses frame 1 or as a software application in any portable or wearable device, such as smartphone or watch, with wireless or Bluetooth connection to command the regulator modular 11 for adjusting the lens modular 12. The lens modular, in this embodiment, can be as focal adjustable lens or electronic accommodative intraocular lens.
- As
FIG. 8 , this embodiment can work from modifying the default visual ACC 4 to the customized visual ACC 4, under autodidactic mode. The user is like getting an additional bionic crystalline lens, which assisting focal adjustment for visual experience. Therefore, this release the workload of natural crystalline lens accommodative movement in order to release eye fatigue. This embodiment is different from U.S. Pat. Nos. 8,474,976 and 8,628,193, because this embodiment has the ability to record and modify the refractive power requirement from focal adjustment. As the result, this embodiment is based on providing the realistic visual assisting functions to its user. - Whether myopia, hyperopia or astigmatism, after the basic diopter correction, the eyes still require accommodative ability for changing focus between near and far visual distances. 2. The following table is the accommodative demands under various distances and illumination. This embodiment is an automatic focusing eyewear for people, who lost the accommodative ability in sight. It can immediately satisfy the adjustment needs between near and far viewing distances. In order to fulfill the needs of the focal length switching under various visual distance, the table below shows at least +0.00 D˜+7.25 D accommodative amplitude for normal eye usage. Nevertheless, taking into account the individual accommodative demand, this embodiment provides a range of +0.00 D˜+9.00 D.
- The table below is for accommodative demand under various visual distances
-
The Distance area and Environment brightness with diopters EB (lux) Dis 50~75 75~100 100~150 150~200 200~300 400~500 500~600 (cm; m) (65) (80) (120) (180) (275) (485) (550) 10 m~∞ +0.000 D +0.000 D +0.000 D +0.000 D +0.000 D +0.000 D +0.000 D 0.9 m~10 m +0.125 D +0.125 D +0.125 D +0.125 D +0.025 D +0.025 D +0.000 D 80 cm~90 cm +0.500 D +0.500 D +0.250 D +0.250 D +0.250 D +0.125 D +0.000 D 70 cm~80 cm +1.000 D +1.000 D +0.875 D +0.850 D +0.750 D +0.625 D +0.500 D 43 cm~70 cm +1.500 D +1.500 D +1.375 D +1.300 D +1.250 D +1.125 D +1.000 D 33 cm~43 cm +1.875 D +1.750 D +1.750 D +1.750 D +1.750 D +1.625 D +1.625 D 30 cm~33 cm +2.250 D +2.125 D +2.000 D +2.000 D +2.000 D +2.000 D +1.875 D 27 cm~30 cm +2.750 D +2.875 D +2.500 D +2.450 D +2.375 D +2.375 D +2.250 D 25 cm~27 cm +3.8750 D +3.750 D +3.750 D +3.750 D +3.750 D +3.625 D +3.500 D 20 cm~25 cm +4.250 D +4.250 D +4.125 D +4.125 D +4.125 D +4.000 D +4.000 D 16 cm~20 cm +5.625 D +5.625 D +5.375 D +5.375 D +5.375 D +5.125 D +5.125 D 13 cm~16 cm +6.250 D +6.250 D +6.125 D +6.125 D +6.125 D +5.750 D +5.500 D 5 cm~13 cm +7.250 D +7.250 D +7.000 D +7.000 D +7.000 D +6.500 D +6.500 D EB (lux) Dis 600~750 750~1000 1000~1500 1500~5000 5000~100000 (cm; m) (700) (900) (1200) (3500) (30000) 10 m~∞ +0.000 D +0.000 D +0.000 D +0.000 D +0.000 D 0.9 m~10 m +0.000 D +0.000 D +0.000 D +0.000 D +0.000 D 80 cm~90 cm +0.000 D +0.000 D +0.000 D +0.000 D +0.000 D 70 cm~80 cm +0.500 D +0.375 D +0.375 D +0.250 D +0.125 D 43 cm~70 cm +0.875 D +0.750 D +0.625 D +0.500 D +0.475 D 33 cm~43 cm +1.625 D +1.500 D +1.375 D +1.250 D +1.000 D 30 cm~33 cm +1.875 D +1.750 D +1.625 D +1.550 D +1.500 D 27 cm~30 cm +2.250 D +2.125 D +2.125 D +2.125 D +2.000 D 25 cm~27 cm +3.500 D +3.250 D +3.250 D +3.125 D +3.000 D 20 cm~25 cm +3.875 D +3.875 D +3.650 D +3.500 D +3.500 D 16 cm~20 cm +5.125 D +5.000 D +5.000 D +5.000 D +5.000 D 13 cm~16 cm +5.500 D +5.375 D +5.375 D +5.250 D +5.250 D 5 cm~13 cm +6.250 D +6.125 D +6.125 D +6.125 D +6.125 D EB = Environment brightness (unit = lux); Dis = Distance area(unit = cm; m); D = Diopter - Assuming under normal condition, natural eye requires 3 seconds to acquire +4.25 D refractive power change for switching viewing object from 10 m to 25 cm. It is fast. However, at the same viewing condition from 10 m to 25 cm, presbyopic eye, only remaining+2.50 D accommodative amplitude, which unable to adapt as accommodative demand, needs 1 minute or more to adjust, due to decline in adjustment facility. Even with +1.75 D ordinary reading glasses, it does not change the fact of slow adjustment, still taking 1 minute or more to focus. On one hand, considering quality of life, presbyopic glasses has lose its meaning. On the other hand, this auto-focusing system embodiment can provide user with +4.25 D refractive power change in 3 seconds. Just like healthy eye, it can assist user rapidly switching focus accordingly in various visual distances. Because of diverse needs in individuals, this embodiment can self-learning personal adjustment data from human-machine interactions, amending preset values and recording personal visual baseline. Let each distance and environmental brightness have the best corrected visual acuity.
- To sum up, this exemplary auto-focal visual assisting system is provided through changing the focal length from focal adjustable lens modular and regulator modular. The ACVs data adjustment, which contains user's best subjective visual experience under various visual scenario, is relied on the autodidactic module's learning functions. This is different from the previous patents or current commercial manual focus adjustable glasses.
- <Head-Mounted Personal Multimedia System>
- <System Structure>
-
FIG. 9 shows a head-mountedpersonal multimedia system 100 according to an embodiment of the present invention, which may appear similar to a pair of glasses, for example, with reference to Oculus Rift, HTC Vive, and Google Cardboard. Further, implementation details not directly associated with the present invention may be referred from disclosures of the CN205038406 U, CN 205103492 U, US20100079356A1, US20150253574A1 and U.S. Pat. No. 9,122,321B2, and shall be omitted herein. It should be noted that, the head-mounted personal multimedia system may be a packaged product similar to Oculus Rift or HTC Vive, may be implemented similar to Google Cardboard, or may be a modular product disclosed in the US20100079356A1 and US20150253574A1. - A head-mounted
personal multimedia system 100 shown in the embodiment inFIG. 9 is a modular product. The head-mountedpersonal multimedia system 100 includes aframe 102 for accommodating or disposing various required modular units. As shown, in this embodiment, theframe 102 may accommodate, for example but not limited to, amobile phone 300 having adisplay screen 150, e.g., an Apple iPhone. When themobile phone 300 is accommodated in theframe 102, themobile phone 300 may serve as a multimedia player of the head-mountedpersonal multimedia system 100 to display images or play videos, and thedisplay screen 150 may serve as a display unit of the head-mountedpersonal multimedia system 100 to display images to a user. - In another embodiment not shown in the drawings, the head-mounted
personal multimedia system 100 may include exclusive player and display unit instead of sharing a player and a display unit with other devices (e.g., the mobile phone 300). The display unit exclusive to the head-mountedpersonal multimedia system 100 may be implemented by an LCD panel, an LED panel or a projection display. Details of a head-mounted personal multimedia system adopting a projection display may be referred from the U.S. Pat. No. 8,487,838 B2, in which a display surface of a display image is translucent. In addition to viewing a projected image or projected information, a user may also see an outside scene through the display surface. That is, it should be understood that, the head-mountedpersonal multimedia system 100 may be used in VR, AR or MR applications, and is not limited to a specific application field. It is also understood that, when a user wears the head-mountedpersonal multimedia system 100, regardless of the type of above display units adopted, a physical distance between a display surface provided and the eyes is substantially constant. The constant physical distance between the display surface provided and the eyes means that, without considering deviation caused by drastic vibrations of a head of the user, could be understood in a way similar to a substantially constant physical distance between conventional glasses and eyes. Therefore, in the head-mountedpersonal multimedia system 100, if without the solution provided by the present invention, the focal lengths of the crystalline lenses of the user are kept constant when the user views the image provided by the display surface, which causes eye fatigue over an extended period of time. - Further, the
frame 102 may include a conductive wire (not shown) connected to an input/output (I/O) port of themobile phone 300 to allow other modular units to signally communicate with themobile phone 300. In another embodiment, the signal communication between other modular units on the frame and themobile phone 300 may also be performed directly or indirectly through wireless signals (e.g., Bluetooth). - As shown in
FIG. 10 , the head-mountedpersonal multimedia system 100 includes agaze detection unit 110 disposed on theframe 102. In one embodiment, implementation details of thegaze detection unit 110 may be referred from those disclosed in U.S. Pat. No. 8,487,838 B2 or U.S. Pat. No. 6,456,262B1, but are not limited thereto. These details are omitted herein. In another embodiment, thegaze detection unit 110 may be implemented on themobile phone 300, i.e., shared with themobile phone 300. Associated details may be referred from AMAZON FIRE PHONE by AMAZON. - In addition to the
gaze detection unit 110, theframe 102 may selectively be disposed with aluminance detection unit 120. Theluminance detection unit 120 may be implemented as a photosensitive unit in any quantity, e.g., a CMOS image detection unit, a photoelectric diode unit or a CCD unit, and is not particularly limited by the present invention. It should be noted that, in the prior art, a head-mounted personal multimedia system further also includes a luminance detection unit that detects only the luminance in the environment. However, theluminance detection unit 120 in the embodiment of the present invention is for detecting the luminance of a display surface of a display unit (e.g., the display screen 150) that the user views as the luminance that the eyes of the user senses. Assuming that a display surface of an image is translucent, e.g., in an AR or MR application scenario, the luminance of the display surface may further include luminance contributed by external ambient light beams through the display surface in addition to the luminance of the projected image. Further, according to different embodiments, theluminance detection unit 120 may adopt different light metering modes for the display surface, and switch between the light metering modes based on requirements or user preferences. Associated details may be referred from light metering modes of a camera, e.g., dividing a display surface into multiple small matrix metering regions, or performing spot metering for specific areas; the present invention is not limited to the above examples. Preferably, the light metering mode adopted by theluminance detection unit 120 is capable of reflecting the luminance that the eyes sense. Thus, parts in the display surface that are closer to the eyes may be focused on and be given greater weightings, or light metering is performed only on these parts. - Particularly, the head-mounted
personal multimedia system 100 includes on the frame 102 adiopter adjustment unit 104, which is located between the display surface of the display unit (e.g., the display screen 150) and the eyes of the user. Thediopter adjustment unit 104 is configurable to provide different diopters while the user views an image, and may be dynamically switched among different diopters. In one embodiment, implementation details of thediopter adjustment unit 104 may be referred from US2015235439A1 disclosing details of a high-frequency zoom lens unit, which is implemented as a membrane deformable mirror and a corresponding driving device. The present invention is not limited thereto, and associated details shall be omitted herein. - The head-mounted
personal multimedia system 100 further includes acontrol unit 106 signally connected to and controlling other function units in the head-mountedpersonal system 100. Thecontrol unit 106 in general includes a microprocessor and a memory (not shown), and controls operations of thediopter adjustment unit 104 according to firmware or loaded programs and parameters. Implementation details of thecontrol unit 106 may be referred from a processing module and data module in the US2015235439A1, and are not limited to being implemented at a local end or a remote end. - It should be noted that, current smart phones are equipped with extremely powerful processing capabilities and data storage capabilities. Thus, in one embodiment, taking the mobile 300 in
FIG. 9 for example, its processing resources and data storage resources are sufficient for realizing thecontrol unit 106. In other words, themobile phone 300 may execute related Apps to control the operations of the head-mountedpersonal multimedia system 100. Therefore, the head-mountedpersonal multimedia system 100 is capable of implementing thecontrol unit 106 without needing additional processor and memory. Further, functions of thecontrol unit 106 are not limited to controlling only the operations of thediopter adjustment unit 104. - In a modular embodiment, the above function units may all be individually detachably disposed on the
frame 102. In another embodiment, as shown inFIG. 11a , thegaze detection unit 110, thediopter adjustment unit 104 and thecontrol unit 106 are pre-assembled into avisual assistance device 160, which includes astorage housing 162 in form of a cartridge that can be inserted onto or removed from theframe 102 by the user as desired, as shown inFIG. 10 . That is, themobile phone 300 inFIG. 9 may be insertingly disposed on theframe 102 and be later removed as desired. In another embodiment, only thediopter adjustment unit 104 and thecontrol unit 106 are pre-assembled into avisual assistance device 170, which similarly includes astorage housing 172 similar to a cartridge, as shown inFIG. 11b . Thus, thevisual assistance device 170 may be further assembled onto theframe 102 or removed from theframe 102 by the user. It should be understood that, thevisual assistance device 160 or thevisual assistance device 170 does not necessarily include a thin-type storage housing in form of a cartridge, and the present invention may include other shape designs and implementation methods in addition to the above. However, a position for installing thevisual assistance device 160 or thevisual assistance device 170 needs to locate thediopter adjustment unit 104 between the image and the eyes of the user to allow thediopter adjustment unit 104 to fully exercise its effect. - With the above approach, depending on the needs of the user, instead of being restricted to specific applications, the
visual assistance device 160 or thevisual assistance device 170 is applicable to current head-mounted personal multimedia systems, such as Google Cardboard, or head-mounted personal multimedia systems disclosed in the US20100079356A1 and US20150253574A1, or even simultaneously suitable for other optical visual devices, such as digital binoculars or microscopes. That is to say, thevisual assistance device 160 or thevisual assistance device 170 may serve as an external device that can be added or removed by the user. -
FIG. 12 shows a block diagram of the function of the head-mountedpersonal multimedia system 100. Operations of the head-mountedpersonal multimedia system 100 are to be further given withFIG. 12 , and parts not directly associated with the present invention are omitted herein. - The head-mounted
personal multimedia system 100 selectively further includes auser data unit 108, which has a memory for storing one or multiple sets of user data. Theuser data unit 108 first indexes user names or user identities (IDs). For each user, the corresponding user data that theuser data unit 108 stores for this user may include age, gender, eye disease data (e.g., the degree of myopia) and/or user preferences. It is understood that, similar to thecontrol unit 106, theuser data unit 108 may be implemented at a local end or at a remote end. In one embodiment, theuser data unit 108 may be integrated in thecontrol unit 106. - The head-mounted
personal multimedia system 100 further includes a userID identification unit 109, which, for example, identifies the name or ID of the user through fingerprints of the user or requesting the user to enter a password. It should be noted that, theuser data unit 108 or the userID identification unit 109 may also be implemented through themobile phone 300. Corresponding details may be referred from Touch ID used on Apple iPhone. It is understood that, afingerprint recognition device 109 similar to Touch ID may also be directly disposed on theframe 102, as shown inFIG. 10 . - In one embodiment, when the user starts using the head-mounted
personal multimedia system 100, the ID of the user is first identified by the userID identification unit 109, and theuser data unit 108 verifies the user data corresponding to the user according to the ID of the user and provides the user data to thecontrol unit 106. According to the verified user data, thecontrol unit 106 selects an appropriate control profile, e.g., a control file CP1, from multiple pre-loaded control profiles CP1 to CPn. When the user views an image, thecontrol unit 106 further determines the diopter that it is to control thediopter adjustment unit 104 to provide from the control profile (e.g., implemented by a look-up table (LUT)) according to data currently being accessed (e.g., data fed in by thegaze detection unit 110 or theluminance detection 120, with associated details to be given shortly). It is anticipated that, the diopter thediopter adjustment unit 104 provides dynamically changes as the data thecontrol unit 106 obtains differs or changes. - In one embodiment, particularly in one embodiment where the
control unit 106 is simultaneously implemented as a multimedia player, thecontrol unit 106 may pre-load data of distribution statuses and corresponding depths of image elements in an image that the user views. Thus, according to the gaze direction of the user as detected by thegaze detection unit 110, thecontrol unit 106 may determine which image elements in the image that the user focuses on—associated details may be referred from the U.S. Pat. No. 6,456,262B1. Thecontrol unit 106 may selectively pre-load image histogram data of pixels of an image the user views as luminance data of the image, or as luminance data of particular regions in the image. - Referring to
FIG. 13a andFIG. 13b , images shown inFIG. 13a andFIG. 13b are similar, both having an object A and an object B.FIG. 13a shows a daylight scene, i.e., the average luminance of the image is higher. In contrast,FIG. 13b shows a nighttime scene, i.e., the average luminance of the image is lower. It is understood that, images shown inFIG. 13a andFIG. 13b may be digital photographs (e.g., a panoramic photograph) or a frame of a video. -
FIG. 13a is to be first described. In the image, the object A and the object B are present, with the depth of the object A set to be greater than the depth of the object B. In other words, the object A is set as a far scene and the object B is set as a near scene, relatively speaking. In an embodiment, thecontrol unit 106 further performs scene recognition on the image to generate the depth information of the object A and the object B in the image. For example, the object A is recognized as a mountain and thus is automatically set as a far scene and assigned a greater depth accordingly. - When the
control unit 106 determines that the user focuses on the object A set as a far scene in the image according to the detection result of thegaze detection unit 110, thecontrol unit 106 determines the diopter, e.g., 2.5 D, it is to control thediopter adjustment unit 104 to provide according to the control profile CP1. When thecontrol unit 106 determines that the user focuses on the object B set as a near scene in the image, thecontrol unit 106 determines the diopter, e.g., 1.25 D, it is to control thediopter adjustment unit 104 to provide according to the control profile CP1. - It should be noted that, respective distances from the object A and the object B to the eyes of the user, i.e., a distance from the display surface to the eyes of the user, are substantially the same. Thus, when the diopter 2.5 D provided by the
diopter adjustment unit 104 allows the user to clearly see the object A, the user is theoretically also able to clearly see the object B without having to adjust the diopter to 1.25 D. However, at this point, the focal length of the crystalline lens is kept the same focal length. With the above embodiment of the present invention, when the user focuses on the object A set as a far scene, the eyes are caused to adjust to a lower diopter because thediopter adjustment unit 104 provides a diopter having a greater focusing capability, as if the eyes are viewing a far scene in the real world. In contrast, when the user focuses on the object B set as a near scene, the eyes are caused to adjust to a greater diopter because thediopter adjustment unit 104 provides a diopter having a smaller focusing capability, as if the eyes are viewing a near scene in the real world. Further, as the object or the region that the user focuses on changes, the diopter provided by thediopter adjustment unit 104 also changes, and so the focal length of the crystalline lens is also caused to change instead of being kept at a constant focal length, thereby alleviating eye fatigue. Further, it is understood that, the diopter may be a positive or negative value—a positive value of the diopter indicates the presence of a focusing capability, and a negative value of the diopter indicates an opposite effect, i.e., a dispersing capability. For example, the focusing capability corresponding to a diopter +6.00 D is greater than the focusing capability corresponding to a diopter +3.00 D, the focusing capability corresponding to a diopter +2.00 D is greater than the focusing capability corresponding to a diopter −3.00 D, and the focusing capability corresponding to a diopter −3.00 D is greater than the focusing capability corresponding to a diopter −5.00 D. -
FIG. 13b is similar toFIG. 13a , and the same repeated details are omitted herein. One difference between them is that, the image ofFIG. 13b has a lower luminance, and so the diopter adjustment unit provides a diopter having a smaller focusing capability to cause the eyes to adjust to a diopter having a greater focusing capability, as if the eyes are viewing at the nighttime of the real world. Accordingly, when thecontrol unit 106 similarly determines that the user focuses on the object A set as a far scene, thecontrol unit 106 at this point determines the diopter, e.g., 1.5 D, it is to control thediopter adjustment unit 104 to provide according to the control profile CP1, with the focusing capability of the diopter 1.5 D being lower than that of the diopter 2.5 D provided when the user focuses on the object A inFIG. 13a (of the daylight). When thecontrol unit 106 similarly determines that the user focuses on the object B set as a near scene in the image, thecontrol unit 106 at this point determines the diopter, e.g., 0.25 D, it is to control thediopter adjustment unit 104 to provide according to the control profile CP1, with the focusing capability of the diopter 0.25 D being lower than that of the diopter 1.25 D provided when the user focuses on the object A inFIG. 13a (of the daylight). - The examples in
FIG. 13a andFIG. 13b are based on the same user. For different users, thecontrol unit 106 may select different control profiles, e.g., a control profile CP2. For example, when it is similarly determined that another user focuses on the object A set as a far scene in the image inFIG. 13a , thecontrol unit 106 determines the diopter, e.g., 3D instead of 2.5 D in the foregoing example, it is to control thediopter adjustment unit 104 to provide according to the control profile CP2. When thecontrol unit 106 determines that the user focuses on the object B set as a near scene in the image inFIG. 13a , thecontrol unit 106 determines the diopter, e.g., 1.5 D instead of 1.25 D in the foregoing example, it is to control thediopter adjustment unit 104 to provide according to the control profile CP2. - It should be noted that, in the examples in
FIG. 13a andFIG. 13b , thecontrol unit 106 determines the diopter it is to control thediopter adjustment unit 104 to provide according to the average luminance of the entire image. In another embodiment, thecontrol unit 106 may determine a region in the image that the user focuses on (i.e., a region of interest (ROI)) according to the detection result of thegaze detection unit 110. Thus, thecontrol unit 106 may also determine the diopter it is to control thediopter adjustment unit 104 to provide according to the average luminance of the ROI (instead of the entire image). - In another embodiment, the
control unit 106 does not pre-load the luminance information of the image. As such, thecontrol unit 106 may be connected to theluminance detection unit 120, and generate luminance data according to a metering result of theluminance detection unit 120. Such method is beneficial for application scenarios of AR or MR because the eyes of the user further sense external ambient light beams in addition to the luminance of the image. As previously described, preferably, theluminance detection unit 120 may target at parts in the display surface that are closer to the eyes to perform metering. - Further, in one embodiment, each of the control profiles CP1-CPn may specify a variable range and a variance sensitivity (the magnitude that the diopter increases or decreases per unit time) of the diopter. The reason for such is that, too drastic or too fast adjustment in the diopter may cause discomforts for some users. For example, the diopter that the
diopter adjustment unit 104 provides according to the control profile CP1 may be set to vary within a range between +0 D and +9.00 D, and the variance magnitude may be set to not exceed 1 D per second. However, the diopter that thediopter adjustment unit 104 provides according to the control profile CP2 may be set to vary within a range between +0.25 D and +8.00 D, and the variance magnitude may be set to not exceed 0.75 D per second. In general, a moderate variance is preferably set for presbyopia of the elderly. - It should be noted that, in practice, values of the parameters in each of the control profiles CP1-CPn may be designed with consideration of hardware restrictions of the
diopter adjustment unit 104 as well as user needs and preferences, or may be designed according to optometry and correction results, and are not limited by the present invention. Further, in an embodiment where thediopter adjustment unit 104 individually adjusts for left and right eyes, each of the parameters in each of the control profiles CP1-CPn may be include different setting values for left and right eyes—such approach is preferred because degrees of myopia for left and right eyes of a user are usually different, for example. - Further, for a myopic user, the diopter that the
diopter adjustment unit 104 provides may be designed to vary within a range between −3.00 D and +6.00 D. Thus, basic myopic degrees may be corrected at the same time to allow the user to apply the head-mountedpersonal multimedia system 100 without wearing glasses. In another embodiment, the diopter that thediopter adjustment unit 104 provides is still set to vary within a range between 0 D and +9.00 D. However, in this case, the head-mountedpersonal multimedia system 100 may additionally provide a correction lens (not shown) that can be inserted or removed as desired on an optical path to provide a diopter, e.g., −3.00 D. Therefore, the total diopter that thediopter adjustment unit 104 and the correction lens (when inserted in an optical path) jointly provide varies within a range between −3.00 D and +6.00 D. It should be noted that, the diopter a correction lens provides is usually a constant value, whereas thediopter adjustment unit 104 may provide a dynamically changing diopter. In another embodiment, an approach of the CN205038406 U or CN 205103492 U may also be referred and applied to correct a basic degree of myopia. - In another selective embodiment, as shown in
FIG. 12 , the head-mountedpersonal multimedia system 100 further includes aposition tracking unit 130. When the user applies the head-mountedpersonal multimedia system 100, theposition tracking unit 130 may detect head movements of the user, particularly but not limited to, forward and backward head movements of the user. Implementation details of theposition tracking unit 130 may be referred from Oculus Rift or HTC Vive, or US20090237355, and are not limited by the present invention. - The movement data detected by the
position tracking unit 130 is also fed to thecontrol unit 106 as parameters for thecontrol unit 106 control thediopter adjustment unit 104. In this embodiment, theposition tracking unit 130 primarily assists thegaze detection unit 110. When the two are applied in coordination, thecontrol unit 106 is capable of more accurately determine the object that the user focuses on to determine a more appropriate diopter. For example, assuming that theposition tracking unit 130 detects that the head of the user is tilted forward, thecontrol unit 106 may accordingly determine that the user wishes to more carefully view the object as a near scene in the image; assuming that theposition tracking unit 130 detects that the user continues walking towards a front-left direction, thecontrol unit 106 may accordingly determine that the user is interested in the object at the left in the image. - Further, the depth of the object in the image originally set may be correspondingly changed according to the direction and distance of the user detected by the
position tracking unit 130; that is, an object originally set as a far scene may gradually get “close to” the user to become a near scene. Thus, the diopter thediopter adjustment unit 104 provides may be correspondingly adjusted and reduced (i.e., the eyes are caused to adjust to a diopter having a greater focusing capability). Meanwhile, thecontrol unit 106 may further appropriately control the variance magnitude of the diopter thediopter adjustment unit 104 provides according to a moving speed of the user. - Further, selectively, in an embodiment where the
control unit 106 is also implemented as a multimedia player, thecontrol unit 106 is further signally connected to and controls thedisplay screen 150. When thecontrol unit 106 controls thediopter adjustment unit 104 to provide different diopters, in response to the issue of a spectacle magnification change, it at the same time controls thedisplay screen 150 to zoom in or zoom out the image provided to the user by different display regions. TakingFIG. 13a for example, thecontrol unit 106 initially determines that the user focuses on the object B set as a near scene in the image, and controls thediopter adjustment unit 104 to provide a diopter, e.g., −2.5 D. When thecontrol unit 106 later determines that the user switches to focus on the object A set as a far scene in the image, it controls thediopter adjustment unit 104 to provide a diopter, e.g., 3.5 D. However, compared to a diopter −2.5 D, thecontrol unit 106 at this point also controls thedisplay screen 150 to provide the user with a smaller image (e.g., by turning off (or displaying black by) the pixels at an outer periphery of thedisplay screen 150 and displaying the image by only central pixels, or decreasing the viewable area of the image through other methods) to counteract an enlarging effect caused by the increased diopter. In general, a 1 D change in the diopter produces 1.5% magnification change. That is to say, when the user views the object B (with the diopter set as −2.5 D) set as a near scene and suddenly views the object A (with the diopter set as 3.5 D) set as a far scene, a variance of 6 D is resulted. Without any adjustment, the image perceived by the user is suddenly enlarged by 9%, and so the image on the screen needs to be instantaneously reduced by 9% to counteract such effect. It is understood that, the level of magnification change caused by the diopter differs based on individuals and the devices applied, and so the scaling (zooming in/out) ratio actually performed on the image on the screen is only accurate through personalized correction. - In another embodiment, the
display screen 150 further includes a stepping motor (not shown) to fine tune the distance between the display surface and the eyes of the user. Again takingFIG. 13a for example, when the user views the object B (with the diopter set as −2.5 D) set as a near scene and suddenly views the object A (with the diopter set as 3.5 D) set as a far scene, a variance of 6 D is resulted. Without any adjustment, the image perceived by the user is suddenly enlarged by 9%. In this embodiment, thecontrol unit 106 further controls thedisplay screen 150 to increase the distance between its display surface and the eyes of the user (e.g., by 1 cm) to counteract such enlarging effect. Similarly, as previously described, the level of magnification change caused by the diopter differs based on individuals and the devices applied, and so the scaling (zooming in/out) ratio actually performed on the image on the screen is only accurate through personalized correction. - The present invention can be embodied in any other specific manners without departing from the spirit or essential features of the present invention. Every aspect of the aforesaid embodiments of the present invention must be deemed illustrative rather than restrictive of the present invention. Hence, the scope of the present invention is defined by the appended claims instead of the above description. All equivalent meanings and scope which fall within the appended claims must be deemed falling within the scope of the appended claims.
Claims (17)
1. A head-mounted personal multimedia system, comprising:
a display unit, providing a display surface to display an image to a user and providing a constant physical distance between the displayed image and eyes of the user;
a gaze detection unit, detecting a gaze direction of eyes of the user towards the image;
a diopter adjustment unit, located between the display surface and the eyes, configurably providing a first diopter to the eyes for clear viewing at the constant physical distance to the displayed image and providing a second diopter to the eyes for clear viewing at the same constant physical distance to the displayed image, wherein the first diopter and the second diopter are different; and
a control unit, signally connected to the diopter adjustment unit and the gaze detection unit, controlling the diopter adjustment unit according to the gaze direction detected by the gaze detection unit to provide either the first diopter or the second diopter.
2. The head-mounted personal multimedia system according to claim 1 , wherein the first diopter is greater than the second diopter and thus causes a lower diopter of the eyes.
3. The head-mounted personal multimedia system according to claim 1 , wherein the control unit further controls the diopter adjustment unit to provide the first diopter or the second diopter according to luminance information of the image.
4. The head-mounted personal multimedia system according to claim 3 , further comprising:
a luminance detection unit, signally connected to the control unit, detecting luminance of at least one region in the fixed display surface to generate and provide the luminance information of the image to the control unit.
5. The head-mounted personal multimedia system according to claim 1 , wherein the control unit further determines values of the first diopter and the second diopter according to depth information of the image.
6. The head-mounted personal multimedia system according to claim 5 , wherein the control unit further performs scene recognition on the image to generate the depth information of the image.
7. The head-mounted personal multimedia system according to claim 1 , further comprising:
a user data unit, storing a plurality of sets of user data and determining corresponding user data according to a user identity (ID);
wherein, the control unit is further signally connected to the user data unit, and further determines values of the first diopter and the second diopter according to the corresponding user data the user data unit determines.
8. The head-mounted personal multimedia system according to claim 7 , further comprising a user ID identification unit for identifying the user ID.
9. The head-mounted personal multimedia system according to claim 1 , wherein the display unit is configured to display a video, and the image is a part of the video.
10. The head-mounted personal multimedia system according to claim 1 , wherein the control unit further controls the diopter adjustment unit to provide the first diopter or the second diopter in response to a head movement of the user.
11. The head-mounted personal multimedia system according to claim 1 , wherein the control unit is further signally connected to the display unit; when the control unit controls the diopter adjustment unit to provide the first diopter, the control unit further controls the display unit to display the image with a first magnification; when the control unit controls the diopter adjustment unit to provide the second diopter, the control unit further controls the display unit to display the image with a second magnification.
12. The head-mounted personal multimedia system according to claim 1 , wherein the control unit is further signally connected to the display unit; when the control unit controls the diopter adjustment unit to provide the first diopter, the control unit further controls the display unit to display the image by using a first display region; when the control unit controls the diopter adjustment unit to provide the second diopter, the control unit further controls the display unit to display the image by using a second display region.
13. The head-mounted personal multimedia system according to claim 12 , wherein the first diopter is greater than the second diopter, and a viewable area of the first display region is smaller than a viewable area of the second display region.
14. A visual assistance device, detachably installed in a head-mounted personal multimedia system, the head-mounted personal multimedia system comprising a display unit to provide a display surface for displaying an image to a user and provide a constant physical distance between the displayed image and eyes of the user, the visual assistance device comprising:
a gaze detection unit, detecting a gaze direction of eyes of the user towards the image;
a diopter adjustment unit, located between the display surface and the eyes, configurably providing a first diopter to the eyes for clear viewing at the constant physical distance to the displayed image and providing a second diopter to the eyes for clear viewing at the same constant physical distance to the displayed image, wherein the first diopter and the second diopter are different; and
a control unit, signally connected to the diopter adjustment unit and the gaze detection unit, controlling the diopter adjustment unit according to the gaze direction detected by the gaze detection unit to provide either the first diopter or the second diopter.
15. A visual assistance device, detachably installed in a head-mounted personal multimedia system, the head-mounted personal multimedia system comprising a display unit to provide a display surface for displaying an image to a user and provide a constant physical distance between the displayed image and eyes of the user, and a gaze detection unit for detecting a gaze direction of eyes of the user towards the image, the visual assistance device comprising:
a diopter adjustment unit, located between the display surface and the eyes, configurably providing a first diopter to the eyes for clear viewing at the constant physical distance to the displayed image and providing a second diopter to the eyes for clear viewing at the same constant physical distance to the displayed image, wherein the first diopter and the second diopter are different; and
a control unit, signally connected to the diopter adjustment unit and the gaze detection unit, controlling the diopter adjustment unit according to the gaze direction detected by the gaze detection unit to provide either the first diopter or the second diopter.
16. The head-mounted personal multimedia system according to claim 1 , wherein the gaze detection unit, the diopter adjustment unit, and the control unit together are formed as a visual assistance device and detachably installed in the head-mounted personal multimedia system.
17. The head-mounted personal multimedia system according to claim 1 , wherein the diopter adjustment unit and the control unit together are formed as a visual assistance device and detachably installed in the head-mounted personal multimedia system.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/874,679 US20200278551A1 (en) | 2016-06-15 | 2020-05-15 | Head-mounted personal multimedia systems and visual assistance devices thereof |
Applications Claiming Priority (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW105118695 | 2016-06-15 | ||
TW105118695 | 2016-06-15 | ||
TW105128987 | 2016-09-07 | ||
TW105128987 | 2016-09-07 | ||
US15/621,852 US10684479B2 (en) | 2016-06-15 | 2017-06-13 | Head-mounted personal multimedia systems and visual assistance devices thereof |
US16/874,679 US20200278551A1 (en) | 2016-06-15 | 2020-05-15 | Head-mounted personal multimedia systems and visual assistance devices thereof |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/621,852 Continuation US10684479B2 (en) | 2016-06-15 | 2017-06-13 | Head-mounted personal multimedia systems and visual assistance devices thereof |
Publications (1)
Publication Number | Publication Date |
---|---|
US20200278551A1 true US20200278551A1 (en) | 2020-09-03 |
Family
ID=60660119
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/621,852 Active 2038-01-09 US10684479B2 (en) | 2016-06-15 | 2017-06-13 | Head-mounted personal multimedia systems and visual assistance devices thereof |
US16/874,679 Abandoned US20200278551A1 (en) | 2016-06-15 | 2020-05-15 | Head-mounted personal multimedia systems and visual assistance devices thereof |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/621,852 Active 2038-01-09 US10684479B2 (en) | 2016-06-15 | 2017-06-13 | Head-mounted personal multimedia systems and visual assistance devices thereof |
Country Status (2)
Country | Link |
---|---|
US (2) | US10684479B2 (en) |
TW (1) | TWI710800B (en) |
Families Citing this family (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108414978B (en) * | 2018-02-08 | 2020-08-11 | 北京理工大学 | Extensible base station array, optical tracking system and tracking method thereof |
CN108414979B (en) * | 2018-02-08 | 2020-06-30 | 北京理工大学 | Optical tracking method based on extensible base station array |
US20190302881A1 (en) * | 2018-03-29 | 2019-10-03 | Omnivision Technologies, Inc. | Display device and methods of operation |
US10831023B2 (en) | 2018-09-24 | 2020-11-10 | International Business Machines Corporation | Virtual reality-based viewing system to prevent myopia with variable focal-length and magnification |
DE202019101235U1 (en) * | 2019-03-05 | 2020-03-06 | Christian P. Benzing | Visual aid |
US20200297572A1 (en) * | 2019-03-19 | 2020-09-24 | Optotune Ag | System for eye training and use of the system for eye training |
CN110286488B (en) * | 2019-06-24 | 2021-05-28 | 余廷江 | Outdoor AR box |
JP2021056369A (en) * | 2019-09-30 | 2021-04-08 | セイコーエプソン株式会社 | Head-mounted display |
TWI757727B (en) * | 2020-04-17 | 2022-03-11 | 宏達國際電子股份有限公司 | Method for compensating visual field defects, electronic device, smart glasses, computer readable storage medium |
CN111680546A (en) * | 2020-04-26 | 2020-09-18 | 北京三快在线科技有限公司 | Attention detection method, attention detection device, electronic equipment and storage medium |
TWI759840B (en) * | 2020-08-31 | 2022-04-01 | 創新未來國際有限公司 | Mini display device |
CN112263451B (en) * | 2020-10-28 | 2022-11-08 | 中国人民解放军陆军特色医学中心 | Correcting instrument for inhibiting myopia degree from deepening |
CN112595496B (en) * | 2020-12-31 | 2023-04-21 | 深圳惠牛科技有限公司 | Method, device, equipment and storage medium for detecting faults of near-eye display equipment |
CN113900253A (en) * | 2021-10-18 | 2022-01-07 | 杨敬尧 | Mini functional lens module |
WO2023238662A1 (en) * | 2022-06-07 | 2023-12-14 | ソニーグループ株式会社 | Information processing device, information processing method, and recording medium |
Family Cites Families (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6456262B1 (en) | 2000-05-09 | 2002-09-24 | Intel Corporation | Microdisplay with eye gaze detection |
US7594727B2 (en) | 2004-12-03 | 2009-09-29 | Searete Llc | Vision modification with reflected image |
US20090073386A1 (en) * | 2007-09-14 | 2009-03-19 | Petito G Timothy | Enhanced head mounted display |
US20090237355A1 (en) | 2008-03-24 | 2009-09-24 | Storm Orion | Head tracking for virtual reality displays |
US8957835B2 (en) | 2008-09-30 | 2015-02-17 | Apple Inc. | Head-mounted display apparatus for retaining a portable electronic device with display |
US8628193B2 (en) * | 2010-11-20 | 2014-01-14 | Yibin TIAN | Automatic accommodative spectacles using a scene analyzer and focusing elements |
EP2499964B1 (en) * | 2011-03-18 | 2015-04-15 | SensoMotoric Instruments Gesellschaft für innovative Sensorik mbH | Optical measuring device and system |
CA2750287C (en) | 2011-08-29 | 2012-07-03 | Microsoft Corporation | Gaze detection in a see-through, near-eye, mixed reality display |
TWI559034B (en) * | 2011-12-26 | 2016-11-21 | 洛伊馬汀公司 | Head-mounted display apparatus employing one or more reflective optical surfaces |
US9122321B2 (en) | 2012-05-04 | 2015-09-01 | Microsoft Technology Licensing, Llc | Collaboration environment using see through displays |
TW201436786A (en) * | 2013-03-21 | 2014-10-01 | jia-hong Zheng | Dynamic type vision correction eyeglasses |
IL305162A (en) * | 2013-11-27 | 2023-10-01 | Magic Leap Inc | Virtual and augmented reality systems and methods |
CN104750230A (en) * | 2013-12-27 | 2015-07-01 | 中芯国际集成电路制造(上海)有限公司 | Wearable intelligent device, interactive method of wearable intelligent device and wearable intelligent device system |
US20150253574A1 (en) | 2014-03-10 | 2015-09-10 | Ion Virtual Technology Corporation | Modular and Convertible Virtual Reality Headset System |
JP2016092508A (en) * | 2014-10-31 | 2016-05-23 | セイコーエプソン株式会社 | Image display device |
CN205103492U (en) | 2015-08-19 | 2016-03-23 | 海南虚幻视界科技有限公司 | Adjustable virtual reality glasses in position between screen and lens |
CN205038406U (en) | 2015-09-21 | 2016-02-17 | 深圳市虚拟现实科技有限公司 | Wear -type display device of adjustable focal length |
-
2017
- 2017-06-13 US US15/621,852 patent/US10684479B2/en active Active
- 2017-06-15 TW TW106120019A patent/TWI710800B/en active
-
2020
- 2020-05-15 US US16/874,679 patent/US20200278551A1/en not_active Abandoned
Also Published As
Publication number | Publication date |
---|---|
TWI710800B (en) | 2020-11-21 |
US10684479B2 (en) | 2020-06-16 |
US20170363873A1 (en) | 2017-12-21 |
TW201800804A (en) | 2018-01-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20200278551A1 (en) | Head-mounted personal multimedia systems and visual assistance devices thereof | |
US11669161B2 (en) | Enhancing the performance of near-to-eye vision systems | |
CN107526165B (en) | Head-mounted personal multimedia system, visual auxiliary device and related glasses | |
US10319154B1 (en) | Methods, systems, and computer readable media for dynamic vision correction for in-focus viewing of real and virtual objects | |
JP6412110B2 (en) | How to customize an electronic image display device | |
US7543938B2 (en) | Methods and devices for prevention and treatment of myopia and fatigue | |
US10712563B2 (en) | Methods for near-to-eye displays exploiting optical focus and depth information extraction | |
KR101968399B1 (en) | Method and system forcontrolling focusing length to enhance vision | |
US20140137054A1 (en) | Automatic adjustment of font on a visual display | |
US9678337B2 (en) | Viewer with multifocal lens and method for changing focal length of viewer | |
US10783835B2 (en) | Automatic control of display brightness | |
CN105068249A (en) | Holographic intelligent glasses | |
EP3312717A1 (en) | User device and computer program stored in computer-readable medium for controlling display | |
CN107993630A (en) | Eye protection method and device for display terminal, terminal and storage medium | |
CN111886564A (en) | Information processing apparatus, information processing method, and program | |
CN107307981B (en) | Control method of head-mounted display device | |
KR100846355B1 (en) | method for the vision assistance in head mount display unit and head mount display unit therefor | |
KR101911787B1 (en) | Auto focus glasses and the driving method thereof | |
WO2017026942A1 (en) | Apparatus for display adjustment and method thereof | |
KR101882191B1 (en) | Driving method of auto focus glasses | |
Padmanaban | Enabling Gaze-Contingent Accommodation in Presbyopia Correction and Near-Eye Displays | |
CN114816065B (en) | Screen backlight adjusting method, virtual reality device and readable storage medium | |
US20240221301A1 (en) | Extended reality assistance based on user understanding | |
US20230359273A1 (en) | Retinal reflection tracking for gaze alignment | |
CN114816065A (en) | Screen backlight adjusting method, virtual reality device and readable storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: VRVAORIGIN VISION TECHNOLOGY CORP. LTD., TAIWAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CHEN, HSIN-YAN;REEL/FRAME:052668/0782 Effective date: 20170608 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: APPLICATION DISPATCHED FROM PREEXAM, NOT YET DOCKETED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |