WO2002031577A1 - Informationssystem mit erfassung des bildes der aussenwelt auf der netzaut - Google Patents
Informationssystem mit erfassung des bildes der aussenwelt auf der netzaut Download PDFInfo
- Publication number
- WO2002031577A1 WO2002031577A1 PCT/EP2000/009840 EP0009840W WO0231577A1 WO 2002031577 A1 WO2002031577 A1 WO 2002031577A1 EP 0009840 W EP0009840 W EP 0009840W WO 0231577 A1 WO0231577 A1 WO 0231577A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- information
- eye
- image
- retina
- information system
- Prior art date
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/12—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for looking at the eye fundus, e.g. ophthalmoscopes
Definitions
- the invention relates to an information system based on a visual field detection device which detects visible light from the naturally perceived visual field of an eye, and a corresponding method for making information available.
- Optical devices are known from German laid-open publications DE 196 31 414 AI and DE 197 28 890 which enable the retinal reflex image to be recorded and additional images to be superimposed in the eye.
- it describes the adjustment of the above-mentioned optical device and a system which is also able in a new way to project images onto an eye.
- the latter system is based on a projection of an image onto the retina of the eye, which takes place at the same time, but lagging behind a scan-like detection of the retinal reflex image.
- System features developed by the research team that recur in many of the described embodiments include that the system: at least partially captures a corneal reflex image of the eye; - directs part of the light incident on the eye into a sensor device by means of a spherical or spherically acting reflection layer; the retinal image is determined via the degree of oxidation of the retinal caps and / or the retinal rods; - only partially records a retinal reflex image; and / or a visual field detection device which detects visible light from the naturally perceived visual field without acquiring a retinal reflex image.
- each of these three patent applications relates to a respective, summarizing basic concept.
- the aim of the invention is to provide an information system whose information processing meets the natural needs of a sighted person in an unprecedented manner. It is a further object of the invention to provide such an information system which has been improved over the prior art in terms of implementability and economy. The aim of the invention is also to provide corresponding methods for making information available.
- the information system according to the invention comprises a signal detection device which detects signals reflected back from an eye having a retina, an information device and an output device which, in cooperation with the information device, provides information in correlation with the detected signals.
- the information is preferably made available as a function of the detected signals and / or as a function of visible light detected from the naturally perceived visual field.
- One of the glasses systems discussed above is preferably used as the signal detection device, in which a scanning scanning device at least partially detects a retinal reflex image of the retina.
- a modification of this scanning device which detects light reflected on the cornea of the eye instead of the retinal reflex image, is particularly advantageous in infrared applications, since the cornea strongly reflects light with a wavelength of approximately 1.1 ⁇ m.
- the visual field detection device and / or the information device of the information system according to the invention preferably comprises an essentially confocal, sparingly or spherically acting reflection layer which deflects part of the light directed onto the eye into a sensor device for detection. Due to the fact that the reflection layer is many times more reflective than the retinal or corneal reflex, it becomes an essential factor for photosensors of the same sensitivity Light gain achieved. Correspondingly inexpensive photosensors could also be used in the sensor device. It can therefore be advantageous if the light falling on the eye is not detected only partially or not at all via the retinal reflex.
- the orientation of the eye can also be determined at night and / or valuable information can be obtained from the visual field.
- any restrictions regarding the detection of the light falling on an eye can be expedient.
- restrictions of the recorded spectral range, the recorded field of view and the recorded time segments are possibly applied.
- the device of the information system according to the invention intended for this purpose can be designed to acquire the light falling on several eyes.
- the eyes do not have to necessarily belong to a single person.
- Visual field is the part of a room that can be captured with the eye still.
- a field of view is the area that can be seen with the eyes. Thus, as in the rest, the visual field is to be understood as the cause of the light that naturally falls on an eye.
- the information system is able to convert visible light from the visual field assigned to the eye into a quality, i.e. with a sensitivity, a resolution, a sharpness, etc., which far exceeds the natural perception of the eye.
- the correlation according to the invention of the provision of information with the signals detected by the signal detection device makes it possible to treat corresponding parts of the detected light during processing that occurs in the course of the provision of information as if they were reflex images acquired from the eye, i.e. as if they were what you actually saw.
- Such an embodiment of the information system according to the invention thus combines the advantages of an information system that obtains high-quality visual field information directly from the visual field with the advantages of an information system that extracts actual visual field information from the eye.
- the correlation of the provision of information with the detected signals reflected back from the eye can, for example, be This is done by capturing several image points of an eye reflex image, for example a cornea or retinal reflex image, which are connected to corresponding image points from the detected field of view via an evaluation device.
- a gaze direction of the eye determined by the detected signals can also serve to create a correlation between visual field information obtained from the detected visual field and what is actually seen.
- the correlation can also consist of projecting visual field information obtained onto the retina in a manner correlated with the seen.
- the field of view detection device need not be limited to a detection of the field of view, but can also include a partial or complete detection of the field of view, which includes an at least partial detection of the field of view.
- the high quality of the image captured from the field of view or visual field can also serve as the basis for an oversensory information presentation.
- visual field information could be obtained from the detected field of view light and projected onto the retina in such a way that the image perceived by the eye appears at least partially sharper, closer, more wide-angle or otherwise visible.
- the invention provides an information source, which can include a database, a sensor system, an information network connection and / or an evaluation device.
- a particularly interesting embodiment of the invention comprises a sensor system as a source of information. Because this enables a supersensible perception to be brought into connection with what is seen.
- the information source according to the invention could Magnetic field sensors that are able to locate metallic lines with respect to a known coordinate system, for example the detected field of view. It would thus be possible, for example by means of suitable image processing software, to superimpose the course of existing electrical lines by means of a projection of an additional image as described in the above-mentioned patent applications onto the image seen by the eye.
- All types of known sensors are suitable for use as a source of information, in particular when the sensor is activated or queried on the basis of the captured light image.
- the position of this line it would be possible for the position of this line to be calculated on a finished chip after a targeted view of a line on a circuit diagram of the circuit and a keystroke, so that the current and voltage values of the line by means of a contactless one Measuring device detected and presented to the user via the glasses system.
- An example of an information system comprising a database and an information network connection would be an in-house mail distribution system in which files are provided with barcode stickers which uniquely identify the respective file. If a file is to be sent in-house, the sender enters, for example, the extension number of the recipient and a code that designates the file using software that stores this data in a database in one of the many known ways. During a later sorting of the file, the identifying barcode is detected via the glasses system worn by a mail distribution employee, for example with a targeted look and a button click, and recognized by a recognition device or software.
- the post-distribution-relevant data assigned to the file is fetched from the database via radio link with an internal data network and, after preparation, sent to the mail distribution system via a suitable output device. announced, for example as an announcement via headphones "Mr. Schmidt, finance, Building G, 3rd floor, room 310".
- An evaluation device is to be understood to mean all types of evaluation devices, in particular image processing devices. Such evaluation devices have also been discussed in the examples above.
- the information can be made available in a tactile, visual, audible, smellable and / or flavored manner. It is an object of the invention to enable information to be provided that meets the needs of a sighted person in a way never before achieved. This can include that the information can be made available to humans in a suitable manner, that is to say using one or more of the five senses. However, the information can be made available in any way and does not require a specific addressee. For example, the information can be made available to a further system or can be emitted into the surroundings by an optical or acoustic output device. Already by the dependency according to the invention between the provision of information and the light image falling on the eye, it is achieved that the connection expected by the seeing person exists between what is seen and the information made available.
- This dependency is taken into account by the device according to the invention when determining the information, when making the information available or during both of these inherent processes. Examples of taking this dependency into account when determining the information are given above.
- this dependency can be taken into account, for example, in that the information is superimposed on the viewed image by means of a back projection into the eye in such a way that a temporal, color rather, spatial, contrast-related, or other meaningful connection between the information and the image viewed.
- the dependency can be that the captured light image is used to determine the position and orientation of the eyeball, so that an image projected onto the eye for the purpose of providing the information appears to be fixed when the eye moves seems to move along with a movement of the eye or seems to move during a movement of the eye according to a predetermined course.
- the effect of the saccade movements of the eye on these processes can be taken into account or compensated for.
- the information system according to the invention determines the position and orientation of at least one eye quickly, precisely and with little effort, for example with a determination rate of 100 Hz, a positional accuracy of a few micrometers and a device with a portable design.
- the processing can take place so quickly that the accuracy is not falsified by the saccade movements of the eye.
- the information system has a signal detection device that does not touch the eye and detects signals that are reflected back by the eye. Reflectable signals, for example sound or electromagnetic signals, allow high-frequency detection, so that the processing speed is mainly determined by an evaluation device included in the information system.
- Reflectable signals for example sound or electromagnetic signals
- part of the information system itself serves as a reference coordinate system.
- the information system merely represents a reference coordinate system in another reference coordinate system, and that the relationship between the reference coordinate system and the reference coordinate system is determined, for example, by the evaluation device or another mechanism.
- the signal detection device preferably detects light reflected back by the eye.
- Light forms an excellent medium for the transmission of the signals reflected back by the eye, since the operational capability of the eye requires the presence of light.
- This different information can, however, be distinguished using known signal processing methods and used sensibly to determine the orientation of the eye. This is particularly the case when the signal transmission medium comes from a signal source belonging to the information system, which applies a predetermined signal to the medium before it is reflected on the eye.
- the detection of signals from signal transmission media other than light can also be advantageous.
- components for generating and recording sound waves are available on the market in various inexpensive and compact versions. Such components can also be implemented as integrated elements of an integrated circuit. Similar 1577
- Retinal reflex detection has proven to be useful, in which the retinal reflex of natural or artificial light is intermittently or partially detected as a signal reflected back from the eye.
- a complete detection of the retinal reflex is both time-consuming and labor-intensive.
- processing the detected retinal reflex reveals both retinal features, such as the fovea centralis or the blind spot, and the reflection image of the light falling on the eye.
- the blood vessel network in the choroid is also visible when the retinal reflex image is appropriately prepared, which provides a very good basis for determining the orientation of the eyeball.
- retinal features can be tracked without retinal reflex detection.
- the blood vessels of the choroid can be recognized by their heat radiation visible in the infrared range.
- Figure 1 shows an information system according to a first embodiment of the invention
- Figure 2 is a detailed cross-sectional view of an eye
- FIG. 3 shows a known embodiment of an interactive glasses system in which a signal detection device in the form of a scanning eye scanner is provided;
- FIG. 4 shows a known embodiment of an interactive goggle in which an output device is provided in the form of a scanning projection device;
- FIG. 5A shows interactive glasses according to a first exemplary embodiment;
- FIG. 5B shows a detailed drawing of a combined signal detection and projection device shown in FIG. 5;
- FIG. 6A shows interactive glasses according to a second exemplary embodiment
- FIG. 6B shows a detailed drawing of a combined signal detection and projection device shown in FIG. 6A;
- FIG. 7A shows interactive glasses according to a third exemplary embodiment
- FIG. 7B shows a detailed drawing of a combined signal detection and projection device shown in FIG. 7A;
- FIG. 8 shows interactive glasses according to a fourth exemplary embodiment
- FIG. 9 shows interactive glasses according to a fifth exemplary embodiment
- FIG. 10A shows a top view of a pair of glasses according to a sixth exemplary embodiment
- FIG. 10B shows a front view of glasses according to a sixth exemplary embodiment
- FIG. HA shows the naturally perceived visual field of a user of an information system designed according to a seventh exemplary embodiment
- FIG. 11B shows the naturally perceived visual field of a user • of an information system designed according to a seventh exemplary embodiment
- Figure 11C is a schematic representation of a scan pattern
- Figure HD is a schematic representation of a modified scanning pattern
- FIG. 12A shows the naturally perceived visual field of a user of an information system designed according to an eighth exemplary embodiment
- FIG. 12B shows the naturally perceived visual field of a user of an information system designed according to an eighth exemplary embodiment
- FIG. 12C shows the naturally perceived visual field of a user of an information system designed according to an eighth exemplary embodiment
- FIG. 12D shows the naturally perceived visual field of a user of an information system designed according to an eighth exemplary embodiment
- FIG. 12E shows the naturally perceived visual field of a user of an information system designed according to an eighth exemplary embodiment
- FIG. 13A shows the naturally perceived visual field of a user of an information system designed according to a ninth exemplary embodiment
- FIG. 13B shows the naturally perceived visual field of a user of an information system designed according to a ninth exemplary embodiment
- FIG. 14A shows an information system according to the invention in accordance with a tenth exemplary embodiment
- FIG. 14B shows an information system according to the invention in accordance with a tenth exemplary embodiment
- FIG. 15 shows an information system according to the invention in accordance with an eleventh exemplary embodiment
- FIG. 16 shows a schematic illustration of an information system according to the invention in accordance with a twelfth exemplary embodiment
- Figure 17 is an optical system according to a thirteenth embodiment.
- Figure 1 shows an information system 100 in accordance with a first embodiment of the invention.
- the information system 100 is implemented in the form of an interactive glasses system 120 or an interactive glasses 120, respectively comprises two optical devices 150.
- the optical devices 150 are preferably located on the inside of a left 121L or right 121R temple part of the glasses 120.
- there are also other arrangements of the optical devices that do not obstruct the view for example in the area of a nose bridge 122 running over the nose root of a user the glasses 120, useful.
- the optical device 150 of the glasses 120 is connected to a processor unit 140 via connecting lines 101. If photodetectors and / or light sources are included in the optical devices, the connecting lines serve for the transmission of electrical detector or control signals. However, the photodetectors or light sources can be arranged in the processor unit 140 and connected to the optical devices 150 of the glasses 120 via light-conducting connecting lines 101. This contributes to the weight reduction of the glasses 120.
- FIG. 2 shows a detailed view of an eye 280 in cross section for the purpose of understanding the invention.
- the eye 280 which is housed in an eye socket 20 (lat. Orbita) in the head of a human being and is to be understood here in the sense of an eyeball 280, consists of a translucent cornea 283 (lat. Cornea) and a visible one white leather skin 28 (lat. Sclera) surrounding chamber.
- the sclera 28 is covered on its side facing the inside of the eye 280 by a choroid 287 (lat. Choroid) which bears a light-sensitive retina 281 (lat. Retina) on its inner side and supplies it with blood.
- the tissue of the retina 281 comprises two types of photoreceptor cells, rods and cones (both not shown), which enable humans to see. These photoreceptor cells absorb the light bundled through an eye lens 282 in a wavelength range of approx. 380-760 nm and convert it into electrical nerve signals through a series of chemical reactions. The signals from the various nerve cells of the retina 281 are then passed on to the brain via an optic nerve 25 and processed there to form a perceptible image.
- the numerous, approx. 120 million and highly light-sensitive rods are specialized in signal recording in dim light (so-called scotopic vision) and provide a grayscale image.
- photopic vision When light is absorbed, pigments are oxidized in the photoreceptor cells. It takes about 6 minutes to regenerate the pigments and about 30 minutes for the rods. A viewing period of approx. 200 msec is necessary until the visual stimulus via the photoreceptors begins and information is recorded via the retina 281.
- the retina 281 has a depression 286, which appears to be somewhat more pigmented due to its higher density of cones than the rest of the retina.
- the fovea centralis 286 is only included Occupied cones, has a very high cone density and only takes up approx. 0.01% of the surface of the retina.
- the optic nerve 25 enters the interior of the eye through a sieve-like opening in the dermis 28.
- This location 288 has no photoreceptor cells, which is why it is referred to as a "blind spot".
- the chamber formed by the cornea 283 and the dermis 28 is divided by a deformable lens 282 and a muscular radiation body 23 (also called ciliary body) which supports the lens 282.
- the part of the chamber which is referred to as anterior chamber 22 and lies between cornea 283 and lens 282, contains a liquid which nourishes cornea 283.
- the lens 282 In its original form, the lens 282 typically refracts the light falling on the eye in such a way that the far field of view is sharply imaged on the retina 281.
- the shape and thus also the refraction characteristics of the lens 282 can be changed over a wide range, for example to enable sharp imaging of nearby objects of the visual field on the retina 281. In most cases, this process takes place unconsciously for the person concerned.
- a diaphragm 285 of variable diameter consisting of colored tissue, which regulates the incidence of light on the light-sensitive parts of the eye 280 and gives the eye 280 its characteristic color.
- This aperture 285 is therefore called the iris 285 (lat. Iris).
- the iris 285 Due to the low light reflection of the lens 282, the vitreous body 21 and the retina 281, the central area of the iris 285 appears black and is called the pupil 284. The regulation of the pupil size is also unconscious for humans.
- the eye 280 is connected to the skull via six muscles 24, some of which are parallel, some of which are oblique to one another, which allow the eye 280 to pivot and consequently change the direction of view.
- the binocular, without eye movement 280 The visual field is approximately 170 ° horizontally and approximately 110 ° vertically. If the eyes 280 are moved, a binocular field of view of approximately 290 ° horizontally and approximately 190 ° vertically can be captured.
- the area of sharp vision covered by the fovea centralis 286 covers only about 1 °.
- a fictitious axis through the middle of this area is called the visual axis and corresponds to the viewing direction.
- a rotation of the eye around the visual axis is also made possible by the muscles 24.
- the six muscles 24 are responsible for all eye movements.
- microtreors of the eye 280 take place, in which the eye 280 trembles slightly in order to avoid a temporary exhaustion of the chemical reactivity of the affected photoreceptor cells while the stimulus remains the same.
- saccade movements take place, with the help of which the fovea centralis 286 is aimed at its new fixation target or is held at its previous fixation target.
- the eye 280 is moved involuntarily with a small amplitude of up to several tens of degrees and an extremely fast angular velocity of up to several hundred degrees per second.
- the eye reaches 280 angular speeds of just one to two hundred degrees per second.
- a conjunctiva 26 lines the space between the eyelids 27a and 27b, the eye cavity 20 and the eyeball 280. The conjunctiva 26 merges into the inside of the lid on the one hand, and into the cornea 283 on the other hand, and represents a second protective wall against the penetration of germs and foreign bodies.
- FIG. 3 shows a known embodiment of the interactive spectacle system or spectacles 320 as described above, in which a signal detection device in the form of a scanning eye scanner 350D is provided.
- the left half of the image represents a top view of the head of a user 302 together with glasses 320 with the right temple part 321R, while the right half of the image shows a cross section of the glasses 320 running through the left temple part 321L.
- the devices belonging to the interactive glasses 320 no further components of the information system 100 according to the invention are shown in FIG.
- light rays 333a and 333b falling on the eye 380 which originate, for example, from the visual field, are sharply imaged by the lens 382 on the retina 381 as a coherent image and reflected back by it as a retinal reflex image.
- a light beam 331 thus reflected back passes through the lens 382 again in the opposite direction, is focused via two concave mirrors 322 and 323 belonging to the mirror system of the glasses 320 and is directed onto a scanning eye scanner 350D as shown.
- the eye scanning device 350D comprises a signal detection device 351 in the form of a photodetector 351, which detects the light beam 331 reflected back by the retina 381, and two movable flat mirrors 352H and 353V, which cause a horizontal or vertical deflection of the light beam 331 onto the photodetector 351 ,
- the glasses 320 additionally comprise a light trap 324, which prevents light from coming in from undesired directions of incidence.
- the mirror 323 can be realized by a mirrored inner surface of the glasses. However, the surface must have a certain shape in order to enable the entire retinal reflex image to be recorded even if the eye 380 is possibly rotated. This in turn limits the design options for the glasses 320.
- the combination of a point-shaped detector 351 with corresponding control of the flat mirrors 352H and 352V results in serial point-by-point scanning of the retinal reflex image as a sequence of pixels.
- the retina 381, as described in DE 196 31 414 AI and DE 197 28 890, is preferably scanned with a circular, spiral or elliptical scan pattern. This has the advantage that the flat mirrors 352 can be driven without backward movements and that a higher pixel density (number of pixels per unit area of the retina) in the area of the fovea centralis 286 can be detected.
- a suitable synchronization process for determining the instantaneous visual axis is preferably preceded by the recording process, if this has not yet been done in a previous projection process, so that the scanning process can be carried out eye-centered.
- FIG. 4 shows a known embodiment of the interactive glasses 420 described above, in which an output device in the form of a scanning projection device 450P is provided.
- the left half of the image represents a top view of the head of a user 402 together with glasses 420 with the right temple part 421R, while the right half of the image shows a cross section of the glasses 420 running through the left temple part 421L. Except for the Devices belonging to interactive glasses 420 are shown in FIG. 2 no further components of the information system 100 according to the invention.
- the scanning projection device 450P comprises a light source 453 emitting a projection light beam 432, for example a laser diode or an LED focused via a lens system, and two movable flat mirrors 454H and 454V.
- the projection light beam 432 is directed via the movable flat mirrors 454H and 454V onto a mirror system of the glasses 420, which comprises two concave mirrors 422 and 423, which throw the projection light beam 432 onto the lens 482 of an eye 480 and finally onto the retina 481.
- the mirror 423 can be realized by a mirrored inner surface of the glasses lens.
- the surface must have a certain shape in order to enable a projection onto all areas of the retina 481 even if the eye 480 is possibly rotated. This in turn limits the design options for the glasses 420.
- the glasses 420 can be equipped with a light trap 424, which prevents incidence of light from undesired directions of incidence.
- the projection as described in DE 196 31 414 AI and DE 197 28 890, is preferably carried out using a circular, spiral or elliptical scan pattern. This has the advantage that the flat mirrors 452 can be driven without backward movements and that a higher pixel density in the area of the fovea centralis 286 can be projected onto the retina 481.
- the degree of perception of an image projected into the eye 480 can be controlled in relation to the naturally perceived image by the brightness of the projected pixels.
- retinal perception is a deeply complex process in which psychological effects also play a very strong role.
- the retina 481 adjusts itself to the brightness of the light falling on it as a whole.
- the faint glow of a clock radio clock that is not perceived in daylight can appear to illuminate an entire room in the dark.
- the strong headlights of oncoming vehicles are hardly noticeable in daylight.
- the brightness of an individual pixel in relation to the otherwise perceived pixels is therefore felt.
- the Retina 481 works similarly. If the brightness of a pixel projected on an area of the retina 481 exceeds the brightness of the light otherwise falling on this area by approx. 10%, only the projected pixel is effectively perceived by this area of the retina 481 instead of the other light. Due to psychological effects, the exact value can be between 5% -10%, 10% -15% or even 15% -20% instead of 10%.
- a suitable synchronization process for determining the current visual axis is preferably connected upstream of the projection process, if this has not yet been done in a previous scan process, so that the projection process can be carried out eye-centered.
- Figure 5A shows an interactive goggle 520 according to a first preferred exemplary embodiment, in which a combined signal is generated.
- Detection and projection device 550 is attached to the glasses 520 in the region of the nose bridge 522.
- the combined signal detection and projection device 550 comprises both a projection device 553 and a signal detection device, which are accommodated together in a protective housing 558.
- Light rays 530 enter the interior of the housing 558 and vice versa through a translucent window 559 in an outer wall of the housing 558.
- closing the housing 558 through the window 559 prevents dust, sweat and other foreign matter from interfering with the operation of the combined signal acquisition and projection device 550.
- the construction of the interactive glasses 520 can be simplified in that the mirrors 352 and 452, which are separate in the prior art, for vertical and horizontal deflection of the respective light beam 331 and 432 are replaced by a swash mirror 552 and 554.
- a partially transparent mirror 556 can serve to enable separate beam paths within the housing 558 for the light 530 falling or projected through the window 559.
- the inside of the spectacle lens is preferably provided with a surface 523 which is highly reflective for rays incident from this direction and which is used as a mirror for the beam path between the eye 580 and the combined signal detection and projection device 550.
- the interactive glasses 520 is shown in a minimalist embodiment, in which a combined signal detection and projection device 550 is provided only for the left eye 580, it goes without saying that a mirror-inverted second combined signal detection and projection device 550 is in the area the right half of the nose bridge 522 can be provided for the right eye, not shown, if necessary.
- FIG. 6A shows, in the form of a modification of the glasses 520 shown in FIGS. 5A and 5B, interactive glasses 620 according to a second preferred exemplary embodiment, in which the left combined signal detection and projection devices 650L in the between the left lens 624L and the left temple Part 621L area and the right combined signal detection and projection devices 650R are arranged in the area lying between the right spectacle lens 624R and the left temple part 621R.
- Such an arrangement of the combined signal acquisition and projection devices 650L, 650R in relation to the respective spectacle lenses 624L, 624R and the respective eyes 680 is normal associated with the need either to provide a plurality of mirrors along the beam path 630 (cf. mirrors 322 and 323 in FIG. 3) or to give the respective spectacle lens 624L, 624R a special shape in order to ensure detection of all areas of the retina 681.
- the interactive glasses 620 according to FIG. 6 provide glasses 624L, 624R, the inside of which are provided with a respective holographic coating 623L, 623R.
- Such holographic coatings 623 are able to emulate any reflection topology.
- a holographically coated, flat surface can act like a spherically curved surface.
- a holographically coated, spherically curved surface can also act like a flat surface.
- the change in the effective reflection topology depends only on the holographic content of the coating.
- the holographic coatings 623L and 623R mirrors are formed and arranged symmetrically to one another.
- Figure 6B contains a detailed drawing of the combined signal acquisition and projection devices 650L. Analogously to the combined signal detection and projection device 550 shown in FIG. 5B, it comprises a housing 658, a projection device 653 and a signal detection device 651, respective wobble mirrors 652 and 654, a partially transparent mirror 656 and a housing window 659.
- FIG. 7A shows, in the form of a modification of the glasses 520 shown in FIGS. 5A and 5B, interactive glasses 720 according to a third preferred exemplary embodiment, in which the left combined signal detection and projection devices 750L in the between the left glasses glass 724L and the left bracket 721L lying area and the right combined signal detection and projection devices 750R are arranged in the area lying between the right spectacle lens 724R and the left temple part 721R.
- Figure 7B contains a detailed drawing of the combined signal acquisition and projection devices 750L. Analogous to the combined signal detection and projection device 550 shown in FIG. 5B, it comprises a housing 758, a projection device 753 and a signal detection device 751, respective wobble mirrors 752 and 754, a partially transparent mirror 756 and a housing window 759.
- the above-mentioned problem of the beam path 730 is solved in a space-saving manner by specially designed pads 725L and 725R.
- glasses 720 are supported either on the nose bridge by the nose bridge 722 or by so-called pads 725.
- pads are relatively flat, slightly curved and oval.
- they are either pivoted or tumbling on a projection extending from the nose bridge 722 in order to ensure that the pads fit snugly against the side surfaces of the nose root.
- the pads 725 are designed as dimensionally stable, elongated units which protrude from the glasses 720 in the direction of the eye 780 in the region of the nose bridge 722.
- the pads 725 form the support surface which rests on the root of the nose.
- the pads 725 In their end region opposite the glasses 720, the pads 725 have a wing on the side facing the eye, which is provided with a mirror or a reflective coating, for example a metal coating or a holographic coating.
- the frame of the glasses 720 has a basically solid shape, both quasi-static, eg due to material fatigue and / or temperature changes, as well as dynamic deformations of the frame.
- the relative arrangement of the glasses 720 with respect to the eye 780 is also not a constant.
- both the optical system of the glasses 720 that is to say those system components which contribute to the optical signal detection or optical projection, and any processing system which may be connected to it, must be designed and designed in such a way that such changes in arrangement are taken into account and / or compensated for may or may not cause extraordinary malfunctions. This applies to all types of interactive glasses systems.
- the problem mentioned above can be overcome in particular by suitable signal processing of the detected and of the signals to be generated.
- Optical markings fixed to the spectacle frame in the vicinity of the usual beam path 730 can also be detected regularly or as required by the signal detection device 751 for the purpose of calibrating its optical system.
- FIG. 8 shows, in the form of a modification of the glasses 520 shown in FIGS. 5A and 5B, interactive glasses according to a fourth preferred exemplary embodiment, in which the signal detection device 851 of the combined signal detection and projection devices 850 is able to record the corneal reflex image at least partially.
- the cornea is usually rotationally symmetrical to the visual axis. Rays that fall perpendicularly onto a central area of the cornea are thus confocal to the optical system of the eye 880 and form the basis of what is actually lent perceived image.
- the cornea 883 consists largely of water and therefore has a very high degree of reflection at a wavelength of approximately 1.1 ⁇ m. Since this wavelength is in the infrared spectral range, the corneal reflex image is primarily suitable for infrared applications, for example in night vision devices. However, reflections do not only take place on the outer, concave corneal surface, but also inside the cornea. In addition, due to its structure, the cornea 883 does not cause a mirror-like reflection but a diffuse one, which becomes more diffuse with increasing depth of the reflection event inside the cornea.
- the spectacle lens 824 which is placed in front of the eye and whose side facing the eye 880 is provided with a surface 823 which is highly reflective for rays incident from this direction, has a specially designed shape which bundles the light reflected perpendicularly from the cornea in such a way that it as almost parallel light rays 834 fall on the signal detection device 851, while light not reflected perpendicularly from the cornea is directed in another direction.
- the spectacle lens 824 can be designed differently, but have a partially transparent holographically reflecting layer 823, which likewise effects such a concentration of the light reflected perpendicularly from the cornea that it strikes the signal detection device 851 as almost parallel light beams 834, while not perpendicularly from light reflected from the cornea is directed in a different direction.
- an aperture 857 is provided shortly in front of the signal detection device 851, which prevents detection of those light beams whose angle of incidence lies outside a narrow angle of incidence range such as Light rays 834 described above, running almost parallel.
- FIG. 9 shows, in the form of a modification of the glasses 520 shown in FIGS. 5A and 5B, interactive glasses according to a fifth preferred exemplary embodiment, in which a spherical or spherically acting, partially transparent, reflective additional element 929 is arranged between the spectacle lens 924 and the eye 980.
- the additional element 929 is preferably arranged confocal to the optical system of the eye 980.
- the degree of reflection of such an additional element 929 can be adapted to the needs of the information system. You can choose between a high degree of reflection, which enables very good detection of light rays 933a-933c directed towards the eye 980, and a low degree of reflection, which avoids impairing the perception by the eye 980.
- the additional element 929 preferably has a low (for example less than 10%), homogeneous degree of reflection over its entire reflection surface.
- reflective organs of the eye 980 for example the cornea 983 or the retina 981, sometimes have very strong local reflection dependencies. Similar statements concern the spectral reflection dependencies of the additional element or the reflecting organs of the eye 980.
- the additional element 929 can preferably be designed such that it has a homogeneous degree of reflection over all relevant spectral ranges, the different organs of the eye 980 have very different features Degrees of absorption, which in many cases are also subject to strong local fluctuations.
- the additional element 929 should have as little effect as possible on the light falling on it.
- the additional element 929 is preferably made of a homogeneous translucent and undyed material and with a constant thickness in the direction of the light rays directed towards the center of the eye.
- the reflective contour of such an additional element 929 is well defined and can accordingly be made available to the information system as known information, while the contour of the relevant reflective organs of the eye 980 must first be determined. The latter can involve considerable effort in some cases.
- the detection of light rays 933a-933c directed towards the eye 980 via such an additional element 929 can thus provide high-quality images of the field of view.
- the side of the spectacle lens 924 facing the eye 9 is strong for rays incident from this direction reflecting surface 923, and has a specially designed shape or a specially designed coating that bundles the light rays reflected perpendicularly from the additional element in such a way that they are almost parallel light rays 934 fall on the signal detection device 951, while light rays not reflected perpendicularly by the additional element are directed in another direction. Furthermore, an aperture 957 is provided shortly in front of the signal detection device 951, which prevents detection of those light rays whose angle of incidence lies outside a narrow angle of incidence of the light rays 934 which run almost parallel, as described above.
- the correlation between the detected light and the perceived visual field must be determined.
- this correlation is achieved by a preferred confocal arrangement of the additional element 929 for the optical system of the eye 980. It is therefore preferred that the additional element 929 is attached to the glasses via an adjustable suspension in such a way that the position of the additional element 929 can be readjusted both in vertical and in two horizontal directions.
- confocality is given when the additional element 929, seen optically, is arranged rotationally symmetrically to the visual axis and at a distance from the lens 982, that the optical center of the optical system of the eye with the center of the additional element acting through the spherical or spherical defined ball matches.
- the visual axis can be adequately determined via the orientation of the pupil 984, which can be easily recognized by its sharp contours, and the orientation of which can be determined easily due to its round shape.
- no pivoting of the additional element 929 about the possible pivot axes of the eye 980 is necessary to ensure confocality.
- the additional element 929 Because even when the eye is twisted by a corresponding vertical and / or horizontal Displacement of the additional element 929 at least a substantial part of the additional element 929, optically seen, rotationally symmetrical to the visual axis.
- the distance to the lens 982 there are various ways of determining the necessary distance. For example, an optical or acoustic measurement of the cornea 983 can be carried out, the curvature of which gives a very good guide value for the correct arrangement of the additional element 929.
- Retinal or corneal reflex images can also be acquired at least partially, and the correct distance can be determined on the basis of a comparison of the reflex images with the light acquired via the additional element 929.
- FIG. 10 shows a top view (FIG. 10A) and a front view (FIG. 10B) of a pair of glasses 1020 according to a sixth exemplary embodiment, in which two sensor devices 1061R and 1061L, for example two solid-state cameras, for example CCD or TTL cameras, for the purpose further signal detection, in particular from the visible field of view, are provided.
- FIG. 10B also shows the left and right eyes 1080L and 1080R of a possible wearer 1002 of the glasses 1020. However, for the sake of clarity, no other features of the user 1002 are shown in FIG. 10B.
- the cameras 1061 should be arranged as axially as possible with respect to their "visual axes".
- the cameras 1061 it has proven expedient in the current state of the art to arrange the cameras 1061 in the front area of the respective bracket parts 1021L, 1021R as shown. Installation in the area of the nose bridge 1022, for example in the pads 1025, also makes sense.
- the solid-state cameras 1061 can be arranged in the spectacle frame above the respective spectacle lenses 1024L, 1024R in order to achieve a further axis alignment.
- solid-state or other types of light detection systems can be installed in the eyeglass lens 1024 in the future, which can of course also be a plastic or other translucent material.
- Such an arrangement of the cameras 1061 would enable an almost confocal signal acquisition with the respective eye 1080L, 1080R.
- the information obtained from the sensor devices 1061 should possibly be correlated with the eyes 1080.
- Such a correlation is particularly important if the sensor devices 1061 are real ized by cameras 1061 and an overlay image is to be projected into the respective eye 1080L, 1080R on the basis of image information obtained from the cameras 1061.
- parallax occurs, in which the “field of view” of the respective camera 1061L, 1061R does not match the naturally perceived field of view.
- the parallax would lead to an abnormal perception, especially if the eyes were rotated 1080 from the rest position or if there were objects in the near field of view. Because in such cases ge the visual axis of the eye 1080 obliquely to the "visual axis" of the respective camera 1061L, 1061R.
- the signal detection device 1051 detects an at least partial reflection image of the field of view from the respective eye 1080L, 1080R. Characteristic pixels that can be found both in the captured reflex image and in the images captured by the cameras 1061 then serve as reference points for a perspective-correct projection of the image information captured by the cameras 1061 onto the eye 1080. Similarly, those captured from the eye 1080 can be used Signals serve to determine the viewing direction of the respective eye 1080L, 1080R with respect to the coordinate system of the glasses 1020 in order to carry out a mathematically based correlation from this angle.
- a correlation also makes sense in system applications in which the eyes 1080 are prevented from perceiving the visual field.
- This is the case, for example, when using closed, so-called “virtual reality” glasses 1020 (as shown, but with opaque glasses 1024) in which only an artificially generated image is presented to the eyes 1080.
- the correlation discussed could consist, for example, in that the viewing direction of the eye 1080 is detected as described above and that a virtually generated image corresponding to the orientation of the respective eye 1080L, 1080R is projected into it.
- the glasses 1020 serve as the coordinate system here.
- a correlation can be established between the respective eye 1080L, 1080R and the surroundings.
- a system could be for example in a virtual adventure house, similar to a haunted house.
- anyone who is currently on a running track could be projected with a virtual image that gives them the feeling that they are walking on floating tree trunks in the middle of a wild river.
- the information system according to the invention comprises means which make it possible to provide a binocular function.
- FIGS. HA and 11B illustrate the perceptible effect of the binocular function on a user.
- FIG. HA shows the naturally perceived field of view 1190 of a user of an information system designed according to the seventh exemplary embodiment.
- the field of view 1190 includes approximately 170 ° horizontally and approximately 110 ° vertically of the surroundings, only a small area 1191 of a few degrees around the visual axis forms the area of the sharpest vision 1191.
- the information system can be designed in such a way that this area 1191 is optically enlarged, for example at the push of a button after appropriate processing of the detected image points by means of an evaluation device included in the information device the area of sharpest vision is projected 1191.
- the level of perception of a person projected image in relation to the naturally perceived image can be controlled by the brightness of the projected pixels. If the field of view light is detected, for example, as a reflex image from the eye, a spatial or temporal separation of the detection and the projection ensures that the projection does not influence the detection.
- the information system can determine the visual axis or the position of the fovea centralis relative to the optical system of the glasses by detecting signals from the eye, the information system is able to avoid this disadvantage of standard binoculars.
- the projection can be carried out in a manner as shown in FIG. 11B, in which only a small area 1191, which lies in the natural field of view immediately around the visual axis, is projected enlarged onto the fovea centralis, while no projected image information is superimposed on the rest of the field of view , Thus, the scene perceived peripherally by the user remains the same despite the telescopic presentation of the most relevant area of the visual field.
- the brightness of the image information projected into the eye must of course be selected so that the desired perceptual relationship between the natural and the projected image is created.
- This system also has the advantage that the effort required for enlarging the image processing is kept within limits, because only a selected image area 1191 of the field of view 1190 is processed.
- a magnified image is projected into the eye in such a way that the projected image is enlarged more in an annular border area between the area of the sharpest vision 1191 and the remaining area of the retina with increasing proximity to the visual axis.
- the outer edge is not enlarged at all and the inner edge is enlarged with the same "zoom factor" as the enlarged image projected into the inside of the ring, ie onto the fovea centralis. With a correspondingly selected brightness of the projected image information, there is a smooth transition between the peripheral scene and the telescopically seen.
- FIGS. 11C and HD show schematically how an enlargement of the image naturally falling on the fovea centralis can be achieved by changing a scanning pattern 1138, 1139 when scanning a reflex image.
- projection patterns 1137 and scanning patterns 1138, 1139 are shown in a common plane in FIGS. 11C and HD for the sake of explanation, it may be the case in the information system according to the invention that the retina is projected while the scanning, for example, from the cornea he follows.
- Figure 11C schematically illustrates a typical scan pattern 1138 that scans the corneal or retinal area 1189 reflecting the field of view.
- the scanning pattern 1138 thus coincides with the projection pattern 1137 despite possible spatial or temporal separation of the scanning and projection beams.
- the scanning can be carried out according to a modified scanning pattern 1139 which is shown in in a central area with an increase in the density of the scanned image points. If these image points recorded with increased densities are correspondingly projected in the projection, but are projected back with lower densities, this results in an enlarged image.
- the information system represents a guidance system.
- the information device of the information system comprises position sensors, for example acceleration measuring devices or GPS receivers, and a database or database connection which provides orientation data.
- a database can be implemented, for example, via a CD-ROM carrying the data, a DVD or another exchangeable storage medium in connection with a corresponding reading device.
- Methods and devices for obtaining location information for example determining the location or making it possible to determine it, by combining such orientation data with data obtained from the position sensors are known.
- the orientation data comprise map information which is used in connection with signals provided by the position sensors for determining the location. Establishing a correlation or a dependency, for example, in the acquisition or display of such location information between signals detected from the eye or light detected from the visual field and the provision of the information, however, far exceeds the technical nature.
- FIGS. 12A to 12E show the perceived visual field 1290 of a user of an information system designed according to the eighth exemplary embodiment.
- the detected field of view light is, in view of the location information obtained, by means of a pattern recognition, taking into account those for the determined location Available data evaluated.
- Orientation indications to be expected for the determined location such as striking buildings, side streets, or the like, are recognized so that, for example, visual or acoustic guidance or identification can take place, if necessary.
- the guidance system is used for navigation.
- the next street on the right is to be turned.
- This street is recognized on the basis of the detected field of view light by means of a pattern recognition, whereupon an arrow pointing towards the street is projected into the field of view in accordance with the location, taking into account the viewing direction determined by the system.
- the guidance system could provide the road user with acoustic messages, for example "turn right after 50m" or "now right".
- the guidance system is used for information.
- information about his immediate environment can optionally be made available to a user.
- a tourist using the information system looks at a striking building and actuates an activation button that is physically present or virtually displayed in the visual field.
- the building is then determined on the basis of the determined location and a pattern recognition based on the detected field of view light or an electronic compass determining the head direction, whereupon information about the building is made available.
- These can come from a database or other information source and can be selected, for example, interactively using a context-sensitive menu that visually or acoustically lists the information available for the respective building.
- the selection could be via voice control or via a fi xation done with the eyes. More on eye-controlled menu navigation is explained in a later section of this description.
- FIG. 12B historical data are faded into the visual field by projection.
- the system uses the visual field light to determine a suitable fade-in point, for example in front of a monotonous roof or against the sky.
- the data is displayed in accordance with the insertion point.
- the fovea centralis will initially not be directed at the fade-in point, which is why the faded-in data is initially perceived as a fuzzy peripheral phenomenon.
- Only by correspondingly swiveling the viewing direction according to FIG. 12C is the stationary data displayed on the fovea centralis. If the view is directed to another building recognized by the system, the information displayed can change according to FIGS. 12D and 12E.
- the circle 1290 represents the perceived visual field, while the circle 1291 identifies the area of the visual field covered by the fovea centralis.
- such an orientation system could be carried by a pedestrian, a cyclist, a motorcyclist or another vehicle driver.
- the information system according to the invention functions as a driving aid.
- the figures show the perceived field of view 1390 of a user of such a system.
- the information device of the information system preferably comprises a distance sensor, for example an optical or acoustic distance measuring device or a radar device, or is connected to a corresponding distance measuring system that determines the distance between a vehicle and objects in front of the vehicle in the direction of travel.
- a distance sensor for example an optical or acoustic distance measuring device or a radar device
- the distance could be determined by means of a paralax calculation, in which the change in the position of the object in a respective image captured on the left and right provides information about the distance.
- a warning sign 1395 in the area of sharpest vision 1391 and a warning circle 1394 around the dangerous object can be used, for example, by means of an as described above Projection. If the object is outside or on the edge of the area of peripheral vision, another warning sign 1395a can indicate where the danger is. This is shown in Figure 13A.
- a warning sign 1395 can be displayed in the area of the keenest vision 1391. This is shown in Figure 13B.
- the advantage of displaying the warning sign 1395 in the area of the sharpest vision 1391 is that the sign 1395 appears where the eye is looking, and therefore does not lead the eye to look away from the present scene. For this reason, the brightness should be faded in Characters are chosen so that the characters appear translucent. The danger can also be indicated acoustically.
- FIGS. 14A and 14B show an information system according to the invention in accordance with a tenth exemplary embodiment, which illustrates the possibilities of a complex, versatile information system.
- the information system shown has a mobile fire control center 1410, which includes a control panel 1412, and a plurality of helmet systems 1411.
- Each of the helmet systems 1411 includes a signal detection device as described above and a field of view detection device.
- Each of the helmet systems 1411 can optionally be equipped with a projection device, infrared sensors and / or position sensors. They can also be equipped with additional sensors that, for example, enable air quality to be determined.
- each of the helmets 1411 at - equipped playing with a radio communication system that communicates with the control center 1410 or the control console 1412 and the accepts through its sending and receiving information on both tasks of an information apparatus and tasks of an output device.
- the visual field images captured by the respective helmets 1411 which can be matched to the actually perceived visual field of the respective firefighter on the basis of the signals acquired from the eyes, are transmitted to the control console 1412 and displayed there on monitors.
- operators of the control console 1412 could also wear a projecting spectacle system, so that only the image data falling on the area of the fovea centralis of the operator must be transmitted or recorded in high resolution.
- a correlated visual field image of a single firefighter or a mosaic of several images could also be projected into it. The operator could see exactly what the firefighter sees, or an image that changes depending on his own eye movements could be made available to the firefighter.
- additional information could be woven into the projected image for the operator and / or the fireman.
- orientation or temperature information obtained by the position sensors or infrared sensors could be blended into the visual field.
- the constant display of certain cardinal points, such as north and west, as well as elevations, would be a helpful reference for both the operator, who is distant from what is happening, and the fireman, who is covered by smoke and smoke.
- FIG. 15 shows an information system according to the invention in accordance with an eleventh exemplary embodiment, in which the information system is used to operate an external system, for example a remote-controlled robot 1570 designed to move dangerous objects.
- the robot 1570 movable on wheels includes a chamber device 1571 and a gripper arm 1572.
- the robot 1570 is connected, for example, via a radio link to an eyeglass system 1520 worn by a user 1502.
- the images recorded monoscopically or stereoscopically via the camera device 1571 could be monoscopically or stereoscopically projected onto the retina of the user 1502 using a projection device comprised by the glasses system 1520. With stereoscopic projection, spatial vision would be guaranteed.
- the field of view seen by the user 1502 can be selected by selecting an image section from the image provided by the camera device 1571, as described above , depending on the detected eye movements of the user 1502 are kept in correlation with the distant image. Otherwise, the camera device 1571 could be swiveled in correlation with the eye movements.
- the movements of the head of the user 1502 can also be detected via position sensors in such a way that the camera device 1571 pivots in correlation with the head movements.
- a microphone in particular a directional microphone that is oriented as a function of the head position or the viewing direction
- a further sensory dimension can be realized.
- a manually operated control stick 1525 is connected to the spectacle system 1520, for example via a cable 1526. In this way, for example, the gripper arm 1572 or the direction of travel of the robot 1570 could be controlled in several directions.
- FIG. 16 schematically shows an information system according to the invention in accordance with a twelfth exemplary embodiment, in which an eyeglass system 1620 functions as a universal remote control for one or more devices, for example a computer, a video recorder 1676, a printer 1677, a slide projector and / or a telephone 1679 ,
- an eyeglass system 1620 functions as a universal remote control for one or more devices, for example a computer, a video recorder 1676, a printer 1677, a slide projector and / or a telephone 1679 ,
- the glasses system 1620 provides a two-way interface between a user 1602 and the device 1675-1679 to be operated.
- the identity of the targeted device 1675-1679 can be determined either with or without the help of the device 1675-1679. In the following it is assumed that both the device 1675-1679 and the glasses 1620 are equipped with the signal reception or transmission device necessary for the described processes.
- this device 1675-1679 either emits an identification signal at more or less regular intervals, for example an infrared or ultrasound signal, or it is emitted by one of the glasses 1620 broadcast request signal prompted to broadcast an identification signal.
- the request signal must be broadcast locally in the direction of the gaze in order to prevent other devices from responding.
- the one broadcast by the device 1675-1679 Identification signal is recognized by the glasses, from which the identity of the device is deduced.
- the glasses 1620 in cooperation with a database or other information source 1640, which contains pattern recognition data for the respective addressable devices 1675-1679, perform a pattern recognition of the targeted area of the visual field.
- a menu adapted to the possible functions of the device is faded into the field of view of the user 1602, possibly at the touch of a button or with a wink.
- the corresponding information from a database or another information source 1640 is first brought to the knowledge, for example by standardized query of the device itself. Identification of the device embedded in the query signal can ensure that only the desired device responds to the query. Because the menu is superimposed on the field of view, the user 1602 can operate the hierarchical menu, if necessary, by slight eye movements like a computer menu.
- a signal corresponding to the function is sent from the glasses 1620 to the device 1675-1679. Identification of the device embedded in the signal can ensure that only the desired device responds to the signal.
- FIG. 17 shows an optical system according to a thirteenth exemplary embodiment, in which a tilting mirror 1755 enables switching between an image from the visual field and an image from the eye 1780 or a projection onto the retina 1781.
- the advantage of this optical system is that the same swash mirrors 1754H and 1754V can be used for a picture from the visual field and for a projection onto the retina 1781, and that the beam path for a picture from the visual field and the beam path for a picture from the eye 1780 or a projection onto the retina 1781 are accordingly largely identical.
- the optical system thus already achieves a high correlation between the light detected from the visual field and the signals detected from the eye or a high correlation between the light detected from the visual field and the image projected onto the retina. This means that no additional correlation errors are attempted by the fact that the beam paths discussed run over different wobble mirrors, which could have different rotation characteristics.
- the same light detection device 1751 can even be used for light detection from the visual field and light detection from the eye. The correlation can only be negatively influenced by the reflection on the spectacle lens 1724 and the optical system of the eye 1780.
- the information system according to the invention is designed in such a way that the provision of information comprises a projection of image information into the eye, various visually related media, for example electronic books or newspapers, television or video games, can be realized by the information system.
- the information system according to the invention is implemented, for example, as described above, in the form of portable glasses, which are connected via a cable, infrared or radio link, for example to an information network, a portable storage device, for example a CD-ROM or DVD reader, or a other source of information can be connected.
- an advantage of such an embodiment of the information system according to the invention is that its detection of signals from the eye in connection with its detection of the visual field enables a projection in which the projected text or the projected images appear to be fixed in space.
- the information device comprises an evaluation device which determines the correlation of the visual axis to the field of view and which controls the projection accordingly, so that the information projected onto the eye appears to be immovable vis-à-vis the field of view despite movements of the eye.
- the determination of the correlation of the visual axis to the surroundings can also be supported by position sensors mounted in the glasses.
- the virtual location of the fixation can be determined, for example, by means of a fixation with the eyes in connection with a wink or a keystroke, or also automatically, for example by means of an image-processing evaluation of the field of vision, which determines an area of the field of vision that is as low in content as possible.
- the disruptive effect of the natural field of view which is not necessarily covered by the projection of the information, could be reduced by a color-complementary “wiping out”, in which complementary-colored image points are determined on the basis of the light detected from the field of view, the correlated projection of which on the respectively assigned areas of the Retina makes the natural background appear white by adding color. If a black background is desired, the perceived overall brightness of the projection must exceed the perceived overall brightness of the natural visual field by approximately 10% to 20%, so that even the brightest points of the natural visual field are perceived as black.
- image information representing virtual control buttons could be projected into the eye in such a way that they also appear fixed in the visual field in the vicinity of the text or image.
- the virtual information medium could be remotely operated by targeting the corresponding control button with the fovea centralis plus pressing a button or winking, i.e. Turning, fast-forwarding, rewinding, etc.
- access to dictionaries, databases, etc. be made possible by targeting words or parts of pictures.
- the information system could also be operated, for example, by means of a menu guidance, in which operating menus “jump open” when viewing certain image areas, in order to enable eye-controlled selection from the hierarchical menu, if any.
- Another advantage of such an embodiment of the information system according to the invention is that the amount of data required for a sufficient instantaneous display is far less than the amount of data that would be necessary for high-resolution display of the entire field of view. This is due to the fact that the information system knows the area of sharpest vision. Thus, only those parts of the project tion with high resolution that affect the area of the fovea centralis. A projection with a low pixel density is sufficient on other areas of the retina. Accordingly, the amount of data required for a current display is reduced, which brings clear system advantages. In particular, the perceived size of the projected image can be chosen as desired without the result that large amounts of data cannot be processed to present the current image.
- the current visual axis determines the image section.
- the projection takes place in such a way that the current image section fills the entire active area of the retina. Additional sections of the image can be brought into the field of vision by moving the eyes. If the projected image is smaller than the visual field, then only a limited part of the retina has to be projected. If the natural background of the visual field is not hidden, it changes with eye movements. Particularly in the case of television or cinema-like information displays, a projection that fills the visual field is preferred.
- the projection can be carried out stereoscopically, with each eye being fed a picture which is so slightly different that the brain believes it is able to perceive a three-dimensional overall picture.
- an optimal system-human interface could be realized, for example, for 3D television, 3D video games, 3D CAD applications or other, in particular interactive, 3D applications.
- the information system preferably comprises further operating elements, for example a control stick, pedal or steering wheel, which enables navigation or a change of perspective within the displayed virtual image or any other influence on the information presentation or a system connected to the information system.
- the eye itself can also act as a control element. With appropriate application of the measures required above for the positioning of an electronic newspaper at a virtual location, it is equally possible for the wearer of the information system according to the invention to play other orientation aids on the retina, such as an artificial horizon.
- the information system according to the invention is eminently suitable for configuration as an ophthalmic system.
- the information system according to the invention can be implemented as a positioning system for ophthalmic surgery, in particular for ophthalmic laser surgery.
- the information system according to the invention is also used, for example, as an ophthalmic diagnostic system, visual aid system and / or visual defect correction system.
- the therapeutic system can be connected to the information system according to the invention for the purpose of exchanging information in such a way that information Mations with regard to the instantaneous position of the eye are made available to the therapeutic system, so that precise, automated therapy of the eye can also take place when the eyes are moving.
- a therapeutic laser beam is directed over the optical system of the information system according to the invention.
- Laser treatment of the eye, in particular the retina can thus be carried out in the same way as a projection described above.
- pathological veins of the choroid can be obliterated by injecting or ingesting a photosensitive agent and by irradiating pathological areas of the choroid with pinpoint accuracy for several tens of seconds.
- Such therapy can be carried out precisely using the information system according to the invention.
- the output device of the information system comprises a projection device that projects vision-improving image information onto the retina.
- the information device will include an evaluation device which determines the vision-improving image information on the basis of the light detected from the visual field.
- the view-improving image information is preferably projected onto the retina in correlation with the signals detected from the eye in such a way that the naturally perceived field of view and the projected image information are perceived as a uniform image. In extreme cases, the vision-improving image information is projected onto the retina in such a way that the otherwise naturally perceived visual field is not perceived by the eye at all.
- the degree of perception of an image thus projected in relation to the naturally perceived image can be controlled by the brightness of the projected image points.
- Such an information system can be used, for example, to correct vision defects for short-sighted or far-sighted people and those with poor color vision.
- the information system can be set to a (quasi -) fixed correction, enable a changeable correction, or adapt dynamically to the visual defect.
- the correction is carried out via an optionally adjustable optical focusing system within the projection device or by means of image processing measures. The latter can be achieved with less system effort.
- a realization with a dynamic, automatic correction of the natural imaging error includes, in addition to the correlation described above, a further dependence on the signals detected by the eye.
- a retinal reflex image is recorded, which provides information about the sharpness of the image imaged on the retina by comparison with the light detected from the visual field and / or by an image processing evaluation. Accordingly, the light captured from the visual field is processed into vision-enhancing image information and projected onto the retina. By outputting the correction value determined in this way, the information system can function as a diagnostic system.
- the information system By detecting signals reflected back from the eye and light originating from the visual field, the information system according to the invention is able to provide information about many ophthalmologically relevant properties of the eye by means of an appropriately programmed evaluation device. For example, squint angles, primary positions (PP), visual field determinations with colors, smoldering value tests, standardized test procedures for glaucoma diagnosis, tests of retinal functions (e.g. ERG and VEP) can also be carried out at selected locations and perform or determine against the receptive fields.
- the person skilled in the art selects the signals to be recorded for this purpose from the eye, the visual field stimuli required for this and the processing algorithms required for this, based on his specialist knowledge and in consideration of the invention described above.
- the visual acuity can be determined by an evaluation of signals reflected back from the eye and then corrected
- the correction of some other visual defects requires a system-independent determination of the defect, for example by an ophthalmologist.
- a suitable setting of the correction made by the information system can be carried out recursively or simply.
- a correction according to the previous setting is made by the information system while the eyesight of the defective person is tested.
- a new setting of the information system is selected based on the results of the tests. This process is carried out repeatedly until the visual defect has been sufficiently compensated. In this sense, the information system nevertheless functions as a diagnostic system; because the best correcting final setting can be used to determine the visual defect.
- the eyesight of the defective person is tested without any compensation.
- a suitable setting of the information system is selected, which, in later use, then processes the light captured from the visual field into vision-improving image information according to this setting and projects it onto the retina.
- processing according to the setting, ie the original visual defect, for example certain spectral components or certain areas of the Field of view highlighted or changed by other image processing measures.
- a visual aid can be implemented by the information system according to the invention in that the light detected from the visual field, for example by means of highly light-sensitive photodetectors, is projected onto the retina in a greatly increased manner.
- the cones can be excited in such a way that predominantly colored, photopic vision takes place instead of scotopic vision.
- the maximum permitted brightness of the individual projected image points is also limited to a predetermined threshold value in order to avoid dazzling from brightly illuminated objects such as street lamps and oncoming cars. Such a system is therefore also suitable as an anti-blend system.
- the information device also includes an infrared sensor that detects infrared light from the field of view, additional monochrome image information relating to the field of view at night or in fog can be obtained, which can be transformed into the visible spectral range, by means of which the detection device and the field of view can be used Evaluation device obtained to evaluate image information.
- the information system according to the invention can also be suitable for improving vision.
- image information whose brightness has been adjusted can be projected into the eye in order to enable improved vision.
- Helmets The integration of the information system according to the invention in a firefighter's helmet was explained above. Similar configurations, for example as soldiers, drivers, crane drivers, athletes or pilots helmets or glasses, are also conceivable.
- the information device of the information system preferably comprises sensors and / or radio receivers that enable a real perception of the environment and / or the reception of information from a command center.
- the output device will provide information preferably visual, audible or tactile, for example in the form of short electrical stimulation currents on the skin. The latter could be used to immediately inform a soldier of the direction of a foreign object to be moved from behind.
- the information system would also detect infrared light from the field of view in addition to the detection of visible light from the visual field.
- image information can be obtained from such detected infrared light and used in the upgrading of image information to be projected into the eye.
- the helmet could project position information or orientation aids onto the retina.
- the projection of such information into the eye is preferably similar to the projection of an electronic newspaper. This means that a distraction of the soldier is avoided by the fact that the image of the information appears to be fixed in space or vis-à-vis a neutral position of the eye. Adaptation of the image information to the background perceived behind it for the best possible result Readability takes place through an evaluation device belonging to the information device.
- the information device comprises one or more cameras which record images from outside the field of vision.
- the image information obtained in this way is then projected onto the retina via a projection device.
- the additional image projected onto the visual field image could, for example, be projected as an image in the image as a small image in the corner of the natural or projected visual field image or appear as a longitudinal stripe at the bottom.
- the detection of signals from the eye together with the detection of the visual field serves to keep the projected images in correlation with the movements of the eye.
- the information system according to the invention could include additional sensors, with the aid of which distance or weight information can be determined in order to be projected into the visual field.
- Such information can be made audible or visual, for example, when the load is viewed in combination with a button click.
- the light determined from the visual field serves as the basis for image recognition, while the signals from the eye, as described above, enable the detected visual field to be correlated with the visual axis.
- the information system according to the invention could make a lot of different information available to a pilot.
- relevant data such as flight altitude, speed or direction of flight or an artificial horizon could be faded into the pilot's field of vision as described.
- landing aid information could also be displayed, which represent a virtual landing corridor, or specify altitude or direction correction values.
- friend / enemy and target help information can be provided to the pilot.
- the pilot's line of sight plays a role both in the spatial overlay of the information and in the selection of information. The pilot wants a missile that he is sighting to be identified. If the identification is visual, he wants the overlay not to cover any relevant areas of his field of vision.
- the information system according to the invention can also function as a subsystem for the information system of the aircraft and provide it with information.
- information about where the pilot is looking could be supplied by the information system according to the invention to the aircraft information system and could contribute to target acquisition there.
- the information system could locate enemy radar positions via sensors and display their position with the associated terrain in three dimensions.
- Various information could be made available to athletes by the information system according to the invention, as in the previous examples.
- an information system according to the invention carried by an athlete can function as a subsystem of a sports device or a vehicle.
- a visible perception can be achieved by embodiments of the information system according to the invention, in which the information device comprises one or more sensors, for example magnetic field detectors, pressure sensors, thermometers, spectral sensors, optical or acoustic interference measuring devices.
- the information device comprises one or more sensors, for example magnetic field detectors, pressure sensors, thermometers, spectral sensors, optical or acoustic interference measuring devices.
- the representation corresponds to the needs of a sighted person.
- the information system according to the invention can appear as a component, in particular as a presentation device, of a complex measuring device.
- An example of such a system is an eyeglass system equipped with sensitive magnetic sensors, which is able to locate current-carrying or metallic objects in relation to the eyeglasses. If such localized objects are color-coded in the natural field of view using a projection as described above, then water or power lines running under plaster, for example, could be found very easily. the. A fitter wearing such a spectacle system would see the course of the lines, so to speak, "brushed on the wall".
- a two- or three-dimensional array or other one-dimensional or multi-dimensional distribution of the sensors is selected, very complex vector fields or gradient profiles can also be made visible to an observer via the associated object or arrangement.
- an arrangement of pressure sensors around a test object in a wind tunnel could provide pressure information which the information system according to the invention processes as described above and projects into the eyes of a viewer who is observing the test object through a window so that he can see it through the test object the resulting pressure gradients can be seen by means of the corresponding colored marking of the pressure values where they exist.
- a welder could be shown temperature information obtained by means of an infrared camera in his field of vision in such a way that the local surface temperature along the processed objects is recognizable.
- spectral sensors can be used to provide a user with information about exact color values or material compositions. Here it also makes sense to present the determined information audibly, depending on where the user is looking.
- a database and pattern recognition such a system could, for example, be used to at least approximately identify fungi or plants by the user looking at certain parts of the fungus or plant when prompted by the system or by using the sensors.
- Information system mi t - a signal detection device that detects back-reflected signals from at least one eye having a retina; an information device of an output device which provides information in cooperation with the information device and in dependence on the detected signals, the signal detection device comprising a scanning scanning device which makes at least partial detection of a retinal reflex image of the retina, and the provision of the information does not project from Includes information on the retina.
- the information device comprises an evaluation device which obtains image information relating to the visual field from the detected light; and the output device comprises a projection device that projects the image information onto the retina in correlation with the detected signals such that a naturally perceived one
- Field of view and the projected image information are perceived by the retina as a uniform image.
- the signal detection device comprises a scanning device which records an at least partial detection of the retinal reflex image in a first scanning operation and undertakes a less extensive detection of the retinal reflex image in a later scanning operation.
- the visual field detection device has a spherical or spherical reflection layer that deflects part of the light directed onto the eye into a sensor device for detection.
- Information system according to one of the preceding points wherein the signal detection device and the visual field detection device are designed as a portable unit.
- the output device providing the information in a tactile, visual, audible, smellable and / or flavored manner.
- the information device being a database, a sensor system, an information network connection and / or an evaluation device.
- Information system according to one of the preceding points, the information system being carried out in a portable form.
- a method of providing information comprising the steps:
- the signal detection comprises a scanning scan, whereby an at least partial retinal reflex image of the retina is obtained, and the making available of the information does not include any projection of information onto the retina
- Projection of the image information onto the retina in correlation with the detected signals in such a way that the naturally perceived visual field and the projected image information are perceived by the retina as a uniform image.
- the signal detection comprises scanning processes, wherein in a first scanning process an at least partial detection of the retinal reflex image takes place and in a later scanning process a less extensive detection of the retinal reflex image is carried out.
- the information device is a database, a sensor system, an information network connection and / or an evaluation device.
- Device according to item 26 for transferring optical information onto the human retina using a serial scanning and projection system with a predetermined movement pattern of the scanning and projection beam thereby indicates that the movement patterns (1502a, 1502b) of the scanning and projection beams are offset from one another.
- Retina using a sample electro-retinogram (ERG) and a correlation device with which an image played on the retina can be brought into correlation with the actually determined ERG.
- ERG electro-retinogram
- VEP Visual Enabling for Precision Surgery
- SLO Scanning Laser Ophthalmoloskop
Landscapes
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Heart & Thoracic Surgery (AREA)
- Surgery (AREA)
- Ophthalmology & Optometry (AREA)
- Biomedical Technology (AREA)
- Human Computer Interaction (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Biophysics (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Eye Examination Apparatus (AREA)
Abstract
Description
Claims
Priority Applications (24)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU2001211340A AU2001211340A1 (en) | 2000-10-07 | 2000-10-07 | Information system which detects an image of the outside world on the retina |
EP00972696A EP1405121A1 (de) | 2000-10-07 | 2000-10-07 | Informationssystem mit erfassung des bildes der aussenwelt auf der netzhaut |
PCT/EP2000/009840 WO2002031577A1 (de) | 2000-10-07 | 2000-10-07 | Informationssystem mit erfassung des bildes der aussenwelt auf der netzaut |
PCT/EP2001/011633 WO2002033472A2 (de) | 2000-10-07 | 2001-10-08 | Informationssystem und verfahren zum zurverfügungstellen von informationen unter verwendung eines holographischen elements |
US10/551,443 US8113657B2 (en) | 2000-10-07 | 2001-10-08 | Device and method for determining the orientation of an eye |
AU2002215929A AU2002215929A1 (en) | 2000-10-07 | 2001-10-08 | Device and method for determining the orientation of an eye |
AU2002221662A AU2002221662A1 (en) | 2000-10-07 | 2001-10-08 | Information system and method for providing information using a holographic element |
EP01986772A EP1405122B1 (de) | 2000-10-07 | 2001-10-08 | Vorrichtung zur bestimmung der orientierung eines auges |
DE50112749T DE50112749D1 (de) | 2000-10-07 | 2001-10-08 | Vorrichtung zur bestimmung der orientierung eines auges |
DE50112248T DE50112248D1 (de) | 2000-10-07 | 2001-10-08 | Informationssystem und Verfahren zur Zurverfügungstellen von Informationen unter Verwendung eines Holographischen Elements |
EP01987895A EP1405123B1 (de) | 2000-10-07 | 2001-10-08 | Informationssystem und Verfahren zur Zurverfügungstellen von Informationen unter Verwendung eines Holographischen Elements |
AT01987895T ATE357680T1 (de) | 2000-10-07 | 2001-10-08 | Informationssystem und verfahren zur zurverfügungstellen von informationen unter verwendung eines holographischen elements |
AT01986772T ATE367596T1 (de) | 2000-10-07 | 2001-10-08 | Vorrichtung zur bestimmung der orientierung eines auges |
PCT/EP2001/011634 WO2002031581A1 (de) | 2000-10-07 | 2001-10-08 | Vorrichtung und verfahren zur bestimmung der orientierung eines auges |
ES07013946T ES2401132T3 (es) | 2000-10-07 | 2001-10-08 | Dispositivo y procedimiento para la determinación de la orientación de un ojo |
US10/551,445 US7641342B2 (en) | 2000-10-07 | 2001-10-08 | Information system and method for providing information using a holographic element |
EP07013946A EP1840627B1 (de) | 2000-10-07 | 2001-10-08 | Vorrichtung und Verfahren zur Bestimmung der Orientierung eines Auges |
US12/646,670 US8016421B2 (en) | 2000-10-07 | 2009-12-23 | Information system and method for providing information using a holographic element |
US13/223,825 US8944602B2 (en) | 2000-10-07 | 2011-09-01 | Information system and method for providing information using a holographic element |
US13/300,691 US8382285B2 (en) | 2000-10-07 | 2011-11-21 | Device and method for determining the orientation of an eye |
US13/749,945 US20130135181A1 (en) | 2000-10-07 | 2013-01-25 | System and Method for Determining the Orientation of an Eye |
US14/572,264 US9427154B2 (en) | 2000-10-07 | 2014-12-16 | Information system and method for providing information using a holographic element |
US15/235,845 US10188288B2 (en) | 2000-10-07 | 2016-08-12 | Information system and method for providing information using a holographic element |
US16/259,496 US20190150731A1 (en) | 2000-10-07 | 2019-01-28 | Information System and Method for Providing Information Using a Holographic Element |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/EP2000/009840 WO2002031577A1 (de) | 2000-10-07 | 2000-10-07 | Informationssystem mit erfassung des bildes der aussenwelt auf der netzaut |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2002031577A1 true WO2002031577A1 (de) | 2002-04-18 |
Family
ID=8164119
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2000/009840 WO2002031577A1 (de) | 2000-10-07 | 2000-10-07 | Informationssystem mit erfassung des bildes der aussenwelt auf der netzaut |
Country Status (3)
Country | Link |
---|---|
EP (1) | EP1405121A1 (de) |
AU (1) | AU2001211340A1 (de) |
WO (1) | WO2002031577A1 (de) |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7641342B2 (en) | 2000-10-07 | 2010-01-05 | Metaio Gmbh | Information system and method for providing information using a holographic element |
US8113657B2 (en) | 2000-10-07 | 2012-02-14 | Metaio Gmbh | Device and method for determining the orientation of an eye |
US8549415B2 (en) | 2007-05-04 | 2013-10-01 | Apple Inc. | Automatically adjusting media display in a personal display system |
US8605008B1 (en) | 2007-05-04 | 2013-12-10 | Apple Inc. | Head-mounted display |
US8957835B2 (en) | 2008-09-30 | 2015-02-17 | Apple Inc. | Head-mounted display apparatus for retaining a portable electronic device with display |
US9298283B1 (en) | 2015-09-10 | 2016-03-29 | Connectivity Labs Inc. | Sedentary virtual reality method and systems |
TWI551886B (zh) * | 2014-10-13 | 2016-10-01 | 英業達股份有限公司 | 可供尋找物品之可穿戴式裝置以及尋找物品方法 |
US10481403B2 (en) | 2018-02-15 | 2019-11-19 | Tectus Corporation | Contact lens with retinal camera |
EP2929527B1 (de) * | 2011-12-06 | 2020-11-18 | E- Vision Smart Optics, Inc. | Systeme, vorrichtungen und/oder verfahren zur bereitstellung von bildern |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5659327A (en) * | 1992-10-22 | 1997-08-19 | Board Of Regents Of The University Of Washington | Virtual retinal display |
DE19631414A1 (de) * | 1996-08-05 | 1998-02-19 | Daimler Benz Ag | Vorrichtung zur Aufnahme des Netzhautreflexbildes und Überlagerung von Zusatzbildern im Auge |
FR2762688A1 (fr) * | 1997-04-29 | 1998-10-30 | Sextant Avionique | Systeme optique combinant une presentation d'image et une analyse de l'oeil |
WO1999036826A1 (en) * | 1998-01-20 | 1999-07-22 | University Of Washington | Virtual retinal display with eye tracking |
WO1999042315A1 (de) * | 1998-02-20 | 1999-08-26 | Daimlerchrysler Ag | Verfahren zum steuern oder bedienen von systemen durch bildinformationen und verfahren zur erfassung von bildinformationen |
-
2000
- 2000-10-07 EP EP00972696A patent/EP1405121A1/de not_active Withdrawn
- 2000-10-07 AU AU2001211340A patent/AU2001211340A1/en not_active Abandoned
- 2000-10-07 WO PCT/EP2000/009840 patent/WO2002031577A1/de not_active Application Discontinuation
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5659327A (en) * | 1992-10-22 | 1997-08-19 | Board Of Regents Of The University Of Washington | Virtual retinal display |
DE19631414A1 (de) * | 1996-08-05 | 1998-02-19 | Daimler Benz Ag | Vorrichtung zur Aufnahme des Netzhautreflexbildes und Überlagerung von Zusatzbildern im Auge |
FR2762688A1 (fr) * | 1997-04-29 | 1998-10-30 | Sextant Avionique | Systeme optique combinant une presentation d'image et une analyse de l'oeil |
WO1999036826A1 (en) * | 1998-01-20 | 1999-07-22 | University Of Washington | Virtual retinal display with eye tracking |
WO1999042315A1 (de) * | 1998-02-20 | 1999-08-26 | Daimlerchrysler Ag | Verfahren zum steuern oder bedienen von systemen durch bildinformationen und verfahren zur erfassung von bildinformationen |
Cited By (37)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8944602B2 (en) | 2000-10-07 | 2015-02-03 | Metaio Gmbh | Information system and method for providing information using a holographic element |
US8016421B2 (en) | 2000-10-07 | 2011-09-13 | Metaio Gmbh | Information system and method for providing information using a holographic element |
US8113657B2 (en) | 2000-10-07 | 2012-02-14 | Metaio Gmbh | Device and method for determining the orientation of an eye |
US10188288B2 (en) | 2000-10-07 | 2019-01-29 | Apple Inc. | Information system and method for providing information using a holographic element |
US7641342B2 (en) | 2000-10-07 | 2010-01-05 | Metaio Gmbh | Information system and method for providing information using a holographic element |
US9427154B2 (en) | 2000-10-07 | 2016-08-30 | Metaio Gmbh | Information system and method for providing information using a holographic element |
US9880720B2 (en) | 2007-05-04 | 2018-01-30 | Apple Inc. | Adjusting media display in a personal display system based on perspective |
US8605008B1 (en) | 2007-05-04 | 2013-12-10 | Apple Inc. | Head-mounted display |
US11733845B2 (en) | 2007-05-04 | 2023-08-22 | Apple Inc. | Automatically adjusting media display in a personal display system |
US8832557B2 (en) | 2007-05-04 | 2014-09-09 | Apple Inc. | Adjusting media display in a personal display system based on perspective |
US8549415B2 (en) | 2007-05-04 | 2013-10-01 | Apple Inc. | Automatically adjusting media display in a personal display system |
US9965157B2 (en) | 2007-05-04 | 2018-05-08 | Apple Inc. | Automatically adjusting media display in a personal display system |
US10306036B2 (en) | 2008-09-30 | 2019-05-28 | Apple Inc. | Head-mounted display apparatus for retaining a portable electronic device with display |
US8957835B2 (en) | 2008-09-30 | 2015-02-17 | Apple Inc. | Head-mounted display apparatus for retaining a portable electronic device with display |
US9646574B2 (en) | 2008-09-30 | 2017-05-09 | Apple Inc. | Head-mounted display apparatus for retaining a portable electronic device with display |
US9646573B2 (en) | 2008-09-30 | 2017-05-09 | Apple Inc. | Head-mounted display apparatus for retaining a portable electronic device with display |
US9749451B2 (en) | 2008-09-30 | 2017-08-29 | Apple Inc. | Head-mounted display apparatus for retaining a portable electronic device with display |
US11716412B2 (en) | 2008-09-30 | 2023-08-01 | Apple Inc. | Head-mounted display apparatus for retaining a portable electronic device with display |
US9482869B2 (en) | 2008-09-30 | 2016-11-01 | Apple Inc. | Head-mounted display apparatus for retaining a portable electronic device with display |
US9595237B2 (en) | 2008-09-30 | 2017-03-14 | Apple Inc. | Head-mounted display apparatus for retaining a portable electronic device with display |
US9429759B2 (en) | 2008-09-30 | 2016-08-30 | Apple Inc. | Head-mounted display apparatus for retaining a portable electronic device with display |
US10897528B2 (en) | 2008-09-30 | 2021-01-19 | Apple Inc. | Head-mounted display apparatus for retaining a portable electronic device with display |
US10306037B2 (en) | 2008-09-30 | 2019-05-28 | Apple Inc. | Head-mounted display apparatus for retaining a portable electronic device with display |
US10306038B2 (en) | 2008-09-30 | 2019-05-28 | Apple Inc. | Head-mounted display apparatus for retaining a portable electronic device with display |
US11258891B2 (en) | 2008-09-30 | 2022-02-22 | Apple Inc. | Head-mounted display apparatus for retaining a portable electronic device with display |
US11089144B2 (en) | 2008-09-30 | 2021-08-10 | Apple Inc. | Head-mounted display apparatus for retaining a portable electronic device with display |
US10530915B2 (en) | 2008-09-30 | 2020-01-07 | Apple Inc. | Head-mounted display apparatus for retaining a portable electronic device with display |
US10530914B2 (en) | 2008-09-30 | 2020-01-07 | Apple Inc. | Head-mounted display apparatus for retaining a portable electronic device with display |
US10686922B2 (en) | 2008-09-30 | 2020-06-16 | Apple Inc. | Head-mounted display apparatus for retaining a portable electronic device with display |
EP2929527B1 (de) * | 2011-12-06 | 2020-11-18 | E- Vision Smart Optics, Inc. | Systeme, vorrichtungen und/oder verfahren zur bereitstellung von bildern |
TWI551886B (zh) * | 2014-10-13 | 2016-10-01 | 英業達股份有限公司 | 可供尋找物品之可穿戴式裝置以及尋找物品方法 |
US11125996B2 (en) | 2015-09-10 | 2021-09-21 | Connectivity Labs Inc. | Sedentary virtual reality method and systems |
US10345588B2 (en) | 2015-09-10 | 2019-07-09 | Connectivity Labs Inc. | Sedentary virtual reality method and systems |
US9804394B2 (en) | 2015-09-10 | 2017-10-31 | Connectivity Labs Inc. | Sedentary virtual reality method and systems |
US9298283B1 (en) | 2015-09-10 | 2016-03-29 | Connectivity Labs Inc. | Sedentary virtual reality method and systems |
US11803055B2 (en) | 2015-09-10 | 2023-10-31 | Connectivity Labs Inc. | Sedentary virtual reality method and systems |
US10481403B2 (en) | 2018-02-15 | 2019-11-19 | Tectus Corporation | Contact lens with retinal camera |
Also Published As
Publication number | Publication date |
---|---|
AU2001211340A1 (en) | 2002-04-22 |
EP1405121A1 (de) | 2004-04-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
DE10103922A1 (de) | Interaktives Datensicht- und Bediensystem | |
EP1430349B1 (de) | Informationssystem | |
EP1190667A2 (de) | System zur Aufnahme des Netzhautreflexbildes | |
EP1405123B1 (de) | Informationssystem und Verfahren zur Zurverfügungstellen von Informationen unter Verwendung eines Holographischen Elements | |
EP0825826B1 (de) | Verfahren und vorrichtung zum parallelen erfassen von sehinformation | |
DE102006002001B4 (de) | Verfahren zur Bestimmung der räumlichen Relation eines Auges einer Person bezüglich einer Kameravorrichtung | |
DE10251933B4 (de) | Aufnahmevorrichtung für die kopfgestützte Bilderfassung und Verfahren zur Steuerung der Aufnahmevorrichtung | |
EP0917661A2 (de) | Vorrichtung zur aufnahme des netzhautreflexbildes und überlagerung von zusatzbildern im auge | |
WO2017133992A1 (de) | Projektionsvorrichtung für eine datenbrille, verfahren zum darstellen von bildinformationen mittels einer projektionsvorrichtung und steuergerät | |
CN101634750A (zh) | 具有变焦距透镜的头戴显示器 | |
EP2737278A1 (de) | Berührungslos bedienbare vermessungsvorrichtung und steuerverfahren für eine solche | |
DE102017108551A1 (de) | Kopftragbare Darstellungsvorrichtung, Verfahren zum Betreiben derselben und medizinisch optisches Beobachtungssystem | |
CN109964230A (zh) | 用于眼睛度量采集的方法和设备 | |
WO2002031577A1 (de) | Informationssystem mit erfassung des bildes der aussenwelt auf der netzaut | |
Tatler et al. | Eye movement recordings in natural settings | |
WO2002097511A1 (de) | Verfahren und vorrichtung zur anpassung eines optischen systems an die blickrichtung des menschlichen auges | |
EP1430350B1 (de) | Informationssystem | |
EP1840627B1 (de) | Vorrichtung und Verfahren zur Bestimmung der Orientierung eines Auges | |
Sachsenweger et al. | Stereoscopic acuity in ocular pursuit of moving objects: Dynamic stereoscopy and movement parallax: Relevance to road safety and occupational medicine | |
DE19502337C2 (de) | Vorrichtung und Verfahren zur Prüfung von Sehfunktionen | |
US8567950B2 (en) | Apparatus for treating visual field loss | |
WO1999003013A1 (de) | Verfahren zur verbesserung des optischen wahrnehmungsvermögens durch modifikation des netzhautbildes | |
RU2792536C1 (ru) | Цифровые очки для восстановления и эмуляции бинокулярного зрения | |
DE10127826A1 (de) | Projektionssystem und Projektionsverfahren | |
WO2023096713A1 (en) | Personalized optics |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG |
|
DFPE | Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101) | ||
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
REG | Reference to national code |
Ref country code: DE Ref legal event code: 8642 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2000972696 Country of ref document: EP |
|
WWP | Wipo information: published in national office |
Ref document number: 2000972696 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: JP |
|
WWW | Wipo information: withdrawn in national office |
Ref document number: 2000972696 Country of ref document: EP |
|
REG | Reference to national code |
Ref country code: DE Ref legal event code: 8642 |