CN109963495A - Retina image-forming device equipment and system with edge processing - Google Patents

Abstract

In one embodiment, a kind of ophthalmoscope that the machine vision for view film analysis enables includes but is not limited to: optical lens device；Imaging sensor, positions with the optical lens device and the light for being configured as will test is converted to retinal image data；Computer-readable memory；At least one communication interface；And image processor, it can be otherwise communicatively linked to described image sensor, the computer-readable memory and at least one described communication interface, described image processor are programmed to execute operation, and the operation includes at least: obtaining the retinal image data from described image sensor；Output data is generated based on the analysis to the retinal image data, the output data needs the less bandwidth for transmission than the retinal image data；And the output data is transmitted via at least one described communication interface.

Description

Retina image-forming device equipment and system with edge processing

All themes of priority application are not incorporated herein by reference in these themes in contradictory degree herein.

Technical field

Certain embodiments of the present invention relate generally to the retina image-forming device equipment with edge processing and system.

Summary of the invention

In one embodiment, a kind of ophthalmoscope that the machine vision for view film analysis enables includes but is not limited to: Optical lens device；Imaging sensor, positions with the optical lens device and the light for being configured as will test is converted to Retinal image data；Computer-readable memory；At least one communication interface；And image processor, it can communicatedly link To described image sensor, the computer-readable memory and at least one described communication interface, described image processor quilt It is programmed to carry out operation, the operation includes at least: obtaining the retinal image data from described image sensor；Based on pair The analysis of the retinal image data generates output data, and the output data needs less than the retinal image data For transmission bandwidth；And the output data is transmitted via at least one described communication interface.

In another embodiment, by ophthalmoscope, (ophthalmoscope includes optical lens device, be configured as will be detected Light be converted to retinal image data imaging sensor and at least one communication interface) computer processor component execute Technique, include but not limited to: obtaining retinal image data from imaging sensor；Based on dividing retinal image data Analysis generates output data, and output data needs the less bandwidth for transmission than retinal image data；And pass through at least one A communication interface transmits output data.

In yet another embodiment, a kind of ophthalmoscope includes but is not limited to for obtaining retinal images from imaging sensor The device of data；For generating the device of output data based on the analysis to retinal image data, output data compares retina Image data needs the less bandwidth for transmission；With the dress for transmitting output data by least one communication interface It sets.

Detailed description of the invention

Below with reference to the following drawings detailed description of the present invention embodiment:

Fig. 1 is the perspective view according to the retina image-forming device equipment with edge processing of an embodiment；

Fig. 2 is the device that can be used in the retina image-forming device equipment with edge processing according to an embodiment Side view.

Fig. 3 A is the eyes that according to the utilization of an embodiment there is the retina image-forming device equipment of edge processing to position The zoom side view of anatomical structure；

Fig. 3 B is the diagram according to the uneven irradiation of the retina of an embodiment；

Fig. 4 is the block diagram according to the retina image-forming device equipment with edge processing of an embodiment；And

Fig. 5-33 is the work realized according to the retina image-forming device equipment that the use of multiple embodiments has edge processing The block diagram of skill.

Specific embodiment

Embodiment disclosed herein relates generally to the imaging device with edge processing and system.Be described below and The detail of certain embodiments is elaborated in Fig. 1-33, to provide the thorough understanding to these embodiments.

Fig. 1 is the perspective according to the retina image-forming device equipment 100 or ophthalmoscope with edge processing of an embodiment Figure.Retina image-forming device equipment 100 provides the machine vision for being used for health care, can be realized bottom line view outstanding Film monitoring simultaneously has high visual acuity.For example, retina image-forming device equipment 100 can when needed be with or without doctor or Nurse supervises and does not need the fast imaging for executing retina in the case where pupil dilation.Use environment may include family, public affairs Region, long-range, health clinic, hospital, nursing facility, the outer space/space flight etc. altogether.For example, retina image-forming device equipment 100 It can use/dispose on international space station, Orion (Orion) or other unit spacecrafts.

One specific embodiment includes independent compact autonomous device 100 comprising shell 102, eyepiece 104, peace Fill bracket 106, visible light emitting diode 118 (for example, red, white etc.), and/or infrared light-emitting diode 116 and infrared Imager 112, to realize, manually or automatically retina is focused.Including in retina image-forming device equipment 100, and herein Further discuss and illustrate and it is partially or completely hiding in Fig. 1 be optical lens device 120；Imaging sensor 114, It is positioned together with optical lens device 120, and the light for being configured as will test is converted to retinal image data；Computer can Read memory；At least one communication interface；Image processor is communicably linked to imaging sensor 114, computer-readable Memory and at least one communication interface, image processor programmably execute operation, and the operation includes at least: passing from image Sensor 114 obtains retinal image data；Output data is generated based on the analysis to retinal image data, output data is than view Nethike embrane image data needs the less bandwidth for transmission；And output data is transmitted by least one communication interface.

Mounting bracket 106 can couple or be removably coupled to support construction, such as desk, estrade, wall or other are flat Platform.Mounting bracket 106 includes z-axis track 108 and y-axis track 110.Z-axis track 108 enables 104 edge of shell 102 and eyepiece Z-axis is mobile relative to support construction (for example, forward and forward).Y-axis track 110 enables shell 102 relative to support construction And it is mobile along y-axis (for example, to the left and to the right) relative to eyepiece 104.Therefore, shell 102 can control between eyepiece 104 It is mobile, with to user left eye and/or right eye sample.Shell 102 can further along and move backward so that making User is comfortable or carries out other adjustings.

In certain embodiments, retina image-forming device equipment 100 includes one or more of following property or feature: The eye-point distance (eye-relief) of about 10mm, the polarization optics for reducing stray light, at 450nm to 650nm operation, The spot size less than about 7 microns, annular illumination at imager is adjustable better than what -4D to 4D was adjusted to slow down stray light Focal length and/or infrared channel have about 850nm light source and infrared imaging device, and for the eyes of about 10mm to be imaged, being used for can The optical axis in light-exposed channel is aligned.

Various forms and shape can be presented in retina image-forming device equipment 100, and is not limited to form shown in Fig. 1.Example Such as, retina image-forming equipment 100 can be coupled to wall, desk, estrade, kiosk (kiosk), computer, smart phone, notebook electricity Brain, virtual reality headset, augmented reality earphone, handheld device, rod-type installation equipment can integrate including exposes or hide The other structures of the part of structure shown in Fig. 1, largely or entirely structure.For example, shell 102, eyepiece 104 and mounting bracket 106 are desirably integrated into personal health pavilion, which hides all components other than eyepiece 104, so that energy Enough left eyes and right eye that user is positioned relative to retina image-forming device equipment 100.In addition, retina image-forming device equipment 100 can be with Mounting bracket 106 is omitted, and uses immovable mounting bracket, move and pivot (for example, 360 degree on additional direction Rotation, inclination, y-axis are mobile etc.) mounting bracket or with structure (for example, private station comprising integrated retina on it Imager device 100) integration.Alternatively, shell 102 may include two shells, have for eyepiece 104 left half and The redundant component of each of right half.In addition, eyepiece 104 may include the single mesh shared for the left eye and right eye of user Mirror.

In a specific embodiment, retina image-forming device equipment 100 be incorporated into eyeshade, laptop computer, monitor, It in phone, tablet computer or computer or is distributed there between comprising request signal device is (for example, tunable laser Or infrared transmitting set) and including can be used for capturing retinal images and/or detection eye position, rotation, pupil diameter or poly- The camera of divergence.Camera may include the irradiation apparatus (for example, red or infrared laser) being aligned jointly and multiple high-resolution phases Machine (for example, 2-3).Laptop computer or the display of other equipment can dim automatically during imaging and export vision Instruction or focus so as to the viewing in the image of one or more retinas of camera capture user or are stared.Be coupled to one or The image processor of multiple cameras realize the real-time Airborne Video System of image is acquired, is cut, is sized, is sutured or other Disclosed processing.

Fig. 2 be according to an embodiment can with edge processing retina image-forming device equipment 100 or ophthalmoscope in The side view of the device 200 used.Device 200 includes: the imaging lens arrangement 202 along first axle alignment；Along perpendicular to the The illumination lens device 204 of the second axis alignment of one axis；At least one polarizing beam splitter/combiner 206；It is configured to emit Irradiation LED 208 of the light 209 for imaging；Imaging sensor 222 is configured as the detection that will come from the guidance of optical splitter 207 To light be converted to retinal image data；And one or more coverings 210, it is configured as the light 209 in LED 208 By covering at least some of light 209 before illumination lens device 204, wherein at least one described polarizing beam splitter/combination Device 206 is configured as to be redirected to by the light 209 for the illumination lens device 204 being aligned along second axis along first axle pair At least part of retina 214 is irradiated in quasi- image optics lens devices 202.In a specific embodiment, imaging The length of lens devices 202 is about 267mm, and individual can be positioned to the about 13mm of range Imaging lens devices 202.In some realities It applies in scheme, device 200 further includes being configured to transmitting infrared light 218 to be positioned and/or be focused determining infrared LED 216, combiner 205, infrared image sensor 226, be configured as passing through illumination lens in the infrared light 218 of infrared LED 216 The infrared covering 220 of one or more that at least some of infrared light 218 is covered before device 204, wherein described at least one A polarizing beam splitter/combiner 206 is configured as will be by the infrared light for the illumination lens device 204 being aligned along second axis 218 are redirected at least part that retina 214 is irradiated along the image optics lens devices 202 of first axle alignment. In certain embodiments, device 200 further include micro-display or may be coupled to computer, smart phone, notebook electricity Brain or other personal devices.

In one particular embodiment, device 200 operates as follows: infrared LED 216 emits infrared light 218, passes through One or more infrared coverings 220, thus controllably stop at least some of infrared light 218 to be further transmitted.Via The infrared light 218 that one or more infrared coverings 220 transmit is directed into illumination lens device 204 via combiner 205. Then infrared light 218 is directed into imaging lens arrangement 202 via polarizing beam splitter/combiner 206.Then, infrared light 218 The dispersing element of (for example, people) eyes 212 is passed through before being reflected by retina 214.Then, the infrared light 218 of reflection returns It is detected back through imaging lens arrangement 202 and by infrared imaging device 226.The infrared light 218 detected by infrared imaging device 226 is used for Determine whether retina is placed in the middle and/or focuses.Then, light 209 of the transmitting of irradiation LED 208 for imaging, light 209, which passes through, to be stopped One or more coverings 210 of at least some light 209.Light 209 across one or more coverings 210 then passes through irradiation Lens devices 204, wherein it is directed into imaging lens arrangement 202 via polarizing beam splitter/combiner 206.Then, light 209 pass through the dispersing element of eyes 212 before being reflected by retina 214.The light 209 of reflection then backs through imaging len The device 202 and device 207 that is split is directed to imaging sensor 222.The retinal image data that imaging sensor 222 captures can As disclosed herein by storage, verifying and/or processing.It can according to need or require to repeat this method, such as needle Eyes to people are carried out for multiple individuals.

Can with one or more different devices come modifications or substitutions device 200 in whole or in part to capture high-resolution Rate retinal images.For example, can need to modify any lens, lens combination, lens position, lens shaped according to specific application Shape etc..Moreover, device 200 may include at least one additional imaging lens arrangement；With at least one additional image sensing Device, the light for positioning together at least one additional imaging lens arrangement, and being configured to will test are converted into additional view Nethike embrane image data.In this embodiment, imaging lens arrangement 202 and at least one additional imaging lens arrangement can have There is least partially overlapped visual field, with the section for capturing specific retina.Alternatively, imaging lens arrangement 202 and at least One additional imaging lens arrangement can have substantially parallel visual field, with the section for capturing specific retina or be used for Capture image data (for example, two eyes sampled simultaneously) associated with the second retina simultaneously.In addition, infrared LED 216 can co-locate with irradiation LED 208, and infrared LED 216 can exchange in place or infrared LED with irradiation LED 208 216 and irradiation LED 208 can be aligned relative to imaging lens arrangement 202 or differently position.In addition, imaging sensor 222 Each positioning can be co-located and/or made with infrared imaging device 226, exchanged or changed.Device 200 can be applicable to Or be used for non-retina, face, body, eyes or other image purposes, such as any other science, research, investigation or The aim of learning.

Fig. 3 A is according to the zoom side view of the anatomical structure of the eyes 300 of an embodiment, and the eyes 300 are with side The retina image-forming device equipment positioning of edge processing.Eyes 300 can be the left eye or right eye of individual, and position with device 200. Eyes 300 include cornea 302, pupil 304, crystalline lens 306 and retina 214.For illustration and clarity, the light of Fig. 3 A It is simplified, but substantially the irradiation light 209 from irradiation LED 208 enters through cornea 302, pupil 304 and crystalline lens 306, Then, it is reflected by retina 214 as imaging 308.Irradiation light 209 provides annular illumination input to retina 214.Imaging 308 are reflected by crystalline lens 306, pupil 304 and cornea 302, have about 40 to be used as by imaging sensor 222 The retinal image data capture of two degree of visual fields.Due to the positioning of one or more coverings 210, irradiation light 209 and imaging 308 have the path of the non-intersecting or minimum intersection in the dispersing element (for example, crystalline lens 306 and cornea 302) of eyes.One Or multiple coverings 210 reduce stray light, but the uneven irradiation of retina can be caused, use one or more compensation Procedure operation compensates (Fig. 3 B).In certain embodiments, one or more covering 210 (and/or one or more is moved A infrared covering 220) to adjust the distribution of the irradiation light 209 on retina 214.

Table 1: the uneven irradiation on retina generated by covering is distributed

Fig. 4 is the component according to the retina image-forming device equipment 402 or ophthalmoscope with edge processing of an embodiment Figure 40 0.In one embodiment, the ophthalmoscope 402 enabled for the machine vision of view film analysis includes but is not limited to optics Lens devices 404 position and the light that is configured to will test is converted to retinal image data with optical lens device 404 Imaging sensor 408, computer-readable memory 406, at least one communication interface 410 and it is communicably linked to image The image processor 412 of sensor 408, computer-readable memory 406 and at least one communication interface 410, image processor 408 are programmed to execute operation, and the operation includes at least: retinal image data is obtained from imaging sensor at 412, 416 generate output data based on the analysis to retinal image data, and output data needs less than retinal image data Output data is transmitted via at least one communication interface for the bandwidth of transmission, and 418.Retina image-forming device equipment 402 Or the form or different forms of retina image-forming equipment 100 can be used in ophthalmoscope.

In ophthalmoscope 402, optical lens device 404, which is arranged to, to be focused the light on imaging sensor 408, such as herein It is discussed.Imaging sensor 408 is coupled to image processor 412 via high-bandwidth link.Then, 412 coupling of image processor Computer storage 406 and communication interface 410 are closed, for being communicated via the communication link with low bandwidth ability.

Optical lens device 404 may include any Optical devices discussed in this article, such as device 200, illumination lens dress 204 and/or imaging lens arrangement 202 or another different Optical devices are set, and for related with human retina specific Visual field.Optical lens device 404 can be fixed and/or moveable, rotatable, pivotable or slidable.

Imaging sensor 408 includes the high pixel density imager that can be realized ultrahigh resolution retina image-forming.For example, Imaging sensor 408 may include the sensor of at least 18,000,000 or 20,000,000 pixels, provided in image data it is per second about 20 gigabytes, every square degree square grade provide 10,000 pixels, and are at least about 20 microns of resolution ratio.The one of imaging sensor 408 A particular example is SONY IMX 230 comprising 1.12 microns of 5408H × 4412V pixel.

Imaging sensor 408 is communicably linked via high bandwidth communications link and image processor 412.Relatively high bandwidth Communication link enable image processor 412 in real time or near real-time access exported by imaging sensor 408 it is tens of Ultrahigh resolution image within the scope of Gbps.The example of high bandwidth communications link includes MIPI-CSI to LEOPARD/ INTRINSYC adapter provides data and/or power between image processor 412 and imaging sensor 408.

Image processor 412 is communicably linked with imaging sensor 408.Due to high bandwidth communications link, image procossing Device 412 in real time or near real-time access images sensor 408 completely each pixel.Use the access, image processor 412 Before transmitting any data via communication interface 410 to full resolution retinal images execute one or more operations (for example, " edge processing ").The exemplary operation for the function of being executed by image processor 412 includes but is not limited to pass 412 from image Sensor obtains retinal image data, generates output data, the output data based on the analysis to retinal image data 416 The less bandwidth for transmission is needed compared with retinal image data, and is passed 418 via at least one communication interface Send output data.It is discussed herein and illustrate other operation and/or functions executed by image processor 412.Image processor 412 particular example includes cellular phone grade SOM, such as SNAPDRAGON SOM.Image processor 412 can also be by Program or be configured to execute any general-purpose computer processor of dedicated operations as disclosed herein, such as INTEL or AMTEL Computer processor.

In certain embodiments, ophthalmoscope 402 may include multiple 404/ imaging sensor of optical lens device, 408/ figures As the combination of processor 412, hub processor is linked to utilize and allocation processing load via backboard/hub circuit. Each of optical lens device 404 can be directed toward the overlapped fov or partial sector of retina, to increase retinal map As the whole resolution of data.

Communication interface 410 is via the communication link of Mbps magnitude in image processor 412 and client, equipment, server Or the communication interface of opposite low bandwidth is provided between cloud destination.Although communication interface 410 can provide it is available or it is feasible most High wireless bandwidth, but with the high-bandwidth communication between the imaging sensor 408 in ophthalmoscope 402 and image processor 412 It compares, this bandwidth is relatively low.Therefore, image processor 412 is necessarily transmitted via wireless communication interface 410 all available Pixel data, and the edge processing being used on ophthalmoscope 402, so as to collect very high-resolution retinal map Picture simultaneously selects/reduces communication interface 410 to transmit (or non-transmission) retinal images.In certain embodiments, communication interface 410 can be replaced with based on wired network interface, such as be replaced with Ethernet, USB and/or HDMI.The one of communication interface 410 A particular example includes honeycomb, WIFI, bluetooth, satellite network and/or websocket, can pass through internet and operation The client of JAVASCRIPT, HTML5, CANVAS GPU and WEBGL are communicated.For example, having zoom viewer application journey The HTML-5 client of sequence can be connected to ANDROID server video/camera application program of ophthalmoscope 402 via WIFI, Retinal images are transmitted with about 720p streaming.

Computer storage 406 may include non-transitory computer storage memory and/or temporary computer storage. Computer storage 406 can store program instruction and/or the original retinal images of storage for configuring image processor 412 Data, processed retinal image data, derived alphanumeric text or binary data or other similar information.

The exemplary operation and/or feature of ophthalmoscope 402 may include one or more in following item: arrive at about 20 seconds Realization user itself imaging in three minutes, can manually or automatically capture retinal images and acorea expands (non-mydriasis), mention For being automatically aligned to, the wide-angle retinal images of about forty degrees or more are captured, adjustable focal length is enabled, high-resolution is realized in each session The multiple images of rate retinal images capture, and can show/check the retinal images of capture, use the communication of opposite low bandwidth Link (for example, 1-2Mbps) in real time batch or interval (for example, from satellite to earth station) transmit high-resolution retinal map Picture enables selftest, and execution automated graphics compare or image analysis, detection retinal images (such as present image and benchmark Between image) difference, detect health problem, reduce text output, execute on machine vision or plate/original position/edge processing, make Remote watching high-definition picture, energy are realized with the opposite low bandwidth communication link (for example, wireless or interconnection net spee) of standard It is enough long-range as needed and continually monitor patient, by scene/plate/edge processing is come screen for diabetic retinopathy Become, macular degeneration, cardiovascular disease, glaucoma, malaria retinopathy, Alzheimer disease, by the video of varifocal window Preview is transmitted to client computer or equipment, so as to browse High-resolution Retinal, realizes full resolution figure As being transmitted to the visual field and level of zoom of client device or computer for request, and/or enabling machine vision applications Or third party application.

Fig. 5 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.In one embodiment, method 500 is executed by the computer processor component 412 of ophthalmoscope 402, ophthalmoscope 402 are converted to the imaging sensor 408 of retinal image data including optical lens device 404, the light for being configured to will test And at least one communication interface 410, which, which includes at least, obtains retinal image data from imaging sensor 502, 504 generate output data based on the analysis to retinal image data, and the output data needs more than retinal image data Few bandwidth for transmission, and output data is transmitted via at least one communication interface 506.

For example, processor 412 can obtain the retinal images of ultrahigh resolution from imaging sensor 408, and can be with Select the wide visual field and low zoom of retinal images.Due to the very high resolution ratio of retinal image data, processor 412 can extract the pixel in selected visual field so that image data is reduced to still relatively high resolution ratio, with Client device is transmitted to via communication interface 410.Pixel decimation leads to the lower bandwidth requirement to transmission, but the view transmitted Nethike embrane image data still can meet or exceed that the resolution capability of the display screen of client device.

As additional example, processor 412 can obtain the retinal map of ultrahigh resolution from imaging sensor 408 Picture, and can choose the narrow visual field and high zoom of retinal images.Due to the very high resolution ratio of retinal image data, Processor 412 can extract seldom pixel in selected visual field or even not extract pixel, and outside selected visual field Many is extracted to all pixels to reduce image data and keep high-resolution and high acuity to transmit via communication interface 410 To client device.Selective pixel decimation leads to the lower bandwidth requirement to transmission, but the retinal image data transmitted Part on the display screen of client device for selected visual field provides high acuity.

As another example, processor 412 can obtain ultrahigh resolution retinal images from imaging sensor 408, and will Retinal images obtained are compared to detect one or more unusual shapes with the history of storage or benchmark retinal images State.In the case where not detecting pathosis, processor 412 can not transmit image data, or in certain embodiment party In case, the binary system of transmission analysis result or alphanumeric text instruction.It is possible thereby to by avoiding image data from transmitting or pass The data for only needing several bytes per second are sent to reduce the load in communication interface 410.

As another associated exemplary, processor 412 can obtain ultrahigh resolution retinal images from imaging sensor 408, And retinal images obtained are compared with the history of storage or benchmark retinal images one or more anti-to detect Normal state.In the case where detecting potential pathosis, processor 412 can transmit retinal map related with pathosis As a part or selected visual field of data, or in certain embodiments, the binary system or alphanumeric of transmission analysis result Text instruction.It is possible thereby to by modify for transmission image data or transmission only need the data of several bytes per second come Reduce the load in communication interface 410.

Aforementioned exemplary embodiment party is supplemented or extended herein by many other examples and explanation of the operation of method 500 Case.

Fig. 6 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.It is in one embodiment, described that obtain retinal image data from imaging sensor 502 include following item In it is one or more: obtain retinal image data from the imaging sensor positioned with Optical devices 602,604 from Retinal image data can be obtained along the imaging sensor for the Optical devices positioning that at least one of x, y or z-axis are moved, 606 obtain retinal image data from the imaging sensor positioned with Optical devices that are rotatable and/or pivoting, or 608 from Retinal image data is obtained with the imaging sensor of the Optical devices positioning perpendicular to illumination lens device.

In one embodiment, image processor 412 is obtained 602 from the imaging sensor 408 positioned with Optical devices 404 Obtain retinal image data.Imaging sensor 408 can be positioned with Optical devices 404, as relative to illustrated in Fig. 1 and/or Fig. 2 With it is described.However, imaging sensor 408 can be located in common axis with Optical devices 404 relative to Optical devices 404 On, on the vertical axis with the positioning of Optical devices 404, it is located on obtuse angle or acute angle axis with Optical devices 404, or be located in one A little other positions.Imaging sensor 408 can be mobile relative to Optical devices 404.Alternatively, one or more of Optical devices 404 A lens can be mobile relative to imaging sensor 408, such as focusing light at imaging sensor 408.Image sensing Device 408 can be it is removable, changeable and/or interchangeable, so as to using have various features, ability or resolution The imaging sensor 408 of rate.

In one embodiment, image processor 412 can be 604 from can move along at least one of x, y or z-axis The imaging sensor 408 that Optical devices 404 position obtains retinal image data.Optical devices 404 can be in all directions It is mobile, so as to for example adapt to user eyes position.That is, Optical devices 404 can upwards, backward, downwards, to Before, be moved to the left or right, with the position that is overlapped with the position of the eyes of specific user in eyepiece (for example, detecting eye automatically The movement of the position of eyeball and Optical devices or the shell comprising Optical devices, is moved to eye position for eyepiece).Alternatively, Optical devices 404 can be moved to average height, position and/or the specific position of position of the eyes corresponding to various individuals. In addition, Optical devices 404 can manually or automatically move between the eyes (for example, left and right) of individual in sampling ession for telecommunication It is dynamic, so that individual is in the position that sampling ession for telecommunication is kept constant relative to any eyepiece or eyeshade.In these examples, optics Device 404 can move or the shell comprising Optical devices 404 can move.

In one embodiment, image processor 412 is determined 606 from rotatable and/or pivotable Optical devices 404 The imaging sensor 408 of position obtains retinal image data.For example, Optical devices 404 can be relative to support construction (such as table Son, pillar or extension) it rotates so that retinal images sampling can be carried out from different location.In addition, Optical devices 404 can With along curve movement, to track the head shape or eye position of specific user.This can send out in retinal images sampling period It is raw, to obtain the image data of different angle when one of individual or more eyes remain stationary.The rotation of Optical devices 404 Turn, pivot or it is mobile can be manually or automatically, such as realized by using electromagnetic motor.In addition, Optical devices 404 can Shell with rotation, pivot or movement, or comprising Optical devices 404 can be rotated, pivots or be moved.

In one embodiment, image processor 412 is 608 from the Optical devices 404 perpendicular to illumination lens device The imaging sensor 408 of positioning obtains retinal image data.For example, Fig. 2 shows the photographs perpendicular to imaging lens arrangement 202 Lens devices 204 are penetrated, thus irradiation light 209 is directed to by illumination lens device 204 using polarizing beam splitter/combiner 206 As in lens devices 202.By using one or more coverings 210, the path of irradiation light 209 is controllable to reduce or eliminate With intersecting for the path of the imaging 308 in the dispersing element of eyes 212, as shown in Figure 3A.Imaging sensor 408 can substitute Ground is positioned with the Optical devices 404 for being not orthogonal to illumination lens device.For example, Optical devices 404 are relative to illumination lens device It can be at obtuse angle, vertical, at an acute angle or removable.In some cases, illumination lens device is omitted.

Fig. 7 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.In one embodiment, described to obtain retinal image data from imaging sensor 502 and include but unlimited It is passed in the image positioned 702 from the Optical devices intersected with the irradiation in the dispersing element for minimizing or eliminating eyes/reflection Sensor obtains retinal image data, 704 from the image sensing with the Optical devices positioning for including one or more coverings Device obtains retinal image data, 706 from the image with the Optical devices positioning for including one or more movable shield parts Sensor obtains retinal image data, or obtains retinal images from the imaging sensor of at least 18,000,000 pixels 708 Data.

In one embodiment, image processor 412 is 702 from the photograph in the dispersing element for minimizing or eliminating eyes Penetrate/reflect the acquisition retinal image data of imaging sensor 408 that the Optical devices 404 of intersection position.Fig. 3 A shows eyes 212 dispersing element, eyes include cornea 302 and crystalline lens 306, focus and/or scatter to retina 214 for incident light. Irradiation light 209 is guided along the path of the dispersing element by eyes 212 and is distributed in the one or more of retina 214 On part.Some in irradiation light 209 are reflected as imaging 308, and imaging 308 is along the scattering for passing back through eyes 212 The path of element passes through to be detected.Optical devices 404 are configured as minimizing the imaging 308 of irradiation light 209 and reflection Close to eyes 212 dispersing element region in or in interaction and/or interference.

In one embodiment, image processor 412 is 704 from the Optical devices for including one or more coverings The imaging sensor 408 of 404 positioning obtains retinal image data, or hides 706 from including one or more move The imaging sensor 408 that the Optical devices 404 of shield position obtains retinal image data.Fig. 2 shows be located at irradiation LED One or more coverings 210 near 208.Light 209 from irradiation LED 208 is transmitted to one or more coverings 210 And it is at least partly covered by one or more before passing through illumination lens device 204 and entering imaging lens arrangement 202 Part 210 blocks.Light 209 is then guided to retina 214.Therefore, the position of one or more coverings 210 is influenced from photograph The path of the light 209 of LED 208, position of the light 209 in the dispersing element of eyes 212 are penetrated, and is finally influenced in retina 214 The irradiation area at place.In some cases, one or more coverings 210 include in any position from one to three or more Multiple coverings 210.One or more coverings 210 can along the path orientation of light 209 at a point or along It is located in the path order of light 209 at different points.One or more coverings 210, which can be, completely or partially blocks masking Part, such as block the covering of the percentage of whole light 209, the covering for polarizing light 209 or the masking for crossing optical filtering 209 Part.In a specific embodiment, one or more coverings 210 are manually or automatically to move, to adjust the road of light 209 Irradiation area on diameter or retina 214.For example, one or more coverings 210 can be automatically moved to irradiate retina 214 Various pieces and the retinal image data of generation can be stitched together to establish comprehensive retinal images view.

Fig. 8 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.It is in one embodiment, described that obtain retinal image data from imaging sensor 502 include following item In it is one or more: retinal image data is obtained from the imaging sensor of at least 20,000,000 pixels 802,804 from every The imaging sensor of at least 10,000 pixels of square degree square grade obtains retinal image data, obtains from imaging sensor as quiet 806 The retinal image data of state image data, or the retinal images as video data are obtained from imaging sensor 808 Data.

In one embodiment, image processor 412 is from least 18,000,000 pixels or at least 2000 802 708 The imaging sensor 408 of ten thousand pixels obtains retinal image data.Imaging sensor 408 provides ultrahigh resolution image, model Enclosing can be from about 1,000,000 pixel to about 20,000,000 pixels to 100,000,000 pixels or more ten thousand pixels.In certain embodiments, Imaging sensor 408 includes the pixel of technical/commercially available maximum quantity.Therefore, imaging sensor 408 makes it possible to It is enough that retinal image data is captured with extremely high-caliber resolution ratio and visual acuity.Image processor 412 is accessible to be passed by image The full resolution retinal images that sensor 408 captures, to be used to analyze, visual field selects, focus selection, pixel decimation, resolution ratio It reduces, stationary body removes, unchanged object removes other illustrated herein or disclosed operations.

In one embodiment, image processor 412 is 804 from the imaging sensors 408 of every square degree square grade at least 10,000 pixels Obtain retinal image data.As discussed, imaging sensor 408 provide ultrahigh resolution image, range can from In about 1,000 pixel of every square degree square grade to the tens of thousands of a pixels of every square degree square grade.In certain embodiments, imaging sensor 408 includes skill In art/pixel of commercially available maximum quantity.In certain other embodiments, pixel density is in imaging sensor Changes in distribution or uneven on 408 provides higher resolution to be comparably certain retinal areas with other retinal areas Rate.Note that pixel density can be measured with square inch or square centimeter or some other measurements.Under any circumstance, scheme As therefore sensor 408 can capture retinal image data with extremely high-caliber resolution ratio and visual acuity.Image processor 412 The accessible full resolution retinal images captured by imaging sensor 408, with for analyze, visual field selection, focus selection, Pixel decimation, resolution ratio reduce, stationary body removes, unchanged object removes other illustrated herein or disclosed behaviour Make.

In one embodiment, image processor 412 is obtained from imaging sensor 408 as static image data 806 Retinal image data.Therefore, image processor 412 can be in one or more different times, by indicating manually or certainly Dynamic instruction triggering, such as by the control of computer program, obtain one or more retinal maps as static image data Picture.Static retinal image data can be associated with the entire visual field of retina or selection visual field.For example, static retinal map As data may include a series of images, a part of each image covering retina, wherein irradiation and/or covering are each Change between image.Alternatively, static retinal image data may include the image sequence for covering overlapped fov, can be used for point Resolution enhancing and/or splicing.In addition, static retinal image data may include the left eye of individual and the retinal images of right eye.

In one embodiment, image processor 412 obtains from imaging sensor 408 view as video data 808 Nethike embrane image data.Therefore, image processor 412 can be obtained by a series of still image (examples of one or more periods Such as, 20 frame about per second) composition one or more retina videos.The set of one or more retina videos can be by hand Dynamic instruction or automatic instruction triggering, such as triggered by the control from computer program.Retina video data can be with view The entire visual field or selection visual field of nethike embrane are associated.For example, retina video data may include the various pieces in retina The upper movement for carrying out digital reconstruction or panning change wherein irradiating and/or covering during movement or panning.In addition, retina Video data may include the retina video for personal left eye and right eye.

Fig. 9 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.It is in one embodiment, described that obtain retinal image data from imaging sensor 502 include following item In it is one or more: in the retinal image data that 902 obtain from imaging sensor the video data as about 20 frame per second, It is obtained 904 from imaging sensor and needs at least retinal image data of the bandwidth of 10Gbps for transmission, 906 from image Sensor, which obtains, needs at least retinal image data of the bandwidth of 20Gbps for transmission, or 908 from imaging sensor And retinal image data is obtained from least one additional imaging sensor.

In one embodiment, image processor 412 is obtained from imaging sensor 408 as about 20 frame per second 902 The retinal image data of video data.The frame rate of video data can be more or less than 20 frame per second, be specifically dependent upon spy Fixed application.For example, frame rate can slow to about 1 frame per second, or about 30 frame per second can be increased to or more.Frame speed Rate can be inputted according to user or application program controlling is adjusted.In certain embodiments, from the multiple of video data Frame can be used for the pixel by combining multiple frames from video data to generate the still image of resolution ratio enhancing.

In one embodiment, image processor 412, which is obtained 904 from imaging sensor 408, needs at least 10Gbps's Bandwidth is used to transmit or needs at least retinal image data of the bandwidth of 20Gbps for transmission 906.As begged for herein Opinion, imaging sensor 408 has high-resolution pixel density.No matter image processor 412 be with static image data or Retain the retinal image data from imaging sensor 408 in the form of video image data, the amount of captured image is all Magnitude that is significant and can be 10,000,000,000 byte per second, 20,000,000,000 bytes or more trillion bytes.The image data of the quantity It cannot be by the way that several Mbytes of communication interface 410 (for example, wireless communication interface) per second transmission completely in time can be restricted to. Therefore, before the transmission of any image data, this paper is executed by 412 plate of image processor or edge using ophthalmoscope 402 Disclosed operation.Therefore, image processor 412 has the high band to the full resolution image captured by imaging sensor 408 Width access, to execute, analysis, abnormal state detection, image compares, selective pixel decimation, selective pixel are kept, static map As removal or other operations discussed in this article.The output of image processor 412 after any full resolution processing operation It may need less bandwidth and can be transmitted more in time via communication interface 410.

In one embodiment, image processor 412 is 908 from imaging sensor 408 and from least one additional figure As sensor obtains retinal image data.For example, at least one additional imaging sensor can be with additional lens devices Associated, thus the capture of each of imaging sensor 408 and at least one additional imaging sensor and retina be not Same section, the lap with retina, or from different retinas (for example, substantially simultaneously or sequential sampling individual a left side Retina and right retina) associated image data.Alternatively, at least one described additional imaging sensor can be red Outer imaging sensor is configured as capture infrared picture data, can such as be focused by image processor 412 using to execute With eyes positioning or function placed in the middle, while iris contraction being avoided to respond.

Figure 10 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.In one embodiment, obtaining retinal image data from imaging sensor 502 includes in following item It is one or more: to be obtained and least partially overlapped view 1002 from imaging sensor and at least one additional imaging sensor The associated retinal image data in field, obtains and puts down from imaging sensor and at least one additional imaging sensor 1004 The associated retinal image data of row visual field, in the retinal image data for the resolution ratio that 1006 obtain at least 20 microns, or Retinal image data associated with about 40 degree of donut-like visual field is obtained 1008.

In one embodiment, image processor 412 is 1002 from imaging sensor 408 and at least one additional image Sensor obtains retinal image data associated with least partially overlapped visual field or additional from least one 1004 Imaging sensor obtain and the associated retinal image data of parallel visual field.Each imaging sensor can capture superelevation point Resolution image independently can be analyzed or be combined by image processor 412.For example, an imaging sensor can capture a left side Retinal image data, and another imaging sensor can capture right retinal image data.Independent image processor can be with It handles corresponding left and right retinal image data simultaneously and executes function and operation disclosed herein, such as view film analysis, Abnormal state detection, variation detection, pixel decimation, pixel selection, the removal of unchanged pixel or other operations.Left and right view Processing can reduce the duration of entire view film analysis and test while film image data.

In one embodiment, the retinal images for the resolution ratio that image processor 412 obtains at least 20 microns 1006 Data.Retinal image data can have hundreds of or several millimeters resolution ratio or can have micro- down to 10 such as detailed description Rice or smaller resolution ratio.Various Optical devices 404 and/or imaging sensor 408 can be used, be limited solely by technically and It is commercially available or be limited to budget or need it is permitted.In some embodiments, it is enough to provide view for about 20 microns The superelevation visual acuity of nethike embrane, so that image processor 412 is able to carry out the various operations and functions for being disclosed herein and showing.

In one embodiment, processor 412 obtains retinal images associated with about 40 degree of donut-like visual fields 1008 Data.Optical lens device 404 may include imaging lens arrangement 202 shown in Fig. 2, about provide since center +/- 21.7 degree of visual field.However, for different lens devices, from the very narrow visual field in about several years to non-more than 40 degree The different visual fields of the visual field of constant width are possible.In certain embodiments, Optical devices can be configured to provide adjustable , revisable or selectable visual field.In other embodiments, Optical devices 404 can be replaced with different Optical devices It changes to realize different visual fields.

Figure 11 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.It is in one embodiment, described that obtain retinal image data from imaging sensor 502 include following item In it is one or more: 1102 obtain as retina it is different, adjacent, be overlapped and/or least partially overlapped region it is more The retinal image data of a sequence captured image, and splice multiple sequence captured images of retina to create entirety View, and/or the retinal image data for obtaining multiple least partially overlapped images as retina 1104, and will be more A image is combined into High-resolution Retinal data.

In one embodiment, image processor 412 1102 obtain as retina it is different, adjacent, be overlapped and/or The retinal image data of multiple sequence captured images in least partially overlapped region, and splice multiple sequences of retina Captured image is to create overview.For example, image processor 412 can obtain left lower quadrant from imaging sensor 408, it is left The retinal image data associated with retina of upper quadrant, right upper quadrant and right lower quadrant, each quadrant image with it is adjacent Quadrant image have about 5 percent overlapping.Lap can be used by quadrant image mosaic in image processor 412 Together to carry out position alignment, to generate the whole composograph of retina.Image processor 412 can obtain less or more The section image of multi-quantity is to establish the partial or complete image of retina.In certain embodiments, image processor 412 can To control the illumination variations between each quadrant image for obtaining retina (for example, passing through one associated with irradiation source Or the controlled movement of multiple coverings).In a specific embodiment, image processor 412 passes through the figure for obtaining entire visual field As and extract pixel associated with certain non-selected regions and obtain segment or section retinal images.In another embodiment In, image processor 412 obtains a part of retinal images by the movement or adjustment of optical lens device 404.

In one embodiment, image processor 412 is obtained 1104 as the multiple least partially overlapped of retina The retinal image data of image, and multiple images are combined into High-resolution Retinal data.For example, image processor 412 can obtain a series of High-resolution Retinals of the identical overview of retina from imaging sensor 408.So Afterwards, processor 412 can be by being added together to combination a series of images at least some of pixel, with relative to being obtained Individual retinal images in any single retinal images increase pixel density, resolution ratio and/or visual acuity.Some In embodiment, the combination of the pixel from multiple retinal images can be uniform or non-uniform.For example, processor 412 can increase the pixel density in specific retina area-of-interest (for example, the region for having changed or having presented specific lesion), The pixel density in other regions is kept simultaneously.Therefore, in the retinal images that processor 412 can obtain based on one or more One or more trigger events (such as detecting potential problem area, it is contemplated that medical care and health personnel requests specific region) open Dynamic pixel density enhancing.

Figure 12 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.In one embodiment, described that output data, institute are generated based on the analysis to retinal image data 504 Stating output data to need the less bandwidth for transmission than retinal image data includes the one or more in following item: Output data, compared to retinal image data, the output number are generated based on the analysis to retinal image data 1202 According to needing about 1/10th bandwidth to generate output number based on the analysis to retinal image data for transmitting, or 1204 According to compared to the bandwidth of the about 20Gbps of the transmission for retinal image data, the output data needs the band of about 1Mbps Width is for transmitting.

In one embodiment, image processor 412 generates output based on the analysis to retinal image data 1202 Data, compared to retinal image data, the output data needs about 1/10th bandwidth to be used to transmit, or 1204 Output data is generated based on the analysis to retinal image data, compared to the pact of the transmission for retinal image data The bandwidth of 20Gbps, the output data need the bandwidth of about 1Mbps for transmitting.Image processor 412 is from imaging sensor 408 obtain ultrahigh resolution image (for example, still image or video) for one or more examples in time.The original view obtained The amount of nethike embrane image data can be far smaller than that the communication bandwidth ability of communication interface 410.For example, for transmitting all original views The required bandwidth of nethike embrane image data can be 10 times of the amount of bandwidth available of communication interface 410,20 times or more.Processor 412 overcome this potential deficiency by executing operation to ultrahigh resolution retinal images in 402 level of ophthalmoscope, this It can be referred to as on edge processing, in-situ treatment or plate and handle.By executing edge processing, figure to original retinal image data As real-time or near real-time the image of the accessible ultrahigh resolution of processor 412, and can be generated size reduce and/or According to specific needs or require the output data modified.Compared to communication interface 410, the size of output data for transmission and Speech can be obvious less, but for specific application or request be focus, be highly useful, even high-resolution Rate/acuity.

Figure 13 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.In one embodiment, described that output data, institute are generated based on the analysis to retinal image data 504 Stating output data to need the less bandwidth for transmission than retinal image data includes the one or more in following item: In the output data for transmission that 1302 generate the reduction resolution version including retinal image data, and/or 1304 Generation includes the output data for transmission of at least one of following kind of change of retinal image data: size, Pixel reduction, resolution ratio, splicing, compression, color, overlapping is reduced, static reduction and/or background are reduced.

In one embodiment, image processor 412 generates the reduction resolution ratio including retinal image data 1302 The output data for transmission of version.Image processor 412 obtains ultrahigh resolution image from imaging sensor 408, packet Include the pixel of much larger number.Therefore, original retinal images can have considerably beyond the total of the screen resolution of request equipment Resolution ratio (for example, the original retinal image data of 20,000,000 pixels shows screen to 1,000,000 pixels).Therefore, image procossing The resolution ratio of original retinal image data can be reduced to still very high resolution ratio, the very high resolution by device 412 Rate meets or more than the display resolution or average display resolution for requesting equipment.This method can be referred to as pixel pumping It takes, and image processor 412 can uniformly or non-uniformly execute pixel decimation in entire retinal image data.By The amount for the pixel decimation that image processor 412 executes can also change according to the region of selected retinal image data. For example, image processor 412, which can be configured as, extracts greater amount of pixel for the retinal image data in big region. For zonule (for example, corresponding to digital zoom), the pixel that image processor 412 can be configured as extraction lesser amt is arrived Do not extract pixel.Variable pixel depending on region extracts the retina for making it possible to transmit constant acuity or constant resolution Image.

In one embodiment, it includes the following kind of of retinal image data that image processor 412 is generated 1304 The output data for transmission of at least one of change: size, pixel reduction, resolution ratio, splicing, compression, color, overlapping It reduces, static reduction and/or background are reduced.Image processor 412 does not need to transmit all original retinal image datas, and It can use highly useful data of the various operations original retinal image data to be reduced to focus and target.For example, Image processor 412 can reduce retinal images by extracting the pixel data in addition to possible interested particular range The overall region size of data.In addition, image processor 412 can be executed in selected area-of-interest pixel decimation or Resolution ratio is reduced to for specific application (for example, printing, large-scale high-resolution monitor, mobile phone are shown by pixel reduction Show device etc.) still high resolution ratio.In some embodiments, image processor 412 can execute entire retinal images Analyzing adjuncts or reduction operation before various retinal images sections are stitched together to generate whole retinal images.? In some cases, image processor 412 can identify the redundancy lap of the retinal image data of multiple user's requests, and And only the redundancy of transmission retinal image data or lap are primary.In some embodiments, image processor 412 identifies The region of unchanged retinal image data, then removes these regions from transmission since previous transmission, so that service Device or client device return the region gap filling of omission in retinal image data.Alternatively, image processor can be with First resolution transmits the selected part of retinal image data, and transmits view with the second resolution lower than first resolution The adjacent area or background parts of film image data.In this example, first resolution, which can be, shows resolution relative to screen The high-resolution of rate, second resolution is shown relative to screen can be low resolution.Other than these operations, image procossing Device 412 can also execute compression of images to any image data before transmission.The compress technique executed by image processor 412 Example include reduce color space, coloration sub-sampling (chroma subsampling), transition coding, fractal compression, the distance of swimming One or more of coding, DPCM, entropy coding, compression (deflation), chain encoding etc..

The exemplary operational sequence of image processor 412 shows how image processor 412 utilizes one in aforementioned techniques Kind is a variety of.Image processor 412 can obtain ultrahigh resolution retinal images from imaging sensor 408 and select substantially The whole visual field in entire retinal images region.Image processor can identify region of variation (for example, due to the new table of lesion It is existing).Then, image processor 412 equably executes pixel decimation on retinal images, to reduce the resolution of retinal images Rate, to retain about the 1/10 of retinal image data.Then, image processor 412 further will be corresponding to the area in addition to change In addition the resolution ratio of retinal image data except domain reduces by 50 percent.Then, remaining image data is by image It manages device 412 to compress, and is transmitted to client device associated with doctor in the bandwidth constraint of communication interface 410.Then, objective Retinal image data can be decompressed to contract and output it to show by family end equipment, so that retinal image data includes Correspond respectively to high resolution portion and the low resolution part of region of variation and non-region of variation.Then, by image processor The 412 received requests for higher resolution image associated with non-region of variation can be logical for the specific request region It crosses and only transmits additional 50 percent pixel data via communication interface 410 and met.

Figure 14 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.In one embodiment, described that output data, institute are generated based on the analysis to retinal image data 504 Stating output data to need the less bandwidth for transmission than retinal image data includes the one or more in following item: The part corresponding with health problem including retinal image data is generated based on the analysis to retinal image data 1402 Output data, 1404 based on to retinal image data analysis generation include at least one of following health problem Identification output data: diabetic retinopathy, macular degeneration, cardiovascular disease, glaucoma, malaria retinopathy, Ah Alzheimer's disease, sphere flattening, papilledema and/or choroid fold, or 1406 based on to retinal map As output data of the analysis generation including metadata of data, the output data needs less use than retinal image data In the bandwidth of transmission.

In one embodiment, image processor 412 is generated based on the analysis to retinal image data 1402 and is corresponded to In the output data of a part including retinal image data of health problem, or 1404 based on to retinal images number According to analysis generate include the identification at least one of following health problem output data: diabetic retinopathy, Macular degeneration, cardiovascular disease, glaucoma, malaria retinopathy, Alzheimer disease, sphere flattening, optic papilla water Swollen and/or choroid fold.The accessible ultrahigh resolution retina obtained from imaging sensor 408 of image processor 412 Image, and can onboard, original position and/or using edge processing any retinal images transmission before to retinal images Execute image analysis.Image analysis may include such as image recognition analysis and measurement to detect and/or identify one of lesion Or multiple potential examples.The analysis or measurement executed by image processor 412 can based on basic parameter, from particular individual The variation of previous retinal images, and/or general or specific group of patients average value.If detection measures retinopathy Become, then image processor 412 can generate output data based on the retinopathy.The output generated by image processor 412 Data may include the binary system instruction of lesion, the alphanumeric description of lesion or measurement, and/or relative retinal map As data.

Image processor 412 can be configured as one of detection and/or the different retinopathy of measurement or a variety of. For example, image processor 412 can be configured as detection or measurement diabetic retinopathy, macular degeneration, cardiovascular disease, In glaucoma, malaria retinopathy, Alzheimer disease, sphere flattening, papilledema and/or choroid fold It is any one or more of.For example, about diabetic retinopathy, image processor 412 can be detected in retina and/or Measurement bleeding, bleed, new fragile blood vessel is to one of eye center growth or blood leakage or a variety of situations.About macula lutea Denaturation, image processor 412 can detecte and/or measure angiogenic growth, blood leakage or fluid in macula retinae region Leakage.About cardiovascular disease, image processor 412 can detecte and/or measure inflammatory and marks, such as relatively narrow retina is small Artery diameter or biggish retina veinlet diameter.About glaucoma, image processor 412 can detecte and/or measure view Disk, optic cup and neural retina edge, and calculate the share of cup disc ratio and neural retina edge.About malaria retinopathy, Image processor 412 can detecte and/or measure blood vessel discoloration, retina bleaches and bleeding or red lesion.About A Erci Extra large Mo's disease, it is fine that image processor 412 can detecte and/or measure plaque deposition object, venous blood column diameter or retina neural It is thinning to tie up layer.About sphere flattening, choroid fold, image processor 412 can detecte and/or measure the object in retina Manage impression, shape, compression or displacement.About papilledema, image processor 412 can detecte and/or measure optic disk Expansion, retinal vein is full or tortuous, retinal hemorrhage around optic disk.Image processor 412 can be configured as survey Measure or detect any visually detectable parameter, including any of above parameter or other parameters.In addition, image processor 412 Can be configured as has any one or more parameters associated with any one or more potential lesions.In addition to what is listed Except lesion, retinal images detection can be used and/or measure many other lesions, including such as papilledema, optic nerve Sheath expansion, optic disk extension, cotton spot, macula hole, macular pucker, degenerative myopia, crystalline lens denaturation, tears retinal, view Film is detached from retinal arterial obstruction, branch retinal vein occlusion remaining, thrombosis of central vein of retina, intraocular tumour, heredity view Omental lesion, penetrating trauma ocular, children and newborn's retinal disease, the infection of cytomegalovirus (cmv) retina, macula lutea water Swollen, uveitis, the infectious retinitis, central serous retinopathy, retinoblastoma, entophthamia, high blood Pressure property retinopathy, retinal hemorrhage, solar retinopathy change, retinal pigment degeneration or other optic nerves or eye become Change.

In one embodiment, image processor 412 includes based on the analysis generation to retinal image data 1406 The output data of metadata, output data need the less bandwidth for transmission than retinal image data.Image processor 412 generate metadata may include various information, as patient's name, sample time, patient age, determination potential lesion, Resolution ratio, frame per second, the image coordinate of the potential lesion of display, measurement, lesion description, the variation between previously measurement, recommendation row Dynamic scheme, additional physiological measurements are (for example, heart rate, weight, blood pressure, the visual acuity of patient, temperature, blood oxygen level, body movement Measurement, skin conductance rate) etc..Metadata can pass together with retinal image data before transmitting any retinal images It send, or is transmitted in the case where no retinal images.Metadata can be alphanumeric text, binary system or picture number According to, it is thus possible to need the bandwidth than bandwidth much less needed for transmission High-resolution Retinal.

Figure 15 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.In one embodiment, described that output data, institute are generated based on the analysis to retinal image data 504 Stating output data to need the less bandwidth for transmission than retinal image data includes the one or more in following item: 1502 based on the analysis to retinal image data, the output data of the contextual information including addition, the output are generated Data need the less bandwidth for transmission than retinal image data, 1504 based on dividing retinal image data Analysis, generates alphanumeric text output data, and the alphanumeric text output data needs less than retinal image data The bandwidth for transmission, alternatively, generating binary system output data, institute 1506 based on the analysis to retinal image data It states binary system output data and needs the less bandwidth for transmission than retinal image data.

In one embodiment, 1502 based on the analysis to retinal image data, generation includes image processor 412 The output data of the contextual information of addition, the output data need the less band for transmission than retinal image data It is wide.For example, image processor 412 can add information to retinal image data with via communication interface 410 transmit, it is described Information such as name/surname of date/time, subject, the session id of inspection, problem or lesion region highlight (for example, right The arrow or circle of image addition, the attention of Lai Jizhong clinician) or additional history image data (for example, patient Past retinal image data is compared with the current retinal image data juxtaposition of patient is to assist).It is given birth to by image processor 412 At contextual information may include text, image data, binary data, coordinate information etc..Contextual information can be with view Film image data transmit together, transmission or replacement or replace retinal images before or after retinal image data Data transmission.

For example, image processor 412 can obtain the retinal images of ultrahigh resolution from imaging sensor 408, and right Retinal images execute image recognition analysis, with identify bleeding, bleed, new fragile blood vessel is seeped towards eye center growth or blood One or more examples of leakage.The resolution ratio of retinal image data can be reduced to IPHONE 7 and shown by image processor 412 Show the resolution ratio (for example, 750 × 1334 pixels) of device, and further drops the resolution ratio in the region except the region identified Low 25 percent in addition.Then, image processor 412 can remove the institute since previous transmission in image data There is unchanged region, contextual information is then attached to retinal image data before transmission.Contextual information can be with Label including the example that date, time, patient's name and protrusion are identified.Then, the transmission of image processor 412 has reduction Retinal image data contextual information, wherein retinal image data is used before being forwarded to IPHONE 7 and requesting equipment The retinal image data filling gap previously transmitted.

In one embodiment, image processor 412 generates letter 1504 based on the analysis to retinal image data Digital text output data, the alphanumeric text output data than retinal image data need it is less for transmission Bandwidth.Image processor 412 may access to the ultrahigh resolution retinal images from imaging sensor 408.In some cases, In order to reduce the bandwidth load in communication interface 410, image processor 412 can execute the image recognition about retinal images To determine lesion or no lesion, and alphanumeric text is generated based on the lesion or without lesion.For example, alphanumeric is literary Originally the lesion detected can be described or instruction has not changed since previous analysis.Alphanumeric text can be letter, Word, phrase or paragraph, and may include number and or symbol.Therefore, alphanumeric text can be by image processor 412 transmit via communication interface 410, can only need the bandwidth of several bytes per second, rather than original retinal images number According to the megabytes per second of needs or the bandwidth of gigabytes per second.

For example, image processor 412 can obtain ultrahigh resolution image from imaging sensor 408 and execute image recognition To identify the increase of the growth of macula retinae region medium vessels, blood leakage or fluid leakage.Then, image processor 412 can To generate alphanumeric text, such as " subject John Q.Smith is in left eye with some signs of macular degeneration, packet It includes angiogenic growth and increases by 10%, the blood leakage and/or fluid in the macula lutea of left view nethike embrane leak two kinds of situations.".Then, scheme As processor 412 can transmit alphanumeric text description via communication interface, it is only necessary to several bytes per second with for transmitting, So that caregiver is it can be considered that identical situation.Retinal image data can in response to the request to further information and It is transmitted, or can be dropped, such as known the situation in caregiver and do not need further to check retinal map It is abandoned as in the case where.

In one embodiment, image processor 412 1506 based on the analysis to retinal image data, generate two into Output data processed, the binary system output data need the less bandwidth for transmission than retinal image data.At image It manages the retinal images of the accessible ultrahigh resolution from imaging sensor 408 of device 412 and executes image recognition with determination Potential lesion or no lesion in retinal image data.Then, image processor 412 can transmit electricity based on the determination Pressing high RST, (or voltage low signal (for example, 0 or 1) needs seldom bandwidth to not needing bandwidth.Retinal image data can With with binary system instruction transmit together, indicated after binary system, or do not transmit, be specifically dependent upon specific application, request or Program instruction.

For example, image processor 412 can execute image recognition or comparative analysis to ultrahigh resolution retinal images, with Determination does not change, and also exists without potential lesion.Then, image processor 412 can be generated zero instruction and connect via communication Mouth 410 transmits the instruction, without the transmission of any retinal image data.

Figure 16 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.In one embodiment, described that output data, institute are generated based on the analysis to retinal image data 504 Stating output data to need the less bandwidth for transmission than retinal image data includes the one or more in following item: 1602 by pixel decimation generate output data with independently of retinal image data selection area and/or level of zoom protect Constant resolution ratio is held, output data is generated with the selection area independently of retinal image data by pixel decimation 1604 And/or level of zoom keeps resolution ratio, the resolution ratio is less than or equal to the resolution ratio of client device, or is based on 1606 Output data is generated to the analysis of retinal image data and compresses output data, the output data compares retinal image data Need the less bandwidth for transmission.

In one embodiment, image processor 412 generates output data independently of view by pixel decimation 1602 The resolution ratio that the selection area and/or level of zoom of nethike embrane image data are kept constant.Image processor 412 may have access to non- The often ultrahigh resolution retinal images of the pixel (for example, 20,000,000 pixels or bigger pixel) of big quantity.Image processor 412 can extract the pixel of original ultrahigh resolution retinal images to maintain given resolution ratio (for example, 1,000,000 Pixel is to 5,000,000 pixels).Be extracted with maintain the pixel quantity of given resolution ratio by with selected from original retinal images Region/level of zoom size inversely changes.That is, when selection corresponds to the width of substantially entire retina When visual field, image processor 412 can extract most of pixel data.This is because selection includes nearly all original image number According to and pixel.However, when selection corresponds to the narrow visual field of the zonule (for example, optic nerve or macular region) of retina or neglects When field or high zoom level, image processor 412 can extract seldom pixel or even not extract pixel.This is because selection includes It is possibly less than given resolution ratio (for example, less than 1,000,000 pixels to 5,000,000 pixels).In this respect, wide or low zoom is selected It selects to very small or high zoom selection, image processor 412 can maintain very high level of sharpness, and in communication interface There is no essence difference in 410 opposite bandwidth requirement low.

In one embodiment, image processor 412 generates output data independently of view by pixel decimation 1604 The selection area and/or level of zoom of nethike embrane image data keep resolution ratio, and the resolution ratio is less than or equal to client device Resolution ratio.Image processor 412 can obtain the type of instruction request equipment or request first number of the screen resolution of equipment According to.Based on the metadata, the adjustable desired resolution ratio of image processor 412 and pixel decimation amount can be by spies with offer The retinal image data for the highest resolution that locking equipment adapts to.Therefore, the equipment or printing of higher screen resolution are answered With for example, image processor 412 can adjust downwards extraction amount, so that extracting less pixel and transmitting higher resolution Image.Similarly, for the equipment of lower screen resolution, image processor 412 can adjust upward extraction amount, so that taking out It takes more pixels and transmits the image of more low resolution.Image processor 412 can be adjusted in real time for various users request Whole extraction amount, to adapt to the application of many distinct devices or retinal image data.

For example, image processor 412 can be from the forth generation IPAD equipment with specified screen resolution 2048 × 1536 Receive request.The adjustable extraction of image processor is to be kept for dividing for about 3,000,000 pixels for various visual fields/or zoom selection Resolution.Image processor 412 can receive another request from the IWATCH of the given resolution with 312 × 390.In this feelings Under condition, image processor can further adjust extraction, to keep about 100,000 pixels for various visual fields and/or zoom selection Resolution ratio.In this respect, image processor 412 provides high-resolution retinal image data for particular device, while most The bandwidth requirement of smallization communication interface 410.

In one embodiment, image processor 412 generates output based on the analysis to retinal image data 1606 Data simultaneously compress output data, and the output data needs the less bandwidth for transmission than retinal image data.Image Processor 412 can compress original retinal image data or compression reduction (for example, pixel reduction, stationary body omit, do not change Become region omission etc.) after retinal image data.Compression or coding output data can via communication interface 410 with compared with Small bandwidth load transmission.The example of the compress technique executed by image processor 412 is adopted including reduction color space, coloration One or more of sample, transition coding, fractal compression, Run- Length Coding, DPCM, entropy coding, compression, chain encoding etc..

Figure 17 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.In one embodiment, described that output data, institute are generated based on the analysis to retinal image data 504 Stating output data to need the less bandwidth for transmission than retinal image data includes the one or more in following item: 1702 generated based on the analysis to retinal image data include retinal image data with the object or feature that detect The output data of corresponding part, or 1704 based on the object or feature identification generation output number in retinal image data According to the output data needs the less bandwidth for transmission than retinal image data.

In one embodiment, image processor 412 includes based on the analysis generation to retinal image data 1702 The output data of the part corresponding with the object or feature that detect of retinal image data.Image processor 412 is from image Sensor 408 obtains the retinal images of ultrahigh resolution and executes image recognition or analysis to identify interested special object Or feature.Then, image processor 412 can be to all or part outside the region including interested special object or feature Pixel is extracted.The region can define in various ways comprising only interested special object or feature, interested The image of percentage or distance, designating frame or circle or the like around special object or feature.Image processor 412 can be into One step reduce the resolution ratio of the image in corresponding with interested special object or feature region and/or can execute one or Multiple others pixels reduce operation (for example, static object removal, has not been changed region and remove, and overlapping region removes etc.).

For example, image processor 412 can obtain ultrahigh resolution retinal images and execution figure from imaging sensor 408 As analysis is to identify the one or more plaque deposition objects that may indicate that Alzheimer disease.Image processor 412 can choose The region of retinal images comprising plaque deposition object adds about 10% except plaque deposition object.Retinal images it is non-selected Region can be extracted and be stored or be abandoned, and selected areas experience pixel can be reduced before transmitting via communication interface 410 And/or compression.

In one embodiment, image processor 412 1704 based in retinal image data object or feature know Not Sheng Cheng output data, the output data than retinal image data need it is less for transmission bandwidth.Image procossing Device 412 can obtain ultrahigh resolution retinal images from imaging sensor 408, and it is specific right to identify to execute image recognition As or feature.In response to detecting specific object or feature, output data is can be generated in image processor 412, the output number According to the relevant portion that may include image data and/or other data.It can wrap by other data that image processor 412 generates Include program or function call, alphanumeric text, binary data or other similar information or the data based on movement.

For example, image processor 412 can obtain ultrahigh resolution retinal image data and be held from imaging sensor 408 Row object or feature identification are to identify one or more markers of inflammation, such as relatively narrow retinal arterioles diameter or biggish view Nethike embrane veinlet diameter.In the one or more labels of identification, image processor 412 can be generated program function and call to start The distribution of drug alerts clinic supplier, changes diet or exercise plan (is consolidated for example, increasing cardiovascular exercise and minimizing gallbladder Alcohol intake), or the non-retina physiological measurements that triggering is additional.

Figure 18 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.In one embodiment, described that output data, institute are generated based on the analysis to retinal image data 504 Stating output data to need the less bandwidth for transmission than retinal image data includes the one or more in following item: 1802 based in retinal image data event or action recognition generate output data, the output data compares retinal map As data need the less bandwidth for transmission, or the output for generating the specified visual field in retinal image data 1804 Data, the output data need the less bandwidth for transmission than retinal image data.

In one embodiment, image processor 412 is 1802 based on the event or movement knowledge in retinal image data Not Sheng Cheng output data, the output data than retinal image data need it is less for transmission bandwidth.Image procossing Device 412 obtains ultrahigh resolution image from imaging sensor 408 and executes image analysis with identification events or movement, such as previously The variation of retinal images, more than the measurement of threshold value and the deviation of specified value or other definition events or movement.It is examining Measure event or movement when, image processor 412 generate output data, the output data may include image data and/or its The relevant portion of his data.It may include program or function call, alphanumeric by other data that image processor 412 generates Text, binary data or other similar information or movement.

For example, image processor 412 can obtain ultrahigh resolution retinal images from imaging sensor 408, and will view Nethike embrane image is compared with the one or more prior images obtained in previous time for special object.In response to this ratio Compared with it is in subject and possible that image processor 412 can detecte blood vessel discoloration, retina bleaches and not previously exists Indicate the bleeding or red lesion of malaria retinopathy.Then, image processor 412 can be based on or in response to detecting Variation, such as " instruction of malaria retinopathy: 1 ", the combination of alphanumeric text and binary data is generated, via communication Interface 410 is transmitted.

In one embodiment, image processor 412 generates the defeated of the specified visual field in retinal image data 1804 Data out, the output data need the less bandwidth for transmission than retinal image data.Image processor 412 is from figure As the acquisition ultrahigh resolution retinal images of sensor 408, but in some cases, and not all retinal images all include Use information.Therefore, image processor 412 can execute reduction operation to eliminate or remove unwanted or useless information, and Retain visual field or selection comprising required or useful information.For example, visual field may include quadrant, part, section, radius, user Definition region, user request region or region corresponding with special characteristic, object or event.It is generated by image processor 412 Visual field is also possible to small high zoom region or big low zoom area.

For example, image processor 412 can be used for eyes substantially to client device transmission via communication interface 410 The big visual field of entire retina.User at client device can pull frame or kneading in big visual field and zoom to view The specified region of film.The specified area that the comparatively low resolution of retina is presented in the data previously obtained can be used in client device Domain, and further request the additional pixel data in specified region.Image processor 412 can in response to client request, via Communication interface 410 transmits the additional pixel data that may be previously extracted, with the specified region at enhancement-client equipment Acuity and/or resolution ratio.

Figure 19 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.In one embodiment, described that output data, institute are generated based on the analysis to retinal image data 504 Stating output data to need the less bandwidth for transmission than retinal image data includes the one or more in following item: In the output data that 1902 generate the specified level of zoom in retinal image data, the output data compares retinal images Data need the less bandwidth for transmission, or 1904 based on the analysis to retinal image data and based on to following In at least one of user request to generate output data: specified visual field, specified resolution ratio, specified level of zoom, Specified movement or event, specified object or feature, and/or specified health problem, the output data compare retinal map As data need the less bandwidth for transmission.

In one embodiment, image processor 412 generates the defeated of specified level of zoom 1902 in retinal images Data out, the output data need the less bandwidth for transmission than retinal image data.Image processor 412 is from figure As sensor 408 obtains ultrahigh resolution retinal images and can be by changing holding area and changing in the region kept Pixel maintenance dose digitally generate specified level of zoom.For lesser region, image processor 412 can pass through guarantor It holds the more part in the pixel obtained in original retinal image data and realizes high zoom level to all.For larger Region, image processor 412 can be by the fewer parts that is maintained in the pixel obtained in original retinal image data To realize low level of zoom.Alternatively, it can be adjusted based on the mechanical lens of optical lens device 404 to obtain level of zoom.

For example, image processor 412 can digitally generate the height of the optic nerve region of retina in the following manner Zoom: ultrahigh resolution retinal images are obtained, extract all pixels outside the optic nerve region of retinal images, and keep regarding It is most of to whole in pixel in the optic nerve region of nethike embrane image.Alternatively, for example, image processor 412 can lead to Following manner is crossed to digitally generate the low zoom of entire retina: obtaining ultrahigh resolution retinal images and in retinal map A part in pixel is equably extracted on the entire retina of picture (for example, removing a pixel or removal every a pixel Pattern of pixels).

In one embodiment, image processor 412 is 1904 based on the analysis to retinal image data and based on use Family in following item at least one of request generate output data: specified visual field, specified resolution ratio, specified zoom water Flat, specified movement or event, specified object or feature, and/or specified health problem, output data compare retinal images Data need the less bandwidth for transmission.Image processor 412 can be configured as user's request based on one or more Output data is generated, one or more user's requests can be received via communication interface 410.One or more users request can be with Real-time or near real-time specific request to be met (for example, to the specific visual field of retina and/or asking for level of zoom Ask) or can be request in future time wait meeting (for example, when movement or event occur, when detecting feature or right As when, or with specific health problem in relation to when request to output data).Therefore, image processor 412 can be asked to user Offer response data is provided, can be either programmed to according to timetable or in the routine of one or more specified times in future Ground periodically carries out operation.In the programmed situation of image processor 412, image processor 412 can be in no user Analysis is executed in the case where further participating in, until when needing or requiring.

Figure 20 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.In one embodiment, described that output data, institute are generated based on the analysis to retinal image data 504 Stating output data to need the less bandwidth for transmission than retinal image data includes the one or more in following item: 2002 based on the analysis to retinal image data and based on to the PROGRAMMED REQUESTS of at least one the generation output in following item Data: specified visual field, specified resolution ratio, specified level of zoom, specified movement or event, specified object or spy Sign, and/or specified health problem, the output data need the less bandwidth for transmission than retinal image data, Or 2004 based on the analysis to retinal image data and based on the application requests of local trustship generation output number According to the output data needs the less bandwidth for transmission than retinal image data.

In one embodiment, image processor 412 2002 based on the analysis to retinal image data and based on pair In following item at least one of PROGRAMMED REQUESTS generate output data: specified visual field, specified resolution ratio, specified zoom water Flat, specified movement or event, specified object or feature, and/or specified health problem, the output data compare retina Image data needs the less bandwidth for transmission.Image processor 412 can via communication interface 410 from remote hosting or It runs application program and receives one or more PROGRAMMED REQUESTSs.PROGRAMMED REQUESTS can specify special parameter, which can be by scheming As processor 412 is executed for original high resolution retinal image data obtained to generate output data.Then, it exports Data can be transmitted to remote application or another position (for example, client or server apparatus) by image processor 412.

For example, image processor 412 can obtain PROGRAMMED REQUESTS from electronic third-party case history software application.Program is asked Ask may include the retinal image data to larger field and the retinal image data compared with small field of view request, wherein for Any potential lesion detected, such as in the case where the share at cup disc ratio and neural retina edge is abnormal or changes, depending on The retinal images of disk, optic cup and neural retina edge utilize higher level of zoom.Image processor 412 can be by journey Sequence request keeps in memory and is applied to the retinal image data of the particular patient of acquisition.Detecting potential disease In the case where change, image processor 412 can transmit requested retinal images via communication interface 410, to be stored in use In the electronic health record software application of particular patient.

In one embodiment, image processor 412 based on the analysis to retinal image data and is based on 2004 The application requests of local trustship generate output data, and the output data needs less be used for than retinal image data The bandwidth of transmission.Image processor 412 and computer storage 406 can be configured to managed application, such as third-party application Program executes one or more specified functions to generate specified output data.Various personal or entities can be created for special Door purpose or the application program of research, and application program is uploaded into ophthalmoscope 402 via communication interface.Image processor 412 It can be performed in parallel managed application individually or with multiple and different managed applications, to execute from imaging sensor The custom analysis and data of the 408 ultrahigh resolution retinal images obtained generate.

For example, research institution can develop a kind of application program, which is collected about the retinopathy detected Non- personal data of the type of change relative to the outer space duration.This can be applied into journey before astronaut leaves the earth Sequence uploads to ophthalmoscope 402.During using ophthalmoscope 402 in outer space, image processor 412 can be in retinal images The time of executing application and the record lesion detected and the lesion detected during the normal processes of data collection.It is defeated Data can send back the earth via communication interface 410 out, use for research institution, without any patient identification.? In the example, identical ophthalmoscope 402 can execute the one or more operation disclosed herein about specific astronaut, for Clinician carries out health monitoring.For example, image processor 412 can analyze full resolution retinal images and detect astronaut In papilledema example.Associated retinal image relevant to papilloedema can pass through communication interface 410 send acquisition, reduction and/or compression before clinician to.

Figure 21 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.It in one embodiment, include in following item via at least one communication interface transmission output data 506 One or more: 2102 via in following type entry at least one of at least one communication interface transmission output number According to: WIFI, honeycomb, satellite and/or internet transmit output data, the communication via at least one communication interface 2104 Interface includes about 1/10th bandwidth ability of the capture rate of retinal image data, or is being passed through at the first time 2106 At least one communication interface transmit output data, the output data than retinal image data need it is less for transmission Bandwidth, and in the second time transmission for corresponding at least one of interval time, batch time and/or available bandwidth time At least some of retinal image data.

In one embodiment, image processor 412 is 2102 via at least one at least one in following type entry A communication interface 410 transmits output data: WIFI, honeycomb, satellite and/or internet.Communication interface 410 can be it is wireless or Wired (for example, Ethernet, phone, coaxial cable, conductor etc.).In the case of wireless communication, communication interface 410 can wrap Include local, ZIGBEE, WIFI, bluetooth, BLE, WIMAX, honeycomb, GSM, CDMA, HSPA, LTE, AWS, XLTE, VOLTE, satellite, Infrared, microwave, the electromagnetism of broadcast radio or any other type or acoustics transmission.Ophthalmoscope 402 may include a variety of differences The communication interface 410 of type, to adapt to communication different or simultaneously.

In one embodiment, image processor 412 transmits output number via at least one communication interface 410 2104 According to the communication interface 410 includes about 1/10th bandwidth ability of the capture rate of retinal image data.Image processor 408 can obtain ultrahigh resolution image (such as 10,000,000,000 byte per second, 20,000,000,000 from imaging sensor 408 with high data rate Byte, 30,000,000,000 bytes or more).Communication interface 410 has bandwidth constraint, which can be less, obvious less Or it is less on the order of magnitude.For example, communication interface 410 can have 1 Mbytes to 10 Mbytes about per second or 1 gigabit per second The bandwidth constraint of byte or 5 to 10 gigabytes even as high as per second.Under any circumstance, image processor 412 is accessible The more image datas of image data than being transmitted in time via communication interface 410.

In one embodiment, image processor 412 is passed by least one communication interface 410 in first time 2106 Output data is sent, the output data needs the less bandwidth for transmission than retinal image data, and is corresponding to In the second time transmission retinal image data of at least one of interval time, batch time and/or available bandwidth time It is at least some.Image processor 412 can be staggered via communication interface 410 output data transmission or with single sender Formula transmits output data.For example, image processor 412 can be in the retinal images number of first time transmission low resolution According to, alphanumeric text data or binary data, to minimize the load in communication interface 410.Image processor 412 can be with Additional pixel data or additional retinal image data are transmitted via communication interface 410 in the second time.It can be based on one A or multiple parameters, such as higher than specified amount or the available bandwidth of percentage, received user's request passes through the satellite of earth station Or spacecraft channel, the urgency level of the lesion detected or another like based on patient, based on bandwidth or based on geographical Parameter, to arrange or determine the second time.

For example, ophthalmoscope 402 can be used to monitor and detect in astronaut in entire astronavigation in space environment Retinopathy.Communication interface 410 can be WIFI to the communication channel based on microwave, when spacecraft passes through the ground based on the earth When the station of face, there is 1 Mbytes to 10 Mbytes of bandwidth constraint about per second.Image processor 412 can be from image sensing Device 408 obtains retinal image data and executes image analysis to detect one or more potential lesions.When detecting, image The ultralow bandwidth text based for the lesion that processor 412 can will test describes together with astronaut's identification information via logical Letter interface 410 transmits immediately.When detecting increased signal strength, such as when being located in the earth station based on the earth, Image processor 412 can transmit retinal images associated with the lesion detected.

Figure 22 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.It in one embodiment, include in following item via at least one communication interface transmission output data 506 One or more: transmitted by least one communication interface defeated 2202 in response to detecting at least one health problem Otherwise data out do not transmit any data, logical via at least one 2204 in response to detecting at least one object or feature Believe that interface transmits output data, otherwise do not transmit any data, transmits output data via at least one communication interface 2206 To meet client request, or the output data at 2208 via the transmission of at least one communication interface as image data.

In one embodiment, image processor 412 passes through 2202 in response to detecting at least one health problem At least one communication interface 410 transmits output data, does not otherwise transmit any data, or 2204 in response to detecting at least One object or feature transmit output data via at least one communication interface 412, otherwise do not transmit any data.At image Reason device 412 can be programmed to be the lesion that detects in retinal images, feature or object by the data customization of transmission Seriousness or emergency.For example, image processor 412 can transmit retinal map based on the example of the bleeding vessel detected Picture and notice based on text or Email.Alternatively, image processor 412 can be in response to indicating no interested change Change, lesion, feature or object retinal image data analysis without transmit information, alphanumeric text instruction or binary system Instruction.Seriousness or emergency based on feature, object or the lesion detected can be used for efficiently using logical come scaled data Believe the available bandwidth of interface 410.Other than scalability information, image processor 412 can also similarly scale any transmission Periodically, to transmit urgent or urgent information more in time than non-emergent or non-urgent information.Image processor 412 can be based on The combination that one or more results of retinal images analysis are adjusted using time and data volume.

In one embodiment, image processor 412 2206 via at least one communication interface transmit output data with Meet client request.Image processor 412 can be responded asks via the received one or more clients of communication interface 410 It asks.One or more client requests may include with one or more of Types Below: visual field, level of zoom, resolution ratio, pressure Contracting, the lesion to be monitored, transmission trigger event, panning or other similar request.Image processor 412 can by shaking hands, really Recognize or in real time, near real-time, delay time, scheduling time or periodical time solicited message carry out respond request.

In one embodiment, image processor 412 at 2208 via at least one communication interface 410 by output data It is transmitted as image data.Image processor 412 can be configured as the various data modes that transmission includes image data.Image Data can be transmitted with format in a variety of manners by image processor 412, and the various forms and format include in following item Any one or more: raster, jpeg, jfif, jpeg 2000, exif, tiff, gif, bmp, png, ppm, pgm, pbm, Pnm, webp, hdr, heif, bat, bpg, vector, cgm, gerber, svg, 2d vector, 3d vector, composite format, Stereo format.

Figure 23 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.It in one embodiment, include in following item via at least one communication interface transmission output data 506 One or more: 2302 via at least one communication interface transmit as alphanumeric or the output number of binary data According to via institute in the case where one or more of pixel or overlaid pixel for being transmitted 2304 in no static pixels, previously State at least one communication interface and transmit output data as image data, wherein described image data at remote server into Row gap filling, in the 2306 output number via the transmission of at least one described communication interface as the image data in specified region According to, or in 2308 output data via the transmission of at least one described communication interface as the image data of given resolution.

In one embodiment, image processor 412 is transmitted via at least one communication interface 410 as letter 2302 The output data of number or binary data.Image processor 412 can transmit the binary system being originated from or based on retinal images Alphanumeric output data using replace transmission retinal image data or as transmission retinal image data supplement.Letter Digital text may include word, phrase, paragraph, sentence, sentence, symbol, the number of artificial intelligence generation etc..Binary data May include it is following any one: open and close, it is high and low, 0,1, be, no or binary value other similar expression.

In one embodiment, pixel or overlapping that image processor 412 is transmitted 2304 in no static pixels, previously The output number as image data is transmitted via at least one described communication interface 410 in the case where one or more of pixel According to wherein described image data carry out gap filling at remote server.Image processor 412 can transmit retinal images Data, the retinal image data are then kept or are stored in remote location, such as network site, server or client are set It is standby.The transmission that image processor 412 carries out can transmit in response to client request, PROGRAMMED REQUESTS, scheduling or can be low It is completed during bandwidth or low inactivity period.After transmitting retinal image data, image processor 412 can be from image sensing Device 408 obtains new retinal image data and executes analysis to determine previously when transferred any retinal images number According to.Image processor 412 can remove the retinal image data of any identification previously transmitted, and only retain change or not The retinal image data transmitted in advance.Then, image processor 412 can transmit changing or non-via communication interface 410 The retinal image data previously transmitted so that the retinal image data previously transmitted by gap filling, combination or insertion with Compound retinal images are established before display or printout.

For example, image processor 412 can obtain the retinal images number of John Q.Smith from imaging sensor 408 According to.Retinal image data does not include lesion indication or uncommon biomarker, deposit or discoloration.Server apparatus connects It receives the retinal image data of John Q.Smith and stores it in memory.In subsequent ophthalmoscope ession for telecommunication, figure As processor 412 obtains from imaging sensor 408 retinal image data of John Q.Smith.In the ession for telecommunication, image One or more examples of the identification bleeding of processor 408.Instead of transmitting all retinal image datas, image processor 412 is taken out All unchanged pixels of the retinal images except the region around bleeding are removed.Then, image processor 412 transmits Corresponding to the retinal image data of bleeding, and the retinal image data that server gap filling had previously transmitted, to rebuild The compound retinal image data of John Q.Smith.

In one embodiment, image processor 412 transmits conduct via at least one described communication interface 410 2306 The output data of the image data in specified region.Image processor 412 can determine specified according to client request, PROGRAMMED REQUESTS Region, or can be determined in response to the lesion that detects.It can be via communication interface 410 for the client request in region It receives, and including coordinate, vector value, raster image drawing, text, binary system or other data.PROGRAMMED REQUESTS can be by can With reside in one or more programs on ophthalmoscope 402 or on remote computer, server, cloud or client device manually or It automatically provides.Coordinate, vector value, raster image drawing, text, binary system or other numbers can be similarly included in PROGRAMMED REQUESTS According to.It can carry out trigger in response to value, lesion, instruction or the measurement detected to request.

For example, image processor 412 can obtain retinal image data and execute image analysis to detect choroid wrinkle The example of pleat.Application requests can be automatically generated to obtain measurement result, generate the text description of choroid gauffer, and protected The horizontal retinal image data of high zoom related with choroid gauffer is held, to be used for client via the transmission of communication interface 410 End equipment output.

In one embodiment, image processor 412 transmits conduct via at least one described communication interface 410 2308 The output data of the image data of given resolution.Image processor 412 can according to be attached to client request metadata, The identification of client device associated with client request, previously specified resolution ratio, average mark resolution or default are differentiated Rate determines specified resolution ratio.Specified resolution ratio can be uniformly or non-uniformly applied to view by image processor 412 Film image data.

For example, client device can request the retinal image data of 1600 × 1200 pixels.Image processor 412 can It is kept with the pixel anisotropically by specified resolution applications in retinal image data, so that in optic nerve head, retina Region around heart district, macula lutea and veinlet and parteriole is reduced to 1600 × 1200 pixels.However, image processor 412 Other regions of retinal image data further can be decreased below 1600 × 1200, such as be reduced to 300 × 200 pictures Element.Non-uniform resolution retinal image data can be transmitted to client device in first time by image processor 412, so It is followed afterwards in the second time (for example, immediately after first time) later with complete 1600 × 1200 retinal images.

Figure 24 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.It in one embodiment, include in following item via at least one communication interface transmission output data 506 One or more: 2402 via at least one communication interface transmission as specify level of zoom image data output Data, in 2404 output data via the transmission of at least one communication interface as the image data for specifying object or feature, or Person is in 2406 output data via the transmission of at least one communication interface as the image data for including metadata.

In one embodiment, image processor 412 is used as via the transmission of at least one communication interface 410 2402 and specifies The output data of the image data of level of zoom.Image processor 412 can be from client request, PROGRAMMED REQUESTS or in response to inspection The specified level of zoom of the gain of parameter measured.For example, specified level of zoom can be percentage or level (for example, 10% Or 90% zoom, low-level or high-level zoom).Specified level of zoom may include specifying region and for the given zone The specified visual acuity in domain.It specified region can be by default zone, selection area, frame, focus center, anatomical structure or lesion Region definition.Image processor 412 can also generate the level of zoom specified expected from client or PROGRAMMED REQUESTS, and in client At least some expected level of zoom data are transmitted before end or PROGRAMMED REQUESTS to reduce following waiting time.

For example, image processor 412 can be requested with customer in response end and provide the basic of the low zoom corresponding to retina The retinal image data of upper entire visual field.Image processor 412 can also pass through analyzing and detecting retinal image data In patch or discoloration example.Image processor 412 any user of the request for zoom can will occur in expection Start the horizontal retinal image data of high zoom that transmission corresponds to patch or discoloration before request.And if when receiving pair When user's request of high zoom retinal image data corresponding with patch or discoloration, image processor 412 may Some or all of communicated retinal image data.

In one embodiment, image processor 412 is used as via the transmission of at least one communication interface 410 2404 and specifies The output data of the image data of object or feature.Image processor 412 can receive from user request, PROGRAMMED REQUESTS or The specified object of lesion or variation based on the retinal image data detected or the instruction of feature.Specified object or feature It can be anatomical features, biomarker or corresponding to the lesion detected, the region being altered or varied.Image processor 412 Retinal image data associated with specified object or feature only can be selected and be transmitted, or additional view can be transmitted Film image data.For example, other than the retinal image data for other the one or more situations for corresponding to object or feature, Image processor 412 can also transmit the retinal image data corresponding to object or feature.

For example, image processor 412 can receive for retinal image data corresponding with specific hyperemia parteriole User's request.Image processor 412 can choose and transmit retinal image data corresponding with specific hyperemia parteriole, and It can choose and transmit the non-requested part of retinal image data.The non-requested part of retinal image data can be by image Processor 412 is determined to be relevant to requested part, such as corresponding to the veinlet of all hyperemia or the retina of parteriole Image data.Then, client device can receive the selected retinal image data transmitted and with selected retinal images The relevant non-selected retinal image data of data is for display.

In one embodiment, image processor 412, which is used as 2406 via the transmission of at least one communication interface 410, includes The output data of the image data of metadata.It is generated by image processor 412, selection or the metadata identified can depend on one A or Multiple factors comprising customer Canonical, program specification, particular patient detect related to retinal image data The lesion of connection, label, feature or object.Metadata may include text, number, symbol, link, image or description retinal map As data or other similar data relevant to retinal image data.Metadata can also include about the time information, save Image data slightly, the position of the image data previously transmitted, size of data, bandwidth requirement, frame rate, resolution ratio, files classes Type etc..

Figure 25 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.In one embodiment, method 500 further includes the operation for the communication for receiving request 2502.

Figure 26-28 is realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing Method 500 block diagram.In one embodiment, it is described at 2502 receive request communication include following item in one or It is multinomial: to specify the communication of the request of region or visual field at least one in 2602 receptions, receive 2604 at least one The communication of the request of specified resolution ratio, 2606 receive at least one specified level of zoom request communication, 2608 receive the communication of the request at least one specified object or feature, are related to the logical of the request of zoom in 2702 receptions Letter, receives 2704 and is related to the communication of the request of panning, receives the request at least one required movement or event 2706 Communication, 2708 receive PROGRAMMED REQUESTSs communication, or 2802 via at least one described communication interface receive client The communication of request.

Image processor 412 can receive the communication of client request 2802 via at least one communication interface 410.It can Directly or indirectly to receive client request from client device via communication network.Client device may include intelligent hand Table, smart phone, mobile phone, tablet device, laptop devices, computer, server, augmented reality earphone, virtual reality Any one or more of earphone, game console or combination above-mentioned.Communication network may include direct wire link, straight Connect Radio Link, indirect wire link, indirect wireless link, internet, local network, wide area network, virtual network, Cellular Networks Network, satellite network or combination above-mentioned.

In the context of client device, image processor 412 can be received from client device at least 2602 The request of one specified region or visual field receives the request at least one given resolution 2604, receives 2606 to extremely The request of a few specified level of zoom is specified the request of object or feature at least one in 2608 receptions, is received 2702 The request of zoom receives the request at least one required movement or event in the request that 2704 receive panning, or 2706.Please Asking can be transmitted and can be according to voice input, figure selecting, physics control in the form of audio, binary system or alphanumeric text System is mobile, equipment is mobile or inclination, finger gesture, sensor input or other sources generate.

For example, client device provides use associated with one or more ophthalmoscopes 402 in a specific embodiment Family interface.Specific ophthalmoscope can be selected from one or more ophthalmoscopes 402 to be regarded from the specific ophthalmoscope 402 Nethike embrane image data.For being analyzing particular individual, from real-time or near real-time is obtained from ophthalmoscope 402 and show view Film image data.Output retinal image data is to be used to show, and retinal image data can be by graphical user circle The combination of movement of surface element, input field, gesture and/or client device interacts.Graphical user-interface element can wrap Button or slider bar are included, so as to control zoom, panning, resolution ratio or other parameters.It is defeated that input field can enable text Enter, for example, level of zoom or special object numerical value to be anchored visual field.Gesture can be combined and equipment is mobile to realize function, it is all The mobile carry out panning for such as passing through client device carries out zoom by pinching opposite finger on the touchscreen, and/or logical Sliding finger is crossed to switch between the retina of particular individual.It can receive voice input to indicate particular individual about specific dynamic Make, so as to communicate and notifies with particular individual the individual movement, panning, change eyes, remain stationary or other instruct.Client Equipment can also be provided about the availability of retinal image data or about potential inspection associated with retinal image data The lesion measured, the notice and/or alarm that are altered or varied.

The communication that image processor 412 can receive PROGRAMMED REQUESTS 2708.The program can be run on ophthalmoscope 402 And/or it is run in client device, computer, server or cloud environment.Program remote client devices, computer, In the embodiment run in server or cloud environment, PROGRAMMED REQUESTS can directly or indirectly be received by communication network.It is logical Communication network may include direct wire link, direct Radio Link, indirect wire link, indirect wireless link, internet, local Network, wide area network, virtual network, cellular network, satellite network or combination above-mentioned.The program, which can be, to be exclusively used in obtaining, deposit It stores up, analysis, the dedicated program for forwarding or otherwise handling one or more individual retinal image datas.Alternatively, Program can be a part of another general or specialized application program or system, such as electronic medical record system, health and physiology A part of monitoring program, family health care system etc..

For example, ophthalmoscope 402 can be with the multiple third party applications of trustship, each third party application is for from image The retinal image data that sensor 408 obtains executes different analysis and operation.Potential third party application can wrap Include research application program, business applications, medicinal application program, consumer or hobby application program or other scientific application journeys Sequence.Each of these application programs can obtain some or all of retinal image data, and independently hold to it The different operation of row.For example, the retinal images of specific visual field can be requested, store, transmit and/or be analyzed to an application program Data are (for example, the optic disk area for the researcher being only used in the field of the variation of the diet induced of the optic disk for age control Domain).Only retinal images related with certain features can be requested, store, transmit and/or be analyzed to another application-specific Data (for example, participate in be related to specific Alzheimer disease drugs research individual control group and non-control group patch (when In the presence of) retinal images).Another application program can be medium for all individual requests, storage, transmission and/or analysis The retinal image data of resolution ratio, without anyone identification information (for example, medical college may want to the ophthalmology on classroom Realtime graphic is presented during lecture).Therefore, it can be developed on ophthalmoscope 402 and the specific third party of the various customizations of trustship answers With program, a variety of different entities are used for execute specific function and generate based on identical retinal image data different Output.

Figure 29 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.In one embodiment, method 500 further includes the operation in 2902 irradiation retinas.Optical lens device 404 may include irradiation source, such as incandescent lamp, Organic Light Emitting Diode, light emitting diode, laser or another light source or light source Combination.

Figure 30 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.In one embodiment, include one or more in following item in 2902 irradiation retinas: making 3002 Retina is irradiated with light source and at least one covering for keeping irradiation/reflection in the dispersing elements of eyes cross-minimized, 3004 irradiate retina using infrared light supply and optical lens device, are irradiated 3006 using visible light source and optical lens device Retina, or at least one covering is moved 3008 to change the region of retinal illumination.

In one embodiment, optical lens device 404 uses the photograph in light source and the dispersing element for making eyes 3002 Penetrate/reflect cross-minimized at least one covering irradiation retina.Optical lens device includes being directed on retina And the light source of catoptric imaging.By using the one or more coverings for stopping at least some of irradiation light, at the angle of eyes Make the cross-minimized of irradiation light and reflected light in film and lens structure.Covering can be made of any photoresist, And it can partly or completely fully blocking light.

In one embodiment, optical lens device 404 irradiates retina using infrared light supply 3004.Infrared light supply can Including infrared light-emitting diode, infrared Organic Light Emitting Diode, laser or another infrared light supply.Infrared light passes through optical lens Device is directed on retina and is reflected for infrared imaging.Infrared light will not trigger identical iris contraction reaction, because This can position or relocate for eyes before visible imaging, focus or other will avoid or limit the behaviour of iris contraction Make.Infrared light supply may include one or more coverings, at least partly cover infrared light, to minimize irradiation infrared light With intersection of the reflection infrared light in the dispersing element (for example, cornea and crystalline lens) of eyes.

In one embodiment, optical lens device 404 irradiates retina using visible light source 3006.Visible light source can Including light emitting diode, Organic Light Emitting Diode, incandescent lamp, laser or other visible light sources.In certain embodiments, it is seen that Light source is limited to specific wavelength (such as white or red).Visible light source is guided via optical lens device 404 as irradiation light Onto retina, it is reflected for retina image-forming herein.One or more coverings can at least partly blocking It is light-exposed, to limit the intersection of irradiation light and reflected light in the dispersing element (such as cornea and crystalline lens) of eyes.Minimum can With the interaction in the dispersing element of eyes between irradiation light and reflected light be less than certain percentage, be, for example, less than 1% or Less than 5% or less than 10% or less than 25%.In certain embodiments, focusing and/or eye are being executed using infrared light supply After eyeball positioning, emit visible light source to be used for retina image-forming.

In one embodiment, optical lens device 404 is in 3008 at least one mobile covering to change retina photograph The region penetrated.The irradiation on certain parts of retina can be limited using at least one covering.In certain embodiments, until A few covering moved during retina image-forming (for example, it is gentle or span through the capture of video retinal images or Different predetermined positions to still image capture).Then, for example, over time or from different image captures Retinal images can be used for creating by keeping the part with high acuity and these reservation parts being stitched together Complete compound retinal images.

Figure 31 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.In one embodiment, method 500 further includes executing the operation of analysis in 3102 pairs of retinal image datas. Image processor 412 can execute retinal images number during executing illustrated herein or disclosed one or more operations According to analysis.Analysis may include image recognition, image compare, feature extraction, Object identifying, image segmentation, motion detection, figure As one in pretreatment, image enhancement, image classification, contrast stretching, noise filtering, histogram modification or other similar operation Person or more persons.

Figure 32 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.In one embodiment, 3102 pairs of retinal image datas execute analysis include one in following item or Person is multinomial: obtain benchmark retinal image data from computer-readable memory 3202, by retinal image data with it is described Benchmark retinal image data is compared, and identifies the expression between retinal image data and benchmark retinal image data At least one deviation of at least one health problem, or object or feature identification are executed using retinal image data 3204 Analysis is to identify at least one health problem.

In one embodiment, image processor 412 obtains benchmark retina from computer-readable memory 406 3202 Retinal image data is compared with the benchmark retinal image data, and identifies retinal images number by image data According at least one deviation for indicating at least one health problem between benchmark retinal image data.Image processor 412 It can be that particular individual obtains retinal image data, and the retinal image data is stored in computer and is deposited in first time Benchmark retinal image data is used as in reservoir 406.The second time after the first time, image processor 412 can obtain New retinal image data and by the retinal image data and first time for being stored in computer storage 406 Benchmark retinal image data is compared.Image processor 412 can be identified in retinal image data and benchmark retina Variation or deviation between image data, can indicate health problem.Health problem illustrates and discusses herein, and It may include such as diabetic retinopathy, macular degeneration, cardiovascular disease, glaucoma, malaria retinopathy, alzheimer ' One of silent disease, sphere flattening, papilledema and/or choroid fold are a variety of.It is detecting or is not detecting When to health problem, image processor 412 can execute illustrated herein and/or disclosed one or more operations.Certain In embodiment, benchmark retinal image data be can be for Different Individual or associated with normal retina.

In one embodiment, image processor 412 executes object using retinal image data 3204 or feature is known It does not analyze, to identify at least one health problem.Image processor 412 can compare point being with or without corresponding image benchmark Object or feature discriminance analysis are executed in the case where analysis.Object or feature identification may include identifying any retinal image data Interior anatomical structure, biomarker, discoloration, measurement, shape, profile, line etc..Object or feature can be with various potential health Problem is associated, and is used by image processor 412 to identify potential health problem or possible potential health problem Array.Equally, potential health problem has disclosed and illustrates herein, but may include diabetic retinopathy, Macular degeneration, cardiovascular disease, glaucoma, malaria retinopathy, Alzheimer disease, sphere flattening, optic papilla water Swollen and/or choroid fold.When detecting potential health problem, image processor 412 can be executed as discussed herein And/or one or more operations of explanation.

Figure 33 is the side realized according to the retina image-forming device equipment 400 that the use of multiple embodiments has edge processing The block diagram of method 500.In one embodiment, method 500 further includes following operation: being connect 3302 via at least one communication interface Rating nethike embrane image analysis application program, and realize that the retinal images about retinal image data analyze application 3304 Program.The image processor 412 402 of ophthalmoscope 402 is not necessarily static in its configuration.On the contrary, image processor 412 It can be programmed to execute at any time and receiving software application and deployment software application program via communication interface 410 Between passage and change specific use operation with ad hoc analysis and output retinal image data.Image processor 412 configures Customization make it possible to the modification retinal image data of passage at any time is collected, covering is mobile, exposure intensity or it is lasting when Between or wavelength, pixel decimation, pixel selection, object remove, the transmission of non-selected retinal images, expected object or region pass It send, gap filling, image analysis, data generate, data output, output data destination or timing, bandwidth use, feature or right As detection, event triggering, compare or the amount of health problem detection algorithm, health problem focus, interested retinal area etc. With timing any one of.Therefore, company, individual, research institution, Scientific Organizations, consumer group, educational institution etc. Entity can based on its it is respective need to develop special application program and by vertical application upload to ophthalmoscope 402 with It concurrently or sequentially is realized by image processor 412.As demand changes over time, application program can update, deletes, stop Only, start or otherwise control.

For example, the drugmaker interesting to the cardiovascular disease in the population of individuals for understanding 40-50 years old can develop receipts Collect the retina marker type of the cardiovascular disease detected about patient age and expression summarizes alphanumeric text number According to application program.The application program can upload to ophthalmoscope 402 or eye used in cardiology clinic and hospital ward 402 array of bottom mirror.During using ophthalmoscope 402, image processor 412 can be in the normal mistake of retinal image data collection Executing application and requested data are recorded during journey.Output data can send back computer destination, for pharmacy Company is for studying or being commercialized decision.In this example, identical ophthalmoscope 402 can execute disclosed herein about specific One or more operations of patient, with for real-time or near real-time the health analysis of clinician or monitoring, and can be with One or more other third party applications are executed using different data output for one or more different entities.

It is another as unobtrusively monitoring for the retinal area for medical diagnosis function in a specific embodiment Example, retina image-forming device 402 can be used cooperatively with fluorescence to identify specific instruction.For example, the protein of fluorescent marker or glimmering Photochemistry substance can introduce eyeball by sclera and vitreous humor (for example, passing through eye drops or syringe needle).Alternatively, fluorescence mark The protein or fluorescent chemical of note can introduce retina (for example, capsule, pill, consumables or IV are infused by blood flow It penetrates).Fluorescent chemical or protein adherence can pass through imaging sensor 408 in certain lesion indications of retina Via irradiation and imaging capture.Image processor 412 determines and detects the protein of fluorescent marker or depositing for fluorescent chemical And can be generated based on this it is described herein and explanation output data.As a specific example, curcumin has been displayed It is adhered to amyloid plaques and fluoresces in response to optical stimulation appropriate.Therefore, the view together with curcumin fluorescence The optical stimulation of film or other near surface blood flows can be the instruction of potential Alzheimer's disease.Detecting that curcumin is glimmering In the case where light, output data, such as retinal area relevant to the curcumin detected is can be generated in image processor 412 High eyesight retinal images, or such as potential Alzheimer disease binary instruction.

In other embodiments, retina image-forming device or ophthalmoscope 402 can be used for through non-retinal eye or face Monitoring is to execute non-intervention medical diagnosis functional.For example, imager 402 can be located, be attached, be incorporated to or be integrated into vehicle , such as automobile, Truck, Airplane, Boat, train, heavy-duty machinery etc., wherein visual field is directed to driver, passenger or vehicle multiplies Member.Then, imager 402 can monitor and/or detect eye motion, pupil size, expansion, blink, eyelid position or movement, Facial expression, facial characteristics, pigmenting of skin or other eyes, head, neck or facial parameters.The information (optionally with other The combination of driver's detecting sensor) can be used for executing diagnostic function, such as determine driver's consciousness, alertness, drowsiness, disease, Drug use, alcohol use, energy or health.It is based on any diagnostic function as a result, imager 402 can notify stimulation routine Activation, such as pass through numbers game, display, the stimulator of body worn, audio frequency apparatus, irradiation source etc..Imager 402 can It to other equipment or is set with monitoring and/or detecting the response to stimulation and be adjusted to stimulation or started based on the adjustment Standby control.For example, imager 402 can monitor expansion or the pupil size of driver's eyes.In response to determining expansion response Be slowly, it is fluctuation, unstable, abnormal or higher or lower than specified threshold level, imager 402 can supervise LED is repeated or periodically signaled to while surveying expansion response.Imager 402 can be before and after, during stimulation The expansion of driver's eyes or the measured value of pupil size are obtained, and according to the information and optionally according to other sensors Input and determine whether driver suffers from or undergo fatigue, driver may have another health problem or driver be it is drunk or By drug influence.Based on the determination of fatigue, imager 402 can signal to music player, scroll down through window, adjusting seat Chair position, slows down car speed, and setting vehicle is notified the 3rd side, recorded number using limitation (for example, closing after 30 miles) According to initiating phone or other similar action to mitigate or relieving fatigue.

In a specific embodiment, imager 402 is configured as in retinal images, face-image or body bitmap Euler's video amplifier is executed under the background of picture.Imager 402 captures the one or more images or video of individual, and amplifies one Color change in multiple images or video or it is on the move one or more.For example, retina can be generated in imager 402 Or the video of face, wherein pulse, pulse intensity or pulse duration can be detected and/or be surveyed by the amplification of color change Amount.As another example, the video of individual neck or arm can be generated in imager 402, wherein pulse, pulse intensity or pulse Duration can be detected and/or be measured by the amplification that skin disturbs.Imaging sensor 402 can be used through Euler's video Amplify pulse, pulse frequency, pulse intensity or the other information of acquisition to identify pressure, anxiety, fatigue, attention, disease, disease The situation of disease, disease condition or other health problems.Imager 402 can be based on any identification or the parameter or health problem that detect It signals to one or more equipment or controls one or more equipment, including signal alarm, signal attached Add parameter measurement, capture image, generate image, transmit image, control pill dispenser, control means of climate control, controls vehicle Etc..In a particular example, imager 402 obtains the retinal image data as video data from imaging sensor 408. Image processor 412 executes Euler's video amplifier of retinal images obtained, intraretinal with reinforcement, expansion or amplification Blood flow.Then, image processor 412 executes image analysis to retinal image data, to determine pulse frequency, intensity and come from Any variation of the blood flow of one or more prior images.Image processor 412 can be based on higher or lower than specified threshold Variation that pulse frequency or intensity or passage at any time detect in blood flow generates output data, which can be with Including any data that are described herein or showing.Such output data may include, for example, notifying to clinician abnormal Retinal images around pulse frequency or intensity or potential bleeding part.

The disclosure can have additional embodiment, can describe in the embodiment for not being directed to any specific description One or more details in the case where practice, or any other details that can use for another embodiment description is real Trample any details for the description of a specific embodiment.Although in addition, having illustrated and described as described above certain Embodiment, but many changes can be carried out without departing from the spirit and scope of the disclosure.

The various aspects of theme described herein illustrate in the clause of following number:

1. a kind of ophthalmoscope that the machine vision for view film analysis enables, the ophthalmoscope include:

Optical lens device；

Imaging sensor, positions with the optical lens device and the light for being configured as will test is converted to retinal images Data；

Computer-readable memory；

At least one communication interface；With

Image processor, can be otherwise communicatively linked to described image sensor, the computer-readable memory and it is described at least One communication interface, described image processor are programmed to execute operation, and the operation includes at least:

The retinal image data is obtained from described image sensor；

Output data is generated based on the analysis to the retinal image data, the output data is than the retinal images number According to the less bandwidth for transmission of needs；And

The output data is transmitted via at least one described communication interface.

2. the ophthalmoscope as described in clause 1, wherein the optical lens device, described image sensor, described computer-readable Memory, at least one described communication interface and described image processor are incorporated in virtual reality headset.

3. the ophthalmoscope as described in clause 1, wherein the optical lens device, described image sensor, described computer-readable Memory, at least one described communication interface and described image processor are incorporated in the eyeshade with headband.

4. the ophthalmoscope as described in clause 1, wherein the optical lens device, described image sensor, described computer-readable Memory, at least one described communication interface and described image processor are incorporated in desk or wall-mounted equipment.

5. the ophthalmoscope as described in clause 1, wherein the optical lens device, described image sensor, described computer-readable Memory, at least one described communication interface and described image processor, which are distributed in, to be coupled at least one of following equipment Between eyeshade: smart phone, tablet computer, laptop and/or workstation computer.

6. the ophthalmoscope as described in clause 1, wherein the optical lens device includes:

The optical lens device that can be moved along at least one of x-axis, y-axis or z-axis.

7. the ophthalmoscope as described in clause 1, wherein the optical lens device includes:

The optical lens device that can be rotated and/or can pivot.

8. the ophthalmoscope as described in clause 1, wherein the optical lens device includes:

Along the image optics lens devices of first axle alignment；

Illumination lens device is aligned along the second axis perpendicular to the first axle；And

At least one polarizing beam splitter/combiner.

9. the ophthalmoscope as described in clause 8, further include:

Irradiation LED is configured as transmitting light；With

One or more coverings are configured as before the light of the irradiation LED passes through the illumination lens device At least some of described light is blocked, the irradiation in dispersing element to minimize eyes/reflection intersects,

Wherein, at least one described polarizing beam splitter/combiner is configured as passing through along described in second axis alignment The light-redirecting of illumination lens device is to the image optics lens devices being aligned along the first axle, to irradiate State at least part of retina.

10. the ophthalmoscope as described in clause 9, further include:

Infrared LED is configured as transmitting infrared light；With

One or more infrared coverings, the infrared light for being configured as the infrared LED are passing through the illumination lens At least some of described infrared light is blocked before device, the irradiation in dispersing element to minimize eyes/reflection intersects,

Wherein, at least one described polarizing beam splitter/combiner is configured as passing through along described in second axis alignment The light-redirecting of illumination lens device is to the image optics lens devices being aligned along the first axle, to irradiate State at least part of retina.

11. the ophthalmoscope as described in clause 10, wherein one or more of coverings and one or more of infrared maskings Part is mobile.

12. the ophthalmoscope as described in clause 1, further include:

Irradiation source emits light；With

At least one covering is configured as blocking at least some of described light of the irradiation source, to minimize eyes Dispersing element in irradiation/reflection intersect.

13. the ophthalmoscope as described in clause 10, wherein the covering is mobile.

14. the ophthalmoscope as described in clause 1, further include:

Light source is configured as transmitting infrared light to carry out positioning and/or focus and determine.

15. the ophthalmoscope as described in clause 1, further include:

Radiation source is configured to transmitting visible light for being imaged.

16. the ophthalmoscope as described in clause 1, wherein position with the optical lens device and be configured as will test The described image sensor that light is converted to retinal image data includes:

Imaging sensor is positioned with the optical lens device, and is configured as will test at least 20 microns of resolution ratio To light be converted to retinal image data.

17. the ophthalmoscope as described in clause 1, wherein position with the optical lens device and be configured as will test The described image sensor that light is converted to retinal image data includes:

Imaging sensor is positioned with optical lens device, and the light for being configured as will test is converted into the ring with about 40 degree The associated retinal image data of shape visual field.

18. the ophthalmoscope as described in clause 1, wherein position with the optical lens device and be configured as will test The described image sensor that light is converted to retinal image data includes:

Imaging sensor is positioned with the optical lens device, and is configured as adjacent, overlapping by capture retina And/or multiple high-definition pictures in least partially overlapped region are converted to retinal image data come the light that will test.

19. the ophthalmoscope as described in clause 1, wherein described image sensor includes the image sensing of at least about 18,000,000 pixels Device.

20. the ophthalmoscope as described in clause 1, wherein described image sensor includes the image sensing of at least about 20,000,000 pixels Device.

21. the ophthalmoscope as described in clause 1, wherein imaging sensor includes every square degree square grade at least 10000 pixels.

22. the ophthalmoscope as described in clause 1, wherein position with the optical lens device and be configured as will test The described image sensor that light is converted to retinal image data includes:

Imaging sensor is positioned with the optical lens device, and the light for being configured as will test is converted to retina view Frequency evidence.

23. the ophthalmoscope as described in clause 1, wherein position with the optical lens device and be configured as will test The described image sensor that light is converted to retinal image data includes:

Imaging sensor is positioned with the optical lens device, and to be converted to retina quiet for the light for being configured as will test State image data.

24. the ophthalmoscope as described in clause 1, wherein position with the optical lens device and be configured as will test The described image sensor that light is converted to retinal image data includes:

Imaging sensor, with the optical lens device position, and the light for being configured as will test be converted to it is per second at least The retina video data of 20 frames.

25. the ophthalmoscope as described in clause 1, wherein position with the optical lens device and be configured as will test The described image sensor that light is converted to retinal image data includes:

Imaging sensor is positioned with the optical lens device, and the light for being configured as will test is converted to needs at least Retinal image data of the 10Gbps bandwidth for transmission.

26. the ophthalmoscope as described in clause 1, wherein position with the optical lens device and be configured as will test The described image sensor that light is converted to retinal image data includes:

Imaging sensor is positioned with the optical lens device, and the light for being configured as will test is converted to needs at least Retinal image data of the 20Gbps bandwidth for transmission.

27. the ophthalmoscope as described in clause 1, further include:

Infrared image sensor.

28. the ophthalmoscope as described in clause 1, further include:

At least one additional optical lens device；With

At least one additional imaging sensor is positioned at least one additional optical lens device, and be configured to by The light detected is converted into additional retinal image data.

29. the ophthalmoscope as described in clause 28, wherein the optical lens device and at least one described additional optical lens Device has least partially overlapped visual field.

30. the ophthalmoscope as described in clause 28, wherein the optical lens device and at least one described additional optical lens Device has substantially parallel visual field.

31. the ophthalmoscope as described in clause 28, further include:

At least one additional image processor, it is associated with each of at least one additional imaging sensor；With

At least one hub processor is related to described image processor and at least one described additional image processor Connection,

Wherein, described image processor, at least one described additional image processor and at least one described hub processor It is configured as the processing of distribution retinal image data and additional retinal image data.

32. the ophthalmoscope as described in clause 1, wherein at least one described communication interface includes at least one of Types Below: WIFI, honeycomb, satellite and/or internet.

33. the ophthalmoscope as described in clause 1, wherein at least one described communication interface includes catching for the retinal image data Obtain about 1/10th bandwidth ability of rate.

34. the ophthalmoscope as described in clause 1, wherein at least one described communication interface includes that can communicate with browser client Websocket.

35. the ophthalmoscope as described in clause 1, wherein obtaining retinal image data from imaging sensor and including:

The multiple sequences for obtaining different, the adjacent and/or least partially overlapped part as retina from imaging sensor are caught The retinal image data of the image obtained；With

By the image mosaic of the part for the retina that multiple sequences capture together to generate overview.

36. the ophthalmoscope as described in clause 1, wherein obtaining retinal image data from imaging sensor and including:

The retinal image data as multiple least partially overlapped images is obtained from imaging sensor；With

Multiple images are combined into High-resolution Retinal data.

37. the ophthalmoscope as described in clause 1, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Output data is generated based on the analysis to the retinal image data, it is described compared with the retinal image data Output data needs about 1/10th bandwidth to be used to transmit.

38. the ophthalmoscope as described in clause 1, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Output data is generated based on the analysis to the retinal image data, the pact with the transmission for retinal image data The bandwidth of 20Gbps is compared, and the output data needs the bandwidth of about 1Mbps for transmitting.

39. the ophthalmoscope as described in clause 1, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Output data is generated, which includes the reduction resolution version for transmission of retinal image data.

40. the ophthalmoscope as described in clause 1, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Output data is generated, which includes at least one of following kind of change of the retinal image data With for transmitting: size, pixel selection, pixel diminutions, resolution ratio reduction, pixel extraction, pixel decimation, stationary body removal, Unchanged pixel removal, splicing, compression, color, overlapping is reduced, static reduction and/or background reduce.

41. the ophthalmoscope as described in clause 1, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Being generated based on the analysis to retinal image data includes the opposite with the health problem detected of retinal image data The output data for the part answered.

42. the ophthalmoscope as described in clause 1, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Based on to retinal image data analysis generate output data, the output data include retinal image data with inspection The corresponding a part of object or feature measured.

43. the ophthalmoscope as described in clause 1, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Based on the object or feature identification generation output data in retinal image data, the output data is than retinal images number According to the less bandwidth for transmission of needs.

44. the ophthalmoscope as described in clause 1, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Based on the event or action recognition generation output data in retinal image data, the output data is than retinal images number According to the less bandwidth for transmission of needs.

45. the ophthalmoscope as described in clause 1, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

The output number of the identification including at least one of following health problem is generated based on the analysis to retinal image data According to: diabetic retinopathy, macular degeneration, cardiovascular disease, glaucoma, malaria retinopathy, Alzheimer disease, sphere Flattening, papilloedema and/or choroid fold.

46. the ophthalmoscope as described in clause 1, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

The output data including metadata is generated based on the analysis to retinal image data, which compares retinal images Data need the less bandwidth for transmission.

47. the ophthalmoscope as described in clause 1, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

The output data of the contextual information including addition, the output data ratio are generated based on the analysis to retinal image data Retinal image data needs the less bandwidth for transmission.

48. the ophthalmoscope as described in clause 1, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Alphanumeric text output data, the alphanumeric text output data are generated based on the analysis to retinal image data The less bandwidth for transmission is needed than retinal image data.

49. the ophthalmoscope as described in clause 1, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Binary system output data is generated based on the analysis to retinal image data, which compares retinal images Data need the less bandwidth for transmission.

50. the ophthalmoscope as described in clause 1, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

By pixel decimation generate output data, with independently of retinal image data selection area and/or level of zoom protect Hold constant resolution ratio.

51. the ophthalmoscope as described in clause 1, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Output data is generated by pixel decimation to be kept separate from the selection area and/or level of zoom of retinal image data Resolution ratio, the resolution ratio be less than or equal to client device resolution ratio.

52. the ophthalmoscope as described in clause 1, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Output data is generated based on the analysis to retinal image data；With

The output data is compressed, which needs the less bandwidth for transmission than retinal image data.

53. the ophthalmoscope as described in clause 1, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

The output data of specified visual field is generated in retinal image data, which needs more than retinal image data Few bandwidth for transmission.

54. the ophthalmoscope as described in clause 1, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

The output data of specified level of zoom is generated in retinal image data, which needs than retinal image data Want the less bandwidth for transmission.

55. the ophthalmoscope as described in clause 1, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Number is exported based on the analysis to retinal image data and based on requesting to generate to the user of at least one in following item According to: specified visual field, specified resolution ratio, specified level of zoom, specified movement or event, specified object or feature, And/or specified health problem, the output data need the bandwidth for transmission more less than retinal image data.

56. the ophthalmoscope as described in clause 1, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Number is exported based on the analysis to retinal image data and based on generating to the PROGRAMMED REQUESTS of at least one in following item According to: specified visual field, specified resolution ratio, specified level of zoom, specified movement or event, specified object or feature, And/or specified health problem, the output data need the less bandwidth for transmission than retinal image data.

57. the ophthalmoscope as described in clause 1, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Based on the analysis to retinal image data and output data is generated based on the application requests of local trustship, this is defeated Data need the less bandwidth for transmission than retinal image data out.

58. the ophthalmoscope as described in clause 1, wherein described image processor is also programmed to execute operation, which is at least wrapped It includes:

Execute the analysis to the retinal image data.

59. the ophthalmoscope as described in clause 58, wherein the execution includes: to the analysis of the retinal image data

Benchmark retinal image data is obtained from computer-readable memory；And

Retinal image data is compared with benchmark retinal image data；And

Identify indicate at least one health problem at least one between retinal image data and benchmark retinal image data A deviation.

60. the ophthalmoscope as described in clause 58, wherein the execution includes: to the analysis of the retinal image data

Object or feature discriminance analysis are executed using retinal image data to identify at least one health problem.

61. the ophthalmoscope as described in clause 1, wherein described to transmit the output data via at least one described communication interface Include:

The output data is transmitted via at least one described communication interface to meet client request.

62. the ophthalmoscope as described in clause 1, wherein described to transmit the output data via at least one described communication interface Include:

The output data as image data is transmitted via at least one described communication interface.

63. the ophthalmoscope as described in clause 1, wherein described to transmit the output data via at least one described communication interface Include:

The output data as alphanumeric data is transmitted via at least one described communication interface.

64. the ophthalmoscope as described in clause 1, wherein described to transmit the output data via at least one described communication interface Include:

The output data as binary data is transmitted via at least one described communication interface.

65. the ophthalmoscope as described in clause 1, wherein described to transmit the output data via at least one described communication interface Include:

In no static pixels, previously in the case where one or more of pixel or overlaid pixel for transmitting, via it is described extremely A few communication interface transmits the output data, and wherein described image data fill gap at remote server.

66. the ophthalmoscope as described in clause 1, wherein described to transmit the output data via at least one described communication interface Include:

The output data via the transmission of at least one described communication interface as the image data in specified region.

67. the ophthalmoscope as described in clause 1, wherein described to transmit the output data via at least one described communication interface Include:

The output data via the transmission of at least one described communication interface as the image data of given resolution.

68. the ophthalmoscope as described in clause 1, wherein described to transmit the output data via at least one described communication interface Include:

The output data via the transmission of at least one described communication interface as the image data of specified level of zoom.

69. the ophthalmoscope as described in clause 1, wherein described to transmit the output data via at least one described communication interface Include:

Via the transmission of at least one described communication interface as specified object or the output data of the image data of feature.

70. the ophthalmoscope as described in clause 1, wherein described to transmit the output data via at least one described communication interface Include:

The output data via the transmission of at least one described communication interface as the image data for including metadata.

71. the ophthalmoscope as described in clause 1, wherein described to transmit the output data via at least one described communication interface Include:

The output data is transmitted via at least one described communication interface in first time, the output data compares retinal map As data need less bandwidth for transmitting；And

Corresponding to described in the second time transmission of at least one of interval time, batch time and/or available bandwidth time At least some of retinal image data.

72. the ophthalmoscope as described in clause 1, wherein described to transmit the output data via at least one described communication interface Include:

In response to detecting at least one health problem, the output data is transmitted via at least one described communication interface, it is no Any data are not transmitted then.

73. the ophthalmoscope as described in clause 1, wherein described to transmit the output data via at least one described communication interface Include:

In response to detecting at least one object or feature, the output data is transmitted via at least one described communication interface, Otherwise any data are not transmitted.

74. the ophthalmoscope as described in clause 1, wherein described image processor is also programmed to execute operation, which includes:

Retinal images, which are received, via at least one described communication interface analyzes application program；And

Realize that the retinal images about the retinal image data analyze application program.

75. the ophthalmoscope as described in clause 74, wherein described image processor is also programmed to execute operation, which includes:

Application programming interfaces are provided, to realize the remote interaction with retinal images analysis application program.

76. the ophthalmoscope as described in clause 1, wherein described image processor is also programmed to execute operation, which includes:

Application programming interfaces are provided, realize the long-range friendship with the one or more application program realized using image processor Mutually.

77. the ophthalmoscope as described in clause 1, wherein described image processor is also programmed to execute operation, which includes:

Receive the communication that the request of region or visual field is specified at least one.

78. the ophthalmoscope as described in clause 1, wherein described image processor is also programmed to execute operation, which includes:

Receive the communication of the request at least one given resolution.

79. the ophthalmoscope as described in clause 1, wherein described image processor is also programmed to execute operation, which includes:

Receive the communication that the request of level of zoom is specified at least one.

80. the ophthalmoscope as described in clause 1, wherein described image processor is also programmed to execute operation, which includes:

Receive the communication that the request of object or feature is specified at least one.

81. the ophthalmoscope as described in clause 1, wherein described image processor is also programmed to execute operation, which includes:

It receives and is related to the communication of the request of zoom.

82. the ophthalmoscope as described in clause 1, wherein described image processor is also programmed to execute operation, which includes:

It receives and is related to the communication of the request of panning.

83. the ophthalmoscope as described in clause 1, wherein described image processor is also programmed to execute operation, which includes:

Receive the communication of the request at least one required movement or event.

84. the ophthalmoscope as described in clause 1, wherein described image processor is also programmed to execute operation, which includes:

Receive the communication of PROGRAMMED REQUESTS.

85. the ophthalmoscope as described in clause 1, wherein described image processor is also programmed to execute operation, which includes:

The communication of client request is received via at least one communication interface.

86. a kind of method that the computer disposal device assembly by ophthalmoscope executes, which includes optical lens device, configuration The imaging sensor and at least one communication interface of retinal image data, this method packet are converted at the light that will test It includes:

The retinal image data is obtained from described image sensor；

Output data is generated based on the analysis to the retinal image data, the output data is than the retinal images number According to the less bandwidth for transmission of needs；And

87. the method as described in clause 86, wherein obtaining the retinal image data from described image sensor and including:

The retinal image data is obtained from the described image sensor positioned with the Optical devices.

88. the method as described in clause 86, wherein obtaining the retinal image data from described image sensor and including:

Institute is obtained from the described image sensor positioned with the Optical devices that can be moved along at least one of x, y or z-axis State retinal image data.

89. the method as described in clause 86, wherein obtaining the retinal image data from described image sensor and including:

The retinal images are obtained from the described image sensor positioned with the rotatable and/or pivotable Optical devices Data.

90. the method as described in clause 86, wherein obtaining the retinal image data from described image sensor and including:

The retinal images number is obtained from the described image sensor positioned with the Optical devices perpendicular to illumination lens device According to.

91. the method as described in clause 86, wherein obtaining the retinal image data from described image sensor and including:

The described image positioned from the Optical devices intersected with irradiation/reflection in the dispersing element for minimizing or eliminating eyes passes Sensor obtains the retinal image data.

92. the method as described in clause 86, wherein obtaining the retinal image data from described image sensor and including:

The retinal images are obtained from the described image sensor positioned with the Optical devices for including one or more coverings Data.

93. the method as described in clause 86, wherein obtaining the retinal image data from described image sensor and including:

The view is obtained from the described image sensor positioned with the Optical devices for including one or more movable shield parts Film image data.

94. the method as described in clause 86, wherein obtaining the retinal image data from described image sensor and including:

The retinal image data is obtained from the described image sensor of at least 18,000,000 pixels.

95. the method as described in clause 86, wherein obtaining the retinal image data from described image sensor and including:

The retinal image data is obtained from the described image sensor of at least 20,000,000 pixels.

96. the method as described in clause 86, wherein obtaining the retinal image data from described image sensor and including:

The retinal image data is obtained from the described image sensor of every square degree square grade at least 10000 pixels.

97. the method as described in clause 86, wherein obtaining the retinal image data from described image sensor and including:

The retinal image data as static image data is obtained from described image sensor.

98. the method as described in clause 86, wherein obtaining the retinal image data from described image sensor and including:

The retinal image data as video data is obtained from described image sensor.

99. the method as described in clause 86, wherein obtaining the retinal image data from described image sensor and including:

The retinal image data as video data is obtained from described image sensor using about 20 frame per second.

100. the method as described in clause 86, wherein obtaining the retinal image data from described image sensor and including:

It is obtained from described image sensor and needs at least retinal image data of the bandwidth of 10Gbps for transmission.

101. the method as described in clause 86, wherein obtaining the retinal image data from described image sensor and including:

It is obtained from described image sensor and needs at least retinal image data of the bandwidth of 20Gbps for transmission.

102. the method as described in clause 86, wherein obtaining the retinal image data from described image sensor and including:

The retinal image data is obtained from described image sensor and at least one other sensor.

103. the method as described in clause 86, wherein obtaining the retinal image data from described image sensor and including:

It is obtained from described image sensor and at least one other sensor associated with least partially overlapped visual field The retinal image data.

104. the method as described in clause 86, wherein obtaining the retinal image data from described image sensor and including:

It is obtained and the associated retina of parallel visual field from described image sensor and at least one other sensor Image data.

105. the method as described in clause 86, wherein obtaining the retinal image data from described image sensor and including:

The retinal image data is obtained at least 20 microns of resolution ratio.

106. the method as described in clause 86, wherein obtaining the retinal image data from described image sensor and including:

Obtain the retinal image data relevant to the visual field of about 40 degree of annulars.

107. the method as described in clause 86, wherein obtaining the retinal image data from described image sensor and including:

Obtain the view of multiple high-definition pictures as the adjacent of retina, overlapping and/or least partially overlapped region Nethike embrane image data.

108. the method as described in clause 86, wherein obtaining the retinal image data from described image sensor and including:

Obtain multiple sequence captured images as the different, adjacent of retina, overlapping and/or least partially overlapped region The retinal image data；And

Splice the retinal images of the multiple sequence capture of the retina to create overview.

109. the method as described in clause 86, wherein obtaining the retinal image data from described image sensor and including:

Obtain the retinal image data of multiple least partially overlapped images as retina；And

Described multiple images are combined into high-resolution retinal image data.

110. the method as described in clause 86, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Output data is generated based on the analysis to the retinal image data, it is described compared with the retinal image data Output data needs about 1/10th bandwidth to be used to transmit.

111. the method as described in clause 86, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Output data is generated based on the analysis to the retinal image data, the pact with the transmission for retinal image data The bandwidth of 20Gbps is compared, and the output data needs the bandwidth of about 1Mbps for transmitting.

112. the method as described in clause 86, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Output data is generated, which includes the reduction resolution version for transmission of retinal image data.

113. the method as described in clause 86, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Output data is generated, which includes at least one of following kind of change of the retinal image data For transmitting: size, pixel diminution, resolution ratio, splicing, compression, color, overlapping is reduced, static reduction and/or background subtract It is small.

114. the method as described in clause 86, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

The part corresponding with health problem including retinal image data is generated based on the analysis to retinal image data Output data.

115. the method as described in clause 86, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

The output number of the identification including at least one of following health problem is generated based on the analysis to retinal image data According to: diabetic retinopathy, macular degeneration, cardiovascular disease, glaucoma, malaria retinopathy, Alzheimer disease, sphere Flattening, papilloedema and/or choroid fold.

116. the method as described in clause 86, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

The output data including metadata is generated based on the analysis to retinal image data, which compares retinal images Data need the less bandwidth for transmission.

117. the method as described in clause 86, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

The output data of the contextual information including addition, the output data ratio are generated based on the analysis to retinal image data Retinal image data needs the less bandwidth for transmission.

118. the method as described in clause 86, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Alphanumeric text output data, the alphanumeric text output data are generated based on the analysis to retinal image data The less bandwidth for transmission is needed than retinal image data.

119. the method as described in clause 86, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Binary system output data is generated based on the analysis to retinal image data, which compares retinal images Data need the less bandwidth for transmission.

120. the method as described in clause 86, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

By pixel decimation generate output data, with independently of retinal image data selection area and/or level of zoom protect Hold constant resolution ratio.

121. the method as described in clause 86, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Output data is generated by pixel decimation to be kept separate from the selection area and/or level of zoom of retinal image data Resolution ratio, the resolution ratio be less than or equal to request equipment resolution capability.

122. the method as described in clause 86, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Output data is generated based on the analysis to retinal image data；With

The output data is compressed, which needs the less bandwidth for transmission than retinal image data.

123. the method as described in clause 86, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Based on to retinal image data analysis generate output data, the output data include retinal image data with inspection The corresponding a part of object or feature measured.

124. the method as described in clause 86, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Based on the object or feature identification generation output data in retinal image data, the output data is than retinal images number According to the less bandwidth for transmission of needs.

125. the method as described in clause 86, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Based on the event or action recognition generation output data in retinal image data, the output data is than retinal images number According to the less bandwidth for transmission of needs.

126. the method as described in clause 86, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

The output data of specified visual field is generated in retinal image data, which needs more than retinal image data Few bandwidth for transmission.

127. the method as described in clause 86, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

The output data of specified level of zoom is generated in retinal image data, which needs than retinal image data Want the less bandwidth for transmission.

128. the method as described in clause 86, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Number is exported based on the analysis to retinal image data and based on requesting to generate to the user of at least one in following item According to: specified visual field, specified resolution ratio, specified level of zoom, specified movement or event, specified object or feature, And/or specified health problem, the output data need the bandwidth for transmission more less than retinal image data.

129. the method as described in clause 86, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Number is exported based on the analysis to retinal image data and based on generating to the PROGRAMMED REQUESTS of at least one in following item According to: specified visual field, specified resolution ratio, specified level of zoom, specified movement or event, specified object or feature, And/or specified health problem, the output data need the less bandwidth for transmission than retinal image data.

130. the method as described in clause 86, wherein the analysis based on to the retinal image data generates output number The less bandwidth for transmission is needed to include: than the retinal image data according to, the output data

Based on the analysis to retinal image data and output data is generated based on the application requests of local trustship, this is defeated Data need the less bandwidth for transmission than retinal image data out.

131. the method as described in clause 86, wherein further include:

Execute the analysis to the retinal image data.

132. the method as described in clause 131, wherein the execution includes: to the analysis of the retinal image data

Benchmark retinal image data is obtained from computer-readable memory；And

Retinal image data is compared with benchmark retinal image data；And

Identify indicate at least one health problem at least one between retinal image data and benchmark retinal image data A deviation.

133. the method as described in clause 131, wherein the execution includes: to the analysis of the retinal image data

Object or feature discriminance analysis are executed using retinal image data to identify at least one health problem.

134. the method as described in clause 86, wherein described to transmit the output data via at least one described communication interface Include:

Transmit the output data via at least one communication interface described at least one of Types Below: WIFI, honeycomb, Satellite and/or internet.

135. the method as described in clause 86, wherein described to transmit the output data via at least one described communication interface Include:

Via about 1/10th bandwidth ability described of the capture rate for including the retinal image data, at least one is logical Believe that interface transmits the output data.

136. the method as described in clause 86, wherein described to transmit the output data via at least one described communication interface Include:

The output data is transmitted via at least one described communication interface in first time, the output data compares retinal map As data need less bandwidth for transmitting；And

Corresponding to described in the second time transmission of at least one of interval time, batch time and/or available bandwidth time At least some of retinal image data.

137. the method as described in clause 86, wherein described to transmit the output data via at least one described communication interface Include:

In response to detecting at least one health problem, the output data is transmitted via at least one described communication interface, it is no Any data are not transmitted then.

138. the method as described in clause 86, wherein described to transmit the output data via at least one described communication interface Include:

In response to detecting at least one object or feature, the output data is transmitted via at least one described communication interface, Otherwise any data are not transmitted.

139. the method as described in clause 86, wherein described to transmit the output data via at least one described communication interface Include:

The output data is transmitted via at least one described communication interface to meet client request.

140. the method as described in clause 86, wherein described to transmit the output data via at least one described communication interface Include:

The output data as image data is transmitted via at least one described communication interface.

141. method as described in clause 86, wherein described to transmit the output data via at least one described communication interface Include:

The output data as alphanumeric data is transmitted via at least one described communication interface.

142. method as described in clause 86, wherein described to transmit the output data via at least one described communication interface Include:

The output data as binary data is transmitted via at least one described communication interface.

143. method as described in clause 86, wherein described to transmit the output data via at least one described communication interface Include:

In no static pixels, previously in the case where one or more of pixel or overlaid pixel for transmitting, via it is described extremely A few communication interface transmits the output data, and wherein described image data fill gap at remote server.

144. method as described in clause 86, wherein described to transmit the output data via at least one described communication interface Include:

The output data via the transmission of at least one described communication interface as the image data in specified region.

145. method as described in clause 86, wherein described to transmit the output data via at least one described communication interface Include:

The output data via the transmission of at least one described communication interface as the image data of given resolution.

146. method as described in clause 86, wherein described to transmit the output data via at least one described communication interface Include:

The output data via the transmission of at least one described communication interface as the image data of specified level of zoom.

147. method as described in clause 86, wherein described to transmit the output data via at least one described communication interface Include:

Via the transmission of at least one described communication interface as specified object or the output data of the image data of feature.

148. method as described in clause 86, wherein described to transmit the output data via at least one described communication interface Include:

The output data via the transmission of at least one described communication interface as the image data for including metadata.

149. method as described in clause 86, further comprising:

Receive the communication of request.

150. method as described in clause 149, wherein the communication for receiving request includes:

Receive the communication that the request of region or visual field is specified at least one.

151. method as described in clause 149, wherein the communication for receiving request includes:

Receive the communication of the request at least one given resolution.

152. method as described in clause 149, wherein the communication for receiving request includes:

Receive the communication that the request of level of zoom is specified at least one.

153. method as described in clause 149, wherein the communication for receiving request includes:

Receive the communication that the request of object or feature is specified at least one.

154. method as described in clause 149, wherein the communication for receiving request includes:

It receives and is related to the communication of the request of zoom.

155. method as described in clause 149, wherein the communication for receiving request includes:

It receives and is related to the communication of the request of panning.

156. method as described in clause 149, wherein the communication for receiving request includes:

Receive the communication of the request at least one required movement or event.

157. method as described in clause 149, wherein the communication for receiving request includes:

Receive the communication of PROGRAMMED REQUESTS.

158. method as described in clause 149, wherein the communication for receiving request includes:

The communication of client request is received via at least one communication interface.

159. method as described in clause 86, further include:

Retinal images, which are received, via at least one described communication interface analyzes application program；And

Realize that the retinal images about the retinal image data analyze application program.

160. method as described in clause 167, further include:

Application programming interfaces are provided, to realize the remote interaction with retinal images analysis application program.

161. method as described in clause 86, further include:

The application programming interfaces for realizing remote interaction are provided.

162. method as described in clause 86, further include:

Irradiate retina.

163. method as described in clause 162, wherein the irradiation retina includes:

View is irradiated using light source and at least one covering for keeping irradiation/reflection in the dispersing elements of eyes cross-minimized Film.

164. method as described in clause 162, wherein the irradiation retina includes:

Retina is irradiated using infrared light supply and the optical lens device.

165. method as described in clause 162, wherein the irradiation retina includes:

Retina is irradiated using visible light source and the optical lens device.

166. method as described in clause 162, wherein the irradiation retina includes:

At least one shielding part is moved to change the region of retinal illumination.

A kind of 167. ophthalmoscopes comprising:

For obtaining the device of retinal image data from imaging sensor；

For generating the device of output data based on the analysis to the retinal image data, the output data is than the view Nethike embrane image data needs the less bandwidth for transmission；With

For transmitting the device of output data by least one communication interface.

Although many aspects and embodiment have been disclosed herein, other aspects and embodiment are for art technology It will be apparent for personnel.Many aspects and embodiment disclosed herein are for purposes of illustration without being intended to It is limited, real scope and spirit are indicated by appended claims.

Claims (18)

1. a kind of ophthalmoscope that the machine vision for view film analysis enables, the ophthalmoscope include:

Optical lens device；

Imaging sensor, positions with the optical lens device and the light for being configured as will test is converted to retinal images Data；

Computer-readable memory；

At least one communication interface；With

Image processor, can be otherwise communicatively linked to described image sensor, the computer-readable memory and it is described at least One communication interface, described image processor are programmed to execute operation, and the operation includes at least:

The retinal image data is obtained from described image sensor；

Output data is generated based on the analysis to the retinal image data, the output data is than the retinal images number According to the less bandwidth for transmission of needs；And

The output data is transmitted via at least one described communication interface.

2. ophthalmoscope according to claim 1, wherein the optical lens device, described image sensor, the calculating Machine readable memory, at least one described communication interface and described image processor are incorporated in virtual reality headset.

3. ophthalmoscope according to claim 1, wherein the optical lens device, described image sensor, the calculating Machine readable memory, at least one described communication interface and described image processor are incorporated in the eyeshade with headband.

4. ophthalmoscope according to claim 1, wherein the optical lens device, described image sensor, the calculating Machine readable memory, at least one described communication interface and described image processor are incorporated in desk or wall-mounted equipment.

5. ophthalmoscope according to claim 1, wherein the optical lens device, described image sensor, the calculating Machine readable memory, at least one described communication interface and described image processor at least one of are distributed in following equipment Between the eyeshade of coupling: smart phone, tablet computer, laptop and/or workstation computer.

6. ophthalmoscope according to claim 1, wherein the optical lens device includes:

The optical lens device that can be moved along at least one of x-axis, y-axis or z-axis.

7. ophthalmoscope according to claim 1, wherein the optical lens device includes:

The optical lens device that can be rotated and/or can pivot.

8. ophthalmoscope according to claim 1, wherein the optical lens device includes:

Along the image optics lens devices of first axle alignment；

Illumination lens device is aligned along the second axis perpendicular to the first axle；And

At least one polarizing beam splitter/combiner.

9. ophthalmoscope according to claim 8, further include:

Irradiation LED is configured as transmitting light；With

One or more coverings are configured as before the light of the irradiation LED passes through the illumination lens device At least some of described light is blocked, the irradiation in dispersing element to minimize eyes/reflection intersects,

Wherein, at least one described polarizing beam splitter/combiner is configured as passing through along described in second axis alignment The light-redirecting of illumination lens device is to the image optics lens devices being aligned along the first axle, to irradiate State at least part of retina.

10. ophthalmoscope according to claim 9, further include:

Infrared LED is configured as transmitting infrared light；With

One or more infrared coverings, the infrared light for being configured as the infrared LED are passing through the illumination lens At least some of described infrared light is blocked before device, the irradiation in dispersing element to minimize eyes/reflection intersects,

Wherein, at least one described polarizing beam splitter/combiner is configured as passing through along described in second axis alignment The light-redirecting of illumination lens device is to the image optics lens devices being aligned along the first axle, to irradiate State at least part of retina.

11. ophthalmoscope according to claim 10, wherein one or more of coverings and one or more of red Outer covering is mobile.

12. ophthalmoscope according to claim 1, further include:

Irradiation source emits light；With

At least one covering is configured as blocking at least some of described light of the irradiation source, to minimize eyes Dispersing element in irradiation/reflection intersect.

13. ophthalmoscope according to claim 10, wherein the covering is mobile.

14. ophthalmoscope according to claim 1, further include:

Light source is configured as transmitting infrared light to carry out positioning and/or focus and determine.

15. ophthalmoscope according to claim 1, further include:

Radiation source is configured to transmitting visible light for being imaged.

16. ophthalmoscope according to claim 1, wherein positioned with the optical lens device and be configured as to examine The described image sensor that the light measured is converted to retinal image data includes:

Imaging sensor is positioned with the optical lens device, and is configured as will test at least 20 microns of resolution ratio To light be converted to retinal image data.

17. ophthalmoscope according to claim 1, wherein positioned with the optical lens device and be configured as to examine The described image sensor that the light measured is converted to retinal image data includes:

Imaging sensor is positioned with optical lens device, and the light for being configured as will test is converted into the ring with about 40 degree The associated retinal image data of shape visual field.

18. ophthalmoscope according to claim 1, wherein positioned with the optical lens device and be configured as to examine The described image sensor that the light measured is converted to retinal image data includes:

Imaging sensor is positioned with the optical lens device, and is configured as adjacent, overlapping by capture retina And/or multiple high-definition pictures in least partially overlapped region are converted to retinal image data come the light that will test.