US20160248951A1 - Cellscope apparatus and methods for imaging - Google Patents
Cellscope apparatus and methods for imaging Download PDFInfo
- Publication number
- US20160248951A1 US20160248951A1 US15/052,347 US201615052347A US2016248951A1 US 20160248951 A1 US20160248951 A1 US 20160248951A1 US 201615052347 A US201615052347 A US 201615052347A US 2016248951 A1 US2016248951 A1 US 2016248951A1
- Authority
- US
- United States
- Prior art keywords
- image
- optical
- imaging
- illumination
- housing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H04N5/2254—
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00043—Operational features of endoscopes provided with output arrangements
- A61B1/00045—Display arrangement
- A61B1/00052—Display arrangement positioned at proximal end of the endoscope body
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00064—Constructional details of the endoscope body
- A61B1/00108—Constructional details of the endoscope body characterised by self-sufficient functionality for stand-alone use
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
- A61B1/042—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances characterised by a proximal camera, e.g. a CCD camera
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
- A61B1/044—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances for absorption imaging
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/227—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor for ears, i.e. otoscopes
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0077—Devices for viewing the surface of the body, e.g. camera, magnifying lens
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B25/00—Eyepieces; Magnifying glasses
- G02B25/002—Magnifying glasses
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/21—Combinations with auxiliary equipment, e.g. with clocks or memoranda pads
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/002—Diagnosis, testing or measuring for television systems or their details for television cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
-
- H04N5/2257—
Definitions
- This invention pertains generally to imaging devices, and more particularly to devices and methods for enhanced imaging with mobile electronics devices.
- Handheld mobile devices such as cellular phones, tablets, PDA's, etc.
- Handheld mobile devices are becoming increasingly useful for imaging due to their ready availability to communicate with other devices wirelessly.
- the cameras and illumination sources included with most mobile electronic devices are primitive with respect to the type of imaging that may be required for special surfaces such as a patient's skin or body passage.
- an object of the present invention is an apparatus that allows mobile devices to perform as enhanced camera's and telemedicine tools, utilizing their familiar interface and ease of image capture and transmission. At least some of these objectives will be met in the description below.
- the present invention is an improved system and method for enhanced imaging using wireless transmission devices with a camera (such as a mobile phone) combined with an optical attachment. Images can be viewed and analyzed on the mobile device, or transmitted to another location/device for analysis by a person or software. The results may be used to provide diagnosis, or for a variety of other applications including image comparison over time and product recommendations.
- a camera such as a mobile phone
- One aspect of the invention is an imaging apparatus for a portable wireless device having a built-in camera.
- the apparatus includes a releasable optical assembly having a housing comprising an attachment surface for releasably coupling the releasable optical assembly to the portable wireless device, and an optical transmission element.
- the optical transmission element is configured to enhance an image taken by the built-in camera prior to the image being received the portable wireless device.
- Another aspect is a system for enhancing and post-processing images obtained from a portable wireless device having a built-in camera, comprising: a releasable optical assembly, comprising: a housing comprising an attachment surface for releasably coupling the releasable optical assembly to the portable wireless device, and an optical transmission element.
- the optical transmission element is configured to enhance an image taken by the built-in camera prior to the image being received the portable wireless device.
- the system further comprises programming executable on said wireless device or other external device for receiving the enhanced image and post processing the enhanced image.
- FIG. 1A is a view of the imaging apparatus of the present invention positioned adjacent mobile device.
- FIG. 1B shows the imaging apparatus of FIG. 1A installed on a mobile device in accordance with the present invention.
- FIG. 2 shows a view of the rear side of the imaging apparatus of FIG. 1A .
- FIG. 3 shows the imaging apparatus of FIG. 1A installed on a mobile device in accordance with the present invention, with outer speculum removed for clarity.
- FIG. 4 shows a cross-sectional view of the imaging apparatus of FIG. 1A installed on a mobile device in accordance with the present invention.
- FIG. 5 shows an alternative imaging apparatus in accordance with the present invention.
- FIG. 6 shows the imaging apparatus of FIG. 5 with the diffuser removed for clarity.
- FIG. 7 shows a rear view of the housing of the imaging apparatus of FIG. 4 .
- FIG. 8 shows a cross-sectional view of the imaging apparatus of FIG. 5 installed on a mobile device in accordance with the present invention.
- FIG. 9 shows the imaging apparatus of FIG. 5 with calibration module in accordance with the present invention.
- FIGS. 10A and 10B show perspective and plan views, respectively, of an exposure calibration tool according to the present invention.
- FIG. 11 shows a perspective view of a focus calibration tool according to the present invention.
- FIG. 12A illustrates a side view of an embodiment for coupling the optical attachment of the present invention.
- FIG. 12B illustrates a plan view of an alternative embodiment for coupling for the optical attachment of the present invention.
- FIG. 13 shows a side view of an embodiment of a modular imaging system comprising components for imaging and illumination according to the invention.
- FIG. 14 shows embodiments of a modular attachment system according to the present invention.
- FIG. 15 shows a method for two-way optical data transmission from a mobile device according to the present invention.
- FIG. 16 shows a flow diagram of the image normalization step of FIG. 15 .
- FIG. 17 shows a flow diagram of the image analysis step of FIG. 15 .
- the present invention can be embodied in various ways.
- FIG. 1A illustrates a perspective view of an imaging apparatus 10 positioned adjacent handheld mobile electronic device 12 .
- Mobile device 12 is illustrated as an iPhone 4 in the various figures depicted herein.
- mobile device 12 may be any wireless-enabled device having a camera, i.e. mobile device 12 may comprise any number of possible makes of cellular phones, PDA's, tablets, etc.
- FIG. 1B shows the imaging apparatus 10 installed on the mobile device 12 in accordance with the present invention.
- Imaging apparatus 10 includes one or more optical transmission elements (e.g. lens, fiber optics, etc.) that are configured to enhance an image received by a camera 22 of device 12 prior to that image being received by the camera 22 CCD (not shown).
- the optical transmission elements may provide magnification and/or improved illumination to the imaged target, in addition to other imaging enhancements.
- Imaging apparatus 10 includes a base member 14 that can be coupled to the mobile device 12 .
- FIGS. 1A and 1B illustrate “clip-on” coupling means or surface 20 , although other removable means such as slide-on, snap-on, or adhesives/adhesive backings are also contemplated.
- base member 14 is shown in the current figures as a partial cover of the mobile device 12 , base member 14 may also comprise a full case or cover (i.e. extending along the length of phone 12 ) that covers one or more surfaces, and releasably couples to the mobile device 12 .
- FIGS. 1A and 1B show a releasable optical assembly 16 attached to base 14 .
- the releasable optical assembly 16 comprises a cylindrical housing 40 and a conical-shaped speculum 18 .
- Speculum 18 is shown sized and shaped for ear drum imaging as an otoscope.
- the speculum 18 is one of many different optical attachments that may be used to interface the imaging apparatus 10 with varying anatomical features.
- speculum 18 may be sized and shaped for proper interface with various body cavities, including nasal, oral, vaginal, and anal cavities, etc.
- Speculum 18 is configured for quick release attachment to housing 40 . As shown in FIG. 4 , the speculum 18 is shown with a contact fit over housing 40 .
- other attachment means e.g. mating threads, clips, snaps, tab-and-grooves, etc., may also be used.
- the base member 14 also includes means (not shown) for coupling the releasable optical assembly 16 to the base member 14 , such as clip-on, snap-on, slide-on, twist-on, and other conventional means for attachment.
- the releasable optical assembly 16 may have pins that line up with and snap into one or more corresponding slots in the base member, or vise versa.
- FIG. 2 shows a view of the rear side of the imaging apparatus 10 and base 14 .
- Base 14 comprises clip-on walls 20 that help retain the base 14 on to the mobile device 12 .
- the base 14 comprises an illumination port 34 configured to align with the phone's LED flash 24 to allow illuminated light to pass through the case and into the releasable optical assembly 16 .
- the base 14 also comprises and an imaging port 32 allowing line of sight for the phone's camera 22 from the releasable optical assembly 16 .
- FIG. 3 shows the imaging apparatus 10 installed on a mobile device 12 with outer speculum attachment 18 removed for clarity.
- An optical tube 56 is centered within the housing opening and has a tube aperture 58 configured to line up with the imaging port 32 of the base 14 .
- FIG. 4 shows a cross-sectional view of the imaging apparatus 10 installed on mobile device 12 .
- the back wall 68 of the housing 40 comprises an imaging opening 42 that is configured to line up with optical tube 56 , imaging port 32 and camera 22 .
- Optical tube 56 may be an integral member with housing 40 , or attached to the housing 40 .
- the imaging port 32 and opening 42 provide an optical path for imaging.
- a lens 62 (or series of lenses) is preferably disposed within the optical tube 56 , imaging opening 42 or imaging port 32 (shown in preferred configuration in imaging opening 42 ).
- the lens 62 is preferably configured to provide magnification of the target anatomy (e.g. ear drum, etc.).
- lens 62 comprises a plano-convex lens with a 48 mm focal length. It is appreciated that lens 62 may comprise any number of differing types, (e.g. bi-convex, convex-meniscus, etc.), or any combination of lenses known in the art.
- lens 62 may comprise micro-lens array (e.g.
- each lens element in the array has a shorter focal length/higher magnification than the larger lenses (e.g., the 48 mm f lens in the otoscope), so the design can be much more compact. Due to the space in between the array elements, the array can be scanned to capture the individual images, which are then assembled into a unified image of the field without gaps. This allows for a high magnification system in a much smaller form factor.
- the imaging apparatus 10 preferably comprises means for directing the light from the phone's LED flash 24 to provide improved illumination.
- Illumination with the fiber optics may be used to eliminate shadows.
- the light can be directed to provide on-axis illumination, as well as oblique or off-axis illumination for better contrast for some applications.
- the back wall 68 of the housing 40 further comprises an illumination opening 44 that is configured to line up with a fiber optic bundle 50 a, illumination port 34 and flash 24 .
- Fiber optic bundle 50 a generally comprises one or more optical fibers, configured with end glow or side glow characteristics to suit the particular application or anatomy being imaged.
- the fiber optic bundle 50 a connects at one end to the illumination opening 44 and wraps and extends to optical tube 56 , with optical fibers 50 extending axially around optical tube 56 to form a coaxial layer at least partially surrounding the optical tube.
- the individual optical fibers 50 preferably form a continuous layer around tube 56 .
- the optical fibers may also surround the tube at spaced intervals.
- Optical fibers 50 extend at least a portion of the length of tube 56 such that the end of the optical fibers are aligned in the direction of the tube 56 axis and preferably near the free end of the tube 56 .
- Optical fibers are held in place on tube 56 via an adhesive, band 47 , or like attachment means.
- the bundle 50 a and fibers 50 are configured to propagate light from flash 24 (e.g. LED or the like) and direct it toward the free end of the optical tube 56 and in the direction of speculum 18 .
- the optical fibers 50 arrayed around the end of the tube 56 provide a more uniform ring of illumination in the direction of the target anatomy. Such directed light is particularly useful for viewing/imaging cavities in the body such as the ear or mouth, where light is limited.
- the imaging apparatus is configured such that when base member 14 and releasable optical assembly 16 are attached to device 12 , all optical apertures (speculum aperture 19 , optical tube aperture 58 , optical opening 42 , and optical port 32 ) are in substantially concentric alignment with camera 22 , and correspondingly, all illumination apertures (illumination opening 44 , illumination port 34 ) are all in substantially concentric alignment with flash 24 .
- the optical assembly 16 may also contain one or more filters in the illumination path to improve the illumination of the target anatomy.
- the filters may be positioned in fixed or adjustable configuration at or between one or more structures of the imaging apparatus 10 .
- a sliding color spectrum filter may also be positioned in the path of the LED flash 24 to enable selective color illumination for spectrophotometric applications.
- the filters may comprise one or more of polarizing filters, neutral density filters, or diffusers, or the like.
- one or more polarizing filters can be used to reduce glare and/or shadows, in addition to controlling illumination intensity and uniformity.
- filters may be used to control the intensity and pattern of illumination based on the phone's LED flash 24 (or an integrated light source as provided in FIG. 12 , described in further detail below), and/or to reduce glare for imaging a reflective sample (such as like oily skin).
- variable filters the intensity of sample illumination can be adjusted without changing the output provided by the device LED 24 .
- the LED flash 24 is either on or off when no software support for adjustable intensity is provided, making exposure difficult in some applications.
- two polarizing filters 52 , 54 are stacked in series between the handset LED 24 and the illuminated anatomical target.
- the first filter 52 is fixed and disposed within a rectangular counter bore 46 set into the rear wall 68 of housing 40 .
- the second filter 54 is set into a circular counter bore 48 in housing 40 , and is configured to be rotated with use of lever 66 to modulate the intensity of the light transmitted to the sample anatomy.
- the filters 52 , 54 may be positioned anywhere within the optical path, e.g. within corresponding counter bores (not shown) in the base 14 .
- the intensity of the transmitted light is controlled by the relative orientation of the filters 52 , 54 , where parallel orientation permits the maximum transmission and perpendicular orientation permits minimal transmission. This could also be achieved with a gradient neutral density filter, which could be moved (rotated in the case of a circular gradient) to adjust the light transmission
- a spectral selection tool may also be included for controlling illumination wavelength.
- a slider (or color wheel, etc., not shown) containing color filters may provide for specific wavelengths to be chosen from the LED 24 illumination. This enables comparison of images taken with different colors to look for absorption differences. This is useful in skin imaging, for example.
- the optical assembly 16 may also comprise one or more filters in the optical path (e.g. between optical port 32 and optical opening 42 ).
- one or more filters comprising a polarizer, neutral density filter, or spectral selection filter may be positioned in the optical path using a system similar to the illumination filters 52 , 54 of FIG. 4 .
- Optical assembly 16 may further allow for adjustment of the optical components (e.g. lens 62 ).
- optical assembly 16 may comprise a lens slider (not shown) similar to slider 66 in FIGS. 4-6 to allow for one or more lenses to be moved in and out of the optical path (lens stacking), or for lens position to be moved along the optical axis. Removing all attachment lenses 62 from the path provides the device's 12 standard imaging characteristics, while adding one or more lenses 62 in the optical path modifies the imaging characteristics to suit the application.
- single optical assembly 16 may be configured to provide variable magnification and numerical aperture characteristics, similar to the way that many microscopes contain a turret of objectives.
- FIGS. 5-8 show an imaging apparatus 25 preferably configured for use in imaging skin surfaces, and in particular, non-cavity-type skin surfaces.
- imaging apparatus 25 includes a releasable optical assembly 17 attached to base 14 .
- the releasable optical assembly 17 comprises an open ended housing or spacer 45 having an optical opening 42 .
- the optical opening 42 provides an open path to the optical port 32 of base 14 and camera 22 of device 12 .
- Spacer 45 of imaging apparatus 25 provides a set distance between camera 22 , lens 62 and the image target.
- Spacer 45 may also include an additional sliding tube (as provided in tube 96 in calibration tool 90 shown in FIG. 11 ) to provide adjustable spacing.
- the spacer element 45 could be adjusted to discrete or continuous height steps to accommodate the focal length of the lens or lenses 62 .
- Fiber optic bundle 50 b may be used to change the shape and/or position of the light source 24 .
- fiber optic bundle 50 b could be arrayed under a diffuser 60 to provide controlled (e.g. uniform) illumination, ( FIG. 6 shows the diffuser removed for clarity).
- the fiber optic bundle 50 b is disposed within illumination opening 44 of the housing 45 , such that the fiber optic bundle 50 b is in line with illumination port 34 of the base 14 and LED 24 of device 12 .
- the optical attachment assembly 17 may also comprise filters 52 , 54 , and slider handle 66 in addition to bores 46 and 48 in the housing 45 to provide additional illumination filtering.
- FIG. 9 shows the imaging apparatus 27 similar to imaging apparatus 25 of FIGS. 5-6 , with calibration module 70 disposed on spaced 45 .
- Calibration module 70 comprises a test pattern feature 72 which appears in a portion of the image field of view to enable calibration of color, white balance, exposure, and size.
- black, white, grey and color patches with known color values on the calibration pattern serve as a reference for post-processing of the image.
- the test pattern also provides an exposure reference (based on the appearance of the black patches in the image) and a size scale due to the known size of the pattern elements.
- the calibration module 70 is instrumental in controlling imaging from a device 12 , such as a mobile phone, which was not designed to produce absolute color/exposure references.
- the calibration module 70 is integrated into the imaging apparatus 27 . It is also appreciated that calibration module 70 may be disposed within aperture 19 of disposable speculum 18 for calibrating device 10 .
- a reference feature may be used as an external test pattern or a common object (for example, a coin). Including a known object in the field of view enables size and color calibration of the resulting image, especially when its depth position is known or can be determined from the image.
- a coin held next to the earlobe can be used by software to determine (or reasonably estimate) the absolute size of the facial features.
- FIGS. 10A through 11 illustrate focus and illumination tools for pre-capture calibration to pre-set the exposure and focus before capturing an image.
- FIGS. 10A and 10B show perspective and plan views, respectively, of an exposure calibration tool 80 according to the present invention.
- the camera's 22 exposure setting may use a larger region of interest (ROI) than the actual image region at the end of the tip of speculum 18 .
- ROI region of interest
- Exposure calibration tool 80 comprises a stepped platform 82 a distance h from a lower platform 84 .
- the stepped platform 82 has large 86 and small 88 dark apertures, and the lower platform 84 correspondingly comprises large 76 and small 78 lighter apertures.
- Exposure calibration is performed by inserting imaging apparatus 10 , 25 (e.g. otoscope tip 18 ) at the particular apertures 76 , 78 , 86 , 88 .
- the stepped platform 82 provides a sharp image at a known distance to pre-set focus
- the lower platform 84 is bright (e.g. with matte aluminum foil or like material, or adjustable to material with a range of known reflectance values) to pre-set the exposure.
- FIG. 11 shows a perspective view of a focus calibration tool 90 having a base 92 and sliding tube 96 disposed within base tube 94 .
- the sliding tube adjusts to various heights H by sliding within base tube height to allow for a range of focal distance pre-sets.
- the calibration tool comprises an illumination opening 95 and imaging aperture 98 .
- the tools 80 and 90 to calibrate focus and exposure may be a separate parts (as shown in FIGS. 10A through 11 ) or integrated within the imaging device (e.g. calibration module 70 in device 27 FIG. 9 ).
- the calibration tool may be adjustable to allow for a range of focal distances (as shown), or use a color wheel or other means to adjust the exposure calibration area
- FIGS. 12A through 13 illustrate different attachment means according to the present invention.
- FIG. 12 A illustrates a side view attachment means coupling an imaging apparatus 104 via manually positioning and affixing the imaging apparatus 104 with a ring 108 (which may be replaceable).
- Ring 108 may comprise adhesive tape, hook-and-loop closure or magnet to releasably attach to the phone.
- FIG. 12B illustrates a plan view of an alternative embodiment for coupling assembly 100 .
- Coupling assembly 100 comprises spring-loaded pincher attachment 102 that is configured to be silideably positioned in the vertical direction.
- Coupling assembly 100 further comprises a rectangular slot 106 that allows the imaging assembly 104 to be adjusted in the horizontal direction to coincide with the phone 12 camera 22 and flash 24 .
- FIG. 13 illustrates modular imaging system 120 comprising separated components for imaging and illumination.
- the flexible fiber bundle 124 is attached to the optical cone 122 , such that the fiber bundle 124 can be bent to accommodate a variety of camera 22 and LED/flash 24 positions on the mobile device 12 or case 14 provided with the device.
- the system 120 is shown in the otoscope-type configuration 10 of FIGS. 1-4 , with a cone 122 to which disposable specula can be attached.
- the same modular approach may also be applied to the apparatus 25 of FIGS. 5-6 .
- FIG. 14 shows a modular attachment system 150 having independent light source 162 .
- System 150 may comprise a disposable speculum 152 that tapers toward its tapered free end, and having tabs 164 at its proximal end for attachment to slot 166 in housing 168 .
- a separate attachment cone 154 may also be included, and have slot 166 for attaching to housing 168 .
- An optical tube 156 containing one or more lenses 62 is provided within housing 168 , and is wrapped in fiber optics 158 for illumination. The fiber bundle 158 can draw light from the phone's LED flash 24 , an external light source 162 by means of elongate tube 160 .
- the image enhancement systems shown in FIGS. 1-14 may be used not only for capturing enhanced digital images and video, but also as a real-time scope for viewing patient anatomy. For example, one could be treating the integrated mobile device 12 as an otoscope for display on the mobile device's screen. At any time, an image capture or video may also be initiated to store the image or video in memory, and transmit the image or video if necessary.
- FIGS. 15 through 17 illustrate a system and method for post processing an image captured from a mobile device 12 . While it is preferred that software for carrying out method 200 be used in conjunction with the image enhancement apparatus disclosed in FIGS. 1 through 14 , it is appreciated that the methods disclosed in FIGS. 15 through 17 may be used for any mobile device, webcam, or camera directly, with or without the image enhancement apparatus disclosed in FIGS. 1 through 14 . Accordingly, a preferred embodiment of the present invention is a system comprising one or more of the enhancement apparatus disclosed in FIGS. 1 through 14 , along with software using methods and algorithms embodied in FIGS. 15 through 17 .
- FIG. 15 shows a method 200 for two-way optical data transmission from a mobile device, which allows the user to point the imaging apparatus 10 , 25 at a surface, while displaying the real-time image of the surface on a secondary device, such as a computer.
- the secondary device can control the features of the imaging system 10 , 25 , such as choosing the focus region of interest, exposure, and image collection, etc.
- Method 200 may be implemented within a software module or application for execution on a processor of the wireless device, as well as applications for execution on the secondary device such as a computer.
- a first step in the method 200 is calibration of the camera 22 at block 202 .
- an image is captured at block 204 and transmitted to secondary device at block 206 .
- Image normalization is then performed at block 208 , and image analysis and/or diagnosis is performed at step 210 .
- Captured images may be transmitted for analysis by software algorithms or a person for a range of applications including diagnosis, monitoring and product recommendations.
- image transmission step may be desirable to perform calculation intensive tasks such as image normalization step 208 and image analysis/diagnosis step 210 on a computer or other device configured to quickly perform such calculations
- transmission step 206 is optional, and that one or both of the image normalization step 208 and image analysis/diagnosis step 210 may be performed using software and programming on the mobile device 12 .
- FIG. 16 illustrates in further detail the image normalization step 208 of method 200 .
- Exposure and focus sharpness of image 212 is calculated with a known feature at stem 214 . If the calculation returns non-acceptable results at evaluation step 218 , the device 12 is prompted for another image to be captured at step 216 . If the calculation returns non-acceptable results at evaluation step 218 , the reference data from image is used at step 220 . The image is then adjusted at step 220 to generate the normalized image 222 .
- Image normalization step 208 has the capability to normalize the image based on test pattern portion of the image 212 as an application loaded as either on-board software on the mobile device 12 , or by uploading the image 212 for server-side processing.
- the normalization step 208 which may comprise white balance, exposure, focus, etc., may be based on the imaging apparatus 10 integrated test pattern (e.g. calibration module 70 ), or on another known standard.
- the orientation of the image 212 may also be adjusted in step 210 using reference features in the image 212 (e.g. in the case of ear drum imaging, adjusting the rotation of the image based on the “cone of light” feature of the ear drum), or using on-board sensors within device 12 such as the accelerometer or gyroscope.
- Normalization step 208 can identify corresponding features from two images to determine whether they have overlapping areas. This too can be improved by adding in accelerometer/gyroscope data, so that the overlap detection is based on images with the same orientation (this compensates for a rotation difference between the two images).
- Normalization data may also be used to override the camera 22 automatic focus and exposure settings so as not to interfere with the acquired calibrated settings.
- FIG. 17 illustrates in further detail the image analysis and/ or diagnosis step 210 of method 200 .
- Diagnosis step 210 provides image processing (either via executing an application on-board the phone/device 12 or uploaded for server-side processing) to analyze images for features of interest, such as skin image analysis for wrinkles, lines, redness, blood vessels, dryness, coloration, UV damage and roughness.
- the normalized image 222 similar image characteristics (e.g. skin type) identified from other users 230 and other image data and results from image analysis or other users are input.
- Data from 230 and 232 may comprise a database of images and associated data.
- the normalized data 222 is compared with data from past images or other user data to arrive at resulting image 238 .
- Software loaded on the mobile device 12 or secondary device may use the results 238 of image analysis to provide recommendations and/or targeted ads to user.
- image analysis provides data on skin type and condition (e.g. Fitzpatrick type, oily/dry/combination, UV damage, wrinkles, etc) and the user is provided with targeted product recommendations.
- the software also allows users to track images over time to monitor changes, results of product usage, etc.
- Recommendations and ads can be based on aggregated data from users from a similar class (e.g. with similar skin types). For example, image analysis (from the magnified imaging system 10 , 25 of the present invention, or standard cameras) may be used to show that users with similar skin have recorded better results using a particular product.
- the method 200 and associated software have the capability to transmit the image in real time for display on the secondary device (e.g., another phone or computer via the device application or website).
- the communication can be two-way, so that the imaging system functions (focus, exposure, image capture, etc.) can be controlled from the second device.
- Images 204 may be tagged with GPS and/or time/date stamp information, which can be used to authenticate the user or perform geographical meta-analysis of results.
- Video may also be captured by on the device 12 , and analyzed by method 200 using software on the device or server-side to identify key frames or to generate an enhanced single frame.
- the software may identify the best frame to present to the physician by using a standard sharpness detection algorithm to find the frame with the sharpest cone of light (bright reflection off the ear drum with a defined border).
- This video could be taken while moving the device around, or while adjusting the focal distance (such as running the camera's 12 autofocus function).
- Video during autofocus provides a set of frames that are focused on a series of focal distance planes. This may then be used to identify the best frame, or to provide something analogous to the 3D image reconstruction done with a confocal microscope image stack.
- optical enhancement systems of FIGS. 1-14 and image processing methods of FIGS. 15-17 may also be useful with 3D stereo cameras now available on some phones).
- Stereo images may be used help in skin imaging, for example to measure the depth of wrinkles or the height of a mole.
- Embodiments of the present invention may be described with reference to flowchart illustrations of methods and systems according to embodiments of the invention, and/or algorithms, formulae, or other computational depictions, which may also be implemented as computer program products.
- each block or step of a flowchart, and combinations of blocks (and/or steps) in a flowchart, algorithm, formula, or computational depiction can be implemented by various means, such as hardware, firmware, and/or software including one or more computer program instructions embodied in computer-readable program code logic.
- any such computer program instructions may be loaded onto a computer, including without limitation a general purpose computer or special purpose computer, or other programmable processing apparatus to produce a machine, such that the computer program instructions which execute on the computer or other programmable processing apparatus create means for implementing the functions specified in the block(s) of the flowchart(s).
- blocks of the flowcharts, algorithms, formulae, or computational depictions support combinations of means for performing the specified functions, combinations of steps for performing the specified functions, and computer program instructions, such as embodied in computer-readable program code logic means, for performing the specified functions. It will also be understood that each block of the flowchart illustrations, algorithms, formulae, or computational depictions and combinations thereof described herein, can be implemented by special purpose hardware-based computer systems which perform the specified functions or steps, or combinations of special purpose hardware and computer-readable program code logic means.
- these computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the block(s) of the flowchart(s).
- the computer program instructions may also be loaded onto a computer or other programmable processing apparatus to cause a series of operational steps to be performed on the computer or other programmable processing apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable processing apparatus provide steps for implementing the functions specified in the block(s) of the flowchart(s), algorithm(s), formula(e), or computational depiction(s).
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Surgery (AREA)
- Physics & Mathematics (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Optics & Photonics (AREA)
- Pathology (AREA)
- Molecular Biology (AREA)
- Biophysics (AREA)
- Veterinary Medicine (AREA)
- Public Health (AREA)
- Animal Behavior & Ethology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Signal Processing (AREA)
- Radiology & Medical Imaging (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Multimedia (AREA)
- General Physics & Mathematics (AREA)
- Studio Devices (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
- Endoscopes (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
An improved system and methods for enhancing the imaging of cameras included with wireless mobile devices, such as cellular phone or tablets. The imaging system includes a releasable optical attachment for imaging skin surfaces and cavities of the body. The releasable optical attachment comprises optical enhancement elements such as magnifying lenses, illumination diverting elements, and filters. Images can be viewed and analyzed on the mobile device, or transmitted to another location/device for analysis by a person or software. The results can be used to provide diagnosis, or for a variety of other applications including image comparison over time and product recommendations.
Description
- This application is a continuation of U.S. patent application Ser. No. 13/855,501 filed on Apr. 2, 2013, incorporated herein by reference in its entirety, which is a 35 U.S.C. §111(a) continuation of PCT international application number PCT/US2011/058466 filed on Oct. 28, 2011, incorporated herein by reference in its entirety, which claims priority to and the benefit of U.S. provisional patent application Ser. No. 61/532,617 filed on Sep. 9, 2011, incorporated herein by reference in its entirety, and which claims priority to and the benefit of U.S. provisional patent application Ser. No. 61/408,568 filed on Oct. 29, 2010, incorporated herein by reference in its entirety.
- The above-referenced PCT international application was published as PCT International Publication No. WO 2012/058641 on May 3, 2012 and republished on Jul. 5, 2012, and is incorporated herein by reference in its entirety.
- This application is related to U.S. patent application Ser. No. 12/826,375 filed on Jun. 29, 2010, incorporated herein by reference in its entirety, which claims priority from, and is a 35 U.S.C. §111(a) continuation of, PCT international application number PCT/US2008/088646 filed on Dec. 31, 2008, incorporated herein by reference in its entirety, which claims priority from U.S. provisional application Ser. No. 61/018,537 filed on Jan. 2, 2008, incorporated herein by reference in its entirety.
- This application is also related to PCT International Publication No. WO 2009/088930 published on Jul. 16, 2009, incorporated herein by reference in its entirety.
- Not Applicable
- Not Applicable
- A portion of the material in this patent document is subject to copyright protection under the copyright laws of the United States and of other countries. The owner of the copyright rights has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the United States Patent and Trademark Office publicly available file or records, but otherwise reserves all copyright rights whatsoever. The copyright owner does not hereby waive any of its rights to have this patent document maintained in secrecy, including without limitation its rights pursuant to 37 C.F.R. §1.14.
- 1. Field of the Invention
- This invention pertains generally to imaging devices, and more particularly to devices and methods for enhanced imaging with mobile electronics devices.
- 2. Description of Related Art
- Handheld mobile devices, such as cellular phones, tablets, PDA's, etc., are becoming increasingly useful for imaging due to their ready availability to communicate with other devices wirelessly. However, the cameras and illumination sources included with most mobile electronic devices are primitive with respect to the type of imaging that may be required for special surfaces such as a patient's skin or body passage.
- Many common medical tests may be performed using telemedicine, but stand-alone devices used by physicians are often too expensive or specialized to appeal to consumers.
- Accordingly, an object of the present invention is an apparatus that allows mobile devices to perform as enhanced camera's and telemedicine tools, utilizing their familiar interface and ease of image capture and transmission. At least some of these objectives will be met in the description below.
- The present invention is an improved system and method for enhanced imaging using wireless transmission devices with a camera (such as a mobile phone) combined with an optical attachment. Images can be viewed and analyzed on the mobile device, or transmitted to another location/device for analysis by a person or software. The results may be used to provide diagnosis, or for a variety of other applications including image comparison over time and product recommendations.
- One aspect of the invention is an imaging apparatus for a portable wireless device having a built-in camera. The apparatus includes a releasable optical assembly having a housing comprising an attachment surface for releasably coupling the releasable optical assembly to the portable wireless device, and an optical transmission element. The optical transmission element is configured to enhance an image taken by the built-in camera prior to the image being received the portable wireless device.
- Another aspect is a system for enhancing and post-processing images obtained from a portable wireless device having a built-in camera, comprising: a releasable optical assembly, comprising: a housing comprising an attachment surface for releasably coupling the releasable optical assembly to the portable wireless device, and an optical transmission element. The optical transmission element is configured to enhance an image taken by the built-in camera prior to the image being received the portable wireless device. The system further comprises programming executable on said wireless device or other external device for receiving the enhanced image and post processing the enhanced image.
- Further aspects of the invention will be brought out in the following portions of the specification, wherein the detailed description is for the purpose of fully disclosing preferred embodiments of the invention without placing limitations thereon.
- The invention will be more fully understood by reference to the following drawings which are for illustrative purposes only:
-
FIG. 1A is a view of the imaging apparatus of the present invention positioned adjacent mobile device. -
FIG. 1B shows the imaging apparatus ofFIG. 1A installed on a mobile device in accordance with the present invention. -
FIG. 2 shows a view of the rear side of the imaging apparatus ofFIG. 1A . -
FIG. 3 shows the imaging apparatus ofFIG. 1A installed on a mobile device in accordance with the present invention, with outer speculum removed for clarity. -
FIG. 4 shows a cross-sectional view of the imaging apparatus ofFIG. 1A installed on a mobile device in accordance with the present invention. -
FIG. 5 shows an alternative imaging apparatus in accordance with the present invention. -
FIG. 6 shows the imaging apparatus ofFIG. 5 with the diffuser removed for clarity. -
FIG. 7 shows a rear view of the housing of the imaging apparatus ofFIG. 4 . -
FIG. 8 shows a cross-sectional view of the imaging apparatus ofFIG. 5 installed on a mobile device in accordance with the present invention. -
FIG. 9 shows the imaging apparatus ofFIG. 5 with calibration module in accordance with the present invention. -
FIGS. 10A and 10B show perspective and plan views, respectively, of an exposure calibration tool according to the present invention. -
FIG. 11 shows a perspective view of a focus calibration tool according to the present invention. -
FIG. 12A illustrates a side view of an embodiment for coupling the optical attachment of the present invention. -
FIG. 12B illustrates a plan view of an alternative embodiment for coupling for the optical attachment of the present invention. -
FIG. 13 shows a side view of an embodiment of a modular imaging system comprising components for imaging and illumination according to the invention. -
FIG. 14 shows embodiments of a modular attachment system according to the present invention. -
FIG. 15 shows a method for two-way optical data transmission from a mobile device according to the present invention. -
FIG. 16 shows a flow diagram of the image normalization step ofFIG. 15 . -
FIG. 17 shows a flow diagram of the image analysis step ofFIG. 15 . - Referring more particularly to the figures, the present invention can be embodied in various ways.
-
FIG. 1A illustrates a perspective view of animaging apparatus 10 positioned adjacent handheld mobileelectronic device 12.Mobile device 12 is illustrated as an iPhone 4 in the various figures depicted herein. However, it is appreciatedmobile device 12 may be any wireless-enabled device having a camera, i.e.mobile device 12 may comprise any number of possible makes of cellular phones, PDA's, tablets, etc. -
FIG. 1B shows theimaging apparatus 10 installed on themobile device 12 in accordance with the present invention.Imaging apparatus 10 includes one or more optical transmission elements (e.g. lens, fiber optics, etc.) that are configured to enhance an image received by acamera 22 ofdevice 12 prior to that image being received by thecamera 22 CCD (not shown). The optical transmission elements may provide magnification and/or improved illumination to the imaged target, in addition to other imaging enhancements. -
Imaging apparatus 10 includes abase member 14 that can be coupled to themobile device 12.FIGS. 1A and 1B illustrate “clip-on” coupling means orsurface 20, although other removable means such as slide-on, snap-on, or adhesives/adhesive backings are also contemplated. Whilebase member 14 is shown in the current figures as a partial cover of themobile device 12,base member 14 may also comprise a full case or cover (i.e. extending along the length of phone 12) that covers one or more surfaces, and releasably couples to themobile device 12. -
FIGS. 1A and 1B show a releasableoptical assembly 16 attached tobase 14. The releasableoptical assembly 16 comprises acylindrical housing 40 and a conical-shapedspeculum 18.Speculum 18 is shown sized and shaped for ear drum imaging as an otoscope. Thespeculum 18 is one of many different optical attachments that may be used to interface theimaging apparatus 10 with varying anatomical features. In particular,speculum 18 may be sized and shaped for proper interface with various body cavities, including nasal, oral, vaginal, and anal cavities, etc.Speculum 18 is configured for quick release attachment tohousing 40. As shown inFIG. 4 , thespeculum 18 is shown with a contact fit overhousing 40. However, other attachment means, e.g. mating threads, clips, snaps, tab-and-grooves, etc., may also be used. - Accordingly, the
base member 14 also includes means (not shown) for coupling the releasableoptical assembly 16 to thebase member 14, such as clip-on, snap-on, slide-on, twist-on, and other conventional means for attachment. For example the releasableoptical assembly 16 may have pins that line up with and snap into one or more corresponding slots in the base member, or vise versa. -
FIG. 2 shows a view of the rear side of theimaging apparatus 10 andbase 14.Base 14 comprises clip-onwalls 20 that help retain the base 14 on to themobile device 12. Thebase 14 comprises anillumination port 34 configured to align with the phone'sLED flash 24 to allow illuminated light to pass through the case and into the releasableoptical assembly 16. The base 14 also comprises and animaging port 32 allowing line of sight for the phone'scamera 22 from the releasableoptical assembly 16. -
FIG. 3 shows theimaging apparatus 10 installed on amobile device 12 withouter speculum attachment 18 removed for clarity. Anoptical tube 56 is centered within the housing opening and has atube aperture 58 configured to line up with theimaging port 32 of thebase 14. -
FIG. 4 shows a cross-sectional view of theimaging apparatus 10 installed onmobile device 12. Theback wall 68 of thehousing 40 comprises animaging opening 42 that is configured to line up withoptical tube 56,imaging port 32 andcamera 22.Optical tube 56 may be an integral member withhousing 40, or attached to thehousing 40. Theimaging port 32 andopening 42 provide an optical path for imaging. A lens 62 (or series of lenses) is preferably disposed within theoptical tube 56, imagingopening 42 or imaging port 32 (shown in preferred configuration in imaging opening 42). Thelens 62 is preferably configured to provide magnification of the target anatomy (e.g. ear drum, etc.). In one embodiment,lens 62 comprises a plano-convex lens with a 48 mm focal length. It is appreciated thatlens 62 may comprise any number of differing types, (e.g. bi-convex, convex-meniscus, etc.), or any combination of lenses known in the art. - It is also appreciated that
lens 62 may comprise micro-lens array (e.g. - two or more lenses space apart in a planar array) in place of a single lens. Light passes through normal to the 2D array (not shown). Each lens element in the array has a shorter focal length/higher magnification than the larger lenses (e.g., the 48 mm f lens in the otoscope), so the design can be much more compact. Due to the space in between the array elements, the array can be scanned to capture the individual images, which are then assembled into a unified image of the field without gaps. This allows for a high magnification system in a much smaller form factor.
- The
imaging apparatus 10 preferably comprises means for directing the light from the phone'sLED flash 24 to provide improved illumination. Use of just theLED flash 24 to illuminate the anatomical target (e.g. ear drum) directly would lead to shadows from theoptical tube 56. Illumination with the fiber optics may be used to eliminate shadows. The light can be directed to provide on-axis illumination, as well as oblique or off-axis illumination for better contrast for some applications. - The
back wall 68 of thehousing 40 further comprises anillumination opening 44 that is configured to line up with afiber optic bundle 50 a,illumination port 34 andflash 24.Fiber optic bundle 50 a generally comprises one or more optical fibers, configured with end glow or side glow characteristics to suit the particular application or anatomy being imaged. - In a preferred embodiment, the
fiber optic bundle 50 a connects at one end to theillumination opening 44 and wraps and extends tooptical tube 56, withoptical fibers 50 extending axially aroundoptical tube 56 to form a coaxial layer at least partially surrounding the optical tube. The individualoptical fibers 50 preferably form a continuous layer aroundtube 56. However it is appreciated that the optical fibers may also surround the tube at spaced intervals.Optical fibers 50 extend at least a portion of the length oftube 56 such that the end of the optical fibers are aligned in the direction of thetube 56 axis and preferably near the free end of thetube 56. Optical fibers are held in place ontube 56 via an adhesive,band 47, or like attachment means. Thebundle 50 a andfibers 50 are configured to propagate light from flash 24 (e.g. LED or the like) and direct it toward the free end of theoptical tube 56 and in the direction ofspeculum 18. Theoptical fibers 50 arrayed around the end of thetube 56 provide a more uniform ring of illumination in the direction of the target anatomy. Such directed light is particularly useful for viewing/imaging cavities in the body such as the ear or mouth, where light is limited. - The imaging apparatus is configured such that when
base member 14 and releasableoptical assembly 16 are attached todevice 12, all optical apertures (speculum aperture 19,optical tube aperture 58,optical opening 42, and optical port 32) are in substantially concentric alignment withcamera 22, and correspondingly, all illumination apertures (illumination opening 44, illumination port 34) are all in substantially concentric alignment withflash 24. - In a preferred embodiment, the
optical assembly 16 may also contain one or more filters in the illumination path to improve the illumination of the target anatomy. The filters may be positioned in fixed or adjustable configuration at or between one or more structures of theimaging apparatus 10. A sliding color spectrum filter may also be positioned in the path of theLED flash 24 to enable selective color illumination for spectrophotometric applications. - In one embodiment, the filters may comprise one or more of polarizing filters, neutral density filters, or diffusers, or the like. For example, one or more polarizing filters can be used to reduce glare and/or shadows, in addition to controlling illumination intensity and uniformity. Thus, filters may be used to control the intensity and pattern of illumination based on the phone's LED flash 24 (or an integrated light source as provided in
FIG. 12 , described in further detail below), and/or to reduce glare for imaging a reflective sample (such as like oily skin). With use of variable filters, the intensity of sample illumination can be adjusted without changing the output provided by thedevice LED 24. For the iPhone for example, theLED flash 24 is either on or off when no software support for adjustable intensity is provided, making exposure difficult in some applications. - In one example of a tunable illumination system illustrated in
FIG. 4 , twopolarizing filters handset LED 24 and the illuminated anatomical target. Referring further toFIG. 7 , thefirst filter 52 is fixed and disposed within a rectangular counter bore 46 set into therear wall 68 ofhousing 40. Thesecond filter 54 is set into a circular counter bore 48 inhousing 40, and is configured to be rotated with use oflever 66 to modulate the intensity of the light transmitted to the sample anatomy. It is appreciated that thefilters base 14. The intensity of the transmitted light is controlled by the relative orientation of thefilters - A spectral selection tool may also be included for controlling illumination wavelength. A slider (or color wheel, etc., not shown) containing color filters may provide for specific wavelengths to be chosen from the
LED 24 illumination. This enables comparison of images taken with different colors to look for absorption differences. This is useful in skin imaging, for example. - The
optical assembly 16 may also comprise one or more filters in the optical path (e.g. betweenoptical port 32 and optical opening 42). For example, one or more filters comprising a polarizer, neutral density filter, or spectral selection filter may be positioned in the optical path using a system similar to the illumination filters 52, 54 ofFIG. 4 . -
Optical assembly 16 may further allow for adjustment of the optical components (e.g. lens 62). For example,optical assembly 16 may comprise a lens slider (not shown) similar toslider 66 inFIGS. 4-6 to allow for one or more lenses to be moved in and out of the optical path (lens stacking), or for lens position to be moved along the optical axis. Removing allattachment lenses 62 from the path provides the device's 12 standard imaging characteristics, while adding one ormore lenses 62 in the optical path modifies the imaging characteristics to suit the application. Thus, singleoptical assembly 16 may be configured to provide variable magnification and numerical aperture characteristics, similar to the way that many microscopes contain a turret of objectives. -
FIGS. 5-8 show animaging apparatus 25 preferably configured for use in imaging skin surfaces, and in particular, non-cavity-type skin surfaces. Referring toFIG. 5 ,imaging apparatus 25 includes a releasableoptical assembly 17 attached tobase 14. The releasableoptical assembly 17 comprises an open ended housing orspacer 45 having anoptical opening 42. As shown in further detail in the cross-sectional view ofFIG. 8 , theoptical opening 42 provides an open path to theoptical port 32 ofbase 14 andcamera 22 ofdevice 12.Spacer 45 ofimaging apparatus 25 provides a set distance betweencamera 22,lens 62 and the image target. When theimaging apparatus 25 is touched to the image target (skin, hair, etc.) directly, the image target is within the focus range for thecamera 22, facilitating image collection. This distance may be adjustable (to discrete distances or continuously) to accommodate different imaging applications.Spacer 45 may also include an additional sliding tube (as provided intube 96 incalibration tool 90 shown inFIG. 11 ) to provide adjustable spacing. Thus, thespacer element 45 could be adjusted to discrete or continuous height steps to accommodate the focal length of the lens orlenses 62. -
Fiber optic bundle 50 b may be used to change the shape and/or position of thelight source 24. As shown inFIGS. 5 and 6 ,fiber optic bundle 50 b could be arrayed under adiffuser 60 to provide controlled (e.g. uniform) illumination, (FIG. 6 shows the diffuser removed for clarity). Referring now to the cross-sectional view ofFIG. 8 , thefiber optic bundle 50 b is disposed withinillumination opening 44 of thehousing 45, such that thefiber optic bundle 50 b is in line withillumination port 34 of thebase 14 andLED 24 ofdevice 12. Similar toapparatus 16 shown inFIGS. 1-4, and 7 , theoptical attachment assembly 17 may also comprisefilters bores housing 45 to provide additional illumination filtering. -
FIG. 9 shows theimaging apparatus 27 similar toimaging apparatus 25 ofFIGS. 5-6 , withcalibration module 70 disposed on spaced 45.Calibration module 70 comprises a test pattern feature 72 which appears in a portion of the image field of view to enable calibration of color, white balance, exposure, and size. In one embodiment, black, white, grey and color patches with known color values on the calibration pattern serve as a reference for post-processing of the image. The test pattern also provides an exposure reference (based on the appearance of the black patches in the image) and a size scale due to the known size of the pattern elements. Thecalibration module 70 is instrumental in controlling imaging from adevice 12, such as a mobile phone, which was not designed to produce absolute color/exposure references. Preferably, thecalibration module 70 is integrated into theimaging apparatus 27. It is also appreciated thatcalibration module 70 may be disposed withinaperture 19 ofdisposable speculum 18 for calibratingdevice 10. - Alternatively, a reference feature may be used as an external test pattern or a common object (for example, a coin). Including a known object in the field of view enables size and color calibration of the resulting image, especially when its depth position is known or can be determined from the image. A coin held next to the earlobe can be used by software to determine (or reasonably estimate) the absolute size of the facial features.
-
FIGS. 10A through 11 illustrate focus and illumination tools for pre-capture calibration to pre-set the exposure and focus before capturing an image. -
FIGS. 10A and 10B show perspective and plan views, respectively, of anexposure calibration tool 80 according to the present invention. In the otoscope application, for example, the camera's 22 exposure setting may use a larger region of interest (ROI) than the actual image region at the end of the tip ofspeculum 18. In that case it is useful to set the exposure relative to a brighter image in the smaller field at the end of the tip, to compensate for the mismatch with the camera's 12 ROI.Exposure calibration tool 80 comprises a stepped platform 82 a distance h from alower platform 84. The steppedplatform 82 has large 86 and small 88 dark apertures, and thelower platform 84 correspondingly comprises large 76 and small 78 lighter apertures. Exposure calibration is performed by insertingimaging apparatus 10, 25 (e.g. otoscope tip 18) at theparticular apertures platform 82 provides a sharp image at a known distance to pre-set focus, thelower platform 84 is bright (e.g. with matte aluminum foil or like material, or adjustable to material with a range of known reflectance values) to pre-set the exposure. - It is also useful to preset the focus so that the
camera 22 is focused on a known distance before imaging a delicate area of anatomy, such as a patient's eardrum.FIG. 11 shows a perspective view of afocus calibration tool 90 having a base 92 and slidingtube 96 disposed withinbase tube 94. The sliding tube adjusts to various heights H by sliding within base tube height to allow for a range of focal distance pre-sets. The calibration tool comprises anillumination opening 95 andimaging aperture 98. - The
tools FIGS. 10A through 11 ) or integrated within the imaging device (e.g. calibration module 70 indevice 27FIG. 9 ). The calibration tool may be adjustable to allow for a range of focal distances (as shown), or use a color wheel or other means to adjust the exposure calibration area -
FIGS. 12A through 13 illustrate different attachment means according to the present invention. -
FIG. 12 A illustrates a side view attachment means coupling animaging apparatus 104 via manually positioning and affixing theimaging apparatus 104 with a ring 108 (which may be replaceable).Ring 108 may comprise adhesive tape, hook-and-loop closure or magnet to releasably attach to the phone. -
FIG. 12B illustrates a plan view of an alternative embodiment forcoupling assembly 100.Coupling assembly 100 comprises spring-loadedpincher attachment 102 that is configured to be silideably positioned in the vertical direction.Coupling assembly 100 further comprises arectangular slot 106 that allows theimaging assembly 104 to be adjusted in the horizontal direction to coincide with thephone 12camera 22 andflash 24. -
FIG. 13 illustratesmodular imaging system 120 comprising separated components for imaging and illumination. Theflexible fiber bundle 124 is attached to theoptical cone 122, such that thefiber bundle 124 can be bent to accommodate a variety ofcamera 22 and LED/flash 24 positions on themobile device 12 orcase 14 provided with the device. Thesystem 120 is shown in the otoscope-type configuration 10 ofFIGS. 1-4 , with acone 122 to which disposable specula can be attached. The same modular approach may also be applied to theapparatus 25 ofFIGS. 5-6 . -
FIG. 14 shows amodular attachment system 150 having independentlight source 162.System 150 may comprise adisposable speculum 152 that tapers toward its tapered free end, and havingtabs 164 at its proximal end for attachment to slot 166 inhousing 168. Aseparate attachment cone 154 may also be included, and haveslot 166 for attaching tohousing 168. Anoptical tube 156 containing one ormore lenses 62 is provided withinhousing 168, and is wrapped infiber optics 158 for illumination. Thefiber bundle 158 can draw light from the phone'sLED flash 24, an externallight source 162 by means ofelongate tube 160. - The image enhancement systems shown in
FIGS. 1-14 may be used not only for capturing enhanced digital images and video, but also as a real-time scope for viewing patient anatomy. For example, one could be treating the integratedmobile device 12 as an otoscope for display on the mobile device's screen. At any time, an image capture or video may also be initiated to store the image or video in memory, and transmit the image or video if necessary. -
FIGS. 15 through 17 illustrate a system and method for post processing an image captured from amobile device 12. While it is preferred that software for carrying outmethod 200 be used in conjunction with the image enhancement apparatus disclosed inFIGS. 1 through 14 , it is appreciated that the methods disclosed inFIGS. 15 through 17 may be used for any mobile device, webcam, or camera directly, with or without the image enhancement apparatus disclosed inFIGS. 1 through 14 . Accordingly, a preferred embodiment of the present invention is a system comprising one or more of the enhancement apparatus disclosed inFIGS. 1 through 14 , along with software using methods and algorithms embodied inFIGS. 15 through 17 . -
FIG. 15 shows amethod 200 for two-way optical data transmission from a mobile device, which allows the user to point theimaging apparatus imaging system Method 200 may be implemented within a software module or application for execution on a processor of the wireless device, as well as applications for execution on the secondary device such as a computer. - As shown in
FIG. 15 , a first step in themethod 200 is calibration of thecamera 22 atblock 202. Next an image is captured atblock 204 and transmitted to secondary device atblock 206. Image normalization is then performed atblock 208, and image analysis and/or diagnosis is performed atstep 210. Captured images may be transmitted for analysis by software algorithms or a person for a range of applications including diagnosis, monitoring and product recommendations. - While image transmission step may be desirable to perform calculation intensive tasks such as
image normalization step 208 and image analysis/diagnosis step 210 on a computer or other device configured to quickly perform such calculations, is appreciated thattransmission step 206 is optional, and that one or both of theimage normalization step 208 and image analysis/diagnosis step 210 may be performed using software and programming on themobile device 12. -
FIG. 16 illustrates in further detail theimage normalization step 208 ofmethod 200. First, exposure and focus sharpness ofimage 212 is calculated with a known feature atstem 214. If the calculation returns non-acceptable results atevaluation step 218, thedevice 12 is prompted for another image to be captured atstep 216. If the calculation returns non-acceptable results atevaluation step 218, the reference data from image is used atstep 220. The image is then adjusted atstep 220 to generate the normalizedimage 222. -
Image normalization step 208 has the capability to normalize the image based on test pattern portion of theimage 212 as an application loaded as either on-board software on themobile device 12, or by uploading theimage 212 for server-side processing. Thenormalization step 208, which may comprise white balance, exposure, focus, etc., may be based on theimaging apparatus 10 integrated test pattern (e.g. calibration module 70), or on another known standard. The orientation of theimage 212 may also be adjusted instep 210 using reference features in the image 212 (e.g. in the case of ear drum imaging, adjusting the rotation of the image based on the “cone of light” feature of the ear drum), or using on-board sensors withindevice 12 such as the accelerometer or gyroscope. This is a significant advantage in ear drum imaging, for example, where the doctor is used to a certain orientation but the imaging device may produce a rotated view.Normalization step 208 can identify corresponding features from two images to determine whether they have overlapping areas. This too can be improved by adding in accelerometer/gyroscope data, so that the overlap detection is based on images with the same orientation (this compensates for a rotation difference between the two images). - Normalization data may also be used to override the
camera 22 automatic focus and exposure settings so as not to interfere with the acquired calibrated settings. -
FIG. 17 illustrates in further detail the image analysis and/ ordiagnosis step 210 ofmethod 200.Diagnosis step 210 provides image processing (either via executing an application on-board the phone/device 12 or uploaded for server-side processing) to analyze images for features of interest, such as skin image analysis for wrinkles, lines, redness, blood vessels, dryness, coloration, UV damage and roughness. Atstep 234, the normalizedimage 222, similar image characteristics (e.g. skin type) identified fromother users 230 and other image data and results from image analysis or other users are input. Data from 230 and 232 may comprise a database of images and associated data. Atstep 236 the normalizeddata 222 is compared with data from past images or other user data to arrive at resultingimage 238. - Software loaded on the
mobile device 12 or secondary device may use theresults 238 of image analysis to provide recommendations and/or targeted ads to user. In the case of skin care, image analysis provides data on skin type and condition (e.g. Fitzpatrick type, oily/dry/combination, UV damage, wrinkles, etc) and the user is provided with targeted product recommendations. The software also allows users to track images over time to monitor changes, results of product usage, etc. Recommendations and ads can be based on aggregated data from users from a similar class (e.g. with similar skin types). For example, image analysis (from the magnifiedimaging system - For skin imaging of the face, which can be difficult to self-take, the
method 200 and associated software have the capability to transmit the image in real time for display on the secondary device (e.g., another phone or computer via the device application or website). The communication can be two-way, so that the imaging system functions (focus, exposure, image capture, etc.) can be controlled from the second device. -
Images 204 may be tagged with GPS and/or time/date stamp information, which can be used to authenticate the user or perform geographical meta-analysis of results. - Video may also be captured by on the
device 12, and analyzed bymethod 200 using software on the device or server-side to identify key frames or to generate an enhanced single frame. For example, in the ear exam application, the software may identify the best frame to present to the physician by using a standard sharpness detection algorithm to find the frame with the sharpest cone of light (bright reflection off the ear drum with a defined border). This video could be taken while moving the device around, or while adjusting the focal distance (such as running the camera's 12 autofocus function). Video during autofocus provides a set of frames that are focused on a series of focal distance planes. This may then be used to identify the best frame, or to provide something analogous to the 3D image reconstruction done with a confocal microscope image stack. - It is also appreciated that the optical enhancement systems of
FIGS. 1-14 and image processing methods ofFIGS. 15-17 may also be useful with 3D stereo cameras now available on some phones). Stereo images may be used help in skin imaging, for example to measure the depth of wrinkles or the height of a mole. - Embodiments of the present invention may be described with reference to flowchart illustrations of methods and systems according to embodiments of the invention, and/or algorithms, formulae, or other computational depictions, which may also be implemented as computer program products. In this regard, each block or step of a flowchart, and combinations of blocks (and/or steps) in a flowchart, algorithm, formula, or computational depiction can be implemented by various means, such as hardware, firmware, and/or software including one or more computer program instructions embodied in computer-readable program code logic. As will be appreciated, any such computer program instructions may be loaded onto a computer, including without limitation a general purpose computer or special purpose computer, or other programmable processing apparatus to produce a machine, such that the computer program instructions which execute on the computer or other programmable processing apparatus create means for implementing the functions specified in the block(s) of the flowchart(s).
- Accordingly, blocks of the flowcharts, algorithms, formulae, or computational depictions support combinations of means for performing the specified functions, combinations of steps for performing the specified functions, and computer program instructions, such as embodied in computer-readable program code logic means, for performing the specified functions. It will also be understood that each block of the flowchart illustrations, algorithms, formulae, or computational depictions and combinations thereof described herein, can be implemented by special purpose hardware-based computer systems which perform the specified functions or steps, or combinations of special purpose hardware and computer-readable program code logic means.
- Furthermore, these computer program instructions, such as embodied in computer-readable program code logic, may also be stored in a computer-readable memory that can direct a computer or other programmable processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the block(s) of the flowchart(s). The computer program instructions may also be loaded onto a computer or other programmable processing apparatus to cause a series of operational steps to be performed on the computer or other programmable processing apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable processing apparatus provide steps for implementing the functions specified in the block(s) of the flowchart(s), algorithm(s), formula(e), or computational depiction(s).
- From the discussion above it will be appreciated that the invention can be embodied in various ways, including the following:
-
- 1. An imaging apparatus for a portable wireless device having a built-in camera, comprising: a releasable optical assembly, comprising: a housing; the housing comprising an attachment surface for releasably coupling the releasable optical assembly to the portable wireless device; and an optical transmission element; wherein the optical transmission element is configured to enhance an image taken by the built-in camera prior to the image being received the portable wireless device.
- 2. The apparatus of
embodiment 1, wherein the optical transmission element comprises a first optical transmission element configured to magnify the image. - 3. The apparatus of embodiment 2, wherein the optical transmission element comprises a second optical transmission element configured to enhance illumination of the image.
- 4. The apparatus of embodiment 3: wherein the first optical transmission element comprises a lens; the housing configured to house the lens in an alignment within an optical path of the built-in camera.
- 5. The apparatus of embodiment 4: the portable wireless device further comprising an illumination source; wherein the second optical transmission element comprises an optical fiber; the housing configured to house the optical fiber in an alignment within the illumination path of the illumination source; and wherein the optical fiber is configured to alter the illumination path to enhance illumination of the image.
- 6. The apparatus of embodiment 5: the releasable optical assembly further comprising one or more optical filters coupled to the housing; and the housing configured to house the one or more optical filters in an alignment within the one or more of the illumination path or optical path.
- 7. The apparatus of embodiment 6, wherein the one or more optical filters comprises a filter comprising one or more of a: polarizer, neutral density filter, or spectral selection filter.
- 8. The apparatus of embodiment 6, wherein the one or more optical filters comprises: a first filter having a fixed orientation; a second filter having a variable orientation to allow for adjustment of transmission of light; wherein the first and second filters are stacked in series in one or more of the illumination path and optical path.
- 9. The apparatus of embodiment 5: wherein the housing further comprises an optical tube; the optical tube having a central aperture; the optical tube being attached to the housing such that the central aperture is aligned with the optical path when the releasable optical assembly is attached to the portable wireless device; wherein the optical tube comprises a free end extending away from the housing and built-in-camera; wherein the optical fiber comprises one of a bundle of optical fibers; the bundle of optical fibers extending from a location at or near the illumination source to the optical tube wherein the optical fibers extend axially along the optical tube toward the free end of the tube to form a coaxial layer at least partially surrounding the optical tube; and wherein the optical fibers are configured to propagate light from the illumination source in the direction of the free end of the optical tube.
- 10. The apparatus of embodiment 9, further comprising: a speculum configured to interface with a body cavity of a patient; the speculum having a proximal end and distal free end; said speculum comprising a conical shape that tapers from the proximal end to the free end; the proximal end of the speculum configured to releasably attach to the housing; said distal end of the speculum having an aperture configured to concentrically align with the optical tube when the speculum is attached to the housing.
- 11. The apparatus of embodiment 5: wherein the housing comprises a cylindrical tube having a proximal end comprising the attachment surface; the cylindrical tube having an open distal end extending away from said portable wireless device when the imaging apparatus is attached to said portable wireless device; wherein the cylindrical tube has a predetermined length corresponding to an optical characteristic of said lens and said built in camera; and wherein the open distal end of the cylindrical body is configured to be positioned to contact a surface of a patient's skin to facilitate imaging of said skin surface.
- 12. The apparatus of embodiment 11: wherein the optical fiber comprises one of a bundle of optical fibers; further comprising a diffuser disposed between the optical fibers and the open distal end of the cylindrical tube; and wherein the diffuser is configured to diffuse light propagated through the bundle of optical fibers.
- 13. The apparatus of embodiment 5, further comprising: a calibration module attached to said housing; the calibration module being disposed in a field of view of the optical path to provide calibration of the built in camera.
- 14. The apparatus of
embodiment 1, further comprising: a base member; wherein the base member comprises an attachment surface for coupling the base member to the wireless device; wherein the base member is configured to releasably attach to the housing; and wherein the base member comprises at least one aperture aligned with the illumination path and optical path for imaging and illumination through the housing. - 15. A system for enhancing and post-processing images obtained from a portable wireless device having a built-in camera, comprising: a releasable optical assembly, comprising: a housing; the housing comprising an attachment surface for releasably coupling the releasable optical assembly to the portable wireless device; an optical transmission element; wherein the optical transmission element is configured to enhance an image taken by the built-in camera prior to the image being received the portable wireless device; programming executable on said wireless device or other external device for: receiving the enhanced image; post processing the enhanced image.
- 16. The system of embodiment 15, wherein post processing comprises image normalization.
- 17. The system of
embodiment 16, wherein image normalization comprises: calculating one or more of exposure and focus characteristics with a known feature; and adjusting the image based on reference data from the image. - 18. The system of
embodiment 16, wherein said programming is further configured for calibrating said built in camera as a function of optical characteristics releasable optical assembly. - 19. The system of
embodiment 17, wherein said programming is further configured for: inputting data from the normalized image along with other image data; and comparing the data from the normalized image with the other image data to analyze said image. - 20. The system of
embodiment 19, wherein the other image data comprises images from similar images to the normalized image. - 21. The system of
embodiment 20, wherein the normalized image comprises an image of a person's skin; and wherein the other image data comprises skin images from patients having similar skin characteristics. - 22. The system of
embodiment 19, wherein said programming is further configured for: transmitting said image to a secondary device to perform post processing. - 23. The system of embodiment 15, wherein the optical transmission element comprises a first optical transmission element configured to magnify the image and a second optical transmission element configured to enhance illumination of the image.
- 24. The system of embodiment 23: wherein the first optical transmission element comprises a lens; the housing configured to house the lens in an alignment within an optical path of the built-in camera; the portable wireless device further comprising an illumination source; wherein the second optical transmission element comprises an optical fiber; the housing configured to house the optical fiber in an alignment within the illumination path of the illumination source; and wherein the optical fiber is configured to alter the illumination path to enhance illumination of the image.
- 25. The system of embodiment 24: the releasable optical assembly further comprising one or more optical filters coupled to the housing; and the housing configured to house the one or more optical filters in an alignment within the one or more of the illumination path or optical path.
- 26. The system of
embodiment 25, wherein the one or more optical filters comprises a filter comprising one or more of a: polarizer, neutral density filter, or spectral selection filter. - 27. The system of embodiment 24: wherein the housing further comprises an optical tube; the optical tube having a central aperture; the optical tube being attached to the housing such that the central aperture is aligned with the optical path when the releasable optical assembly is attached to the portable wireless device; wherein the optical tube comprises a free end extending away from the housing and built-in-camera; wherein the optical fiber comprises one of a bundle of optical fibers; the bundle of optical fibers extending from a location at or near the illumination source to the optical tube wherein the optical fibers extend axially along the optical tube toward the free end of the tube to form a coaxial layer at least partially surrounding the optical tube; and wherein the optical fibers are configured to propagate light from the illumination source in the direction of the free end of the optical tube.
- 28. The system of
embodiment 27, further comprising: a speculum configured to interface with a body cavity of a patient; the speculum having a proximal end and distal free end; said speculum comprising a conical shape that tapers from the proximal end to the free end; the proximal end of the speculum configured to releasably attach to the housing; said distal end of the speculum having an aperture configured to concentrically align with the optical tube when the speculum is attached to the housing. - 29. The system of embodiment 24: wherein the housing comprises a cylindrical tube having a proximal end comprising the attachment surface; the cylindrical tube having an open distal end extending away from said portable wireless device when the imaging apparatus is attached to said portable wireless device; wherein the cylindrical tube has a predetermined length corresponding to an optical characteristic of said lens and said built in camera; and wherein the open distal end of the cylindrical body is configured to be positioned to contact a surface of a patient's skin to facilitate imaging of said skin surface.
- 30. A method for enhancing and post-processing images obtained from a portable wireless device having a built-in camera, comprising: receiving an image from a built-in camera of a portable wireless device; wherein the portable wireless device comprises a releasable optical assembly releasably disposed within a field of view of the built-in camera; wherein the releasable optical assembly comprises an optical transmission element configured to enhance the image prior to the image being received by the portable wireless device; and post processing the enhanced image.
- 31. The method of embodiment 30, further comprising: transmitting the enhanced image to a secondary device for post processing.
- 32. The method of embodiment 30, wherein post processing comprises normalizing the image.
- 33. The method of
embodiment 32, wherein normalizing the image comprises: calculating one or more of exposure and focus characteristics with a known feature; and adjusting the image based on reference data from the image. - 34. The method of embodiment 30, further comprising: calibrating said built in camera as a function of optical characteristics releasable optical assembly.
- 35. The method of embodiment 33, further comprising: inputting data from the normalized image along with other image data; and comparing the data from the normalized image with the other image data to analyze said image.
- 36. The method of embodiment 35, wherein the other image data comprises images from similar images to the normalized image.
- 37. The method of embodiment 35, wherein the normalized image comprises an image of a person's skin; and wherein the other image data comprises skin images from patients having similar skin characteristics.
- 38. The method of embodiment 30, wherein the optical transmission element comprises a first optical transmission element configured to magnify the image and a second optical transmission element configured to enhance illumination of the image. Although the description above contains many details, these should not be construed as limiting the scope of the invention but as merely providing illustrations of some of the presently preferred embodiments of this invention.
- Therefore, it will be appreciated that the scope of the present invention fully encompasses other embodiments which may become obvious to those skilled in the art, and that the scope of the present invention is accordingly to be limited by nothing other than the appended claims, in which reference to an element in the singular is not intended to mean “one and only one” unless explicitly so stated, but rather “one or more.” All structural, chemical, and functional equivalents to the elements of the above-described preferred embodiment that are known to those of ordinary skill in the art are expressly incorporated herein by reference and are intended to be encompassed by the present claims. Moreover, it is not necessary for a device or method to address each and every problem sought to be solved by the present invention, for it to be encompassed by the present claims. Furthermore, no element, component, or method step in the present disclosure is intended to be dedicated to the public regardless of whether the element, component, or method step is explicitly recited in the claims. No claim element herein is to be construed as a “means plus function” element unless the element is expressly recited using the phrase “means for”. No claim element herein is to be construed as a “step plus function” element unless the element is expressly recited using the phrase “step for”.
Claims (1)
1. An imaging apparatus for a portable wireless device having a built-in camera, comprising:
a releasable optical assembly, comprising:
a housing;
the housing comprising an attachment surface for releasably coupling the releasable optical assembly to the portable wireless device; and
an optical transmission element;
wherein the optical transmission element is configured to enhance an image taken by the built-in camera prior to the image being received the portable wireless device.
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/052,347 US20160248951A1 (en) | 2008-01-02 | 2016-02-24 | Cellscope apparatus and methods for imaging |
US15/403,874 US10616457B2 (en) | 2008-01-02 | 2017-01-11 | Cellscope apparatus and methods for imaging |
US16/810,805 US20200336630A1 (en) | 2010-10-29 | 2020-03-05 | Cellscope apparatus and methods for imaging |
Applications Claiming Priority (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US1853708P | 2008-01-02 | 2008-01-02 | |
US12/826,375 US8743194B2 (en) | 2008-01-02 | 2010-06-29 | High numerical aperture telemicroscopy apparatus |
US40856810P | 2010-10-29 | 2010-10-29 | |
US201161532617P | 2011-09-09 | 2011-09-09 | |
PCT/US2011/058466 WO2012058641A2 (en) | 2010-10-29 | 2011-10-28 | Cellscope apparatus and methods for imaging |
US13/855,501 US9325884B2 (en) | 2008-01-02 | 2013-04-02 | Cellscope apparatus and methods for imaging |
US15/052,347 US20160248951A1 (en) | 2008-01-02 | 2016-02-24 | Cellscope apparatus and methods for imaging |
Related Parent Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/855,501 Continuation US9325884B2 (en) | 2008-01-02 | 2013-04-02 | Cellscope apparatus and methods for imaging |
US15/403,874 Continuation US10616457B2 (en) | 2008-01-02 | 2017-01-11 | Cellscope apparatus and methods for imaging |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/403,874 Continuation US10616457B2 (en) | 2008-01-02 | 2017-01-11 | Cellscope apparatus and methods for imaging |
Publications (1)
Publication Number | Publication Date |
---|---|
US20160248951A1 true US20160248951A1 (en) | 2016-08-25 |
Family
ID=45994834
Family Applications (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/855,501 Active US9325884B2 (en) | 2008-01-02 | 2013-04-02 | Cellscope apparatus and methods for imaging |
US15/052,347 Abandoned US20160248951A1 (en) | 2008-01-02 | 2016-02-24 | Cellscope apparatus and methods for imaging |
US15/403,874 Active 2032-01-09 US10616457B2 (en) | 2008-01-02 | 2017-01-11 | Cellscope apparatus and methods for imaging |
US16/810,805 Abandoned US20200336630A1 (en) | 2010-10-29 | 2020-03-05 | Cellscope apparatus and methods for imaging |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/855,501 Active US9325884B2 (en) | 2008-01-02 | 2013-04-02 | Cellscope apparatus and methods for imaging |
Family Applications After (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/403,874 Active 2032-01-09 US10616457B2 (en) | 2008-01-02 | 2017-01-11 | Cellscope apparatus and methods for imaging |
US16/810,805 Abandoned US20200336630A1 (en) | 2010-10-29 | 2020-03-05 | Cellscope apparatus and methods for imaging |
Country Status (4)
Country | Link |
---|---|
US (4) | US9325884B2 (en) |
EP (1) | EP2633678A4 (en) |
CN (1) | CN103181154A (en) |
WO (1) | WO2012058641A2 (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160012269A1 (en) * | 2014-07-08 | 2016-01-14 | Padloc Inc. | Imaging and Peripheral Enhancements for Mobile Devices |
US20170032206A1 (en) * | 2015-07-30 | 2017-02-02 | Fuji Xerox Co., Ltd. | Unit for photographing and photographing system |
US20170371128A1 (en) * | 2016-06-27 | 2017-12-28 | Ming-Jui LI | Disposable lens applied to electronic operation device for recognition |
KR20180109420A (en) * | 2017-03-28 | 2018-10-08 | (주)시원광기술 | Illumination guide, lens module with the same, and device for observing subject using mobile phone camera with the lens module |
US10495568B2 (en) | 2017-04-28 | 2019-12-03 | The Royal Institution For The Advancement Of Learning/Mcgill University | Apparatus for analyzing a sample of granular material |
EP3970601A1 (en) * | 2020-09-21 | 2022-03-23 | Pukyong National University Industry - University Cooperation Foundation | Mobile colposcopy device for early diagnosis of cervical cancer |
EP4276529A4 (en) * | 2021-01-05 | 2024-03-20 | IT Access Co., Ltd | Imaging assistance tool and skin imaging device |
Families Citing this family (128)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2009088930A2 (en) | 2008-01-02 | 2009-07-16 | The Regents Of The University Of California | High numerical aperture telemicroscopy apparatus |
GB0802290D0 (en) * | 2008-02-08 | 2008-03-12 | Univ Kent Canterbury | Camera adapter based optical imaging apparatus |
CN103181154A (en) | 2010-10-29 | 2013-06-26 | 加利福尼亚大学董事会 | Cellscope apparatus and methods for imaging |
US8279544B1 (en) | 2011-03-18 | 2012-10-02 | Premier Systems USA, Inc | Selectively attachable and removable lenses for communication devices |
US9518929B2 (en) | 2012-05-25 | 2016-12-13 | Gemex Systems, Inc. | Engraved gemstone viewer for personal communications devices |
EP2856234A4 (en) * | 2012-05-25 | 2015-09-30 | Gemex Systems Inc | Engraved gemstone viewer for personal communications devices |
WO2014004905A1 (en) * | 2012-06-27 | 2014-01-03 | Ryan Boucher | Devices, methods and systems for acquiring medical diagnostic information and provision of telehealth services |
JP6293757B2 (en) * | 2012-08-31 | 2018-03-14 | ジェメックス システムズ,インク. | Jewel identification device using digital imaging viewer |
US9239294B2 (en) | 2012-08-31 | 2016-01-19 | Gemex Systems, Inc. | Gem identification method and apparatus using digital imaging viewer |
DE102012223691A1 (en) * | 2012-12-19 | 2014-06-26 | Heine Optotechnik Gmbh & Co Kg | Otoscope with disposable ear funnel |
JP6038341B2 (en) * | 2012-12-21 | 2016-12-07 | インテル・コーポレーション | Electronic computing device and lens apparatus |
US9565996B2 (en) | 2013-01-18 | 2017-02-14 | Ricoh Company, Ltd. | Plenoptic otoscope |
US10327627B2 (en) | 2013-01-18 | 2019-06-25 | Ricoh Company, Ltd. | Use of plenoptic otoscope data for aiding medical diagnosis |
US9294659B1 (en) * | 2013-01-25 | 2016-03-22 | The Quadrillion Group, LLC | Device and assembly for coupling an external optical component to a portable electronic device |
JP2014174185A (en) * | 2013-03-06 | 2014-09-22 | Sony Corp | Control device, control method, and imaging apparatus |
FR3004098B1 (en) * | 2013-04-09 | 2019-07-26 | Laurent Schmoll | DEVICE FOR ACQUIRING IMAGES OF A ZONE OF A HUMAN OR ANIMAL BODY |
TR201305176A2 (en) | 2013-05-02 | 2014-11-21 | Hueseyin Yetik | A system for visualizing body areas |
US20140340573A1 (en) * | 2013-05-15 | 2014-11-20 | Cassidy Clawson | Light Emitting Mobile Device Case |
EP3003124A4 (en) | 2013-05-31 | 2017-02-08 | The Board of Trustees of The Leland Stanford Junior University | Modular lens adapters for mobile anterior and posterior segment ophthalmoscopy |
US9995921B2 (en) * | 2013-06-06 | 2018-06-12 | Cell Focus, LLC | Surface adhering lens |
CN103345104B (en) * | 2013-07-08 | 2015-11-25 | 谢虹 | A kind of mobile lens amplifier |
KR101512187B1 (en) * | 2013-09-02 | 2015-04-16 | 주식회사 이스트포토닉스 | Portable Optical Jumper Cord Contamination monitoring device To monitor for Contamination of Optical Jumper Cord. |
WO2015035229A2 (en) * | 2013-09-05 | 2015-03-12 | Cellscope, Inc. | Apparatuses and methods for mobile imaging and analysis |
CN104519183A (en) * | 2013-10-08 | 2015-04-15 | 鸿富锦精密工业(深圳)有限公司 | Mobile phone |
US10028649B2 (en) * | 2013-12-02 | 2018-07-24 | Welch Allyn, Inc. | Digital colposcope system |
UA118684C2 (en) * | 2013-12-12 | 2019-02-25 | Мес Медікал Електронік Системз Лтд. | Home testing device |
US20150172522A1 (en) * | 2013-12-16 | 2015-06-18 | Olloclip, Llc | Devices and methods for close-up imaging with a mobile electronic device |
US9634759B2 (en) | 2013-12-16 | 2017-04-25 | Fluke Corporation | System and apparatus for inspecting fiber optic cables |
JP6255992B2 (en) * | 2013-12-27 | 2018-01-10 | セイコーエプソン株式会社 | Spectroscopic measurement system, spectral module, and positional deviation detection method |
CA2944384C (en) * | 2014-04-02 | 2019-06-11 | Bilibaby, Llc | System and method for determining bilirubin levels in newborn babies |
US10036881B2 (en) | 2014-05-23 | 2018-07-31 | Pathonomic | Digital microscope system for a mobile device |
CN105125170A (en) | 2014-06-05 | 2015-12-09 | 苏州速迈医疗设备有限公司 | Observation cover of dermatoscope |
TWI533025B (en) * | 2014-07-07 | 2016-05-11 | 億觀生物科技股份有限公司 | Portable microscope |
EP3160114B1 (en) | 2014-07-15 | 2018-12-19 | Huawei Technologies Co. Ltd. | Mobile terminal and camera assembly thereof |
WO2016019235A1 (en) * | 2014-07-31 | 2016-02-04 | The University Of Akron | A smartphone endoscope system |
WO2016049259A1 (en) * | 2014-09-24 | 2016-03-31 | Atkinson Don | Evaluation apparatus using uniform illumination and data capture |
US11546527B2 (en) | 2018-07-05 | 2023-01-03 | Irisvision, Inc. | Methods and apparatuses for compensating for retinitis pigmentosa |
US11372479B2 (en) | 2014-11-10 | 2022-06-28 | Irisvision, Inc. | Multi-modal vision enhancement system |
CN104323757A (en) * | 2014-11-13 | 2015-02-04 | 王卫东 | Endoscope with flash lamp and camera for portable intelligent equipment |
GB201421098D0 (en) * | 2014-11-27 | 2015-01-14 | Cupris Ltd | Attachment for portable electronic device |
JP2016110029A (en) * | 2014-12-10 | 2016-06-20 | 富士ゼロックス株式会社 | Imaging unit and imaging system |
JP6528396B2 (en) * | 2014-12-10 | 2019-06-12 | 富士ゼロックス株式会社 | Imaging unit and imaging system |
US10105051B2 (en) | 2015-03-22 | 2018-10-23 | Spect Inc. | System and method for a portable eye examination camera |
WO2016154558A1 (en) | 2015-03-25 | 2016-09-29 | The Board Of Trustees Of The Leland Stanford Junior University | Modular adapters for mobile ophthalmoscopy |
KR101718517B1 (en) * | 2015-04-03 | 2017-04-05 | 재단법인대구경북과학기술원 | Mobile multispectral imaging device, user mobile device connection, image analysis software in a connected server for skin healthcare |
CN104796589A (en) * | 2015-04-22 | 2015-07-22 | 梧州学院 | Biological photomicrograph shooting method and biological photomicrograph shooting device |
US10952601B2 (en) | 2015-05-08 | 2021-03-23 | Photonicare, Inc. | Otoscope tip and methods of use |
WO2016182999A1 (en) | 2015-05-08 | 2016-11-17 | Photonicare, Inc. | Otoscope tip and methods of use |
CN107615137A (en) * | 2015-05-27 | 2018-01-19 | 捷迈克斯***公司 | Engraved gemstone viewer for personal communication devices |
US10188294B2 (en) | 2015-06-18 | 2019-01-29 | Verana Health, Inc. | Adapter for retinal imaging using a hand held computer |
WO2016205950A1 (en) * | 2015-06-23 | 2016-12-29 | Metaoptima Technology Inc. | Apparatus for imaging skin |
JP6855451B2 (en) * | 2015-08-27 | 2021-04-07 | ユニリーバー・ナームローゼ・ベンノートシヤープ | Methods and systems for making product recommendations |
US10103768B2 (en) | 2015-10-15 | 2018-10-16 | Microsoft Technology Licensing, Llc | Mobile device casing |
ITUB20155205A1 (en) | 2015-10-21 | 2017-04-21 | Fondazione St Italiano Tecnologia | OPTICAL ADAPTER CAN BE CONNECTED WITH AN IMAGE ACQUISITION DEVICE AND IN PARTICULAR INTENDED FOR USE IN MICROSCOPIC OBSERVATION. |
US10098529B2 (en) | 2015-10-28 | 2018-10-16 | Ricoh Company, Ltd. | Optical design of a light field otoscope |
CN106814437A (en) * | 2015-11-30 | 2017-06-09 | 东莞酷派软件技术有限公司 | A kind of camera head and its manufacture method, mobile terminal |
US9835842B2 (en) * | 2015-12-04 | 2017-12-05 | Omnivision Technologies, Inc. | Microscope attachment |
US10108222B2 (en) * | 2015-12-04 | 2018-10-23 | Apple Inc. | Electronic device displays with holes to accommodate components |
US20170215728A1 (en) * | 2016-02-01 | 2017-08-03 | University Of Washington | Applanation tonometer |
JP6574074B2 (en) | 2016-02-08 | 2019-09-11 | イクアリティ コスメティクス インコーポレイテッドEquality Cosmetics, Inc. | Apparatus and method for formulating and dispensing visually customized cosmetics |
WO2017137070A1 (en) * | 2016-02-09 | 2017-08-17 | Borsetti Andrea Marco | System and method for diagnosing skin and hair conditions |
DE102016102867A1 (en) | 2016-02-18 | 2017-08-24 | Oculyze Gmbh | microscope arrangement |
ES2950501T3 (en) * | 2016-04-22 | 2023-10-10 | Fitskin Inc | Systems for skin analysis using electronic devices |
US11096627B2 (en) * | 2016-04-25 | 2021-08-24 | Welch Allyn, Inc. | Medical examination system enabling interchangeable instrument operating modes |
WO2017201584A1 (en) * | 2016-05-26 | 2017-11-30 | Atlas Idioverse Pty Ltd | Imaging apparatus and accessory |
GB2552929A (en) * | 2016-07-12 | 2018-02-21 | Cupris Ltd | Optical attachment for a portable electronic device |
WO2018029286A1 (en) * | 2016-08-09 | 2018-02-15 | Koninklijke Philips N.V. | Device and method for measuring skin elasticity |
IT201600084973A1 (en) * | 2016-08-12 | 2018-02-12 | Ralph Ciech | SMARTPHONE FUNGENT FROM LIGHT SOURCE |
WO2018030969A1 (en) * | 2016-08-12 | 2018-02-15 | Karacor Adem Can | Lens and lighting device attachable to communication devices for use in dental imaging applications |
US10298906B2 (en) | 2016-08-18 | 2019-05-21 | Verily Life Sciences Llc | Dermal camera attachment |
CN106235997A (en) * | 2016-08-30 | 2016-12-21 | 曹隆和 | The endotoscpe that a kind of combination mobile phone uses |
GB2569078A (en) * | 2016-09-16 | 2019-06-05 | Throat Scope Pty Ltd | Orifice inspection system |
ES2882498T3 (en) * | 2016-10-18 | 2021-12-02 | Koninklijke Philips Nv | Accessory device and imaging device |
CN106444007A (en) * | 2016-11-15 | 2017-02-22 | 华中科技大学 | Smartphone-based oral cavity magnifying glass imaging system and application thereof |
CN106772993A (en) * | 2016-11-22 | 2017-05-31 | 大连理工大学 | A kind of microscope equipment and method based on smart mobile phone and conical fiber array coupling imaging |
US11231577B2 (en) | 2016-11-22 | 2022-01-25 | Alexander Ellis | Scope viewing apparatus |
US10110719B2 (en) * | 2016-12-12 | 2018-10-23 | Brian Joseph Aberle | Magnification and lighting attachment for mobile telephones |
WO2018120020A1 (en) * | 2016-12-30 | 2018-07-05 | 香港北大青鸟显示有限公司 | Light emitting diode micro-array flash |
CN108267909B (en) * | 2016-12-30 | 2021-06-01 | 上海显耀显示科技有限公司 | Micro array flash lamp of light-emitting diode |
WO2018148471A2 (en) * | 2017-02-08 | 2018-08-16 | Essenlix Corporation | Optics, device, and system for assaying |
US10972641B2 (en) | 2017-02-08 | 2021-04-06 | Essenlix Corporation | Optics, device, and system for assaying |
US10296780B2 (en) | 2017-03-07 | 2019-05-21 | Ricoh Company, Ltd. | Automatic eardrum registration from light field data |
US10275644B2 (en) | 2017-03-08 | 2019-04-30 | Ricoh Company, Ltd | Automatic classification of eardrum shape |
JP6848585B2 (en) * | 2017-03-24 | 2021-03-24 | カシオ計算機株式会社 | Imaging device and lens unit for imaging device |
US9939714B1 (en) | 2017-03-28 | 2018-04-10 | Andrew Ryan Matthews | Intra-oral camera |
US20180284580A1 (en) * | 2017-03-28 | 2018-10-04 | Andrew Ryan Matthews | Intra-oral camera |
GB201706497D0 (en) * | 2017-04-25 | 2017-06-07 | Kwong Tsong Yun | New product |
WO2018213492A1 (en) | 2017-05-16 | 2018-11-22 | Spect Inc. | Stereoscopic mobile retinal imager |
CN107249055A (en) * | 2017-05-16 | 2017-10-13 | 北京小米移动软件有限公司 | Smart mobile phone |
EP3641637A4 (en) * | 2017-06-21 | 2021-06-16 | My Homedoc Ltd. | Medical examination device |
EP3661476A4 (en) | 2017-07-25 | 2021-07-21 | Blee. LLC | System and device for customization of cosmetics |
CN108261169B (en) * | 2017-11-07 | 2019-09-24 | 吉林大学第一医院 | Intelligent in-ear medical care system |
CN107898434B (en) * | 2017-11-07 | 2018-12-14 | 徐州玖胜医疗器械有限公司 | Healthcare system in intelligent ear |
GB2569325B (en) | 2017-12-13 | 2020-05-06 | Imperial Innovations Ltd | Ear examination apparatus |
CN108175380A (en) * | 2017-12-28 | 2018-06-19 | 佳木斯大学附属第医院 | A kind of Multifunctional ear-nose-throat department probes into treatment integrated system |
US11249293B2 (en) * | 2018-01-12 | 2022-02-15 | Iballistix, Inc. | Systems, apparatus, and methods for dynamic forensic analysis |
US11147441B2 (en) | 2018-01-16 | 2021-10-19 | Welch Allyn, Inc. | Physical assessment device |
US10979649B2 (en) | 2018-01-29 | 2021-04-13 | Don Atkinson | Auxiliary apparatus for a digital imaging device |
CN112534467A (en) | 2018-02-13 | 2021-03-19 | 弗兰克.沃布林 | Method and apparatus for contrast sensitivity compensation |
US10575623B2 (en) | 2018-06-29 | 2020-03-03 | Sephora USA, Inc. | Color capture system and device |
WO2020023865A1 (en) * | 2018-07-26 | 2020-01-30 | Luminent Health, LLC | Apparatus and method for providing improved health care |
US11885952B2 (en) | 2018-07-30 | 2024-01-30 | Essenlix Corporation | Optics, device, and system for assaying and imaging |
USD1006234S1 (en) | 2018-10-23 | 2023-11-28 | Luminent Health Llc | Point-of-care patient information instrument |
KR102635884B1 (en) | 2018-10-31 | 2024-02-14 | 삼성전자주식회사 | A camera module including an aperture |
CN109407445B (en) * | 2018-12-05 | 2021-02-09 | 肯维捷斯(武汉)科技有限公司 | Portable microcosmic imaging device |
US10818040B2 (en) * | 2018-12-27 | 2020-10-27 | Sephora USA, Inc. | Image capture device for a color customization system |
WO2020154698A1 (en) | 2019-01-25 | 2020-07-30 | Otonexus Medical Technologies, Inc. | Machine learning for otitis media diagnosis |
ES2775521A1 (en) * | 2019-01-27 | 2020-07-27 | Delgado Oscar Ruesga | ELECTRONIC CASE FOR ADAPTATION OF MOBILE DEVICES WITH MULTIDISCIPLINARY MEDICAL DIAGNOSTIC INSTRUMENTS (Machine-translation by Google Translate, not legally binding) |
US10945673B2 (en) | 2019-01-29 | 2021-03-16 | 3Gen, Inc. | Medical illuminator mobile device attachment apparatus and method |
US10678120B1 (en) | 2019-01-29 | 2020-06-09 | 3Gen, Inc. | Medical illuminator mobile device attachment apparatus and method |
WO2020161391A1 (en) * | 2019-02-06 | 2020-08-13 | Tötterman Research Oy | Medical imaging arrangement for a mobile device |
GB2586570A (en) | 2019-05-24 | 2021-03-03 | Cupris Ltd | Imaging apparatus |
AU2020309098A1 (en) * | 2019-07-11 | 2022-03-10 | Sensibility Pty Ltd | Machine learning based phone imaging system and analysis method |
US11712177B2 (en) | 2019-08-12 | 2023-08-01 | Essenlix Corporation | Assay with textured surface |
US11395714B2 (en) | 2019-11-11 | 2022-07-26 | Dermlite Llc | Medical illuminator with variable polarization |
US11003048B1 (en) * | 2019-12-13 | 2021-05-11 | VG Technology Inc. | Polarized imaging apparatus for use with a mobile device |
FR3105407B1 (en) | 2019-12-23 | 2021-12-03 | cosnova GmbH | MEASURING THE COLOR OF A TARGET AREA OF INTEREST OF A MATERIAL, WITH COLOR CALIBRATION TARGETS |
FR3105408B1 (en) | 2019-12-23 | 2021-12-03 | cosnova GmbH | MEASURING THE COLOR OF A TARGET AREA OF INTEREST OF A MATERIAL, WITH ILLUMINATION CONTROLLED |
BR112022017149A2 (en) * | 2020-02-26 | 2022-10-11 | Get Grin Inc | SYSTEMS AND METHODS FOR REMOTE DENTAL MONITORING |
US11385412B2 (en) * | 2020-05-26 | 2022-07-12 | Westek Electronics, Inc. | Fiber inspection tool |
WO2022040392A1 (en) | 2020-08-19 | 2022-02-24 | Blee.LLC | System and device for customization of cosmetics |
US20220133141A1 (en) * | 2020-11-02 | 2022-05-05 | Presley M. Mock | Remote medical examination |
WO2022149566A1 (en) * | 2021-01-06 | 2022-07-14 | ピンポイントフォトニクス株式会社 | Remote system for determining risk of skin diseases and remote method for determining risk of skin diseases |
WO2022192242A1 (en) * | 2021-03-10 | 2022-09-15 | Designs For Vision, Inc. | Fluorescence based image capture system |
CN113729626B (en) * | 2021-08-03 | 2023-04-14 | 蒋登文 | Portable skin quality detection device and system based on image recognition |
CN113984759B (en) * | 2021-09-24 | 2023-12-12 | 暨南大学 | Optical instant detection system and body fluid slide crystallization and detection method |
WO2023147346A1 (en) * | 2022-01-28 | 2023-08-03 | Johnson & Johnson Consumer Inc. | Systems, methods, and apparatus for tele-otoscopy |
CN116149042B (en) * | 2022-11-02 | 2023-08-22 | 华中科技大学 | Photoelectric sighting device |
Family Cites Families (69)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2553941Y2 (en) | 1989-06-27 | 1997-11-12 | オリンパス光学工業株式会社 | Adapter device for close-up photography |
US5202758A (en) | 1991-09-16 | 1993-04-13 | Welch Allyn, Inc. | Fluorescent penetrant measurement borescope |
JPH10274742A (en) | 1997-01-28 | 1998-10-13 | Nikon Corp | Immersion microscopic objective lens |
US20010044584A1 (en) | 1997-08-28 | 2001-11-22 | Kensey Kenneth R. | In vivo delivery methods and compositions |
JPH1196333A (en) * | 1997-09-16 | 1999-04-09 | Olympus Optical Co Ltd | Color image processor |
US6606413B1 (en) | 1998-06-01 | 2003-08-12 | Trestle Acquisition Corp. | Compression packaged image transmission for telemicroscopy |
US7050648B1 (en) * | 1998-09-18 | 2006-05-23 | Canon Kabushiki Kaisha | Image processing apparatus, image processing method, and recording medium |
US7450229B2 (en) * | 1999-01-25 | 2008-11-11 | Amnis Corporation | Methods for analyzing inter-cellular phenomena |
JP2000232653A (en) * | 1999-02-08 | 2000-08-22 | Fuji Photo Film Co Ltd | Image pickup device |
US7139016B2 (en) * | 2001-02-28 | 2006-11-21 | Eastman Kodak Company | Intra-oral camera system with chair-mounted display |
US7288751B2 (en) | 2001-07-06 | 2007-10-30 | Palantyr Research, Llc | Imaging system, methodology, and applications employing reciprocal space optical design |
US20030103262A1 (en) | 2001-09-07 | 2003-06-05 | Board Of Regents, The University Of Texas System | Multimodal miniature microscope |
US8049816B2 (en) * | 2001-11-16 | 2011-11-01 | Nokia Corporation | Mobile terminal device having camera system |
JP2004032551A (en) * | 2002-06-27 | 2004-01-29 | Seiko Epson Corp | Image processing method, image processor, and projector |
JP4319444B2 (en) | 2002-07-23 | 2009-08-26 | 富士フイルム株式会社 | Imaging device |
US6950241B1 (en) | 2002-09-18 | 2005-09-27 | Dmetrix, Inc. | Miniature microscope objective for an array microscope |
JP4175502B2 (en) * | 2003-03-14 | 2008-11-05 | スカラ株式会社 | Magnification imaging unit |
JP4076148B2 (en) * | 2003-03-20 | 2008-04-16 | 株式会社リコー | Digital camera |
KR20050006623A (en) * | 2003-07-09 | 2005-01-17 | 주식회사 팬택앤큐리텔 | Mobile communication terminal comprising magnifiable camera |
NL1024115C2 (en) | 2003-08-15 | 2004-10-01 | P J M J Beheer B V | Device is for coupling endoscope to mobile picture telephone and is recorded by a camera contained in housing of telephone |
US7305233B2 (en) | 2004-05-27 | 2007-12-04 | Exclaim, Inc. | Method and apparatus for image distribution using a cellular phone |
TWI245229B (en) * | 2003-09-18 | 2005-12-11 | Ind Tech Res Inst | Region based illumination-normalization method and system |
EP1725973A4 (en) | 2004-03-05 | 2013-12-11 | Siemens Healthcare Diagnostics | Hadheld optical diagnostic device having image system array |
KR20050093291A (en) * | 2004-03-18 | 2005-09-23 | 에스케이 텔레콤주식회사 | Mobile phone equipped with telephoto-lens and operating method thereof |
KR100632099B1 (en) * | 2004-04-14 | 2006-10-04 | 주식회사 팬택앤큐리텔 | a macro lens rotating apparatus of a camera for a mobile communication terminal |
CN2722826Y (en) | 2004-04-22 | 2005-09-07 | 上海西叶电子科技有限责任公司 | Long distance medical service device |
JP4450187B2 (en) * | 2004-06-08 | 2010-04-14 | パナソニック株式会社 | Solid-state imaging device |
JP4774059B2 (en) | 2005-02-01 | 2011-09-14 | シーメンス カナダ リミテッド | Electrical exhaust gas recirculation valve |
KR100513156B1 (en) * | 2005-02-05 | 2005-09-07 | 아람휴비스(주) | Extension image system of magnification high for cellular telephone |
WO2006107666A2 (en) | 2005-04-01 | 2006-10-12 | Reinhard Hafellner | Body fluid testing component for analyte detection |
JP2006295838A (en) * | 2005-04-14 | 2006-10-26 | Fuji Photo Film Co Ltd | Camera system |
CA2509590A1 (en) * | 2005-06-06 | 2006-12-06 | Solar International Products Inc. | Portable imaging apparatus |
JP2007003646A (en) * | 2005-06-22 | 2007-01-11 | Fujifilm Holdings Corp | Camera system, lens unit and accessory |
US20100005692A1 (en) * | 2005-10-21 | 2010-01-14 | Donald Farnsworth | Re-attachable container identifiers |
US7821569B2 (en) * | 2006-02-10 | 2010-10-26 | Lumos Technology Co., Ltd. | Converter lens attachment with built-in light source for compact digital camera |
JP4640825B2 (en) * | 2006-02-23 | 2011-03-02 | 富士フイルム株式会社 | Specific orientation face determination method, apparatus, and program |
US7755672B2 (en) * | 2006-05-15 | 2010-07-13 | Zoran Corporation | Techniques for modifying image field data obtained using illumination sources |
US20070280677A1 (en) | 2006-05-30 | 2007-12-06 | Marc Thomas Drake | Auxiliary lens attachment for cellular telephones |
US20080058629A1 (en) * | 2006-08-21 | 2008-03-06 | University Of Washington | Optical fiber scope with both non-resonant illumination and resonant collection/imaging for multiple modes of operation |
US9137466B2 (en) * | 2006-08-30 | 2015-09-15 | Micron Technology, Inc. | Image sensor defect identification using optical flare |
US8280139B2 (en) * | 2007-02-13 | 2012-10-02 | Nec Corporation | Cell feature amount calculating apparatus and cell feature amount calculating method |
JP2010263254A (en) * | 2007-08-29 | 2010-11-18 | Panasonic Corp | Camera system and camera body |
WO2009088930A2 (en) | 2008-01-02 | 2009-07-16 | The Regents Of The University Of California | High numerical aperture telemicroscopy apparatus |
US8115934B2 (en) * | 2008-01-18 | 2012-02-14 | The Board Of Trustees Of The University Of Illinois | Device and method for imaging the ear using optical coherence tomography |
US8400505B2 (en) * | 2008-05-19 | 2013-03-19 | Panasonic Corporation | Calibration method, calibration device, and calibration system including the device |
EP4336447A1 (en) * | 2008-05-20 | 2024-03-13 | FotoNation Limited | Capturing and processing of images using monolithic camera array with heterogeneous imagers |
US8406859B2 (en) * | 2008-08-10 | 2013-03-26 | Board Of Regents, The University Of Texas System | Digital light processing hyperspectral imaging apparatus |
US9572494B2 (en) * | 2008-08-12 | 2017-02-21 | New Jersy Institute of Technology | Method and apparatus for multi-spectral imaging and analysis of skin lesions and biological tissues |
JP5641718B2 (en) * | 2008-09-16 | 2014-12-17 | キヤノン株式会社 | Shooting lens |
ES2341079B1 (en) * | 2008-12-11 | 2011-07-13 | Fundacio Clinic Per A La Recerca Biomedica | EQUIPMENT FOR IMPROVED VISION BY INFRARED VASCULAR STRUCTURES, APPLICABLE TO ASSIST PHYTOSCOPIC, LAPAROSCOPIC AND ENDOSCOPIC INTERVENTIONS AND SIGNAL TREATMENT PROCESS TO IMPROVE SUCH VISION. |
JP5325726B2 (en) * | 2009-09-24 | 2013-10-23 | 富士フイルム株式会社 | Endoscope system |
US8605997B2 (en) * | 2009-11-23 | 2013-12-10 | Samsung Electronics Co., Ltd. | Indoor-outdoor detector for digital cameras |
TWM385006U (en) * | 2010-01-22 | 2010-07-21 | Lumos Technology Co Ltd | Microscopic detection device for fluorescent testing |
US8224175B2 (en) * | 2010-08-16 | 2012-07-17 | Lumos Technology Co., Ltd. | Photographic apparatus having ring light module |
JP5582935B2 (en) * | 2010-09-22 | 2014-09-03 | 富士フイルム株式会社 | Imaging module |
CN103181154A (en) | 2010-10-29 | 2013-06-26 | 加利福尼亚大学董事会 | Cellscope apparatus and methods for imaging |
JP5617561B2 (en) * | 2010-11-25 | 2014-11-05 | 株式会社リコー | Imaging device |
JP5274720B2 (en) * | 2010-12-14 | 2013-08-28 | オリンパスメディカルシステムズ株式会社 | Imaging device |
TW201239502A (en) * | 2011-03-16 | 2012-10-01 | Lumos Technology Co Ltd | Adapter lens module and adapter seat for the same |
US20120296162A1 (en) * | 2011-05-18 | 2012-11-22 | Centre Hospitalier Universitaire De Bordeaux (C.H.U. De Bordeaux) | Method for Positioning a Disposable Sterile Endotracheal Tube, and Corresponding System for Intubation |
WO2012177544A1 (en) * | 2011-06-18 | 2012-12-27 | Intuitive Medical Technologies, Llc | Smart-phone adapter for ophthalmoscope |
US9251439B2 (en) * | 2011-08-18 | 2016-02-02 | Nikon Corporation | Image sharpness classification system |
WO2013049778A1 (en) * | 2011-09-30 | 2013-04-04 | Intuitive Medical Technologies, Llc | Optical adapter for ophthalmological imaging apparatus |
KR20130035422A (en) * | 2011-09-30 | 2013-04-09 | 삼성전기주식회사 | Calibration apparatus for camera module |
WO2013152402A1 (en) * | 2012-04-13 | 2013-10-17 | Blackmagic Design Pty Ltd | Camera |
CN104781714A (en) * | 2012-09-12 | 2015-07-15 | 欧乐柯利普有限责任公司 | Removable optical devices for mobile electronic devices |
US20150002950A1 (en) * | 2013-03-15 | 2015-01-01 | Olloclip, Llc | Removable lenses for mobile electronic devices |
US9661200B2 (en) * | 2013-08-07 | 2017-05-23 | Olloclip, Llc | Auxiliary optical components for mobile devices |
US20150172522A1 (en) * | 2013-12-16 | 2015-06-18 | Olloclip, Llc | Devices and methods for close-up imaging with a mobile electronic device |
-
2011
- 2011-10-28 CN CN2011800516005A patent/CN103181154A/en active Pending
- 2011-10-28 WO PCT/US2011/058466 patent/WO2012058641A2/en active Application Filing
- 2011-10-28 EP EP11837229.1A patent/EP2633678A4/en not_active Ceased
-
2013
- 2013-04-02 US US13/855,501 patent/US9325884B2/en active Active
-
2016
- 2016-02-24 US US15/052,347 patent/US20160248951A1/en not_active Abandoned
-
2017
- 2017-01-11 US US15/403,874 patent/US10616457B2/en active Active
-
2020
- 2020-03-05 US US16/810,805 patent/US20200336630A1/en not_active Abandoned
Cited By (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160012269A1 (en) * | 2014-07-08 | 2016-01-14 | Padloc Inc. | Imaging and Peripheral Enhancements for Mobile Devices |
US9672400B2 (en) * | 2014-07-08 | 2017-06-06 | Aila Technologies Inc. | Imaging and peripheral enhancements for mobile devices |
US20170032206A1 (en) * | 2015-07-30 | 2017-02-02 | Fuji Xerox Co., Ltd. | Unit for photographing and photographing system |
US10068145B2 (en) * | 2015-07-30 | 2018-09-04 | Fuji Xerox Co., Ltd. | Photographing system configured to hold a pill |
US20170371128A1 (en) * | 2016-06-27 | 2017-12-28 | Ming-Jui LI | Disposable lens applied to electronic operation device for recognition |
US9869840B1 (en) * | 2016-06-27 | 2018-01-16 | Ming-Jui LI | Disposable lens applied to electronic operation device for recognition |
KR20180109420A (en) * | 2017-03-28 | 2018-10-08 | (주)시원광기술 | Illumination guide, lens module with the same, and device for observing subject using mobile phone camera with the lens module |
KR102047540B1 (en) | 2017-03-28 | 2019-11-21 | (주)시원광기술 | Device for observing subject |
US10495568B2 (en) | 2017-04-28 | 2019-12-03 | The Royal Institution For The Advancement Of Learning/Mcgill University | Apparatus for analyzing a sample of granular material |
EP3970601A1 (en) * | 2020-09-21 | 2022-03-23 | Pukyong National University Industry - University Cooperation Foundation | Mobile colposcopy device for early diagnosis of cervical cancer |
US20220087520A1 (en) * | 2020-09-21 | 2022-03-24 | Pukyong National University Industry-University Cooperation Foundation | Mobile colposcopy device for early diagnosis of cervical cancer |
JP2022051712A (en) * | 2020-09-21 | 2022-04-01 | プキョン ナショナル ユニバーシティ インダストリー-ユニバーシティ コーポレーション ファウンデーション | Mobile vagina magnifying glass device for cervical cancer early diagnosis |
US11771315B2 (en) * | 2020-09-21 | 2023-10-03 | Pukyong National University Industry—University Cooperation Foundation | Mobile colposcopy device for early diagnosis of cervical cancer |
EP4276529A4 (en) * | 2021-01-05 | 2024-03-20 | IT Access Co., Ltd | Imaging assistance tool and skin imaging device |
Also Published As
Publication number | Publication date |
---|---|
US20170126943A1 (en) | 2017-05-04 |
US9325884B2 (en) | 2016-04-26 |
US20130300919A1 (en) | 2013-11-14 |
EP2633678A2 (en) | 2013-09-04 |
WO2012058641A2 (en) | 2012-05-03 |
WO2012058641A3 (en) | 2012-07-05 |
CN103181154A (en) | 2013-06-26 |
US20200336630A1 (en) | 2020-10-22 |
EP2633678A4 (en) | 2015-05-20 |
US10616457B2 (en) | 2020-04-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20200336630A1 (en) | Cellscope apparatus and methods for imaging | |
JP4088313B2 (en) | Image processing system, hospital processing system | |
JP6287238B2 (en) | Plenoptic otoscope | |
JP4937971B2 (en) | Image processing system | |
JP4482021B2 (en) | camera | |
US20050200707A1 (en) | Multi-purpose imaging apparatus and adaptors therefor | |
US20090237498A1 (en) | System and methods for the improvement of images generated by fiberoptic imaging bundles | |
US10524647B2 (en) | Smartphone endoscope system | |
JP2005341175A (en) | Photographing system | |
JP4616318B2 (en) | camera | |
US11003048B1 (en) | Polarized imaging apparatus for use with a mobile device | |
CA2956779C (en) | Miniature multi-target optical imaging apparatus | |
KR101349923B1 (en) | Otoscope using a smartphone and the specular attachment | |
CN103932661A (en) | Plenoptic otoscope | |
WO2013148367A1 (en) | Apparatus for enhanced imaging and lighting | |
KR20120094232A (en) | Remote monitoring slit lamp microscope device for ubiquitous health care | |
KR102325597B1 (en) | Portable meibomian photographing device | |
KR102648059B1 (en) | Mobile otoscope system | |
Bartczak et al. | Spectral video in image-guided microsurgical applications: Integrating imaging technology into the clinical environment and ergonomic considerations | |
US20200383559A1 (en) | Imaging Device Attachment Compatible With A Mobile Device | |
JP2016029961A (en) | Endoscope apparatus | |
JP2023502686A (en) | optical device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: THE REGENTS OF THE UNIVERSITY OF CALIFORNIA, CALIF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:FLETCHER, DANIEL;DOUGLAS, ERIK;SHENG, AMY;AND OTHERS;SIGNING DATES FROM 20130506 TO 20130516;REEL/FRAME:037930/0613 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |