EP1302066A1 - Appareil photographique avec illuminateur de pixels de type reflex - Google Patents
Appareil photographique avec illuminateur de pixels de type reflexInfo
- Publication number
- EP1302066A1 EP1302066A1 EP00942347A EP00942347A EP1302066A1 EP 1302066 A1 EP1302066 A1 EP 1302066A1 EP 00942347 A EP00942347 A EP 00942347A EP 00942347 A EP00942347 A EP 00942347A EP 1302066 A1 EP1302066 A1 EP 1302066A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- light
- scene
- photosurface
- region
- camera according
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000005286 illumination Methods 0.000 claims abstract description 213
- 238000000034 method Methods 0.000 claims description 58
- 239000004973 liquid crystal related substance Substances 0.000 claims description 14
- 238000012545 processing Methods 0.000 claims description 12
- 238000009826 distribution Methods 0.000 claims description 11
- 238000003384 imaging method Methods 0.000 claims description 8
- 238000001228 spectrum Methods 0.000 claims description 5
- 238000002834 transmittance Methods 0.000 claims description 4
- 210000002858 crystal cell Anatomy 0.000 claims description 3
- 238000009499 grossing Methods 0.000 claims description 3
- 230000003111 delayed effect Effects 0.000 claims description 2
- 230000000873 masking effect Effects 0.000 claims description 2
- 230000000694 effects Effects 0.000 description 7
- 210000004027 cell Anatomy 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 5
- 238000002310 reflectometry Methods 0.000 description 5
- 238000009416 shuttering Methods 0.000 description 4
- 238000006073 displacement reaction Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 238000013139 quantization Methods 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 230000003595 spectral effect Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000005562 fading Methods 0.000 description 1
- 230000004313 glare Effects 0.000 description 1
- PCHJSUWPFVWCPO-UHFFFAOYSA-N gold Chemical compound [Au] PCHJSUWPFVWCPO-UHFFFAOYSA-N 0.000 description 1
- 239000010931 gold Substances 0.000 description 1
- 229910052737 gold Inorganic materials 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 229910052751 metal Inorganic materials 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 238000002366 time-of-flight method Methods 0.000 description 1
- 238000001429 visible spectrum Methods 0.000 description 1
- 238000011179 visual inspection Methods 0.000 description 1
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
- B60Q1/02—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments
- B60Q1/04—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights
- B60Q1/06—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights adjustable, e.g. remotely-controlled from inside vehicle
- B60Q1/08—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights adjustable, e.g. remotely-controlled from inside vehicle automatically
- B60Q1/085—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights adjustable, e.g. remotely-controlled from inside vehicle automatically due to special conditions, e.g. adverse weather, type of road, badly illuminated road signs or potential dangers
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F21—LIGHTING
- F21S—NON-PORTABLE LIGHTING DEVICES; SYSTEMS THEREOF; VEHICLE LIGHTING DEVICES SPECIALLY ADAPTED FOR VEHICLE EXTERIORS
- F21S41/00—Illuminating devices specially adapted for vehicle exteriors, e.g. headlamps
- F21S41/10—Illuminating devices specially adapted for vehicle exteriors, e.g. headlamps characterised by the light source
- F21S41/14—Illuminating devices specially adapted for vehicle exteriors, e.g. headlamps characterised by the light source characterised by the type of light source
- F21S41/141—Light emitting diodes [LED]
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F21—LIGHTING
- F21S—NON-PORTABLE LIGHTING DEVICES; SYSTEMS THEREOF; VEHICLE LIGHTING DEVICES SPECIALLY ADAPTED FOR VEHICLE EXTERIORS
- F21S41/00—Illuminating devices specially adapted for vehicle exteriors, e.g. headlamps
- F21S41/10—Illuminating devices specially adapted for vehicle exteriors, e.g. headlamps characterised by the light source
- F21S41/14—Illuminating devices specially adapted for vehicle exteriors, e.g. headlamps characterised by the light source characterised by the type of light source
- F21S41/141—Light emitting diodes [LED]
- F21S41/143—Light emitting diodes [LED] the main emission direction of the LED being parallel to the optical axis of the illuminating device
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F21—LIGHTING
- F21S—NON-PORTABLE LIGHTING DEVICES; SYSTEMS THEREOF; VEHICLE LIGHTING DEVICES SPECIALLY ADAPTED FOR VEHICLE EXTERIORS
- F21S41/00—Illuminating devices specially adapted for vehicle exteriors, e.g. headlamps
- F21S41/10—Illuminating devices specially adapted for vehicle exteriors, e.g. headlamps characterised by the light source
- F21S41/14—Illuminating devices specially adapted for vehicle exteriors, e.g. headlamps characterised by the light source characterised by the type of light source
- F21S41/141—Light emitting diodes [LED]
- F21S41/147—Light emitting diodes [LED] the main emission direction of the LED being angled to the optical axis of the illuminating device
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F21—LIGHTING
- F21S—NON-PORTABLE LIGHTING DEVICES; SYSTEMS THEREOF; VEHICLE LIGHTING DEVICES SPECIALLY ADAPTED FOR VEHICLE EXTERIORS
- F21S41/00—Illuminating devices specially adapted for vehicle exteriors, e.g. headlamps
- F21S41/10—Illuminating devices specially adapted for vehicle exteriors, e.g. headlamps characterised by the light source
- F21S41/14—Illuminating devices specially adapted for vehicle exteriors, e.g. headlamps characterised by the light source characterised by the type of light source
- F21S41/141—Light emitting diodes [LED]
- F21S41/151—Light emitting diodes [LED] arranged in one or more lines
- F21S41/153—Light emitting diodes [LED] arranged in one or more lines arranged in a matrix
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F21—LIGHTING
- F21S—NON-PORTABLE LIGHTING DEVICES; SYSTEMS THEREOF; VEHICLE LIGHTING DEVICES SPECIALLY ADAPTED FOR VEHICLE EXTERIORS
- F21S41/00—Illuminating devices specially adapted for vehicle exteriors, e.g. headlamps
- F21S41/60—Illuminating devices specially adapted for vehicle exteriors, e.g. headlamps characterised by a variable light distribution
- F21S41/65—Illuminating devices specially adapted for vehicle exteriors, e.g. headlamps characterised by a variable light distribution by acting on light sources
- F21S41/663—Illuminating devices specially adapted for vehicle exteriors, e.g. headlamps characterised by a variable light distribution by acting on light sources by switching light sources
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q2300/00—Indexing codes for automatically adjustable headlamps or automatically dimmable headlamps
- B60Q2300/05—Special features for controlling or switching of the light beam
- B60Q2300/054—Variable non-standard intensity, i.e. emission of various beam intensities different from standard intensities, e.g. continuous or stepped transitions of intensity
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q2300/00—Indexing codes for automatically adjustable headlamps or automatically dimmable headlamps
- B60Q2300/30—Indexing codes relating to the vehicle environment
- B60Q2300/31—Atmospheric conditions
- B60Q2300/312—Adverse weather
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q2300/00—Indexing codes for automatically adjustable headlamps or automatically dimmable headlamps
- B60Q2300/30—Indexing codes relating to the vehicle environment
- B60Q2300/32—Road surface or travel path
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q2300/00—Indexing codes for automatically adjustable headlamps or automatically dimmable headlamps
- B60Q2300/40—Indexing codes relating to other road users or special conditions
- B60Q2300/45—Special conditions, e.g. pedestrians, road signs or potential dangers
Definitions
- the present invention relates to imaging a scene with light and in particular to methods and apparatus for illuminating the imaged scene.
- Satisfactory and effective imaging of a scene with light requires proper illumination of the scene. In many instances however, achieving proper illumination is a relatively complicated and arduous task. Often it is desirable and/or necessary to illuminate different regions of a scene with different intensity and/or color light. Sometimes a dynamic range of a camera limits contrast in an image of a scene and brightest regions and dimmest regions of the scene cannot be properly imaged at the same time. Sometimes lighting and color of illumination must be adjusted to provide desired effects in an image.
- lighting usually has to be adjusted to increase illumination of certain regions of the product while decreasing illumination of other regions of the product.
- color of light used to illuminate the product may have to be adjusted and substantial effort invested in arranging direction and intensity of indirect lighting of the product.
- lighting In imaging items for visual inspection, lighting generally has to be adjusted to assure that inspected features of the items are appropriately visible to enable proper inspection. Often, to distinguish features of an inspected item, color of light illuminating a first region of the item is optionally adjusted to be different from color of light illuminating a second region of the item.
- Distance to a region is determined from timing of the gates with respect to emission times of the light pulses and a total amount of light from the region that is received and imaged during the gates.
- differences in reflectivity of different regions of the scene and/or differences in distances of different region in the scene from the camera result in substantial differences in intensity of reflected light reaching the camera.
- intensity of light received from a region in a scene is a function of a solid angle subtended by the region at the camera. Since the solid angle is inversely proportional to the square of the distance from the camera, small differences in distances from the camera of regions in the scene can generate large differences in intensity of light reaching the camera from the regions. The range of these intensity differences can sometimes approach or exceed the dynamic range of the camera. As a result, accuracy of determination of distances to regions in the scene can vary substantially. In some instances, as a result of intensity differences it may not be possible to determine distances to all regions of the scene at a same time.
- An aspect of some embodiments of the present invention relates to providing a camera, comprising an improved illumination system for illuminating a scene imaged with the camera.
- the illumination system illuminates regions of the scene that are imaged on contiguous regions of the photosurface independently of each other.
- regions of a scene that are independently illuminated in accordance with an embodiment of the present invention are referred to as "illumination zones”.
- the size of an illumination zone is such that the illumination zone is imaged on a single pixel of the photosurface.
- the size of an illumination zone is such that the illumination zone is imaged on a group of pixels on the photosurface.
- all illumination zones of a scene are imaged regions of the photosurface having a same size and shape.
- different illumination zones are imaged on different size and/or shape regions of the photosurface.
- An aspect of some embodiments of the present invention relates to adjusting intensity of light that illuminates each illumination zone of a scene independently of other illumination zones in the scene.
- An aspect of some embodiments of the present invention relates to adjusting color of light that illuminates each illumination zone of a scene independently of other illumination zones in the scene.
- a camera in accordance with an embodiment of the present invention comprises a photosurface on which light from a scene imaged with the camera is focused and an illumination system having a spatially modulated light source boresighted with the photosurface.
- the light source hereinafter referred to as a "pixelated illuminator”
- the size, location and orientation of the pixelated illuminator and optics used to boresight the pixelated illuminator with the photosurface are such that a virtual image of the pixelated illuminator is substantially coincident with the photosurface.
- a virtual image of each luxel of the pixelated illuminator is therefore located in a different corresponding region of the photosurface and light from virtual images of any two luxels does not appear to pass through or emanate from a same region of the photosurface.
- the pixelated illuminator is boresighted with the photosurface using methods and devices described in US Patent Application, number 09/250,322, the disclosure of which is incorporated herein by reference.
- the region of the photosurface on which a virtual image of a luxel is located images a region of the scene that is an illumination zone of the scene corresponding to the luxel.
- Light from the luxel illuminates only the illumination zone that is imaged on the region of the photosurface in which the virtual image of the luxel is located.
- the camera comprises a controller that controls intensity of light provided by a luxel so as to control intensity of illumination of the illumination zone corresponding to the luxel.
- the controller controls the luxel to adjust hue and/or saturation of light illuminating the illumination zone.
- the controller receives signals generated by a pixel or pixels of the photosurface on which an illumination zone of a scene is imaged responsive to light incident on the pixel or pixels from the illumination zone.
- the controller controls light provided by the luxel that illuminates the illumination zone, responsive to the received signals.
- the controller receives instructions from a user that define a desired hue, and/or saturation and/or intensity for light reaching the pixel or pixels of the photosurface from the illumination zone.
- the controller controls light provided by the luxel responsive to the instructions so that light that reaches the pixel or pixels has the desired characteristics defined by the user.
- a person uses a camera in accordance with an embodiment of the present invention to image a metal object that has highly reflecting areas.
- the person might prefer to reduce light reaching the camera from the highly reflecting areas to reduce glare and improve perceived quality of the image of the object.
- the person can accomplish this by instructing the controller to reduce, by a desired amount, intensity of illumination of illumination zones corresponding to pixels in the image that register light intensity greater than a maximum light intensity defined by the person.
- the person can accomplish this by indicating on a display of a preview of the image, a region or regions for which the user wants to reduce brightness.
- the user may indicate an amount by which the user wishes to reduce illumination of the region or regions on an appropriate control panel that is displayed with the preview.
- the controller reduces illumination of illumination zones corresponding to the indicated region or regions, a new preview may be presented to the user, which if the user desires he or she can adjust again.
- hue and saturation of light illuminating a scene being imaged using the camera are adjusted similarly.
- the pixelated illuminator illuminates illumination zones with R, G or B light
- the user can adjust color of the image by adjusting intensity, using for example methods similar to those described above, of R, G and/or B light illuminating illumination zones of the scene.
- the virtual image of a luxel on the photosurface is substantially coincident with a single pixel on the photosurface.
- the luxel therefore illuminates a region, i.e. an illumination zone, of a scene imaged on the photosurface that is imaged on the single pixel on the photosurface.
- the virtual image of a luxel is substantiality coincident with a group of pixels on the photosurface and the luxel illuminates an illumination zone of a scene that is imaged on the group of pixels.
- luxels are not all the same size and/or shape and two different luxels may illuminate different size and/or shape illumination zones in a scene.
- a camera comprises an illumination system having a pixelated illuminator that is not boresighted with a photosurface of the camera. Instead, the illumination system comprises its own optics that focuses light from the pixelated illuminator on a scene being imaged by the camera.
- the camera may comprise a controller that controls the illumination system optics so that the light from the pixelated illuminator is focused to the scene being imaged by the camera.
- Light providing systems and devices suitable for use as a pixelated illuminator for practice of the present invention are available in the market.
- certain types of light projectors used for projection display of images are suitable for use in practice of the present invention.
- These light projectors comprise luxels that are independently controllable to provide light at desired intensities and colors.
- the luxels can be made as small as pixels in a typical CCD or CMOS camera.
- US Patent 4,680,579 to E. O. Granville describes a light projector that uses a digital mirror device (DMD) in which micro mirrors function as luxels and reflect light of desired intensity and color provided by a suitable light source.
- DMD digital mirror device
- US Patent 5,844,588 to Anderson describes a DMD device used in an illumination system for a xerographic printer.
- Texas Instruments markets DMD light projectors and image projection systems based on DMDs.
- JVC markets a D-ILA (Direct, Direct Drive or Digital, Image Light Amplifier) light projector and image projection systems in which liquid crystal (LC) pixels are controlled to project light of desired intensity and color.
- D-ILA Direct, Direct Drive or Digital, Image Light Amplifier
- An aspect of some embodiments of the invention is concerned with the acquisition of high gray level resolution images utilizing a camera having a lower gray level resolution.
- a first image of a scene is acquired utilizing uniform lighting.
- the lighting which can be controlled to controllably and differently illuminate the various regions of the field of view is adjusted to give a relatively flat (contrast-wise) image.
- the illumination may have up to N' illuminations spaced at intervals such that for each gray level there exists a combination of N and N' such that N*N -C, where C is a constant that is the same for all of the pixels.
- the illumination is matched to intensity measured on the initial image acquisition, and a second image is acquired, the intensity variations are less than ⁇ 0.5 of the intensity distance between the initial gray levels.
- the acquisition range is set to cover this range of gray levels with substantially the entire scan of acquisition levels. If M acquisition levels and P illumination levels are available, each pixel (i, j) is characterized by two numbers my and pjj. The gray levels of a uniformly illuminated image can thus be derived to a resolution given by MxP gray levels.
- the illumination is controlled only over regions of greater than one pixel.
- the second image will have a variability that is larger than the variability when the illumination of the individual pixels are separately illuminated.
- the field of view is divided into Q regions. An uniformly lit image is acquired. The acquired intensity over the regions is averaged and the illumination is adjusted such that the acquired intensity (for a subsequent image) over all of the regions (based on the averages) is uniform to within the quantization accuracies of the illumination and the acquisition.
- each pixel is characterized by two numbers, one for the illumination and one for the acquisition.
- the number of levels for illumination and acquisition need not be the same. Thus, for example, if there are half as many illumination levels as there are acquisition levels, the illumination levels are matched to every second acquisition level, such that the total range of illuminations for the second acquisition is ⁇ 1 original gray level. The second acquisition is set to cover this range with the entire range of acquisition values.
- a very high resolution gray level (uniformly illuminated) image can be constructed utilizing these embodiments by generating an image in which each pixel has a brightness derived from the illumination level and the acquired brightness level.
- the first P bits of the image gray level would be given by the illumination values and the next M bits of the image gray level would be given by the acquisition levels of the second acquired image.
- two matrices are provided, one of which contains information on the illumination and the other information on the second acquisition.
- an A/D that allows for adjusting the zero level for the acquisition (so that the acquisition starts at the gray level of the pixel with the lowest illumination) and the A D gain, so that the highest acquisition gray level is matched with the brightest portion of the image.
- An iris may be provided to at least partially adjust the gain.
- the illumination elements illuminate pixels or groups of pixels without overlap.
- illumination of a pixel for individual pixel illumination
- illumination of a region for regional pixel illumination
- the reconstruction optionally takes into account the effects of illumination of adjacent pixels when determining the illumination to be used and in reconstructing the image.
- the overlap is adjusted such that, for uniform brightness of the sources, each pixel is uniformly illuminated. This can be achieved, for example, by providing for Gaussian roll off of the illumination, with the half illumination point at the edge of the portion being illuminated.
- a camera comprising: a photosurface comprising light sensitive pixels that generate signals responsive to light incident thereon and optics that focus an image of a scene onto the photosurface; and an illumination system for illuminating the scene, the illumination system comprising: an illuminator having a plurality of substantially contiguous, independently controllable light providing regions; optics that focuses an image of the illuminator on the scene so that light from the illuminator illuminates substantially all of and substantially only the field of view of the camera; and a controller that controls light provided by each light providing region.
- the illuminator is boresighted with the photosurface so that a virtual image of the illuminator is located at the photosurface and optics that image the scene on the photosurface image the illuminator on the scene.
- a virtual image of the illuminator is substantially coincident with the photosurface.
- light from each of the light providing regions that is reflected from the scene is imaged on a different group of contiguous pixels in the photosurface.
- light from each of the light providing regions that is reflected from the scene and imaged by the camera is imaged on a region of the photosurface having a size substantially equal to the size of a pixel in the photosurface.
- the region on which the light is imaged is located substantially within the area of a pixel on the photosurface.
- the regions of the photosurface on which light from at least two adjacent light providing regions of the illuminator is imaged overlap.
- light from a plurality of the light providing regions that is reflected from the scene and imaged by the camera is imaged on a same region of the photosurface having a size substantially equal to the size of a pixel in the photosurface.
- the region on which the light from the plurality of light providing regions is imaged is located substantially within the area of a pixel on the photosurface.
- each light providing region provides white light.
- each light providing region is controllable to provide light in at least two different wavelength bands of light.
- each light providing region is controllable to provide R, G and B light.
- the plurality of light providing regions comprises three light providing regions.
- each light providing region provides a different one of R, G or B light.
- the controller controls intensity of R, G or B light provided by each light providing region so as to control hue, saturation or intensity of light illuminating a region of the scene which is illuminated by light from the light providing region independently of hue saturation and intensity of light illuminating other regions of the scene.
- the controller controls light provided by at least one light providing region to control an intensity distribution of R, G or B light reflected by the scene that is incident on pixels of the photosurface. In some embodiments of the present invention the controller controls intensity of light provided by each light providing region so as to control intensity of light illuminating a region of the scene illuminated by light from the light providing region independently of intensity of light illuminating other regions of the scene. In some embodiments of the present invention the controller controls light provided by at least one light providing region to control an intensity distribution of light reflected by the scene that is incident on pixels of the photosurface.
- the controller receives signals generated by each pixel responsive to light incident on the pixel and controls light provided by at least one of the light providing regions responsive to the signals to adjust illumination of the scene.
- the controller controls light provided by at least one light providing region to decrease intensity of light reaching the camera from a region of the scene for which intensity of light incident on a pixel that images the region is greater than a predetermined maximum intensity.
- the controller controls light provided by at least one light providing region to increase intensity of light reaching the camera from a region of the scene for which intensity of light incident on a pixel that images the region is less than a predetermined minimum intensity.
- the camera comprises a user operated input terminal to transmit instructions to the controller and wherein the controller controls light from at least one of the light providing regions responsive to the instructions to adjust illumination of the scene.
- the input terminal comprises a display screen.
- the controller generates a preview of an image of the scene being imaged by the camera on the screen, responsive to signals that it receives from the pixels.
- the screen is a touch sensitive screen on which a border can be delineated surrounding an object or region in the preview of the scene to select the object or region by touching the screen.
- the camera comprises a pointer controllable to select an object or region in the preview.
- the controller controls light provided by light providing regions responsive to the selected region or object.
- the controller displays a control panel having control icons on the screen and wherein manipulation of the control icons transmits instructions to the controller.
- the camera comprises a shutter that the controller opens and closes to gate the photosurface on and off.
- pixels in the photosurface are controllable to be gated on and off and wherein the controller gates the photosurface on and off by gating the pixels.
- the controller may simultaneously turn on and turn off light providing regions so as to radiate at least one pulse of light having a pulse width that illuminates the scene.
- the controller gates the photosurface on and off at times responsive to a time at which the at least one light pulse is radiated.
- the controller gates the photosurface off when the illumination system is providing light to illuminate the scene.
- the at least one light pulse comprises a train of light pulses.
- the controller gates the photosurface on for a first gate period after a first time lapse following each radiated light pulse of a first plurality of radiated light pulses in the train of light pulses; and gates the photosurface on for a second gate period after a second time lapse following each radiated light pulse of a second plurality of radiated light pulses.
- the mid points of first and second gate periods are delayed with respect to the radiated light pulses that they respectively follow by the same amount of time.
- the duration of the first gate is greater than or equal to three times the pulse width.
- the duration of the second gate period is substantially equal to the pulse width of the radiated light pulses.
- the controller determines intensity of light reaching the camera from a region of the scene from an amount of light incident on a pixel that images the region. Optimally, the controller controls light provided by the light providing regions so as to minimize a difference between a predetermined light intensity and intensity of light reaching each pixel in the photosurface from the scene.
- the controller may determine a distance to region of the scene imaged on a pixel of the photosurface responsive to amounts of light incident on the pixel during the first and second gates.
- each light providing region are light sources that emit light.
- Each light providing region comprises a laser.
- each light providing region comprises a light emitting diode.
- the camera comprises a light source and wherein the light providing regions provide light by reflecting and modulating light from the light source that is incident on the light providing regions.
- each light providing region comprises a micromirror controllable to reflect light in a direction towards the optics that focuses an image of the illuminator on the scene.
- each light providing region may comprises a liquid crystal having a controllable transmittance and a mirror and wherein light from the light source enters the liquid crystal and is reflected back out the liquid crystal cells by the mirror in a direction towards the optics that focuses an image of the illuminator on the scene.
- a method for illuminating a scene being imaged by a camera comprising a photosurface having pixels and optics for imaging the scene on the photosurface, the method comprising: illuminating the scene with an illuminator comprising a plurality of light providers so that each region of the scene that is imaged on a region of the photosurface comprising at least one pixel but less than all the pixels of the photosurface is illuminated with light provided by at least one light provider that provides light substantially only for the region; and controlling light provided the at least one light provider for a region of the scene to adjust illumination of the scene.
- the at least one pixel may a single pixel.
- the method comprises boresighting the illuminator so that a virtual image of the illuminator is located substantially at the photosurface.
- the virtual image of the illuminator is substantially coincident with the photosurface.
- a virtual image of each light provider is located within a different group of contiguous pixels on the photosurface.
- a virtual image of each light provider is located substantially within a corresponding single pixel.
- a virtual image of a plurality of light providers is located substantially within a corresponding single pixel.
- the light providers are independently controllable and wherein controlling each of the light providing regions comprises controlling each of the light providing regions independently of the other light providing regions.
- controlling light comprises controlling the light to control contrast in an image of the scene provided by the camera. In some embodiments of the present invention controlling contrast comprises controlling contrast in only a localized region of the image.
- controlling light comprises controlling the light to adjust an intensity distribution of light from the scene that is incident on pixels in the photosurface.
- adjusting an intensity distribution comprises controlling a parameter of the intensity distribution.
- controlling light comprises controlling the light to perform a predetermined image processing procedure.
- the image processing procedure comprises unsharp masking.
- the image processing procedure comprises sharpening.
- the image processing procedure comprises smoothing.
- the image processing procedure comprises histogramic equalization.
- a method of imaging comprising: illuminating at least a portion of a scene with substantially uniform lighting; determining a spatially varying illumination that reduces the variability of brightness values of the at least portion of the scene; illuminating the at least portion with said varying illumination; acquiring a second image of the at least portion, said second image having brightness values for areas thereof; and determining the brightness values of the scene under uniform illumination from the brightness values and the varying values of the illumination.
- illuminating comprises illuminating utilizing the method of any of claims 50-57.
- acquiring the second image comprises acquiring the images using a brightness acquisition range limited to the range of brightness values in the image.
- Fig. 1 schematically shows a camera comprising an illumination system having a pixelated illuminator boresighted with a photosurface of the camera, in accordance with an embodiment of the present invention
- Fig. 2 schematically shows another camera comprising an illumination system having a light projector and a "boresighted" pixelated illuminator, in accordance with an embodiment of the present invention
- Fig. 3 schematically shows a camera comprising an illumination system in which a pixelated illuminator of the illumination system is not boresighted with a photosurface of the camera, in accordance with an embodiment of the present invention
- Fig. 4 is a flow chart of a method for providing a high gray level resolution image, in accordance with an exemplary embodiment of the invention.
- FIG. 1 schematically shows a camera 20 comprising an illumination system 21, in accordance with an embodiment of the present invention.
- Camera 20 comprises a photosurface 22, such as a CCD or CMOS light sensitive surface, having pixels 24 and optics represented by a lens 26 for focusing an image of a scene on photosurface 22.
- a single lens 26 represents the optics
- the optics may comprise any suitable optical system, which may have a plurality of lenses and optical elements, as known in the art, for focusing images on photosurface 22.
- Illumination system 21 comprises a pixelated illuminator 30 having a plurality of light providing luxels 32.
- Pixelated illuminator 30 is boresighted with photosurface 22 using an appropriate beam splitter 34 and optical elements (not shown) as might be required, so that optimally, a virtual image of pixelated illuminator 30 is substantially coincident with photosurface 22. It is to be noted that because lens 26 is used both to focus an image of a scene being imaged with camera 20 on pixelated surface 22 and to focus light from pixelated illuminator 30 on the scene, that the virtual image of pixelated illuminator 30 remains automatically registered to photosurface 22 during zooming operations of the camera.
- pixelated illuminator 30 In general the size of pixelated illuminator 30 does not have to be the same as the size of photosurface 22. However, in order for a virtual image of pixelated illuminator 30 to be substantially coincident with photosurface 22, pixelated illuminator 30 or a real or virtual image of the pixelated illuminator that is boresighted with the photosurface must have a same size and shape as the photosurface. In Fig. 1 and figures that follow, for convenience of exposition, pixelated illuminator 30 is shown, by way of example, as having a same size as photosurface 22.
- Pixelated illuminator 30 is therefore shown boresighted with photosurface 22 without an optical system that provides an appropriate real or virtual image of the pixelated illuminator that has substantially a same size as photosurface 22.
- Pixelated illuminator 30 may be boresighted with photosurface 22 using methods similar to those described in US Patent Application 09/250,322 referenced above.
- luxels 32, of pixelated illuminator 30 are assumed to have a size and shape so that a virtual image of each luxel 32 is substantially coincident with a single pixel 24 of photosurface 22. There is therefore (since a virtual image of pixelated illuminator
- Mesh squares 40 are homologous with pixels 24 such that light that is collected by lens 26 that appears to come from any particular mesh square 40 is focused by the lens onto a single pixel 24 of photosurface 22 that corresponds to the particular mesh square.
- light provided by each luxel 32 is reflected by beam splitter 34 and illuminates substantially only, and all of, a single mesh square 40.
- the mesh square illuminated by the luxel 32 corresponds to the pixel 24 with which the virtual image of the luxel is coincident.
- Light from luxel 32 illuminates substantially only, and substantially all of, a single mesh square 40 as a result of the assumption, by way of example, that a virtual image of each luxel 32 is substantially coincident with a single pixel 24.
- size and shape of luxels 32 and position of pixelated illuminator 30 are such that light from adjacent luxels 32 overlap adjacent mesh squares 40.
- Illumination zones of the scene being imaged are those regions of the scene that can be illuminated by light from a single luxel 32. Boundaries of illumination zones of the scene are generally either coincident with or close to projections ofboundari.es of mesh squares 40 on the scene.
- Dashed lines 41 in Fig. 1 represent selected light rays between corresponding points at peripheries of photosurface 22, pixelated illuminator 30 and field of view 38. Arrowheads on dashed lines represent direction of travel of light. For lines 41 that have arrows pointing in both directions along the lines, arrowheads pointing towards field of view 38 indicate direction of light from pixelated illuminator 30 that illuminates the field of view. Arrowheads pointing away from field of view 38 indicate light reflected from field of view 38 that is focused on photosurface 20.
- the illumination zones of letter 51 would not of course be squares but would be defined by generally curvilinear boundaries determined by the shape of the surface of letter 51 (and the shape of luxels 32). If letter 51 were displaced away from object plane 36 in a direction perpendicular to object plane 36, adjacent illumination zones would overlap along their mutual borders, with the amount of overlap varying with the displacement. For example if the displacement of letter 51 were rectilinear and did not comprise a rotation, the overlap would increase linearly with magnitude of the displacement.
- the widths of the vertical "back” and horizontal “arms” of letter 51 are shown as having a width equal to a side of a mesh square 40 for convenience of presentation.
- the back and arms of letter 51 can of course be many mesh squares 40 wide and/or the widths can be equal to a fractional number of mesh squares or it can be offset from edges of the mesh squares.
- Luxels 32 in pixelated illuminator 30 that illuminate illumination zones of letter 51 are shaded.
- the shaded luxels 32 form an illumination pattern "E" 52, inverted top to bottom and reversed left to right, which corresponds to letter 51 in field of view 38.
- shaded pixels 24 in photosurface 22 indicate pixels 24 on which letter 51 in field of view 38 is imaged by camera 20, and form an image letter "E", 53 on the photosurface.
- Letter 53 in photosurface 22 is a reflection, in beam splitter 34, of letter 52 in pixelated illuminator 30.
- each shaded luxel 32 in letter 52 illuminates a single corresponding illumination zone 40 of letter 51 in field of view of 38.
- the illumination zones are referred to by the numeral 40 which identifies mesh squares 40.
- light provided by the luxel 32 at the tip of the short middle arm of letter 52 on pixelated illuminator 30 illuminates only that illumination zone 40 located at the tip of the short middle arm in letter 51.
- luxels 32 are controllable to provide desired patterns of illumination for a scene that is imaged with camera 20.
- luxels 32 are "color" luxels, for which light intensity as well as a spectrum of light provided by the pixels can be controlled to provide different color light.
- luxels 32 are RGB luxels controllable to provide different combinations of R, G and B light so as to control hue, saturation and intensity of light illuminating illumination zones of the scene.
- luxels 32 are "gray level” luxels that provide light having a fixed spectrum and for which only intensity of light provided by the pixels is varied.
- light provided by luxels 32 is not limited to the visible spectrum but may, for example, comprise infrared or ultraviolet light.
- Luxels 32 may provide and control light by emission, reflection or transmission, or a combination of these processes.
- luxels 32 may comprise one or a combination of light sources, such as for example semiconductor lasers, that provide light by emission, micro- mirrors that provide light by reflection and/or liquid crystal cells that provide light by transmission.
- the luxels may provide a multi-level controlled illumination.
- Illumination system 21 may comprise a controller 60 for controlling luxels 32 and a shutter 62 for shuttering photosurface 22.
- Controller 60 shutters light provided by pixelated illuminator 30 so as to provide at least one light pulse to illuminate a scene being imaged with camera 20.
- controller 60 shutters light from pixelated illuminator 30 by turning on and turning off luxels of luxels 32.
- camera 20 comprises a shutter, which is controlled by controller 60, to transmit and not transmit light in order to shutter light from pixelated illuminator 30, and provide at least one light pulse that illuminates a scene imaged by the camera.
- the shutter may, for example, be located between pixelated illuminator 30 and beam splitter 34. If pixelated illuminator 30 is an illuminator that provides light to illuminate a scene by reflecting light from a light source, such as the illuminator shown in Fig. 2, the shutter may be located between the light source and the illuminator.
- controller 60 controls shutter 62 so that during a time that luxels of luxels 32 are "on” to provide a pulse of light, shutter 62 does not transmit light.
- shutter 62 does not transmit light.
- the intensity of the light may be varied in one or more of the following ways:
- the number of pulses emitted from each of the luxels may be varied.
- 256 pulsed of light should be available for each frame (image) and the light level for each luxel adjusted by varying the number of pulses.
- a spatial attenuator having a controllable number of attenuation levels is used to adjust the illumination level.
- the length of light pulses is adjusted.
- the intensity of the light pulses is adjusted, as for example, by adjusting the current to laser luxel sources.
- shutter 62 is gated open for a limited accurately determined “gate” period of time, during which shutter 62 transmits light, following an accurately determined delay from the time that each light pulse of the at least one light is radiated.
- Light pulse width, repetition rate, gate width and relative timing of gates and light pulses are determined so that light from the light pulse that reaches photosurface 22 is reflected only by objects in a limited desired range of distances from camera 20.
- the range of distances defines a scene having a desired depth of field and distance (i.e. range) from the camera.
- range parameters are determined and the determined range parameters define a range and depth of field for a scene
- distance to a scene is determined and range parameters are determined responsive to the distance.
- the distance may be determined, for example, using devices and methods for determining range by focus or determining range by any of various time of flight techniques, techniques used in gated 3D cameras or geometrical techniques. Techniques for determining distances to regions in a scene are described in PCT applications PCT/IL98/00476 and PCT/IL98/00611 the disclosures of which are incorporated herein by reference.
- camera 20 is a 3D camera and illumination parameters are determined to provide a 3D map of an imaged scene.
- the parameters may be determined using methods and described in PCT Publications WO 97/01111, WO 97/01112, WO 97/01113.
- photosurface 22 is a "self shuttering" photosurface for which shuttering of the photosurface is accomplished by controlling circuits comprised in the photosurface.
- PCT publication WO 00/19705 the disclosure of which is incorporated herein by reference, describes self-shuttering photosurfaces in which each pixel in the photosurface comprises a circuit controllable to gate the pixel on or off.
- pixels 24 in photosurface 22 may have different types of spectral sensitivities.
- photosurface 22 is a gray level "colorblind" photosurface. All pixels 24 in the photosurface are gray level pixels that are sensitive to substantially only total intensity of light, in a same limited spectrum, incident on the pixels.
- photosurface 22 is a "color photosurface" 22, that provides a color image of a scene imaged by camera 20 and pixels 24 are color sensitive pixels, such as RGB pixels.
- pixels 24 are sensitive to infrared or ultraviolet light.
- pixelated illuminator 30 is an RGB color illuminator and that photosurface 22 is an RGB color photosurface.
- the surface of letter 51 that is imaged by camera 20 is white and that the letter is set against a black background.
- color of an image of letter 51, i.e. letter 53 formed on photosurface 22, provided by camera 20 can be changed.
- luxels 32 in illumination pattern 52 illuminate letter 51 with one of R, G or B light
- image 53 on photosurface 22 will be respectively red green or blue.
- camera 20 to provide a "rainbow" colored image of letter 51 by controlling different luxels on pixelated illuminator 30 to provide light of different hues.
- Light from luxels 32 can also be controlled to compensate for variations in reflectivity between different surface regions of letter 51. For example, assume that surface regions of the middle arm of letter 51 are faded and are characterized by relatively low reflectivity compared to other surface regions of letter 51. If intensity of illumination of the surface of letter 51 is substantially uniform, the middle short arm in an image of letter 51 provided by camera 20 will appear faded. To compensate, in accordance with an embodiment of the present invention, for the fading, intensity of light provided by luxels 32 in the middle arm of illumination pattern 52 (i.e. "E" 52) is increased relative to intensity of light provided by the other luxels 32 in illumination pattern 52.
- E intensity of light provided by luxels 32 in the middle arm of illumination pattern 52
- Extreme lighting effects can also be provided by an illumination system in accordance with an embodiment of the present invention. For example, if luxels 32 in the middle and lower arms of illumination pattern 52 are turned off so that they do not provide any light, only the back and bottom arm of letter 51 will be illuminated and an image of letter
- controller 60 can control light provided by pixelated illuminator 30 to "tint" her face so that it appears more vital. If the earrings appear too bright, controller 60 can control luxels 32 in pixelated illuminator 30 to decrease intensity of illumination of the earrings.
- an illumination system in accordance with an embodiment of the present invention, can control illumination of a scene being imaged by a camera so as to control both color and contrast of the image.
- camera 20 comprises a visual display screen 64 that a person using the camera 20 employs to transmit information to and receive information from controller 60.
- controller 60 may, for example, display a preview of the scene on screen 64.
- controller 60 also displays a control panel 66 having appropriate control buttons 68, such as toggle and slide buttons, and or a keyboard (not shown) for communicating instructions to controller 60.
- the user can indicate a region of the scene for which the user wishes to adjust illumination by selecting the region in the preview.
- Various methods known in the art may be used for selecting the region. For example, the user can touch the region with a finger or draw a contour around the region using a stylus.
- camera 20 comprises a mouse that can be used to draw a suitable border around a region to be selected or to point to an object for which object a region is automatically delineated using image processing methods well known in the art. Once a region is selected, the user indicates desired changes of illumination for the region by pressing or sliding appropriate control buttons shown on screen 66.
- Fig. 1 screen 64 shows a preview letter E, 70 of letter 51 as it will be imaged by camera 20 under illumination conditions that obtain at the time that preview 70 is shown.
- the bottom arm of the letter is faded, which is indicated by lighter shading of the bottom arm of "preview E" 70 in comparison to shading of other regions of the preview E.
- the user selects the bottom arm of preview letter 70.
- the user then instructs controller 60 to increase illumination of the region of letter 51 corresponding to the selected region of preview 70 by moving an appropriate slider displayed in control panel 66 by a desired amount.
- Controller 60 controls luxels 32 corresponding to the selected region responsive to the amount by which the user moved the slider and displays an adjusted preview of letter 51 on the output screen. If the user determines, responsive to the adjusted preview, that illumination of letter 51 requires further adjustment, the user again selects a region of the letter in the preview to be adjusted and indicates a desired adjustment of the illumination using displayed control panel 66. If the user determines that further adjustment is not required, the user instructs camera 20 to image letter 51.
- controller 60 receives signals from pixels 24 in photosurface 22 responsive to light that is incident on the pixels. In some embodiments of the present invention, controller 60 uses signals from pixels 24 to calibrate light output of luxels 32 that correspond to the pixels. The user controls camera 20 to image a suitable surface having uniform reflectivity that fills a field of view of camera 20. Controller 60 uses the signals to determine correspondence between control settings of luxels 32 and light output of the luxels.
- such measurement can also be used to determine overlap between luxels. For example, where individual pixels are selectively illuminated, the pixels are sequentially illuminated and the intensity on illumination acquired by the camera at adjacent pixels is determined. Similarly, when areas of the field of view are illuminated together, both edge fall-off and overlap can be determined in the same way. These measurements can be sued to correct certain of the results in some embodiments of the invention.
- controller 60 controls light provided by luxels 32 that correspond to the pixels, responsive to the signals. For example, assume that the user instructs controller 60 to increase brightness of a region of a scene being imaged by a desired amount. Controller 60 increases output intensity of the luxels until brightness of the region, as determined from signals from pixels 24, indicate that brightness of the region of the scene is of the desired magnitude.
- controller 60 automatically adjusts illumination of a scene imaged by camera 20 responsive to a particular algorithm so as to provide a desired contrast of an imaged scene. For example, in accordance with an embodiment of the present invention, controller 60 may automatically reduce illumination of illumination zones in the scene corresponding to pixels 24 that generate signals indicating that intensity of light incident on the pixels is greater than a predetermined intensity. Similarly controller 60 can be programmed to increase illumination of illumination zones for which corresponding pixels 24 indicate that intensity of incident light is low.
- controller 60 uses signals from pixels 24 to perform relatively more complicated processing of an image of a scene being imaged by camera 20. For example controller 60 may control illumination of the scene to provide smoothing of the image or sharpemng of the image. In some embodiments of the present invention controller 60 uses signals from pixels 24 to determine parameters, such as for example mean brightness and/or brightness range, of a brightness histogram of the imaged scene. Controller 60 then adjusts illumination of the scene so that the parameters in the image of the scene assume desired values. In some embodiments of the present invention a "histogram adjustment", such as a histogramic equalization of the image or a region of the image, is performed by controller 60 for a single histogram of total integrated light intensity reaching pixels 24.
- a histogram adjustment such as a histogramic equalization of the image or a region of the image
- controller 60 performs brightness histogram adjustments for each color light provided by pixelated illuminator 30. For example if pixelated illuminator provides RGB light, histogram adjustments are made for each of R, G and B light.
- camera 20 in accordance with an embodiment of the present invention, provides accurate determination of reflectance of regions in a scene being imaged by the camera and as a result high resolution processing of a scene being imaged by the camera.
- An aspect of some embodiments of the invention is concerned with the acquisition of high gray level resolution images utilizing a camera having a lower gray level resolution.
- An exemplary method for acquiring such an image is shown in Fig. 4.
- a first image with uniform lighting is first acquired (200).
- the brightness values in the image are used to determine illumination values for the pixels (202) such that the lighting differently illuminate the various regions of the field of view is adjusted to give a relatively flat (contrast-wise) image.
- These illumination values are stored (204). If the acquisition has a resolution of N gray levels (from zero to some maximum) the illumination may have up to N' illuminations spaced at intervals such that for each gray level there exists a combination of N and N' such that N*N-C, where C is a constant that is the same for all of the pixels. Under this flattening illumination, a second image is acquired (208).
- the intensity variations in this image are less than ⁇ 0.5 of the intensity distance between the initial gray levels.
- the acquisition range is set (206) to cover this range of gray levels with substantially the entire range of acquisition levels.
- the acquisition values are preferably stored (210). If M acquisition levels and P illumination levels are available, each pixel (i, j) is characterized by two numbers mjj and pjj. The gray levels of a uniformly illuminated image can thus (ideally) be derived to a resolution given by MxP gray levels.
- the illumination is controlled only over regions of greater than one pixel.
- the second image will have a variability that is larger than the variability when the illumination of the individual pixels are separately illuminated.
- the field of view is divided into Q regions. An uniformly lit image is acquired. The acquired intensity over the regions is averaged and the illumination is adjusted such that the acquired intensity (for a subsequent image) over all of the regions (based on the averages) is uniform to within the quantization accuracies of the illumination and the acquisition.
- each pixel is characterized by two numbers, one for the illumination and one for the acquisition.
- the number of levels for illumination and acquisition need not be the same. Thus, for example, if there are half as many illumination levels as there are acquisition levels, the illumination levels are matched to every second acquisition level, such that the total range of illuminations for the second acquisition is ⁇ 1 original gray level. The second acquisition is set to cover this range with the entire range of acquisition values.
- a very high resolution gray level (uniformly illuminated) image can be constructed (212) by generating an image in which each pixel has a brightness derived from the illumination level and the acquired brightness level.
- the first P bits of the image gray level would be given by the illumination values and the next M bits of the image gray level would be given by the acquisition levels of the second acquired image.
- two matrices are provided, for example in a memory in controller 60, one of which contains information on the illumination and the other info ⁇ nation on the second acquisition.
- an A/D that allows for adjusting the zero level for the acquisition (so that the acquisition starts at the gray level of the pixel with the lowest illumination) and the A/D gain, so that the highest acquisition gray level is matched with the brightest portion of the image.
- An iris may be provided to at least partially adjust the gain.
- the illumination elements illuminate pixels or groups of pixels without overlap.
- illumination of a pixel for individual pixel illumination
- illumination of a region for regional pixel illumination
- the reconstruction optionally takes into account the effects of illumination of adjacent pixels when determining the illumination to be used and in reconstructing the image.
- the overlap is adjusted such that, for uniform brightness of the sources, each pixel is uniformly illuminated. This can be achieved, for example, by providing for Gaussian roll off of the illumination, with the half illumination point at the edge of the portion being illuminated.
- the method may be used for acquiring only a portion of a scene or for acquiring a scene in piecewise portions.
- Fig. 2 schematically shows a camera 71 similar to camera 20 comprising an illumination system 72, in accordance with an embodiment of the present invention.
- Illumination system 72 comprises a pixelated illuminator 74 having luxels 76, a beam splitter 78 and a light source 80 that provides light that is incident on beam splitter 78.
- light source 80 is schematically shown, by way of example, as an incandescent lamp, light source 80 may comprise any suitable light source, such as for example a laser, an array of lasers, flash lamp, arc source and an integrating sphere.
- Light source 80 may also comprise optical elements required to coUimate and/or direct light from the light source so that the light is appropriately incident on beam splitter 78.
- Beam splitter 78 reflects a portion of the light so that it is incident on pixelated illuminator 74.
- dashed lines 41 and associated arrowheads indicate direction of travel of light along selected light rays.
- each luxel 76 in pixelated illuminator 74 comprises a liquid crystal (LC) cell (not shown) having a front surface that faces beam splitter 78 and its own reflecting electrode (not shown) at a back surface of the cell.
- LC liquid crystal
- Light from light source 80 that enters a luxel 76 enters the LC cell of the luxel and is reflected back out the luxel by the electrode.
- Voltage applied to the luxel's electrode controls transmittance of the luxel's LC cell and therefore intensity of light that exits the luxel.
- Light that exits the luxel 76 is incident on beam splitter 78, which transmits some of the light to beam splitter 34.
- Beam splitter 34 in turn reflects a portion of the light to illuminate an illumination zone of a scene being imaged with camera 71 that corresponds to the luxel.
- Controller 60 controls voltages applied to the pixel electrodes of luxels 76 and controls thereby light from the luxels that illuminates a scene being imaged with camera 71.
- light source 80 provides white light and each pixel electrode reflects substantially only R, G or B light.
- a luxel 76 of pixelated illuminator 74 therefore provides either R, G or B light.
- R, G and B luxels 76 may be grouped into groups of three luxels, each group comprising an R, G and B luxel and each such group corresponding to a single (color) pixel 24 in photosurface 22. (Assuming that each pixel 24 comprises an R, G and B photosensor, preferably, a configuration of the photosensors in the pixel is homologous with a configuration of the R, G and B luxels in the group of luxels corresponding to the pixel.
- virtual images of R, G and B luxels are slightly defocused so that each luxel 76 in a group of luxels illuminates the appropriate photosensor in the corresponding pixel 24.
- Controller 60 controls intensity, hue and saturation of illumination of the region by controlling intensity of light from each of the R, G and B luxels 76 that illuminate the illumination zones.
- light source 80 provides R, G and B light, using for example a color wheel, and pixel electrodes of luxels 76 are "white" reflectors characterized by a substantially same reflectivity for R, G and B light.
- Each luxel 76 optionally corresponds to a single pixel 24 and a region of a scene imaged on the pixel 24 corresponds to the illumination zone of the scene illuminated by the luxel 76.
- Controller 60 may control light source 80 to illuminate pixelated illuminator sequentially with R, G and B light. Controller 60 controls transmittance of the LC cells in luxels 76 in synchrony with R, G and B light from light source 80 to control hue, saturation and intensity of illumination of illumination zones in the imaged scene.
- pixelated illuminator is a DMD device and each luxel 76 comprises a micromirror (not shown). Controller 60 controls the micromirrors, using methods known in the art, to control intensity of light from light source 80 that is provided by each pixel 76.
- Fig. 3 schematically shows a camera 100 having a photosurface 22 and comprising an illumination system 102 having a pixelated illuminator 74 comprising luxels 76, a light source 80 and a beam splitter 78, in accordance with an embodiment of the present invention.
- Light from a scene imaged by camera 100 is focused by optics represented by a lens 26 onto photosurface 22.
- a field of view 38 of camera 100 in an object plane 36 of the camera is located at an appropriate position in the scene.
- Pixelated illuminator 74 is not boresighted with photosurface 22 and illumination system 102 comprises optics, represented by a lens 104, that focuses light from luxels 74 onto a scene imaged by camera 102.
- dashed lines 41 and associated arrowheads indicate direction of travel of light along selected light rays.
- light from light source 80 is directed to pixelated illuminator 74 by beam splitter 78.
- Each of luxels 76 reflects a controlled amount of light incident on the luxel from light source 80 towards optics 104.
- Optics 104 focuses the light from the luxel to an illumination zone in field of view 38.
- Optimally optics 104 forms an image of pixelated illuminator 74 at object plane 36 which is substantially coincident with field of view 38.
- illumination system 104 comprises a controller 60 that controls illumination system optics 104. Controller 60 adjusts optics 104 so that as camera 100 images scenes at different distances from the camera and distance of field of view 38 from the camera changes, light from pixelated illuminator 74 is appropriately focused to the field of view.
- illumination system 102 is similar to and functions similarly to illumination systems 21 and 72. Variations of illumination system 102, in accordance with embodiments of the present invention, can be used to provide gray level and/or color illumination of a scene imaged by camera 100 and/or perform any of the illumination adjustments described with respect to illumination systems 21 and 72 and variations thereof. Similarly, whereas illumination system 102 is shown comprising light source 80 and a "reflecting type" pixelated illuminator, other types of non-boresighted illumination systems, in accordance with an embodiment of the present invention, are possible and can be advantageous.
- a non-boresighted illumination system in accordance with an embodiment of the present invention, may be without a light source 80 and comprise a pixelated illuminator that emits light instead of one that reflects light.
- Any of the boresighted illumination systems and variations thereof described above can, in accordance with an embodiment of the present invention, be configured as a non-boresighted illumination system.
- illumination system 102 is shown, by way of example comprising a visual display 64 for communicating with a user.
- controller 60 controls pixel illuminator 74 to illuminate an imaged scene with a particular spatial and/or temporal "calibration" pattern of light. Controller 60 correlates response of pixels 24 in photosurface 22 with the calibration light pattern to determine alignment of pixelated illuminator 74 relative to photosurface 22 and determine which pixels 24 in photosurface 22 image each of the illumination zones of a scene illuminated by the illumination system. By way of example, controller 60 may turn on and turn off a pattern of luxels 76 in pixelated illuminator 74 so that the pixels in the pattern "flicker" and illuminate illumination zones of a scene imaged by camera 100 with flickering light.
- Controller 60 determines which pixels 24 in photosurface 22 generate signals indicating that light incident on the pixels is flickering in cadence with the titrning on and turning off of luxels 76 in the pattern. Controller 60 associates "flickering" photosurface pixels 24 with their corresponding luxels 76 and illumination zones in the scene. By determining which flickering luxels 76 correspond to which "flickering" photosurface pixels 24, controller 60 determines alignment of pixelated illuminator 76 relative to photosurface 22 and generates a "map" of which pixels in photosurface 22 image each of the illumination zones of a scene illuminated by the illumination system. Controller 60 uses the map to determine which luxels 76 to control to provide desired lighting of the scene.
- each of the verbs, "comprise” “include” and “have”, and conjugates thereof, are used to indicate that the object or objects of the verb are not necessarily a complete listing of members, components, elements or parts of the subject or subjects of the verb.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Microelectronics & Electronic Packaging (AREA)
- Optics & Photonics (AREA)
- Mechanical Engineering (AREA)
- Mathematical Physics (AREA)
- Lighting Device Outwards From Vehicle And Optical Signal (AREA)
- Image Input (AREA)
- Color Television Image Signal Generators (AREA)
- Studio Devices (AREA)
Abstract
Cette invention concerne un appareil photographique comprenant : une surface photographique avec des pixels photosensibles qui produisent des signaux en réponse à la lumière qui les frappe et une optique qui fait la mise au point sur la surface photographique ; et un système d'illumination illuminant la scène. Ce système d'illumination comporte lui-même une pluralité de régions émettant de la lumière, sensiblement contiguës et pouvant être commandées séparément; une optique projetant l'image de l'illuminateur sur la scène de sorte que la lumière provenant dudit illuminateur éclaire sensiblement la totalité du champ de vision de l'appareil photographique à l'exclusion de sensiblement toute autre chose ; et une unité de commande qui règle la lumière fournie par chacune des régions d'où provient la lumière.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/IL2000/000404 WO2002005549A1 (fr) | 1999-02-16 | 2000-07-09 | Appareil photographique avec illuminateur de pixels de type reflex |
Publications (1)
Publication Number | Publication Date |
---|---|
EP1302066A1 true EP1302066A1 (fr) | 2003-04-16 |
Family
ID=11042986
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP00942347A Withdrawn EP1302066A1 (fr) | 2000-07-09 | 2000-07-09 | Appareil photographique avec illuminateur de pixels de type reflex |
Country Status (4)
Country | Link |
---|---|
EP (1) | EP1302066A1 (fr) |
JP (1) | JP2004503188A (fr) |
AU (1) | AU2001269414A1 (fr) |
WO (1) | WO2002004247A1 (fr) |
Families Citing this family (37)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6445884B1 (en) | 1995-06-22 | 2002-09-03 | 3Dv Systems, Ltd. | Camera with through-the-lens lighting |
DE10129743C2 (de) * | 2001-06-20 | 2003-05-08 | Daimler Chrysler Ag | Fahrzeugscheinwerfer, mit einer Anzahl von elektronischen Leuchtelementen als Lichtquelle |
EP1335235A3 (fr) * | 2002-02-12 | 2003-09-17 | MARICO s.a.s di Dallara Riccardo & C. | Un système de vision utilisant la projection des figures de la lumière |
DE10227170A1 (de) * | 2002-06-18 | 2004-01-08 | Bayerische Motoren Werke Ag | Verfahren und Vorrichtung zur Steuerung der Lichtverteilung eines Kraftfahrzeugs |
DE10354104A1 (de) * | 2003-11-19 | 2005-06-02 | Bayerische Motoren Werke Ag | Verfahren zur Steuerung der Ausleuchtung eines seitlichen Fahrbahnbereichs mittels eines Hilfsscheinwerfers für ein Fahrzeug |
JP5026969B2 (ja) * | 2004-08-06 | 2012-09-19 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Led照明システム |
DE102005032848A1 (de) * | 2005-07-14 | 2007-01-25 | Robert Bosch Gmbh | Verfahren und Vorrichtung zur Fahrerunterstützung |
JP2008226140A (ja) * | 2007-03-15 | 2008-09-25 | Mazda Motor Corp | 車両の運転支援装置 |
EP2208354A4 (fr) | 2007-10-10 | 2010-12-22 | Gerard Dirk Smits | Projecteur d'image avec suivi de lumière réfléchie |
DE102008025947A1 (de) * | 2008-05-30 | 2009-12-03 | Hella Kgaa Hueck & Co. | Verfahren und Vorrichtung zum Steuern der Lichtabgabe eines Frontscheinwerfers eines Fahrzeugs |
DE102009050282A1 (de) * | 2009-10-21 | 2011-04-28 | GM Global Technology Operations, Inc., Detroit | Vorrichtung und Verfahren zur Steuerung zumindest eines Scheinwerfers eines Fahrzeugs |
DE202010006097U1 (de) * | 2009-12-22 | 2010-08-05 | Automotive Lighting Reutlingen Gmbh | Lichtmodul für einen Kraftfahrzeugscheinwerfer |
US12025807B2 (en) | 2010-10-04 | 2024-07-02 | Gerard Dirk Smits | System and method for 3-D projection and enhancements for interactivity |
US9199574B2 (en) | 2012-09-11 | 2015-12-01 | Gentex Corporation | System and method for detecting a blocked imager |
DE102013102764A1 (de) | 2013-03-19 | 2014-09-25 | Dr. Ing. H.C. F. Porsche Aktiengesellschaft | Verfahren zum Beleuchten von mindestens einem reflektierenden Hinweiselement |
DE102013213375A1 (de) | 2013-07-09 | 2015-01-15 | Ford Global Technologies, Llc | Verfahren zur Steuerung der Lichtverteilung von Kraftfahrzeug-Frontscheinwerfern |
DE102013017625B4 (de) * | 2013-10-23 | 2017-03-09 | Audi Ag | Verfahren zum Betreiben einer Fahrerassistenzeinrichtung eines Kraftfahrzeugs sowie Fahrerassistenzeinrichtung |
DE102014001299A1 (de) * | 2014-01-31 | 2015-08-06 | Audi Ag | Verfahren zum Betreiben eines Scheinwerfers für ein Kraftfahrzeug sowie Scheinwerfer |
FR3019260B1 (fr) * | 2014-04-01 | 2019-04-05 | Valeo Vision | Eclairage a couleur adaptative |
DE102014106854A1 (de) * | 2014-05-15 | 2016-01-28 | Odos Imaging Ltd. | Bildgebendes System und Verfahren zum Überwachen eines Sichtfeldes |
WO2016025502A1 (fr) * | 2014-08-11 | 2016-02-18 | Gerard Dirk Smits | Systèmes et procédés de poursuite à base de triangulation tridimensionnelle et de temps de vol |
FR3034841B1 (fr) * | 2015-04-08 | 2019-12-13 | Psa Automobiles Sa. | Dispositif d’eclairage pour un bloc optique de vehicule, a faisceau lumineux assurant un eclairement constant d’un obstacle quelle que soit sa position |
CN107851184B (zh) * | 2015-07-28 | 2022-12-23 | 苹果公司 | 用于光和图像投影的***和方法 |
CN108025670A (zh) * | 2015-10-27 | 2018-05-11 | 株式会社小糸制作所 | 车辆用灯具 |
WO2017106875A1 (fr) | 2015-12-18 | 2017-06-22 | Gerard Dirk Smits | Détection de position en temps réel d'objets |
KR101770642B1 (ko) * | 2016-05-16 | 2017-09-05 | 엘지전자 주식회사 | 차량용 조명 장치 및 차량 |
CN110073243B (zh) | 2016-10-31 | 2023-08-04 | 杰拉德·迪尔克·施密茨 | 利用动态体素探测的快速扫描激光雷达 |
DE102016122492A1 (de) * | 2016-11-22 | 2018-05-24 | HELLA GmbH & Co. KGaA | Erzeugung einer homogenen Lichtverteilung in Abhängigkeit von der Topografie und der gemessenen Leuchtdichte |
EP3563347A4 (fr) | 2016-12-27 | 2020-06-24 | Gerard Dirk Smits | Systèmes et procédés pour la perception par les machines |
JP7246322B2 (ja) | 2017-05-10 | 2023-03-27 | ジェラルド ディルク スミッツ | 走査ミラーシステム及び方法 |
WO2019079750A1 (fr) | 2017-10-19 | 2019-04-25 | Gerard Dirk Smits | Procédés et systèmes permettant la navigation d'un véhicule équipé d'un nouveau système à marqueurs de repères |
WO2021174227A1 (fr) | 2020-02-27 | 2021-09-02 | Gerard Dirk Smits | Balayage à haute résolution d'objets distants avec des faisceaux laser panoramiques rapides et récupération de signal par réseau de pixels agité |
DE102020126935B4 (de) | 2020-10-14 | 2022-05-05 | Dr. Ing. H.C. F. Porsche Aktiengesellschaft | Verfahren zum Ansteuern eines Scheinwerfers eines Fahrzeugs mit Beleuchtungsfunktion von Überkopf-Straßenschildern und entsprechend konfigurierter Scheinwerfer |
EP3984818A1 (fr) | 2020-10-19 | 2022-04-20 | ZKW Group GmbH | Dispositif d'éclairage pour un phare de véhicule automobile |
DE102021127180A1 (de) * | 2021-10-20 | 2023-04-20 | Cariad Se | Verfahren zum Betreiben einer Scheinwerfervorrichtung für ein Fahrzeug sowie Kraftfahrzeug mit einer Scheinwerfervorrichtung |
EP4306362A1 (fr) * | 2022-07-15 | 2024-01-17 | ZKW Group GmbH | Système d'éclairage de véhicule automobile |
FR3140823A1 (fr) * | 2022-10-17 | 2024-04-19 | Alstom Holdings | Voiture de véhicule comprenant un système de projection configuré pour émettre au moins un faisceau lumineux, véhicule associé |
Family Cites Families (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4501961A (en) | 1982-09-01 | 1985-02-26 | Honeywell Inc. | Vision illumination system for range finder |
JPS59193682A (ja) * | 1983-04-18 | 1984-11-02 | Omron Tateisi Electronics Co | 撮像システム |
JPH04133570A (ja) * | 1990-09-25 | 1992-05-07 | Kyocera Corp | 像記録装置 |
JPH05137039A (ja) * | 1991-11-14 | 1993-06-01 | Asahi Optical Co Ltd | 電子カメラ |
DE4341409C2 (de) * | 1993-12-04 | 2002-07-11 | Bosch Gmbh Robert | Einrichtung zur Regelung der Leuchtweite von Scheinwerfern von Kraftfahrzeugen |
JPH07301513A (ja) * | 1994-05-02 | 1995-11-14 | Komatsu Ltd | 対象物の認識装置 |
AU6135996A (en) | 1995-06-22 | 1997-01-22 | 3Dv Systems Ltd. | Improved optical ranging camera |
IL114278A (en) | 1995-06-22 | 2010-06-16 | Microsoft Internat Holdings B | Camera and method |
US5828485A (en) | 1996-02-07 | 1998-10-27 | Light & Sound Design Ltd. | Programmable light beam shape altering device using programmable micromirrors |
JPH11164183A (ja) * | 1997-11-25 | 1999-06-18 | Nikon Corp | 画像入出力装置 |
EP2312363B1 (fr) * | 1998-05-25 | 2013-09-18 | Panasonic Corporation | Télémètre et caméra |
US6146018A (en) | 1998-06-26 | 2000-11-14 | 3M Innovative Properties Company | Gift package |
EP1515541A3 (fr) | 1998-09-28 | 2008-07-23 | 3DV Systems Ltd. | Mesure de distance au moyen d'une caméra |
EP1147370B1 (fr) | 1998-12-16 | 2009-02-25 | 3DV Systems Ltd. | Surface photosensible a deblocage automatique |
US7224384B1 (en) | 1999-09-08 | 2007-05-29 | 3Dv Systems Ltd. | 3D imaging system |
-
2000
- 2000-07-09 EP EP00942347A patent/EP1302066A1/fr not_active Withdrawn
- 2000-07-09 JP JP2002509283A patent/JP2004503188A/ja active Pending
-
2001
- 2001-07-09 AU AU2001269414A patent/AU2001269414A1/en not_active Abandoned
- 2001-07-09 WO PCT/IL2001/000627 patent/WO2002004247A1/fr active Application Filing
Non-Patent Citations (1)
Title |
---|
See references of WO0205549A1 * |
Also Published As
Publication number | Publication date |
---|---|
WO2002004247A1 (fr) | 2002-01-17 |
AU2001269414A1 (en) | 2002-01-21 |
JP2004503188A (ja) | 2004-01-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7355648B1 (en) | Camera having a through the lens pixel illuminator | |
EP1302066A1 (fr) | Appareil photographique avec illuminateur de pixels de type reflex | |
US8736710B2 (en) | Automatic exposure control for flash photography | |
US7661828B2 (en) | Adjusting light intensity | |
US8004766B2 (en) | Illuminating device, illuminating method, image signal processing device, image signal processing method, and image projecting apparatus | |
US10359277B2 (en) | Imaging system with synchronized dynamic control of directable beam light source and reconfigurably masked photo-sensor | |
US6556706B1 (en) | Three-dimensional surface profile imaging method and apparatus using single spectral light condition | |
EP4053499A1 (fr) | Dispositif de mesure tridimensionnelle | |
KR20160007361A (ko) | 투영광원을 구비한 촬영방법 및 그 촬영장치 | |
JP2004503188A5 (fr) | ||
JP2004212385A (ja) | 撮影装置とその撮影装置の撮影方法及び制御方法 | |
TWI801637B (zh) | 用於相機之紅外光預閃光 | |
US20080151194A1 (en) | Method and System for Illumination Adjustment | |
CN110702031B (zh) | 适用于深色表面的三维扫描装置及扫描方法 | |
KR20110002045A (ko) | 스펙클 감소 시스템 및 그 방법 | |
US20220034651A1 (en) | Energy optimized imaging system with synchronized dynamic control of directable beam light source and reconfigurably masked photo-sensor | |
KR20200028406A (ko) | 측정 물체의 표면을 광학적으로 측정하는 방법 및 장치 | |
JP7401013B2 (ja) | 情報処理装置、制御装置、情報処理方法及びプログラム | |
JPS62130473A (ja) | 描画電気信号発生装置 | |
JP7005175B2 (ja) | 距離測定装置、距離測定方法及び撮像装置 | |
GB2482562A (en) | Light control device | |
TW201621451A (zh) | 投影裝置及將影像用像素方式投影的方法 | |
CN110710201B (zh) | 用于激光投影单元的运行方法和控制单元以及激光投影单元 | |
Siegmann et al. | Fundaments in luminance and retroreflectivity measurements of vertical traffic signs using a color digital camera | |
EP3560184B1 (fr) | Compensation de vignettage |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20030207 |
|
AK | Designated contracting states |
Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20050201 |