Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
  • H04N23/70—Circuitry for compensating brightness variation in the scene
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
  • H04N23/70—Circuitry for compensating brightness variation in the scene
  • H04N23/75—Circuitry for compensating brightness variation in the scene by influencing optical camera components

Definitions

• the present invention relates to a device for increasing the dynamic range of a camera, thereby making it tolerant of significant differences in brightness between the points of the scene of which an image is perceived.
• the devices known to date, of the tube camera or charge transfer device type tolerate very little glare and have a dynamic, ratio of the strongest lightings to the weakest lightings simultaneously and correctly perceived, very low, the order of a hundred.
• the present invention intends to remedy these drawbacks by restoring a stable image and a high dynamic, which may be greater than one hundred thousand.
• the restored image can correspond to a very high sensitivity.
• the device which is the subject of the present invention is a device for increasing the dynamic range of a camera comprising a primary electronic image sensor operating in a spectral band and providing image information for a range of values. of light intensities reaching it according to a first dynamic, said dynamic corresponding to the ratios of the strongest light intensities to the weakest light intensities in this area, and an objective forming an image of a scene on said primary image sensor, characterized in that it comprises a second source of image information, said image information coming from at least one image of said scene taken through said objective in the same spectral band as that of the primary image sensor and an electronic image processing circuit combining the information coming from the primary image sensor and the information coming from the second source of image information and providing informa ⁇ image tions representative of the perceived scene with a ratio of the highest light intensities to the weakest light intensities of the areas of this scene represented by this restored image information, said ratio being greater than the dynamic range of the image sensor primary images.
• the second source of image information can comprise a secondary image sensor capturing the same image as the primary image sensor but with a different sensitivity.
• the second source of image information can also include an image memory.
• the image information stored in said image memory can correspond to an image previously taken by the primary image sensor, to an image originating from a processing carried out on an image previously captured by the primary image sensor. ⁇ mayor, an image from several shots previously taken by the primary image sensor, combined or added together.
• image information processing systems are adaptable to these different embodiments. They relate in particular to the control of the sensitivity of the primary image sensor, over its entire surface or by zones using a flat matrix screen optically placed in front of the primary image sensor.
• tone in the mathematical sense of the term, as a function of the light intensities of the points of the scene perceived by the primary image sensor.
• the dynamic is defined as being, for the light rays incident on said image sensor, the ratio of the strongest light intensities to the light intensities the weaker than he perceives simultaneously and correctly. Between these two values, it returns image information representative of the light intensity. The lowest value is equal to the sensitivity. Above the highest value, the sensor is saturated and the image information is constant.
• the sensor comprises a photo-sensitive surface and circuits for controlling the operation of each point of this photo-sensitive surface.
• control circuits known per se, are not shown in the figures nor detailed in the description.
• image also designates the frames provided by certain image sensors, for which two frames form an image.
• Figure 1 is a schematic representation of the operative device object of the present invention.
• Figure 2 is a schematic representation of a first preferred embodiment of the device according to the invention comprising a single image sensor.
• FIG. 3 is a schematic representation of a second embodiment of the device according to the invention comprising two image sensors of different sensitivities.
• FIG. 4 is a representation of control potentials of grids of a charge transfer image sensor incorporated in the two embodiments of the device object of the invention, as shown in FIGS. 2 and 3.
• FIG. 1 are represented a scene 1 and, on an optical axis A and in a partially shown camera housing B, a shutter flat screen 13, a lens 2 forming an image 6 of scene 1 on a primary electronic image sensor 3 and a flat matrix screen 11 optically placed in front of the primary image sensor 3.
• the primary image sensor 3 comprises an electronic shutter 47.
• a second source of image information 4 is shown, an electronic image processing circuit 5 having an electrical connection 7 with the primary image sensor 3, an electrical connection 8 with the second source d '' information image 4, and an electrical output link 9 connected to a conversion table 12 having an electrical output connection 14.
• a circuit 10 for controlling the sensitivity of the primary image sensor 3 is connected by an electrical connection 16 to the image processing circuit 5, by an electrical connection 17 to the primary image sensor 3, by an electrical connection 18 to the shutter flat screen 13 and by an electrical connection 15 to the matrix flat screen 11.
• Electrical connections may include one or more several electrical connections so as to transmit information in series or in parallel.
• Objective 2 is of known type, in particular in the production of video cameras, and is either interchangeable or definitively linked with camera housing B.
• the primary image sensor 3 is of known type, in particular in the production of electronic and video cameras. It correctly and simultaneously picks up light intensities reaching it in a given spectral band, in a limited value range of light intensities. Its sensitivity defines the lowest value in this area and depends on the transparency of the optical components which separate it from scene 1, a value also called aperture. Its dynamics are defined as being, for the light rays incident on this primary image sensor 3, the ratio of the strongest light intensities to the weakest light intensities which it perceives simultaneously and correctly. Between these two extreme values, it returns image information representative of the light intensity. The lowest value is equal to the sensitivity. Above the highest value, the sensor is saturated and the image information is constant, in the following we call “response domain" the domain of the light intensity values of the areas of scene 1 for which the values light intensities incident on the primary image sensor 3 are between these two extreme values.
• This primary image sensor 3 comprises a photo-sensitive surface and a circuit for controlling the operation of each point of this photo-sensitive surface.
• the primary image sensor 3 provides information representative of the light intensity received by each point of its photo-sensitive surface, light intensity coming from an area of scene 1 and forming an image 6 on this photo-sensitive surface.
• This image information is provided in a way sequential, that is to say representing the incident light intensity arriving successively on each of the points of the primary image sensor 3.
• the second source of image information 4 provides on the electrical link 8, and simultaneously with the primary image sensor 3, image information corresponding to scene 1 taken through the objective 1. That is to say that for each point of scene i for which the objective 2 forms an image on a point of the primary image sensor 3, the information concerning this point of scene 1 is transmitted simultaneously by the sensor primary image 3 and the second image information source 4.
• the second source of image information 4 is constituted either by a secondary image sensor capturing the same image as the primary image sensor 3 but with a different sensitivity (FIG. 3) or by a image memory in which image information from the primary image sensor 3 is stored (FIG. 2).
• the image information leaving said image memory on the electrical link 8 may correspond to an image previously taken by the primary image sensor 3 with a sensitivity different from that corresponding to the image simultaneously leaving from this primary image sensor 3, to an image originating from a processing carried out on an image previously captured by the primary image sensor, an image originating from several shots previously taken by the primary image sensor 3, combined or added together.
• the information coming from the primary image sensor 3 and from the second source of image information 4 corresponds to images of scene 1 viewed with different sensitivities, therefore also corresponding to fields nes of luminous intensities of the points of scene 1 different.
• the image processing circuit 5 combines the information coming from the primary image sensor 3, on the link - 7 -
• the device according to the invention therefore allows the increase in dynamic range of a camera whose case B comprises the primary image sensor 3 and the objective 2 forming the image "6 of scene 1 on the primary image sensor 3
• it comprises a second source of image information 4 coming from at least one image of said scene 1 and an electronic image processing circuit 5 combining the information coming from the primary image sensor 3 and the information coming from the second source of image information 4 and providing image information representative of scene 1 with a ratio of the strongest light intensities to the weakest light intensities of the areas of this scene 1 represented by this information 0 image mations, greater than the dynamic range of the i sensor primary school 3.
• the conversion table 12 performs an application, in the mathematical sense of the term between two sets of signal values, one coming from it on connection 9, the other coming out on connection "14.
• the conversion table sion includes, for example, a memory on which the bus address is connected to connection 9 and the data bus is connected to connection 14. This memory is loaded beforehand by a device not shown. It can be a random access memory, dynamic or static or a read-only memory, possibly programmable.
• the advantage of this conversion table is to format the image information leaving the device so that it is easier to view on a monitor.
• the flat shutter screen 13 which is controlled by the circuit 10 for controlling the sensitivity of the primary image sensor 3 via the electrical connection 18 has a transmittance electrically controlled over a single optical operating zone.
• the flat shutter screen 13 may in particular include a flat liquid crystal screen, for example nematic or ferroelectric and two polarizers between which is the liquid crystal.
• the shutter flat screen 13 varies the sensitivity of the primary image sensor 3 as a function of its transmittance.
• the matrix flat screen 11 has a network of points for which the transmittance is independently controlled electrically.
• the matrix flat screen 1 1 may, for example, include a liquid crystal screen used in certain pocket televisions.
• An electrical signal for transmittance control of each of the points of the matrix flat screen 11 is sent, through the electrical connection 15, by the control circuit 10 of the sensitivity of the primary image sensor 3.
• the transmittance of each point of the matrix flat screen 11 controls the sensitivity of the points of the primary image sensor 3 which is optically behind it.
• the control circuit 10 for the sensitivity of the primary image sensor 3 controls a transparency of each point of the matrix flat screen 11 according to a decreasing function of the light intensity received by the points of the primary image sensor 3 which are optically placed behind said point of the matrix flat screen 11.
• the sensitivity points of the primary image sensor 3 is a decreasing function of the light intensity of the light rays which reach it.
• the control circuit 10 controls the duration of this opto-electronic operation by controlling the electronic shutter 47 of the primary image sensor 3. To do this, it sends, thanks to the electrical connection 17, an impulse d 'a duration equal to that of this opto-electronic operation, ie a code which corresponds to this duration, depending on the type of primary image sensor 3 used.
• the variation in the opto ⁇ electronic operating time of the primary image sensor 3 controlled by the electronic shutter 47 corresponds to a variation in sensitivity of the primary image sensor 3.
• the primary image sensor 3 controls the control voltage of each of the points of the primary image sensor 3. Finally, it independently controls the duration of the opto-electronic operation of each of the points of the primary image sensor 3.
• the primary image sensor 3 must be adapted and matrix connections with each of the points of this primary image sensor 3 must be electrically accessible by the control circuit 10.
• the potential zones or grids of each point of the primary image sensor 3 can be controlled individually so that the creation of electrical outlets at each photo point -sensitive by opto-electronic effect, ie a decreasing function of the light intensity of the rays reaching this point.
• the control of the potentials of these grids being carried out by the sensitivity control means 10 in the same way as the control of the matrix flat screen 11, by matrix slaving.
• the primary image sensor 3 takes images with an alternately high and low sensitivity controlled by the sensitivity control circuit 10.
• the second source of image information 4 comprises a memory which stores image information and restores it as indicated above and the electronic image processing circuit 5 combines the information leaving the memory and the primary image sensor 3.
• the primary image sensor 3 takes images with constant sensitivity
• the second source of image information 4 includes a memory in which the information leaving the processing circuit is stored. 5, the image processing circuit 5 carrying out a weighted average of the image information coming from the primary image sensor 3 and from the memory, with a weighting coefficient varying as a function of the light intensities to which the image information corresponds and restoring an image at the same frequency as the primary image sensor 3.
• the information stored in the memory corresponds to a greater sensitivity and to a dynamic range than the information from the primary image sensor 3.
• the primary image sensor 3 operates with a high frequency
• the second source of image information 4 comprises a memory in which are stored information leaving the image processing circuit 5 at the same high frequency, the image processing circuit combining in the memory the information coming successively from the primary image sensor 3 and that stored in the memory and li- - li ⁇
• the second source of image information 4 comprises a network of memories placed on the primary image sensor component 3, next to each point of its photo-sensitive surface and the cir ⁇ image processing cooked 5 controls the coefficient of transfer of image information from each point of the photo-sensitive surface to the juxtaposed memory as a function of the light intensity incident on said point and then reads this memory and restores as well as scene image information.
• An example of this fourth operating mode is presented with reference to FIG. 4.
• the second source of image information comprises a memory in which are stored state information of the flat screen 11 and / or information of influence of each point of the matrix flat screen 11 and the image processing circuit calculates for each point of the primary image sensor 3, the transparency of the optical system which precedes it and the light intensities of the area of scene 1 whose light reaches said primary image sensor point 3.
• two image sensors simultaneously capturing the same image with different sensitivities supply image information to the image processing circuit which combines this information.
• FIG. 2 are shown a scene 1 and, on an optical axis A and in a partially shown camera housing B, a three-color flat screen 25, a flat shutter screen 13, a lens 2 forming an image 6 of scene 1 on an electronic primary image sensor 3 and comprising an electrically controlled diaphragm 46 and a matrix flat screen 11 placed optically in front of the primary image sensor 3.
• the primary image sensor comprises an electronic shutter 47.
• a second source of image information 4 is represented comprising an image memory 19, a state memory 26 of the matrix flat screen 11, a data memory 27, an electronic image processing circuit 5 having two electrical connections 7A and 7B with the primary image sensor 3, eight electrical connections 8A, 8B, 8C, 8D, 8E, 8F, 8G and 8H with the second source informat image ions 4 , the electrical connections 8A and 8B and 8G being connected to the image memory 19, the electrical connections 8C, 8D, and 8E being connected to the state memory 26 of the flat screen matrix 11, the electrical connections 8F and 8G being connected to the geometric data memory 27, and an electrical output link 28 of the image processing circuit 5, indirectly connected to a conversion table 12 having an electrical connection output 14.
• a circuit 10 for controlling the sensitivity of the primary image sensor 3 is connected at its inputs by an electrical connection 16 to the image processing circuit 5 and by an electrical connection 32 to the state memory 26 , and, at its outputs, by an electrical connection 17 to the primary image sensor 3, by an electrical connection 18 to the shutter flat screen 13, by an electrical connection 15 to the matrix flat screen 11 and to the electric diaphragm 46.
• Outputs of the state memory 26 are respectively connected to an input of the geometrical data memory 27 and at an input to the control circuit 10.
• the conversion table 12 has a data input connection 9 and is electrically connected at its output to a digital analog converter 29 having an output connection 30.
• the image processing circuit 5 comprises a image start detector 31 connected to the output of the primary image sensor 3 and a gate potential control sequencer 33 itself connected at its input to the image start sensor 31 and, in its output, at the electrical connection 7B of the primary image sensor 3.
• the image processing circuit 5 comprises an analog function circuit 34, an analog digital converter 35, a multiplier 36, an adder 37 interconnected successively.
• the adder 37 is connected at its output to the connection 8B and to an input of a switch 40 whose second input is connected to the connection 8A and whose single output is connected to the connection 9 of the conversion table 12
• a switch 39 connects one of its two inputs, linked to a conversion table 38 and to the connection 8A, to the adder 37.
• the conversion table 38 is connected at its input to the output of switch 40.
• a contrast measurement means 41 is connected at the input to the connection 14 and at the output to the conversion table 12 and to the circuit 10 for controlling the sensitivity of the primary image sensor 3.
• a dazzle halo detector 48 is connected to connections 8A and 8B at its inputs and to the control circuit 10 at its output.
• a variable threshold circuit 42 is connected at the input to the output of the primary image sensor 3 and to the state memory * 26 of the matrix flat screen 11 and at the output to said state memory 26.
• a cal culateur 43 is connected at its inputs to the state memory 26 and to the memory of geometric data 27 and, at its output, to the multiplier 36.
• a divider by two 44 is connected at its input to the connection 7A of output of the primary image sensor 3 and at its output to the control circuit 10, to commands of position of the switches 39 and 40 and to a divider by three 45 which is itself connected to the three-color flat screen 25.
• the electrical connections may include one or more electrical connections so as to transmit information in series or in parallel.
• a circuit assembly D comprises the switch 40, the conversion table 12 and the analog digital converter 29.
• a circuit assembly C comprises the circuits of the circuit assembly D to which are added the analog function circuit 34, the analog digital converter 35, the multiplier 36, the adder 37, the switch 39 and the conversion table 38.
• the electronic primary image sensor 3 is of known type, notably in the production of video cameras. It correctly and simultaneously picks up light intensities reaching it in a given spectral band, in a value range of limited light intensities. Its sensitivity defines the lowest value in this area and depends on the transparency of the optical components which separate it from scene 1, a value also called aperture. Its dynamic is defined as being the ratio of the strongest light intensities to the weakest light intensities which it perceives simultaneously and correctly. Between these two extreme values, it returns image information representative of the light intensity. The lowest value is equal to the sensitivity.
• the sensor is saturated and the image information is constant, in the following we call “response domain” the domain of the light intensity values of the areas of scene 1 for which the values of the light intensities incident on the primary image sensor 3 are between these two extreme values.
• This sensor comprises a photo-sensitive surface and a circuit for controlling the operation of each point of this photo-sensitive surface.
• the primary image sensor 3 provides information representative of the light intensity received by each point of its photo ⁇ sensitive surface, light intensity coming from an area of scene 1 and forming an image 6 on this photo ⁇ sensitive surface.
• This image information is provided sequentially, ie representing the incident light intensity arriving successively on each of the points of the primary image sensor 3.
• the image memory 19, incorporated in the second source of image information 4 provides on the electrical link 8A, and simultaneously with the primary image sensor 3, image information corresponding to the scene 1 taken through the lens 1. This means that for each point of scene 1 for which the lens 2 forms an image on a point of the primary image sensor 3, the information concerning this point of the scene. 1 are transmitted simultaneously by the primary image sensor 3 and from the second source of image information 4.
• the circuit of analog function 34 has the function of amplifying the weakest signals which leave the primary image sensor 3 without amplifying the strongest signals.
• the analog function circuit 34 performs, for example a logarithmic function retaining the extreme values of the image information leaving the primary image sensor 3.
• the analog-digital converter 35 converts the signal leaving the parallel digital data analog function circuit 34.
• the multiplier 36 multiplies the digital values leaving the analog digital converter. than 35 by the digital values leaving the computer 43. It is described below how the computer 43 provides digital values corresponding to the transparency of the flat matrix screen 11, for each point of the primary image sensor 3.
• the adder 37 adds the digital values leaving the multiplier 36 by the digital values leaving the switch 39.
• the divider by two 44 indicates to the control circuit IG the parity of the number of the image transmitted by the primary image sensor 3 and switches the switches 39 and 40 in parallel.
• the control circuit 10 for the sensitivity of the sensor primary image 3 alternates the average sensitivity of the primary image sensor 3 between two values supplied to it by the contrast measurement means 41, by controlling the flat shutter screen 13, the electric diaphragm 46 and the shutter electronics 47 of the primary image sensor 3.
• the cutter 39 connects the output 8A of the image memory 19 to the input of the adder 37 and the switch 40 connects the adder 37 to the conversion table 12.
• the switches 39 and 40 are in the reverse positions while the control circuit controls the lowest sensitivity of the primary image sensor 3. From this In this way, the information leaving on the outputs 14 and 30 of the device correspond to the sum of the information coming from two response domains of the primary image sensor 3 which are different.
• the dynamic range of the camera is then the product of the dynamic range of the primary image sensor by the ratio of the lowest sensitivity, expressed in lux, to the sensitivity strongest unit.
• the control circuit 10 controls the duration of the optoelectronic operation by controlling the electronic shutter 47 of the primary image sensor 3. For this, it sends, thanks to the electrical connection 17, an impulse of a duration equal to that of this opto ⁇ electronic operation, ie a code which corresponds to this duration, depending on the type of primary image sensor 3 used.
• the number of different sensitivities controlled by the control circuit 10 can be greater than two, in which case the switches 39 and 40 have this number of positions and the divider 44 divides by this number.
• the circuit 10 for controlling the sensitivity of the primary image sensor 3 does not alternate the sensitivity of said sensor.
• the switches 39 and 40 are blocked in such a way that the conversion table 38 is connected to the adder 37, the position of the switch 40 being indifferent.
• the conversion table 38 performs an increasing then decreasing function as a function of the numerical values "x" arriving at its input. For example, this function is of the form
• the device operates as according to the second mode of operation but the switch 40 is in a fixed position such that the conversion table 12 is constantly connected to the image memory 19.
• the image sensor operates at a high frequency and the conversion table 12 reads the image memory 19 with a low frequency.
• the increase in dynamic range of the camera is similar to that presented in the second operating mode, but the remanence is attenuated.
• the device operates as according the third mode of operation, but the switch 39 changes its position and connects any of the two input to its output during a reproduction period of an image by the image sensor primary 3 after each reading time from the image memory 19 by the conversion table 12. In this way, the remanence no longer exists at the output of the device since the information present in the image memory 19 is renewed at each reading.
• the fifth and sixth operating modes use the command of the matrix flat screen 11 to vary the sensitivity of the primary image sensor 3 in the matrix manner.
• the matrix flat screen 11 has a network of points for which the transmittance is controlled individually electrically.
• the matrix flat screen 11 can, for example, include a liquid crystal screen used in certain pocket televisions.
• An electrical signal for controlling the transmittance of each of the points of the flat matrix screen 11 is sent, through the electrical connection 15, by the control circuit 10 of the sensitivity of the primary image sensor 3.
• This si ⁇ General status is supplied to the control circuit 10 by the state memory as indicated below.
• the transmittance of each point of the flat matrix screen 11 controls the sensitivity of the points of the primary image sensor 3 which is optically behind it.
• the control circuit 10 for the sensitivity of the primary image sensor 3 controls a transparency of each point of the matrix flat screen 11 according to a decreasing function of the light intensity received by the points of the primary image sensor 3 which are optically placed behind said point of the matrix flat screen 11.
• the sensitivity of the points of the primary image sensor 3 is a decreasing function of the light intensity of the light rays which reach it.
• the geometric data memory 27 keeps, for any point on the flat matrix screen 11, the influence factors on each of the points of the primary image sensor 3 which are optically behind it. These factors depend on the distance between the flat matrix screen 11 and the primary image sensor 3, on the position and opening of the electric diaphragm 46, on the state of obscuration of the points of the flat screen matrix! 11 surrounding said arbitrary point.
• This optical influence is an effect of the projection, by the light rays coming from scene 1 through the electric diaphragm 46, of the points of the flat matrix screen 11 on the photo-sensitive surface of the primary image sensor 3
• the electric diaphragm 46 being connected to an input of the geometrical data memory 27, as well as the state memory 26 of the flat matrix screen 11, the geometrical data memory 27 can provide the optical influence factors to the computer 43.
• This calculates the inversion of the optical attenuation factor of the light rays arriving at each point of the primary image sensor 3. This inverse being multiplied by the light intensity value perceived by said point, by the multiplier 36, the values exiting the multiplier correspond to a constant sensitivity over the entire photo-sensitive surface of the primary image sensor 3.
• the state memory 26 of the flat matrix screen 11 makes it possible to avoid oscillations of the image due to the closed loop control.
• the variable threshold circuit 42 compares for each photo-sensitive point of the primary image sensor 3, the value of light intensity incident on this point, value which is provided by connection 7A of said primary image sensor. 3, with a threshold depending on the state of transparency of the point of the matrix flat screen 11 which is optically in front of this point of the sensor, the state information being supplied by the state memory 26 Depending on this state of transparency, a threshold is fixed.
• variable threshold circuit 42 controls the maximum obscuration of this corresponding point of the software flat screen 11, by sending information to the state memory 26. If the threshold is not exceeded, for none of the points of the primary image sensor 3 being optically behind said point of the 'matrix flat screen 11, the variable threshold circuit controls the maximum transmittance of this corresponding point of the matrix flat screen 11, by sending other information to the state memory 26. In this way, for a scene 1 fixed, the state commands of the matrix flat screen 11 are constant, the maximum threshold variation corresponding to the maximum contrast of the matrix flat screen 11. No oscillation of the state of the points of the matrix flat screen 11 nor outgoing image information of the primary image sensor 3 is not possible.
• 15 state memory 26 correspond to at least one image of scene 1, taken through the objective 2.
• the image processing circuit 5 performs the combination of this information with that coming from the primary images 3 and reproducing image information from scene 1 corresponding to a dynamic range greater than that of the primary image sensor 3.
• the seventh operating mode uses the detector. at the start of image 31 and the grid potential control sequencer 33. o c
• the start of image detector 31 indicates to the gate potential control sequencer 33 the start of image leaving the primary image sensor 3 in the form of image information.
• the sequencer 33 then sends potential signals to the grids of the primary image sensor 3 in such a way that a partial transfer of the electric charges created on its surface is transferred to its output 7A as explained below, on a example of structure of primary image sensor with charge transfer.
• a primary image sensor ⁇ 3 comprising four potential zones side by side for each point of the photo-sensitive zone sible, the said potential zones having a potential controlled by the sequencer 33, four grids each defining a potential for all the identical zones of these points are accessible by the sequencer 33.
• all the photo-sensitive points of the primary image sensor 3 simultaneously possesses the same electrical configuration of potential on their four potential zones.
• a primary image sensor 3 controlled by the sequencer 33, said image sensor 3 having four grids, the first of which corresponds to the photo-sensitive areas of each photo ⁇ sensitive point, the next two correspond to the charge transfer zones and the last to a potential barrier, or a drain, preventing the electrical connection between the zones of two neighboring points.
• the last three grids therefore correspond to areas of the points of the primary image sensor 3 which are not photo-sensitive and do not have opto-electronic operation.
• the fourth grid ie the potential barrier or the drain, remains such that the electrons cannot cross it.
• the sequencer 33 first controls a long-term opto-electronic operation on the photo-sensitive areas, ie the first grid. At this instant, the second and third grids do not retain any electrical charge. Secondly, the sequencer controls the setting of the first three grids to the same potential. In this way, the electrical charges initially located in the first zone are partially transferred to the second and third zones. Thirdly, the potential of the second grid is modified in such a way that the electrical charges can no longer pass from the first to the third zone.
• the potential of the first grid is modified in such a way that the charges retained by the first zone are eliminated, or transferred to a substrate or a drain. At this moment only the third zone retains electrical charges, the sum of these electrical charges being a fraction of the sum of the electrical charges created in the first time in the first zone. No saturation of the third zone is therefore possible.
• the potential of the first grid is adapted to relaunch an opto-electronic operation of the first zone for a shorter duration than the duration of the first beat.
• the electric charges present in the first zone are fully transferred to the third zone, via the second zone in a usual manner.
• the charges of the third zone are transferred to an output of the image information from the primary image sensor 3 in the usual way.
• these charges correspond to a part of the charges coming from the first opto-electronic operating time and from the charges coming from the fifth time, opto-electronic working times.
• This seventh mode of operation of the device makes it possible to perform, in a memory placed in the primary image sensor 3, said memory consisting of the third areas of the photo-sensitive points of said primary image sensor 3, the same operations that in the first operating mode, that is to say that the image information leaving said memory placed on the primary image sensor 3 comprises information corresponding to two shots taken according to different sensitivities of the heading ⁇ primary image sensor 3. This information corresponds to a dynamic higher than that of the primary image sensor 3.
• the eighth time is identical to the second time except that the third grid has a potential which does not allow the transfer of electric charges inside.
• the ninth beat is identical to the third step, the potentials of the second and third zones being gradually interchanged.
• the result on the positions of the electric charges in the fourth step is the same as above.
• Other control sequences of the grids or of the potentials sent to the primary image sensor are in accordance with the spirit of the invention, in particular if the number of zones per point of the primary image sensor or the number of the grill used is different from the one used above.
• Another example of a gate potential control sequence carried out by the sequencer 33 is given with regard to FIG. 4.
• the invention proposes various systems for improving the quality of image information, in particular in the case of glare.
• a reduction in the effect of dazzling streak, better known by its English name of "smoker", in the images coming from the primary image sensor 3 is obtained by the darkening of the screen.
• the circuit 10 for controlling the sensitivity of the primary image sensor 3 controls this obfuscation of the shutter flat screen 13 thanks to a clock not shown.
• the contrast measurement means 41 measures the variations in the digital values leaving the device. For this, it can perform a quadratic measurement of the differences with the average numerical value. It can also detect extreme numerical values.
• This contrast measurement is supplied on the one hand to the sensitivity control circuit 10 and on the other hand to the conversion table 12.
• the sensitivity control circuit 10 uses this data to control the variations in sensitivity of the sensor d 'primary images 3 accordingly.
• the conversion table includes several transfer functions adapted to different contrast values to optimize the visualization of the image information leaving the device.
• the glare halo detector 48 compares the values entering and leaving the image memory 19. These images correspond to different sensitivities. To prevent a glare halo, better known by the English term "blooming", from appearing on the most sensitive image, the glare halo detector 48 verifies only one saturation value of the information coming from an image taken with the highest sensitivity, corresponds to a non-zero value of the information coming from an image taken with the lowest sensitivity. The information corresponding to these two images is present on the connections 8A and 8B according to the first mode of operation of the device. The detection of a dazzling halo is transmitted to the sensitivity control circuit 10.
• the latter then controls a smaller difference in sensitivity between the successive images, via the shutter flat screen 13 , the electric diaphragm 46 and the electronic shutter 47.
• the conversion table 12 makes it possible to increase the readability of the image leaving the device. In particular, increasing and then decreasing conversion functions, creating a solarisatiim effect, increase the perception of this image.
• a primary image sensor 3 operating monochromatically, three sets of circuits D must be incorporated into the device, each of its sets D corresponding to one of the fundamental colors.
• the electrical connection 8H connecting the divider by three 45 and the image memory 19 makes it possible to select the memory plane of the image memory 19 corresponding to the color transmitted by the three-color flat screen 25 as described below.
• the three-color flat screen 25 which is controlled by the control circuit 10 of the sensitivity of the primary image sensor 3, has a transmittance electrically controlled on a single optical operating zone for each of the fundamental colors.
• the three-color flat screen 25 may in particular include three flat liquid crystal screens, for example nematic or ferroelectric and three dichroic polarizers between which the flat liquid crystal screens and a conventional polarizer are interposed.
• Dichroic polarizers have the ability to filter a color along an axis of polarization and to be transparent along an axis of polarization perpendicular to the first.
• the conventional polarizer is transparent along an axis of polarization and opaque along the axis of polarization perpendicular to the first.
• the three-color flat screen 25 varies the sensitivity of the primary image sensor 3 as a function of its transittance, and this for each of the fundamental colors.
• This control circuit 10 controls the operating voltage of each of the points : of the primary image sensor 3. In addition, it independently controls the duration of the opto-electronic operation of each of the points of the image sensor. primary 3.
• the primary image sensor 3 must be adapted and matrix connections with each of the points of this primary image sensor 3 must be electrically accessible by the control circuit 10 It is clear that the device which is the subject of the present invention may include fewer functions than all those presented with reference to FIGS. 1 or 2 while achieving an increase in the dynamics of the primary image sensor in accordance with invention.
• the image information stored by the second source of image information corresponds "to an image representing a domain of variation of light intensities different from that of the image sensor. primai're- 3, for which this range of variation is called dynamic.
• FIG. 3 are represented a scene 1 and, on an optical axis A and in a partially shown camera housing B, a shutter flat screen 13, a lens 2 forming an image 6 of scene 1 on a sensor primary images 3 a separating means of light 21 and a matrix flat screen 11 optically placed in front of the primary image sensor 3.
• a second source of image information 4 comprising a secondary image sensor 23 on which is formed by objective 2 an image 24 of scene 1 similar to image 6, an electronic circuit of image processing 5 having an electrical connection 7 with the primary image sensor 3, an electrical connection 8 with the second source of image information 4, and an output electrical connection 9 connected to a conversion table 12 having an electrical output connection 14.
• a circuit 10 for controlling the sensitivity of the primary image sensor 3 is connected by an electrical connection 16 to the image processing circuit 5, by an electrical connection 17 to the primary image sensor 3 , by an electrical connection 18 to the shutter flat screen 13 and by an electrical connection 15 to the matrix flat screen 11.
• the light separating means 21 has the function of separating the light rays which are incident to it into two light rays propagating on the one hand towards the primary image sensor 3 and on the other hand towards the secondary image sensor 23.
• it may consist of partially reflecting mirrors, transparent plates with or without surface treatment, optical prisms such as those used in cameras with three image sensors each capturing a color, or even image recovery objective.
• the second source of image information 4 includes a memory identical to that presented with reference to FIG. 2. It also includes the secondary image sensor 23 which captures an image 24 similar to image 6 with a sensitivity. different from that of the primary image sensor 3. POL that, the transparency or the aperture of the optical system located in front of the secondary image sensor 23 is different from that of the optical system located in front of the sensor primary image 3.
• the light intensity value domains of points of scene 1 for which the image sensors 3 and 23 provide representative information are therefore different. J the image processing circuit 5 combines this information to provide on its output electrically connection 9 information corresponding to the combination of these two fields of light intensity values of points in the scene 1. -. ,
• FIG. 4 s & iPfc represented, at the top, grids of charge transfer devices of an electronic image sensor and, below!, States of potentials of the grids, vertically thereof, at successive instants, potentials imposed by the gate potential sequencer presented in FIG. 2.
• grids G1, G2, G3, G4 on a substrate 50 grids G5, G6, G7 on a substrate 51, G8 and G9 on a substrate 52.
• the substrates 50, 51 and 52 correspond respectively to image sensors having four, three and two grids per photo-sensitive point of the photo-sensitive surface.
• - Masks 53 mask light G2, G, G4, G6, G7 and G9 grids which are intended for transi _ ⁇ t. , charges created by opto-electronic effect on the Gl, G5 and G8 grids.
• the first curved line L1 represents the potential levels during the shooting, ie while charges are formed on the grids G1, G5 and G8.
• the following lines indicate, for successive instants, from top to bottom, the charge transfers carried out between the grids.
• the points of these curved lines placed above the axes correspond to positive potentials, and below the axes to negative potentials.
• the positive potential points form a barrier for the holes which are the charges transferred into charge transfer devices.
• the negative potential points correspond to potential wells where the charges of the holes are kept.
• the positions of the charges are represented by "+" signs.
• the grids Gl, G5 and G8 have a negative potential while the other grids have a zero potential.
• the positive electrical charges are created and stored by the gates G1, G5 and G8.
• the grids Gl, G2, G3, G5, G6 have a negative potential, the other grids having a zero potential except for the grid G8 which has a very low negative potential.
• the charges of the grids G1 and G5 are distributed respectively under the grids G2 and G3 on the one hand and G6 and G7 on the other hand
• the charges created under the grid G8 disappear partially in the grid G8.
• the grids, Gl, G3, G5, G7 and G9 have negative potentials, the other grids having zero potential.
• the grids G3, G7 and G9 cc store charges, the number of which is the sum of the charges created during the second shot with a portion of the charges created during the first shot. of sight (li ll).
• the second shot is from a shorter time or with a lower sensitivity than the first. In this way, no saturation of information can appear.
• the grids G3, G7 and G9 form an array of memories placed in the primary image sensor, this array of memories being a second source of image information according to the present invention.
• the potential zones or grids of each point of the primary image sensor can be controlled individually so that the creation of electric charges at each photo-sensitive point by opto-effect electronic is a decreasing function of the light intensity of the rays reaching this point.
• the control of the potentials of these ⁇ ⁇ girls being effected by the sensitivity control means 10 in the same manner as the control of the matrix flat screen 11, by matrix servo control.
• the device which is the subject of the present invention can be produced so as to be added to any pre-existing electronic camera or incorporated in the housing of a camera.
• the applications of the device which is the subject of the present invention are mainly in shooting in uncontrolled lighting, outdoors, in endoscopy, in welding robotics, for example.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Transforming Light Signals Into Electric Signals (AREA)
• Studio Devices (AREA)

Applications Claiming Priority (4)

Publications (1)

Family

ID=26227875

Family Applications (1)

Country Status (5)

Cited By (1)

Families Citing this family (31)

Family Cites Families (10)

• 1991
  • 1991-02-18 US US07/920,302 patent/US5638119A/en not_active Expired - Lifetime
  • 1991-02-18 CA CA002074488A patent/CA2074488A1/fr not_active Abandoned
  • 1991-02-18 WO PCT/FR1991/000127 patent/WO1991012690A1/fr not_active Application Discontinuation
  • 1991-02-18 JP JP91505293A patent/JPH05506971A/ja active Pending
  • 1991-02-18 EP EP91905495A patent/EP0515565A1/de not_active Withdrawn

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events