EP1374564A2 - Procede de photographie numerique et appareil photo numerique - Google Patents
Procede de photographie numerique et appareil photo numeriqueInfo
- Publication number
- EP1374564A2 EP1374564A2 EP01914941A EP01914941A EP1374564A2 EP 1374564 A2 EP1374564 A2 EP 1374564A2 EP 01914941 A EP01914941 A EP 01914941A EP 01914941 A EP01914941 A EP 01914941A EP 1374564 A2 EP1374564 A2 EP 1374564A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- image
- matrix
- signals
- comparison
- comparison result
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/81—Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation
- H04N23/811—Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation by dust removal, e.g. from surfaces of the image sensor or processing of the image signal output by the electronic image sensor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
- H04N25/68—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to defects
- H04N25/683—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to defects by defect estimation performed on the scene signal, e.g. real time or on the fly detection
Definitions
- the present invention relates to a digital photography method according to the preamble of claim 1 and a digital camera according to that of claim 10.
- digital photography offers many advantages, since no films are used and thus running costs are avoided.
- digital photography also has a major disadvantage: defects in photochemical films occur only once, and a new negative is already used for the next picture.
- opto-electronic sensors or converters in digital photography, however, the same sensors are used for each image registration. Defects from or on these image sensors always have an effect.
- the present invention is based primarily on the problem of defects that are mechanically connected to the matrix of optoelectronic sensors, such as scratches in the sensor coating, dust particles on the matrix, defective pixels or sensors and / or Glass defects, scratches, dust etc. in or on the protective glass positioned and connected in front of the sensor and / or eg IR cut filter etc. can be detected in a simple and reliable manner and thus create the basis for a corresponding image correction.
- the above-mentioned task is primarily made possible for the aforementioned error detection and additionally for opening further detection possibilities for image properties, in principle by signals dependent on the image signals of the two images being fed to a comparison operation and a comparison result image in the form of electrical comparison result signals is generated with the respective sensor position information and with electrical
- Signals of the comparison result image the first and / or second registered image is modified.
- the mentioned defects or defects which are mechanically bound to the matrix of optoelectric sensor elements, move together with the matrix when the matrix is shifted, while the image impressed on the imaging beam moves with respect to the matrix, inversely to the matrix shift, shifts. If the matrix is only shifted to the right, for example, the image of the imaging beam shifts to the left with respect to the matrix; because the image of the defect is stationary on the matrix remains, the image shifts in the imaging beam on the matrix, the latter shifts with respect to the image of the defect.
- the electrical image signals of the two images which of course also contain the position information, are compared directly with one another, and there are sensor elements whose output signals indicate a correspondence at least to a predetermined extent
- Comparison result in the comparison result picture identified as malfunctioning. Because, in the mechanical matrix shift mentioned, faulty sensor elements are also shifted, the above-mentioned direct comparison results in signal identity at faulty sensor positions, and ideally corresponding zero signals when differences are formed, for example, due to shift tolerances, comparison result signals that do not ideally disappear can also result, and thus a measure of A predetermined criterion, for example a threshold value, is specified, which must be undercut for the identification of a fault location.
- a predetermined criterion for example a threshold value
- the comparison is now made between the phantom image and the associated non-phantom image: If a phantom image is generated from the first image, the comparison is preferably carried out on the first image and its phantom image and analogously for the second image. If necessary, phantom images can certainly be generated from both images and the detection quality can be increased by double comparison.
- the location detection is now carried out.
- use is now made of the fact that the undisturbed image information for the storage location is present in the already existing images.
- electrical signals on the first, second or phantom image are preferably replaced at the positions at which, in the comparison result image, comparison result signals are below a predetermined value for the generation of the recording image - that is to say the definitive image
- Threshold This also solves the problem that in the case of uniform scenes in which even after mechanical wear, uniform sections of the scene overlap with the original image and could be interpreted as error areas.
- a digital camera according to the invention is further characterized or according to the characterizing part of claim 10 that of claim 14, preferred embodiments according to claims 11 to 13.
- the invention is subsequently explained, for example, with reference to figures. These explanations open up a wide variety of possible implementations of the present invention to the person skilled in the art. In the figures, for example:
- FIG. 2 in a representation analogous to that of FIG. 1, a first form of realization of the camera according to the invention or of the method according to the invention;
- FIGS. 1 and 2 in a representation analogous to that of FIGS. 1 and 2, the method according to the invention or a digital camera according to the invention in a preferred embodiment
- FIG. 4 shows a Bayer pattern as an example of the pattern of color-selective sensors on a sensor matrix for digital color photography.
- a matrix 1 of optoelectric sensors such as a CCD matrix
- a matrix 1 of optoelectric sensors is precisely displaceably guided in the camera with respect to the imaging beam (not shown) and, as shown schematically in FIG. 1, is drive-connected to a displacement drive 3.
- a preferably used precision guide with drive of such a matrix 1 in a digital camera reference is made to WO 01/00001 by the same applicant, which in this regard is to be an integrated description part of the present application.
- image Bi is imaged on the matrix 1.
- the electrical output signals of the matrix sensor elements, at the output Ai, are fed to a multiplexer unit via a time-controlled switchover unit 5.
- the matrix 1 is shifted by a drive 3 by a predeterminable displacement vector S (x s , y s ).
- the image B 2 appears on the matrix 1, as shown on the right in FIG. 1, shifted by the direction-inverted vector 5 ′′ 1 .
- the image B ⁇ e which has been optoelectrically converted on the matrix 1, is stored in a storage unit 1 ⁇ , likewise, after the displacement 5 of the matrix 1 has taken place, the image B 2e in a storage unit 7.
- the stored images are formed by signals which are dependent on the sensor output signals and information on the position of each sensor on the matrix 1. Together, both signal components, signals of the optoelectric conversion and position information, hereinafter referred to as output signals of the sensors and thus also of the matrix 1.
- comparison unit 9 the comparison unit 9 and one and / or both of the storage units 7 ⁇ or 7 2 are interposed with a processing unit III or 11 2 shown in dashed lines in FIG. 1, so that the respective output A 1 or A 72 is operatively connected to the corresponding inputs E 92 or E 9 ⁇ , but not necessarily directly.
- comparison unit 9 On the comparison unit 9, according to a predetermined algorithm, output signals from sensors or sensor groups, possibly processed, are compared with one another.
- the comparison result ⁇ at the output of the comparison unit 9, which corresponds to a matrix of comparison result signals is preferably revised. This takes place on an image processing arithmetic unit 12.
- the correspondingly processed, corrected electronic image Bi k results in a memory unit 14.
- a fault Z for example in the form of a dust particle, is present on the sensor matrix 1 at the location x z , y 2 . If the matrix 1 is shifted by a shift vector S, as has been described with reference to FIG. 1, the portion of the image Bi caused by the imaging beam moves on the
- Matrix 1 corresponding to the direction-inverted vector S '1 .
- the position coordinates of the disturbance Z on the matrix 1 are retained even after the matrix 1 has been shifted, ie the disturbance Z is shifted together with the matrix 1, in contrast to the image from the imaging beam.
- This provides the basis for transmitting the information to the arithmetic unit 12 according to FIG. 1, which is not shown repeatedly in FIG. 2, and where in the matrix 1 interference-affected sensors or pixels are located. from that For example, the computing unit 12 can replace the interference-related output signals by signal interpolation of output signals from adjacent sensors.
- FIG. 3 shows a particularly preferred embodiment of the present invention, in which output signals from sensors or pixels influenced by errors or defects are replaced with signals corresponding to the undisturbed image of the imaging beam and what next enables moving parts of the image in the
- images Bi e and B 2e are stored in the assigned storage units 7 ⁇ and 7 2 .
- a phantom image Ph B ⁇ is determined, preferably from one of the two stored images B ⁇ e or B 2e , as shown in FIG. 3, preferably from image B 2e .
- the output of the storage unit 7 2 is operatively connected to a computing unit 14 and, as schematized in FIG. 3, it is supplied with the displacement vector information S.
- the arithmetic unit 14 now rearranges the sensor output signals stored in the memory unit 7 2 in accordance with the image B e
- Shift vector S shifted so that an image is created as phantom image Ph B ⁇ and stored in a storage unit 7 Ph , which, since shifted by S, actually corresponds to image B ⁇ e , with the difference that that now the position coordinates of the sensors or pixels, which have been disturbed by the fault
- Comparison unit 9 the comparison between the image B ⁇ e stored on the memory unit 7 ⁇ and the electronic image P m stored on the phantom image memory 7 Ph .
- the comparison signal matrix formed thereon only has signal values which do not vanish or signal values which lie above a predetermined threshold value, where image B ⁇ e differs from phantom image Ph B ⁇ , ie following the representations of FIG. 3, at locations x z / y z as well as at S x ' z / y' zr . Because the shift vector
- the signal A (x 2 / y z ) is replaced by the computing unit 12, which is no longer shown here, in the place of the image B x or B le with the position coordinate xz / yz.
- the information relating to x z and y z is thus obtained from the Comparison signal matrix determined in the comparison unit 9.
- an interference-free image B 1 K according to Bi is provided in the image storage unit 14 according to FIG. 1.
- sensor matrixes for digital color photography provide patterns of sensors, e.g. Register one of the primary colors red, green or blue.
- the so-called Bayer pattern is known, which has the color grid of the sensor selectivity shown in FIG. 4.
- the so-called four-shot method is used for recordings of the highest quality, for example when using the Bayer pattern mentioned.
- the matrix is increased by one sensor grid dimension after each recording horizontally shifted, an image registration was carried out, then the matrix was shifted vertically by one sensor grid dimension with respect to the starting position, another image was registered and finally, with respect to the starting position, shifted horizontally and vertically with a sensor diagonal grid dimension, again an image was registered.
- the color information of the red, blue and twice of the green channel is available for each image pixel.
- the shift is preferably carried out with the arrangement described in WO 01/00001 by the same applicant, following the principle described there.
- Shift S is made by more than one grid dimension, strictly speaking even with a combined horizontal / vertical shift of the matrix by one
- Diagonal grid dimension Since, as can be seen from FIG. 4, every second sensor is a green sensor, with only two registrations shifted diagonally by a diagonal grid dimension, entire images can already be interpolated and compared with one another in the sense of the present invention. It may well be appropriate to shift by an even or an odd number of grid dimensions in order to implement the method according to the invention. In the event of a shift by an even number of grid dimensions, it is ensured that sensors of the same color selectivity are always present at the same image location. A shift by an odd number of sensor distances is suggested by combining the four-shot technique with a larger shift S in favor of the procedure according to the invention described with reference to FIGS.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Analysing Materials By The Use Of Radiation (AREA)
- Solid State Image Pick-Up Elements (AREA)
Abstract
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CH2001/000206 WO2001052525A2 (fr) | 2001-03-30 | 2001-03-30 | Procede de photographie numerique et appareil photo numerique |
US09/821,792 US20040207738A1 (en) | 2001-03-30 | 2001-03-30 | Digital photography method and digital camera |
Publications (1)
Publication Number | Publication Date |
---|---|
EP1374564A2 true EP1374564A2 (fr) | 2004-01-02 |
Family
ID=33541887
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP01914941A Withdrawn EP1374564A2 (fr) | 2001-03-30 | 2001-03-30 | Procede de photographie numerique et appareil photo numerique |
Country Status (4)
Country | Link |
---|---|
US (1) | US20040207738A1 (fr) |
EP (1) | EP1374564A2 (fr) |
AU (1) | AU2001242209A1 (fr) |
WO (1) | WO2001052525A2 (fr) |
Families Citing this family (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7120315B2 (en) * | 2002-03-18 | 2006-10-10 | Creo Il., Ltd | Method and apparatus for capturing images using blemished sensors |
JP4179079B2 (ja) * | 2002-08-30 | 2008-11-12 | 株式会社ニコン | 電子カメラ及びその制御プログラム |
JP4757085B2 (ja) * | 2006-04-14 | 2011-08-24 | キヤノン株式会社 | 撮像装置及びその制御方法、画像処理装置、画像処理方法、及びプログラム |
DE102006039389A1 (de) * | 2006-08-22 | 2008-02-28 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Vorrichtung und Verfahren zur Reduzierung von Übergangsartefakten in einem Gesamtbild, das sich aus Teilbildern zusammensetzt |
JP2008072565A (ja) * | 2006-09-15 | 2008-03-27 | Ricoh Co Ltd | 撮像装置及び欠陥画素補正方法 |
US8170321B2 (en) * | 2008-05-23 | 2012-05-01 | Siemens Aktiengesellschaft | System and method for contour tracking in cardiac phase contrast flow MR images |
KR20110120327A (ko) * | 2009-02-16 | 2011-11-03 | 매뉴팩처링 리소시스 인터내셔널 인코포레이티드 | 디스플레이 특성 피드백 루프 |
US8441574B2 (en) * | 2009-02-16 | 2013-05-14 | Manufacturing Resources International, Inc. | Visual identifier for images on an electronic display |
JP5868039B2 (ja) * | 2011-06-30 | 2016-02-24 | キヤノン株式会社 | 撮像装置、画像合成方法、及びコンピュータプログラム |
US10319408B2 (en) | 2015-03-30 | 2019-06-11 | Manufacturing Resources International, Inc. | Monolithic display with separately controllable sections |
US10922736B2 (en) | 2015-05-15 | 2021-02-16 | Manufacturing Resources International, Inc. | Smart electronic display for restaurants |
US10269156B2 (en) | 2015-06-05 | 2019-04-23 | Manufacturing Resources International, Inc. | System and method for blending order confirmation over menu board background |
US10319271B2 (en) | 2016-03-22 | 2019-06-11 | Manufacturing Resources International, Inc. | Cyclic redundancy check for electronic displays |
US10313037B2 (en) | 2016-05-31 | 2019-06-04 | Manufacturing Resources International, Inc. | Electronic display remote image verification system and method |
US10510304B2 (en) | 2016-08-10 | 2019-12-17 | Manufacturing Resources International, Inc. | Dynamic dimming LED backlight for LCD array |
US11895362B2 (en) | 2021-10-29 | 2024-02-06 | Manufacturing Resources International, Inc. | Proof of play for images displayed at electronic displays |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS59186481A (ja) * | 1983-04-08 | 1984-10-23 | Citizen Watch Co Ltd | 撮像装置 |
US4748507A (en) * | 1986-10-17 | 1988-05-31 | Kenneth Gural | Solid state imaging device having means to shift the image between scans and associated circuitry to improve the scanned image |
JPS6462977A (en) * | 1987-09-03 | 1989-03-09 | Fujitsu Ltd | Solid-state image pickup device |
GB9211566D0 (en) * | 1992-05-29 | 1992-07-15 | Secr Defence | Imaging system |
US5889553A (en) * | 1993-11-17 | 1999-03-30 | Canon Kabushiki Kaisha | Image pickup apparatus capable of high resolution imaging |
US5514865A (en) * | 1994-06-10 | 1996-05-07 | Westinghouse Electric Corp. | Dither image scanner with compensation for individual detector response and gain correction |
JPH1038961A (ja) * | 1996-07-22 | 1998-02-13 | Fujitsu Ltd | 二次元固体撮像デバイスの画素欠陥検出装置 |
FR2756129B1 (fr) * | 1996-11-15 | 1999-07-09 | Sagem | Camera video a deviateur d'augmentation de resolution |
US6011584A (en) * | 1996-12-09 | 2000-01-04 | Raytheon Company | Method and apparatus for correcting offsets of two detectors using respective functions of a difference |
US5838813A (en) * | 1996-12-20 | 1998-11-17 | Lockheed Martin Corp. | Dithered image reconstruction |
-
2001
- 2001-03-30 EP EP01914941A patent/EP1374564A2/fr not_active Withdrawn
- 2001-03-30 WO PCT/CH2001/000206 patent/WO2001052525A2/fr not_active Application Discontinuation
- 2001-03-30 AU AU2001242209A patent/AU2001242209A1/en not_active Abandoned
- 2001-03-30 US US09/821,792 patent/US20040207738A1/en not_active Abandoned
Non-Patent Citations (1)
Title |
---|
See references of WO0152525A2 * |
Also Published As
Publication number | Publication date |
---|---|
US20040207738A1 (en) | 2004-10-21 |
AU2001242209A1 (en) | 2001-07-24 |
WO2001052525A2 (fr) | 2001-07-19 |
WO2001052525A3 (fr) | 2002-01-31 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
DE69131591T2 (de) | Bewegungsabhängige Videosignalverarbeitung | |
DE69222667T2 (de) | Videosignalverarbeitungsgerät zur Kompensation des Kamerawackelns | |
DE69733978T2 (de) | Bilddateninterpolationsgerät | |
EP1374564A2 (fr) | Procede de photographie numerique et appareil photo numerique | |
DE69704896T2 (de) | Kamera mit digitaler und analoger Klemmschaltung | |
DE69016074T2 (de) | Verfahren und Einrichtung zur temporalen Interpolation von Bildern mit korrigierter Bewegungskompensation. | |
DE3107042C2 (de) | Anordnung zur Korrektur von Abtastfehlern einer Farbfernsehkamera | |
DE3687434T2 (de) | Geraet zum ausgleich von bewegung in einem von einem von einem fernsehsignal abgeleiteten bild. | |
DE69611113T3 (de) | Vorrichtung zur Videorauschreduktion | |
DE69021431T2 (de) | Bewegungsabhängige Videosignalverarbeitung. | |
DE4108288C2 (fr) | ||
EP0702487A1 (fr) | Méthode et circuit de détection et de masquage d'erreurs dans un signal vidéo | |
DE3310826A1 (de) | Adaptive fehlerkaschierung bei abgetasteter videoinformation | |
DE3609887A1 (de) | Schaltungsanordnung zur adaptiven steuerung eines rekursiven filters fuer videosignale | |
EP1585059A2 (fr) | Procédé et dispositif d'évaluation de vecteurs de vitesse attribués à des régions d'image | |
DE3636077C2 (de) | Verfahren zum Verdecken von Fehlern in einem Videosignal und Schaltung zur Durchführung des Verfahrens | |
EP0472239A2 (fr) | Méthode d'évaluation des mouvements horizontaux dans le contenu d'images d'un signal de télévision | |
DE69027704T2 (de) | Bewegungsabhängige Videosignalverarbeitung | |
DE3142602C2 (de) | Kompensationsschaltung | |
DE69028033T2 (de) | Bewegungsabhängige Videosignalverarbeitung | |
DE69635259T2 (de) | Verdeckung von Flecken in Videosignalen | |
DE10084783B3 (de) | System und Verfahren zur Generierung von Videoframes | |
EP1605405A1 (fr) | Procédé pour la détermination des vecteurs de mouvement | |
DE2261228C2 (de) | Verfahren und Schaltungsanordnung zur Unterdrückung des Kammeffekts bei der Aufzeichnung von dem Zeilensprungverfahren entsprechenden Videosignalen auf Kinofilm | |
DE2048349C3 (de) | Farbfernsehkamera mit mehreren Bildaufnahmeröhren |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20030826 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR |
|
AX | Request for extension of the european patent |
Extension state: AL LT LV MK RO SI |
|
17Q | First examination report despatched |
Effective date: 20040419 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): CH DE DK GB LI NL |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20051001 |