EP1648156A2 - Adaptive contrast enhancement - Google Patents
Adaptive contrast enhancement Download PDFInfo
- Publication number
- EP1648156A2 EP1648156A2 EP05256355A EP05256355A EP1648156A2 EP 1648156 A2 EP1648156 A2 EP 1648156A2 EP 05256355 A EP05256355 A EP 05256355A EP 05256355 A EP05256355 A EP 05256355A EP 1648156 A2 EP1648156 A2 EP 1648156A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- luminance
- primitive
- reference transfer
- histogram
- weighted sum
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000003044 adaptive effect Effects 0.000 title abstract description 7
- 238000012546 transfer Methods 0.000 claims abstract description 80
- 238000000034 method Methods 0.000 claims abstract description 18
- 230000007423 decrease Effects 0.000 claims description 4
- 230000001965 increasing effect Effects 0.000 abstract description 6
- 235000019557 luminance Nutrition 0.000 description 57
- 230000002708 enhancing effect Effects 0.000 description 4
- 238000013459 approach Methods 0.000 description 3
- 238000001228 spectrum Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 230000001186 cumulative effect Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000003292 diminished effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000000630 rising effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
- H04N5/57—Control of contrast or brightness
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/40—Picture signal circuits
- H04N1/407—Control or modification of tonal gradation or of extreme levels, e.g. background level
- H04N1/4072—Control or modification of tonal gradation or of extreme levels, e.g. background level dependent on the contents of the original
- H04N1/4074—Control or modification of tonal gradation or of extreme levels, e.g. background level dependent on the contents of the original using histograms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/40—Image enhancement or restoration using histogram techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
- G06T5/92—Dynamic range modification of images or parts thereof based on global image properties
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/06—Adjustment of display parameters
- G09G2320/066—Adjustment of display parameters for control of contrast
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2360/00—Aspects of the architecture of display systems
- G09G2360/16—Calculation or use of calculated indices related to luminance levels in display data
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
Definitions
- the present invention relates generally to contrast enhancement and, more particularly, to a method for using primitive transfer curves to generate transfer curves for adaptive contrast enhancement.
- a luminance histogram is generated.
- the luminance histogram is then expressed as a weighted sum of a set of predefined "primitive" histograms.
- Each primitive histogram has an associated reference transfer curve.
- a final transfer curve is produced as a corresponding weighted sum of the associated reference transfer curves.
- the image luminance can then be adjusted according the to the final transfer curve, resulting in enhanced image contrast.
- a display such as a Liquid Crystal Display (LCD), an Organic Light Emitting Diode (OLED) screen, a Digital Light Processor (DLP), a Cathode Ray Tube (CRT), a plasma panel or other type of display
- LCD Liquid Crystal Display
- OLED Organic Light Emitting Diode
- DLP Digital Light Processor
- CRT Cathode Ray Tube
- a transfer curve can be used for describing a mapping between input luminance levels and output luminance levels. Since different images have different luminance histograms, it is desirable to tailor the transfer curve to the particular image at hand in order to obtain optimal contrast enhancement.
- One approach is to divide the luminance spectrum into a number of luminance ranges each associated with a reference transfer curve, sum the reference transfer curves proportional to the representation of their luminance ranges in the image, and use the sum as a transfer curve for processing the image luminance. While this approach works well, improving contrast enhancement by expanding the number of available reference transfer curves requires an increase in the number of luminance ranges, thereby adding boundary cases and producing uneven contrast enhancement during fade-ins and fade-outs (e.g. in a video stream). It is therefore desirable to expand the number of available reference transfer curves without increasing the number of predefined luminance ranges.
- the present invention expands the number of available reference transfer curves without increasing the number of luminance ranges.
- a luminance histogram is generated for the image at hand.
- the luminance histogram is expressed as a weighted sum of a set of predefined "primitive" histograms.
- the number of primitive histograms is larger than the number of luminance ranges, but the number of primitive histograms needed to adequately approximate the luminance histogram is generally smaller than the total number of available primitive histograms.
- Each primitive histogram has an associated reference transfer curve.
- a final transfer curve is produced as a corresponding weighted sum of the associated reference transfer curves. The image luminance can then be processed according to the final transfer curve, resulting in enhanced image contrast.
- Fig. 1a shows an example medium-bright image and a histogram for the image
- Fig. 1b shows an example dark (low-brightness) image and a histogram for the image.
- the horizontal axes of the histograms represent luminance values and the vertical axes represent the number of pixels having a given luminance value.
- the luminance histogram indicates that most of the pixels have low luminance
- the luminance histogram indicates a larger number of brighter pixels.
- a low-luminance range a medium-luminance range and a high-luminance range.
- Fig. 1c shows three example luminance ranges 11, 12 and 13, in accordance with an embodiment of the present invention.
- the luminance ranges are user-definable and may be chosen to overlap in order to provide for smooth contrast enhancement.
- a low-luminance range of 0% to 40%, a medium-luminance range of 30% to 70%, and a high-luminance range of 60% to 100% luminance have been found to work well.
- generating a luminance histogram for the purposes of the present invention corresponds to counting the number of image pixels in each of the luminance ranges.
- a histogram can be visualized as having three bars, each bar representing the proportion of image pixels in a particular luminance range.
- Fig. 2a shows an example image
- Fig. 2b shows a luminance histogram for the example image generated based on the three luminance ranges.
- the generation of image luminance histograms is preferably done in hardware, although it should be appreciated that this can also be done partially or entirely in software or other computing layer.
- Fig. 3 shows an example set of nine primitive histograms H 1 , ... , H 9 , in accordance with an embodiment of the present invention.
- H 1 can be described as dark with the darkness monotonically falling, H 2 as bright with the brightness monotonically rising, H 3 as uniformly bright, H 4 as dark without distinct bright details, H 5 as bright without distinct dark details, H 6 as distinct dark and bright regions, H 7 as very dark, H 8 as medium bright, and H 9 as very bright.
- the source histogram can be expressed as a weighted sum of two or more primitive histograms (with positive weights).
- the weighted sum may not match the source histogram exactly, but it will closely resemble the source histogram.
- One greedy algorithm for generating such a weighted sum is to choose a first primitive histogram which, when appropriately weighted using a maximal positive weight, leaves the smallest difference with the source histogram.
- the remaining difference (if any) between the source histogram and the first weighted primitive histogram is then similarly diminished by choosing a second primitive histogram which, when appropriately weighted using a maximal positive weight and added to the first weighted primitive histogram, leaves the smallest difference between the weighted sum and the source histogram.
- the above algorithm can be continued to include additional primitive histograms for producing a weighted sum of three or more primitive histograms. It is contemplated that a weighted sum of two or three primitive histograms will approximate source histograms closely enough to enable a highly enhanced image contrast.
- Another heuristic for generating a weighted sum of primitive histograms for the image first generates a preliminary histogram for the image using only two bins, with the first bin representing the lower half of the luminance spectrum and the second bin representing the higher half.
- the preliminary histogram is then used to indicate whether the image has low-luminance (first bin contains significantly more pixels than second bin), medium-luminance (first and second bins contain about the same number of pixels) or high-luminance (second bin contains significantly more pixels than second bin).
- the threshold can be defined explicitly. For example, if the less represented bin contains 45% of the pixels, the image is declared to have medium-luminance, else the image is declared low-luminance or high-luminance.
- the high-luminance primitive histograms H 2 and H 9 are excluded from consideration for the weighted sum.
- the low-luminance histograms H 1 and H 7 are excluded.
- the low-luminance and high-luminance primitive histograms H 2 , H 9 , H 1 and H 7 are excluded.
- the source histogram is then expressed as a weighted sum of the non-excluded primitive histograms using the above greedy algorithm.
- the primitive histograms are preferably chosen and added by firmware for improved performance, although it should be appreciated that this can also be done fully or partially in software or other computing layer.
- a final transfer curve is generated.
- the primitive histograms H 1 , ... , H 9 are user-defined reference transfer curves TF 1 (x), ... , TF 9 (x), wherein TF i (x) represents a reference transfer curve generated to be suitable for enhancing the contrast of an image whose histogram resembles the primitive histogram H i .
- FIGs. 5a, 5b and 5c illustrate three such example reference transfer curves TF 7 (x), TF 8 (x) and TF 9 (x), corresponding to the primitive histograms H 7 , H 8 and H 9 , in accordance with an embodiment of the present invention.
- TF 7 ( x ) decreases the luminance in the dark regions of the image without substantially changing the luminance in the medium- and high-luminance regions
- TF 9 ( x ) increases luminance in the bright regions of the image without substantially changing the luminance in the medium- and low-luminance regions
- TF 8 ( x ) increases the luminance in the high-luminance regions and decreases the luminance in the low-luminance regions without substantially changing the luminance in the medium-luminance range of the image.
- the weights used to produce the final transfer curve correspond to the weights used for the primitive histograms.
- the final transfer curve T(x) can then be used to adjust the pixel luminances of the image, thereby enhancing the contrast of the image.
- the number of primitive histograms used in a weighted sum can be limited to two or three per weighted sum.
- the above examples are for illustration purposes only.
- There can be any number of primitive histograms H i and corresponding reference transfer curves T i ( x ) to choose from any number of primitive histograms can be chosen for inclusion in the weighted sum ⁇ i w i ⁇ H i for approximating the source histogram, and any corresponding number of reference transfer curves can be chosen for inclusion in the weighted sum ⁇ i w i ⁇ T i ( x ) representing the final transfer curve T (x).
- Fig. 6 is a flowchart illustrating a method for adaptively enhancing the contrast of an image, in accordance with an embodiment of the present invention.
- Given an input image generate 101 a histogram and express 102 the histogram as a weighted sum of primitive histograms.
- the image luminance can be adjusted 104 accordingly.
- the final transfer function can be generated based on the cumulative image content of the most recent frames.
- One implementation of this technique comprises accumulating the histograms of the most recent set of frames and computing their average. The resulting average histogram is then expressed as a weighted sum of primitive histograms, producing a final transfer function as described above.
- a buffer of 5 to 15 frames has been found to work well.
- One advantage of the present invention is faster development of the reference transfer curves.
- a given reference transfer curve corresponding to a given primitive histogram needs only be verified on images that have luminance histograms similar to the given primitive histogram.
- only nine corresponding transfer curves need to be designed and thusly verified. This dramatically cuts development time, since the reference transfer curves do not need to be verified and optimized against many hours of material encompassing many different primitive histograms in order to discover side effects due to interdependence of reference transfer curves.
- Another advantage of the present invention is a reduced need for hardware resources. Using the above example of only 3 luminance histogram ranges (or histogram "bins"), it is possible to achieve contrast enhancement performance comparable to or better than using 8 or 16 bins in a traditional contrast enhancement approach.
- Another advantage of the present invention is improved contrast dynamic range without sacrificing the luminance resolution of the image.
- an input original image and associated histogram are shown in Fig. 4a
- the enhanced output image and associated histogram are shown in Fig. 4b. Note that in the luminance histogram of the enhanced image, the dark and bright pixels are spread out further (i.e. increased dynamic range), whereas the medium-luminance pixels are mostly unaffected.
- adaptive contrast enhancement for a movie may exclude the upper and lower black bands that run horizontally across the display or screen.
- adaptive contrast enhancement may be restricted to a user-definable region of the display, such as a window or a physical region of the display.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Processing (AREA)
- Picture Signal Circuits (AREA)
- Facsimile Image Signal Circuits (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
- Controls And Circuits For Display Device (AREA)
- Transforming Electric Information Into Light Information (AREA)
Abstract
Description
- The present invention relates generally to contrast enhancement and, more particularly, to a method for using primitive transfer curves to generate transfer curves for adaptive contrast enhancement.
- Traditional contrast adjustment methods in displays and TVs do not take into account the input image content and result in unintended average brightness shifts as well as saturation or clipping. For example, poor results are obtained when increasing the contrast on an image which already has good contrast, and poor contrast is obtained when the image has a large portion of very bright or very dark pixels. Similarly, decreasing the contrast will typically "black out" images that already have poor contrast.
- Therefore, improved contrast enhancement techniques are desired.
- What is provided, therefore, is an adaptive contrast enhancement method that allows expansion of the number of available reference transfer curves without increasing the number of luminance ranges. Given an input image, a luminance histogram is generated. The luminance histogram is then expressed as a weighted sum of a set of predefined "primitive" histograms. Each primitive histogram has an associated reference transfer curve. A final transfer curve is produced as a corresponding weighted sum of the associated reference transfer curves. The image luminance can then be adjusted according the to the final transfer curve, resulting in enhanced image contrast.
- Embodiments of the invention will now be described by way of example with reference to the accompanying drawings, in which:
- Fig. 1a shows an example medium-bright image and a histogram for the image, in accordance with an embodiment of the present invention.
- Fig. 1b shows an example dark (low-brightness) image and a histogram for the image, in accordance with an embodiment of the present invention.
- Fig. 1c shows three example luminance ranges, in accordance with an embodiment of the present invention.
- Fig. 2a shows an example image, and Fig. 2b shows a luminance histogram for the example image generated based on the three example luminance ranges.
- Fig. 3 shows an example set of nine primitive histograms H 1, ... , H 9, in accordance with an embodiment of the present invention.
- Fig. 4a shows an example input image and associated histogram, and Fig. 4b shows a contrast enhanced version of the image and associated histogram, in accordance with an embodiment of present invention.
- Figs. 5a, 5b and 5c illustrate three example reference transfer curves TF 7(x), TF 8(x) and TF 9(x) corresponding to the three primitive histograms H 7, H 8 and H 9, in accordance with an embodiment of the present invention.
- Fig. 6 is a flowchart illustrating a method for adaptively enhancing the contrast of an image, in accordance with an embodiment of the present invention.
- Reference will now be made in detail to a particular embodiment of the invention, examples of which are illustrated in the accompanying drawings. While the invention will be described in conjunction with the particular embodiments, it will be understood that it is not intended to limit the invention to the described embodiments. To the contrary, it is intended to cover alternatives, modifications, and equivalents as may be included within the scope of the invention as defined by the appended claims.
- When preparing an image for presentation, for example on a display such as a Liquid Crystal Display (LCD), an Organic Light Emitting Diode (OLED) screen, a Digital Light Processor (DLP), a Cathode Ray Tube (CRT), a plasma panel or other type of display, it is desirable to enhance the contrast of the image by adjusting pixel luminance levels. A transfer curve can be used for describing a mapping between input luminance levels and output luminance levels. Since different images have different luminance histograms, it is desirable to tailor the transfer curve to the particular image at hand in order to obtain optimal contrast enhancement.
- One approach is to divide the luminance spectrum into a number of luminance ranges each associated with a reference transfer curve, sum the reference transfer curves proportional to the representation of their luminance ranges in the image, and use the sum as a transfer curve for processing the image luminance. While this approach works well, improving contrast enhancement by expanding the number of available reference transfer curves requires an increase in the number of luminance ranges, thereby adding boundary cases and producing uneven contrast enhancement during fade-ins and fade-outs (e.g. in a video stream). It is therefore desirable to expand the number of available reference transfer curves without increasing the number of predefined luminance ranges.
- Accordingly, the present invention expands the number of available reference transfer curves without increasing the number of luminance ranges. First, a luminance histogram is generated for the image at hand. Then, the luminance histogram is expressed as a weighted sum of a set of predefined "primitive" histograms. The number of primitive histograms is larger than the number of luminance ranges, but the number of primitive histograms needed to adequately approximate the luminance histogram is generally smaller than the total number of available primitive histograms. Each primitive histogram has an associated reference transfer curve. A final transfer curve is produced as a corresponding weighted sum of the associated reference transfer curves. The image luminance can then be processed according to the final transfer curve, resulting in enhanced image contrast.
- Fig. 1a shows an example medium-bright image and a histogram for the image, and Fig. 1b shows an example dark (low-brightness) image and a histogram for the image. The horizontal axes of the histograms represent luminance values and the vertical axes represent the number of pixels having a given luminance value. For example, for the dark scene in Fig. 1b, the luminance histogram indicates that most of the pixels have low luminance, while for the medium-bright scene in Fig. 1a the luminance histogram indicates a larger number of brighter pixels.
- The invention will now be described using an example of three luminance ranges dividing the image luminance spectrum. It should be noted, however, that the following description is exemplary in nature and should therefore not be construed as limiting either the scope or intent of the invention.
- In the present description, three example luminance ranges are used: a low-luminance range, a medium-luminance range and a high-luminance range. Fig. 1c shows three
example luminance ranges - Once the luminance ranges are defined, generating a luminance histogram for the purposes of the present invention corresponds to counting the number of image pixels in each of the luminance ranges. In the example case of three luminance ranges, such a histogram can be visualized as having three bars, each bar representing the proportion of image pixels in a particular luminance range. Fig. 2a shows an example image, and Fig. 2b shows a luminance histogram for the example image generated based on the three luminance ranges. The generation of image luminance histograms is preferably done in hardware, although it should be appreciated that this can also be done partially or entirely in software or other computing layer.
- After generating a luminance histogram (hereinafter referred to as the source histogram) for an input image, the goal is to express the source histogram as a weighted sum of a set of predefined primitive histograms. Fig. 3 shows an example set of nine primitive histograms H 1 , ... , H 9 , in accordance with an embodiment of the present invention. H 1 can be described as dark with the darkness monotonically falling, H 2 as bright with the brightness monotonically rising, H 3 as uniformly bright, H 4 as dark without distinct bright details, H 5 as bright without distinct dark details, H 6 as distinct dark and bright regions, H 7 as very dark, H 8 as medium bright, and H 9 as very bright.
- The source histogram can be expressed as a weighted sum of two or more primitive histograms (with positive weights). The weighted sum may not match the source histogram exactly, but it will closely resemble the source histogram. One greedy algorithm for generating such a weighted sum is to choose a first primitive histogram which, when appropriately weighted using a maximal positive weight, leaves the smallest difference with the source histogram. The remaining difference (if any) between the source histogram and the first weighted primitive histogram is then similarly diminished by choosing a second primitive histogram which, when appropriately weighted using a maximal positive weight and added to the first weighted primitive histogram, leaves the smallest difference between the weighted sum and the source histogram.
- By way of example, assuming that H 1 and H 5 were chosen among all the primitive histograms to serve as the first and second primitive histograms in the above algorithm, their weighted sum can be written as w 1 ·H 1 + w 2·H 5, with w 1 and w 2 representing the appropriately chosen positive weights. Optionally, the above algorithm can be continued to include additional primitive histograms for producing a weighted sum of three or more primitive histograms. It is contemplated that a weighted sum of two or three primitive histograms will approximate source histograms closely enough to enable a highly enhanced image contrast.
- Another heuristic for generating a weighted sum of primitive histograms for the image first generates a preliminary histogram for the image using only two bins, with the first bin representing the lower half of the luminance spectrum and the second bin representing the higher half. The preliminary histogram is then used to indicate whether the image has low-luminance (first bin contains significantly more pixels than second bin), medium-luminance (first and second bins contain about the same number of pixels) or high-luminance (second bin contains significantly more pixels than second bin). The threshold can be defined explicitly. For example, if the less represented bin contains 45% of the pixels, the image is declared to have medium-luminance, else the image is declared low-luminance or high-luminance. For a low-luminance image, the high-luminance primitive histograms H 2 and H 9 are excluded from consideration for the weighted sum. For a high-luminance image, the low-luminance histograms H 1 and H 7 are excluded. For a medium-luminance image, the low-luminance and high-luminance primitive histograms H 2 , H 9 , H 1 and H 7 are excluded. The source histogram is then expressed as a weighted sum of the non-excluded primitive histograms using the above greedy algorithm.
- The primitive histograms are preferably chosen and added by firmware for improved performance, although it should be appreciated that this can also be done fully or partially in software or other computing layer.
- Once an appropriate weighted sum of primitive histograms is obtained, a final transfer curve is generated. Corresponding to the primitive histograms H 1, ... , H 9 are user-defined reference transfer curves TF 1(x), ... , TF 9(x), wherein TF i(x) represents a reference transfer curve generated to be suitable for enhancing the contrast of an image whose histogram resembles the primitive histogram H i.
- By way of example, Figs. 5a, 5b and 5c illustrate three such example reference transfer curves TF 7 (x), TF 8 (x) and TF 9 (x), corresponding to the primitive histograms H 7, H 8 and H 9, in accordance with an embodiment of the present invention. Note that TF 7 (x) decreases the luminance in the dark regions of the image without substantially changing the luminance in the medium- and high-luminance regions; TF 9(x) increases luminance in the bright regions of the image without substantially changing the luminance in the medium- and low-luminance regions; and TF 8(x) increases the luminance in the high-luminance regions and decreases the luminance in the low-luminance regions without substantially changing the luminance in the medium-luminance range of the image.
- The final transfer curve T(x) is produced as a weighted sum of the corresponding reference transfer curves: T(x) = w 1 ·TF 1(x)+W 2 ·TF 5 (x). The weights used to produce the final transfer curve correspond to the weights used for the primitive histograms. The final transfer curve T(x) can then be used to adjust the pixel luminances of the image, thereby enhancing the contrast of the image.
- In general, the number of primitive histograms used in a weighted sum, and therefore the number of reference transfer curves used in a corresponding weighted sum, can be limited to two or three per weighted sum. However, the above examples are for illustration purposes only. There can be any number of primitive histograms H i and corresponding reference transfer curves T i (x) to choose from, any number of primitive histograms can be chosen for inclusion in the weighted sum
- Fig. 6 is a flowchart illustrating a method for adaptively enhancing the contrast of an image, in accordance with an embodiment of the present invention. Given an input image, generate 101 a histogram and express 102 the histogram as a weighted sum of primitive histograms. Then generate 103 a final transfer curve as a corresponding weighted sum of the reference transfer curves associated with the primitive histograms. Once the final transfer curve is generated, the image luminance can be adjusted 104 accordingly.
- For smooth contrast enhancement in a sequence of images (such as in a video stream), the final transfer function can be generated based on the cumulative image content of the most recent frames. One implementation of this technique comprises accumulating the histograms of the most recent set of frames and computing their average. The resulting average histogram is then expressed as a weighted sum of primitive histograms, producing a final transfer function as described above. When implementing such an averaging technique, a buffer of 5 to 15 frames has been found to work well.
- One advantage of the present invention is faster development of the reference transfer curves. A given reference transfer curve corresponding to a given primitive histogram needs only be verified on images that have luminance histograms similar to the given primitive histogram. In the above example set of nine primitive histograms, only nine corresponding transfer curves need to be designed and thusly verified. This dramatically cuts development time, since the reference transfer curves do not need to be verified and optimized against many hours of material encompassing many different primitive histograms in order to discover side effects due to interdependence of reference transfer curves.
- Another advantage of the present invention is a reduced need for hardware resources. Using the above example of only 3 luminance histogram ranges (or histogram "bins"), it is possible to achieve contrast enhancement performance comparable to or better than using 8 or 16 bins in a traditional contrast enhancement approach.
- Another advantage of the present invention is improved contrast dynamic range without sacrificing the luminance resolution of the image. By way of example, an input original image and associated histogram are shown in Fig. 4a, and the enhanced output image and associated histogram are shown in Fig. 4b. Note that in the luminance histogram of the enhanced image, the dark and bright pixels are spread out further (i.e. increased dynamic range), whereas the medium-luminance pixels are mostly unaffected.
- While the invention has been described in the context of displaying an image on a digital display device, it should be appreciated that the same techniques can be used in an environment where the adaptive contrast enhancement is limited to a region in the display. By way of example, adaptive contrast enhancement for a movie may exclude the upper and lower black bands that run horizontally across the display or screen. By way of another example, adaptive contrast enhancement may be restricted to a user-definable region of the display, such as a window or a physical region of the display.
- Foregoing described embodiments of the invention are provided as illustrations and descriptions. They are not intended to limit the invention to precise form described. Other variations and embodiments are possible in light of above teachings, and it is thus intended that the scope of invention not be limited by this Detailed Description, but rather by Claims following.
Claims (14)
- A method for generating a transfer function, comprising:approximating an image luminance histogram by a first weighted sum of a set of primitive histograms, each primitive histogram associated with a corresponding reference transfer function from a set of reference transfer functions; andgenerating a final transfer function expressed as a second weighted sum of the set of reference functions;wherein the reference functions in the second weighted sum are weighted according to the associated primitive histograms in the first weighted sum.
- A method as recited in claim 1, further comprising:generating the image luminance histogram based on an input image.
- A method as recited in claim 1, wherein each reference transfer function of the set of reference transfer functions is chosen to optimally enhance the contrast of images that have luminance values distributed according to the primitive histogram associated with the reference transfer function.
- A method as recited in claim 1, wherein a first reference transfer function of the set of reference transfer functions decreases luminance in dark image regions without substantially altering luminance in medium-luminance and high-luminance image regions, the first reference transfer function associated with a primitive histogram that indicates predominantly bright images.
- A method as recited in claim 1, wherein a first reference transfer function of the set of reference transfer functions increases luminance in bright image regions without substantially altering luminance in medium-luminance and low-luminance image regions, the first reference transfer function associated with a primitive histogram that indicates predominantly dark images.
- A method as recited in claim 1, wherein the first weighted sum comprises at most two primitive histograms with positive weights, and the second weighted sum comprises at most two reference transfer curves with positive weights.
- A method as recited in claim 1, wherein the first weighted sum comprises at most three primitive histograms with positive weights, and the second weighted sum comprises at most three reference transfer curves with positive weights.
- An apparatus for generating a transfer function, comprising:a controller for:(a) approximating an image luminance histogram by a first weighted sum of a set of primitive histograms, each primitive histogram associated with a corresponding reference transfer function from a set of reference transfer functions; and(b) generating a final transfer function expressed as a second weighted sum of the set of reference transfer functions;wherein the reference transfer functions in the second weighted sum are weighted according to the associated primitive histograms in the first weighted sum.
- An apparatus as recited in claim 8, the controller further for:generating the image luminance histogram based on an input image.
- An apparatus as recited in claim 8, wherein each reference transfer function of the set of reference transfer functions is chosen to optimally enhance the contrast of images that have luminance values distributed according to the primitive histogram associated with the reference transfer function.
- An apparatus as recited in claim 8, wherein a first reference transfer function of the set of reference transfer functions decreases luminance in dark image regions without substantially altering luminance in medium-luminance and high-luminance image regions, the first reference transfer function associated with a primitive histogram that indicates predominantly bright images.
- An apparatus as recited in claim 8, wherein a first reference transfer function of the set of reference transfer functions increases luminance in bright image regions without substantially altering luminance in medium-luminance and low-luminance image regions, the first reference transfer function associated with a primitive histogram that indicates predominantly dark images.
- An apparatus as recited in claim 8, wherein the first weighted sum comprises at most two primitive histograms with positive weights, and the second weighted sum comprises at most two reference transfer curves with positive weights.
- An apparatus as recited in claim 8, wherein the first weighted sum comprises at most three primitive histograms with positive weights, and the second weighted sum comprises at most three reference transfer curves with positive weights.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US61951804P | 2004-10-15 | 2004-10-15 | |
US11/044,755 US7760961B2 (en) | 2004-10-15 | 2005-01-26 | Adaptive contrast enhancement |
Publications (3)
Publication Number | Publication Date |
---|---|
EP1648156A2 true EP1648156A2 (en) | 2006-04-19 |
EP1648156A3 EP1648156A3 (en) | 2009-01-07 |
EP1648156B1 EP1648156B1 (en) | 2010-09-29 |
Family
ID=35781454
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP05256355A Active EP1648156B1 (en) | 2004-10-15 | 2005-10-13 | Adaptive contrast enhancement |
Country Status (8)
Country | Link |
---|---|
US (1) | US7760961B2 (en) |
EP (1) | EP1648156B1 (en) |
JP (1) | JP4616749B2 (en) |
KR (1) | KR101234958B1 (en) |
CN (1) | CN1770847B (en) |
DE (1) | DE602005023821D1 (en) |
SG (1) | SG121976A1 (en) |
TW (1) | TWI392377B (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1903500A3 (en) * | 2006-09-25 | 2009-03-25 | Samsung Electronics Co., Ltd. | System, medium, and method compensating brightness of an image |
EP1868374A3 (en) * | 2006-06-12 | 2011-08-17 | Sony Corporation | Image processing apparatus, image capture apparatus, image output apparatus, and method and program for these apparatus |
CN103137098A (en) * | 2011-12-02 | 2013-06-05 | 联咏科技股份有限公司 | Tone corresponding method and imaging processing device |
Families Citing this family (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7593591B2 (en) * | 2005-08-05 | 2009-09-22 | Seiko Epson Corporation | Method and apparatus for increasing contrast in a digital image |
JP5196731B2 (en) * | 2006-04-20 | 2013-05-15 | キヤノン株式会社 | Image processing apparatus and image processing method |
TWI355856B (en) * | 2006-12-14 | 2012-01-01 | Au Optronics Corp | Method and related apparatus of compensating color |
US8000554B2 (en) * | 2007-04-04 | 2011-08-16 | Xerox Corporation | Automatic dynamic range adjustment in digital imaging |
KR100944595B1 (en) * | 2007-04-24 | 2010-02-25 | 가부시끼가이샤 르네사스 테크놀로지 | Display device, display driver, image display method, electronic apparatus and image display driver |
US8233738B2 (en) * | 2007-07-30 | 2012-07-31 | Dolby Laboratories Licensing Corporation | Enhancing dynamic ranges of images |
CN101431637B (en) * | 2007-11-06 | 2013-06-19 | 奇美电子股份有限公司 | Frame data processing apparatus and method |
JP5123713B2 (en) * | 2008-04-04 | 2013-01-23 | キヤノン株式会社 | Image processing apparatus and image processing method |
JP4575501B2 (en) * | 2009-02-26 | 2010-11-04 | 株式会社東芝 | Video signal processing apparatus, control method therefor, and television signal receiving apparatus |
CN101626454B (en) * | 2009-04-10 | 2011-01-05 | 黄宝华 | Method for intensifying video visibility |
CN101620727B (en) * | 2009-08-10 | 2012-05-09 | 电子科技大学 | Self-adaptive enhancement algorithm of weighted histogram of infrared image |
US8457398B2 (en) * | 2009-10-27 | 2013-06-04 | Himax Media Solutions, Inc. | Image enhancement method and apparatuses utilizing the same |
CN101710955B (en) * | 2009-11-24 | 2014-06-25 | 北京中星微电子有限公司 | Method and equipment for adjusting brightness and contrast |
JP2011124800A (en) * | 2009-12-10 | 2011-06-23 | Sony Corp | Image processor, image processing method, and program |
US9055227B2 (en) * | 2010-03-17 | 2015-06-09 | Texas Instruments Incorporated | Scene adaptive brightness/contrast enhancement |
US8881044B2 (en) * | 2011-07-14 | 2014-11-04 | Apple Inc. | Representing ranges of image data at multiple resolutions |
US9008458B2 (en) | 2013-02-07 | 2015-04-14 | Raytheon Company | Local area processing using packed distribution functions |
CN103491312B (en) * | 2013-09-29 | 2016-06-15 | 武汉虹识技术有限公司 | A kind of automatic exposure control method for iris recognition and device |
CN105303586B (en) * | 2014-07-16 | 2018-05-11 | 深圳Tcl新技术有限公司 | Obtain method, the method and image processing apparatus of luminance dynamic adjustment of histogram |
CN104200794B (en) * | 2014-08-20 | 2017-11-10 | 明基电通有限公司 | Image regulating method and display |
CN105898369A (en) * | 2015-12-01 | 2016-08-24 | 乐视云计算有限公司 | Video image quality adjustment method and device |
TWI653894B (en) | 2018-01-05 | 2019-03-11 | 瑞昱半導體股份有限公司 | Image enhancement circuit and method thereof |
CN110035267B (en) * | 2018-01-12 | 2021-07-16 | 瑞昱半导体股份有限公司 | Image enhancement circuit and method |
CN111063319B (en) * | 2018-10-16 | 2021-05-18 | 深圳Tcl新技术有限公司 | Image dynamic enhancement method and device based on backlight adjustment and computer equipment |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0424920A2 (en) * | 1989-10-25 | 1991-05-02 | Dainippon Screen Mfg. Co., Ltd. | Method of and apparatus for obtaining tone curve |
Family Cites Families (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS6342575A (en) * | 1986-08-08 | 1988-02-23 | Dainippon Screen Mfg Co Ltd | Method and device for gradation conversion |
US5063607A (en) | 1988-10-24 | 1991-11-05 | Hughes Aircraft Company | Image contrast enhancement technique |
US5414538A (en) | 1993-10-07 | 1995-05-09 | Xerox Corporation | Image-dependent exposure enhancement |
US5450502A (en) * | 1993-10-07 | 1995-09-12 | Xerox Corporation | Image-dependent luminance enhancement |
US6463173B1 (en) * | 1995-10-30 | 2002-10-08 | Hewlett-Packard Company | System and method for histogram-based image contrast enhancement |
KR100213039B1 (en) | 1996-04-10 | 1999-08-02 | 윤종용 | Method and apparatus of image enhancement using average-matching histogram equalization |
ES2185874T3 (en) * | 1996-04-10 | 2003-05-01 | Samsung Electronics Co Ltd | PROCEDURE TO IMPROVE IMAGE QUALITY THROUGH THE EQUALIZATION OF HISTOGRAM FOR MEDIA ADJUSTMENT AND CIRCUIT FOR CARRYING OUT. |
US5828793A (en) | 1996-05-06 | 1998-10-27 | Massachusetts Institute Of Technology | Method and apparatus for producing digital images having extended dynamic ranges |
KR100261214B1 (en) * | 1997-02-27 | 2000-07-01 | 윤종용 | Histrogram equalization method and apparatus of a contrast expanding apparatus in image processing system |
US5949918A (en) | 1997-05-21 | 1999-09-07 | Sarnoff Corporation | Method and apparatus for performing image enhancement |
EP0891075A3 (en) * | 1997-06-09 | 2002-03-06 | Seiko Epson Corporation | An image processing apparatus and method, and an image evaluation device and method |
EP0973128B1 (en) | 1998-06-22 | 2003-06-11 | Texas Instruments Incorporated | Selective intensity expansion |
US6239782B1 (en) | 1999-01-19 | 2001-05-29 | Tektronix, Inc. | Single knob intensity control for use in digital test and measurement equipment |
US6594388B1 (en) * | 2000-05-25 | 2003-07-15 | Eastman Kodak Company | Color image reproduction of scenes with preferential color mapping and scene-dependent tone scaling |
US6650664B1 (en) * | 2001-01-19 | 2003-11-18 | The United States Of America As Represented By The Secretary Of The Air Force | Cladding-pumped fiber with helical rare-earth-doped core for fiber lasers and amplifiers |
JP4130366B2 (en) | 2001-04-11 | 2008-08-06 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Image signal contrast control method |
CA2365893A1 (en) * | 2001-12-21 | 2003-06-21 | Jaldi Semiconductor Corp. | System and method for dynamically enhanced colour space |
KR100466785B1 (en) * | 2002-01-18 | 2005-01-17 | (주)플렛디스 | Apparatus and Method Of Controlling Picture Quality In Flat Display Panel |
KR100456017B1 (en) * | 2002-02-06 | 2004-11-08 | 삼성전자주식회사 | Contrast enhancement apparatus using histogram matching and method thereof |
EP1345172A1 (en) | 2002-02-26 | 2003-09-17 | Sony International (Europe) GmbH | Contrast enhancement for digital images |
US7221807B2 (en) * | 2002-03-29 | 2007-05-22 | Sharp Laboratories Of America, Inc. | Methods and systems for digital image characteristic adjustment using a neural network |
US6778183B1 (en) | 2002-07-10 | 2004-08-17 | Genesis Microchip Inc. | Method and system for adaptive color and contrast for display devices |
US7034843B2 (en) | 2002-07-10 | 2006-04-25 | Genesis Microchip Inc. | Method and system for adaptive color and contrast for display devices |
KR20040008067A (en) | 2002-07-15 | 2004-01-28 | 삼성전자주식회사 | Image enhancing circuit using corelation between frames and method therefor |
US7116838B2 (en) * | 2002-10-25 | 2006-10-03 | Eastman Kodak Company | Enhancing the tonal and spatial characteristics of digital images using selective spatial filters |
KR20040040699A (en) * | 2002-11-07 | 2004-05-13 | 삼성전자주식회사 | Apparatus and Method for compansation contrast |
-
2005
- 2005-01-26 US US11/044,755 patent/US7760961B2/en active Active
- 2005-10-04 TW TW094134726A patent/TWI392377B/en active
- 2005-10-07 SG SG200506565A patent/SG121976A1/en unknown
- 2005-10-12 JP JP2005298064A patent/JP4616749B2/en active Active
- 2005-10-13 KR KR1020050096429A patent/KR101234958B1/en active IP Right Grant
- 2005-10-13 EP EP05256355A patent/EP1648156B1/en active Active
- 2005-10-13 DE DE602005023821T patent/DE602005023821D1/en active Active
- 2005-10-14 CN CN2005101249436A patent/CN1770847B/en active Active
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0424920A2 (en) * | 1989-10-25 | 1991-05-02 | Dainippon Screen Mfg. Co., Ltd. | Method of and apparatus for obtaining tone curve |
Non-Patent Citations (2)
Title |
---|
SANG-YEON KIM ET AL: "IMAGE CONTRAST ENHANCEMENT BASED ON THE PIECEWISE-LINEAR APPROXIMATION OF CDF" IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, IEEE SERVICE CENTER, NEW YORK, NY, US, vol. 45, no. 3, 1 August 1999 (1999-08-01), pages 828-827, XP011083806 ISSN: 0098-3063 * |
YEONG-TAEG KIM Y E T A: "Contrast Enhancement Using Brightness Preserving Bi-Histogram Equalization" 19970201, vol. 43, no. 1, 1 February 1997 (1997-02-01), pages 1-8, XP011008353 * |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1868374A3 (en) * | 2006-06-12 | 2011-08-17 | Sony Corporation | Image processing apparatus, image capture apparatus, image output apparatus, and method and program for these apparatus |
EP1903500A3 (en) * | 2006-09-25 | 2009-03-25 | Samsung Electronics Co., Ltd. | System, medium, and method compensating brightness of an image |
US8705886B2 (en) | 2006-09-25 | 2014-04-22 | Samsung Electronics Co., Ltd. | System, medium, and method compensating brightness of an image |
CN103137098A (en) * | 2011-12-02 | 2013-06-05 | 联咏科技股份有限公司 | Tone corresponding method and imaging processing device |
CN103137098B (en) * | 2011-12-02 | 2015-06-17 | 联咏科技股份有限公司 | Tone corresponding method |
Also Published As
Publication number | Publication date |
---|---|
EP1648156B1 (en) | 2010-09-29 |
CN1770847B (en) | 2010-08-04 |
SG121976A1 (en) | 2006-05-26 |
JP4616749B2 (en) | 2011-01-19 |
KR20060086815A (en) | 2006-08-01 |
US20060083425A1 (en) | 2006-04-20 |
KR101234958B1 (en) | 2013-02-19 |
CN1770847A (en) | 2006-05-10 |
JP2006140995A (en) | 2006-06-01 |
US7760961B2 (en) | 2010-07-20 |
TW200627971A (en) | 2006-08-01 |
EP1648156A3 (en) | 2009-01-07 |
TWI392377B (en) | 2013-04-01 |
DE602005023821D1 (en) | 2010-11-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1648156B1 (en) | Adaptive contrast enhancement | |
US7573533B2 (en) | Method of generating transfer curves for adaptive contrast enhancement | |
RU2452039C2 (en) | Video display device | |
US8334934B2 (en) | Image display device and image display method | |
US9396526B2 (en) | Method for improving image quality | |
JP6136030B2 (en) | Video display control device | |
US7826680B2 (en) | Integrated histogram auto adaptive contrast control (ACC) | |
JP5644444B2 (en) | Image display device, image display method, and image processing device | |
JP3961515B2 (en) | Image quality improving apparatus and method | |
US10944910B2 (en) | Display apparatus, control method thereof, and non-transitory computer readable medium | |
JP5165076B2 (en) | Video display device | |
JP5152203B2 (en) | Image processing apparatus, image processing method, image processing program, and image correction apparatus | |
CA2397057A1 (en) | Contrast adjusting circuit | |
JP2011124800A (en) | Image processor, image processing method, and program | |
US20110110602A1 (en) | Image processing apparatus and control method thereof, and computer-readable storage medium | |
JP2017098845A (en) | Image processing apparatus, image processing method, and program | |
US9288426B2 (en) | Video display control device | |
JP4453805B2 (en) | Image processing system, projector, program, information storage medium, and image processing method | |
US20190341003A1 (en) | Display apparatus and display method | |
JP2010008535A (en) | Image display device | |
JP4280904B2 (en) | Image processing system, projector, program, information storage medium, and image processing method | |
JP2010091949A (en) | Histogram generation method, histogram generation circuit and image processing device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA HR MK YU |
|
PUAL | Search report despatched |
Free format text: ORIGINAL CODE: 0009013 |
|
AK | Designated contracting states |
Kind code of ref document: A3 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA HR MK YU |
|
17P | Request for examination filed |
Effective date: 20090702 |
|
AKX | Designation fees paid |
Designated state(s): DE FR GB |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: TAMIRAS PER PTE. LTD., LLC |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): DE FR GB |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REF | Corresponds to: |
Ref document number: 602005023821 Country of ref document: DE Date of ref document: 20101111 Kind code of ref document: P |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602005023821 Country of ref document: DE Effective date: 20110630 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 11 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 12 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 13 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 14 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230527 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20230914 Year of fee payment: 19 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20230914 Year of fee payment: 19 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20230915 Year of fee payment: 19 |