US20100183238A1 - Method and Apparatus for Spectrum Estimation - Google Patents
Method and Apparatus for Spectrum Estimation Download PDFInfo
- Publication number
- US20100183238A1 US20100183238A1 US12/637,526 US63752609A US2010183238A1 US 20100183238 A1 US20100183238 A1 US 20100183238A1 US 63752609 A US63752609 A US 63752609A US 2010183238 A1 US2010183238 A1 US 2010183238A1
- Authority
- US
- United States
- Prior art keywords
- image data
- pixel
- control parameters
- enhancement
- adaptive
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000001228 spectrum Methods 0.000 title claims abstract description 83
- 238000000034 method Methods 0.000 title claims abstract description 39
- 230000003044 adaptive effect Effects 0.000 claims abstract description 68
- 238000009826 distribution Methods 0.000 claims abstract description 64
- 230000003595 spectral effect Effects 0.000 claims abstract description 9
- 238000001914 filtration Methods 0.000 claims abstract description 8
- 241000023320 Luma <angiosperm> Species 0.000 claims description 3
- 238000012937 correction Methods 0.000 claims description 3
- OSWPMRLSEDHDFF-UHFFFAOYSA-N methyl salicylate Chemical compound COC(=O)C1=CC=CC=C1O OSWPMRLSEDHDFF-UHFFFAOYSA-N 0.000 claims description 3
- 230000008569 process Effects 0.000 description 12
- 238000010586 diagram Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 238000012545 processing Methods 0.000 description 6
- 238000007796 conventional method Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 5
- 238000001514 detection method Methods 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 230000000116 mitigating effect Effects 0.000 description 2
- 238000007781 pre-processing Methods 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000009795 derivation Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/73—Deblurring; Sharpening
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20004—Adaptive image processing
- G06T2207/20012—Locally adaptive
Definitions
- the present invention relates in general to processing image data and more particularly to providing control parameters for enhancement of image data.
- Perceived sharpness of displayed images is an important parameter in defining picture quality.
- Many devices utilize sharpness enhancement to optimize visual display of image data.
- sharpness enhancement typically assume that received image data relates to full spectrum, for example data satisfying the Nyquist frequency.
- received image data may be sub-optimal.
- one cause of spectrum reduction in image data may be due to upscaling of lower definition video sources (e.g., 480 p resolution such as video format) to a high-definition format.
- sharpness enhancement performed on the image data without knowledge of the incoming image data spectrum can render sharpness enhancement of the image data ineffective.
- the conventional methods and devices for image enhancement do not address spectrum of the input image data.
- sharpness enhancement has become an important issue.
- standard definition (SD) video and television (SDTV) sources may be upscaled and broadcast as high definition (HD) programming.
- HD high definition
- Many of the conventional techniques apply static sharpness settings usually based on an assumption that signal quality matches picture resolution and thus, disregard upscaled image data.
- the conventional techniques for sharpness enhancement based on the received imaged data will not produce the desired effect.
- Conventional techniques of contrast enhancement further do not address the presence of artifacts in broadcast image streams, nor the presence of HD graphics (e.g., logos) overlaid on broadcast image data.
- a method includes receiving image data for a first frame, calculating an adaptive threshold value based on the image data, and determining a pixel slope distribution for a pixel window of the image data, wherein the pixel window is selected based on the adaptive threshold value.
- the method further includes determining a spectrum estimation coefficient based on the pixel distribution, wherein the spectrum estimation coefficient is determined based on the spectral components of the image data, and determining one or more control parameters for enhancement of the image data based on the spectrum estimation coefficient, wherein the one or more control parameters relate to filtering parameters for adaptive enhancement of image data.
- FIG. 1 depicts a simplified block diagram of a spectrum analyzer according to one or more embodiments of the invention
- FIG. 2 depicts a simplified block diagram of image processing system according to one embodiment of the invention
- FIGS. 3A-3D depict a graphical representations of pixel distributions according to one or more embodiments of the invention.
- FIG. 4 depicts a simplified block diagram of a spectrum analyzer according to another embodiment of the invention.
- FIG. 5 depicts a process for determining one or more control parameters according to one embodiment of the invention
- FIG. 6 depicts a process for calculating a control parameter according to one embodiment of the invention.
- FIGS. 7A-7D depict graphical representations of control parameters based on the pixel distributions of FIGS. 3A-3D according to one or more embodiments of the invention.
- control parameters may be determined for particular types of image data in order to provide adaptive sharpness enhancement.
- One or more control parameters may be determined by analyzing input image data in order to detect upscaling of image data, and a scaling factor.
- a method for determining control parameters includes determining an adaptive threshold value for the image data, which may relate to one of upscaled standard definition image data to partial high definition (e.g., 1280 ⁇ 720) and full high definition (e.g., 1920 ⁇ 1080) image data. The spectral content of received image data may be analyzed to estimate an original resolution.
- the method may further include determining a spectrum estimation coefficient based on the adaptive threshold value.
- One or more control parameters for adaptive sharpness enhancement may be determined based on the spectrum estimation coefficient. In that fashion, spectral components of image data may be analyzed to provide one or more control parameters for adaptive sharpness enhancement of image data.
- a device may be provided including a slope analyzer module and adaptive threshold module configured to calculate a distribution of the image data.
- the device may be configured to estimate the image data spectrum and generate an appropriate control signal for sharpness enhancement.
- the methods and apparatus as disclosed herein may provide output to a content adaptive sharpening (CAS) module according to one or more embodiments.
- CAS content adaptive sharpening
- FIG. 1 depicts a simplified block diagram of a spectrum analyzer according to one or more embodiments of the invention.
- image spectrum of received image data may be determined by spectrum analyzer 100 .
- spectrum analyzer 100 may be configured to produce one or more parameters which may be employed by an adaptive sharpness enhancement device according to one or more embodiments of the invention.
- Spectrum analyzer 100 may be configured to receive image data as input.
- Exemplary input to the system includes, but is not limited to, quarter video graphics array (QVGA), encoded image and/or movie data (e.g., YUV422), compressed images (e.g., Y-only downscaled copies), standard definition (SD) and high definition (HD) image data.
- input to spectrum analyzer 100 may be a high definition feed which may include upscaled image data, such as upscaled SD image data.
- slope analyzer 105 can calculate a pixel slope distribution of the image data.
- Spectrum analyzer 105 may be configured to determine image quality of received image data.
- the pixel slope distribution may relate to a histogram of fast and slow edges of a horizontal or vertical window of the image data.
- One pixel apart and two pixel apart slopes may respectively relate to fast and slow edges.
- fast edges become slow edges and slow edges become slower edges (e.g., >4 pixel s apart).
- fast edges become 1.5 pixel edges and slow edges become 3 pixels when upscaling SD to 720p, or 720 to 1080. Therefore, the percentage of both fast and slow edges in the upscaled image data may be expected to significantly decrease.
- Adaptive threshold module 110 may similarly receive the image data of a first frame and may further be configured to calculate a dynamic threshold reflecting image detail and a dynamic range of the image data.
- An adaptive threshold value may be provided by adaptive threshold module 110 to slope analyzer 105 for determination of one or more pixel windows.
- Slope analyzer 105 may be configured to provide a pixel slope distribution of pixel slopes to spectrum estimation module 115 .
- Slope or gradient measurements, relate to time domain measurements based on the detection of the highest slope in the image signal and distribution of various slopes.
- spectrum estimation module 115 may be configured to process the distribution to estimate spectral components of the image data.
- the spectrum analyzer 100 may characterize received image data as one or more types of image input. Exemplary image input types are listed in Table 1 below.
- spectrum estimation module 115 may produce one or more spectrum estimation coefficients.
- the functions of the units of spectrum analyzer 100 may be implemented in a variety of ways including hardware, firmware, software, and combinations thereof.
- System 200 may be configured to provide adaptive enhancement of image data.
- Image data received by input 205 of system 200 maybe pre-processed at block 210 .
- pre-processing functions at block 210 may relate to one or more of noise reduction, deinterlacing of image data, and image deblocking.
- deblocking performed by pre-processing module 210 may advantageously allow for mitigation of noise effects and small block boundary discontinuities due to artifacts in compressed video streams. Block artifacts in compressed video streams, such as pixel discontinuity between 8 ⁇ 8 pixel blocks create false fast edges unrelated to upscaled image content.
- deblocking can aid in mitigating these effects.
- deblocking may not fully eliminate noise effects.
- the adaptive threshold value may be determined to select a small percentage (e.g., top 10%) of edges in each image for further consideration to eliminate noise effects and small block boundary discontinuities.
- the pre-processed image data may then be received by spectrum analyzer module 215 and content adaptive sharpening module 220 .
- spectrum analyzer 215 may be configured to perform one or more of the functions including slope analysis, and determination of an adaptive threshold to provide one or more parameters for content adaptive sharpening module 220 .
- spectrum analyzer 215 may perform the functions of spectrum analyzer 105 and adaptive threshold module 110 .
- spectrum analyzer 215 and content adaptive sharpening module 220 may be coupled to processor 225 .
- Processor 225 may include one or more interfaces for coupling with spectrum analyzer 215 and content adaptive sharpening module 220 .
- spectrum analyzer 215 may provide data related to slope counting, window range, and pixel slope distribution to processor 225 via interface 235 a.
- spectrum analyzer 215 may further be configured to perform pixel based processing of received image data, wherein processor 225 performs spectrum estimation functions (e.g., spectrum estimation block 115 ).
- Spectrum analyzer 215 may be configured to perform slope analysis and adaptive threshold determination.
- Spectrum analyzer 215 may be configured to process pixels in a 9-pixel window centered on a current pixel. The window orientation may be programmed to be either horizontal or vertical. As will be discussed in more detail below with respect to FIG.
- the spectrum analyzer may be configured to count pixel slopes within windows of the image data when two conditions are met: 1.) the range of the signal (e.g., max-min) in the window exceeds the adaptive threshold calculated for the image frame; and 2.) the height of the pixel slope centered in a window exceeds a predefined percentage.
- Processor 225 may be configured to calculate an adaptive threshold for a current frame based on the window range histogram. Processor 225 may be configured to output adaptive threshold value via interface 235 b to spectrum analyzer 215 . Processor 225 may additionally be configured to process output of the slope analyzer 215 of spectrum analyzer 215 to generate output of control parameters to content adaptive sharpening module 220 via interface 235 c. In one embodiment, control parameters may range between 0 and 1, with high values reflect true HD definition video content and low values corresponding to SD. Based on the image data and distribution data provided by spectrum analyzer 215 , processor 225 may output configuration parameters to content adaptive sharpening module 220 , which may then output enhanced image data at output 230 . Output of processor interface 235 c may be employed by a content adaptive enhancement module of a display device.
- processor 225 may be configured to operate based on one or more instructions stored in memory 240 , wherein memory 240 relates to one of ROM and RAM memory. Executable instructions and/or data received by processor 225 may be stored by memory 240 .
- content adaptive sharpening module 220 may be configured to perform content adaptive sharpening on received image data.
- content adaptive sharpening module 220 may convert one or more luminance levels of an input signal based on a look-up table (LUT) matrix, wherein the LUT matrix is determined based on image data received for one or more frames.
- Device 200 may be configured to process one or more frames of the image data received.
- a frame may relate to image data captured by an imaging device, such as a photosensor, camera, video detector, etc.
- a frame may also describe detection data for a particular period of time.
- Spectrum analyzer 215 may provide one or more coefficient values which may be employed to enhanced sharpening functions of the content adaptive sharpening module 220 . Accordingly, image signals and/or data received on input 205 may be processed and output with enhanced dynamic range.
- FIGS. 3A-3D graphical representations are depicted of pixel slope distributions according to one or more embodiments of the invention.
- the spectrum of an input signal may vary based on the type of image data and upscaling of the image data.
- FIGS. 3A-3D are exemplary representations of pixel slope distributions for exemplary input types.
- the pixel slope distributions include distributions of 1 pixel apart to 7 pixel apart slope distributions.
- pixel slope distribution 305 relates to a pixel slope distribution for standard definition (SD) image data upscaled to high definition (e.g., 1080 line image resolution).
- SD standard definition
- pixel slope distribution 310 relates to a pixel slope distribution for HD image data transmitted as HD (e.g., 1080 line image resolution).
- pixel slope distribution 315 relates to a pixel slope distribution for upscaled SD image data transmitted as lower definition HD (e.g., 720 line image resolution).
- pixel slope distribution 320 relates to a pixel slope distribution for HD image data transmitted as lower definition HD (e.g., 720 line image resolution).
- the pixel slope distributions may be analyzed by a slope analyzer (e.g., slope analyzer 105 ) to estimate spectral components of received image data.
- a slope analyzer e.g., slope analyzer 105
- Spectrum analyzer module 400 (e.g., spectrum analyzer module 215 ) may be configured to output data to a processor (e.g., processor 225 ) for calculation of one or more control parameters based on image data received via input 405 .
- Shift register 410 and multiplexer 415 may be configured to select output windows of pixel data based on output of horizontal input 430 to multiplexer 415 .
- Horizontal module 430 may output signals based on data received by a processor (e.g., processor 225 ).
- Min/Max module 420 may be configured to determined maximum and minimum values in the pixel window. In one embodiment, the pixel values may relate to a nine (9) pixel horizontal or vertical window.
- Window selection at block 425 may be based on controller input from adaptive threshold input 435 . Window selection may help to keep certain windows for further processing whose range exceeds a threshold provided by adaptive threshold module 435 .
- window selection module 425 may be configured to select a window of image data smaller than the image frame to mitigate the presence of HD network logos and/or graphics which may be overlaid on upscaled image data. The presence of overlaid HD content may cause the detection algorithm into classifying the entire image as HD image data. Based on a programmable detection window by window selection module 425 , a window smaller than the image frame may be selected to exclude overlaid graphics.
- Adaptive threshold module 435 may be provided by a processor (e.g., processor 225 ).
- the adaptive threshold value for a subsequent frame of the image data may be based on the distribution of the window dynamic range values for a current frame for image data that substantially correlates with a previous frame.
- Image data may then be passed to slope classifier 445 which may be configured to distribute determined slopes centered in the analysis window. Selection by slope classifier 445 may target the top 10% of windows according to their range. A higher percentage of windows can increase noise rejection but may lower distribution results. Slope classifier 445 may base the distribution of slope based on window threshold input 440 . In one embodiment, an analysis window may be separated into five bins, wherein slope values may be distributed into the following categories:
- counters may determine slope counts. As shown in FIG. 4 , 1-pix counter 450 , 2-pix counter 455 , 3-pix counter 460 , 4-pix counter 465 , and x-pix counter 470 , accumulate slope counts for the five bins described above. Output of the pix counters may be provided to slope counter 475 . Slope counter 475 may be configured to determine a number of slope values based on the output of the pix counters. In certain embodiments only a portion of the pix counter outputs may be used by spectrum analyzer module 400 to provide output parameters. By way of example, only 1-pix counter 450 and 2-pix counter 455 may be required to determine parameters for spectrum analyzing in one embodiment.
- Distribution maximum/minimum (Max-Min) module 480 may be configured to track the frequency distribution of window dynamic range.
- Distribution max-min determination module 480 may calculate values for 65 bins to determine max and min values of the distribution.
- Range distribution module 485 may be configured to determine the pixel distribution range of image data. In certain embodiments, higher image contrast in a 9-pixel window will relate to larger values accumulated in higher distribution bins. In certain embodiments the first 32 bins of a distribution are expected to cover the significant distribution data and may be relevant to pixel determinations. Accordingly, range distribution module 485 may be configured to determine the range of bins.
- a processor may be configured to determine one or more parameters for control of a content adaptive sharpening module (e.g., content adaptive sharpening 220 ).
- the processor may define several sets of parameters covering a continuous range of spectrum utilization scenarios (e.g., from very flat upscaled SD to best quality HD). The processor may then map the continuous spectrum utilization coefficient based on the parameters sets to select a corresponding set of control parameters dynamically.
- Spectrum estimation provide by system 400 may be combined with additional sources of information, including resolution and black bar presence detectors to produce more robust results.
- the spectrum utilization coefficient can be limited to values larger than 0.3 when image resolution relates 720 line resolution, because upscaling cannot exceed 1.5 ⁇ . Similarly, in another embodiment the coefficient cannot be lowered when black bars are present, which typically flags SD content.
- process 500 may be performed by the signal spectrum analyzer of FIG. 1 .
- Process 500 may be initiated by receiving image data for a first frame at block 505 .
- An adaptive threshold value may then be calculated based on the image data at block 510 .
- the adaptive threshold value may be employed to define a range threshold for image data of the pixel window.
- a range for one or more pixel windows may be determined by a min/module of the spectrum analyzer for selection of pixel windows with range values that exceed the adaptive threshold value.
- a pixel distribution may be determined based on a pixel window of the image data.
- the pixel window may be selected based on the adaptive threshold value.
- the pixel distribution may be calculated based on a luma component of the image data.
- the pixel distribution may be calculated for fast and slow edges within a horizontal or vertical pixel window of image data.
- Process 500 may continue by determining a spectrum estimation coefficient based on the pixel distribution at block 520 , wherein the spectrum estimation coefficient is determined based on the spectral components of the image data.
- the spectrum estimation coefficient may relate to a scaling factor of the image data, such as a scaling factor of SD image data for transmission on an HD channel/broadcast. Lower coefficient values may be associated with standard definition image quality and higher values are associated with high definition image quality.
- the spectrum analyzer may be configured to limit a spectrum estimation coefficient when the pixel distribution indicates that image data relates to SD.
- one or more control parameters may be determined for enhancement of the image data based on the spectrum estimation coefficient.
- image enhancement relates to content adaptive sharpening of image data.
- control parameters may be determined for one or more different types of image processing to enhance image display.
- the one or more control parameters may relate to filtering parameters for sharpness enhancement of image data and may be provided to match filtering of a content adaptive sharpening device (e.g., content adaptive sharpening module 220 ) to the quality of the image data and spectrum utilization.
- the control parameters may further provide sharpness correction factors for upscaled image data.
- Process 600 may be performed by a processor (e.g., processor 225 ) of a content adaptive sharpening module and may be initiated by receiving slope counter values at block 605 .
- Slope count may be based on output of a plurality of pixel counters (e.g., 1-pix count 450 and 2-pix count 455 ).
- a spectrum utilization coefficient may then be calculated at block 610 based on the received slope count. In one embodiment, calculation of the spectrum utilization coefficient may be based on calculation of percentages of the 1- and 2-pixel slope counts, limiting and normalizing of the result and derivation of the utilization coefficient.
- Control parameters may relate to values between 0 and 1, wherein a value of 0 corresponds to low quality SD images upscaled to 1080 lines, and a value of 1 corresponds to unsealed best quality true HD images. Intermediate values around the mid point may roughly correspond to SD images upscaled to 720, or 720 images upscaled to HD.
- control parameters may be filtered to reduce variance.
- a first order recursive filter and peak tracking filter may be used.
- the first order recursive filter may operate as an infinite impulse response (IIR) filter.
- IIR infinite impulse response
- the filter control parameter may be determined as follows:
- a peak tracking filter may be employed based on a comparison of control parameters to a value associate with a peak value of the image data. Output of the peak filter may be more conservative (higher) than a simple recursive filter.
- control parameters are depicted for SD image data upscaled to HD (e.g., 1080 lines) based on pixel slope distribution 305 .
- control parameters 710 relate to a pixel slope distribution for HD image data transmitted as HD based on pixel distribution 310 .
- control parameters 715 relate to pixel slope distribution 315 for upscaled SD image data transmitted as lower definition HD (e.g., 720).
- control parameters 720 relate to the pixel slope distribution 320 for HD image data transmitted as lower definition HD (e.g., 720).
- SD clips upscaled to 1080 yield consistently low results, while hi-def clips produce consistently high results.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
- Picture Signal Circuits (AREA)
Abstract
Description
- This application claims the benefit of U.S. Provisional Application No. 61/145,684, filed on Jan. 19, 2009, which is hereby fully incorporated by reference.
- This application is related to concurrently filed application entitled, “Method and Apparatus for Content Adaptive Sharpness Enhancement” which is hereby fully incorporated by reference.
- The present invention relates in general to processing image data and more particularly to providing control parameters for enhancement of image data.
- Perceived sharpness of displayed images is an important parameter in defining picture quality. Many devices utilize sharpness enhancement to optimize visual display of image data. There are several techniques for improving sharpness. The conventional methods of sharpness enhancement typically assume that received image data relates to full spectrum, for example data satisfying the Nyquist frequency. However, in many cases received image data may be sub-optimal. For example, one cause of spectrum reduction in image data may be due to upscaling of lower definition video sources (e.g., 480 p resolution such as video format) to a high-definition format. As a result, sharpness enhancement performed on the image data without knowledge of the incoming image data spectrum can render sharpness enhancement of the image data ineffective. The conventional methods and devices for image enhancement, however, do not address spectrum of the input image data.
- For display devices in particular, such as digital televisions, sharpness enhancement has become an important issue. Quite often, standard definition (SD) video and television (SDTV) sources may be upscaled and broadcast as high definition (HD) programming. Many of the conventional techniques apply static sharpness settings usually based on an assumption that signal quality matches picture resolution and thus, disregard upscaled image data. In this particular case, the conventional techniques for sharpness enhancement based on the received imaged data will not produce the desired effect. Conventional techniques of contrast enhancement further do not address the presence of artifacts in broadcast image streams, nor the presence of HD graphics (e.g., logos) overlaid on broadcast image data.
- Thus, there is a need in the art for systems and methods of spectrum estimation of image data and determination of sharpness enhancement control parameters.
- Disclosed and claimed herein, are an apparatus and methods for determining control parameters for image enhancement. In one embodiment, a method includes receiving image data for a first frame, calculating an adaptive threshold value based on the image data, and determining a pixel slope distribution for a pixel window of the image data, wherein the pixel window is selected based on the adaptive threshold value. The method further includes determining a spectrum estimation coefficient based on the pixel distribution, wherein the spectrum estimation coefficient is determined based on the spectral components of the image data, and determining one or more control parameters for enhancement of the image data based on the spectrum estimation coefficient, wherein the one or more control parameters relate to filtering parameters for adaptive enhancement of image data.
- Other aspects, features, and techniques of the invention will be apparent to one skilled in the relevant art in view of the following detailed description of the invention.
- The features, objects, and advantages of the present invention will become more apparent from the detailed description set forth below when taken in conjunction with the drawings in which like reference characters identify correspondingly throughout and wherein:
-
FIG. 1 depicts a simplified block diagram of a spectrum analyzer according to one or more embodiments of the invention; -
FIG. 2 depicts a simplified block diagram of image processing system according to one embodiment of the invention; -
FIGS. 3A-3D depict a graphical representations of pixel distributions according to one or more embodiments of the invention; -
FIG. 4 depicts a simplified block diagram of a spectrum analyzer according to another embodiment of the invention; -
FIG. 5 depicts a process for determining one or more control parameters according to one embodiment of the invention; -
FIG. 6 depicts a process for calculating a control parameter according to one embodiment of the invention; and -
FIGS. 7A-7D depict graphical representations of control parameters based on the pixel distributions ofFIGS. 3A-3D according to one or more embodiments of the invention. - One aspect of the present invention relates to methods and apparatus for determining control parameters for image enhancement, such as content adaptive sharpening (CAS) of image data. In one embodiment, control parameters may be determined for particular types of image data in order to provide adaptive sharpness enhancement. One or more control parameters may be determined by analyzing input image data in order to detect upscaling of image data, and a scaling factor. In one embodiment a method for determining control parameters includes determining an adaptive threshold value for the image data, which may relate to one of upscaled standard definition image data to partial high definition (e.g., 1280×720) and full high definition (e.g., 1920×1080) image data. The spectral content of received image data may be analyzed to estimate an original resolution. The method may further include determining a spectrum estimation coefficient based on the adaptive threshold value. One or more control parameters for adaptive sharpness enhancement may be determined based on the spectrum estimation coefficient. In that fashion, spectral components of image data may be analyzed to provide one or more control parameters for adaptive sharpness enhancement of image data.
- In another embodiment, a device may be provided including a slope analyzer module and adaptive threshold module configured to calculate a distribution of the image data. The device may be configured to estimate the image data spectrum and generate an appropriate control signal for sharpness enhancement. The methods and apparatus as disclosed herein may provide output to a content adaptive sharpening (CAS) module according to one or more embodiments.
- Referring now to the figures,
FIG. 1 depicts a simplified block diagram of a spectrum analyzer according to one or more embodiments of the invention. For optimum performance of sharpness enhancement of image data, image spectrum of received image data may be determined byspectrum analyzer 100. Accordingly,spectrum analyzer 100 may be configured to produce one or more parameters which may be employed by an adaptive sharpness enhancement device according to one or more embodiments of the invention.Spectrum analyzer 100 may be configured to receive image data as input. Exemplary input to the system includes, but is not limited to, quarter video graphics array (QVGA), encoded image and/or movie data (e.g., YUV422), compressed images (e.g., Y-only downscaled copies), standard definition (SD) and high definition (HD) image data. In one embodiment, input tospectrum analyzer 100 may be a high definition feed which may include upscaled image data, such as upscaled SD image data. Based on the received image data,slope analyzer 105 can calculate a pixel slope distribution of the image data. -
Spectrum analyzer 105 may be configured to determine image quality of received image data. In one embodiment, the pixel slope distribution may relate to a histogram of fast and slow edges of a horizontal or vertical window of the image data. One pixel apart and two pixel apart slopes may respectively relate to fast and slow edges. When SD image data is upscaled by a multiple of 2.25 (e.g., from 480 to 1080), fast edges become slow edges and slow edges become slower edges (e.g., >4 pixel s apart). Similarly, fast edges become 1.5 pixel edges and slow edges become 3 pixels when upscaling SD to 720p, or 720 to 1080. Therefore, the percentage of both fast and slow edges in the upscaled image data may be expected to significantly decrease. -
Adaptive threshold module 110 may similarly receive the image data of a first frame and may further be configured to calculate a dynamic threshold reflecting image detail and a dynamic range of the image data. An adaptive threshold value may be provided byadaptive threshold module 110 toslope analyzer 105 for determination of one or more pixel windows. -
Slope analyzer 105 may be configured to provide a pixel slope distribution of pixel slopes tospectrum estimation module 115. Slope, or gradient measurements, relate to time domain measurements based on the detection of the highest slope in the image signal and distribution of various slopes. Based on the slope data,spectrum estimation module 115 may be configured to process the distribution to estimate spectral components of the image data. Based on the spectrum estimation, thespectrum analyzer 100 may characterize received image data as one or more types of image input. Exemplary image input types are listed in Table 1 below. Based on the estimated spectrum,spectrum estimation module 115 may produce one or more spectrum estimation coefficients. -
TABLE 1 Input Mode Spectrum (% of maximum) CVBS NTSC over the air 62% (4.2 MHz of 6.75 MHz) PAL over the air 62% (4.2 MHz of 6.75 MHz) CVBS video generated 62% (4.2 MHz of 6.75 MHz) locally (i.e., STB or DVD player) ATSC Dull HD 100% HDMI 1.50x (480 lines → 720, 66% 720→ 1080) YPbPr 2.25x (480 lines → 1080) 44% - It should be appreciated that the functions of the units of
spectrum analyzer 100 may be implemented in a variety of ways including hardware, firmware, software, and combinations thereof. - Referring now to
FIG. 2 , a simplified block diagram is shown of an image processing system according to one embodiment of the invention.System 200 may be configured to provide adaptive enhancement of image data. Image data received byinput 205 ofsystem 200 maybe pre-processed atblock 210. In one embodiment, pre-processing functions atblock 210 may relate to one or more of noise reduction, deinterlacing of image data, and image deblocking. According to another embodiment, deblocking performed bypre-processing module 210 may advantageously allow for mitigation of noise effects and small block boundary discontinuities due to artifacts in compressed video streams. Block artifacts in compressed video streams, such as pixel discontinuity between 8×8 pixel blocks create false fast edges unrelated to upscaled image content. Performing deblocking can aid in mitigating these effects. In certain embodiments, deblocking may not fully eliminate noise effects. Accordingly, the adaptive threshold value may be determined to select a small percentage (e.g., top 10%) of edges in each image for further consideration to eliminate noise effects and small block boundary discontinuities. - The pre-processed image data may then be received by
spectrum analyzer module 215 and content adaptive sharpeningmodule 220. In one embodiment,spectrum analyzer 215 may be configured to perform one or more of the functions including slope analysis, and determination of an adaptive threshold to provide one or more parameters for content adaptive sharpeningmodule 220. In one embodiment,spectrum analyzer 215 may perform the functions ofspectrum analyzer 105 andadaptive threshold module 110. - As shown in
FIG. 2 ,spectrum analyzer 215 and content adaptive sharpeningmodule 220 may be coupled toprocessor 225.Processor 225 may include one or more interfaces for coupling withspectrum analyzer 215 and content adaptive sharpeningmodule 220. In one embodiment,spectrum analyzer 215 may provide data related to slope counting, window range, and pixel slope distribution toprocessor 225 viainterface 235 a. - In another
embodiment spectrum analyzer 215 may further be configured to perform pixel based processing of received image data, whereinprocessor 225 performs spectrum estimation functions (e.g., spectrum estimation block 115).Spectrum analyzer 215 may be configured to perform slope analysis and adaptive threshold determination.Spectrum analyzer 215 may be configured to process pixels in a 9-pixel window centered on a current pixel. The window orientation may be programmed to be either horizontal or vertical. As will be discussed in more detail below with respect toFIG. 3 , the spectrum analyzer may be configured to count pixel slopes within windows of the image data when two conditions are met: 1.) the range of the signal (e.g., max-min) in the window exceeds the adaptive threshold calculated for the image frame; and 2.) the height of the pixel slope centered in a window exceeds a predefined percentage. -
Processor 225 may be configured to calculate an adaptive threshold for a current frame based on the window range histogram.Processor 225 may be configured to output adaptive threshold value viainterface 235 b tospectrum analyzer 215.Processor 225 may additionally be configured to process output of theslope analyzer 215 ofspectrum analyzer 215 to generate output of control parameters to content adaptive sharpeningmodule 220 via interface 235 c. In one embodiment, control parameters may range between 0 and 1, with high values reflect true HD definition video content and low values corresponding to SD. Based on the image data and distribution data provided byspectrum analyzer 215,processor 225 may output configuration parameters to content adaptive sharpeningmodule 220, which may then output enhanced image data atoutput 230. Output of processor interface 235 c may be employed by a content adaptive enhancement module of a display device. - According to another embodiment,
processor 225 may be configured to operate based on one or more instructions stored inmemory 240, whereinmemory 240 relates to one of ROM and RAM memory. Executable instructions and/or data received byprocessor 225 may be stored bymemory 240. - According to one embodiment, content adaptive sharpening
module 220 may be configured to perform content adaptive sharpening on received image data. For example, content adaptive sharpeningmodule 220 may convert one or more luminance levels of an input signal based on a look-up table (LUT) matrix, wherein the LUT matrix is determined based on image data received for one or more frames.Device 200 may be configured to process one or more frames of the image data received. As used herein, a frame may relate to image data captured by an imaging device, such as a photosensor, camera, video detector, etc. A frame may also describe detection data for a particular period of time.Spectrum analyzer 215 may provide one or more coefficient values which may be employed to enhanced sharpening functions of the content adaptive sharpeningmodule 220. Accordingly, image signals and/or data received oninput 205 may be processed and output with enhanced dynamic range. - Referring now to
FIGS. 3A-3D , graphical representations are depicted of pixel slope distributions according to one or more embodiments of the invention. The spectrum of an input signal may vary based on the type of image data and upscaling of the image data. According to one embodiment of the invention,FIGS. 3A-3D are exemplary representations of pixel slope distributions for exemplary input types. The pixel slope distributions include distributions of 1 pixel apart to 7 pixel apart slope distributions. InFIG. 3A ,pixel slope distribution 305 relates to a pixel slope distribution for standard definition (SD) image data upscaled to high definition (e.g., 1080 line image resolution). InFIG. 3B ,pixel slope distribution 310 relates to a pixel slope distribution for HD image data transmitted as HD (e.g., 1080 line image resolution). InFIG. 3C ,pixel slope distribution 315 relates to a pixel slope distribution for upscaled SD image data transmitted as lower definition HD (e.g., 720 line image resolution). InFIG. 3D , pixel slope distribution 320 relates to a pixel slope distribution for HD image data transmitted as lower definition HD (e.g., 720 line image resolution). The pixel slope distributions may be analyzed by a slope analyzer (e.g., slope analyzer 105) to estimate spectral components of received image data. - Referring now to
FIG. 4 , a simplified block diagram is shown of a spectrum analyzer module input according to one embodiment of the invention. Spectrum analyzer module 400 (e.g., spectrum analyzer module 215) may be configured to output data to a processor (e.g., processor 225) for calculation of one or more control parameters based on image data received viainput 405.Shift register 410 andmultiplexer 415 may be configured to select output windows of pixel data based on output ofhorizontal input 430 tomultiplexer 415.Horizontal module 430 may output signals based on data received by a processor (e.g., processor 225). Min/Max module 420 may be configured to determined maximum and minimum values in the pixel window. In one embodiment, the pixel values may relate to a nine (9) pixel horizontal or vertical window. - Window selection at
block 425 may be based on controller input fromadaptive threshold input 435. Window selection may help to keep certain windows for further processing whose range exceeds a threshold provided byadaptive threshold module 435. According to one embodiment,window selection module 425 may be configured to select a window of image data smaller than the image frame to mitigate the presence of HD network logos and/or graphics which may be overlaid on upscaled image data. The presence of overlaid HD content may cause the detection algorithm into classifying the entire image as HD image data. Based on a programmable detection window bywindow selection module 425, a window smaller than the image frame may be selected to exclude overlaid graphics. -
Adaptive threshold module 435 may be provided by a processor (e.g., processor 225). In one embodiment, the adaptive threshold value for a subsequent frame of the image data may be based on the distribution of the window dynamic range values for a current frame for image data that substantially correlates with a previous frame. - Image data may then be passed to
slope classifier 445 which may be configured to distribute determined slopes centered in the analysis window. Selection byslope classifier 445 may target the top 10% of windows according to their range. A higher percentage of windows can increase noise rejection but may lower distribution results.Slope classifier 445 may base the distribution of slope based onwindow threshold input 440. In one embodiment, an analysis window may be separated into five bins, wherein slope values may be distributed into the following categories: -
- Single-pixel slope is dominant (larger than dynamic threshold win)
- Two-pixel slope sis dominant
- Three-pixel slope is dominant
- 4-pixel slope is dominant.
- For each bin of the distribution, counters may determine slope counts. As shown in
FIG. 4 , 1-pix counter 450, 2-pix counter 455, 3-pix counter 460, 4-pix counter 465, andx-pix counter 470, accumulate slope counts for the five bins described above. Output of the pix counters may be provided toslope counter 475.Slope counter 475 may be configured to determine a number of slope values based on the output of the pix counters. In certain embodiments only a portion of the pix counter outputs may be used byspectrum analyzer module 400 to provide output parameters. By way of example, only 1-pix counter 450 and 2-pix counter 455 may be required to determine parameters for spectrum analyzing in one embodiment. - Distribution maximum/minimum (Max-Min)
module 480 may be configured to track the frequency distribution of window dynamic range. Distribution max-min determination module 480 may calculate values for 65 bins to determine max and min values of the distribution.Range distribution module 485 may be configured to determine the pixel distribution range of image data. In certain embodiments, higher image contrast in a 9-pixel window will relate to larger values accumulated in higher distribution bins. In certain embodiments the first 32 bins of a distribution are expected to cover the significant distribution data and may be relevant to pixel determinations. Accordingly,range distribution module 485 may be configured to determine the range of bins. - Based on the output by
slope counter 475 andrange distribution module 485, a processor (e.g., processor 225) may be configured to determine one or more parameters for control of a content adaptive sharpening module (e.g., content adaptive sharpening 220). In one embodiment, the processor may define several sets of parameters covering a continuous range of spectrum utilization scenarios (e.g., from very flat upscaled SD to best quality HD). The processor may then map the continuous spectrum utilization coefficient based on the parameters sets to select a corresponding set of control parameters dynamically. - Spectrum estimation provide by
system 400 may be combined with additional sources of information, including resolution and black bar presence detectors to produce more robust results. In an exemplary embodiment, the spectrum utilization coefficient can be limited to values larger than 0.3 when image resolution relates 720 line resolution, because upscaling cannot exceed 1.5×. Similarly, in another embodiment the coefficient cannot be lowered when black bars are present, which typically flags SD content. - Referring now to
FIG. 5 , a process is depicted for determining control parameters for enhancement of image data according to one embodiment of the invention. In one embodiment,process 500 may be performed by the signal spectrum analyzer ofFIG. 1 .Process 500 may be initiated by receiving image data for a first frame atblock 505. An adaptive threshold value may then be calculated based on the image data atblock 510. The adaptive threshold value may be employed to define a range threshold for image data of the pixel window. A range for one or more pixel windows may be determined by a min/module of the spectrum analyzer for selection of pixel windows with range values that exceed the adaptive threshold value. Atblock 515, a pixel distribution may be determined based on a pixel window of the image data. The pixel window may be selected based on the adaptive threshold value. In certain embodiments, the pixel distribution may be calculated based on a luma component of the image data. According to another embodiment, the pixel distribution may be calculated for fast and slow edges within a horizontal or vertical pixel window of image data. -
Process 500 may continue by determining a spectrum estimation coefficient based on the pixel distribution atblock 520, wherein the spectrum estimation coefficient is determined based on the spectral components of the image data. The spectrum estimation coefficient may relate to a scaling factor of the image data, such as a scaling factor of SD image data for transmission on an HD channel/broadcast. Lower coefficient values may be associated with standard definition image quality and higher values are associated with high definition image quality. In certain embodiments, the spectrum analyzer may be configured to limit a spectrum estimation coefficient when the pixel distribution indicates that image data relates to SD. - At
block 525, one or more control parameters may be determined for enhancement of the image data based on the spectrum estimation coefficient. In one embodiment, image enhancement relates to content adaptive sharpening of image data. However, it should also be appreciated that control parameters may be determined for one or more different types of image processing to enhance image display. The one or more control parameters may relate to filtering parameters for sharpness enhancement of image data and may be provided to match filtering of a content adaptive sharpening device (e.g., content adaptive sharpening module 220) to the quality of the image data and spectrum utilization. The control parameters may further provide sharpness correction factors for upscaled image data. - Referring now to
FIG. 6 , a process is depicted for determining control parameters according to one embodiment of the invention.Process 600 may be performed by a processor (e.g., processor 225) of a content adaptive sharpening module and may be initiated by receiving slope counter values atblock 605. Slope count may be based on output of a plurality of pixel counters (e.g., 1-pix count 450 and 2-pix count 455). A spectrum utilization coefficient may then be calculated atblock 610 based on the received slope count. In one embodiment, calculation of the spectrum utilization coefficient may be based on calculation of percentages of the 1- and 2-pixel slope counts, limiting and normalizing of the result and derivation of the utilization coefficient. The processor may then calculate one or more control parameters atblock 615. Control parameters may relate to values between 0 and 1, wherein a value of 0 corresponds to low quality SD images upscaled to 1080 lines, and a value of 1 corresponds to unsealed best quality true HD images. Intermediate values around the mid point may roughly correspond to SD images upscaled to 720, or 720 images upscaled to HD. - According to another embodiment, control parameters may be filtered to reduce variance. For example one or more of a first order recursive filter and peak tracking filter may be used. In one embodiment, the first order recursive filter may operate as an infinite impulse response (IIR) filter. In an exemplary embodiment the filter control parameter may be determined as follows:
-
hd — c — iir=hd — c+0.8*(hd — c — iir−hd — c) - Alternatively a peak tracking filter may be employed based on a comparison of control parameters to a value associate with a peak value of the image data. Output of the peak filter may be more conservative (higher) than a simple recursive filter.
- Referring now to
FIGS. 7A-7D , graphical representations are depicted of control parameters determined for images data corresponding to the pixel slope distributions of toFIGS. 3A-3D , according to one or more embodiments. InFIG. 7A , control parameters are depicted for SD image data upscaled to HD (e.g., 1080 lines) based onpixel slope distribution 305. InFIG. 7B ,control parameters 710 relate to a pixel slope distribution for HD image data transmitted as HD based onpixel distribution 310. InFIG. 7C ,control parameters 715 relate topixel slope distribution 315 for upscaled SD image data transmitted as lower definition HD (e.g., 720). InFIG. 7D ,control parameters 720 relate to the pixel slope distribution 320 for HD image data transmitted as lower definition HD (e.g., 720). SD clips upscaled to 1080 yield consistently low results, while hi-def clips produce consistently high results. - While certain exemplary embodiments have been described and shown in the accompanying drawings, it is to be understood that such embodiments are merely illustrative of and not restrictive on the broad invention, and that this invention not be limited to the specific constructions and arrangements shown and described, since various other modifications may occur to those ordinarily skilled in the art. Trademarks and copyrights referred to herein are the property of their respective owners.
Claims (20)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/637,526 US8503814B2 (en) | 2009-01-19 | 2009-12-14 | Method and apparatus for spectrum estimation |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14568409P | 2009-01-19 | 2009-01-19 | |
US12/637,526 US8503814B2 (en) | 2009-01-19 | 2009-12-14 | Method and apparatus for spectrum estimation |
Publications (2)
Publication Number | Publication Date |
---|---|
US20100183238A1 true US20100183238A1 (en) | 2010-07-22 |
US8503814B2 US8503814B2 (en) | 2013-08-06 |
Family
ID=42336999
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/637,526 Expired - Fee Related US8503814B2 (en) | 2009-01-19 | 2009-12-14 | Method and apparatus for spectrum estimation |
Country Status (1)
Country | Link |
---|---|
US (1) | US8503814B2 (en) |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100189373A1 (en) * | 2009-01-19 | 2010-07-29 | Zoran Corporation | Method and Apparatus for Content Adaptive Sharpness Enhancement |
US20120162527A1 (en) * | 2010-12-22 | 2012-06-28 | Tektronix, Inc. | Blur detection with local sharpness map |
WO2014142632A1 (en) * | 2013-03-15 | 2014-09-18 | Samsung Electronics Co., Ltd. | Control of frequency lifting super-resolution with image features |
WO2014142631A1 (en) * | 2013-03-15 | 2014-09-18 | Samsung Electronics Co., Ltd. | Creating details in an image with adaptive frequency strength controlled transform |
US9305332B2 (en) | 2013-03-15 | 2016-04-05 | Samsung Electronics Company, Ltd. | Creating details in an image with frequency lifting |
US9462293B1 (en) * | 2011-11-23 | 2016-10-04 | Pixel Works, Inc. | Super resolution weighting blending |
US9536288B2 (en) | 2013-03-15 | 2017-01-03 | Samsung Electronics Co., Ltd. | Creating details in an image with adaptive frequency lifting |
US9652829B2 (en) | 2015-01-22 | 2017-05-16 | Samsung Electronics Co., Ltd. | Video super-resolution by fast video segmentation for boundary accuracy control |
CN107680084A (en) * | 2017-09-21 | 2018-02-09 | 程丹秋 | A kind of agricultural modernization monitoring system |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11308349B1 (en) * | 2021-10-15 | 2022-04-19 | King Abdulaziz University | Method to modify adaptive filter weights in a decentralized wireless sensor network |
Citations (36)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4908875A (en) * | 1989-03-21 | 1990-03-13 | Hughes Aircraft Company | Adaptive thresholding technique |
US5583659A (en) * | 1994-11-10 | 1996-12-10 | Eastman Kodak Company | Multi-windowing technique for thresholding an image using local image properties |
US5594807A (en) * | 1994-12-22 | 1997-01-14 | Siemens Medical Systems, Inc. | System and method for adaptive filtering of images based on similarity between histograms |
US5828771A (en) * | 1995-12-15 | 1998-10-27 | Xerox Corporation | Method and article of manufacture for determining whether a scanned image is an original image or fax image |
US5880767A (en) * | 1996-09-11 | 1999-03-09 | Hewlett-Packard Company | Perceptual image resolution enhancement system |
US6256179B1 (en) * | 1998-02-13 | 2001-07-03 | Murata Manufacturing Co., Ltd. | Switching power supply apparatus |
US6600518B1 (en) * | 2000-11-06 | 2003-07-29 | Koninklijke Philips Electronics N.V. | Adaptive clipping prevention for picture sharpness enhancement |
US6614930B1 (en) * | 1999-01-28 | 2003-09-02 | Koninklijke Philips Electronics N.V. | Video stream classifiable symbol isolation method and system |
US6667815B1 (en) * | 1998-09-30 | 2003-12-23 | Fuji Photo Film Co., Ltd. | Method and apparatus for processing images |
US6717622B2 (en) * | 2001-03-30 | 2004-04-06 | Koninklijke Philips Electronics N.V. | System and method for scalable resolution enhancement of a video image |
US6771835B2 (en) * | 2000-06-12 | 2004-08-03 | Samsung Electronics Co., Ltd. | Two-dimensional non-linear interpolation system based on edge information and two-dimensional mixing interpolation system using the same |
US6795585B1 (en) * | 1999-07-16 | 2004-09-21 | Eastman Kodak Company | Representing digital images in a plurality of image processing states |
US6847738B1 (en) * | 1999-01-15 | 2005-01-25 | Koninklijke Philips Electronics N.V. | Sharpness enhancement |
US20050041883A1 (en) * | 2000-09-29 | 2005-02-24 | Maurer Ron P. | Method for enhancing compressibility and visual quality of scanned document images |
US6862368B1 (en) * | 2000-01-12 | 2005-03-01 | Koninklijke Philips Electronics N.V. | Method and apparatus for edge detection |
US6898319B1 (en) * | 1998-09-11 | 2005-05-24 | Intel Corporation | Method and system for video frame enhancement using edge detection |
US20060017773A1 (en) * | 2004-07-26 | 2006-01-26 | Sheraizin Semion M | Adaptive image improvement |
US7006704B2 (en) * | 2001-03-23 | 2006-02-28 | Nec Viewtechnology, Ltd. | Method of and apparatus for improving picture quality |
US20060181644A1 (en) * | 2003-04-10 | 2006-08-17 | Gerard De Haan | Spatial image conversion |
US20060279660A1 (en) * | 2005-06-10 | 2006-12-14 | Intel Corporation | Enhancing sharpness in video images |
US20060285766A1 (en) * | 2005-06-20 | 2006-12-21 | Ali Walid S I | Selective local transient improvement and peaking for video sharpness enhancement |
US7176983B2 (en) * | 2003-05-21 | 2007-02-13 | Stmicroelectronics Asia Pacific Pte. Ltd. | Adaptive coring for video peaking |
US20070139563A1 (en) * | 2005-12-20 | 2007-06-21 | Sheng Zhong | Method and system for analog video noise reduction by blending FIR and IIR filtering |
US20070139568A1 (en) * | 2005-12-20 | 2007-06-21 | Sheng Zhong | Method and system for content adaptive analog video noise detection |
US7283680B2 (en) * | 2003-07-07 | 2007-10-16 | Primax Electronics Ltd. | Method for image processing by unsharp masking |
US7336844B2 (en) * | 2000-07-11 | 2008-02-26 | Edward Roy Pike | Image enhancement |
US7408590B2 (en) * | 2004-05-07 | 2008-08-05 | Micronas Usa, Inc. | Combined scaling, filtering, and scan conversion |
US7421127B2 (en) * | 2001-10-26 | 2008-09-02 | Koninklijke Philips Electronics N.V. | Spatial scalable compression scheme using spatial sharpness enhancement techniques |
US20080211959A1 (en) * | 2007-01-05 | 2008-09-04 | Nikhil Balram | Methods and systems for improving low-resolution video |
US20080267524A1 (en) * | 2007-04-30 | 2008-10-30 | Doron Shaked | Automatic image enhancement |
US7483081B2 (en) * | 2005-10-27 | 2009-01-27 | Mediatek Inc. | Edge compensated feature detector and method thereof |
US20090028458A1 (en) * | 2007-07-23 | 2009-01-29 | Chia-Yuan Teng | Scaling filter for video sharpening |
US20090087120A1 (en) * | 2007-09-28 | 2009-04-02 | Ati Technologies Ulc | Apparatus and method for generating a detail-enhanced upscaled image |
US20100189373A1 (en) * | 2009-01-19 | 2010-07-29 | Zoran Corporation | Method and Apparatus for Content Adaptive Sharpness Enhancement |
US8009908B2 (en) * | 2006-10-27 | 2011-08-30 | Konica Minolta Business Technologies, Inc. | Area testing method for image processing |
US8031961B2 (en) * | 2007-05-29 | 2011-10-04 | Hewlett-Packard Development Company, L.P. | Face and skin sensitive image enhancement |
-
2009
- 2009-12-14 US US12/637,526 patent/US8503814B2/en not_active Expired - Fee Related
Patent Citations (36)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4908875A (en) * | 1989-03-21 | 1990-03-13 | Hughes Aircraft Company | Adaptive thresholding technique |
US5583659A (en) * | 1994-11-10 | 1996-12-10 | Eastman Kodak Company | Multi-windowing technique for thresholding an image using local image properties |
US5594807A (en) * | 1994-12-22 | 1997-01-14 | Siemens Medical Systems, Inc. | System and method for adaptive filtering of images based on similarity between histograms |
US5828771A (en) * | 1995-12-15 | 1998-10-27 | Xerox Corporation | Method and article of manufacture for determining whether a scanned image is an original image or fax image |
US5880767A (en) * | 1996-09-11 | 1999-03-09 | Hewlett-Packard Company | Perceptual image resolution enhancement system |
US6256179B1 (en) * | 1998-02-13 | 2001-07-03 | Murata Manufacturing Co., Ltd. | Switching power supply apparatus |
US6898319B1 (en) * | 1998-09-11 | 2005-05-24 | Intel Corporation | Method and system for video frame enhancement using edge detection |
US6667815B1 (en) * | 1998-09-30 | 2003-12-23 | Fuji Photo Film Co., Ltd. | Method and apparatus for processing images |
US6847738B1 (en) * | 1999-01-15 | 2005-01-25 | Koninklijke Philips Electronics N.V. | Sharpness enhancement |
US6614930B1 (en) * | 1999-01-28 | 2003-09-02 | Koninklijke Philips Electronics N.V. | Video stream classifiable symbol isolation method and system |
US6795585B1 (en) * | 1999-07-16 | 2004-09-21 | Eastman Kodak Company | Representing digital images in a plurality of image processing states |
US6862368B1 (en) * | 2000-01-12 | 2005-03-01 | Koninklijke Philips Electronics N.V. | Method and apparatus for edge detection |
US6771835B2 (en) * | 2000-06-12 | 2004-08-03 | Samsung Electronics Co., Ltd. | Two-dimensional non-linear interpolation system based on edge information and two-dimensional mixing interpolation system using the same |
US7336844B2 (en) * | 2000-07-11 | 2008-02-26 | Edward Roy Pike | Image enhancement |
US20050041883A1 (en) * | 2000-09-29 | 2005-02-24 | Maurer Ron P. | Method for enhancing compressibility and visual quality of scanned document images |
US6600518B1 (en) * | 2000-11-06 | 2003-07-29 | Koninklijke Philips Electronics N.V. | Adaptive clipping prevention for picture sharpness enhancement |
US7006704B2 (en) * | 2001-03-23 | 2006-02-28 | Nec Viewtechnology, Ltd. | Method of and apparatus for improving picture quality |
US6717622B2 (en) * | 2001-03-30 | 2004-04-06 | Koninklijke Philips Electronics N.V. | System and method for scalable resolution enhancement of a video image |
US7421127B2 (en) * | 2001-10-26 | 2008-09-02 | Koninklijke Philips Electronics N.V. | Spatial scalable compression scheme using spatial sharpness enhancement techniques |
US20060181644A1 (en) * | 2003-04-10 | 2006-08-17 | Gerard De Haan | Spatial image conversion |
US7176983B2 (en) * | 2003-05-21 | 2007-02-13 | Stmicroelectronics Asia Pacific Pte. Ltd. | Adaptive coring for video peaking |
US7283680B2 (en) * | 2003-07-07 | 2007-10-16 | Primax Electronics Ltd. | Method for image processing by unsharp masking |
US7408590B2 (en) * | 2004-05-07 | 2008-08-05 | Micronas Usa, Inc. | Combined scaling, filtering, and scan conversion |
US20060017773A1 (en) * | 2004-07-26 | 2006-01-26 | Sheraizin Semion M | Adaptive image improvement |
US20060279660A1 (en) * | 2005-06-10 | 2006-12-14 | Intel Corporation | Enhancing sharpness in video images |
US20060285766A1 (en) * | 2005-06-20 | 2006-12-21 | Ali Walid S I | Selective local transient improvement and peaking for video sharpness enhancement |
US7483081B2 (en) * | 2005-10-27 | 2009-01-27 | Mediatek Inc. | Edge compensated feature detector and method thereof |
US20070139568A1 (en) * | 2005-12-20 | 2007-06-21 | Sheng Zhong | Method and system for content adaptive analog video noise detection |
US20070139563A1 (en) * | 2005-12-20 | 2007-06-21 | Sheng Zhong | Method and system for analog video noise reduction by blending FIR and IIR filtering |
US8009908B2 (en) * | 2006-10-27 | 2011-08-30 | Konica Minolta Business Technologies, Inc. | Area testing method for image processing |
US20080211959A1 (en) * | 2007-01-05 | 2008-09-04 | Nikhil Balram | Methods and systems for improving low-resolution video |
US20080267524A1 (en) * | 2007-04-30 | 2008-10-30 | Doron Shaked | Automatic image enhancement |
US8031961B2 (en) * | 2007-05-29 | 2011-10-04 | Hewlett-Packard Development Company, L.P. | Face and skin sensitive image enhancement |
US20090028458A1 (en) * | 2007-07-23 | 2009-01-29 | Chia-Yuan Teng | Scaling filter for video sharpening |
US20090087120A1 (en) * | 2007-09-28 | 2009-04-02 | Ati Technologies Ulc | Apparatus and method for generating a detail-enhanced upscaled image |
US20100189373A1 (en) * | 2009-01-19 | 2010-07-29 | Zoran Corporation | Method and Apparatus for Content Adaptive Sharpness Enhancement |
Cited By (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8885967B2 (en) | 2009-01-19 | 2014-11-11 | Csr Technology Inc. | Method and apparatus for content adaptive sharpness enhancement |
US20100189373A1 (en) * | 2009-01-19 | 2010-07-29 | Zoran Corporation | Method and Apparatus for Content Adaptive Sharpness Enhancement |
US20120162527A1 (en) * | 2010-12-22 | 2012-06-28 | Tektronix, Inc. | Blur detection with local sharpness map |
US8754988B2 (en) * | 2010-12-22 | 2014-06-17 | Tektronix, Inc. | Blur detection with local sharpness map |
US9462293B1 (en) * | 2011-11-23 | 2016-10-04 | Pixel Works, Inc. | Super resolution weighting blending |
US9066025B2 (en) | 2013-03-15 | 2015-06-23 | Samsung Electronics Co., Ltd. | Control of frequency lifting super-resolution with image features |
WO2014142631A1 (en) * | 2013-03-15 | 2014-09-18 | Samsung Electronics Co., Ltd. | Creating details in an image with adaptive frequency strength controlled transform |
CN105210374A (en) * | 2013-03-15 | 2015-12-30 | 三星电子株式会社 | Control of frequency lifting super-resolution with image features |
US9305332B2 (en) | 2013-03-15 | 2016-04-05 | Samsung Electronics Company, Ltd. | Creating details in an image with frequency lifting |
US9349188B2 (en) | 2013-03-15 | 2016-05-24 | Samsung Electronics Co., Ltd. | Creating details in an image with adaptive frequency strength controlled transform |
WO2014142632A1 (en) * | 2013-03-15 | 2014-09-18 | Samsung Electronics Co., Ltd. | Control of frequency lifting super-resolution with image features |
US9536288B2 (en) | 2013-03-15 | 2017-01-03 | Samsung Electronics Co., Ltd. | Creating details in an image with adaptive frequency lifting |
US9652829B2 (en) | 2015-01-22 | 2017-05-16 | Samsung Electronics Co., Ltd. | Video super-resolution by fast video segmentation for boundary accuracy control |
CN107680084A (en) * | 2017-09-21 | 2018-02-09 | 程丹秋 | A kind of agricultural modernization monitoring system |
Also Published As
Publication number | Publication date |
---|---|
US8503814B2 (en) | 2013-08-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8503814B2 (en) | Method and apparatus for spectrum estimation | |
US7769089B1 (en) | Method and system for reducing noise level in a video signal | |
US8553783B2 (en) | Apparatus and method of motion detection for temporal mosquito noise reduction in video sequences | |
US8218083B2 (en) | Noise reducer, noise reducing method, and video signal display apparatus that distinguishes between motion and noise | |
US8305397B2 (en) | Edge adjustment method, image processing device and display apparatus | |
EP2311007B1 (en) | Method and apparatus for banding artifact detection | |
JP5514344B2 (en) | Video processing device, video processing method, television receiver, program, and recording medium | |
US20130169834A1 (en) | Photo extraction from video | |
US10440318B2 (en) | Motion adaptive de-interlacing and advanced film mode detection | |
KR20120018124A (en) | Automatic adjustments for video post-processor based on estimated quality of internet video content | |
KR20020008179A (en) | System and method for improving the sharpness of a video image | |
US10033962B2 (en) | Method and device for inverse tone mapping | |
US20060171466A1 (en) | Method and system for mosquito noise reduction | |
US20080152253A1 (en) | Noise cancellation | |
US7944508B1 (en) | Method and system for automatic detection and suppression of cross-luma and cross-color in a component video signal | |
US20110229046A1 (en) | Image processing apparatus and image processing method | |
EP1933556A2 (en) | TV user interface and processing for personal video players | |
JP4932910B2 (en) | Method and system for reducing mosquito noise in digital images | |
KR20090014681A (en) | Signal processing apparatus and control method thereof | |
KR20070020996A (en) | Apparatus for correcting color error and method thereof | |
US9883162B2 (en) | Stereoscopic image inspection device, stereoscopic image processing device, and stereoscopic image inspection method | |
JP2010148014A (en) | Noise-level detector | |
JP4916251B2 (en) | TV image filtering | |
US11501416B2 (en) | Image processing method and image processing circuit capable of smoothing false contouring without using low-pass filtering | |
GB2468304A (en) | Video image processing method that smooths the jagged diagonal edges created by epsilon filtering |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: ZORAN CORPORATION, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:AYZENBERG, OSCAR;FRUCHTER, VLAD;REEL/FRAME:023874/0093 Effective date: 20091209 |
|
AS | Assignment |
Owner name: CSR TECHNOLOGY INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ZORAN CORPORATION;REEL/FRAME:027550/0695 Effective date: 20120101 |
|
AS | Assignment |
Owner name: CSR TECHNOLOGY INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ZORAN CORPORATION;REEL/FRAME:036642/0395 Effective date: 20150915 |
|
REMI | Maintenance fee reminder mailed | ||
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.) |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20170806 |