USRE43628E1 - Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding - Google Patents
Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding Download PDFInfo
- Publication number
- USRE43628E1 USRE43628E1 US12/908,690 US90869010A USRE43628E US RE43628 E1 USRE43628 E1 US RE43628E1 US 90869010 A US90869010 A US 90869010A US RE43628 E USRE43628 E US RE43628E
- Authority
- US
- United States
- Prior art keywords
- adjacent blocks
- spatially adjacent
- image
- motion vectors
- same
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime, expires
Links
- 238000001914 filtration Methods 0.000 title claims abstract description 68
- 238000000034 method Methods 0.000 title claims description 19
- 239000013598 vector Substances 0.000 claims description 50
- 230000000903 blocking effect Effects 0.000 claims description 13
- 102220526841 Basic salivary proline-rich protein 1_H26L_mutation Human genes 0.000 claims description 2
- 240000008042 Zea mays Species 0.000 claims 1
- 235000005824 Zea mays ssp. parviglumis Nutrition 0.000 claims 1
- 235000002017 Zea mays subsp mays Nutrition 0.000 claims 1
- 235000005822 corn Nutrition 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 6
- 208000037170 Delayed Emergence from Anesthesia Diseases 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 238000013139 quantization Methods 0.000 description 3
- 230000003139 buffering effect Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000015556 catabolic process Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/117—Filters, e.g. for pre-processing or post-processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
- H04N19/139—Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/189—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
- H04N19/196—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/527—Global motion vector estimation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/573—Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/577—Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
- H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
- H04N19/89—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder
- H04N19/895—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder in combination with error concealment
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
- H04N19/86—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
Definitions
- Block based motion compensated video coding is used in many video compression standards such as H.261, H.263, H263+, MPEG-1, MPEG-2, and H26L.
- the lossy compression process can create visual artifacts in the decoded images, referred to as image artifacts. Blocking artifacts occur along the block boundaries in an image and are caused by the coarse quantization of transform coefficients.
- Image filtering techniques can be used to reduce artifacts in reconstructed images.
- Reconstructed images are the images produced after being inverse transformed and decoded.
- the rule of thumb in these techniques is that image edges should be preserved while the rest of the image is smoothed.
- Low pass filters are carefully chosen based on the characteristic of a particular pixel or set of pixels surrounding the image edges.
- Non-correlated image pixels that extend across image block boundaries are specifically filtered to reduce blocking artifacts.
- this filtering can introduce blurring artifacts into the image. If there are little or no blocking artifacts between adjacent blocks, then low pass filtering needlessly incorporates blurring into the image while at the same time wasting processing resources.
- the present invention addresses this and other problems associated with the prior art.
- Adjacent blocks are identified in an image. Coding parameters for the adjacent blocks are identified. Deblock filtering between the identified adjacent blocks is skipped if the coding parameters for the identified adjacent blocks are similar and not skipped if the coding parameters for the identified adjacent blocks are substantially different.
- FIG. 1 is a diagram showing how deblock filtering is selectively skipped according to similarities between adjacent image blocks.
- FIG. 2 is a diagram showing two adjacent image blocks having similar motion vectors.
- FIG. 3 is a diagram showing how transform coefficients are identified for one of the image blocks.
- FIG. 4 is a diagram showing how residual transform coefficients are compared between two adjacent image blocks.
- FIG. 5 is a block diagram showing how the video image is encoded and decoded.
- FIG. 6 is a block diagram showing how deblock filtering is selectively skipped in a codec.
- FIG. 7 shows a table containing the results from selective deblock filter skipping.
- filter processing only considers a single reconstructed image frame at a time.
- the motion-vector information available at both the encoder and decoder is not used. If two adjacent blocks share the same motion vector with respect to the same reference image frame, (for a multiple reference frames system) there may be no significant difference between the image residuals of each block. The block boundary of these two adjacent blocks may have been filtered in the reference frame and should therefore not be filtered again for the current frame. If a deblock filter is used without considering this motion-vector information, the conventional filtering process might filter the same boundary again and again from frame to frame. This unnecessary filtering not only causes unnecessary blurring but also results in extra filter computations.
- FIG. 1 shows an image 12 that selectively filters block artifacts according to similarities between image blocks.
- the image 12 includes multiple image blocks 14 that are each individually encoded before being stored, transmitted, etc.
- the borders between some of the blocks 14 include blocking artifacts 18 .
- Blocking artifacts are any image discontinuities between blocks 14 that may be created by the encoding process.
- a low pass filter is used to reduce the blocking artifacts that exist at the borders of adjacent image blocks.
- blocking artifacts 24 exist between blocks 20 and 22 .
- a low pass filter is used at the border 26 between blocks 20 and 22 to remove or reduce the blocking artifacts 24 .
- the low pass filter in one example selects a group of pixels 28 from both sides of the border 26 .
- An average pixel value is derived from the group of pixels 28 . Then each individual pixel is compared to the average pixel value. Any pixels in group 28 outside of a predetermined range of the average pixel value is then replaced with the average pixel value.
- a skip mode filtering scheme uses the motion estimation and compensation information for adjacent image blocks. If the motion estimation and compensation information is similar, deblock filtering is skipped. This not only avoids unnecessary image blurring but also significantly reduces the required number of filtering operations.
- Skip mode filtering can be used for any horizontal or vertical boundary between any adjacent blocks in image 12 .
- FIG. 2 shows reference frames 42 and 48 and a current frame 40 that is currently being encoded or decoded. Coding parameters for blocks 44 and 46 are compared to determine whether deblock filtering should be skipped between the two adjacent blocks 44 and 46 .
- One encoding parameter that is compared is the Motion Vectors (MV) for the blocks 44 and 46 .
- MV Motion Vectors
- the motion vector MV 1 points from block 44 in current image frame 40 to an associated block 44 ′ in the reference image 42 .
- the motion vector MV 2 points from block 46 in current image frame 40 to an associated block 46 ′ in reference frame 42 .
- More than one reference frame may be used during the encoding and decoding process.
- the adjacent blocks 44 and 46 may have motion vectors pointing to different reference frames.
- the decision to skip deblock filtering depends on whether the motion vectors for the two adjacent blocks point to the same reference frame.
- image block 44 may have a motion vector 49 pointing to reference frame 48 and image block 46 may have the motion vector MV 2 pointing to reference frame 42 . Deblock filtering is not skipped in this example because the motion vectors 49 and MV 2 point to different reference frames.
- FIG. 3 shows another coding parameter that may be used to decide whether or not to skip deblock filtering.
- the image block 44 from image frame 40 is compared with reference block 44 ′ from the reference frame 42 pointed to by the motion vector MV 1 as previously shown in FIG. 2 .
- a residual block 44 ′′ is output from the comparison between image block 44 and reference block 44 ′.
- a transform 50 is performed on the residual block 44 ′′ creating a transformed block 44 ′′′ of transform coefficients.
- the transform 50 is a Discrete Cosine Transform.
- the transformed block 44 ′′′ includes a D.C. component 52 and A.C. components 53 .
- the D.C. component 52 refers to a lowest frequency transform coefficient in image block 44 .
- the coefficient that represents the average energy in the image block 44 .
- the A.C. components 53 refer to the transform coefficients that represent the higher frequency components in the image block 44 .
- the transform coefficients that represent the large energy differences between pixels in the image block 44 are compared to the transform coefficients that represent the large energy differences between pixels in the image block 44 .
- FIG. 4 shows the transformed residual blocks 44 ′′′ and 46 ′′′.
- the D.C. components 52 from the two transformed blocks 44 ′′′ and 46 ′′′ are compared in processor 54 . If the D.C. components are the same or within some range of each other, the processor 54 notifies a deblock filter operation 56 to skip deblock filtering between the border of the two adjacent blocks 44 and 46 . If the D.C. components 52 are not similar, then no skip notification is initiated and the border between blocks 44 and 46 is deblock filtered.
- skip mode filtering is incorporated into the Telecommunications Sector of the International Telecommunication Union (ITU-T) proposed H.26L encoding scheme.
- the H.26L scheme only uses 4 ⁇ 4 integer Discrete Cosine Transform (DCT) blocks.
- DCT Discrete Cosine Transform
- the upper D.C. component 52 and the three lower frequency A.C. transform coefficients 53 for block 44 ′′′ may be compared with the upper D.C. component 52 and three lower frequency A.C. transform coefficients 53 for block 46 ′′′.
- Different combinations of D.C. and/or low frequency A.C. transform coefficients can be used to identify the relative similarity between the two adjacent blocks 44 and 46 .
- the processor 54 can also receive other coding parameters 55 that are generated during the coding process. These coding parameters include the motion vectors and reference frame information for the adjacent blocks 44 and 46 as described above. The processor 54 uses all of these coding parameters to determine whether or not to skip deblock filtering between adjacent image blocks 44 and 46 . Other encoding and transform functions performed on the image may be carried out in the same processor 54 or in a different processing circuit. In the case where all or most of the coding is done in the same processor, the skip mode is simply enabled by setting a skip parameter in the filtering routine.
- FIG. 5 shows how skip mode filtering is used in a block-based motion-compensated Coder-Decoder (Codec) 60 .
- the codec 60 is used for inter-frame coding.
- An input video block from the current frame is fed from box 62 into a comparator 64 .
- the output of a frame buffering box 80 generates a reference block 81 according to the estimated motion vector (and possible reference frame number).
- the difference between the input video block and the reference block 81 is transformed in box 66 and then quantized in box 68 .
- the quantized transform block is encoded by a Variable Length Coder (VLC) in box 70 and then transmitted, stored, etc.
- VLC Variable Length Coder
- the encoding section of the codec 60 reconstructs the transformed and quantized image by first Inverse Quantizing (IQ) the transformed image in box 72 .
- the inverse quantized image is then inverse transformed in box 74 to generate a reconstructed residual image.
- This reconstructed residual block is then added in box 76 to the reference block 81 to generate a reconstructed image block.
- the reconstructed image is loop filtered in box 78 to reduce blocking artifacts caused by the quantization and transform process.
- the filtered image is then buffered in box 80 to form reference frames.
- the frame buffering in box 80 uses the reconstructed reference frames for motion estimation and compensation.
- the reference block 81 is compared to the input video block in comparator 64 .
- An encoded image is output at node 71 from the encoding section and is then either stored or transmitted.
- a variable length decoder decodes the encoded image in box 82 .
- the decoded image is inverse quantized in box 84 and inverse transformed in box 86 .
- the reconstructed residual image from box 86 is added in the summing box 88 to the reference block 91 before being loop filtered in box 90 to reduce blocking artifacts and buffered in box 92 as reference frames.
- the reference block 91 is generated from box 92 according to the received motion vector information.
- the loop filtered output from box 90 can optionally be post filtered in box 94 to further reduce image artifacts before being displayed as a video image in box 96 .
- the skip mode filtering scheme can be performed in any combination of the filtering functions in boxes 78 , 90 and 94 .
- the motion estimation and compensation information available during video coding are used to determine when to skip deblock filtering in boxes 78 , 90 and/or 94 . Since these coding parameters are already generated during the encoding and decoding process, there are no additional coding parameters that have to be generated or transmitted specially for skip mode filtering.
- FIG. 6 shows is further detail how skip mode filtering is used in the filters 78 , 90 , and/or 94 in the encoder and decoder in FIG. 5 .
- the interblock boundary between any two adjacent blocks “j” and “k” is first identified in box 100 .
- the two blocks may be horizontally or vertically adjacent in the image frame.
- only the reference frame and motion vector information for the adjacent image blocks are used to determine block skipping.
- only the D.C. and/or A.C. residual coefficients are used to determine block skipping.
- the motion vector, reference frame and residual coefficients are all used to determine block skipping.
- the skip mode filtering scheme can be applied to spatially sub-sampled chrominance channels For example in a case with 4:2:0 color format sequences, skip mode filtering for block boundaries may only rely on the equality of motion vectors and D.C. components for the luminance component of the image. If the motion vectors and the D.C. components are the same, deblock filtering is skipped for both the luminance and chrominance components of the adjacent image blocks. In another embodiment, the motion vectors and the D.C. components are considered separately for each luminance and chrominance component of the adjacent blocks. In this case, a luminance or chrominance component for adjacent blocks may be deblock filtered while the other luminance or chrominance components for the same adjacent blocks are not deblock filtered.
- FIG. 7 includes a table 110 showing the results of skip mode filtering using a ITU-TH.26L Testing Model-Long TML5.0.
- Table 110 compares the results of the TML filtering standard with skip mode filtering as described above. Encoding results using skip mode filtering are shown in table 110 under the heading SLA.
- Skip mode filtering can be used with any system that encodes or decodes multiple image frames.
- the skip mode filtering described above can be implemented with dedicated processor systems, micro controllers, programmable logic devices, or microprocessors that perform some or all of the operations. Some of the operations described above may be implemented in software and other operations may be implemented in hardware.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Color Television Systems (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
Abstract
Adjacent blocks are identified in an image. Coding parameters for the adjacent blocks are identified. Deblock filtering between the identified adjacent blocks is skipped if the coding parameters for the identified adjacent blocks are similar and not skipped if the coding parameters for the identified adjacent blocks are substantially different.
Description
This application is a divisional based on prior U.S. Ser. No. 09/817,701, filed Mar. 26, 2001 now U.S. Pat. No. 6,931,063.
Block based motion compensated video coding is used in many video compression standards such as H.261, H.263, H263+, MPEG-1, MPEG-2, and H26L. The lossy compression process can create visual artifacts in the decoded images, referred to as image artifacts. Blocking artifacts occur along the block boundaries in an image and are caused by the coarse quantization of transform coefficients.
Image filtering techniques can be used to reduce artifacts in reconstructed images. Reconstructed images are the images produced after being inverse transformed and decoded. The rule of thumb in these techniques is that image edges should be preserved while the rest of the image is smoothed. Low pass filters are carefully chosen based on the characteristic of a particular pixel or set of pixels surrounding the image edges.
Non-correlated image pixels that extend across image block boundaries are specifically filtered to reduce blocking artifacts. However, this filtering can introduce blurring artifacts into the image. If there are little or no blocking artifacts between adjacent blocks, then low pass filtering needlessly incorporates blurring into the image while at the same time wasting processing resources.
The present invention addresses this and other problems associated with the prior art.
Adjacent blocks are identified in an image. Coding parameters for the adjacent blocks are identified. Deblock filtering between the identified adjacent blocks is skipped if the coding parameters for the identified adjacent blocks are similar and not skipped if the coding parameters for the identified adjacent blocks are substantially different.
In conventional filtering methods, filter processing only considers a single reconstructed image frame at a time. The motion-vector information available at both the encoder and decoder is not used. If two adjacent blocks share the same motion vector with respect to the same reference image frame, (for a multiple reference frames system) there may be no significant difference between the image residuals of each block. The block boundary of these two adjacent blocks may have been filtered in the reference frame and should therefore not be filtered again for the current frame. If a deblock filter is used without considering this motion-vector information, the conventional filtering process might filter the same boundary again and again from frame to frame. This unnecessary filtering not only causes unnecessary blurring but also results in extra filter computations.
For example, blocking artifacts 24 exist between blocks 20 and 22. A low pass filter is used at the border 26 between blocks 20 and 22 to remove or reduce the blocking artifacts 24. The low pass filter in one example selects a group of pixels 28 from both sides of the border 26. An average pixel value is derived from the group of pixels 28. Then each individual pixel is compared to the average pixel value. Any pixels in group 28 outside of a predetermined range of the average pixel value is then replaced with the average pixel value.
As described above, if there are little or no blocking artifacts 24 between the adjacent pixels, then the group of pixels 28 may be needlessly filtered causing blurring in the image and wasting processing resources. A skip mode filtering scheme uses the motion estimation and compensation information for adjacent image blocks. If the motion estimation and compensation information is similar, deblock filtering is skipped. This not only avoids unnecessary image blurring but also significantly reduces the required number of filtering operations.
For example, it is determined during the encoding process that adjacent image blocks 30 and 32 have similar coding parameters. Accordingly, deblock filtering is skipped for the groups of pixels 34 that extend across the border 31 between adjacent blocks 30 and 32. Skip mode filtering can be used for any horizontal or vertical boundary between any adjacent blocks in image 12.
The motion vector MV1 points from block 44 in current image frame 40 to an associated block 44′ in the reference image 42. The motion vector MV2 points from block 46 in current image frame 40 to an associated block 46′ in reference frame 42. Skip mode filtering checks to see if the motion vectors MV1 and MV2 point to adjacent blocks in the same reference frame 42. If the motion vectors point to adjacent blocks in the reference frame (MV1=MV2), then deblock filtering is skipped. This motion vector information may be used along with other coding information to decide whether to skip deblock filtering between the two image blocks 44 and 46.
More than one reference frame may be used during the encoding and decoding process. For example, there may be another reference frame 48. The adjacent blocks 44 and 46 may have motion vectors pointing to different reference frames. In one embodiment, the decision to skip deblock filtering depends on whether the motion vectors for the two adjacent blocks point to the same reference frame. For example, image block 44 may have a motion vector 49 pointing to reference frame 48 and image block 46 may have the motion vector MV2 pointing to reference frame 42. Deblock filtering is not skipped in this example because the motion vectors 49 and MV2 point to different reference frames.
The D.C. component 52 refers to a lowest frequency transform coefficient in image block 44. For example, the coefficient that represents the average energy in the image block 44. The A.C. components 53 refer to the transform coefficients that represent the higher frequency components in the image block 44. For example, the transform coefficients that represent the large energy differences between pixels in the image block 44.
In one embodiment, skip mode filtering is incorporated into the Telecommunications Sector of the International Telecommunication Union (ITU-T) proposed H.26L encoding scheme. The H.26L scheme only uses 4×4 integer Discrete Cosine Transform (DCT) blocks. Here, only the D.C. component of the two adjacent blocks may be checked. However some limited low frequency A.C. coefficients could also be checked when the image blocks are bigger sizes, such as 8×8 or 16×16 blocks. For example, the upper D.C. component 52 and the three lower frequency A.C. transform coefficients 53 for block 44′″ may be compared with the upper D.C. component 52 and three lower frequency A.C. transform coefficients 53 for block 46′″. Different combinations of D.C. and/or low frequency A.C. transform coefficients can be used to identify the relative similarity between the two adjacent blocks 44 and 46.
The processor 54 can also receive other coding parameters 55 that are generated during the coding process. These coding parameters include the motion vectors and reference frame information for the adjacent blocks 44 and 46 as described above. The processor 54 uses all of these coding parameters to determine whether or not to skip deblock filtering between adjacent image blocks 44 and 46. Other encoding and transform functions performed on the image may be carried out in the same processor 54 or in a different processing circuit. In the case where all or most of the coding is done in the same processor, the skip mode is simply enabled by setting a skip parameter in the filtering routine.
The encoding section of the codec 60 reconstructs the transformed and quantized image by first Inverse Quantizing (IQ) the transformed image in box 72. The inverse quantized image is then inverse transformed in box 74 to generate a reconstructed residual image. This reconstructed residual block is then added in box 76 to the reference block 81 to generate a reconstructed image block. Generally the reconstructed image is loop filtered in box 78 to reduce blocking artifacts caused by the quantization and transform process. The filtered image is then buffered in box 80 to form reference frames. The frame buffering in box 80 uses the reconstructed reference frames for motion estimation and compensation. The reference block 81 is compared to the input video block in comparator 64. An encoded image is output at node 71 from the encoding section and is then either stored or transmitted.
In a decoder portion of the codec 60, a variable length decoder (VLD) decodes the encoded image in box 82. The decoded image is inverse quantized in box 84 and inverse transformed in box 86. The reconstructed residual image from box 86 is added in the summing box 88 to the reference block 91 before being loop filtered in box 90 to reduce blocking artifacts and buffered in box 92 as reference frames. The reference block 91 is generated from box 92 according to the received motion vector information. The loop filtered output from box 90 can optionally be post filtered in box 94 to further reduce image artifacts before being displayed as a video image in box 96. The skip mode filtering scheme can be performed in any combination of the filtering functions in boxes 78, 90 and 94.
The motion estimation and compensation information available during video coding are used to determine when to skip deblock filtering in boxes 78, 90 and/or 94. Since these coding parameters are already generated during the encoding and decoding process, there are no additional coding parameters that have to be generated or transmitted specially for skip mode filtering.
It is then determined whether the residual coefficients for the two adjacent blocks are similar. If there is no significant difference between the image residuals of the adjacent blocks, for example, the two blocks j and k have the same of similar D.C. component (dc(j)=dc(k)), then the deblock filtering process in box 104 is skipped. Skip mode filtering then moves to the next interblock boundary in box 106 and conducts the next comparison in decision box 102. Skip mode filtering can be performed for both horizontally adjacent blocks and vertically adjacent blocks.
In one embodiment, only the reference frame and motion vector information for the adjacent image blocks are used to determine block skipping. In another embodiment, only the D.C. and/or A.C. residual coefficients are used to determine block skipping. In another embodiment, the motion vector, reference frame and residual coefficients are all used to determine block skipping.
The skip mode filtering scheme can be applied to spatially sub-sampled chrominance channels For example in a case with 4:2:0 color format sequences, skip mode filtering for block boundaries may only rely on the equality of motion vectors and D.C. components for the luminance component of the image. If the motion vectors and the D.C. components are the same, deblock filtering is skipped for both the luminance and chrominance components of the adjacent image blocks. In another embodiment, the motion vectors and the D.C. components are considered separately for each luminance and chrominance component of the adjacent blocks. In this case, a luminance or chrominance component for adjacent blocks may be deblock filtered while the other luminance or chrominance components for the same adjacent blocks are not deblock filtered.
There were four images that were tested, Akiyo_cif for 300 frames at 30 Frames Per Second (fps), Foreman_cif for 300 frames at 30 fps, Foreman_qcif for 100 frames at 10 fps, and Tempete_cif for 260 frames at 30 fps. Quantization Parameters (QP) of 25 and 30 were used. The results show no significant visual quality degradation with the skip mode filtering. The Picture Signal to Noise Ratio (PSNR) for the images stays approximately the same for the luminance Y and chrominance U and V channels. However, skip mode filtering provides time savings of 40-70 percent.
Skip mode filtering can be used with any system that encodes or decodes multiple image frames. For example, DVD players, video recorders, or any system that transmits image data over a communications channel, such as over television channels or over the Internet.
The skip mode filtering described above can be implemented with dedicated processor systems, micro controllers, programmable logic devices, or microprocessors that perform some or all of the operations. Some of the operations described above may be implemented in software and other operations may be implemented in hardware.
For the sake of convenience, the operations are described as various interconnected functional blocks or distinct software modules. This is not necessary, however, and there may be cases where these functional blocks or modules are equivalently aggregated into a single logic device, program or operation with unclear boundaries. In any event, the functional blocks and software modules or described features can be implemented by themselves, or in combination with other operations in either hardware or software.
Having described and illustrated the principles of the invention in a preferred embodiment thereof, it should be apparent that the invention may be modified in arrangement and detail without departing from such principles. Claim is made to all modifications and variation coming within the spirit and scope of the following claims.
Claims (17)
1. A method for encoding an image, comprising:
identifying spatially adjacent blocks in a same frame of the image;
identifying transform coefficients motion vectors used for motion compensation for the spatially adjacent blocks in the same frame of the image and associated reference frames for the motion vectors of the spatially adjacent blocks;
comparing the transform coefficients betweenjudging whether to perform deblock filtering for removing image residuals between the identified spatially adjacent block caused by encoding the image, by: determining whether the motion vectors for the spatially adjacent blocks in the same frame of the image are the same or similar to each other and determining whether the reference frames for motion vectors of the spatially adjacent blocks are identical; and
skipping deblock filtering for removing image residuals caused by encoding the image between the identified spatially adjacent blocks when the comparison indicates that the motion vectors for the spatially adjacent blocks in the same frame of the image have are determined to be the same or similar transform coefficients; and
deblock filtering to remove image residuals between the identified spatially adjacent blocks when the comparison between the transform coefficients for the identified spatially adjacent blocks in the same frame of the image indicate that the spatially adjacent blocks do not have the same or similar transform coefficients and the reference frames for the motion vectors of the spatially adjacent blocks are determined to be identical.
2. A method according to claim 1 including:
identifying D.C. components in the transform coefficients for the spatially adjacent blocks;
comparing the D.C. components for the spatially adjacent blocks with each other; and
skipping deblock filtering between the spatially adjacent blocks when the D.C. components for the compared spatially adjacent blocks have same or similar values relative to each other.
3. A method according to claim 1 including:
identifying both D.C. and A.C. components in the transform coefficients for the spatially adjacent blocks;
comparing the D.C. components for adjacent blocks and A.C. components for adjacent blocks; and
skipping deblock filtering between the adjacent blocks when both the D.C. components are the same or similar and the A.C. components are the same or similar.
4. A method according to claim 1 including controlling deblock filtering for a loop filter in an image coder.
5. A method according to claim 1 including controlling deblock filtering in one or both of a loop filter and a post filter in an image decoder.
6. A method according to claim 1 including:
identifying similarities between coding parameters in a luminance channel of the adjacent blocks; and
controlling deblock filtering for both the luminance channel and a chrominance channel in the image according to identified similarities in the luminance channel.
7. A method according to claim 1 including selectively skipping deblock filtering in any one of a H.261, H.263, H263+, MPEG-1, MPEG-2, or H26L encoding standard according to encoding parameter similarities between adjacent image blocks.
8. An encoder for encoding an image, comprising:
a processor adapted to:
compare blocks in a same image frame with reference frames; transform a result of the comparison between the reference frames and the blocks in the image frame into transformed blocks having transform coefficients;identify motion vectors and associated reference frames for the motion vectors of spatially adjacent blocks in a same frame of the image;
compare are the similarities between the transform coefficientsdetermine whether motion vectors for spatially adjacent transformed blocks within the same image frame are the same or similar to each other and determine whether reference frames for the motion vectors of the spatially adjacent blocks are identical; and
skippingskip deblock filtering between spatially adjacent transformed blocks in the image that have the same or similar transform coefficients motion vectors and that have identical reference frames for the motion vectors.
9. An encoder according to claim 8 wherein the processor is adapted to
identify motion vectors and associated reference frames for the adjacent blocks and skip deblock filtering between the spatially adjacent blocks according to the identified motion vectors and reference frames.
10. An encoder according to claim 8 wherein the processor is adapted to identify residual coefficients for the spatially adjacent blocks and skip deblock filtering according to the identified residual coefficients.
11. An encoder according to claim 8 wherein the processor is adapted to skip deblock filtering according to both D.C. and A.C. components in the residual coefficients.
12. A decoder for decoding an encoded image, comprising:
a processor adapted to identify spatially adjacent blocks in the encoded image;
identify coding parameters including D.C. coefficients motion vectors and associated reference frames for the motion vectors of the spatially adjacent blocks within a same encoded image frame;
compare the motion vectors and associated references frames for the motion vectors of the identified D.C. coefficients between coding parameters of the identified spatially adjacent blocks; and
enable or disable filtering of blocking artifacts between the spatially adjacent blocks according to the comparison of the D.C. coefficients coding parameters between the spatially adjacent blocks within the same encoded image frame, wherein
the processor skips deblock filtering when the motion vectors for the spatially adjacent blocks are the same or similar and the reference frames for motion vectors of the spatially adjacent blocks are identical.
13. A decoder according to claim 12 wherein the processor is adapted to
identify both D.C. coefficients and A.C. coefficients for the spatially adjacent blocks within a same encoded image frame;
compare the identified D.C. coefficients between the identified spatially adjacent blocks and corn are compare the identified A.C. coefficients between the identified spatially adjacent blocks; and
enable or disable filtering of blocking artifacts between the spatially adjacent blocks according to the comparison of the D.C. coefficients between the adjacent blocks within the same encoded image frame and according to the comparison of the A.C. coefficients between the adjacent blocks within the same encoded image frame.
14. A decoder according to claim 12 wherein the processor is adapted to identify residual coefficients for the spatially adjacent blocks and skip deblock filtering between the spatially adjacent blocks according to the identified residual coefficients.
15. A decoder according to claim 12 wherein the processor is adapted to
inverse transform the encoded image,
compare blocks in the inverse transformed encoded image with reference frames,
generate a reconstructed image from the comparison between the inverse transformed encoded image and the reference frame, and
skip deblock filtering between spatially adjacent blocks in the reconstructed image according to the coding parameters for the spatially adjacent blocks.
16. A decoder according to claim 15 wherein the coding parameters include transform coefficients, motion vectors, and reference frame information and the processor skips deblock filtering when the transform coefficients, motion vectors, and reference frame information for the spatially adjacent blocks are the same or similar.
17. A decoder according to claim 12 wherein the processor is adapted to skip deblock filtering in one or both of a loop filter and a post filter.
Priority Applications (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/908,690 USRE43628E1 (en) | 2001-03-26 | 2010-10-20 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US13/495,944 USRE44497E1 (en) | 2001-03-26 | 2012-06-13 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US13/954,817 USRE45250E1 (en) | 2001-03-26 | 2013-07-30 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US14/512,165 USRE46482E1 (en) | 2001-03-26 | 2014-10-10 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US14/512,067 USRE46491E1 (en) | 2001-03-26 | 2014-10-10 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US15/651,868 USRE47202E1 (en) | 2001-03-26 | 2017-07-17 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US15/651,879 USRE47261E1 (en) | 2001-03-26 | 2017-07-17 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/817,701 US6931063B2 (en) | 2001-03-26 | 2001-03-26 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US11/105,729 US7440501B2 (en) | 2001-03-26 | 2005-04-13 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US12/908,690 USRE43628E1 (en) | 2001-03-26 | 2010-10-20 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
Related Parent Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/817,701 Division US6931063B2 (en) | 2001-03-26 | 2001-03-26 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US11/105,729 Reissue US7440501B2 (en) | 2001-03-26 | 2005-04-13 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/105,729 Continuation US7440501B2 (en) | 2001-03-26 | 2005-04-13 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US13/495,944 Continuation USRE44497E1 (en) | 2001-03-26 | 2012-06-13 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
Publications (1)
Publication Number | Publication Date |
---|---|
USRE43628E1 true USRE43628E1 (en) | 2012-09-04 |
Family
ID=25223683
Family Applications (10)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/817,701 Expired - Lifetime US6931063B2 (en) | 2001-03-26 | 2001-03-26 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US10/112,683 Expired - Lifetime US7352812B2 (en) | 2001-03-26 | 2002-03-29 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US11/105,729 Ceased US7440501B2 (en) | 2001-03-26 | 2005-04-13 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US12/908,690 Expired - Lifetime USRE43628E1 (en) | 2001-03-26 | 2010-10-20 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US13/495,944 Expired - Lifetime USRE44497E1 (en) | 2001-03-26 | 2012-06-13 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US13/954,817 Ceased USRE45250E1 (en) | 2001-03-26 | 2013-07-30 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US14/512,165 Expired - Lifetime USRE46482E1 (en) | 2001-03-26 | 2014-10-10 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US14/512,067 Expired - Lifetime USRE46491E1 (en) | 2001-03-26 | 2014-10-10 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US15/651,879 Expired - Lifetime USRE47261E1 (en) | 2001-03-26 | 2017-07-17 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US15/651,868 Expired - Lifetime USRE47202E1 (en) | 2001-03-26 | 2017-07-17 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
Family Applications Before (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/817,701 Expired - Lifetime US6931063B2 (en) | 2001-03-26 | 2001-03-26 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US10/112,683 Expired - Lifetime US7352812B2 (en) | 2001-03-26 | 2002-03-29 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US11/105,729 Ceased US7440501B2 (en) | 2001-03-26 | 2005-04-13 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
Family Applications After (6)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/495,944 Expired - Lifetime USRE44497E1 (en) | 2001-03-26 | 2012-06-13 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US13/954,817 Ceased USRE45250E1 (en) | 2001-03-26 | 2013-07-30 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US14/512,165 Expired - Lifetime USRE46482E1 (en) | 2001-03-26 | 2014-10-10 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US14/512,067 Expired - Lifetime USRE46491E1 (en) | 2001-03-26 | 2014-10-10 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US15/651,879 Expired - Lifetime USRE47261E1 (en) | 2001-03-26 | 2017-07-17 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US15/651,868 Expired - Lifetime USRE47202E1 (en) | 2001-03-26 | 2017-07-17 | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
Country Status (5)
Country | Link |
---|---|
US (10) | US6931063B2 (en) |
EP (7) | EP2278813B1 (en) |
JP (15) | JP3688248B2 (en) |
DE (3) | DE60234875D1 (en) |
HK (4) | HK1153596A1 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070098077A1 (en) * | 2001-09-14 | 2007-05-03 | Shijun Sun | Adaptive filtering based upon boundary strength |
USRE44497E1 (en) * | 2001-03-26 | 2013-09-17 | Sharp Kabushiki Kaisha | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US8805100B2 (en) | 2010-06-03 | 2014-08-12 | Sharp Kabushiki Kaisha | Filter device, image decoding device, image encoding device, and filter parameter data structure |
US8976856B2 (en) * | 2010-09-30 | 2015-03-10 | Apple Inc. | Optimized deblocking filters |
Families Citing this family (73)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100538215B1 (en) * | 2002-01-23 | 2005-12-21 | 삼성전자주식회사 | Video reproduction apparatus having fast post-processing and method thereof |
KR100943581B1 (en) | 2002-07-11 | 2010-02-23 | 파나소닉 주식회사 | Filtering strength determination method, moving picture encoding method, and moving picture decoding method |
WO2004008773A1 (en) | 2002-07-11 | 2004-01-22 | Matsushita Electric Industrial Co., Ltd. | Filtering intensity decision method, moving picture encoding method, and moving picture decoding method |
US7463688B2 (en) * | 2003-01-16 | 2008-12-09 | Samsung Electronics Co., Ltd. | Methods and apparatus for removing blocking artifacts of MPEG signals in real-time video reception |
EP1443776B1 (en) * | 2003-01-29 | 2012-08-15 | Sony Deutschland GmbH | Video signal processing system |
US8761252B2 (en) | 2003-03-27 | 2014-06-24 | Lg Electronics Inc. | Method and apparatus for scalably encoding and decoding video signal |
KR20060105409A (en) * | 2005-04-01 | 2006-10-11 | 엘지전자 주식회사 | Method for scalably encoding and decoding video signal |
KR20060109247A (en) | 2005-04-13 | 2006-10-19 | 엘지전자 주식회사 | Method and apparatus for encoding/decoding a video signal using pictures of base layer |
JP3997171B2 (en) | 2003-03-27 | 2007-10-24 | 株式会社エヌ・ティ・ティ・ドコモ | Moving picture encoding apparatus, moving picture encoding method, moving picture encoding program, moving picture decoding apparatus, moving picture decoding method, and moving picture decoding program |
WO2005002230A1 (en) * | 2003-06-27 | 2005-01-06 | Mitsubishi Denki Kabushiki Kaisha | Post-filter, post-filtering method and video signal decoder |
US20050013494A1 (en) * | 2003-07-18 | 2005-01-20 | Microsoft Corporation | In-loop deblocking filter |
US8625680B2 (en) * | 2003-09-07 | 2014-01-07 | Microsoft Corporation | Bitstream-controlled post-processing filtering |
US7724827B2 (en) * | 2003-09-07 | 2010-05-25 | Microsoft Corporation | Multi-layer run level encoding and decoding |
WO2005051025A1 (en) * | 2003-11-20 | 2005-06-02 | Research In Motion Limited | Seamless call switching in a dual mode environment |
EP1534016A3 (en) * | 2003-11-21 | 2007-03-07 | Matsushita Electric Industrial Co., Ltd. | Using motion vectors and the occurrence of coefficient quantization levels to drive a noise removal image postprocessing |
CN1285214C (en) * | 2004-01-14 | 2006-11-15 | 华中科技大学 | Loop filtering method and loop filter |
US7551793B2 (en) * | 2004-01-14 | 2009-06-23 | Samsung Electronics Co., Ltd. | Methods and apparatuses for adaptive loop filtering for reducing blocking artifacts |
KR101000926B1 (en) * | 2004-03-11 | 2010-12-13 | 삼성전자주식회사 | Filter for removing blocking effect and filtering method thereof |
JP4419062B2 (en) * | 2004-03-29 | 2010-02-24 | ソニー株式会社 | Image processing apparatus and method, recording medium, and program |
KR100631768B1 (en) * | 2004-04-14 | 2006-10-09 | 삼성전자주식회사 | Interframe Prediction Method and Video Encoder, Video Decoding Method and Video Decoder in Video Coding |
EP1592259B1 (en) * | 2004-04-30 | 2011-10-05 | Panasonic Corporation | Processing auxiliary data of video sequences |
NO20042477A (en) | 2004-06-14 | 2005-10-17 | Tandberg Telecom As | Chroma de-blocking procedure |
KR100619041B1 (en) | 2004-07-22 | 2006-09-01 | 삼성전자주식회사 | Video synchronization apparatus and video synchronization method |
KR100714853B1 (en) | 2004-10-21 | 2007-05-04 | 주식회사 렛스비전 | Unified Application System For Adaptive Loop Filtering And Post Filtering Of Moving Picture Coding System |
JP4277793B2 (en) * | 2004-12-17 | 2009-06-10 | ソニー株式会社 | Image processing apparatus, encoding apparatus, and methods thereof |
US7136536B2 (en) * | 2004-12-22 | 2006-11-14 | Telefonaktiebolaget L M Ericsson (Publ) | Adaptive filter |
JP4191729B2 (en) * | 2005-01-04 | 2008-12-03 | 三星電子株式会社 | Deblock filtering method considering intra BL mode and multi-layer video encoder / decoder using the method |
KR20060099236A (en) * | 2005-03-11 | 2006-09-19 | 삼성전자주식회사 | Syncronization signal detection apparatus and vsb receiver using the same and method thereof |
US8660180B2 (en) * | 2005-04-01 | 2014-02-25 | Lg Electronics Inc. | Method and apparatus for scalably encoding and decoding video signal |
US8520739B2 (en) | 2005-05-09 | 2013-08-27 | Intel Corporation | Method and apparatus for adaptively reducing artifacts in block-coded video |
KR20080007675A (en) * | 2005-05-11 | 2008-01-22 | 코닌클리케 필립스 일렉트로닉스 엔.브이. | Objective system for an optical scanning device for ultraviolet and/or deep-ultraviolet wavelengths |
US8045615B2 (en) * | 2005-05-25 | 2011-10-25 | Qualcomm Incorporated | Deblock filtering techniques for video coding according to multiple video standards |
US8755434B2 (en) * | 2005-07-22 | 2014-06-17 | Lg Electronics Inc. | Method and apparatus for scalably encoding and decoding video signal |
JP2009506699A (en) * | 2005-08-29 | 2009-02-12 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Device for filtering images obtained by block-based image decompression |
KR100710338B1 (en) * | 2005-08-29 | 2007-04-23 | 엘지전자 주식회사 | Multi-format video decoder and deblocking filtering method |
US8155189B2 (en) * | 2005-10-19 | 2012-04-10 | Freescale Semiconductor, Inc. | System and method of coding mode decision for video encoding |
US8233535B2 (en) * | 2005-11-18 | 2012-07-31 | Apple Inc. | Region-based processing of predicted pixels |
US8094959B2 (en) * | 2005-12-09 | 2012-01-10 | Seiko Epson Corporation | Efficient detection of camera shake |
US20070291839A1 (en) * | 2006-06-15 | 2007-12-20 | Faraday Technology Corp. | Method and device for multimedia processing |
US20080084932A1 (en) * | 2006-10-06 | 2008-04-10 | Microsoft Corporation | Controlling loop filtering for interlaced video frames |
US20080101469A1 (en) * | 2006-10-31 | 2008-05-01 | Motorola, Inc. | Method and apparatus for adaptive noise filtering of pixel data |
CN105392005A (en) | 2006-11-08 | 2016-03-09 | 汤姆逊许可证公司 | Methods and apparatus for in-loop de-artifact filtering |
KR101370287B1 (en) | 2006-11-22 | 2014-03-07 | 세종대학교산학협력단 | Method and apparatus for deblocking filtering |
US9961372B2 (en) * | 2006-12-08 | 2018-05-01 | Nxp Usa, Inc. | Adaptive disabling of deblock filtering based on a content characteristic of video information |
US9445128B2 (en) | 2006-12-08 | 2016-09-13 | Freescale Semiconductor, Inc. | System and method of determining deblocking control flag of scalable video system for indicating presentation of deblocking parameters for multiple layers |
CN101669360B (en) * | 2007-04-26 | 2016-08-03 | 宝利通公司 | De-blocking filter arrangements |
US8619880B2 (en) * | 2007-10-10 | 2013-12-31 | Qualcomm Incorporated | Universal blockiness correction |
JP5050158B2 (en) * | 2008-06-02 | 2012-10-17 | 株式会社メガチップス | Transcoder |
US20090304086A1 (en) * | 2008-06-06 | 2009-12-10 | Apple Inc. | Method and system for video coder and decoder joint optimization |
US20110103464A1 (en) * | 2008-06-12 | 2011-05-05 | Yunfei Zheng | Methods and Apparatus for Locally Adaptive Filtering for Motion Compensation Interpolation and Reference Picture Filtering |
JP5089504B2 (en) | 2008-07-01 | 2012-12-05 | 株式会社エヌ・ティ・ティ・ドコモ | Wireless communication system, base station, user apparatus and method |
US8457396B2 (en) * | 2009-08-11 | 2013-06-04 | Microsoft Corporation | Digital image compression and decompression |
JP5583992B2 (en) * | 2010-03-09 | 2014-09-03 | パナソニック株式会社 | Signal processing device |
AU2011241284B2 (en) | 2010-04-13 | 2015-05-07 | Samsung Electronics Co., Ltd. | Video-encoding method and video-encoding apparatus using prediction units based on encoding units determined in accordance with a tree structure, and video-decoding method and video-decoding apparatus using prediction units based on encoding units determined in accordance with a tree structure |
KR20110123651A (en) | 2010-05-07 | 2011-11-15 | 한국전자통신연구원 | Apparatus and method for image coding and decoding using skip coding |
TWI508534B (en) * | 2010-05-18 | 2015-11-11 | Sony Corp | Image processing apparatus and image processing method |
JP5732765B2 (en) * | 2010-07-22 | 2015-06-10 | 富士ゼロックス株式会社 | Image data decoding device |
US8787443B2 (en) | 2010-10-05 | 2014-07-22 | Microsoft Corporation | Content adaptive deblocking during video encoding and decoding |
US9042458B2 (en) | 2011-04-01 | 2015-05-26 | Microsoft Technology Licensing, Llc | Multi-threaded implementations of deblock filtering |
US9445093B2 (en) * | 2011-06-29 | 2016-09-13 | Qualcomm Incorporated | Multiple zone scanning order for video coding |
CN106713914B (en) * | 2011-06-30 | 2021-06-01 | 三菱电机株式会社 | Image encoding device and method, image decoding device and method |
CN108989803B (en) | 2011-09-20 | 2021-05-28 | Lg 电子株式会社 | Method and apparatus for encoding/decoding image information |
EP2775711B1 (en) | 2011-11-04 | 2020-01-01 | LG Electronics Inc. | Method and apparatus for encoding/decoding image information |
JP6399433B2 (en) * | 2013-05-31 | 2018-10-03 | サン パテント トラスト | Image encoding method, image decoding method, image encoding device, and image decoding device |
CN105096351B (en) * | 2014-05-19 | 2018-04-17 | 北京大学 | Image deblocking effect treating method and apparatus |
US10110926B2 (en) | 2015-10-15 | 2018-10-23 | Cisco Technology, Inc. | Efficient loop filter for video codec |
US10091533B2 (en) | 2016-02-18 | 2018-10-02 | Cisco Technology, Inc. | Generalized filter for removing video compression artifacts |
CN105812829B (en) * | 2016-03-10 | 2018-11-02 | 福州瑞芯微电子股份有限公司 | A kind of error concealing method and device of vector field extrapolation |
EP3298783B1 (en) | 2016-04-15 | 2020-11-18 | Magic Pony Technology Limited | Motion compensation using temporal picture interpolation |
EP3547685A4 (en) * | 2016-11-28 | 2020-08-05 | Nippon Hoso Kyokai | Encoding device, decoding device, encoding method, and decoding method |
JP7418152B2 (en) * | 2018-12-17 | 2024-01-19 | キヤノン株式会社 | Image encoding device, image encoding method, image decoding device, image decoding method |
KR20200140096A (en) | 2019-06-05 | 2020-12-15 | 삼성전자주식회사 | Apparatus and method for performing artificial intelligence encoding and artificial intelligence decoding of image |
CN113709504B (en) * | 2021-10-27 | 2022-02-15 | 深圳传音控股股份有限公司 | Image processing method, intelligent terminal and readable storage medium |
Citations (46)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5072293A (en) | 1989-08-29 | 1991-12-10 | U.S. Philips Corporation | Method of estimating motion in a picture signal |
US5126841A (en) * | 1989-10-13 | 1992-06-30 | Matsushita Electric Industrial Co., Ltd. | Motion compensated prediction interframe coding system |
JPH05227518A (en) | 1991-03-19 | 1993-09-03 | Olympus Optical Co Ltd | Picture signal decoder |
US5329318A (en) | 1993-05-13 | 1994-07-12 | Intel Corporation | Method for optimizing image motion estimation |
US5367385A (en) | 1992-05-07 | 1994-11-22 | Picturetel Corporation | Method and apparatus for processing block coded image data to reduce boundary artifacts between adjacent image blocks |
US5473384A (en) | 1993-12-16 | 1995-12-05 | At&T Corp. | Method of and system for enhancing distorted graphical information |
US5479211A (en) | 1992-04-30 | 1995-12-26 | Olympus Optical Co., Ltd. | Image-signal decoding apparatus |
EP0714209A2 (en) | 1994-11-24 | 1996-05-29 | Victor Company Of Japan, Ltd. | Method and device for decoding image data |
JPH08205178A (en) | 1995-01-26 | 1996-08-09 | Victor Co Of Japan Ltd | Method for reducing quantization noise and device for decoding image data |
US5565921A (en) | 1993-03-16 | 1996-10-15 | Olympus Optical Co., Ltd. | Motion-adaptive image signal processing system |
EP0777388A2 (en) | 1995-12-08 | 1997-06-04 | Kabushiki Kaisha Toshiba | Video encoder and decoder with noise reduction |
US5654759A (en) | 1995-02-15 | 1997-08-05 | Hitachi America Ltd. | Methods and apparatus for reducing blockiness in decoded video |
KR970078645A (en) | 1996-05-14 | 1997-12-12 | 배순훈 | Method and apparatus for removing blocking phenomenon of video decoder |
US5731840A (en) | 1995-03-10 | 1998-03-24 | Kabushiki Kaisha Toshiba | Video coding/decoding apparatus which transmits different accuracy prediction levels |
US5737019A (en) * | 1996-01-29 | 1998-04-07 | Matsushita Electric Corporation Of America | Method and apparatus for changing resolution by direct DCT mapping |
JPH1093966A (en) | 1992-02-29 | 1998-04-10 | Samsung Electron Co Ltd | Picture encoding device |
EP0838955A2 (en) | 1996-10-24 | 1998-04-29 | Fujitsu Limited | Video coding apparatus and decoding apparatus |
US5768433A (en) | 1994-03-30 | 1998-06-16 | Sgs-Thomson Microelectronics S.A. | Picture compression circuit |
US5787204A (en) | 1991-01-10 | 1998-07-28 | Olympus Optical Co., Ltd. | Image signal decoding device capable of removing block distortion with simple structure |
JPH1118085A (en) | 1997-06-05 | 1999-01-22 | General Instr Corp | Temporally and spatially scalable encoding for video object plane |
US5933542A (en) | 1996-04-24 | 1999-08-03 | Sony Corporation | Method and apparatus for blocking effect reduction in images by post-processing in the spatial domain |
JPH11275584A (en) | 1998-03-23 | 1999-10-08 | Hitachi Ltd | Block distortion reduction circuit for image signal |
US5974196A (en) | 1996-03-15 | 1999-10-26 | Sony Corporation | Method and apparatus for blocking effect reduction in images |
US5987184A (en) | 1996-09-30 | 1999-11-16 | Kweon; Ji-Heon | Device for coding/decoding image information |
WO2000014685A1 (en) | 1998-09-08 | 2000-03-16 | Sarnoff Corporation | Subband coding/decoding |
US6041145A (en) | 1995-11-02 | 2000-03-21 | Matsushita Electric Industrial Co., Ltd. | Device and method for smoothing picture signal, device and method for encoding picture and device and method for decoding picture |
US6044177A (en) | 1997-06-18 | 2000-03-28 | Hewlett-Packard Company | Artifact reduction decompression method and apparatus for interpolated images |
US6115503A (en) | 1996-07-04 | 2000-09-05 | Siemens Aktiengesellschaft | Method and apparatus for reducing coding artifacts of block-based image encoding and object-based image encoding |
JP2000299864A (en) | 1999-04-12 | 2000-10-24 | Canon Inc | Method for processing dynamic image |
US6144700A (en) | 1996-05-14 | 2000-11-07 | Daewoo Electronics Co., Ltd. | Method and apparatuses for removing blocking effect in a motion picture decoder |
US6160503A (en) * | 1992-02-19 | 2000-12-12 | 8×8, Inc. | Deblocking filter for encoder/decoder arrangement and method with divergence reduction |
JP2001094996A (en) | 1999-07-19 | 2001-04-06 | Sony Corp | Block distortion reduction method and block distortion reduction device |
CA2374523A1 (en) | 2000-01-20 | 2001-07-26 | Nokia Mobile Phones Ltd. | A method and associated device for filtering digital video images |
JP2001204029A (en) | 1999-08-25 | 2001-07-27 | Matsushita Electric Ind Co Ltd | Noise detection method, noise detector and image recorder |
JP2001224031A (en) | 2000-02-10 | 2001-08-17 | Sharp Corp | Moving picture decoder |
US6424676B1 (en) * | 1998-08-03 | 2002-07-23 | Custom Technology Corp. | Motion vector detecting method and device, and storage medium |
US6618445B1 (en) * | 2000-11-09 | 2003-09-09 | Koninklijke Philips Electronics N.V. | Scalable MPEG-2 video decoder |
US20040101059A1 (en) | 2002-11-21 | 2004-05-27 | Anthony Joch | Low-complexity deblocking filter |
US6748113B1 (en) | 1999-08-25 | 2004-06-08 | Matsushita Electric Insdustrial Co., Ltd. | Noise detecting method, noise detector and image decoding apparatus |
US20040190626A1 (en) | 2001-09-14 | 2004-09-30 | Shijun Sun | Adaptive filtering based upon boundary strength |
JP2004328634A (en) | 2003-04-28 | 2004-11-18 | Sony Corp | Image decoding apparatus and method |
US6931063B2 (en) * | 2001-03-26 | 2005-08-16 | Sharp Laboratories Of America, Inc. | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US20060146941A1 (en) | 2005-01-04 | 2006-07-06 | Samsung Electronics Co., Ltd. | Deblocking control method considering intra BL mode and multilayer video encoder/decoder using the same |
JP2006191576A (en) | 2005-01-04 | 2006-07-20 | Samsung Electronics Co Ltd | Deblocking filtering method considering intra bl mode and multilayer video encoder/decoder using the same |
US20070160133A1 (en) | 2006-01-11 | 2007-07-12 | Yiliang Bao | Video coding with fine granularity spatial scalability |
US7627034B2 (en) | 2005-04-01 | 2009-12-01 | Lg Electronics Inc. | Method for scalably encoding and decoding video signal |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0813138B2 (en) * | 1990-11-28 | 1996-02-07 | 松下電器産業株式会社 | Image coding device |
JPH04207878A (en) * | 1990-11-30 | 1992-07-29 | Toshiba Corp | Moving image management device |
JP3165296B2 (en) * | 1992-12-25 | 2001-05-14 | 三菱電機株式会社 | Inter-frame coding processing method, inter-frame coding processing method, and coding control method |
KR0174452B1 (en) | 1995-02-28 | 1999-03-20 | 배순훈 | Digital image decoder |
AU717480B2 (en) * | 1998-08-01 | 2000-03-30 | Korea Advanced Institute Of Science And Technology | Loop-filtering method for image data and apparatus therefor |
CN101448162B (en) * | 2001-12-17 | 2013-01-02 | 微软公司 | Method for processing video image |
US7319415B2 (en) * | 2002-05-01 | 2008-01-15 | Thomson Licensing | Chroma deblocking filter |
US6907079B2 (en) * | 2002-05-01 | 2005-06-14 | Thomson Licensing S.A. | Deblocking filter conditioned on pixel brightness |
US7167522B2 (en) * | 2003-02-27 | 2007-01-23 | Texas Instruments Incorporated | Video deblocking filter |
US8625680B2 (en) * | 2003-09-07 | 2014-01-07 | Microsoft Corporation | Bitstream-controlled post-processing filtering |
KR100819289B1 (en) * | 2006-10-20 | 2008-04-02 | 삼성전자주식회사 | Deblocking filtering method and deblocking filter for video data |
US8204129B2 (en) * | 2007-03-27 | 2012-06-19 | Freescale Semiconductor, Inc. | Simplified deblock filtering for reduced memory access and computational complexity |
US8861879B2 (en) * | 2009-09-17 | 2014-10-14 | Samsung Electronics Co., Ltd. | Method and apparatus for encoding and decoding image based on skip mode |
US9942573B2 (en) * | 2011-06-22 | 2018-04-10 | Texas Instruments Incorporated | Systems and methods for reducing blocking artifacts |
-
2001
- 2001-03-26 US US09/817,701 patent/US6931063B2/en not_active Expired - Lifetime
-
2002
- 2002-03-15 JP JP2002072698A patent/JP3688248B2/en not_active Expired - Lifetime
- 2002-03-20 EP EP10012398A patent/EP2278813B1/en not_active Expired - Lifetime
- 2002-03-20 EP EP09010824A patent/EP2124453B1/en not_active Expired - Lifetime
- 2002-03-20 EP EP02006295A patent/EP1246131B1/en not_active Expired - Lifetime
- 2002-03-20 EP EP06018872A patent/EP1727373B1/en not_active Expired - Lifetime
- 2002-03-20 DE DE60234875T patent/DE60234875D1/en not_active Expired - Lifetime
- 2002-03-20 EP EP05016012A patent/EP1596604B1/en not_active Expired - Lifetime
- 2002-03-20 DE DE60220106T patent/DE60220106T2/en not_active Expired - Lifetime
- 2002-03-20 EP EP10012444A patent/EP2278814B1/en not_active Expired - Lifetime
- 2002-03-20 DE DE60215241T patent/DE60215241T2/en not_active Expired - Lifetime
- 2002-03-20 EP EP10012445A patent/EP2278815B1/en not_active Expired - Lifetime
- 2002-03-29 US US10/112,683 patent/US7352812B2/en not_active Expired - Lifetime
-
2004
- 2004-07-09 JP JP2004202737A patent/JP3714944B2/en not_active Expired - Lifetime
- 2004-07-09 JP JP2004202741A patent/JP4120989B2/en not_active Expired - Lifetime
-
2005
- 2005-04-13 US US11/105,729 patent/US7440501B2/en not_active Ceased
-
2008
- 2008-02-14 JP JP2008032606A patent/JP4565010B2/en not_active Expired - Lifetime
-
2009
- 2009-02-13 JP JP2009031373A patent/JP4666411B2/en not_active Expired - Lifetime
- 2009-08-18 JP JP2009189287A patent/JP4666413B2/en not_active Expired - Lifetime
- 2009-10-14 JP JP2009237141A patent/JP4666415B2/en not_active Expired - Lifetime
- 2009-10-14 JP JP2009237136A patent/JP4666414B2/en not_active Expired - Lifetime
- 2009-12-28 JP JP2009297308A patent/JP4723024B2/en not_active Expired - Lifetime
- 2009-12-28 JP JP2009297315A patent/JP4723026B2/en not_active Expired - Lifetime
- 2009-12-28 JP JP2009297311A patent/JP4723025B2/en not_active Expired - Lifetime
- 2009-12-28 JP JP2009297321A patent/JP4723027B2/en not_active Expired - Lifetime
- 2009-12-28 JP JP2009297264A patent/JP4717136B2/en not_active Expired - Lifetime
- 2009-12-28 JP JP2009297283A patent/JP4717138B2/en not_active Expired - Lifetime
- 2009-12-28 JP JP2009297276A patent/JP4717137B2/en not_active Expired - Lifetime
-
2010
- 2010-03-09 HK HK11107536.3A patent/HK1153596A1/en not_active IP Right Cessation
- 2010-03-09 HK HK11107465.8A patent/HK1149664A1/en not_active IP Right Cessation
- 2010-03-09 HK HK10102452.5A patent/HK1134615A1/en not_active IP Right Cessation
- 2010-03-09 HK HK11107464.9A patent/HK1149663A1/en not_active IP Right Cessation
- 2010-10-20 US US12/908,690 patent/USRE43628E1/en not_active Expired - Lifetime
-
2012
- 2012-06-13 US US13/495,944 patent/USRE44497E1/en not_active Expired - Lifetime
-
2013
- 2013-07-30 US US13/954,817 patent/USRE45250E1/en not_active Ceased
-
2014
- 2014-10-10 US US14/512,165 patent/USRE46482E1/en not_active Expired - Lifetime
- 2014-10-10 US US14/512,067 patent/USRE46491E1/en not_active Expired - Lifetime
-
2017
- 2017-07-17 US US15/651,879 patent/USRE47261E1/en not_active Expired - Lifetime
- 2017-07-17 US US15/651,868 patent/USRE47202E1/en not_active Expired - Lifetime
Patent Citations (56)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5072293A (en) | 1989-08-29 | 1991-12-10 | U.S. Philips Corporation | Method of estimating motion in a picture signal |
US5126841A (en) * | 1989-10-13 | 1992-06-30 | Matsushita Electric Industrial Co., Ltd. | Motion compensated prediction interframe coding system |
US5787204A (en) | 1991-01-10 | 1998-07-28 | Olympus Optical Co., Ltd. | Image signal decoding device capable of removing block distortion with simple structure |
JPH05227518A (en) | 1991-03-19 | 1993-09-03 | Olympus Optical Co Ltd | Picture signal decoder |
US6160503A (en) * | 1992-02-19 | 2000-12-12 | 8×8, Inc. | Deblocking filter for encoder/decoder arrangement and method with divergence reduction |
US6263026B1 (en) | 1992-02-29 | 2001-07-17 | Samsung Electronics Co., Ltd. | Signal compressing system |
JPH1093966A (en) | 1992-02-29 | 1998-04-10 | Samsung Electron Co Ltd | Picture encoding device |
US5479211A (en) | 1992-04-30 | 1995-12-26 | Olympus Optical Co., Ltd. | Image-signal decoding apparatus |
US5367385A (en) | 1992-05-07 | 1994-11-22 | Picturetel Corporation | Method and apparatus for processing block coded image data to reduce boundary artifacts between adjacent image blocks |
US5565921A (en) | 1993-03-16 | 1996-10-15 | Olympus Optical Co., Ltd. | Motion-adaptive image signal processing system |
US5329318A (en) | 1993-05-13 | 1994-07-12 | Intel Corporation | Method for optimizing image motion estimation |
US5473384A (en) | 1993-12-16 | 1995-12-05 | At&T Corp. | Method of and system for enhancing distorted graphical information |
US5768433A (en) | 1994-03-30 | 1998-06-16 | Sgs-Thomson Microelectronics S.A. | Picture compression circuit |
US6167157A (en) | 1994-11-24 | 2000-12-26 | Victor Company Of Japan, Ltd. | Method of reducing quantization noise generated during a decoding process of image data and device for decoding image data |
EP0714209A2 (en) | 1994-11-24 | 1996-05-29 | Victor Company Of Japan, Ltd. | Method and device for decoding image data |
US5949908A (en) | 1994-11-24 | 1999-09-07 | Victor Company Of Japan, Ltd. | Method of reducing quantization noise generated during a decoding process of image data and device for decoding image data |
JPH08205178A (en) | 1995-01-26 | 1996-08-09 | Victor Co Of Japan Ltd | Method for reducing quantization noise and device for decoding image data |
US5654759A (en) | 1995-02-15 | 1997-08-05 | Hitachi America Ltd. | Methods and apparatus for reducing blockiness in decoded video |
US5731840A (en) | 1995-03-10 | 1998-03-24 | Kabushiki Kaisha Toshiba | Video coding/decoding apparatus which transmits different accuracy prediction levels |
US6041145A (en) | 1995-11-02 | 2000-03-21 | Matsushita Electric Industrial Co., Ltd. | Device and method for smoothing picture signal, device and method for encoding picture and device and method for decoding picture |
EP0777388A2 (en) | 1995-12-08 | 1997-06-04 | Kabushiki Kaisha Toshiba | Video encoder and decoder with noise reduction |
US5737019A (en) * | 1996-01-29 | 1998-04-07 | Matsushita Electric Corporation Of America | Method and apparatus for changing resolution by direct DCT mapping |
US5974196A (en) | 1996-03-15 | 1999-10-26 | Sony Corporation | Method and apparatus for blocking effect reduction in images |
US5933542A (en) | 1996-04-24 | 1999-08-03 | Sony Corporation | Method and apparatus for blocking effect reduction in images by post-processing in the spatial domain |
US6144700A (en) | 1996-05-14 | 2000-11-07 | Daewoo Electronics Co., Ltd. | Method and apparatuses for removing blocking effect in a motion picture decoder |
KR970078645A (en) | 1996-05-14 | 1997-12-12 | 배순훈 | Method and apparatus for removing blocking phenomenon of video decoder |
US6115503A (en) | 1996-07-04 | 2000-09-05 | Siemens Aktiengesellschaft | Method and apparatus for reducing coding artifacts of block-based image encoding and object-based image encoding |
US5987184A (en) | 1996-09-30 | 1999-11-16 | Kweon; Ji-Heon | Device for coding/decoding image information |
JPH10191351A (en) | 1996-10-24 | 1998-07-21 | Fujitsu Ltd | Moving image encoder and decoder |
EP0838955A2 (en) | 1996-10-24 | 1998-04-29 | Fujitsu Limited | Video coding apparatus and decoding apparatus |
US6104434A (en) | 1996-10-24 | 2000-08-15 | Fujitsu Limited | Video coding apparatus and decoding apparatus |
US6057884A (en) | 1997-06-05 | 2000-05-02 | General Instrument Corporation | Temporal and spatial scaleable coding for video object planes |
JPH1118085A (en) | 1997-06-05 | 1999-01-22 | General Instr Corp | Temporally and spatially scalable encoding for video object plane |
US6044177A (en) | 1997-06-18 | 2000-03-28 | Hewlett-Packard Company | Artifact reduction decompression method and apparatus for interpolated images |
JPH11275584A (en) | 1998-03-23 | 1999-10-08 | Hitachi Ltd | Block distortion reduction circuit for image signal |
US6424676B1 (en) * | 1998-08-03 | 2002-07-23 | Custom Technology Corp. | Motion vector detecting method and device, and storage medium |
WO2000014685A1 (en) | 1998-09-08 | 2000-03-16 | Sarnoff Corporation | Subband coding/decoding |
JP2000299864A (en) | 1999-04-12 | 2000-10-24 | Canon Inc | Method for processing dynamic image |
JP2001094996A (en) | 1999-07-19 | 2001-04-06 | Sony Corp | Block distortion reduction method and block distortion reduction device |
US6748113B1 (en) | 1999-08-25 | 2004-06-08 | Matsushita Electric Insdustrial Co., Ltd. | Noise detecting method, noise detector and image decoding apparatus |
JP2001204029A (en) | 1999-08-25 | 2001-07-27 | Matsushita Electric Ind Co Ltd | Noise detection method, noise detector and image recorder |
CA2374523A1 (en) | 2000-01-20 | 2001-07-26 | Nokia Mobile Phones Ltd. | A method and associated device for filtering digital video images |
US20010017944A1 (en) | 2000-01-20 | 2001-08-30 | Nokia Mobile Pnones Ltd. | Method and associated device for filtering digital video images |
JP2001224031A (en) | 2000-02-10 | 2001-08-17 | Sharp Corp | Moving picture decoder |
US6618445B1 (en) * | 2000-11-09 | 2003-09-09 | Koninklijke Philips Electronics N.V. | Scalable MPEG-2 video decoder |
US6931063B2 (en) * | 2001-03-26 | 2005-08-16 | Sharp Laboratories Of America, Inc. | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US7440501B2 (en) * | 2001-03-26 | 2008-10-21 | Sharp Laboratories Of America, Inc. | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US20040190626A1 (en) | 2001-09-14 | 2004-09-30 | Shijun Sun | Adaptive filtering based upon boundary strength |
JP2005503737A (en) | 2001-09-14 | 2005-02-03 | シャープ株式会社 | Adaptive filtering based on boundary strength |
US20040101059A1 (en) | 2002-11-21 | 2004-05-27 | Anthony Joch | Low-complexity deblocking filter |
JP2004328634A (en) | 2003-04-28 | 2004-11-18 | Sony Corp | Image decoding apparatus and method |
US20050002646A1 (en) | 2003-04-28 | 2005-01-06 | Kazushi Sato | Video decoding apparatus and method |
US20060146941A1 (en) | 2005-01-04 | 2006-07-06 | Samsung Electronics Co., Ltd. | Deblocking control method considering intra BL mode and multilayer video encoder/decoder using the same |
JP2006191576A (en) | 2005-01-04 | 2006-07-20 | Samsung Electronics Co Ltd | Deblocking filtering method considering intra bl mode and multilayer video encoder/decoder using the same |
US7627034B2 (en) | 2005-04-01 | 2009-12-01 | Lg Electronics Inc. | Method for scalably encoding and decoding video signal |
US20070160133A1 (en) | 2006-01-11 | 2007-07-12 | Yiliang Bao | Video coding with fine granularity spatial scalability |
Non-Patent Citations (37)
Title |
---|
"Index of /av-arch/video-site/0109-San", Sep. 4, 2001, pp. 1-4, XP002606104, Retrieved from the Internet: URL:http://ftp.itu3.int/av-arch/video-site/0109-San [retrieved on Oct. 4, 2005]. |
"Working Draft 1.0 of 14496-10: 200x/AMD1 Scalable Video Coding" ITU Study Group 16-Video Coding Experts Group-ISO/IEC MPEG & ITU-T VCEG/ISO/IEC JTC1/SC29/ WG11 and ITU-T SG16 Q6), No. N6901, Feb. 5, 2005, (Feb. 5, 2005), XP030013621. |
"Working Draft 4 of ISO/IEC 14496-10: 200x/Amd.3 Scalable Video Coding" ITU Study Group 16-Video Coding Experts Group-ISO/IEC MPEG & ITU-T VCEG(ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q6), No. N7555. Oct. 28, 2005 (Oct. 28, 2005), XP030014100 p. 118-p. 119. |
Bjontegaard G.: "H.26L Test Model Long Term No. 6 (TML-6) draft 0", ITU Telecommunication Standarization Sector, Eibsee, Germany, Jan. 9 (Jan. 9, 2001), pp. 1-35, generated Mar. 3, 2001. |
Bjontegaard G.: "H.26L Test Model Long Term No. 7 (TML-7) draft 0" ITU-Telecommunications Standardization Sector, Study Group 16, Video Coding Experts Group; Document VCEG-M81, May 3, 2001; Austin Texas, USA Apr. 2-4, 2001. |
Bjontegaard, Gisle (Editor), "H.26L Test Model Long Term No. 6 (TML-6) draft0", ITU Telecommunications Standardization Sector, Study Group 16, Video Coding Experts Group (VCEG), 12TH meeting, Eibsee, Germany, Jan. 9-12, 2001. |
Derviaux C et al.: "Blocking Artifact Reduction of DCT Coded Image Sequences Using a Visually Adaptive Postprocessing" Proceedings of the International Conference on Image Processing (ICIP), Lausanne, Sep. 16-19, 1996, New York, IEEE, US, vol. 1, Sep. 16, 1996 pp. 5-8. |
Derviaux, Christian et al., "Blocking Artifact Reduction of DCT Coded Image Sequences Using a Visually Adaptive Postprocessing", IEEE, pp. 5-8, 1996. |
European Search Report for EP02006295.6, Apr. 28, 2005. |
European Search Report for EP02798822.9, Oct. 17, 2005. |
European Search Report for EP05016012.6, Oct. 7, 2005. |
European Search Report for EP06019135.0, Aug. 30, 2007. |
European Search Report for EP06736425.7, Sep. 1, 2010. |
European Search Report for European Application No. EP 02 00 6295, dated Apr. 20, 2005. |
Francois E. et al: "Extended Spatial Scalability" International Organisation for Standardisation Organisation International De Normalisation, ISO/IEC JTC1/SC29/WG11, Coding of Moving Pictures and Audio, ISO/IEC JTC1/SC29/WG11, MPEG2005/M11660, Jan. 2005, Hong Kong. |
Han W. et al.: "Response of SVC CE-3: Interlayer prediction" ITU Study Group 16-Video Coding Experts Group-ISO/IEC MPEG & ITU-T VCEG (ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q6), No. M11585,11 Jan. 2005 (Jan. 11, 2005, XP030040330. |
He Y; Wu F; Li S; Zhong 7; Yang S: "H.26L-Based Fine Granularity Scalable Video Coding" Proceedings-IEEE International Symposium on Circuits and Systems, vol. 4, 2002, pp. IV-548-IV-551, XP002593544 ISSN:0271-4310. |
International Search Report for PCT/JP02/09306, Dec. 17, 2002. |
International Search Report for PCT/US2006/007105, Nov. 23, 2007. |
Kim C. et al.: "Simplified Loop Filter for Mobile Service (VCEG-M43)" ITU-Telecommunication Standardization Sector Study Group 16, VCEG-M43, Austin, Texas, Apr. 2-4, 2001, generated Mar. 28, 2001. |
Kim S. D. et al.: "A Deblocking Filter with Two Separate Modes in Block-Based Video Coding", IEEE Transactions on Circuits and Systems for Video Technology, vol. 9, No. 1, Feb. 1999; pp. 156-160. |
Lee Y. L. et al.: "Loop-filtering and post-filtering for low bit-rates moving picture coding" Image Processing, 1999. ICIP 99. Proceedings,1999 International Conference on Kobe, Japan Oct. 24-28, 1999, Piscataway, NJ, USA, IEEE, US, vol. 1, Oct. 24, 1999. |
Lee, Y.L. et al., "Loop-filtering and Post-filtering for Low Bit-rates Moving Picture Coding", IEEE, pp. 94-98, 1999. |
List P. et al. "H.26L Test Model Long Term No. 8.40 (TML-8.4), Software Module: loop-filter.c" ITU-Telecommunications Standardization Sector Study Group 16, VCEG, [Online] Aug. 29, 2001, pp. 1-3, XP002440062, Santa Barbara, CA, USA. |
List P. et al.: "Adaptive Deblocking Filter" IEEE Transactions on Circuits and Systems for Video Technology, IEEE Service Center, Piscataway, NJ, US LINKD-DOI: 10.1109/TCSVT. 2003.815175, vol. 13, No. 7, Jul. 1, 2003 (Jul. 1, 2003). pp. 614-619, XP01122109. |
List P.: "Report of the Ad Hoc Committee on Loop Filter Improvement (VCEG-N08)" ITU Telecommunications Standardization Sector Study Group 16, VCEG-N008, [Online] Sep. 4, 2001, pp. 1-3, XP002347724 Santa Barbara, CA, USA, generated Aug. 8, 2001. |
Meier T. et al.: "Reduction of Blocking Artifacts in Image and Video Coding", IEEE Transactions on Circuits and Systems for Video Technology, vol. 9, No. 3, Apr. 1999; pp. 490-499. |
Park H. W. et al.: "A Postprocessing Method for Reducing Quantization Effects in Low Bit-Rate Moving Picture Coding", IEEE Transactions on Circuits and Systems for Video Technology, IEEE Inc. New York, US, vol. 9, No. 1, Feb. 1999 (Feb. 1999), pp. 161-171. |
Peter List, "Report of the AD Hoc Committee on Loop Filter Improvement (VCEG-N08)" ITE Telecommunications Standardization Sector Study Group 16, XX, XX, Sep. 4, 2001, pp. 1-3, XP 002347724, p. 2, paragraph 4.5, Santa Barbara. |
Shijun Sun et al., "Loop Filter with Skip mode (VCEG-M20)", ITU Telecommunications Standardization Sector Study Group 16, XX, XX vol., VCEG-M20, Mar. 27, 2001, pp. 1/8, XP002321426, p. 1, paragraph 2, Austin. |
Suehring, Karsten, "Release of reference software TML 8.4", tml84changes.txt, Sep. 3, 2001, XP002606232, Retrieved from the Internet: URL:http//wftp3.itu.int/av-arch/video-site/h26L/older-tml/tml84changes.txt [retrieved on Oct. 20, 2010]. |
Sun S. et al.: "Extended Spatial Scalability with Picture-Level Adaptation," ITU Study Group 16-Video Coding Experts Group-ISO/IEC MPEG & ITU-T VCEG(ISO/IEC JTC1/SC29/VVG11 and ITU-T SG16 Q6), No. JVT-0008, Apr. 13, 2005 (Apr. 13, 2005), XP030005956. |
Sun S. et al.: "Improved TML Loop Filter with Lower Complexity (VCEG-N17)" ITU Telecommunications Standardization Sector Study Group 16, VCEG-N17, [Online] Sep. 24, 2001, pp. 1-8, XP002347725 Santa Barbara, CA USA, generated Aug. 14, 2001. |
Sun S. et al.: "Loop Filter with Skip Mode (VCEG-M20)" ITU Telecommunications Standardization Sector Study Group 16, VCEG-M20, Apr. 2-4, 2001, pp. 1-8, XP002321426 Austin, Texas, USA, sections 1 + 2 with figure 1, generated Mar. 27, 2001. |
Sun S.:"CE2 Part 2: Deblocking filter for I-BL Blocks Spatial Scalable Video Coding", ITU Study Group 16-Video Coding Experts Group-ISO/IEC MPEG & ITU-T VCEG(ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q6), No. JVT-P013r1, Jul. 28, 2005 (Jul. 28, 2005), XP030006055. |
Turkowski K.: "Filters for Common Resampling Tasks," Graphics Gems I, Academic Pres, Apple Computer, Apr. 1990. |
Video & JVT, Description of Core Experiments in SVC, International Organisation For Standardisation, Organisation International De Normalisation, Coding Of Moving Pictures And Audio, ISO/IEC JTC1/SC29/WG11/N6898, Hong Kong, Jan. 2005. |
Cited By (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
USRE46482E1 (en) | 2001-03-26 | 2017-07-18 | Dolby Laboratories Licensing Corporation | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
USRE47261E1 (en) | 2001-03-26 | 2019-02-26 | Dolby Laboratories Licensing Corporation | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
USRE44497E1 (en) * | 2001-03-26 | 2013-09-17 | Sharp Kabushiki Kaisha | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
USRE47202E1 (en) | 2001-03-26 | 2019-01-08 | Dolby Laboratories Licensing Corporation | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
USRE46491E1 (en) | 2001-03-26 | 2017-07-25 | Dolby Laboratories Licensing Corporation | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
USRE45250E1 (en) * | 2001-03-26 | 2014-11-18 | Sharp Kabushiki Kaisha | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding |
US10178386B2 (en) | 2001-09-14 | 2019-01-08 | Dolby Laboratories Licensing Corporation | Adaptive filtering based upon boundary strength |
US9848191B2 (en) | 2001-09-14 | 2017-12-19 | Dolby Laboratories Licensing Corporation | Adaptive filtering based upon boundary strength |
US9344730B2 (en) | 2001-09-14 | 2016-05-17 | Dolby Laboratories Licensing Corporation | Adaptive filtering based upon boundary strength |
US9407914B2 (en) | 2001-09-14 | 2016-08-02 | Dolby Laboratories Licensing Corporation | Adaptive filtering based upon boundary strength |
US9407913B2 (en) | 2001-09-14 | 2016-08-02 | Dolby Laboratories Licensing Corporation | Adaptive filtering based upon boundary strength |
US9503759B2 (en) | 2001-09-14 | 2016-11-22 | Dolby Laboratories Licensing Corporation | Adaptive filtering based upon boundary strength |
US9609327B1 (en) | 2001-09-14 | 2017-03-28 | Dolby Laboartories Licensing Corporation | Adaptive filtering based upon boundary strength |
US10602142B2 (en) | 2001-09-14 | 2020-03-24 | Dolby Laboratories Licensing Corporation | Adaptive filtering based upon boundary strength |
US8891634B2 (en) | 2001-09-14 | 2014-11-18 | Sharp Kabushiki Kaisha | Adaptive filtering based upon boundary strength |
US9124888B2 (en) | 2001-09-14 | 2015-09-01 | Sharp Kabushiki Kaisha | Adaptive filtering based upon boundary strength |
US9866834B2 (en) | 2001-09-14 | 2018-01-09 | Dolby Laboratories Licensing Corporation | Adaptive filtering based upon boundary strength |
US9872024B2 (en) | 2001-09-14 | 2018-01-16 | Dolby Laboratories Licensing Corporation | Adaptive filtering based upon boundary strength |
US20070098077A1 (en) * | 2001-09-14 | 2007-05-03 | Shijun Sun | Adaptive filtering based upon boundary strength |
US10349051B1 (en) | 2001-09-14 | 2019-07-09 | Dolby Laboratories Licensing Corporation | Adaptive filtering based upon boundary strength |
US20070098076A1 (en) * | 2001-09-14 | 2007-05-03 | Shijun Sun | Adaptive filtering based upon boundary strength |
US10257511B2 (en) | 2001-09-14 | 2019-04-09 | Dolby Laboratories Licensing Corporation | Adaptive filtering based upon boundary strength |
US8805100B2 (en) | 2010-06-03 | 2014-08-12 | Sharp Kabushiki Kaisha | Filter device, image decoding device, image encoding device, and filter parameter data structure |
US8976856B2 (en) * | 2010-09-30 | 2015-03-10 | Apple Inc. | Optimized deblocking filters |
Also Published As
Similar Documents
Publication | Publication Date | Title |
---|---|---|
USRE47202E1 (en) | Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding | |
US10349051B1 (en) | Adaptive filtering based upon boundary strength |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
AS | Assignment |
Owner name: DOLBY LABORATORIES LICENSING CORPORATION, CALIFORN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SHARP KABUSHIKI KAISHA;REEL/FRAME:036724/0111 Effective date: 20150929 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 12 |