WO2006108654A2 - Method and apparatus for enhanced video coding - Google Patents
Method and apparatus for enhanced video coding Download PDFInfo
- Publication number
- WO2006108654A2 WO2006108654A2 PCT/EP2006/003410 EP2006003410W WO2006108654A2 WO 2006108654 A2 WO2006108654 A2 WO 2006108654A2 EP 2006003410 W EP2006003410 W EP 2006003410W WO 2006108654 A2 WO2006108654 A2 WO 2006108654A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- filter
- video signal
- sub
- pel
- filter coefficients
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 60
- 230000004044 response Effects 0.000 claims abstract description 17
- 230000003044 adaptive effect Effects 0.000 claims description 40
- 230000002123 temporal effect Effects 0.000 claims description 8
- 238000005192 partition Methods 0.000 claims description 6
- 238000000354 decomposition reaction Methods 0.000 claims description 2
- 230000011664 signaling Effects 0.000 claims 1
- 239000013598 vector Substances 0.000 abstract description 15
- 238000013139 quantization Methods 0.000 abstract description 3
- 230000006835 compression Effects 0.000 abstract 1
- 238000007906 compression Methods 0.000 abstract 1
- 238000011156 evaluation Methods 0.000 abstract 1
- 238000006073 displacement reaction Methods 0.000 description 15
- 238000013459 approach Methods 0.000 description 8
- 238000004364 calculation method Methods 0.000 description 5
- 239000011159 matrix material Substances 0.000 description 4
- 239000000306 component Substances 0.000 description 3
- 238000005457 optimization Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 241001025261 Neoraja caerulea Species 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/59—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/117—Filters, e.g. for pre-processing or post-processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/174—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/187—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/189—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
- H04N19/196—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
- H04N19/463—Embedding additional information in the video signal during the compression process by compressing encoding parameters before transmission
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/523—Motion estimation or motion compensation with sub-pixel accuracy
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/593—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
- H04N19/31—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the temporal domain
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
- H04N19/33—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the spatial domain
Definitions
- the invention relates to methods for encoding and decoding a video signal and corresponding apparatuses.
- Coding of video signals is well known in the art and usually related to the MPEG 4 or H.264/AVC standard.
- the responsible committees for these two standards are the ISO and ITU.
- the ISO and ITU coding standards apply hybrid video coding with motion- compensated prediction combined with transform coding of the prediction error.
- the motion-compensated prediction is performed.
- the temporal redundancy i.e. the correlation between consecutive images is exploited for the prediction of the current image from already transmitted images.
- the residual error is transform coded, thus the spatial redundancy is reduced.
- the current image of a sequence is split into blocks.
- a displacement vector dj is esti- mated and transmitted that refers to the corresponding position in one of refer- ence images.
- the displacement vectors may have fractional-pel resolution.
- Today's standard H.264/AVC allows for 1 ⁇ -pel displacement resolution.
- Displacement vectors with fractional-pel resolution may refer to positions in the reference image, which are located between the sampled positions.
- the reference image has to be interpolated on the sub-pel positions.
- H.264/AVC uses a 6-tap Wiener interpolation filter with fixed filter coefficients.
- the interpolation process used in H.264/AVC is depicted in Figure 1 and can be subdivided into two steps.
- the half-pel positions aa, bb, cc, dd, ee, ff and gg, hh, H, kk, II, mm are calculated, using a horizontal or vertical 6-tap Wiener filter, respectively.
- the sub-pel position j is computed.
- the sub-pel position j can be computed using the horizontal filter set applied at sub-pel positions gg, hh, ii, kk, II, mm).
- the residual quarter-pel positions are obtained, using a bilinear filter, applied at already calculated half-pel positions and existing full-pel positions.
- the object is solved by the methods according to claim 1 , 13, and 21.
- a method for encoding a video signal representing a moving picture comprises the steps of receiving successive frames of a video signal, coding a frame of the video signal, using a reference frame of the video signal, and calculating analytically a value of a sub-pel position of the reference frame by use of a filter having an individual set of two-dimensional filter coefficients.
- the present invention instead of calculating the values of sub-pel positions in two steps based on two one-dimensional filters, the present invention discloses a method of calculating the value of a sub-pel position in a single step by use of a set of two-dimensional filter coefficients.
- the filter set can be established by setting up an individual set of equations for the sub-pel position. Accordingly, the calculation is independent for each sub-pel position.
- some of the two-dimensional filter coeffi- cients are set equal under the constraint that the distance of the corresponding full-pel position to the current sub-pel position for which the two-dimensional filter coefficients are calculated is equal. This contributes to reduce data overhead. Instead of transmitting all filter coefficients, only a reduced number of filter coefficients has to be transmitted.
- the filter coefficients are coded.
- the coding may be based on a temporal prediction, wherein the differences of a first filter set with respect to a second filter set have to be transmitted. It is also possible to base the prediction on spatial prediction, wherein the symmetry of the statistical properties of the video signal is exploited.
- the step of predicting the two-dimensional filter coefficients of a second sub-pel is carried out by the use of an interpolation step with respect to the impulse response of a filter set up of two- dimensional filter coefficients for a first sub-pel, such that the result is used for a second sub-pel. Coding the filter coefficients provides further reduction of the amount of data to be transmitted from an encoder to a decoder.
- the standard representation form of a filter having one-dimensional filter coefficients is replaced by the corresponding two-dimensional form of the filter. Accordingly, the means provided to encode or decode a video signal can be configured to fulfil only the requirements for a two- dimensional representation form even though two-dimensional and one- dimensional filter sets are used.
- the method according to the present invention supports all kinds of filtering, such as for example a Wiener-filter having fixed coefficients.
- the two-dimensional filter can also be a polyphase filter.
- different filters are provided for different regions of a picture, such that several sets of filter coefficients can be transmitted and the method comprises the step of indicating which filter set is to be used for a specific region. Accordingly, it is not necessary to transmit all individual sets of filter coefficients, if these sets are identical for different regions. Instead of conveying the data related to the filter coefficients repeatedly from the encoder to the decoder, a single flag or the like is used to select the filter set for a specific region.
- the region can be a macroblock or a slice. In particular, for a macroblock, it is possible to signal the partition id.
- a different method for encoding a video signal representing a moving picture by use of a motion compensated prediction includes the steps of receiving successive frames of a video signal, coding a frame of the video signal using a reference frame of the video signal and calculating a value of the sub-pel position inde- pendently by minimisation of an optimisation criteria in an adaptive manner.
- the calculation step of a value of sub-pel position is not only carried out independently, but also by minimisation of an optimisation criteria in an adaptive manner. "In an adaptive manner” implies the use of an adaptive algorithm or iteration. Providing an adaptive solution enables the encoder to find an optimum solution with respect to a certain optimisation criteria.
- the optimisation criteria may vary in time or for different locations of the sub-pel, entailing a continuously adapted optimum solution.
- This aspect of the invention can be combined with the step of calculating the value of the sub-pel position analytically by use of a filter having an individual set of two-dimensional filter coefficients, such that the filter coefficients are calculated adaptively.
- the optimisation criteria can be based on the rate distortion measure or on the prediction error energy.
- the calculation can be carried out by setting up an individual set of equations for the filter coefficients of each sub-pel position. In particular, with respect to the prediction error energy as an optimisation criteria, it is possible to compute first the derivative of the prediction error energy in order to find an optimum solution.
- the set of two-dimensional filter coefficients can also profit from setting two-dimensional filter coefficients equal for which the distance of the corresponding full-pel position to the current sub-pel position is equal.
- the step of equating can be based on statistical properties of the video signal, a still picture, or any other criteria.
- the two-dimensional filter coefficients can be coded by means of temporal prediction, wherein the differences of a first filter set to a second filter set (e.g. used for the previous image or picture or frame) have to be determined.
- the filter coefficients can also be coded by a spatial prediction, wherein the symmetry of the statistical properties of the video signal is exploited as set out before.
- the two-dimensional filter can be a polyphase filter.
- Different filters can be provided for different regions of a picture, such that several sets of filter coefficients can be transmitted and the method may comprise a step of indicating which filter set is to be used for a specific region. This can be done by a specific flag provided in the coding semantics.
- the region can be a macro- block or a slice, wherein the partition id can be signalled for each macroblock.
- a method for encoding and decoding a video signal.
- the method provides an adaptive filter flag in the syntax of a coding scheme.
- the adaptive filter flag is suitable to indicate whether a specific filter is used or not. This is particularly useful, since an adaptive filtering step may not be beneficial for all kinds of video signals. Accordingly, a flag (adaptive filter flag) is provided in order to switch on or off the adaptive filter function.
- a sub-pel is selected for which, among a plurality of sub-pels, a filter coefficient is to be transmitted.
- This information is included for example in a coding scheme or a coding syntax.
- it can be indicated whether a set of filter coefficients is to be transmitted for the selected sub-pel. This measure takes account of the fact that filter coefficients are not always calculated for all sub-pels.
- the adaptive filter flag can be introduced in the picture parameter set raw byte sequence payload syntax of the coding scheme. This is only one example for a position of an adaptive filter flag in the coding syntax. Other flags may be provided to indicate whether an adaptive filter is used for a current macroblock, another region of a picture, or for B- or P-slices.
- the present invention provides also an apparatus for encoding a video signal representing a moving picture by use of motion compensated prediction.
- An apparatus according to the present invention comprises means for receiving successive frames of a video signal, means for coding the frame of the video signal using a reference frame of the video signal, and means for calculating analytically a value of a sub-pel position of the reference frame by use of a filter having an individual set of two-dimensional filter coefficients.
- the apparatus may include means for receiving successive frames of a video signal, means for coding a frame of the video signal using a reference frame of the video signal, and means for calculating a value of a sub-pel position inde- pendently by minimisation of an optimisation criteria in an adaptive manner.
- the present invention provides also a respective method for decoding a coded video signal being encoded according to the method for encoding the video signal as set out above and an apparatus for decoding a coded video signal comprising means to carry out the method for decoding.
- the methods and apparatuses for encoding and decoding as well as the coding semantics explained above are applicable to scalable video. It is an aspect of the present invention to provide the methods and apparatuses explained above for scalable video, wherein an independent filter set is used for a layer or a set of layers of the scalable video coding.
- the filter set for a second layer is predicted from a filter set of a first layer.
- the layers are typically produced by spatial or temporal decomposition.
- Fig. 1 shows a simplified diagram of the pels and sub-pels of an im- age
- Fig. 2 shows another simplified diagram of the pels an sub-pels of an image
- Fig. 3 shows the prediction of the impulse response of a polyphase filter for sub-pel positions
- Fig. 4 illustrates an example with interpolated impulse response of a predicted filter at sub-pel position j and calculated filter coefficients
- Fig. 5 shows the frequency responses of a Wiener filter, applied at half-pel positions, and a bilinear filter, applied at quarter-pel po- sitions.
- the present invention relates to an adaptive interpolation filter, which is independently estimated for every image.
- This approach enables to take into account the alteration of image signal properties, especially aliasing, on the basis of minimization of the prediction error energy.
- an approach is disclosed for efficient coding of filter coefficients, required especially at low bit rates and videos with low spatial resolution.
- the new scheme of interpolation filter is described.
- an optimized low-overhead syntax that allows definite filter coefficients decoding is disclosed.
- a two-dimensional 6x6-tap filter is calculated.
- the filter coefficients are calculated in a way that an optimization criterion is minimized.
- the optimization criteria could be the mean squared difference or mean absolute difference between the original and the predicted image signals. Note, that in this proposal we limit the size of the filter to 6x6 and the displacement vector resolution to a quarter-pel, but other filter sizes like 6x4, 4x4, 4x6, 6x1 etc. and displacement vector resolutions are also conceivable with our approach.
- h O o SP , h O i SP , ... , h ⁇ , h 55 sp are the 36 filter coefficients of a 6x6-tap 2D filter used for a particular sub-pel position SP. Then the value p SP (a ... o) to be interpolated is computed by a convolution:
- P,j is an integer sample value (A1 ... F6).
- a first interpolation filter is applied to every reference image.
- This first interpolation filter could be a fixed one like in the standard H.264/AVC, the filter of the previous image or defined by another method.
- 2D filter coefficients h,- j are calculated for each sub-pel position SP independently by minimization of the optimization criteria.
- prediction error energy
- New displacement vectors are estimated.
- the adaptive interpolation filter computed in step 2 is applied. This step en- ables reducing motion estimation errors, caused by aliasing, camera noise, etc. on the one hand and to treat the problem in the rate-distortion sense on the other hand.
- the filter coefficients have to be quantized and transmitted as side information e.g. using an intra/inter-prediction and entropy coding (s. Heading "Prediction and Coding of the Filter Coefficients").
- Symmetric two-dimensional Filter Since transmitting 360 filter coefficients may result in a high additional bit rate, the coding gain can be drastically reduced, especially for video sequences with small spatial resolution. In order to reduce the side information, we assume that statistical properties of an image signal are symmetric.
- the filter coefficients are assumed to be equal, in case the distance of the corresponding full-pel positions to the current sub-pel position are equal (the distance equality between the pixels in x- and y-direction is also assumed, i.e. if the image signal is interlaced, a scaling factor should be considered etc.).
- h C i B a filter coefficient used for computing the interpolated pixel at sub-pel position a at the integer position C1, depicted in Figure 2.
- the remaining filter coefficients are derived in the same manner. Then, based on symmetry assumptions only 5 independent 1 D or 2D filter sets consisting of different numbers of coefficients are required. Thus, for the sub-pel positions a, c, d, I only one filter with 6 coefficients is estimated, since:
- the first type is a temporal (inter) prediction, so the differ- ences of the current filter set to the filter set used for the previous image have to be transmitted.
- This type of coding is applied for filter coefficients at sub-pel positions a and b.
- the second type is a spatial (intra) prediction. Exploiting the symmetry of statistical properties of an image signal and knowing that no bilinear interpolation is used, coefficients of 2D filters for the different sub-pel positions can be regarded as samples of a common 2D filter, also called as polyphase filter. So, knowing the impulse response of the common filter at particular positions, we can predict its impulse response at other positions by interpolation.
- Figure 4 illustrates an example with interpolated impulse response of a predicted filter, at sub-pel position; and actually calculated filter coefficients.
- a matrix for a position f is given:
- the matrix coefficients for the sub-pel positions /, n, k can be obtained, when rotating the matrix used for the sub-pel position f by 90°, 180° and 270° in mathematical sense, respectively.
- the same can be applied at sub-pel positions e, g, m and o.
- the coefficient matrix for the sub-pel position e is given as example. 0 0 1 0 0 0 0
- the quarter-pel positions are calculated using already quantized half-pel positions, they are quantized twice. This can be avoided, if the quarter-pel positions are calculated directly.
- coefficients of 2D filter sets can be regarded as samples of one common 2D filter, sampled at different positions. Since the standard filter as used in H.264 uses a bilinear interpolation for quarter-pel positions, its impulse and frequency response diverges from that of the Wiener filter. In order to show, that the standard interpolation filter applied at quarter-pel positions is far away from the Wiener filter, which is the optimal one, if fixed coefficients are preconditioned, the frequency responses of both, Wiener filter, applied at half-pel positions, and a bilinear filter, applied at quarter-pel positions, are depicted in Figure 5.
- the introduced approach is not restricted to describe settings like quarter-pel motion resolution and 6x6 tap filter size.
- the filter can be either extended to an 8x8-tap filter, what would result in a better prediction quality, but also increase the computational effort, or reduced to a 4x4-tap filter.
- Non-separable two-dimensional Adap- tive Wiener Interpolation Filter can be applied to each reference frame independently. Though, this would increase side information.
- Another extension is defining a set of n predetermined filter sets or n predetermined filters. For each frame, just the index of one or more of the predetermined filter sets is transmitted. Thus, the analytically calculated optimal filter is mapped to the best predetermined filter set or filter of the set. So, only the index of the predetermined filter set or filter (if necessary, entropy coded) needs to be transmitted.
- the adaptive filter scheme can be switched on or off by the encoder.
- adaptive_filter_flagB 1 indicates, that adaptive interpolation scheme is in use for B-slices.
- adaptive_filter_flagB 0 indicates, that adaptive interpolation scheme is not in use for B-slices.
- the entropy coded filter coefficients are transmitted by the encoder.
- This code indicates to the decoder that if adaptive_filter_flag is set to 1 and cur- rent slice is a P-Slice than the entropy coded filter coefficients are transmitted.
- use_all_subpel_positions is transmitted.
- use_all_subpel_positions 1 specifies that all independent filter subsets are in use.
- use_all_subpel_positions 0 indicates that not every sub-pel position sub_pel (a...o) has been used by the motion estimation tool and positions_pattem is transmitted, posi- tions_pattern[ sub_pel ] equal to 1 specifies that FilterCoef[ sub_pel ][ i ] is in use, whereat FilterCoef represents the actually transmitted optimal filter coefficients.
- use_all_subpel_positions signals, if every sub-pel position is in use, posi- tions_pattern cannot be equal to 11111. If use_all_subpel_positions is equal to 0 and the first four entries of positions_pattern are equal to 1 , the last entry G_pos) must be equal to 0 and is not transmitted.
- the entropy coded here, using CAVLC
- DiffFilterCoef are transmitted.
- the reconstructed filter coefficients are obtained by adding differences and predicted filter coefficients.
- a similar scheme can be applied to a scalable video coder, where for each layer (or for several layers) either independent filter sets or common filter set is used. In case that each layer uses independent filter set, it can be predicted from lower to upper layer.
- Locally-adaptive filter
- an additional step at the encoder can be performed, whereby for each macroblock two filter sets, the standard and the adaptive one are compared. For these mac- roblocks where the adaptive filter is better (e.g. in terms of rate-distortion criterion), a new filter is calculated and only this one is transmitted. For the remaining macroblocks, the standard interpolation filter is applied. In order to signal, if the adaptive or the standard filter is applied to the current macroblock, an additional flag has to be transmitted for each macroblock.
- adaptive_filter_in_current_mb 1 specifies, that adaptive filter is in use for current macroblock.
- adaptive_filter_in_current_mb 0 specifies, that standard (fixed) filter is in use for current macroblock.
- adaptive filter_in_current_mb flag would switch between two filter sets, adap- tive_filter_in_current_mb flag can be predicted from neighboring already decoded macroblock so that only the prediction error for adaptive_filter_in_current_mb flag is transmitted. If entropy coding is used (e.g. arithmetic coding, CABAC), this flag can be coded with less than 1 bit/flag.
- CABAC arithmetic coding
- the present invention is beneficial for a broad variety of applications such as digital cinema, video coding, digital TV, DVD, blue ray, HDTV, scalable video. All these applications will profit from one or more aspects of the present invention.
- the present invention is in particular dedicated to improving the MPEG 4 Part 10 H.264/AVC standard.
- particular semantics are disclosed which may comply with the standard requirements.
- the basic principle of the present invention should not be constrained to any particular syntax given on the previous pages, but will be acknowledged by the person skilled in the art in a much broader sense.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
Claims
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2008505817A JP2008536414A (en) | 2005-04-13 | 2006-04-13 | Video extended encoding method and apparatus |
US11/911,505 US20090022220A1 (en) | 2005-04-13 | 2006-04-13 | Method and apparatus for enhanced video coding |
EP06742578A EP1886502A2 (en) | 2005-04-13 | 2006-04-13 | Method and apparatus for enhanced video coding |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US59449405P | 2005-04-13 | 2005-04-13 | |
US60/594,494 | 2005-04-13 | ||
US59594105P | 2005-08-19 | 2005-08-19 | |
US60/595,941 | 2005-08-19 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2006108654A2 true WO2006108654A2 (en) | 2006-10-19 |
WO2006108654A3 WO2006108654A3 (en) | 2007-05-10 |
Family
ID=36750011
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2006/003410 WO2006108654A2 (en) | 2005-04-13 | 2006-04-13 | Method and apparatus for enhanced video coding |
Country Status (4)
Country | Link |
---|---|
US (1) | US20090022220A1 (en) |
EP (1) | EP1886502A2 (en) |
JP (1) | JP2008536414A (en) |
WO (1) | WO2006108654A2 (en) |
Cited By (40)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2007002437A2 (en) * | 2005-06-24 | 2007-01-04 | Ntt Docomo, Inc. | Method and apparatus for video encoding and decoding using adaptive interpolation |
WO2008085109A1 (en) | 2007-01-09 | 2008-07-17 | Telefonaktiebolaget Lm Ericsson (Publ) | Adaptive filter representation |
WO2008084378A2 (en) * | 2007-01-09 | 2008-07-17 | Nokia Corporation | Adaptive interpolation filters for video coding |
WO2008149327A2 (en) * | 2007-06-04 | 2008-12-11 | France Telecom | Method and apparatus for motion-compensated video signal prediction |
WO2009089373A2 (en) * | 2008-01-08 | 2009-07-16 | Qualcomm Incorporated | Video coding of filter coefficients based on horizontal and vertical symmetry |
WO2009087095A1 (en) * | 2008-01-08 | 2009-07-16 | Telefonaktiebolaget Lm Ericsson (Publ) | Encoding filter coefficients |
WO2009126928A1 (en) * | 2008-04-10 | 2009-10-15 | Qualcomm Incorporated | Symmetry for interpolation filtering of sub-pixel positions in video coding |
EP2157799A1 (en) | 2008-08-18 | 2010-02-24 | Panasonic Corporation | Interpolation filter with local adaptation based on block edges in the reference frame |
EP2237557A1 (en) * | 2009-04-03 | 2010-10-06 | Panasonic Corporation | Coding for filter coefficients |
WO2010083438A3 (en) * | 2009-01-15 | 2010-11-11 | Qualcomn Incorporated | Filter prediction based on activity metrics in video coding |
CN101990760A (en) * | 2008-04-10 | 2011-03-23 | 高通股份有限公司 | Advanced interpolation techniques for motion compensation in video coding |
JP2011517238A (en) * | 2008-04-10 | 2011-05-26 | クゥアルコム・インコーポレイテッド | Rate distortion defined interpolation for video coding based on fixed or adaptive filters |
JP2011518508A (en) * | 2008-04-10 | 2011-06-23 | クゥアルコム・インコーポレイテッド | Interpolation filter support for sub-pixel resolution in video coding |
CN102172022A (en) * | 2008-10-03 | 2011-08-31 | 高通股份有限公司 | Digital video coding with interpolation filters and offsets |
CN102204255A (en) * | 2009-07-07 | 2011-09-28 | 松下电器产业株式会社 | Moving picture decoding device, moving picture decoding method, moving picture decoding system, integrated circuit, and program |
EP2144446A3 (en) * | 2008-07-09 | 2011-12-14 | Intel Corporation | Video encoding techniques |
US8090031B2 (en) | 2007-10-05 | 2012-01-03 | Hong Kong Applied Science and Technology Research Institute Company Limited | Method for motion compensation |
JP2012186573A (en) * | 2011-03-04 | 2012-09-27 | Kddi Corp | Moving image encoder, moving image encoding method, and program |
RU2477577C2 (en) * | 2008-04-10 | 2013-03-10 | Квэлкомм Инкорпорейтед | Interpolation-like filtering of integer pixel positions in video coding |
WO2013011492A3 (en) * | 2011-07-21 | 2013-05-30 | Luca Rossato | Tiered signal decoding and signal reconstruction |
EP2605516A1 (en) * | 2010-09-30 | 2013-06-19 | Nippon Telegraph And Telephone Corporation | Image encoding method, image decoding method, image encoding device, image decoding device and program therefor |
CN103430545A (en) * | 2010-12-21 | 2013-12-04 | 英特尔公司 | Content adaptive motion compensation filtering for high efficiency video coding |
CN103546748A (en) * | 2008-07-11 | 2014-01-29 | 高通股份有限公司 | Filtering video data using a plurality of filters |
US8804831B2 (en) | 2008-04-10 | 2014-08-12 | Qualcomm Incorporated | Offsets at sub-pixel resolution |
US8811484B2 (en) | 2008-07-07 | 2014-08-19 | Qualcomm Incorporated | Video encoding by filter selection |
US8831086B2 (en) | 2008-04-10 | 2014-09-09 | Qualcomm Incorporated | Prediction techniques for interpolation in video coding |
CN104067613A (en) * | 2011-11-08 | 2014-09-24 | 株式会社Kt | Method and apparatus for encoding image, and method and apparatus for decoding image |
US8885730B2 (en) | 2009-06-10 | 2014-11-11 | Panasonic Corporation | Image coding method, image decoding method, and apparatuses therefor |
TWI463878B (en) * | 2009-02-19 | 2014-12-01 | Sony Corp | Image processing apparatus and method |
US8964853B2 (en) | 2011-02-23 | 2015-02-24 | Qualcomm Incorporated | Multi-metric filtering |
US8971412B2 (en) | 2008-04-10 | 2015-03-03 | Qualcomm Incorporated | Advanced interpolation techniques for motion compensation in video coding |
US9077971B2 (en) | 2008-04-10 | 2015-07-07 | Qualcomm Incorporated | Interpolation-like filtering of integer-pixel positions in video coding |
EP2901703A2 (en) * | 2012-09-28 | 2015-08-05 | VID SCALE, Inc. | Cross-plane filtering for chroma signal enhancement in video coding |
EP2538673A4 (en) * | 2010-01-22 | 2015-12-23 | Samsung Electronics Co Ltd | Area-based encoding/decoding device and method |
JP5902814B2 (en) * | 2012-07-09 | 2016-04-13 | 日本電信電話株式会社 | Video encoding method and apparatus, video decoding method and apparatus, and programs thereof |
EP2104358A4 (en) * | 2006-11-30 | 2016-04-27 | Ntt Docomo Inc | Dynamic image encoding device, dynamic image encoding method, dynamic image encoding program, dynamic image decoding device, dynamic image decoding method, and dynamic image decoding program |
WO2017196852A1 (en) * | 2016-05-09 | 2017-11-16 | Qualcomm Incorporated | Signalling of filtering information |
RU2684193C1 (en) * | 2015-05-21 | 2019-04-04 | Хуавэй Текнолоджиз Ко., Лтд. | Device and method for motion compensation in video content |
US10972728B2 (en) | 2015-04-17 | 2021-04-06 | Interdigital Madison Patent Holdings, Sas | Chroma enhancement filtering for high dynamic range video coding |
US11438605B2 (en) | 2015-07-08 | 2022-09-06 | Interdigital Madison Patent Holdings, Sas | Enhanced chroma coding using cross plane filtering |
Families Citing this family (34)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070160134A1 (en) * | 2006-01-10 | 2007-07-12 | Segall Christopher A | Methods and Systems for Filter Characterization |
BRPI0714233A2 (en) * | 2006-07-18 | 2013-01-15 | Thomson Licensing | Methods and apparatus for adaptive reference filtering |
KR101354659B1 (en) * | 2006-11-08 | 2014-01-28 | 삼성전자주식회사 | Method and apparatus for motion compensation supporting multicodec |
EP1983759A1 (en) * | 2007-04-19 | 2008-10-22 | Matsushita Electric Industrial Co., Ltd. | Estimation of separable adaptive interpolation filters for hybrid video coding |
EP2048886A1 (en) * | 2007-10-11 | 2009-04-15 | Panasonic Corporation | Coding of adaptive interpolation filter coefficients |
US8184693B2 (en) * | 2008-04-11 | 2012-05-22 | Intel Corporation | Adaptive filtering for bit-depth scalable video codec |
US20110103464A1 (en) * | 2008-06-12 | 2011-05-05 | Yunfei Zheng | Methods and Apparatus for Locally Adaptive Filtering for Motion Compensation Interpolation and Reference Picture Filtering |
CN102224734B (en) * | 2008-10-02 | 2013-11-13 | 索尼公司 | Image processing apparatus and method |
KR101761928B1 (en) * | 2009-03-13 | 2017-07-26 | 톰슨 라이센싱 | Blur measurement in a block-based compressed image |
US8761268B2 (en) * | 2009-04-06 | 2014-06-24 | Intel Corporation | Selective local adaptive wiener filter for video coding and decoding |
US8811485B1 (en) | 2009-05-12 | 2014-08-19 | Accumulus Technologies Inc. | System for generating difference measurements in a video processor |
US8218644B1 (en) | 2009-05-12 | 2012-07-10 | Accumulus Technologies Inc. | System for compressing and de-compressing data used in video processing |
WO2011033643A1 (en) * | 2009-09-17 | 2011-03-24 | 株式会社 東芝 | Dynamic image encoding method and dynamic image decoding method |
WO2011039931A1 (en) * | 2009-09-30 | 2011-04-07 | 三菱電機株式会社 | Image encoding device, image decoding device, image encoding method and image decoding method |
CN102714731A (en) * | 2009-12-22 | 2012-10-03 | 索尼公司 | Image processing device, image processing method, and program |
US20120281749A1 (en) * | 2010-01-08 | 2012-11-08 | Sharp Kabushiki Kaisha | Encoder, decoder, and data configuration |
WO2011086672A1 (en) * | 2010-01-13 | 2011-07-21 | 株式会社 東芝 | Moving image coding device and decoding device |
JP5323211B2 (en) * | 2010-01-13 | 2013-10-23 | 株式会社東芝 | Video encoding apparatus and decoding apparatus |
US8611414B2 (en) * | 2010-02-17 | 2013-12-17 | University-Industry Cooperation Group Of Kyung Hee University | Video signal processing and encoding |
WO2011121716A1 (en) | 2010-03-30 | 2011-10-06 | 株式会社 東芝 | Moving image encoding method, decoding method, encoder apparatus and decoder apparatus |
EP2559238B1 (en) * | 2010-04-13 | 2015-06-03 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Adaptive image filtering method and apparatus |
US9154807B2 (en) * | 2010-06-25 | 2015-10-06 | Qualcomm Incorporated | Inclusion of switched interpolation filter coefficients in a compressed bit-stream |
WO2012000191A1 (en) * | 2010-06-30 | 2012-01-05 | France Telecom Research & Development Beijing Company Limited | Pixel interpolation method and system |
US9247265B2 (en) * | 2010-09-01 | 2016-01-26 | Qualcomm Incorporated | Multi-input adaptive filter based on combination of sum-modified Laplacian filter indexing and quadtree partitioning |
JP2012060208A (en) * | 2010-09-06 | 2012-03-22 | Nippon Telegr & Teleph Corp <Ntt> | Moving image encoding method, moving image encoding apparatus, moving image decoding method, moving image decoding apparatus, and program thereof |
JP2012124673A (en) * | 2010-12-07 | 2012-06-28 | Sony Corp | Image processing system, image processing method and program |
US10045046B2 (en) * | 2010-12-10 | 2018-08-07 | Qualcomm Incorporated | Adaptive support for interpolating values of sub-pixels for video coding |
JP5762243B2 (en) * | 2011-10-18 | 2015-08-12 | 日本電信電話株式会社 | Video encoding method, apparatus, video decoding method, apparatus, and program thereof |
US10448032B2 (en) * | 2012-09-04 | 2019-10-15 | Qualcomm Incorporated | Signaling of down-sampling location information in scalable video coding |
CN104541506A (en) * | 2012-09-28 | 2015-04-22 | 英特尔公司 | Inter-layer pixel sample prediction |
JP5612177B2 (en) * | 2013-07-17 | 2014-10-22 | 株式会社東芝 | Video encoding method, decoding method, encoding device, and decoding device |
CN112188205B (en) * | 2014-10-31 | 2024-04-05 | 三星电子株式会社 | Video encoding apparatus and video decoding apparatus using high precision skip coding and methods thereof |
US10390038B2 (en) | 2016-02-17 | 2019-08-20 | Telefonaktiebolaget Lm Ericsson (Publ) | Methods and devices for encoding and decoding video pictures using a denoised reference picture |
US11044480B2 (en) * | 2019-01-24 | 2021-06-22 | Google Llc | More accurate 2-tap interpolation filters for video compression |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0327268A2 (en) * | 1988-02-04 | 1989-08-09 | AT&T Corp. | Interpolator for and method of interpolating digital samples |
WO2001052546A2 (en) * | 2000-01-10 | 2001-07-19 | Koninklijke Philips Electronics N.V. | Image interpolation and decimation using a continuously variable delay filter and combined with a polyphase filter |
US6510177B1 (en) * | 2000-03-24 | 2003-01-21 | Microsoft Corporation | System and method for layered video coding enhancement |
US20030156646A1 (en) * | 2001-12-17 | 2003-08-21 | Microsoft Corporation | Multi-resolution motion estimation and compensation |
US20050013369A1 (en) * | 2003-06-23 | 2005-01-20 | Tsu-Chang Lee | Method and apparatus for adaptive multiple-dimensional signal sequences encoding/decoding |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5422827A (en) * | 1993-02-12 | 1995-06-06 | Cirrus Logic, Inc. | Integrated video scaling and sharpening filter |
US6037986A (en) * | 1996-07-16 | 2000-03-14 | Divicom Inc. | Video preprocessing method and apparatus with selective filtering based on motion detection |
US6067125A (en) * | 1997-05-15 | 2000-05-23 | Minerva Systems | Structure and method for film grain noise reduction |
DE19730305A1 (en) * | 1997-07-15 | 1999-01-21 | Bosch Gmbh Robert | Method for generating an improved image signal in the motion estimation of image sequences, in particular a prediction signal for moving images with motion-compensating prediction |
US6968008B1 (en) * | 1999-07-27 | 2005-11-22 | Sharp Laboratories Of America, Inc. | Methods for motion estimation with adaptive motion accuracy |
DE10120395A1 (en) * | 2001-04-25 | 2002-10-31 | Bosch Gmbh Robert | Device for the interpolation of samples as well as image encoder and image decoder |
MXPA04006814A (en) * | 2002-01-14 | 2004-12-06 | Nokia Corp | Coding dynamic filters. |
US7389226B2 (en) * | 2002-10-29 | 2008-06-17 | Ntt Docomo, Inc. | Optimized windows and methods therefore for gradient-descent based window optimization for linear prediction analysis in the ITU-T G.723.1 speech coding standard |
US7724818B2 (en) * | 2003-04-30 | 2010-05-25 | Nokia Corporation | Method for coding sequences of pictures |
US7415069B2 (en) * | 2003-12-09 | 2008-08-19 | Lsi Corporation | Method for activation and deactivation of infrequently changing sequence and picture parameter sets |
-
2006
- 2006-04-13 JP JP2008505817A patent/JP2008536414A/en active Pending
- 2006-04-13 EP EP06742578A patent/EP1886502A2/en not_active Withdrawn
- 2006-04-13 US US11/911,505 patent/US20090022220A1/en not_active Abandoned
- 2006-04-13 WO PCT/EP2006/003410 patent/WO2006108654A2/en active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0327268A2 (en) * | 1988-02-04 | 1989-08-09 | AT&T Corp. | Interpolator for and method of interpolating digital samples |
WO2001052546A2 (en) * | 2000-01-10 | 2001-07-19 | Koninklijke Philips Electronics N.V. | Image interpolation and decimation using a continuously variable delay filter and combined with a polyphase filter |
US6510177B1 (en) * | 2000-03-24 | 2003-01-21 | Microsoft Corporation | System and method for layered video coding enhancement |
US20030156646A1 (en) * | 2001-12-17 | 2003-08-21 | Microsoft Corporation | Multi-resolution motion estimation and compensation |
US20050013369A1 (en) * | 2003-06-23 | 2005-01-20 | Tsu-Chang Lee | Method and apparatus for adaptive multiple-dimensional signal sequences encoding/decoding |
Non-Patent Citations (8)
Title |
---|
"Advanced video coding for generic audiovisual services" ITU-T RECOMMENDATION H.264, May 2003 (2003-05), pages 126-128, XP002394289 * |
CROCHIERE R E ET AL: "INTERPOLATION AND DECIMATION OF DIGITAL SIGNALS - A TUTORIAL REVIEW" PROCEEDINGS OF THE IEEE, IEEE. NEW YORK, US, vol. 69, no. 3, 1 March 1981 (1981-03-01), pages 300-331, XP000615159 ISSN: 0018-9219 * |
HENTSCHEL T ET AL: "CONTINUOUS-TIME DIGITAL FILTERS FOR SAMPLE-RATE CONVERSION IN RECONFIGURABLE RADIO TERMINALS ZEITKONTINUIERLICHE DIGITALFILTER ZUR ABTASTRATENWANDLUNG IN REKONFIGURIERBAREN FUNKENDGERAETEN" FREQUENZ, SCHIELE UND SCHON, BERLIN, DE, vol. 55, no. 5/6, 1 May 2001 (2001-05-01), pages 185-188, XP001019533 ISSN: 0016-1136 * |
KIMATA H ET AL: "3D motion vector coding with block base adaptive interpolation filter on h.264" 2003 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING. PROCEEDINGS. (ICASSP). HONG KONG, APRIL 6-10, 2003, vol. III, 6 April 2003 (2003-04-06), pages III.633-III.636, XP010639152 IEEE, US, NEW YORK, NY ISBN: 0-7803-7663-3 * |
See also references of EP1886502A2 * |
WEDI T ET AL: "MOTION- AND ALIASING-COMPENSATED PREDICTION FOR HYBRID VIDEO CODING" IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, IEEE SERVICE CENTER, PISCATAWAY, NJ, US, vol. 13, no. 7, July 2003 (2003-07), pages 577-586, XP001169883 ISSN: 1051-8215 * |
WEDI T: "Adaptive Interpolation Filter for H.26L. Document VCEG-N28 Filename VCEG-N28.doc generated 16.09.2001" ITU STUDY GROUP 16 - VIDEO CODING EXPERTS GROUP, 24 September 2001 (2001-09-24), pages 1-7, XP002398691 14th Meeting, Santa Barbara, CA, USA, 24-27 Sep., 2001 * |
XUDONG SONG ET AL: "A scalable hierarchical motion estimation algorithm for MPEG-2" CIRCUITS AND SYSTEMS, 1998. ISCAS '98. PROCEEDINGS OF THE 1998 IEEE INTERNATIONAL SYMPOSIUM ON MONTEREY, CA, USA 31 MAY-3 JUNE 1998, NEW YORK, NY, USA,IEEE, US, vol. 4, 31 May 1998 (1998-05-31), pages 126-129, XP010289485 ISBN: 0-7803-4455-3 * |
Cited By (117)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8208564B2 (en) | 2005-06-24 | 2012-06-26 | Ntt Docomo, Inc. | Method and apparatus for video encoding and decoding using adaptive interpolation |
WO2007002437A3 (en) * | 2005-06-24 | 2007-05-03 | Ntt Docomo Inc | Method and apparatus for video encoding and decoding using adaptive interpolation |
WO2007002437A2 (en) * | 2005-06-24 | 2007-01-04 | Ntt Docomo, Inc. | Method and apparatus for video encoding and decoding using adaptive interpolation |
EP2104358A4 (en) * | 2006-11-30 | 2016-04-27 | Ntt Docomo Inc | Dynamic image encoding device, dynamic image encoding method, dynamic image encoding program, dynamic image decoding device, dynamic image decoding method, and dynamic image decoding program |
EP2105031A4 (en) * | 2007-01-09 | 2011-06-29 | Ericsson Telefon Ab L M | Adaptive filter representation |
WO2008084378A3 (en) * | 2007-01-09 | 2008-10-23 | Nokia Corp | Adaptive interpolation filters for video coding |
WO2008084378A2 (en) * | 2007-01-09 | 2008-07-17 | Nokia Corporation | Adaptive interpolation filters for video coding |
US8509316B2 (en) | 2007-01-09 | 2013-08-13 | Core Wireless Licensing, S.a.r.l. | Adaptive interpolation filters for video coding |
US9769490B2 (en) | 2007-01-09 | 2017-09-19 | Core Wireless Licensing S.A.R.L. | Adaptive interpolation filters for video coding |
EP2105031A1 (en) * | 2007-01-09 | 2009-09-30 | Telefonaktiebolaget LM Ericsson (PUBL) | Adaptive filter representation |
US8942505B2 (en) | 2007-01-09 | 2015-01-27 | Telefonaktiebolaget L M Ericsson (Publ) | Adaptive filter representation |
WO2008085109A1 (en) | 2007-01-09 | 2008-07-17 | Telefonaktiebolaget Lm Ericsson (Publ) | Adaptive filter representation |
JP2010516082A (en) * | 2007-01-09 | 2010-05-13 | テレフオンアクチーボラゲット エル エム エリクソン(パブル) | Adaptive filter expression |
WO2008149327A2 (en) * | 2007-06-04 | 2008-12-11 | France Telecom | Method and apparatus for motion-compensated video signal prediction |
WO2008149327A3 (en) * | 2007-06-04 | 2009-02-12 | France Telecom | Method and apparatus for motion-compensated video signal prediction |
US8090031B2 (en) | 2007-10-05 | 2012-01-03 | Hong Kong Applied Science and Technology Research Institute Company Limited | Method for motion compensation |
US8687711B2 (en) | 2008-01-08 | 2014-04-01 | Telefonaktiebolaget Lm Ericsson (Publ) | Encoding filter coefficients |
US8638852B2 (en) | 2008-01-08 | 2014-01-28 | Qualcomm Incorporated | Video coding of filter coefficients based on horizontal and vertical symmetry |
WO2009087095A1 (en) * | 2008-01-08 | 2009-07-16 | Telefonaktiebolaget Lm Ericsson (Publ) | Encoding filter coefficients |
WO2009089373A2 (en) * | 2008-01-08 | 2009-07-16 | Qualcomm Incorporated | Video coding of filter coefficients based on horizontal and vertical symmetry |
RU2482616C2 (en) * | 2008-01-08 | 2013-05-20 | Квэлкомм Инкорпорейтед | Video coding of filter coefficients based on horizontal and vertical symmetry |
CN101939993B (en) * | 2008-01-08 | 2013-01-02 | 艾利森电话股份有限公司 | Encoding filter coefficients |
WO2009089373A3 (en) * | 2008-01-08 | 2011-06-30 | Qualcomm Incorporated | Video coding with compression of filter coefficients depending on horizontal and vertical symmetry of the filter tap matrix and the position of a filter tap relative to the central tap |
CN102017630B (en) * | 2008-04-10 | 2013-01-23 | 高通股份有限公司 | Symmetry for interpolation filtering of sub-pixel positions in video coding |
JP2014140192A (en) * | 2008-04-10 | 2014-07-31 | Qualcomm Incorporated | Rate-distortion defined interpolation for video coding based on fixed filter or adaptive filter |
US10440388B2 (en) * | 2008-04-10 | 2019-10-08 | Qualcomm Incorporated | Rate-distortion defined interpolation for video coding based on fixed filter or adaptive filter |
US9077971B2 (en) | 2008-04-10 | 2015-07-07 | Qualcomm Incorporated | Interpolation-like filtering of integer-pixel positions in video coding |
WO2009126928A1 (en) * | 2008-04-10 | 2009-10-15 | Qualcomm Incorporated | Symmetry for interpolation filtering of sub-pixel positions in video coding |
US20190028736A1 (en) * | 2008-04-10 | 2019-01-24 | Qualcomm Incorporated | Advanced interpolation techniques for motion compensation in video coding |
JP2011518508A (en) * | 2008-04-10 | 2011-06-23 | クゥアルコム・インコーポレイテッド | Interpolation filter support for sub-pixel resolution in video coding |
US8971412B2 (en) | 2008-04-10 | 2015-03-03 | Qualcomm Incorporated | Advanced interpolation techniques for motion compensation in video coding |
EP2816806A1 (en) * | 2008-04-10 | 2014-12-24 | Qualcomm Incorporated | Symmetry for interpolation filtering of sub-pixel positions in video coding |
RU2477577C2 (en) * | 2008-04-10 | 2013-03-10 | Квэлкомм Инкорпорейтед | Interpolation-like filtering of integer pixel positions in video coding |
RU2477576C2 (en) * | 2008-04-10 | 2013-03-10 | Квэлкомм Инкорпорейтед | Interpolation filter support for sub-pixel resolution in video coding |
RU2479941C2 (en) * | 2008-04-10 | 2013-04-20 | Квэлкомм Инкорпорейтед | Prediction techniques for interpolation in video coding |
JP2011517912A (en) * | 2008-04-10 | 2011-06-16 | クゥアルコム・インコーポレイテッド | Symmetry for interpolation filtering of sub-pixel positions in video coding |
US8831086B2 (en) | 2008-04-10 | 2014-09-09 | Qualcomm Incorporated | Prediction techniques for interpolation in video coding |
US8462842B2 (en) | 2008-04-10 | 2013-06-11 | Qualcomm, Incorporated | Symmetry for interpolation filtering of sub-pixel positions in video coding |
US9967590B2 (en) * | 2008-04-10 | 2018-05-08 | Qualcomm Incorporated | Rate-distortion defined interpolation for video coding based on fixed filter or adaptive filter |
JP2011517238A (en) * | 2008-04-10 | 2011-05-26 | クゥアルコム・インコーポレイテッド | Rate distortion defined interpolation for video coding based on fixed or adaptive filters |
CN101990760A (en) * | 2008-04-10 | 2011-03-23 | 高通股份有限公司 | Advanced interpolation techniques for motion compensation in video coding |
JP2013243739A (en) * | 2008-04-10 | 2013-12-05 | Qualcomm Inc | Advanced interpolation techniques for motion compensation in video coding |
US8804831B2 (en) | 2008-04-10 | 2014-08-12 | Qualcomm Incorporated | Offsets at sub-pixel resolution |
RU2505938C2 (en) * | 2008-04-10 | 2014-01-27 | Квэлкомм Инкорпорейтед | Distortion-based interpolation depending on transmission rate for video coding based on fixed filter or adaptive filter |
US8705622B2 (en) | 2008-04-10 | 2014-04-22 | Qualcomm Incorporated | Interpolation filter support for sub-pixel resolution in video coding |
US11683519B2 (en) | 2008-04-10 | 2023-06-20 | Qualcomm Incorporated | Rate-distortion defined interpolation for video coding based on fixed filter or adaptive filter |
JP2014057333A (en) * | 2008-04-10 | 2014-03-27 | Qualcomm Incorporated | Interpolation filter support for sub-pixel resolution in video coding |
US8811484B2 (en) | 2008-07-07 | 2014-08-19 | Qualcomm Incorporated | Video encoding by filter selection |
CN102905135A (en) * | 2008-07-09 | 2013-01-30 | 英特尔公司 | Video encoding techniques |
EP2144446A3 (en) * | 2008-07-09 | 2011-12-14 | Intel Corporation | Video encoding techniques |
US8625681B2 (en) | 2008-07-09 | 2014-01-07 | Intel Corporation | Rate-distortion cost reducing video encoding techniques |
US10123050B2 (en) | 2008-07-11 | 2018-11-06 | Qualcomm Incorporated | Filtering video data using a plurality of filters |
CN103546748A (en) * | 2008-07-11 | 2014-01-29 | 高通股份有限公司 | Filtering video data using a plurality of filters |
US11711548B2 (en) | 2008-07-11 | 2023-07-25 | Qualcomm Incorporated | Filtering video data using a plurality of filters |
CN103546748B (en) * | 2008-07-11 | 2017-09-15 | 高通股份有限公司 | Video data is filtered using multiple filters |
EP2157799A1 (en) | 2008-08-18 | 2010-02-24 | Panasonic Corporation | Interpolation filter with local adaptation based on block edges in the reference frame |
US9078007B2 (en) | 2008-10-03 | 2015-07-07 | Qualcomm Incorporated | Digital video coding with interpolation filters and offsets |
CN102172022B (en) * | 2008-10-03 | 2016-08-17 | 高通股份有限公司 | Use interpolation filter and the digital video transcoding of skew |
CN102172022A (en) * | 2008-10-03 | 2011-08-31 | 高通股份有限公司 | Digital video coding with interpolation filters and offsets |
WO2010083438A3 (en) * | 2009-01-15 | 2010-11-11 | Qualcomn Incorporated | Filter prediction based on activity metrics in video coding |
US9143803B2 (en) | 2009-01-15 | 2015-09-22 | Qualcomm Incorporated | Filter prediction based on activity metrics in video coding |
CN102369731A (en) * | 2009-01-15 | 2012-03-07 | 高通股份有限公司 | Filter prediction based on activity metrics in video coding |
CN102369731B (en) * | 2009-01-15 | 2015-03-18 | 高通股份有限公司 | Filter prediction based on activity metrics in video coding |
TWI463878B (en) * | 2009-02-19 | 2014-12-01 | Sony Corp | Image processing apparatus and method |
EP2237557A1 (en) * | 2009-04-03 | 2010-10-06 | Panasonic Corporation | Coding for filter coefficients |
EP2237558A1 (en) * | 2009-04-03 | 2010-10-06 | Panasonic Corporation | Coding for filter coefficients |
US9232236B2 (en) | 2009-04-03 | 2016-01-05 | Panasonic Intellectual Property Corporation Of America | Video coding method, video decoding method, video coding apparatus, and video decoding apparatus that use filters for filtering signals |
US8885730B2 (en) | 2009-06-10 | 2014-11-11 | Panasonic Corporation | Image coding method, image decoding method, and apparatuses therefor |
CN102204255A (en) * | 2009-07-07 | 2011-09-28 | 松下电器产业株式会社 | Moving picture decoding device, moving picture decoding method, moving picture decoding system, integrated circuit, and program |
US8811473B2 (en) | 2009-07-07 | 2014-08-19 | Panasonic Corporation | Moving picture decoding device, moving picture decoding method, moving picture decoding system, integrated circuit, and program |
US9414071B2 (en) | 2010-01-22 | 2016-08-09 | Samsung Electronics Co., Ltd. | Area-based encoding/decoding device and method |
US9386315B2 (en) | 2010-01-22 | 2016-07-05 | Samsung Electronics Co., Ltd. | Area-based encoding/decoding device and method |
US9374587B2 (en) | 2010-01-22 | 2016-06-21 | Samsung Electronics Co., Ltd. | Area-based encoding/decoding device and method |
US9386314B2 (en) | 2010-01-22 | 2016-07-05 | Samsung Electronics Co., Ltd. | Area-based encoding/decoding device and method |
EP2538673A4 (en) * | 2010-01-22 | 2015-12-23 | Samsung Electronics Co Ltd | Area-based encoding/decoding device and method |
EP2963928A1 (en) * | 2010-01-22 | 2016-01-06 | Samsung Electronics Co., Ltd | Apparatus and method for encoding and decoding based on region |
US10298945B2 (en) | 2010-09-30 | 2019-05-21 | Nippon Telegraph And Telephone Corporation | Video encoding method, video decoding method, video encoding apparatus, video decoding apparatus, and programs thereof |
EP2605516A4 (en) * | 2010-09-30 | 2014-05-14 | Nippon Telegraph & Telephone | Image encoding method, image decoding method, image encoding device, image decoding device and program therefor |
EP2605516A1 (en) * | 2010-09-30 | 2013-06-19 | Nippon Telegraph And Telephone Corporation | Image encoding method, image decoding method, image encoding device, image decoding device and program therefor |
CN103430545A (en) * | 2010-12-21 | 2013-12-04 | 英特尔公司 | Content adaptive motion compensation filtering for high efficiency video coding |
US9819936B2 (en) | 2011-02-23 | 2017-11-14 | Qualcomm Incorporated | Multi-metric filtering |
US8964852B2 (en) | 2011-02-23 | 2015-02-24 | Qualcomm Incorporated | Multi-metric filtering |
US9258563B2 (en) | 2011-02-23 | 2016-02-09 | Qualcomm Incorporated | Multi-metric filtering |
US8964853B2 (en) | 2011-02-23 | 2015-02-24 | Qualcomm Incorporated | Multi-metric filtering |
US8982960B2 (en) | 2011-02-23 | 2015-03-17 | Qualcomm Incorporated | Multi-metric filtering |
US8989261B2 (en) | 2011-02-23 | 2015-03-24 | Qualcomm Incorporated | Multi-metric filtering |
US9877023B2 (en) | 2011-02-23 | 2018-01-23 | Qualcomm Incorporated | Multi-metric filtering |
CN102655591B (en) * | 2011-03-04 | 2016-12-14 | Kddi株式会社 | Dynamic image encoding device, moving image decoding apparatus and dynamic image encoding method |
US8976864B2 (en) | 2011-03-04 | 2015-03-10 | Kddi Corporation | Video encoding apparatus, video encoding method, and computer program |
JP2012186573A (en) * | 2011-03-04 | 2012-09-27 | Kddi Corp | Moving image encoder, moving image encoding method, and program |
EA032859B1 (en) * | 2011-07-21 | 2019-07-31 | Лука Россато | Tiered signal decoding and signal reconstruction |
KR20140051344A (en) * | 2011-07-21 | 2014-04-30 | 루카 로사토 | Tiered signal decoding and signal reconstruction |
KR102165147B1 (en) * | 2011-07-21 | 2020-10-14 | 루카 로사토 | Tiered signal decoding and signal reconstruction |
US8948248B2 (en) | 2011-07-21 | 2015-02-03 | Luca Rossato | Tiered signal decoding and signal reconstruction |
CN108712646A (en) * | 2011-07-21 | 2018-10-26 | 卢卡·罗萨托 | Hierarchical signal decodes and signal reconstruction |
WO2013011492A3 (en) * | 2011-07-21 | 2013-05-30 | Luca Rossato | Tiered signal decoding and signal reconstruction |
CN108712646B (en) * | 2011-07-21 | 2022-12-06 | 威诺瓦国际有限公司 | Method, system and storage medium for layered signal decoding and signal reconstruction |
US9729893B2 (en) | 2011-11-08 | 2017-08-08 | Kt Corporation | Method and apparatus for encoding image, and method and apparatus for decoding image |
US9578338B1 (en) | 2011-11-08 | 2017-02-21 | Kt Corporation | Method and apparatus for encoding image, and method and apparatus for decoding image |
US9554140B1 (en) | 2011-11-08 | 2017-01-24 | Kt Corporation | Method and apparatus for encoding image, and method and apparatus for decoding image |
CN104067613A (en) * | 2011-11-08 | 2014-09-24 | 株式会社Kt | Method and apparatus for encoding image, and method and apparatus for decoding image |
JP5902814B2 (en) * | 2012-07-09 | 2016-04-13 | 日本電信電話株式会社 | Video encoding method and apparatus, video decoding method and apparatus, and programs thereof |
EP2901703A2 (en) * | 2012-09-28 | 2015-08-05 | VID SCALE, Inc. | Cross-plane filtering for chroma signal enhancement in video coding |
US11356708B2 (en) | 2012-09-28 | 2022-06-07 | Interdigital Madison Patent Holdings, Sas | Cross-plane filtering for chroma signal enhancement in video coding |
US10397616B2 (en) | 2012-09-28 | 2019-08-27 | Vid Scale, Inc. | Cross-plane filtering for chroma signal enhancement in video coding |
US10798423B2 (en) | 2012-09-28 | 2020-10-06 | Interdigital Madison Patent Holdings, Sas | Cross-plane filtering for chroma signal enhancement in video coding |
US10972728B2 (en) | 2015-04-17 | 2021-04-06 | Interdigital Madison Patent Holdings, Sas | Chroma enhancement filtering for high dynamic range video coding |
RU2684193C1 (en) * | 2015-05-21 | 2019-04-04 | Хуавэй Текнолоджиз Ко., Лтд. | Device and method for motion compensation in video content |
US10536716B2 (en) | 2015-05-21 | 2020-01-14 | Huawei Technologies Co., Ltd. | Apparatus and method for video motion compensation |
US11438605B2 (en) | 2015-07-08 | 2022-09-06 | Interdigital Madison Patent Holdings, Sas | Enhanced chroma coding using cross plane filtering |
US10887604B2 (en) | 2016-05-09 | 2021-01-05 | Qualcomm Incorporation | Signalling of filtering information |
CN109076228B (en) * | 2016-05-09 | 2022-05-24 | 高通股份有限公司 | Signalling of filtering information |
US10382766B2 (en) | 2016-05-09 | 2019-08-13 | Qualcomm Incorporated | Signalling of filtering information |
KR102465720B1 (en) | 2016-05-09 | 2022-11-10 | 퀄컴 인코포레이티드 | Signaling of filtering information |
KR20190006174A (en) * | 2016-05-09 | 2019-01-17 | 퀄컴 인코포레이티드 | Signaling of filtering information |
CN109076228A (en) * | 2016-05-09 | 2018-12-21 | 高通股份有限公司 | The signalling of filtering information |
WO2017196852A1 (en) * | 2016-05-09 | 2017-11-16 | Qualcomm Incorporated | Signalling of filtering information |
Also Published As
Publication number | Publication date |
---|---|
WO2006108654A3 (en) | 2007-05-10 |
US20090022220A1 (en) | 2009-01-22 |
JP2008536414A (en) | 2008-09-04 |
EP1886502A2 (en) | 2008-02-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2006108654A2 (en) | Method and apparatus for enhanced video coding | |
US11889065B2 (en) | Method of decoding motion vector | |
CN107959858B (en) | Video signal decoding method | |
US9516319B2 (en) | Method of deriving motion information | |
US9648343B2 (en) | Method of decoding video data | |
KR101403343B1 (en) | Method and apparatus for inter prediction encoding/decoding using sub-pixel motion estimation | |
US7535961B2 (en) | Video encoding/decoding apparatus and method for color image | |
US7840096B2 (en) | Directional interpolation method and video encoding/decoding apparatus and method using the directional interpolation method | |
US20150139317A1 (en) | Method and apparatus for encoding image, and method and apparatus for decoding image | |
JP5211240B2 (en) | Method for determining a filter for interpolating one or more pixels of a frame | |
US20110002554A1 (en) | Digital image compression by residual decimation | |
WO2010144408A1 (en) | Digital image compression by adaptive macroblock resolution coding | |
WO2012178178A2 (en) | Selection of phase offsets for interpolation filters for motion compensation | |
WO2011095583A2 (en) | Improved method and apparatus for sub-pixel interpolation |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 2008505817 Country of ref document: JP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWW | Wipo information: withdrawn in national office |
Country of ref document: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2006742578 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: RU |
|
WWW | Wipo information: withdrawn in national office |
Country of ref document: RU |
|
WWP | Wipo information: published in national office |
Ref document number: 2006742578 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 11911505 Country of ref document: US |