WO2018120230A1 - 图像滤波方法、装置以及设备 - Google Patents

图像滤波方法、装置以及设备 Download PDF

Info

Publication number
WO2018120230A1
WO2018120230A1 PCT/CN2016/113973 CN2016113973W WO2018120230A1 WO 2018120230 A1 WO2018120230 A1 WO 2018120230A1 CN 2016113973 W CN2016113973 W CN 2016113973W WO 2018120230 A1 WO2018120230 A1 WO 2018120230A1
Authority
WO
WIPO (PCT)
Prior art keywords
chrominance
image
filter
pixel
index
Prior art date
Application number
PCT/CN2016/113973
Other languages
English (en)
French (fr)
Inventor
安基程
郑建铧
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to CN201680088453.1A priority Critical patent/CN109565604A/zh
Priority to EP16925296.2A priority patent/EP3550842A4/en
Priority to PCT/CN2016/113973 priority patent/WO2018120230A1/zh
Publication of WO2018120230A1 publication Critical patent/WO2018120230A1/zh
Priority to US16/457,041 priority patent/US11146826B2/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/86Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/119Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/186Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H04N19/82Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop

Definitions

  • the present invention relates to the field of image processing, and in particular, to an image filtering method, apparatus, and device.
  • Digital video devices are now widely used, such as digital television, digital live broadcast systems, wireless broadcast systems, personal digital assistants (PDAs), laptop or desktop computers, digital cameras, digital recording devices, digital media playback. , video game devices, video game consoles, cellular or satellite radio phones, video conferencing devices, and the like.
  • Digital video devices typically compress video using video compression techniques based on a block-based hybrid video coding framework, such as MPEG-1/2 to the latest video coding standard H.265/HEVC, for more efficient transmission, reception, and storage. Digital video information.
  • the embodiment of the invention discloses an image filtering method, device and device, which can improve the filtering precision of the image, reduce the distortion rate of the image and reduce the code rate occupied by the transmission filter coefficient.
  • an image filtering method is provided.
  • the image to be processed includes a plurality of luma pixel blocks and a plurality of first chroma pixel blocks, and the luma pixel block includes a plurality of adjacent luma pixels.
  • the first chrominance pixel block includes a plurality of adjacent first chrominance pixel points, and the method includes: Obtaining a first index of the luma pixel block, where the first index represents a filter type to which an image property corresponding to the luma pixel block is applicable; acquiring a second index of the first chroma pixel block, the first a second index representing a filter type to which the image property corresponding to the first chroma pixel block is applied; filtering the corresponding pixel in the filter set using the first index for the luma pixel block; The one chroma pixel block performs the filtering using a filter corresponding to the second index in the filter set.
  • An advantageous effect of the embodiments of the present invention is that the filter used in filtering the first chrominance pixel block is often the filter used when filtering the luminance pixel block. Therefore, there is no need to additionally transmit the filter coefficients of the filter that filters the first chroma pixel block, reducing the code rate occupied by the filter coefficients of the transmission filter.
  • the method further includes: when the first index and the second index are the same, the filter corresponding to the first index and the filter corresponding to the second index the same.
  • the image to be processed further includes a plurality of second chrominance pixel blocks, and the second chrominance pixel block includes a plurality of adjacent second chrominance pixel points.
  • the method further includes: acquiring a third index of the second chrominance pixel block, where the third index represents the second chrominance pixel block corresponding to a filter type to which the image property is applied; correspondingly, after the filtering is performed on the first chrominance pixel block using the second index in a filter corresponding to the filter set, : performing the filtering on the second chrominance pixel block using a filter corresponding to the third index in the filter set.
  • An advantageous effect of the embodiment of the present invention is that after the filtering is performed on the plurality of first chrominance pixel blocks by using a filter corresponding to the second index, a target filter may be further determined for the second chrominance pixel block. And filtering the plurality of second chrominance pixel blocks by using the target filter, thereby further improving the filtering precision of the image and reducing the distortion rate of the image.
  • the acquiring the first cable of the luma pixel block includes: classifying the luma pixel block according to a first relationship, and obtaining the first index, where the first relationship includes a texture directivity and a change intensity of an image region corresponding to the luma pixel block.
  • the texture directivity and the change intensity of the image region corresponding to the luma pixel block are pre-predicted by the pixel position of the preset position in the luma pixel block and the luma pixel block.
  • the neighborhood pixel of the pixel at the position is obtained.
  • the acquiring the second index of the first chrominance pixel block includes: classifying the first chrominance pixel block according to a second relationship, obtaining the And a second index, where the second relationship includes a texture directivity and a change intensity of an image region corresponding to the first chroma pixel block.
  • a texture directionality and a change intensity of an image region corresponding to the first chrominance pixel block are determined by a pixel position and a preset position in the first chrominance pixel block.
  • the neighboring pixel points of the pixel points of the preset position in the first chroma pixel block are obtained.
  • the beneficial effects of the embodiments of the present invention are: the second index of each first chroma pixel block can be accurately calculated, and the corresponding first chroma pixel block is filtered by using a more suitable filter, thereby improving filtering. Precision.
  • the first index of the block is taken as the second index.
  • An advantageous effect of the embodiment of the present invention is that the first chrominance block pixel block itself does not have an index, but directly multiplexes the first index of the luma pixel block corresponding to the same image region, thereby reducing the encoder to transmit the index to the decoder.
  • the acquiring the third index of the second chrominance pixel block includes: classifying the second chrominance pixel block according to a third relationship, obtaining the a third index, the third relationship including texture directionality and change of an image region corresponding to the second chrominance pixel block strength.
  • a texture directionality and a change intensity of an image region corresponding to the second chrominance pixel block are determined by a pixel position and a preset position in the second chrominance pixel block.
  • the neighboring pixel points of the pixel points of the preset position in the second chroma pixel block are obtained.
  • the beneficial effects of the embodiments of the present invention are: the third index of each second chrominance pixel block can be accurately calculated, and the corresponding second chrominance pixel block is filtered by using a more suitable filter, thereby improving filtering. Precision.
  • the acquiring, by the third index of the second chrominance pixel block, the brightness pixel corresponding to the same image area as the second chrominance pixel block The first index of the block as the third index; or the second index of the first chrominance pixel block corresponding to the same image region as the second chrominance pixel block as the third index.
  • An advantageous effect of the embodiment of the present invention is that the second chrominance block pixel block itself does not have an index, but directly multiplexes the second index of the first chrominance pixel block corresponding to the same image area, thereby reducing the index transmission of the encoder.
  • the bit rate occupied by the decoder is not limited to the bit rate occupied by the decoder.
  • the method includes: at least two of the first relationship, the second relationship, and the third relationship being the same.
  • the beneficial effects of the embodiment of the present invention are: filtering the first chrominance pixel block and the second chrominance pixel block when the first correspondence relationship, the second correspondence relationship, and the third relationship are the same
  • the filter used at the time is often coincident with the filter used to filter the luma pixel block. Therefore, there is no need to additionally transmit the filter coefficients of the filters that filter the first chrominance pixel block and the second chrominance pixel block, reducing the code rate occupied by the filter coefficients of the transmission filter.
  • the method includes: the first relationship, the second relationship, and the third relationship are different from each other.
  • the method includes: a size of the first chrominance pixel block Greater than the size of the luma pixel block; the size of the second chroma pixel block is larger than the size of the luma pixel block.
  • the beneficial effects of the embodiments of the present invention are that different processing modes can be adopted according to different chrominance and brightness blocks including image details, thereby improving processing efficiency.
  • the method is used by a decoder, before the acquiring the first index of the luma pixel block, further comprising: parsing a code stream, acquiring the filter set information.
  • the method is used by an encoder, before the acquiring the first index of the luma pixel block, further comprising: selecting an encoding from a preset candidate filter set.
  • the lowest cost candidate filter set is used as the filter set; the information of the filter set is encoded.
  • the method before the acquiring the first index of the luma pixel block, the method further includes: dividing the luma pixel point of the to-be-processed image into multiple brightness controls according to the first structure Block, the brightness control block includes one or more adjacent blocks of the luma pixel; and one or more of the brightness control blocks in the image to be processed that need to perform the filtering.
  • the luma filtering identifier represents whether each of the luma control blocks in the image to be processed performs the filtering.
  • the beneficial effects of the embodiments of the present invention are: independently controlling the filtering of different regions of the image, and improving the applicability of the filtering method.
  • the splitting the luma pixel of the to-be-processed image into the plurality of luma control blocks according to the first structure including: pre-preserving the luma pixel of the to-be-processed image
  • the first initial partition is divided into one or more equal sizes; the first primary divided block is divided into a plurality of the brightness control blocks by performing quadtree or binary tree division.
  • the beneficial effects of the embodiments of the present invention are: making the division of the image area more flexible and more utilizing the area Domain filtering.
  • the method is used by a decoder, where the one or more of the brightness control blocks that need to perform the filtering in the image to be processed are determined, including: a decoding station The code stream is obtained, and the information of the brightness filter identifier is obtained.
  • the method is used by an encoder, where determining the one or more of the brightness control blocks in the image to be processed that need to perform the filtering, including: A candidate luma filtering identifier set with the smallest encoding cost is selected as the luma filtering identifier.
  • the method further includes: encoding the brightness filtering identifier information.
  • the method further includes: determining the image to be processed One or more of the first chrominance control blocks that are required to perform the filtering, the first chrominance control block including one or more adjacent first chrominance pixel blocks.
  • the first chrominance filter identifier represents whether each of the first chrominance control blocks in the image to be processed performs the filtering.
  • the beneficial effects of the embodiments of the present invention are: independently controlling the filtering of different regions of the image, and improving the applicability of the filtering method.
  • the method before the determining the one or more of the first chrominance control blocks that need to perform the filtering in the to-be-processed image, the method further includes: The first chrominance pixel of the processed image is divided into a plurality of the first chrominance control blocks according to the first structure; correspondingly, the determining one or more of the to-be-processed images that need to perform the filtering
  • the first chroma control block includes: obtaining the first chroma filter identifier according to the luma filter identifier mapping.
  • An advantageous effect of the embodiment of the present invention is that the division of the luminance pixel point and the first chrominance pixel point can be made easier. Moreover, the luma filter identifier of the luma control block and the first chroma filter identifier of the first chroma control block are associated, which can simplify the setting of the filter identifier, and can also reduce the encoder to transmit the filter identifier to the decoder. Code rate.
  • the method before the determining the one or more of the first chrominance control blocks that need to perform the filtering in the to-be-processed image, the method further includes: The first chrominance pixel of the processed image is divided into a plurality of the first chrominance control blocks in accordance with the second structure.
  • the beneficial effects of the embodiments of the present invention are as follows: according to the embodiment, different structures of the luminance pixel points and the first chrominance pixel points can be divided according to actual needs, thereby improving the degree of freedom of filtering control and improving the precision of filtering. Moreover, the brightness filter identifier of the brightness control block and the first chrominance filter flag of the first chrominance control block are respectively set independently, which can further improve the degree of freedom of the filter control and further improve the precision of the filter.
  • the dividing the first chrominance pixel of the to-be-processed image into the plurality of the first chrominance control blocks according to the second structure including: The first chrominance pixel of the processed image is divided into one or more second contiguous blocks of equal size according to a preset size; and the second preliminary block is divided into a plurality of quadtrees or binary trees, and divided into a plurality of The first chromaticity control block.
  • the method is for a decoder, the determining one or more of the first chrominance control blocks in the image to be processed that need to perform the filtering, including : Decoding the code stream to obtain information of the first chrominance filter identifier.
  • the method is for an encoder, the determining one or more of the first chrominance control blocks in the image to be processed that need to perform the filtering, including And selecting, from the preset candidate first chrominance filter identifier set, a candidate first chrominance filter identifier with the smallest coding cost as the first chrominance filter identifier.
  • the determining the image to be processed is required After performing the filtering of the one or more of the first chrominance control blocks, the method further includes: encoding the information of the first chrominance filter identifier.
  • the method further includes: determining the to-be-determined The one or more of the second chrominance control blocks in the image that require the filtering are processed, the second chrominance control block comprising one or more adjacent ones of the second chrominance pixel blocks.
  • the second chrominance filtering identifier represents whether each of the second chrominance control blocks in the to-be-processed image performs the filtering.
  • the second chrominance pixel of the image to be processed may also be Dividing into a plurality of second chrominance control blocks, and then determining one or more of the second chrominance control blocks in the image to be processed that need to perform the filtering to determine whether each second of the image to be processed
  • the chroma control block performs filtering to further improve the filtering precision of the image and reduce the distortion rate of the image.
  • the method before the determining the one or more of the second chrominance control blocks that need to perform the filtering in the to-be-processed image, the method further includes: The second chrominance pixel of the processed image is divided into a plurality of the second chrominance control blocks according to the first structure; correspondingly, the determining one or more of the to-be-processed images that need to perform the filtering
  • the second chrominance control block includes: obtaining the second chrominance filter identifier according to the brightness filter identifier mapping.
  • An advantageous effect of the embodiment of the present invention is that the division of the luminance pixel point and the second chrominance pixel point can be made easier. Moreover, the luma filter identifier of the luma control block and the second chroma filter flag of the second chroma control block are associated, which can simplify the setting of the filter identifier, and can also reduce the encoder to transmit the filter identifier to the decoder. Code rate.
  • the method before the determining the one or more of the second chrominance control blocks that need to perform the filtering in the to-be-processed image, the method further includes: deal with The second chrominance pixel of the image is divided into a plurality of the second chrominance control blocks according to the second structure; correspondingly, the determining one or more of the to-be-processed images that need to perform the filtering
  • the second chrominance control block includes: obtaining the second chrominance filter identifier according to the first chrominance filter identifier mapping.
  • An advantageous effect of the embodiments of the present invention is that the division of the first chrominance pixel point and the second chrominance pixel point can be made easier. Moreover, the first chroma filter identifier of the first chroma control block and the second chroma filter identifier of the second chroma control block are associated, which can simplify the setting of the filter identifier, and can also reduce the encoder to transmit the filter identifier. The code rate occupied by the decoder.
  • the method before the determining the one or more of the second chrominance control blocks that need to perform the filtering in the to-be-processed image, the method further includes: The second chrominance pixel of the processed image is divided into a plurality of the second chrominance control blocks in accordance with the third structure.
  • the dividing the second chrominance pixel of the to-be-processed image into the plurality of the second chrominance control blocks according to the third structure including: The second chrominance pixel of the processed image is divided into one or more equal-sized third primary blocks according to a preset size; and the third primary block is divided into a plurality of quadtrees or binary trees, and divided into a plurality of The second chromaticity control block.
  • the method is used in a decoder, where the determining one or more of the second chrominance control blocks in the image to be processed that need to perform the filtering, including : Decoding the code stream to obtain information of the second chrominance filter identifier.
  • the method is used by an encoder, where the determining one or more of the second chrominance control blocks in the image to be processed that need to perform the filtering, including And selecting, from the preset candidate second chrominance filter identifier set, a candidate second chrominance filter identifier with the smallest coding cost as the second chrominance filter identifier.
  • the method further includes: encoding the The information identified by the two-chrominance filter.
  • the method includes: at least two of the first structure, the second structure, and the third structure are the same.
  • the first structure, the second structure, and the third structure are different from each other.
  • an image filtering apparatus in a second aspect of the embodiments of the present invention, is provided.
  • the image to be processed includes a plurality of luma pixel blocks and a plurality of first chroma pixel blocks, and the luma pixel block includes a plurality of adjacent luma pixels.
  • the first chrominance pixel block includes a plurality of adjacent first chrominance pixel points
  • the device includes: an acquiring module, configured to acquire a first index of the luma pixel block, where the first index represents a filter type to which the image property corresponding to the luma pixel block is applied; the obtaining module is further configured to acquire a second index of the first chroma pixel block, where the second index represents the first chroma pixel a filter type to which the image property of the block is applied; a filtering module, configured to filter the corresponding pixel in the filter set by using the first index; and the filtering module is further used to The first chrominance pixel block performs the filtering using a filter corresponding to the second index in the filter set.
  • the method further includes: when the first index and the second index are the same, the filter corresponding to the first index and the filter corresponding to the second index the same.
  • the image to be processed further includes a plurality of second chrominance pixel blocks, and the second chrominance pixel block includes a plurality of adjacent second chrominance pixel points.
  • the acquiring module is further configured to: acquire a third index of the second chrominance pixel block, where the third index represents a filter type applicable to an image property corresponding to the second chrominance pixel block;
  • the filtering module is further configured to: perform the filtering on the second chrominance pixel block by using a filter corresponding to the third index in the filter set.
  • the acquiring module is specifically configured to: according to the first And correlating the luma pixel block to obtain the first index, where the first relationship includes texture directivity and change intensity of an image region corresponding to the luma pixel block.
  • the texture directivity and the change intensity of the image region corresponding to the luma pixel block are pre-predicted by the pixel position of the preset position in the luma pixel block and the luma pixel block.
  • the neighborhood pixel of the pixel at the position is obtained.
  • the acquiring module is specifically configured to: classify the first chrominance pixel block according to a second relationship, obtain the second index, where the second relationship includes The texture directivity and the intensity of change of the image region corresponding to the first chroma pixel block are described.
  • a texture directionality and a change intensity of an image region corresponding to the first chrominance pixel block are determined by a pixel position and a preset position in the first chrominance pixel block.
  • the neighboring pixel points of the pixel points of the preset position in the first chroma pixel block are obtained.
  • the acquiring module is specifically configured to: use the first index of the luma pixel block corresponding to the same image region as the first chroma pixel block as the The second index.
  • the acquiring module is specifically configured to: classify the second chrominance pixel block according to a third relationship, and obtain the third index, where the third relationship includes The texture directivity and the intensity of change of the image region corresponding to the second chroma pixel block are described.
  • the texture directivity and the change intensity of the image region corresponding to the second chrominance pixel block are determined by the pixel position and location of the preset position in the second chrominance pixel block.
  • the neighboring pixel points of the pixel points of the preset position in the second chroma pixel block are obtained.
  • the acquiring module is specifically configured to: use the first index of the luma pixel block that corresponds to the same image area as the second chroma pixel block as a third index; or, the second index of the first chrominance pixel block corresponding to the same image region as the second chrominance pixel block is used as the third index.
  • the method includes: at least two of the first relationship, the second relationship, and the third relationship being the same.
  • the method includes: the first relationship, the second relationship, and the third relationship are different from each other.
  • the method includes: a size of the first chroma pixel block is larger than a size of the luma pixel block; and a size of the second chroma pixel block is larger than the luma pixel block size of.
  • the apparatus is used in a decoder, and the apparatus further includes a decoding module, configured to: parse the code stream, and acquire information of the filter set.
  • the apparatus is used by an encoder, where the apparatus further includes an encoding module, configured to: select, from a preset candidate filter set, a candidate filter set with a minimum coding cost As the set of filters; encoding information of the set of filters.
  • the device further includes: a dividing module, configured to divide the luminance pixel of the to-be-processed image into a plurality of brightness control blocks according to the first structure, the brightness control block Include one or more adjacent blocks of the luma pixel; an identification module, configured to determine one or more of the brightness control blocks in the image to be processed that need to perform the filtering.
  • a dividing module configured to divide the luminance pixel of the to-be-processed image into a plurality of brightness control blocks according to the first structure, the brightness control block Include one or more adjacent blocks of the luma pixel
  • an identification module configured to determine one or more of the brightness control blocks in the image to be processed that need to perform the filtering.
  • the identifier module is specifically configured to determine a brightness filter identifier, where the brightness filter identifier represents whether each of the brightness control blocks in the image to be processed performs Filtering.
  • the dividing module is specifically configured to: divide a luminance pixel point of the to-be-processed image into one or more first-sized first-division blocks according to a preset size; Performing a quadtree or binary tree partitioning on the first initial partition, and dividing into a plurality of the brightness control blocks.
  • the device is used by a decoder, and the decoding module is further configured to: decode the code stream, and obtain information about the brightness filtering identifier.
  • the apparatus is used by an encoder, where the encoding module is further configured to: select, from a preset candidate luma filtering identifier set, a candidate luma filtering identifier with a minimum encoding cost as the The brightness filtering identifier is described.
  • the encoding module is further configured to: encode information of the luma filtering identifier.
  • the identifying module is further configured to: determine, in the to-be-processed image, the one or more of the first chrominance control blocks that need to perform the filtering, the first The chrominance control block includes one or more adjacent first chrominance pixel blocks.
  • the identifier module is specifically configured to determine a first chroma filter identifier, where the first chroma filter identifier represents each of the to-be-processed images. Whether a chroma control block performs the filtering, respectively.
  • the dividing module is further configured to: divide the first chrominance pixel of the image to be processed into the plurality of the first chromaticity control according to the first structure
  • the identifier module is further configured to: obtain the first chroma filter identifier according to the lube filtering identifier mapping.
  • the dividing module is further configured to divide the first chrominance pixel of the to-be-processed image into a plurality of the first chrominance control blocks according to a second structure.
  • the dividing module is further configured to: divide the first chrominance pixel of the to-be-processed image into two or more equal-sized seconds according to a preset size. An initial block; performing a quadtree or binary tree partitioning on the second preliminary block, and dividing into a plurality of the first chrominance control blocks.
  • the apparatus is used by a decoder, and the decoding module is further configured to: decode the code stream to obtain information of the first chroma filter identifier.
  • the apparatus is for an encoder, the coding mode
  • the block is further configured to: select, from the preset candidate first chrominance filter identifier set, a candidate first chrominance filter identifier with the smallest coding cost as the first chrominance filter identifier.
  • the encoding module is further configured to: encode information of the first chroma filter identifier.
  • the identifying module is further configured to: determine, in the to-be-processed image, the one or more of the second chrominance control blocks that need to perform the filtering
  • the dichroic control block includes one or more adjacent blocks of the second chrominance pixel.
  • the identifier module is specifically configured to determine a second chroma filter identifier, where the second chroma filter identifier represents each of the to-be-processed images. Whether the two chrominance control blocks respectively perform the filtering.
  • the dividing module is further configured to: divide the second chrominance pixel of the to-be-processed image into the plurality of the second chromaticity control according to the first structure
  • the identifier module is further configured to: obtain the second chroma filter identifier according to the lube filtering identifier mapping.
  • the dividing module is further configured to: divide the second chrominance pixel of the image to be processed into the plurality of the second chromaticity control according to the second structure
  • the identifier module is further configured to: obtain the second chroma filter identifier according to the first chroma filter identifier mapping.
  • the dividing module is further configured to divide the second chrominance pixel of the to-be-processed image into a plurality of the second chrominance control blocks according to a third structure.
  • the dividing module is further configured to: divide the second chrominance pixel of the to-be-processed image into one or more equal-sized thirds according to a preset size. An initial block; performing a quadtree or binary tree partitioning on the third preliminary block, and dividing into a plurality of the second chrominance control blocks.
  • the apparatus is used by a decoder, and the decoding module is further configured to: decode the code stream to obtain information of the second chroma filter identifier.
  • the apparatus is used by an encoder, where the encoding module is further configured to: select, from a preset candidate second chrominance filter identifier set, a candidate second with the lowest coding cost A chroma filter identifier is used as the second chroma filter identifier.
  • the encoding module is further configured to: encode information of the second chroma filter identifier.
  • the method includes: at least two of the first structure, the second structure, and the third structure are the same.
  • the method includes: the first structure, the second structure, and the third structure are different from each other.
  • an image filtering method is provided.
  • the image to be processed includes a plurality of luma pixel blocks and a plurality of first chroma pixel blocks, and the luma pixel block includes a plurality of adjacent luma pixels.
  • the first chrominance pixel block includes a plurality of adjacent first chrominance pixel points
  • the method includes: acquiring a first index of the luma pixel block, where the first index represents the luma pixel block corresponding to a filter type to which the image property is applied; obtaining a second index of the first chrominance pixel block, the second index representing a filter type to which the image property corresponding to the first chrominance pixel block is applicable;
  • the luma pixel block is filtered by a corresponding filter in the filter set using the first index; and the corresponding filter is performed on the first chroma pixel block using the second index in the filter set The filtering.
  • the method further includes: when the first index and the second index are the same, the filter corresponding to the first index and the filter corresponding to the second index the same.
  • the image to be processed further includes a plurality of second colors
  • the second chrominance pixel block includes a plurality of adjacent second chrominance pixel points.
  • the method further includes: acquiring the a third index of the dichroic pixel block, the third index representing a filter type to which the image property corresponding to the second chroma pixel block is applicable; correspondingly, in the pair of the first chroma pixel block
  • After performing the filtering by using the second index in a corresponding filter in the filter set further comprising: using the third index in the second chrominance pixel block, corresponding to the filter set The filter performs the filtering.
  • the acquiring the first index of the luma pixel block includes: classifying the luma pixel block according to a first relationship, obtaining the first index, where A relationship includes texture directivity and intensity of change of an image region corresponding to the luma pixel block.
  • the texture directivity and the change intensity of the image region corresponding to the luma pixel block are pre-predicted by the pixel position of the preset position in the luma pixel block and the luma pixel block.
  • the neighborhood pixel of the pixel at the position is obtained.
  • the acquiring the second index of the first chrominance pixel block includes: classifying the first chrominance pixel block according to a second relationship, obtaining the And a second index, where the second relationship includes a texture directivity and a change intensity of an image region corresponding to the first chroma pixel block.
  • a texture directionality and a change intensity of an image region corresponding to the first chrominance pixel block are determined by a pixel position and a preset position in the first chrominance pixel block.
  • the neighboring pixel points of the pixel points of the preset position in the first chroma pixel block are obtained.
  • the first index of the block is taken as the second index.
  • the acquiring the third index of the second chrominance pixel block includes: classifying the second chrominance pixel block according to a third relationship, obtaining the Three indexes,
  • the third relationship includes texture directivity and change intensity of an image region corresponding to the second chrominance pixel block.
  • a texture directionality and a change intensity of an image region corresponding to the second chrominance pixel block are determined by a pixel position and a preset position in the second chrominance pixel block.
  • the neighboring pixel points of the pixel points of the preset position in the second chroma pixel block are obtained.
  • the acquiring, by the third index of the second chrominance pixel block, the luminance pixel corresponding to the same image region as the second chrominance pixel block The first index of the block as the third index; or the second index of the first chrominance pixel block corresponding to the same image region as the second chrominance pixel block as the third index.
  • the method includes: at least two of the first relationship, the second relationship, and the third relationship being the same.
  • the method includes: the first relationship, the second relationship, and the third relationship are different from each other.
  • the method includes: a size of the first chroma pixel block is larger than a size of the luma pixel block; and a size of the second chroma pixel block is larger than the luma pixel block size of.
  • the method is used by a decoder, before the acquiring the first index of the luma pixel block, further comprising: parsing a code stream, acquiring the filter set information.
  • the method is used by an encoder, before the acquiring the first index of the luma pixel block, further comprising: selecting an encoding from a preset candidate filter set.
  • the lowest cost candidate filter set is used as the filter set; the information of the filter set is encoded.
  • a fourth aspect of the embodiments of the present invention provides a method for image filtering, comprising: dividing a luminance pixel of an image to be processed into a plurality of luminance control blocks according to a first structure, the luminance control block including one or more phases a neighboring luma pixel; determining a luma filtering identifier of the image to be processed, the luma filtering flag representing whether to perform the filtering on each of the luma control blocks in the image to be processed.
  • the dividing the brightness pixel point of the image to be processed into the plurality of brightness control blocks according to the first structure comprising: presetting the brightness pixel point of the image to be processed
  • the first initial partition is divided into one or more equal sizes; the first primary divided block is divided into a plurality of the brightness control blocks by performing quadtree or binary tree division.
  • the method is used by a decoder, where determining the luma filtering identifier of the to-be-processed image includes: decoding the code stream to obtain information about the luma filtering identifier .
  • the method is used by an encoder, where determining the luma filtering identifier of the to-be-processed image comprises: selecting, from a preset candidate luma filtering identifier set, a coding cost minimum The candidate luma filter identifier is used as the luma filter identifier.
  • the method further includes: encoding the information of the luma filtering identifier.
  • the method further includes: determining a first chroma filtering identifier of the to-be-processed image, the first color The degree filter identifier represents whether the filtering is performed on each of the first chrominance control blocks in the image to be processed, the first chrominance control block including one or more adjacent first chrominance pixel points.
  • the method before the determining the first chrominance filter identifier of the image to be processed, the method further includes: following the first chrominance pixel point of the image to be processed
  • the first structure is divided into a plurality of the first chrominance control blocks; correspondingly, the determining the image to be processed
  • the first chroma filtering identifier includes: obtaining the first chroma filtering identifier according to the luma filtering identifier mapping.
  • the method before the determining the first chroma filter identifier of the to-be-processed image, the method further includes: according to the second chroma pixel of the to-be-processed image, according to the second The structure is divided into a plurality of said first chrominance control blocks.
  • the dividing the first chrominance pixel of the to-be-processed image into the plurality of the first chrominance control blocks according to the second structure including: The first chrominance pixel of the processed image is divided into one or more second contiguous blocks of equal size according to a preset size; and the second preliminary block is divided into a plurality of quadtrees or binary trees, and divided into a plurality of The first chromaticity control block.
  • the method is used by a decoder, where determining the first chroma filter identifier of the to-be-processed image includes: decoding the code stream, obtaining the first The information identified by the chroma filter.
  • the method is used by an encoder, where determining the first chroma filter identifier of the to-be-processed image includes: filtering a set of identifiers from a preset candidate first chroma filter The candidate first chrominance filter identifier with the smallest coding cost is selected as the first chrominance filter identifier.
  • the method further includes: encoding information of the first chroma filter identifier.
  • the method further includes: determining a second chroma filter identifier of the to-be-processed image, The second chrominance filter identifier represents whether to perform the filtering on each of the second chrominance control blocks in the image to be processed, the second chrominance control block including one or more adjacent ones of the second Chroma pixels.
  • the method before the determining the second chrominance filter identifier of the image to be processed, the method further includes: following the second chrominance pixel point of the image to be processed Place
  • the first structure is divided into a plurality of the second chrominance control blocks; correspondingly, the determining the second chrominance filter identifier of the image to be processed includes: obtaining the second color according to the brightness filter identifier mapping Degree filter identification.
  • the method before the determining the second chrominance filter identifier of the image to be processed, the method further includes: following the second chrominance pixel point of the image to be processed
  • the second structure is divided into a plurality of the second chrominance control blocks; correspondingly, the determining the second chrominance filter identifier of the to-be-processed image comprises: obtaining the first according to the first chrominance filter identifier mapping Two-chrominance filter identification.
  • the method before the determining the second chrominance filter identifier of the to-be-processed image, the method further includes: following the second chrominance pixel point of the image to be processed according to the third The structure is divided into a plurality of said second chrominance control blocks.
  • the dividing the second chrominance pixel of the to-be-processed image into the plurality of the second chrominance control blocks according to the third structure including: The second chrominance pixel of the processed image is divided into one or more equal-sized third primary blocks according to a preset size; and the third primary block is divided into a plurality of quadtrees or binary trees, and divided into a plurality of The second chromaticity control block.
  • the method is used by a decoder, where determining the second chroma filter identifier of the to-be-processed image includes: decoding the code stream, obtaining the second The information identified by the chroma filter.
  • the method is used by an encoder, where determining the second chroma filter identifier of the to-be-processed image includes: filtering a set of identifiers from a preset candidate second chroma filter The candidate second chrominance filter identifier with the smallest coding cost is selected as the second chrominance filter identifier.
  • the method further includes: encoding information of the second chroma filter identifier.
  • the method includes: the first structure, the second node At least two of the third structure are identical.
  • the method includes: the first structure, the second structure, and the third structure are different from each other.
  • an image filtering method is provided.
  • the image to be processed includes a plurality of luma pixel blocks and a plurality of first chroma pixel blocks, and the luma pixel block includes a plurality of adjacent luma pixels.
  • the first chrominance pixel block includes a plurality of adjacent first chrominance pixel points, the method comprising: determining a filter set corresponding to the image to be processed, the filter set including one or more filters The one or more filters have respective filter indices; determining a first index of each of the plurality of luma pixel blocks, the first index representing a portion of the luma pixel block in the first category a class, the first index and the filter index have a first correspondence; determining a second index of each of the plurality of first chrominance pixel blocks, the second index representing the first chrominance pixel block The second index and the filter index have a second correspondence, the first correspondence and the second correspondence are the same; and the first index is used.
  • filter Is the plurality of filtering luminance pixel blocks; using the second index corresponding to the plurality of first filter block of the chroma pixel filtering.
  • the image to be processed further includes a plurality of second chrominance pixel blocks, and the second chrominance pixel block includes a plurality of adjacent second chrominance pixel points.
  • the method further includes: performing, by using a target filter, the plurality of second chrominance pixel blocks Filtering.
  • An advantageous effect of the embodiment of the present invention is that after the filtering is performed on the plurality of first chrominance pixel blocks by using a filter corresponding to the second index, a target filter may be further determined for the second chrominance pixel block. And filtering the plurality of second chrominance pixel blocks by using the target filter, thereby further improving the filtering precision of the image and reducing the distortion rate of the image.
  • the method before the performing the filtering on the plurality of second chrominance pixel blocks by using the target filter, the method further includes: combining each of the second chrominances A pixel block corresponds to a filter corresponding to a second index of the first chrominance pixel block of the same image region as the target filter.
  • An advantageous effect of the embodiment of the present invention is that the second chrominance block pixel block itself does not have an index, but directly multiplexes the second index of the first chrominance pixel block corresponding to the same image area, thereby reducing the index transmission of the encoder.
  • the bit rate occupied by the decoder is not limited to the bit rate occupied by the decoder.
  • the method before the performing the filtering on the plurality of second chrominance pixel blocks by using the target filter, the method further includes: determining the plurality of second chrominance pixels a third index of each of the blocks, the third index representing a category to which the second chrominance pixel block belongs in the third category, the third index and the filter index having a third correspondence,
  • the first correspondence relationship is the same as the third correspondence relationship
  • the target filter is a filter corresponding to the third index.
  • the beneficial effects of the embodiments of the present invention are: the third index of each second chrominance pixel block can be accurately calculated, and the corresponding second chrominance pixel block is filtered by using a more suitable filter, thereby improving filtering. Precision.
  • the method is used by a decoder, where determining the filter set corresponding to the to-be-processed image includes: decoding a code stream, where the code stream includes the filter The first information of the set; determining the set of filters based on the first information.
  • the method is used by an encoder, where determining the filter set corresponding to the to-be-processed image includes: selecting candidates in the plurality of preset filter sets In the second information, the candidate second information having the smallest coding cost is selected as the second information of the filter set; and the filter set is determined according to the second information.
  • the determining the first index of each of the plurality of luma pixel blocks includes: determining, according to the first relationship, a first index of each luma pixel block, The first relationship is determined according to a pixel point of a preset position in the luma pixel block and a neighboring pixel point of a pixel point of a preset position in the luma pixel block.
  • the method includes: the first relationship represents a texture directivity and a change strength of an image region corresponding to the luma pixel block.
  • the first index and the filter index have a first correspondence, including: each of the first index and one of the filter indexes are equal;
  • the second index and the filter index have a second correspondence, and the first correspondence and the second correspondence are the same, including: each of the second index and one of the filter indexes are equal .
  • the determining the second index of each of the plurality of first chroma pixel blocks includes: determining each of the first chroma pixel blocks according to the second relationship a second index, the second relationship being determined according to a pixel point of a preset position in the first chrominance pixel block and a neighboring pixel point of a pixel point of a preset position in the first chrominance pixel block.
  • the beneficial effects of the embodiments of the present invention are: the second index of each first chroma pixel block can be accurately calculated, and the corresponding first chroma pixel block is filtered by using a more suitable filter, thereby improving filtering. Precision.
  • the method includes: the second relationship represents a texture directivity and a change strength of an image region corresponding to the first chroma pixel block.
  • the first index of the luma pixel block is used as the second index.
  • the beneficial effects of the embodiment of the present invention are that the calculation amount generated by calculating the second index can be avoided, the calculation load of the digital video device is reduced, and the processing speed is improved.
  • the determining the third index of each of the plurality of second chroma pixel blocks includes: determining each of the second chroma pixel blocks according to the third relationship Third And indexing, the third relationship is determined according to a pixel point of the preset position in the second chroma pixel block and a neighboring pixel point of the pixel position of the preset position in the second chroma pixel block.
  • the beneficial effects of the embodiments of the present invention are: the third index of each second chrominance pixel block can be accurately calculated, and the corresponding second chrominance pixel block is filtered by using a more suitable filter, thereby improving filtering. Precision.
  • the method includes: the third relationship represents a texture directivity and a change strength of an image region corresponding to the second chroma pixel block.
  • the determining, by the third index of each of the plurality of second chrominance pixel blocks, the location of the same image region that corresponds to the second chrominance pixel block The first index of the luma pixel block is referred to as the third index; or the second index of the first chroma pixel block corresponding to the same image region as the second chroma pixel block is used as The third index.
  • the beneficial effects of the embodiment of the present invention are that the calculation amount generated by the third index can be avoided, the calculation load of the digital video device is reduced, and the processing speed is improved.
  • the method includes: at least two of the first relationship, the second relationship, and the third relationship being the same.
  • the beneficial effects of the embodiment of the present invention are: filtering the first chrominance pixel block and the second chrominance pixel block when the first correspondence relationship, the second correspondence relationship, and the third relationship are the same
  • the filter used at the time is often coincident with the filter used to filter the luma pixel block. Therefore, there is no need to additionally transmit the filter coefficients of the filters that filter the first chrominance pixel block and the second chrominance pixel block, reducing the code rate occupied by the filter coefficients of the transmission filter.
  • the method includes: the first relationship, the second relationship, and the third relationship are different from each other.
  • the method includes: a size of the first chroma pixel block is larger than a size of the luma pixel block; and a size of the second chroma pixel block is larger than the luma pixel block size of.
  • the beneficial effects of the embodiments of the present invention are that different processing modes can be adopted according to different chrominance and brightness blocks including image details, thereby improving processing efficiency.
  • the method before the filtering, using the filter corresponding to the first index, to filter the plurality of luma pixel blocks, the method further includes: using the luma pixel of the to-be-processed image
  • the point is divided into a plurality of brightness control blocks according to the first structure, the brightness control block includes one or more adjacent brightness pixel points; and a brightness filter identifier of the image to be processed is determined, and the brightness filter flag represents whether Each of the brightness control blocks in the image to be processed performs the filtering, respectively.
  • the beneficial effects of the embodiments of the present invention are: independently controlling the filtering of different regions of the image, and improving the applicability of the filtering method.
  • the dividing the brightness pixel of the to-be-processed image into the plurality of brightness control blocks according to the first structure comprising: pressing the brightness pixel point of the image to be processed according to a preset The size is divided into one or more equal-sized first initial partitions; the first primary divided block is divided into a plurality of the brightness control blocks by performing quadtree or binary tree division.
  • the beneficial effects of the embodiments of the present invention are: making the division of the image area more flexible, and more utilizing the regional filtering.
  • the method is used by a decoder, where determining the luma filtering identifier of the to-be-processed image comprises: decoding the code stream to obtain the luma filtering identifier.
  • the method is used by an encoder, where determining the luma filtering identifier of the to-be-processed image includes: selecting, in a plurality of preset candidate luma filtering identifiers, encoding One of the candidate luminance filtering identifiers that is the least cost is used as the luminance filtering identifier of the image to be processed.
  • the method further includes: determining a first chroma filtering identifier of the to-be-processed image, where the first The chroma filtering flag represents whether the filtering is performed on each of the first chroma control blocks in the image to be processed, the first chroma control block including one or more adjacent first chromas pixel.
  • the beneficial effects of the embodiments of the present invention are: independently controlling the filtering of different regions of the image, and improving the applicability of the filtering method.
  • the method before the determining the first chroma filter identifier of the image to be processed, the method further includes: following the first chroma pixel of the image to be processed
  • the first structure is divided into a plurality of the first chrominance control blocks; correspondingly, the determining the first chrominance filter identifier of the image to be processed includes: obtaining the first chromaticity according to the brightness filtering identifier mapping Filter identification.
  • An advantageous effect of the embodiment of the present invention is that the division of the luminance pixel point and the first chrominance pixel point can be made easier. Moreover, the luma filter identifier of the luma control block and the first chroma filter identifier of the first chroma control block are associated, which can simplify the setting of the filter identifier, and can also reduce the encoder to transmit the filter identifier to the decoder. Code rate.
  • the method before the determining the first chrominance filter identifier of the to-be-processed image, the method further includes: following the second chrominance pixel point of the image to be processed according to the second The structure is divided into a plurality of said first chrominance control blocks.
  • the beneficial effects of the embodiments of the present invention are as follows: according to the embodiment, different structures of the luminance pixel points and the first chrominance pixel points can be divided according to actual needs, thereby improving the degree of freedom of filtering control and improving the precision of filtering. Moreover, the brightness filter identifier of the brightness control block and the first chrominance filter flag of the first chrominance control block are respectively set independently, which can further improve the degree of freedom of the filter control and further improve the precision of the filter.
  • the dividing the first chrominance pixel of the image to be processed into the plurality of the first chrominance control blocks according to the second structure comprising: The first chrominance pixel of the image is divided into one or more equal-sized second preliminary blocks according to a preset size; The second initial block performs quadtree or binary tree partitioning and is divided into a plurality of the first chrominance control blocks.
  • the method is used by a decoder, where determining the first chroma filter identifier of the to-be-processed image includes: decoding the code stream, obtaining the first Chroma filter identification.
  • the method is used by an encoder, where determining the first chroma filtering identifier of the to-be-processed image includes: selecting, in a plurality of preset candidate first chromas In the filtering identifier, one candidate first chrominance filter identifier with the smallest coding cost is selected as the first chrominance filter identifier of the to-be-processed image.
  • the method further includes: determining a second chroma filter identifier of the to-be-processed image, The second chrominance filter identifier represents whether to perform the filtering on each of the second chrominance control blocks in the image to be processed, the second chrominance control block including one or more adjacent ones of the second Chroma pixels.
  • An advantageous effect of the embodiment of the present invention is that, after determining the first chroma filter identifier of the image to be processed, the second chroma pixel of the image to be processed may be further divided into a plurality of second chroma control blocks, and then And determining a second chroma filter identifier of the image to be processed to determine whether to filter each second chroma control block of the image to be processed, thereby further improving the filtering precision of the image and reducing the distortion rate of the image.
  • the method before the determining the second chrominance filter identifier of the image to be processed, the method further includes: following the second chrominance pixel point of the image to be processed
  • the first structure is divided into a plurality of the second chrominance control blocks; correspondingly, the determining the second chrominance filter identifier of the image to be processed includes: obtaining the second chromaticity according to the brightness filter identifier mapping Filter identification.
  • An advantageous effect of the embodiment of the present invention is that the pair of luminance pixels and the second chrominance pixels can be made The division is easier to implement. Moreover, the luma filter identifier of the luma control block and the second chroma filter flag of the second chroma control block are associated, which can simplify the setting of the filter identifier, and can also reduce the encoder to transmit the filter identifier to the decoder. Code rate.
  • the method before the determining the second chrominance filter identifier of the image to be processed, the method further includes: following the second chrominance pixel point of the image to be processed
  • the second structure is divided into a plurality of the second chrominance control blocks; correspondingly, the determining the second chrominance filter identifier of the to-be-processed image comprises: obtaining the first according to the first chrominance filter identifier mapping Two-chrominance filter identification.
  • An advantageous effect of the embodiments of the present invention is that the division of the first chrominance pixel point and the second chrominance pixel point can be made easier. Moreover, the first chroma filter identifier of the first chroma control block and the second chroma filter identifier of the second chroma control block are associated, which can simplify the setting of the filter identifier, and can also reduce the encoder to transmit the filter identifier. The code rate occupied by the decoder.
  • the method before the determining the second chrominance filter identifier of the to-be-processed image, the method further includes: following the second chrominance pixel point of the image to be processed according to the third The structure is divided into a plurality of said second chrominance control blocks.
  • the dividing the second chrominance pixel of the image to be processed into the plurality of the second chrominance control blocks according to the third structure comprising: The second chrominance pixel of the image is divided into one or more equal-sized third preliminary blocks according to a preset size; and the third primary block is divided into a plurality of the first block by a quadtree or a binary tree. Two-color control block.
  • the method is used by a decoder, where determining the second chroma filter identifier of the to-be-processed image includes: decoding the code stream, obtaining the second Chroma filter identification.
  • the method is used by an encoder, where determining the second chroma filter identifier of the to-be-processed image includes: selecting, in a plurality of preset candidate second chromas Filter mark In the identification, one candidate second chrominance filter identifier with the smallest coding cost is selected as the second chrominance filter identifier of the image to be processed.
  • the method includes: at least two of the first structure, the second structure, and the third structure are the same.
  • the method includes: the first structure, the second structure, and the third structure are different from each other.
  • the method includes: the minimum division unit of the first structure is the luma pixel block; and the minimum division unit of the second structure is the first chroma pixel block; The smallest division unit of the third structure is the third chrominance pixel block.
  • the beneficial effects of the embodiment of the present invention are that the minimum control unit of the filtering region is consistent with the filtered minimum processing unit, which reduces the logical judgment in processing and improves the processing efficiency.
  • a codec is provided, where the codec includes a processor and a memory, and the processor is connected to the memory, where the memory is used to store the first aspect and the third aspect.
  • a seventh aspect of the embodiments of the present invention provides a computer storage medium for storing computer software instructions for implementing the method of the first aspect, the third aspect, the fourth aspect, or the fifth aspect, wherein the instruction includes The method of the first aspect, the third aspect, the fourth aspect or the fifth aspect is performed.
  • the embodiments of the present invention provide an image filtering method and apparatus, which can improve image filtering precision, reduce image distortion rate, and reduce transmission filter coefficients.
  • FIG. 1 is a schematic diagram of image segmentation according to an embodiment of the present invention.
  • FIG. 2 is a schematic diagram of filtering a luminance pixel classification and filtering a chroma pixel without classification according to an embodiment of the present invention
  • FIG. 3 is a schematic block diagram of a video codec apparatus or an electronic device 50 according to an embodiment of the present invention
  • FIG. 4 is a schematic diagram of an apparatus for video encoding in accordance with an embodiment of the present invention.
  • FIG. 5 is a schematic block diagram of another video codec system according to an embodiment of the present invention.
  • FIG. 6 is a schematic flowchart of an image filtering method according to an embodiment of the present invention.
  • FIG. 7 is a schematic diagram of a correspondence between a first index and a luma pixel block according to an embodiment of the present invention.
  • FIG. 8 is a schematic diagram showing two ways of presetting preset pixel points according to an embodiment of the present invention.
  • FIG. 9 is a schematic diagram of comparison between a first index and a second index according to an embodiment of the present invention.
  • FIG. 10 is a schematic diagram showing another comparison of a first index and a second index according to an embodiment of the present invention.
  • FIG. 11 is a schematic diagram of comparison of a first index, a second index, and a third index according to an embodiment of the present invention.
  • FIG. 12 is a schematic diagram of comparison of another first index, a second index, and a third index according to an embodiment of the present invention.
  • FIG. 13 is a schematic diagram of comparison of still another first index, second index, and third index according to an embodiment of the present invention.
  • FIG. 14 is a schematic structural diagram of an image segmentation control method according to an embodiment of the present invention.
  • FIG. 15 is a schematic diagram of partitioning of a brightness control block according to an embodiment of the present invention.
  • 16 is a schematic diagram of a dividing process of a brightness control block according to an embodiment of the present invention.
  • 17 is a schematic diagram of a luminance filtering identifier of a brightness control block according to an embodiment of the present invention.
  • FIG. 18 is a schematic diagram of dividing a first chrominance control block by using a first structure according to an embodiment of the present invention.
  • FIG. 19 is a schematic diagram of dividing a first chrominance control block by using a second structure according to an embodiment of the present invention.
  • FIG. 20 is a schematic diagram of a first chrominance filter identifier of a first chrominance control block divided by a second structure according to an embodiment of the present disclosure
  • 21 is a schematic diagram of a first chrominance filter identifier of a first chrominance control block divided by a first structure according to an embodiment of the present disclosure
  • FIG. 22 is a schematic diagram of another first chrominance filtering identifier of a first chrominance control block divided by a first structure according to an embodiment of the present invention.
  • FIG. 23 is a schematic diagram of dividing a second chrominance control block by using a first structure according to an embodiment of the present invention.
  • FIG. 24 is a schematic diagram of a second chrominance filtering identifier of a second chrominance control block divided by a first structure according to an embodiment of the present disclosure
  • FIG. 25 is a schematic diagram of another second chrominance filtering identifier of a second chrominance control block divided by a first structure according to an embodiment of the present invention.
  • 26 is a schematic diagram of dividing a second chrominance control block by using a second structure according to an embodiment of the present invention.
  • FIG. 27 is a schematic diagram of a second chrominance filtering identifier of a second chrominance control block divided by a second structure according to an embodiment of the present disclosure
  • FIG. 28 is a schematic diagram of another second chrominance filtering identifier of a second chrominance control block divided by a second structure according to an embodiment of the present disclosure
  • 29 is a schematic structural diagram of an image filtering apparatus according to an embodiment of the present invention.
  • FIG. 30 is an image segmentation control apparatus according to an embodiment of the present invention.
  • FIG. 31 is another image filtering device according to an embodiment of the present invention.
  • FIG. 33 is a schematic structural diagram of an image filtering apparatus according to an embodiment of the present invention.
  • FIG. 34 is a schematic structural diagram of an image filtering apparatus according to an embodiment of the present invention.
  • the YCbCr model, the luma pixel block, the first chroma pixel block, and the second chroma pixel block according to the embodiment of the present invention are first introduced.
  • the YCbCr model is an artificially defined color model (sometimes called a color space).
  • the YCbCr model consists of three components (Y, Cb, Cr), Y is the luminance component, Cb is the first chrominance component, and Cr is the second chrominance component (of course, Cr is the first chrominance component, Cb is the first A dichroic component), wherein the first chrominance component and the second chrominance component may be collectively referred to as a chrominance component.
  • each pixel in the image includes a luminance pixel point, a first chrominance pixel point, and a second chrominance pixel point, wherein the first chrominance pixel point and the second chromaticity point Pixels can be collectively referred to as chroma pixels.
  • the pixel points of image 110 may be divided into a plurality of pixel blocks 120 (shown by dashed circle boxes in the figure), wherein each pixel block 120 includes a plurality of adjacent pixel points.
  • the pixel block 120 may be an adjacent 2 ⁇ 2 size pixel block, may be a 2 ⁇ 3 size pixel block, may be a 3 ⁇ 3 size pixel block, or the like. It can be understood that when only the luma pixels are considered, the pixel block 120 is a luma pixel block.
  • the pixel block 120 is the first chroma pixel block, and only the second chroma is considered. In the case of a pixel, the pixel block 120 is a second chrominance pixel block.
  • the prior art proposes an image filtering method that separately filters luminance pixels and chrominance pixels.
  • the image filtering method divides a luminance pixel block in an image into a plurality of classifications (a to d classifications in the figure), and applies the same filtering to the luminance pixel blocks of the same classification.
  • the filter is filtered, but for chrominance pixels (including the first chrominance pixel and the second chrominance pixel), the filtering method uses a filter to filter all of the chrominance pixel blocks in the image.
  • the image filtering method uses classification filtering for luminance pixels, but does not use classification filtering for chroma pixels. Moreover, the filter used in the image filtering method for filtering the luminance pixels is different from the filter used for filtering the chrominance pixels.
  • the prior art image filtering method uses the same filter to filter all the chrominance pixel blocks in the image, so that the filtering precision of the filter on the image is not high, and the distortion rate of the filtered image is still too large.
  • the filter used in the image filtering method is different from the filter used in filtering the chrominance pixels, and the filter coefficients corresponding to different filters are different, so The filter coefficients of the filter used to filter the luma pixels and the filter coefficients of the filters used to filter the chroma pixels are respectively transmitted to the decoder, thereby increasing The code rate occupied by the transmission filter coefficients.
  • the present invention provides an image filtering method, apparatus, and device, which can improve the filtering precision of an image, reduce the distortion rate of the image, and reduce the code rate occupied by the transmission filter coefficient. The following will be introduced separately.
  • the digital video device to which the present invention relates is first introduced.
  • the digital video device may include a video codec device or an electronic device 50.
  • 3 is a schematic block diagram of a video codec device or an electronic device 50, which may incorporate a codec according to an embodiment of the present invention, and the codec of the embodiment of the present invention may perform as shown in FIG.
  • the image filtering method, the image blocking control method shown in FIG. 14, and the image filtering method combining the image filtering method shown in FIG. 6 and the image blocking control method shown in FIG. 14, for details, refer to the following. No specific introduction will be made here.
  • 4 is a schematic diagram of an apparatus for video encoding in accordance with an embodiment of the present invention. The units in Figures 3 and 4 will be explained below.
  • the electronic device 50 can be, for example, a mobile terminal or user equipment of a wireless communication system. It should be understood that embodiments of the invention may be practiced in any electronic device or device that may require encoding and decoding, or encoding, or decoding of a video image.
  • Device 50 can include a housing 30 for incorporating and protecting the device.
  • Device 50 may also include display 32 in the form of a liquid crystal display.
  • the display may be any suitable display technology suitable for displaying images or video.
  • Device 50 may also include a keypad 34.
  • any suitable data or user interface mechanism may be utilized.
  • the user interface can be implemented as a virtual keyboard or data entry system as part of a touch sensitive display.
  • the device may include a microphone 36 or any suitable audio input, which may be a digital or analog signal input.
  • the device 50 may further include an audio output device, the audio output device being Embodiments of the invention may be any of the following: an earphone 38, a speaker or an analog audio or digital audio output connection.
  • Device 50 may also include battery 40, and in other embodiments of the invention, the device may be powered by any suitable mobile energy device, such as a solar cell, fuel cell, or clock mechanism generator.
  • the device may also include an infrared port 42 for short-range line of sight communication with other devices.
  • device 50 may also include any suitable short range communication solution, such as a Bluetooth wireless connection or a USB/Firewire wired connection.
  • Device 50 may include a controller 56 or processor for controlling device 50.
  • Controller 56 may be coupled to memory 58, which may store data in the form of images and audio in an embodiment of the invention, and/or may also store instructions for execution on controller 56.
  • Controller 56 may also be coupled to codec circuitry 54 suitable for implementing encoding and decoding of audio and/or video data or assisted encoding and decoding by controller 56.
  • the apparatus 50 may also include a card reader 48 and a smart card 46, such as a UICC and a UICC reader, for providing user information and for providing authentication information for authenticating and authorizing users on the network.
  • a card reader 48 and a smart card 46 such as a UICC and a UICC reader, for providing user information and for providing authentication information for authenticating and authorizing users on the network.
  • Apparatus 50 may also include a radio interface circuit 52 coupled to the controller and adapted to generate, for example, a wireless communication signal for communicating with a cellular communication network, a wireless communication system, or a wireless local area network. Apparatus 50 may also include an antenna 44 coupled to radio interface circuitry 52 for transmitting radio frequency signals generated at radio interface circuitry 52 to other apparatus(s) and for receiving radio frequency signals from other apparatus(s).
  • a radio interface circuit 52 coupled to the controller and adapted to generate, for example, a wireless communication signal for communicating with a cellular communication network, a wireless communication system, or a wireless local area network.
  • Apparatus 50 may also include an antenna 44 coupled to radio interface circuitry 52 for transmitting radio frequency signals generated at radio interface circuitry 52 to other apparatus(s) and for receiving radio frequency signals from other apparatus(s).
  • device 50 includes a camera capable of recording or detecting a single frame, and codec 54 or controller receives the individual frames and processes them.
  • the device may receive video image data to be processed from another device prior to transmission and/or storage.
  • device 50 may receive images for encoding/decoding via a wireless or wired connection.
  • FIG. 5 is a schematic block diagram of another video codec system 10 in accordance with an embodiment of the present invention.
  • the video codec system 10 includes a source device 12 and a destination device 14.
  • Source device 12 produces encoded video data.
  • source device 12 may be referred to as a video encoding device or a video encoding device.
  • Destination device 14 may decode the encoded video data produced by source device 12.
  • destination device 14 may be referred to as a video decoding device or a video decoding device.
  • Source device 12 and destination device 14 may be examples of video codec devices or video codec devices.
  • Source device 12 and destination device 14 may include a wide range of devices including desktop computers, mobile computing devices, notebook (eg, laptop) computers, tablet computers, set top boxes, smart phones, etc., televisions, cameras, display devices , digital media player, video game console, on-board computer, or the like.
  • Channel 16 may include one or more media and/or devices capable of moving encoded video data from source device 12 to destination device 14.
  • channel 16 may include one or more communication media that enable source device 12 to transmit encoded video data directly to destination device 14 in real time.
  • source device 12 may modulate the encoded video data in accordance with a communication standard (eg, a wireless communication protocol) and may transmit the modulated video data to destination device 14.
  • the one or more communication media may include wireless and/or wired communication media, such as a radio frequency (RF) spectrum or one or more physical transmission lines.
  • RF radio frequency
  • the one or more communication media may form part of a packet-based network (eg, a local area network, a wide area network, or a global network (eg, the Internet)).
  • the one or more communication media may include routers, switches, base stations, or other devices that facilitate communication from source device 12 to destination device 14.
  • channel 16 can include a storage medium that stores encoded video data generated by source device 12.
  • destination device 14 can access the storage medium via disk access or card access.
  • the storage medium may include a variety of locally accessible data storage media, such as Blu-ray Disc, DVD, CD-ROM, flash memory, or other suitable digital storage medium for storing encoded video data.
  • channel 16 can include a file server or another intermediate storage device that stores encoded video data generated by source device 12.
  • the destination device 14 can be streamed Transfer or download to access encoded video data stored at a file server or other intermediate storage device.
  • the file server may be a server type capable of storing encoded video data and transmitting the encoded video data to the destination device 14.
  • the instance file server includes a web server (eg, for a website), a file transfer protocol (FTP) server, a network attached storage (NAS) device, and a local disk drive.
  • FTP file transfer protocol
  • NAS network attached storage
  • Destination device 14 can access the encoded video data via a standard data connection (e.g., an internet connection).
  • a standard data connection e.g., an internet connection.
  • An instance type of a data connection includes a wireless channel (eg, a Wi-Fi connection), a wired connection (eg, DSL, cable modem, etc.), or both, suitable for accessing encoded video data stored on a file server. combination.
  • the transmission of the encoded video data from the file server may be streaming, downloading, or a combination of both.
  • the technology of the present invention is not limited to a wireless application scenario.
  • the technology can be applied to video codecs supporting multiple multimedia applications such as aerial television broadcasting, cable television transmission, satellite television transmission, and streaming video. Transmission (eg, via the Internet), encoding of video data stored on a data storage medium, decoding of video data stored on a data storage medium, or other application.
  • video codec system 10 may be configured to support one-way or two-way video transmission to support applications such as video streaming, video playback, video broadcasting, and/or video telephony.
  • source device 12 includes video source 18, video encoder 20, and output interface 22.
  • output interface 22 can include a modulator/demodulator (modem) and/or a transmitter.
  • Video source 18 may include a video capture device (eg, a video camera), a video archive containing previously captured video data, a video input interface to receive video data from a video content provider, and/or a computer for generating video data.
  • Video encoder 20 may encode video data from video source 18.
  • source device 12 transmits the encoded video data directly to destination device 14 via output interface 22.
  • the encoded video data may also be stored on a storage medium or file server for later access by the destination device 14 to Used for decoding and / or playback.
  • destination device 14 includes an input interface 28, a video decoder 30, and a display device 32.
  • input interface 28 includes a receiver and/or a modem.
  • Input interface 28 can receive the encoded video data via channel 16.
  • Display device 32 may be integral with destination device 14 or may be external to destination device 14. In general, display device 32 displays the decoded video data.
  • Display device 32 may include a variety of display devices such as liquid crystal displays (LCDs), plasma displays, organic light emitting diode (OLED) displays, or other types of display devices.
  • LCDs liquid crystal displays
  • OLED organic light emitting diode
  • Video encoder 20 and video decoder 30 may operate in accordance with a video compression standard (eg, the High Efficiency Video Codec H.265 standard) and may conform to the HEVC Test Model (HM).
  • a video compression standard eg, the High Efficiency Video Codec H.265 standard
  • HM HEVC Test Model
  • a textual description of the H.265 standard is published on April 29, 2015, ITU-T.265(V3) (04/2015), available for download from http://handle.itu.int/11.1002/1000/12455 The entire contents of the document are incorporated herein by reference.
  • FIG. 6 is a schematic flowchart diagram of an image filtering method according to an embodiment of the present invention. As shown in FIG. 6, the image filtering method of the embodiment of the present invention includes the following steps:
  • 301 Determine a filter set corresponding to the image to be processed, the filter set includes one or more filters, and the one or more filters have respective filter indexes.
  • the image to be processed includes a plurality of luma pixel blocks, a plurality of first chroma pixel blocks, and a plurality of second chroma pixel blocks, wherein the luma pixel block includes a plurality of adjacent luma pixels.
  • the first chrominance pixel block includes a plurality of adjacent first chrominance pixel points
  • the second chrominance pixel block includes a plurality of adjacent second chrominance pixel points.
  • the size of the luma pixel block and the first chroma pixel block may be the same or different; the size of the luma pixel block and the second chroma pixel block may be the same or different.
  • the size of the first chrominance pixel block can be made larger than the brightness.
  • the size of the pixel block is such that the size of the second chrominance pixel block is larger than the size of the luminance pixel block.
  • the size of the first chrominance pixel block is 4 ⁇ 4
  • the size of the second chrominance pixel block is 4 ⁇ 4
  • the size of the luminance pixel block is 2 ⁇ 2, and the like.
  • determining a filter set corresponding to the image to be processed is specifically: receiving a code stream sent by the encoder, and decoding the code stream, Obtaining first information in the code stream, and determining a filter set corresponding to the to-be-processed image according to the first information.
  • determining that the filter set corresponding to the image to be processed is specifically: candidate second in the plurality of preset filter sets.
  • the candidate second information with the smallest coding cost is selected as the second information of the filter set, and the filter set corresponding to the to-be-processed image is determined according to the second information.
  • the sampling format of the luma pixel, the first chroma pixel, and the second chroma pixel may be 4:2:0, that is, the sampling position of each 2 ⁇ 2 luma pixel is sampled for one first chroma pixel.
  • the sampling format of the luma pixel, the first chroma pixel, and the second chroma pixel may be 4:4:4, that is, the sampling position of each luma pixel is a sampling position of one first chroma pixel and a second chroma pixel. Sampling position.
  • the sampling format is 4:2:0 as an example.
  • the first index represents a category to which the luma pixel block belongs in the first category. That is, the values of the first index are the same, indicating that the categories of the corresponding luma pixel blocks are the same, and the values of the first index are different, indicating that the categories of the corresponding luma pixel blocks are different.
  • the first index having a value of "0" in FIG. 7(a) corresponds to the luminance pixel block of category a in FIG. 7(b), and the first index having a value of "1" in FIG. 7(a) corresponds to FIG. 7 (b).
  • the first index corresponds to the luma pixel block of category d in Figure 7(b).
  • the examples are merely illustrative of the embodiments of the invention and should not be construed as limiting.
  • the value range of the first index is [0, 3]. In other embodiments, the value range of the first index may be [0, 24], or other, and the invention is not specifically limited.
  • the filter index is used to distinguish different filters, that is, when the values of the filter indexes are different, the corresponding filters are also different. Wherein, at least one of the taps and the filter coefficients of the different filters are not the same.
  • the first index and the filter index have a first correspondence. That is, when the values of the first index are the same, the values of the corresponding filter indexes are also the same; when the values of the first index are different, the values of the corresponding filter indexes are also different.
  • each of said first index and one of said filter indices are equal. That is to say, when the values of the first index are the same, the corresponding filters are also the same, and when the values of the first index are different, the corresponding filters are also different. Therefore, the value of the first index is determined, and the corresponding filter is also determined.
  • the digital video device may determine a first index of each of the plurality of luma pixel blocks according to the first relationship.
  • the first relationship represents a texture directivity and a change intensity of an image region corresponding to the luma pixel block. For example, it can be based on Determining a first index of each of the plurality of luma pixel blocks, where C is a first index of the luma pixel block, and D is a texture directivity of the image region corresponding to the luma pixel block, The intensity of change of the image area corresponding to the luma pixel block.
  • the texture directivity D of the image region corresponding to the luma pixel block and the change intensity of the image region corresponding to the luma pixel block And determining, according to the pixel point of the preset position in the luma pixel block and the neighboring pixel point of the pixel position of the preset position in the luma pixel block.
  • the pixel of the preset position may be a pixel of any position in the luma pixel block.
  • the pixel of the preset position is the luma pixel block 112 (the dotted circle in the figure) The pixel in the upper left corner of the block).
  • the pixel position of the preset position may also be a pixel point near the luma pixel block, that is, a point at which the distance from any one of the luma pixel blocks is smaller than the distance threshold (ie, the pixel point where the black point is in the figure), for example, As shown in FIG. 8(b), the pixel point of the preset position is the pixel point of the upper left corner of the pixel in the upper left corner of the luminance pixel block 112 (the block in the dotted circle frame in the figure) (ie, the black dot in the figure) The pixel point).
  • the neighborhood pixel of the pixel at the preset position may be a four-neighbor pixel of the pixel at the preset position, or an eight-neighbor pixel or the like.
  • the examples are merely illustrative of the embodiments of the invention and should not be construed as limiting.
  • the texture directivity D of the image region corresponding to the luma pixel block can be calculated according to the following steps:
  • the gradient g h in the horizontal direction of the image region corresponding to the luma pixel block, the gradient g v in the vertical direction, and the gradients g d1 , g d2 in the two diagonal directions are calculated as follows:
  • V k,l
  • R(k,l) is the coordinate of the pixel point of the preset position of the luma pixel block
  • k is the abscissa of the pixel point of the preset position
  • l is the ordinate of the pixel point of the preset position
  • R(k- 1, l) is the coordinate of the pixel point of the preset position
  • i, j, a , b is an integer, ia ⁇ k ⁇ i + b, ja ⁇ l ⁇ j + b.
  • step 3 If Then go to step 3), otherwise go to step 4)
  • the intensity of the change of the image region corresponding to the luma pixel block It can be calculated in the following way:
  • A is further quantized to an integer in [0, 4], and the quantized value is recorded as
  • the second index represents the first chrominance a class to which the pixel block belongs in the second class
  • a second correspondence between the second index and the filter index is similar to a first correspondence between the first index and the filter index
  • the first correspondence relationship and the second correspondence relationship are the same.
  • the first correspondence is: when the value of the first index is “0”, the corresponding filter is a type; when the value of the first index is “1”, the corresponding filter is a b-type filter; When the value of the first index is "2”, the corresponding filter is a class c filter; when the value of the first index is "3”, the corresponding filter is a d-type filter.
  • the second correspondence is: when the value of the second index is “0”, the corresponding filter is a type; when the value of the second index is “1”, the corresponding filter is a b-type filter; When the value is "2”, the corresponding filter is a class C filter; when the value of the second index is "3", corresponding to the d-type filter, the first correspondence relationship and the second correspondence relationship are the same. of.
  • the examples are merely illustrative of the embodiments of the invention and should not be construed as limiting.
  • the filter used when filtering the first chrominance pixel block is often used when filtering the luma pixel block. Filter. Therefore, there is no need to additionally transmit the filter coefficients of the filter that filters the first chroma pixel block, reducing the code rate occupied by the filter coefficients of the transmission filter.
  • the manner in which the digital video device determines the second index of each of the plurality of first chrominance pixel blocks may include: mode 1, the digital video device determines each of the first colors according to the second relationship The second index of the degree pixel block.
  • the second relationship represents texture directionality and change intensity of an image region corresponding to the first chrominance pixel block, and the second relationship is based on pixel points of a preset position in the first chrominance pixel block.
  • the neighboring pixel points of the pixel points of the preset position in the first chrominance pixel block are determined.
  • the digital video device uses the first index of the luma pixel block corresponding to the same image region as the first chroma pixel block as the second index.
  • the digital video device determines, according to the second relationship, the second index of each of the first chroma pixel blocks and the previous step, the digital video device determines each of the luma pixel blocks according to the first relationship.
  • the first index is similar, and the description is not expanded here.
  • the first index of each of the luma pixel blocks determined by the digital video device according to the first relationship is as shown in FIG. 9(a), and each of the nodes determined according to the second relationship is determined.
  • the second index of the first chrominance pixel block is as shown in FIG. 9(b).
  • first index of each of the luma pixel blocks determined by the present embodiment there is no correlation between the first index of each of the luma pixel blocks determined by the present embodiment and the second index of the corresponding first chroma pixel block.
  • the examples are merely illustrative of the embodiments of the invention and should not be construed as limiting.
  • the first relationship and the second relationship may be the same or different.
  • the second index of each first chroma pixel block can be accurately calculated, and the corresponding first chroma pixel block is filtered by using a more suitable filter, thereby improving The precision of the filtering.
  • the digital video device uses the first index of the luma pixel block corresponding to the same image region as the first chroma pixel block as the second index.
  • the luminance pixel block in the upper left corner of FIG. 10(a) shown by a dotted circle in the figure
  • the first chroma pixel block in the upper left corner of FIG. 10(b) in the figure
  • the dashed circle box corresponds to the same image area, so the first chroma pixel block in the upper left corner of FIG. 10(b) directly uses the first index of the luma pixel block in the upper left corner of FIG. 10(a) as the The second index.
  • first chrominance pixel blocks in Fig. 10(b) The same is true for the other first chrominance pixel blocks in Fig. 10(b). It can be seen that the second index of each first chroma pixel block determined by the present embodiment is associated with the first index of the corresponding luma pixel block.
  • the examples are merely illustrative of the embodiments of the invention and should not be construed as limiting.
  • determining the second index by using the second method can avoid calculating the calculation amount generated by the second index, reducing the calculation load of the digital video device, and improving the processing speed.
  • the filtering is performed on the plurality of first chrominance pixel blocks by using a plurality of filters corresponding to the second index, so that the filtering precision of the image is improved, and the distortion rate of the image is reduced.
  • the digital video device may further determine a target filter for the second chrominance pixel block, and use The target filter filters a plurality of second chrominance pixel blocks, thereby further improving the filtering precision of the image and reducing the distortion rate of the image.
  • the digital video device uses, as the target filter, a filter corresponding to a second index of the first chrominance pixel block of the same image region corresponding to each of the second chrominance block pixel blocks. That is, in the embodiment of the present invention, the second chrominance block pixel block itself does not have an index, but directly multiplexes the second index of the first chrominance pixel block corresponding to the same image region, thereby reducing the index transmission of the encoder. The bit rate occupied by the decoder.
  • the digital video device determines a third index of each of the plurality of second chrominance pixel blocks, and uses a filter corresponding to the third index as a target filter.
  • the third index represents a category to which the first chrominance pixel block belongs in the third category, and the third index and the filter index
  • the third correspondence relationship between the first correspondence and the first index is similar to the first index and the filter index.
  • the first correspondence relationship, the second correspondence relationship, and the third relationship The system is the same. It can be understood that when the first correspondence relationship, the second correspondence relationship, and the third relationship are the same, the filtering used when filtering the first chrominance pixel block and the second chrominance pixel block is used.
  • the filters used to filter the luma blocks are often coincident. Therefore, there is no need to additionally transmit the filter coefficients of the filters that filter the first chrominance pixel block and the second chrominance pixel block, reducing the code rate occupied by the filter coefficients of the transmission filter.
  • the digital video device determines a third index of each of the second chrominance pixel blocks according to the third relationship, and uses a filter corresponding to the third index as the target filter.
  • the third relationship is determined according to a pixel point of a preset position in the second chrominance pixel block and a neighboring pixel point of a pixel point of a preset position in the second chrominance pixel block.
  • the third relationship represents texture orientation and change intensity of an image region corresponding to the second chrominance pixel block.
  • the digital video device determines, according to the third relationship, the third index of each of the second chroma pixel blocks and the previous step, the digital video device determines each of the brightness according to the third relationship.
  • the first index of the pixel block is similar and is not described here.
  • the first index determined by the digital video device according to the first relationship is as shown in FIG. 11(a)
  • the second index determined according to the second relationship is as shown in FIG. 11(b).
  • the third index determined according to the third relationship is as shown in FIG. 11(c).
  • first relationship, the second relationship, and the third relationship are the same, or the first relationship, the second relationship, and the third relationship are different from each other. .
  • the third index of each second chrominance pixel block can be accurately calculated, and the corresponding second chrominance pixel block is filtered by using a more suitable filter, thereby improving the precision of filtering.
  • the digital video device uses the first index of the luma pixel block corresponding to the same image region as the second chroma pixel block as the third index, and uses a filter corresponding to the third index as a filter.
  • Target filter As an example, as shown in FIG. 12, the luminance pixel block in the upper left corner of FIG. 12(a) (shown by a dotted circle in the figure) and the second chrominance pixel block in the upper left corner of FIG. 12(c) (in the figure) The dashed circle box corresponds to the same image area, so the second chroma pixel block in the upper left corner of FIG. 12(c) directly uses the first index of the luma pixel block in the upper left corner of FIG.
  • each second chrominance pixel block determined by the present embodiment is associated with the first index of the corresponding luma pixel block.
  • the calculation amount generated by the third index can be avoided, the calculation load of the digital video device is reduced, and the processing speed is improved.
  • the digital video device uses, as the third index, the second index of the first chrominance pixel block corresponding to the same image region as the second chrominance pixel block, and uses a third index
  • the filter acts as a target filter.
  • FIG. 13 the first chrominance pixel block in the upper left corner of FIG. 13(b) (shown by the dotted circle in the figure) and the second chrominance pixel block in the upper left corner of FIG. 13(c) are illustrated. (shown by the dashed circle in the figure) corresponding to the same image area, so the second chrominance pixel block in the upper left corner of FIG. 13(c) directly uses the first chrominance pixel block in the upper left corner of FIG. 13(b).
  • the second index serves as the third index.
  • the same is true for the other second chrominance pixel blocks in Fig. 13(c). It can be seen that the third index of each second chrominance pixel block determined by the present embodiment is associated with the second index of the corresponding first chrominance pixel block.
  • the calculation amount generated by the third index can be avoided, the calculation load of the digital video device is reduced, the processing speed is improved, and the first chrominance pixel block and the second chromaticity corresponding to the same image region are avoided.
  • the similarity of the pixel block is also relatively large, and the second index of the first chrominance pixel block corresponding to the same image region as the second chrominance pixel block is used as the third index, and the third is also ensured.
  • the precision of the index is also ensured.
  • an implementation method of an adaptive loop filter (ALF) based on JVET-D1001, "Algorithmm Description of Joint Exploration Test Model 4" is provided in an image filtering method (available from http) ://phenix.int-evry.fr/jvet/download, the entire contents of which is incorporated herein by reference, with the following improvements:
  • the classification method of the luminance component for adaptive loop filter block classification in JVET-D1001 is applied to the chrominance Cb, Cr components, respectively.
  • the adaptive loop filter acts on the chrominance component, it is possible to set (i, j) to the coordinates of the upper left ordinate pixel of the 2x2 chrominance pixel block, and let R(i, j) be the (i, j) Reconstructed pixels of chromaticity at coordinates.
  • different luminance, chrominance Cb, and chrominance Cr component blocks having the same classification index are combined together as one classification, sharing the same adaptive loop. Road filter. Therefore, in the improved scheme, it is not necessary to separately transmit different filter coefficients for chrominance and luminance.
  • the correspondence between the index for adaptive filter block classification and the coefficients of the adaptive loop filter is uniform.
  • one indication is encoded to indicate whether the adaptive loop filter scheme in D1001 is applied or the scheme of the embodiment of the present invention.
  • the adaptive loop filter for chroma is controlled to be turned on or off in units of CTU, and one CTU is encoded in each CTU to indicate whether the adaptive loop filter is used for the Two chrominance components within the CTU.
  • the embodiment of the present invention further provides an image segmentation control method.
  • an image segmentation control method By implementing the image segmentation control method provided by the embodiment of the present invention, it is possible to block whether to perform filtering, thereby improving the precision of filtering.
  • the image segmentation control method of the embodiment of the present invention includes the following steps:
  • the brightness control block includes one or more adjacent brightness pixel points.
  • the size of the plurality of brightness control blocks divided by the brightness pixel of the image to be processed according to the first structure may be the same or may not be the same.
  • each square represents a brightness control block
  • each brightness control block has the same size
  • each square represents a brightness control block.
  • the brightness control blocks vary in size.
  • the method for the digital video device to divide the luminance pixel of the image to be processed into a plurality of brightness control blocks according to the first structure is specifically: the brightness pixel of the image to be processed is according to a preset size. Dividing into one or more equal-sized first initial blocks; performing quadtree or binary tree division on the first preliminary blocks, and dividing into a plurality of the brightness control blocks. For example, as shown in FIG. 16( a ), the digital video device divides the luminance pixel point of the image to be processed into four first-sized first primary blocks according to a preset size, and then, Each first initial block performs a first quadtree partitioning iteration to obtain a result as shown in FIG. 16(b).
  • a second quadtree partitioning iteration is performed for each first initial block.
  • the result shown in Fig. 16 (c) is obtained.
  • two iterations of the first initial block are taken as an example.
  • the number of times of iterating the first initial block may be one time or three times. 4 or more, the invention is not specifically limited.
  • the quadtree is performed on the first initial block as an example.
  • the manner of iteratively dividing the first initial block may be asymmetric, for example, The first initial block is divided into two blocks of different sizes and the like, and the present invention is not specifically limited.
  • the luma filtering identifier includes at least a first value and a second value, and when the luma filtering identifier is the first value, performing characterization on performing filtering on a corresponding luma control block in the to-be-processed image, when When the brightness filtering is identified as the second value, the corresponding brightness control in the image to be processed is not characterized
  • the block performs filtering. For example, as shown in FIG. 17, each block represents a brightness control block, and the number in the block is the filter identifier of the corresponding brightness control block. When the brightness filter flag is “0”, it indicates that the corresponding brightness control is not performed. Performing filtering of the block, when the luminance filtering flag is "1", indicates that the filtering of the corresponding brightness control block is performed.
  • the determining, by the digital video device, the brightness filtering identifier of the image to be processed includes: if the image filtering method of the embodiment of the present invention is applied to a decoder, the brightness filtering may be obtained by decoding a code stream. Device identification. If the image filtering method of the embodiment of the present invention is applied to an encoder, among the plurality of preset candidate luma filtering identifiers, selecting one of the candidate luma filtering identifiers with the smallest encoding cost as the luma filtering identifier of the to-be-processed image .
  • the digital video device divides the first chrominance pixel of the image to be processed into a plurality of first chrominance control blocks, including: (1) the first chromaticity of the image to be processed The pixel is divided into a plurality of first chrominance control blocks in accordance with the first structure. (2) dividing the first chrominance pixel of the image to be processed into a plurality of first chrominance control blocks according to the second structure.
  • the digital video device divides the first chrominance pixel of the image to be processed into a plurality of first chrominance control blocks according to the first structure or the second structure, and the brightness of the image to be processed by the digital video device
  • the method in which the pixel points are divided into the plurality of brightness control blocks according to the first structure is similar, and the detailed description is not repeated here.
  • the size between the plurality of first chrominance control blocks in which the digital chrominance device divides the first chrominance pixel of the image to be processed according to the first structure or the second structure may be The same, but also can be different, please refer to the description of the brightness control block, and the description will not be repeated here.
  • first structure and the second structure may be the same or different.
  • first structure and the second structure are the same, as shown in FIG. 19, the first structure and The second structure is different.
  • determining the first chroma filter identifier of the to-be-processed image includes: if the image filtering method of the embodiment of the present invention is applied to a decoder, the first may be obtained by decoding a code stream. Chroma filter identification. If the image filtering method of the embodiment of the present invention is applied to the encoder, in the plurality of preset candidate first chrominance filter identifiers, selecting the candidate first chrominance filter identifier with the smallest encoding cost as the to-be-waited Processing the first chroma filter identification of the image.
  • the digital video device may determine the first chroma filter identifier of the image to be processed according to the method provided by the previous natural segment, for example.
  • each block in FIG. 20a is used to represent a brightness control block, and the numbers in the blocks are used to indicate the brightness filter flag of the corresponding brightness control block, and each block in FIG. 20b is used.
  • the number in the box is used to indicate the first chrominance filter identification of the corresponding first chrominance control block. It can be seen that the luma filter identifier of each luma control block (Fig. 20a) and the first chroma filter flag of each first chroma control block (Fig. 20b) are independent, and there is no correlation between the two. .
  • the embodiment it is possible to divide the luminance pixel point and the first chrominance pixel point into different structures according to actual needs, thereby improving the degree of freedom of filtering control and improving the precision of filtering.
  • the brightness filter identifier of the brightness control block and the first chrominance filter flag of the first chrominance control block are respectively set independently, which can further improve the degree of freedom of the filter control and further improve the precision of the filter.
  • the digital video device may determine the first chrominance filter identifier of the image to be processed according to the method provided by the two natural segments.
  • each block in FIG. 21a is used to represent a brightness control block
  • the numbers in the blocks are used to indicate the brightness filter identification of the corresponding brightness control block, each block in FIG. 21b.
  • Used to represent a first chrominance control block the number in the box is used to indicate the first chrominance filter identification of the corresponding first chrominance control block. It can be seen that the luma filtering identifier of each luma control block (Fig. 21a) and the first chroma filter identifier of each first chroma control block (Fig. 21b) are independent, and there is no correlation between the two. .
  • the division of the luminance pixel point and the first chrominance pixel point can be more easily realized, and the luminance filter identifier of the luminance control block and the first chrominance filter identifier of the first chrominance control block are separately set. It can improve the degree of freedom of filtering control and improve the accuracy of filtering.
  • the digital video device may further obtain the first chroma filter identifier according to the luma filtering identifier mapping.
  • each block in FIG. 22(b) is used to represent a first chrominance control block, and the number in the block is used to indicate the first color of the corresponding first chrominance control block.
  • the degree filter identifies that each block in Figure 22(c) is used to represent a second chrominance control block, the number in the block being used to indicate the second chrominance filter identification of the corresponding second chrominance control block.
  • the first chrominance filter flag of the first chrominance control block (shown by the dashed circle in the figure) in the upper left corner of Fig.
  • FIG. 22(b) is set to be the brightness control block in the upper left corner of Fig. 22(a) corresponding to the same position (
  • the brightness filter marks are the same as shown by the dashed circle in the figure.
  • the same is true for the other first chrominance control blocks in Fig. 22(b). It can be seen that the first chrominance filter identification of each first chrominance control block is associated with a luminance filter identification of the luminance control block corresponding to the same location.
  • the division of the luminance pixel point and the first chrominance pixel point can be made easier.
  • the luma filter identifier of the luma control block and the first chroma filter identifier of the first chroma control block are associated, which can simplify the setting of the filter identifier, and can also reduce the encoder to transmit the filter identifier to the decoder. Code rate.
  • the digital video device may further divide the second chrominance pixel of the image to be processed into a plurality of second chrominance control blocks, and then And determining, by the second chroma filter identifier of the image to be processed, whether to filter each second chroma control block of the image to be processed, thereby further improving the filtering precision of the image and reducing the distortion rate of the image.
  • the manner of dividing the second chrominance pixel of the image to be processed into the plurality of second chrominance control blocks includes:
  • the digital video device divides the second chrominance pixel of the image to be processed into a plurality of the second chrominance control blocks according to the first structure.
  • each square in Fig. 23(a) represents a brightness control block
  • each square in Fig. 23(b) represents a first chromaticity control block
  • Fig. 23 ( Each square in c) represents a second chromaticity control block.
  • the luminance pixel point and the second chrominance pixel point of the image to be processed are all divided by the first structure to obtain a plurality of brightness control blocks as shown in FIG. 23( a ) and as shown in FIG. 23( c ).
  • Second chrominance control block Second chrominance control block.
  • the digital video device may determine the second chroma filter identifier by referring to the method for determining the luma filter identifier of the to-be-processed image in step 402.
  • the digital video device may determine the second chroma filter identifier by referring to the method for determining the luma filter identifier of the to-be-processed image in step 402.
  • each square in FIG. 24(a) represents a brightness control block
  • the number in the square represents the brightness filter flag of the brightness control block
  • each of FIG. 24(b) The squares represent a first chrominance control block
  • the numbers in the squares represent the first chrominance filter identification of the first chrominance control block
  • each square in Figure 24(c) represents a second chromaticity control.
  • the block, the number in the square represents the second chrominance filter identification of the second chrominance control block. It can be seen that although the luminance pixel point and the second chrominance pixel point of the image to be processed are divided by the first structure, a plurality of brightness control blocks as shown in FIG. 24(a) are obtained and as shown in FIG. 24(c). The plurality of second chrominance control blocks are shown, but the luminance filter identifier of each luma control block and the first chrominance filter identifier of each first chrominance control block are independent, and there is no difference between the two Association.
  • the division of the luma pixel point and the second chroma pixel point can be more easily realized, and the luma filter identifier of the luma control block and the second chroma filter identifier of the second chroma control block are separately set. It can improve the degree of freedom of filtering control and improve the accuracy of filtering.
  • the digital video device may further obtain the second chroma filter identifier according to the luma filtering identifier mapping.
  • each square in FIG. 25(a) represents a brightness control block
  • the number in the square represents the brightness filter flag of the brightness control block
  • each of FIG. 25(b) The squares represent a first chrominance control block
  • the numbers in the squares represent the first chrominance filter identification of the first chrominance control block
  • each square in Figure 25(c) represents a second chromaticity control.
  • the block, the number in the square represents the second chrominance filter identification of the second chrominance control block.
  • the second chrominance filter flag of the second chrominance control block (shown by the dashed circle in the figure) in the upper left corner of Fig. 25(c) is set to be the brightness control block in the upper left corner of Fig. 25(a) corresponding to the same position (
  • the brightness filter marks are the same as shown by the dashed circle in the figure.
  • the same is true for the other second chrominance control blocks in Figure 25(c). It can be seen that the luminance pixel point and the second chrominance pixel point of the image to be processed are all divided by the first structure to obtain a plurality of brightness control blocks as shown in FIG. 25(a) and as shown in FIG. 25(c). And a plurality of second chrominance control blocks, and wherein the second chrominance filter identifier of each second chrominance control block is associated with a luminance filter identifier of the brightness control block corresponding to the same location.
  • the division of the luminance pixel point and the second chrominance pixel point can be made easier.
  • the luma filter identifier of the luma control block and the second chroma filter flag of the second chroma control block are associated, which can simplify the setting of the filter identifier, and can also reduce the encoder to transmit the filter identifier to the decoder. Code rate.
  • the digital video device divides the second chrominance pixel of the image to be processed into a plurality of the second chrominance control blocks according to the second structure.
  • each square in Fig. 26(a) represents a brightness control block
  • each square in Fig. 26(b) represents a first chromaticity control block
  • Fig. 26 ( Each square in c) represents a second chromaticity control block.
  • the first chrominance pixel (FIG. 26b) and the second chrominance pixel (FIG. 26c) of the image to be processed are all divided by the second structure to obtain a plurality of first colors as shown in FIG. 26(b).
  • the degree control block and a plurality of second chrominance control blocks as shown in Fig. 26(c).
  • the digital video device may obtain the second chrominance filter identifier by referring to the method for determining the brightness filter identifier of the image to be processed in step 402.
  • the digital video device may obtain the second chrominance filter identifier by referring to the method for determining the brightness filter identifier of the image to be processed in step 402.
  • each square in Fig. 27(a) represents a brightness control block
  • the number in the square represents the brightness filter flag of the brightness control block
  • each of the pictures in Fig. 27(b) The squares represent a first chrominance control block
  • the numbers in the squares represent the first chrominance filter identification of the first chrominance control block
  • each square in Figure 27(c) represents a second chromaticity control.
  • the block, the number in the square represents the second chrominance filter identification of the second chrominance control block. It can be seen that although the first chrominance pixel and the second chrominance pixel of the image to be processed are divided by the second structure, a plurality of first chrominance control blocks as shown in FIG. 27(b) and a plurality of second chrominance control blocks shown in FIG. 27(c), but the first chrominance filter identifier of each first chrominance control block and the second chrominance filter identifier of each second chrominance control block They are all independent and there is no connection between the two.
  • the division of the first chrominance pixel point and the second chrominance pixel point can be made easier, and the first chrominance filter identifier of the first chrominance control block and the second chrominance control block are The second chrominance filter identifiers are independently set, which can improve the degree of freedom of the filter control and improve the accuracy of the filter.
  • the digital video device may further obtain the second chrominance filter identifier according to the first chrominance filter identifier mapping.
  • each square in Fig. 28(a) represents a brightness control block
  • the number in the square represents the brightness filter identification of the brightness control block
  • in Fig. 28(b) The squares represent a first chrominance control block
  • the numbers in the squares represent the first chrominance filter identification of the first chrominance control block
  • each square in Figure 28(c) represents a second chromaticity control.
  • the block, the number in the square represents the second chrominance filter identification of the second chrominance control block.
  • the second chrominance filter flag of the second chrominance control block (shown by the dotted circle in the figure) in the upper left corner of Fig. 28(c) is set to the first chromaticity corresponding to the upper left corner of Fig. 28(b) corresponding to the same position.
  • the first chrominance filter identification of the control block (shown by the dashed circle in the figure) is the same.
  • the same is true for the other second chrominance control blocks in Fig. 28(c). It can be seen that the first chrominance pixel and the second chrominance pixel of the image to be processed are all divided by the second structure. Obtaining a plurality of first chrominance control blocks as shown in FIG.
  • the chrominance filter identifies a first chrominance filter identifier associated with a first chrominance control block corresponding to the same location.
  • the division of the first chrominance pixel point and the second chrominance pixel point can be made easier.
  • the first chroma filter identifier of the first chroma control block and the second chroma filter identifier of the second chroma control block are associated, which can simplify the setting of the filter identifier, and can also reduce the encoder to transmit the filter identifier.
  • the code rate occupied by the decoder is associated.
  • the digital video device divides the second chrominance pixel of the image to be processed into a plurality of the second chrominance control blocks according to the third structure. Wherein the digital video device divides the second chrominance pixel of the image to be processed into a plurality of second chrominance control blocks according to the third structure, and the digital video device according to the brightness pixel of the image to be processed.
  • the method in which the first structure is divided into a plurality of brightness control blocks is similar, and a detailed description thereof will not be repeated here.
  • the size of the plurality of second chrominance control blocks that the digital video device divides the second chrominance pixel of the image to be processed according to the third structure may be The same, but also can be different, please refer to the description of the brightness control block, and the description will not be repeated here.
  • the minimum division unit of the first structure is the luma pixel block described in the method corresponding to FIG. 6, and the minimum division unit of the second structure is described in the method corresponding to FIG.
  • the first chrominance pixel block, the minimum division unit of the third structure is the second chrominance pixel block described in the method corresponding to FIG. 6.
  • the embodiment of the invention also proposes an image filtering method, which can first use the image shown in FIG.
  • the block control method performs block control on the luminance pixel point, the first chrominance pixel point, and the second chrominance pixel point, and then uses the image filtering method as shown in FIG. 6 to filter the image to be processed to obtain more Good image filtering accuracy.
  • the minimum division unit of the first structure is the luma pixel block described in the method corresponding to FIG. 6, and the minimum division unit of the second structure is as described in the method corresponding to FIG.
  • the first chrominance pixel block, the minimum division unit of the third structure is the second chrominance pixel block described in the method corresponding to FIG. 6.
  • an embodiment of the present invention further provides an image filtering apparatus for performing an image filtering method described in the foregoing embodiment of FIG. 6.
  • the image filtering device 70 may include a set determining unit 701, a first index determining unit 702, a second index determining unit 703, a first filtering unit 704, and a second filtering unit 705. among them:
  • the set determining unit 701 is configured to determine a filter set corresponding to the image to be processed, the filter set includes one or more filters, and the one or more filters have respective filter indexes;
  • the first index determining unit 702 is configured to determine a first index of each of the plurality of luma pixel blocks, where the first index represents a category to which the luma pixel block belongs in the first category, the first index and the The filter index has a first correspondence relationship;
  • the second index determining unit 703 is configured to determine a second index of each of the plurality of first chroma pixel blocks, where the second index represents a category to which the first chroma pixel block belongs in the second category.
  • the second index and the filter index have a second correspondence, and the first correspondence and the second correspondence are the same;
  • the first filtering unit 704 is configured to filter the plurality of luma pixel blocks by using a filter corresponding to the first index
  • the second filtering unit 705 is configured to use the filter corresponding to the second index to pair the plurality of first The chroma pixel block performs the filtering.
  • an embodiment of the present invention further provides an image segmentation control apparatus for performing the image segmentation control method described in the foregoing FIG.
  • the image blocking control device 80 may include a luminance blocking unit 801, a luminance identification determining unit 802, a first chrominance blocking unit 803, and a first chrominance identification determining unit 804. among them:
  • the brightness blocking unit 801 is configured to divide the luminance pixel of the image to be processed into a plurality of brightness control blocks according to the first structure, and the brightness control block includes one or more adjacent brightness pixel points.
  • the brightness indicator determining unit 802 is configured to determine a brightness filter identifier of the image to be processed, the brightness filter flag representing whether to perform filtering on each of the brightness control blocks in the image to be processed.
  • the first chroma block unit 803 is configured to divide the first chroma pixel of the image to be processed into a plurality of first chroma control blocks, where the first chroma control block includes one or more adjacent The first chrominance pixel is described.
  • the first chrominance identifier determining unit 804 is configured to determine a first chrominance filter identifier of the image to be processed, where the first chrominance filter identifier represents whether each first chrominance control block in the image to be processed The filtering is performed separately.
  • an embodiment of the present invention further provides an image filtering apparatus including the image blocking control device 80 shown in FIG. 30 and the image filtering device 70 shown in FIG.
  • the image blocking control device 80 shown in FIG. 30 is configured to perform an image segmentation control method described in the foregoing embodiment of FIG. 14.
  • the image filtering device 70 shown in FIG. 29 is configured to perform the foregoing description of the embodiment of FIG. An image filtering method.
  • the minimum division unit of the first structure is the luma pixel block described in the method corresponding to FIG. 6, and the minimum division unit of the second structure is as described in the method corresponding to FIG.
  • the first chrominance pixel block, the minimum division unit of the third structure is the second chrominance pixel block described in the method corresponding to FIG. 6.
  • an image filtering method 1000 includes a plurality of luma pixel blocks and a plurality of first chroma pixel blocks, and the luma pixel block includes a plurality of adjacent luma pixels, the first chroma pixel.
  • the block includes a plurality of adjacent first chrominance pixel points, and the method includes: S1001: acquiring a first index of the luma pixel block, where the first index represents a filter type to which the image property corresponding to the luma pixel block is applicable;
  • acquiring the first index of the luma pixel block includes: classifying the luma pixel block according to the first relationship, obtaining a first index, where the first relationship includes texture orientation of the image region corresponding to the luma pixel block And the intensity of change.
  • the texture directivity and the change intensity of the image region corresponding to the luma pixel block are the pixel points of the preset position in the luma pixel block and the neighboring pixel points of the pixel position of the preset position in the luma pixel block. determine.
  • S1002 Acquire a second index of a first chroma pixel block, where the second index represents a filter type to which an image property corresponding to the first chroma pixel block is applicable;
  • acquiring the second index of the first chroma pixel block includes: classifying the first chroma pixel block according to the second relationship, obtaining a second index, where the second relationship includes the first chroma pixel The texture directivity and intensity of change of the image area corresponding to the block.
  • the texture directivity and the change intensity of the image region corresponding to the first chroma pixel block are preset by the pixel position of the preset position in the first chroma pixel block and the first chroma pixel block.
  • the neighboring pixel points of the pixel of the position are determined.
  • the beneficial effects of the embodiments of the present invention are: the second index of each first chroma pixel block can be accurately calculated, and the corresponding first chroma pixel block is filtered by using a more suitable filter, thereby improving filtering. Precision.
  • acquiring the second index of the first chroma pixel block includes: using a first index of the luma pixel block corresponding to the same image region as the first chroma pixel block as the second index.
  • An advantageous effect of the embodiment of the present invention is that the first chrominance block pixel block itself does not have an index, but directly multiplexes the first index of the luma pixel block corresponding to the same image region, thereby reducing the encoder to transmit the index to the decoder.
  • S1004 Filter, by using a first index on the luma pixel block, a corresponding filter in the filter set;
  • S1005 Filter the first chrominance pixel block by using a second index in a filter in the filter set.
  • An advantageous effect of the embodiments of the present invention is that the filter used in filtering the first chrominance pixel block is often the filter used when filtering the luminance pixel block. Therefore, there is no need to additionally transmit the filter coefficients of the filter that filters the first chroma pixel block, reducing the code rate occupied by the filter coefficients of the transmission filter.
  • the method further includes: when the first index and the second index are the same, the filter corresponding to the first index and the filter corresponding to the second index are the same.
  • the image to be processed further includes a plurality of second chrominance pixel blocks, and the second chrominance pixel block includes a plurality of adjacent second chrominance pixel points, and the first chrominance pixel block is obtained.
  • the second index it also includes:
  • acquiring the third index of the second chrominance pixel block includes: classifying the second chrominance pixel block according to the third relationship, obtaining a third index, where the third relationship includes the second chrominance pixel The texture directivity and intensity of change of the image area corresponding to the block.
  • the texture directivity and the change intensity of the image region corresponding to the second chroma pixel block are preset by the pixel position of the preset position in the second chroma pixel block and the second chroma pixel block.
  • the neighboring pixel points of the pixel of the position are determined.
  • the beneficial effects of the embodiments of the present invention are: the third index of each second chrominance pixel block can be accurately calculated, and the corresponding second chrominance pixel block is filtered by using a more suitable filter, thereby improving filtering. Precision.
  • acquiring the third index of the second chroma pixel block includes: using a first index of the luma pixel block corresponding to the same image region as the second chroma pixel block as a third index; or A second index of the first chrominance pixel block corresponding to the same image region as the second chrominance pixel block is used as the third index.
  • An advantageous effect of the embodiment of the present invention is that the second chrominance block pixel block itself does not have an index, but directly multiplexes the second index of the first chrominance pixel block corresponding to the same image area, thereby reducing the index transmission of the encoder.
  • the bit rate occupied by the decoder is not limited to the bit rate occupied by the decoder.
  • the method further includes:
  • S1006 Filter the second chroma pixel block by using a third index in a corresponding filter in the filter set.
  • An advantageous effect of the embodiment of the present invention is that after filtering a plurality of first chrominance pixel blocks by using a filter corresponding to the second index, the target filter may also be determined for the second chrominance pixel block, and the target filter is used. Filtering a plurality of second chrominance pixel blocks to further improve image filtering accuracy, Reduce the distortion rate of the image.
  • the method includes: at least two of the first relationship, the second relationship, and the third relationship being the same.
  • the beneficial effects of the embodiments of the present invention are: the filtering used when filtering the first chrominance pixel block and the second chrominance pixel block when the first correspondence relationship, the second correspondence relationship, and the third relationship are the same.
  • the filters used to filter the luma blocks are often coincident. Therefore, there is no need to additionally transmit the filter coefficients of the filters that filter the first chrominance pixel block and the second chrominance pixel block, reducing the code rate occupied by the filter coefficients of the transmission filter.
  • the method includes: the first relationship, the second relationship, and the third relationship are different from each other.
  • the method includes: the size of the first chroma pixel block is larger than the size of the luma pixel block; and the size of the second chroma pixel block is larger than the size of the luma pixel block.
  • the beneficial effects of the embodiments of the present invention are that different processing modes can be adopted according to different chrominance and brightness blocks including image details, thereby improving processing efficiency.
  • the method is used by the decoder, before acquiring the first index of the luma pixel block, further comprising: parsing the code stream, and acquiring information of the filter set.
  • the method is used by the encoder, before acquiring the first index of the luma pixel block, further comprising: selecting, from the preset candidate filter set, a candidate filter set with the smallest encoding cost as the filter Set; information that encodes a collection of filters.
  • the method before acquiring the first index of the luma pixel block, the method further includes:
  • the luminance pixel of the image to be processed is divided into a plurality of brightness control blocks according to the first structure, and the brightness control block includes one or more adjacent brightness pixel blocks;
  • dividing the luminance pixel of the image to be processed into the plurality of brightness control blocks according to the first structure includes: dividing the brightness pixel point of the image to be processed into one according to a preset size. Or a plurality of first-sized primary blocks of equal size; performing a quadtree or binary tree division on the first initial block, and dividing into a plurality of brightness control blocks.
  • the beneficial effects of the embodiments of the present invention are: making the division of the image area more flexible, and more utilizing the regional filtering.
  • S1012 Determine one or more brightness control blocks in the image to be processed that need to be filtered, and the brightness filter flag represents whether each of the brightness control blocks in the image to be processed performs filtering.
  • the method is used by the decoder to determine one or more luma control blocks in the image to be processed that need to be filtered, including: decoding the code stream to obtain information of the luma filtering identifier.
  • the method is used by an encoder to determine one or more luma control blocks in the image to be processed that need to be filtered, including: selecting a candidate with the smallest encoding cost from the preset candidate luma filtering identifier set.
  • the luminance filtering identifier is used as a luminance filtering identifier.
  • the method further includes: information for encoding the brightness filter identifier.
  • the beneficial effects of the embodiments of the present invention are: independently controlling the filtering of different regions of the image, and improving the applicability of the filtering method.
  • the method further includes:
  • S1014 Determine one or more first chrominance control blocks that need to be filtered in the image to be processed, where the first chrominance filter identifier represents whether each of the first chrominance control blocks in the image to be processed performs filtering, the first color.
  • the degree control block contains one or more adjacent first chrominance pixel blocks.
  • the method is used by a decoder to determine one or more first chrominance control blocks that need to be filtered in an image to be processed, including: decoding a code stream, and obtaining information of the first chrominance filter identifier. .
  • the method is used in an encoder to determine that an image to be processed needs to be performed.
  • the filtered one or more first chrominance control blocks include: selecting, from the preset candidate first chrominance filter identification set, a candidate first chrominance filter identifier having the smallest coding cost as the first chrominance filter identifier.
  • the method further includes: encoding information of the first chrominance filter identifier.
  • the beneficial effects of the embodiments of the present invention are: independently controlling the filtering of different regions of the image, and improving the applicability of the filtering method.
  • the method before determining the one or more first chrominance control blocks that need to be filtered in the image to be processed, the method further includes:
  • the first chrominance pixel of the image to be processed is divided into a plurality of first chrominance control blocks according to the first structure; correspondingly, one or more first chrominance control blocks that need to be filtered in the image to be processed are determined,
  • the method includes: obtaining a first chroma filter identifier according to the luma filter identifier mapping.
  • An advantageous effect of the embodiment of the present invention is that the division of the luminance pixel point and the first chrominance pixel point can be made easier. Moreover, the luma filter identifier of the luma control block and the first chroma filter identifier of the first chroma control block are associated, which can simplify the setting of the filter identifier, and can also reduce the encoder to transmit the filter identifier to the decoder. Code rate.
  • the method before determining the one or more first chrominance control blocks that need to be filtered in the image to be processed, the method further includes:
  • the beneficial effects of the embodiments of the present invention are as follows: according to the embodiment, different structures of the luminance pixel points and the first chrominance pixel points can be divided according to actual needs, thereby improving the degree of freedom of filtering control and improving the precision of filtering. Moreover, the brightness filter identifier of the brightness control block and the first chrominance filter flag of the first chrominance control block are respectively set independently, which can further improve the degree of freedom of the filter control and further improve the precision of the filter.
  • dividing the first chrominance pixel of the image to be processed into the plurality of first chrominance control blocks according to the second structure comprises: presetting the first chrominance pixel of the image to be processed according to a preset The size is divided into one or more second primary blocks of equal size; the second primary block is divided into quadtrees or binary trees, and divided into a plurality of first chrominance control blocks.
  • the method further includes:
  • S1016 Determine one or more second chrominance control blocks that need to be filtered in the image to be processed, and the second chrominance filter identifier represents whether each second chrominance control block in the image to be processed performs filtering, the second color.
  • the degree control block contains one or more adjacent second chrominance pixel blocks.
  • the method is used by a decoder to determine one or more second chrominance control blocks in the image to be processed that need to be filtered, including: decoding a code stream, and obtaining information of the second chrominance filter identifier. .
  • the method is used by an encoder to determine one or more second chrominance control blocks that need to be filtered in an image to be processed, including: from a preset candidate second chrominance filter identifier set, The candidate second chrominance filter identifier with the smallest coding cost is selected as the second chrominance filter identifier.
  • the method further includes: encoding information of the second chrominance filter identifier.
  • An advantageous effect of the embodiment of the present invention is that after determining one or more first chrominance control blocks that need to be filtered in the image to be processed, the second chrominance pixel of the image to be processed may also be divided into multiple seconds. a chroma control block, then determining one or more second chroma control blocks in the image to be processed that need to be filtered to determine whether to filter each second chroma control block of the image to be processed, thereby further enhancing the image Filter accuracy and reduce the distortion rate of the image.
  • the method before determining one or more second chrominance control blocks that need to be filtered in the image to be processed, the method further includes:
  • the second chrominance pixel of the image to be processed is divided into a plurality of second chrominance control blocks according to the first structure.
  • one or more second chrominance control blocks that need to be filtered in the image to be processed are determined.
  • the method includes: obtaining a second chroma filter identifier according to the luma filtering identifier mapping.
  • An advantageous effect of the embodiment of the present invention is that the division of the luminance pixel point and the second chrominance pixel point can be made easier. Moreover, the luma filter identifier of the luma control block and the second chroma filter flag of the second chroma control block are associated, which can simplify the setting of the filter identifier, and can also reduce the encoder to transmit the filter identifier to the decoder. Code rate.
  • the method before determining one or more second chrominance control blocks that need to be filtered in the image to be processed, the method further includes:
  • S1015' dividing the second chrominance pixel of the image to be processed into a plurality of second chrominance control blocks according to the second structure; correspondingly, determining one or more second chrominance control blocks in the image to be processed that need to be filtered
  • the method includes: obtaining a second chroma filter identifier according to the first chroma filter identifier mapping.
  • An advantageous effect of the embodiments of the present invention is that the division of the first chrominance pixel point and the second chrominance pixel point can be made easier. Moreover, the first chroma filter identifier of the first chroma control block and the second chroma filter identifier of the second chroma control block are associated, which can simplify the setting of the filter identifier, and can also reduce the encoder to transmit the filter identifier. The code rate occupied by the decoder.
  • the method before determining one or more second chrominance control blocks that need to be filtered in the image to be processed, the method further includes:
  • the second chrominance pixel of the image to be processed is divided into a plurality of second chrominance control blocks according to the third structure.
  • dividing the second chrominance pixel of the image to be processed into the plurality of second chrominance control blocks according to the third structure comprises: presetting the second chrominance pixel of the image to be processed The size is divided into one or more equal-sized third primary blocks; the third primary block is divided into quadtrees or binary trees, and divided into a plurality of second chrominance control blocks.
  • the method includes: at least two of the first structure, the second structure, and the third structure being the same.
  • the first structure, the second structure, and the third structure are different from each other.
  • an image filtering apparatus 2000 includes a plurality of luma pixel blocks and a plurality of first chroma pixel blocks, and the luma pixel block includes a plurality of adjacent luma pixels, the first chroma pixel.
  • the block includes a plurality of adjacent first chrominance pixel points
  • the device includes: an obtaining module 2001, configured to acquire a first index of the luma pixel block, where the first index represents a filter type to which the image property corresponding to the luma pixel block is applicable;
  • the obtaining module 2001 is further configured to acquire a second index of the first chrominance pixel block, where the second index represents a filter type to which the image property corresponding to the first chrominance pixel block is applicable;
  • the filtering module 2002 is configured to use the brightness pixel block
  • the first index is used to filter the corresponding filter in the filter set;
  • the filtering module 2002 is further configured to filter the corresponding filter in the filter set by using the second index for the first chroma pixel block.
  • the method further includes: when the first index and the second index are the same, the filter corresponding to the first index and the filter corresponding to the second index are the same.
  • the image to be processed further includes a plurality of second chrominance pixel blocks, and the second chrominance pixel block includes a plurality of adjacent second chrominance pixel points
  • the obtaining module 2001 is further configured to: acquire a third index of the second chrominance pixel block, the third index representing a filter type to which the image property corresponding to the second chrominance pixel block is applicable; correspondingly, the filtering module 2002 is further configured to: use the second chrominance pixel block The third index is filtered by a corresponding filter in the filter set.
  • the obtaining module 2001 is specifically configured to: classify the luma pixel block according to the first relationship, and obtain a first index, where the first relationship includes a texture directivity and a change intensity of the image region corresponding to the luma pixel block.
  • the texture directivity and the change intensity of the image region corresponding to the luma pixel block are the pixel points of the preset position in the luma pixel block and the neighboring pixel points of the pixel position of the preset position in the luma pixel block. determine.
  • the obtaining module 2001 is specifically configured to: classify the first chroma pixel block according to the second relationship, and obtain a second index, where the second relationship includes a texture of the image region corresponding to the first chroma pixel block.
  • the second relationship includes a texture of the image region corresponding to the first chroma pixel block.
  • the texture directivity and the change intensity of the image region corresponding to the first chroma pixel block are preset by the pixel position of the preset position in the first chroma pixel block and the first chroma pixel block.
  • the neighboring pixel points of the pixel of the position are determined.
  • the obtaining module 2001 is specifically configured to: use a first index of the luma pixel block corresponding to the same image region as the first chroma pixel block as the second index.
  • the obtaining module 2001 is specifically configured to: classify the second chrominance pixel block according to the third relationship, and obtain a third index, where the third relationship includes a texture of the image region corresponding to the second chrominance pixel block.
  • the third relationship includes a texture of the image region corresponding to the second chrominance pixel block.
  • the texture directivity and the change intensity of the image region corresponding to the second chroma pixel block are preset by the pixel position of the preset position in the second chroma pixel block and the second chroma pixel block.
  • the neighboring pixel points of the pixel of the position are determined.
  • the acquiring module 2001 is specifically configured to: use a first index of a luma pixel block corresponding to the same image region as the second chroma pixel block as a third index; or, and a second chroma pixel The block corresponds to a second index of the first chroma pixel block of the same image area as a third index.
  • the method includes: at least two of the first relationship, the second relationship, and the third relationship being the same.
  • the method includes: the first relationship, the second relationship, and the third relationship are different from each other.
  • the method includes: the size of the first chroma pixel block is larger than the size of the luma pixel block; and the size of the second chroma pixel block is larger than the size of the luma pixel block.
  • the apparatus is for a decoder, and the apparatus further comprises a decoding module 2003 for parsing the code stream and acquiring information of the filter set.
  • the device is used in an encoder, and the device further includes an encoding module 2004, configured to: select, from the preset candidate filter set, a candidate filter set with the smallest coding cost as the filter set; Information about the collection.
  • the apparatus further includes: a dividing module 2005, configured to divide the luminance pixel of the image to be processed into a plurality of brightness control blocks according to the first structure, where the brightness control block includes one or more adjacent brightness a pixel block; an identification module 2006 for determining one or more brightness control blocks in the image to be processed that need to be filtered, the brightness filter flag representing whether each of the brightness control blocks in the image to be processed performs filtering.
  • a dividing module 2005 configured to divide the luminance pixel of the image to be processed into a plurality of brightness control blocks according to the first structure, where the brightness control block includes one or more adjacent brightness a pixel block
  • an identification module 2006 for determining one or more brightness control blocks in the image to be processed that need to be filtered, the brightness filter flag representing whether each of the brightness control blocks in the image to be processed performs filtering.
  • the dividing module 2005 is specifically configured to: divide a luminance pixel of an image to be processed into one or more first primary blocks of equal size according to a preset size; and perform, for the first primary block
  • the quadtree or the binary tree is divided into a plurality of brightness control blocks.
  • the device is used for a decoder, and the decoding module 2003 is further configured to: decode the code stream, and obtain information of the brightness filter identifier.
  • the device is used in an encoder, and the encoding module 2004 is further configured to: select, from the preset candidate luma filtering identifier set, a candidate luma filtering identifier with a minimum encoding cost as the luma filtering identifier.
  • the encoding module 2004 is further configured to: encode information of the luma filtering identifier.
  • the identifier module 2006 is further configured to: determine one or more first chrominance control blocks in the image to be processed that need to be filtered, where the first chrominance filter identifier represents whether to treat Each of the first chrominance control blocks in the image performs filtering, and the first chrominance control block includes one or more adjacent first chrominance pixel blocks.
  • the dividing module 2005 is further configured to: divide the first chrominance pixel of the image to be processed into a plurality of first chrominance control blocks according to the first structure; correspondingly, the identification module 2006 is further used
  • the first chroma filter identifier is obtained according to the luma filter identifier mapping.
  • the dividing module 2005 is further configured to: divide the first chrominance pixel of the image to be processed into a plurality of first chrominance control blocks according to the second structure.
  • the dividing module 2005 is further configured to: divide the first chrominance pixel of the image to be processed into one or more equal-sized second primary blocks according to a preset size; The initial block is divided into quadtrees or binary trees and divided into a plurality of first chrominance control blocks.
  • the apparatus is used for a decoder, and the decoding module 2003 is further configured to: decode the code stream, and obtain information of the first chroma filter identifier.
  • the apparatus is used by an encoder, and the encoding module 2004 is further configured to: select, from the preset candidate first chrominance filter identifier set, a candidate first chrominance filter identifier with a minimum coding cost as the first Chroma filter identification.
  • the encoding module 2004 is further configured to: encode information of the first chroma filtering identifier.
  • the identifier module 2006 is further configured to: determine one or more second chrominance control blocks that need to be filtered in the image to be processed, where the second chrominance filter identifier represents whether to be processed in the image.
  • Each of the second chrominance control blocks respectively performs filtering, and the second chrominance control block includes one or more adjacent second chrominance pixel blocks.
  • the dividing module 2005 is further configured to: divide the second chrominance pixel of the image to be processed into a plurality of second chrominance control blocks according to the first structure; correspondingly, the identification module 2006 is further used to : obtaining a second chroma filter identifier according to the luma filter identifier mapping.
  • the dividing module 2005 is further configured to: divide the second chrominance pixel of the image to be processed into a plurality of second chrominance control blocks according to the second structure; correspondingly, the identification module 2006 is further used for : obtaining a second chroma filter identifier according to the first chroma filter identifier mapping.
  • the dividing module 2005 is further configured to: divide the second chrominance pixel of the image to be processed into a plurality of second chrominance control blocks according to the third structure.
  • the dividing module 2005 is further configured to: divide the second chrominance pixel of the image to be processed into one or more third grading blocks of equal size according to a preset size; The initial block is divided into quadtrees or binary trees and divided into a plurality of second chrominance control blocks.
  • the apparatus is used for a decoder, and the decoding module 2003 is further configured to: decode the code stream, and obtain information of the second chroma filter identifier.
  • the apparatus is used by an encoder, and the encoding module 2004 is further configured to: select, from the preset candidate second chrominance filter identifier set, a candidate second chrominance filter identifier with a minimum coding cost as the second Chroma filter identification.
  • the encoding module 2004 is further configured to: encode information of the second chroma filter identifier.
  • the method includes: at least two of the first structure, the second structure, and the third structure being the same.
  • the first structure, the second structure, and the third structure are different from each other.
  • FIG. 34 is a schematic block diagram of another image filtering apparatus according to an embodiment of the present invention, which is specifically described below.
  • An embodiment of the present invention provides an apparatus 900 for image filtering, a memory 901 and a processor 902 coupled to the memory; the memory is configured to store codes and instructions; Code and instructions.
  • the image to be processed includes a plurality of luma pixel blocks and a plurality of first chroma pixel blocks, the luma pixel block includes a plurality of adjacent luma pixel points, and the first chroma pixel block includes a plurality of adjacent first pixels.
  • the processor 902 is configured to: acquire a first index of the luma pixel block, where the first index represents a filter type to which an image property corresponding to the luma pixel block is applicable; a second index of the first chrominance pixel block, the second index representing a filter type to which the image property corresponding to the first chrominance pixel block is applied; and filtering the first index using the first chrominance pixel block Corresponding filters in the set of filters are filtered; the filtering is performed on the first chrominance pixel block using the second index in a corresponding filter in the set of filters.
  • the processor 902 can also specifically implement various feasible implementation manners of the image filtering method in the foregoing embodiments, and details are not described herein.
  • the embodiment of the present invention provides a method and a device for image filtering, which can improve the filtering precision of an image, reduce the distortion rate of the image, and reduce the code rate occupied by the transmission filter coefficient.
  • the disclosed system, apparatus, and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the modules or units is only a logical function division.
  • there may be another division manner for example, multiple units or components may be used. Combinations can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of a software functional unit.
  • the integrated unit if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium.
  • all or part of the technical solution may be embodied in the form of a software product stored in a storage medium, including a plurality of instructions for causing a computer device (which may be a personal computer, a server, Either a network device or the like) or a processor performs all or part of the steps of the method described in various embodiments of the invention.
  • the storage medium is a non-transitory medium, including: a flash memory, a mobile hard disk, a read only memory, a random access memory, a magnetic disk, or an optical disk, and the like, which can store program code.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

一种图像滤波方法、装置以及设备。所述方法包括:获取亮度像素块的第一索引(S1001),所述第一索引代表所述亮度像素块对应的图像性质所适用的滤波器类型;获取第一色度像素块的第二索引(S1002),所述第二索引代表所述第一色度像素块对应的图像性质所适用的滤波器类型;对所述亮度像素块使用所述第一索引在滤波器集合中对应的滤波器进行滤波(S1004);对所述第一色度像素块使用所述第二索引在所述滤波器集合中对应的滤波器进行所述滤波(S1005)。

Description

图像滤波方法、装置以及设备 技术领域
本发明涉及图像处理领域,尤其涉及一种图像滤波方法、装置以及设备。
背景技术
数字视频装置在目前得到了广泛的应用,例如,数字电视、数字直播***、无线广播***、个人数字助理(PDA)、膝上型或桌上型计算机、数码相机、数字记录装置、数字媒体播放器、视频游戏装置、视频游戏控制台、蜂窝式或卫星无线电电话、视频会议装置等等。数字视频装置通常采用基于块的混合视频编码框架的视频压缩技术对视频进行压缩,例如从MPEG-1/2到最新的视频编码标准H.265/HEVC,以便于更高效地发射、接收以及存储数字视频信息。
本领域的技术人员在长期实践中发现,采用基于块的混合视频编码框架的视频压缩技术对视频进行压缩时,需要将视频中的每帧图像进行分块处理以提高处理的效率,但是,分块处理会不可避免地导致图像失真的产生,例如,方块效应等等。
发明内容
本发明实施例公开了一种图像滤波方法、装置以及设备,能够提高图像的滤波精度,减少图像的失真率以及减少传输滤波系数所占用的码率。
在本发明实施例的第一方面提供了一种图像滤波方法,待处理图像包括多个亮度像素块和多个第一色度像素块,所述亮度像素块包含多个相邻的亮度像素点,所述第一色度像素块包含多个相邻的第一色度像素点,所述方法包括: 获取所述亮度像素块的第一索引,所述第一索引代表所述亮度像素块对应的图像性质所适用的滤波器类型;获取所述第一色度像素块的第二索引,所述第二索引代表所述第一色度像素块对应的图像性质所适用的滤波器类型;对所述亮度像素块使用所述第一索引在滤波器集合中对应的滤波器进行滤波;对所述第一色度像素块使用所述第二索引在所述滤波器集合中对应的滤波器进行所述滤波。
本发明实施例的有益效果在于:对第一色度像素块进行滤波时所使用到的滤波器往往是对亮度像素块进行滤波时所使用到的滤波器。所以,不需要额外传送对第一色度像素块进行滤波的滤波器的滤波系数,减少了传送滤波器的滤波系数所占用的码率。
在第一方面的一种可行的实施方式中,还包括:当所述第一索引和所述第二索引相同时,所述第一索引对应的滤波器和所述第二索引对应的滤波器相同。
在第一方面的一种可行的实施方式中,所述待处理图像还包括多个第二色度像素块,所述第二色度像素块包含多个相邻的第二色度像素点,在所述获取所述第一色度像素块的第二索引之后,还包括:获取所述第二色度像素块的第三索引,所述第三索引代表所述第二色度像素块对应的图像性质所适用的滤波器类型;对应的,在所述对所述第一色度像素块使用所述第二索引在所述滤波器集合中对应的滤波器进行所述滤波之后,还包括:对所述第二色度像素块使用所述第三索引在所述滤波器集合中对应的滤波器进行所述滤波。
本发明实施例的有益效果在于:在使用所述第二索引对应的滤波器对所述多个第一色度像素块进行所述滤波之后,还可以为第二色度像素块确定目标滤波器,并使用目标滤波器对多个第二色度像素块进行滤波,从而进一步提高图像的滤波精度,减少图像的失真率。
在第一方面的一种可行的实施方式中,所述获取所述亮度像素块的第一索 引,包括:根据第一关系对所述亮度像素块分类,获得所述第一索引,所述第一关系包括所述亮度像素块对应的图像区域的纹理方向性和变化强度。
在第一方面的一种可行的实施方式中,所述亮度像素块对应的图像区域的纹理方向性和变化强度由所述亮度像素块中预设位置的像素点和所述亮度像素块中预置位置的像素点的邻域像素点获得。
在第一方面的一种可行的实施方式中,所述获取所述第一色度像素块的第二索引,包括:根据第二关系对所述第一色度像素块分类,获得所述第二索引,所述第二关系包括所述第一色度像素块对应的图像区域的纹理方向性和变化强度。
在第一方面的一种可行的实施方式中,所述第一色度像素块对应的图像区域的纹理方向性和变化强度由所述第一色度像素块中预设位置的像素点和所述第一色度像素块中预置位置的像素点的邻域像素点获得。
本发明实施例的有益效果在于:可以准确地计算出每个第一色度像素块的第二索引,使用更合适的滤波器对对应的第一色度像素块进行滤波,从而提高了滤波的精度。
在第一方面的一种可行的实施方式中,所述获取所述第一色度像素块的第二索引,包括:将和所述第一色度像素块对应相同图像区域的所述亮度像素块的所述第一索引作为所述第二索引。
本发明实施例的有益效果在于:第一色度块像素块本身不具有索引,而是直接复用对应相同图像区域的亮度像素块的第一索引,从而减少了编码器将索引传输给解码器时所占用的码率。
在第一方面的一种可行的实施方式中,所述获取所述第二色度像素块的第三索引,包括:根据第三关系对所述第二色度像素块分类,获得所述第三索引,所述第三关系包括所述第二色度像素块对应的图像区域的纹理方向性和变化 强度。
在第一方面的一种可行的实施方式中,所述第二色度像素块对应的图像区域的纹理方向性和变化强度由所述第二色度像素块中预设位置的像素点和所述第二色度像素块中预置位置的像素点的邻域像素点获得。
本发明实施例的有益效果在于:可以准确地计算出每个第二色度像素块的第三索引,使用更合适的滤波器对对应的第二色度像素块进行滤波,从而提高了滤波的精度。
在第一方面的一种可行的实施方式中,所述获取所述第二色度像素块的第三索引,包括:将和所述第二色度像素块对应相同图像区域的所述亮度像素块的所述第一索引作为所述第三索引;或者,将和所述第二色度像素块对应相同图像区域的所述第一色度像素块的所述第二索引作为所述第三索引。
本发明实施例的有益效果在于:第二色度块像素块本身不具有索引,而是直接复用对应相同图像区域的第一色度像素块的第二索引,从而减少了编码器将索引传输给解码器时所占用的码率。
在第一方面的一种可行的实施方式中,包括:所述第一关系、所述第二关系和所述第三关系中至少两者相同。
本发明实施例的有益效果在于:当所述第一对应关系、所述第二对应关系和所述第三关系是相同的时,对第一色度像素块和第二色度像素块进行滤波时所使用到的滤波器与对亮度像素块进行滤波时所使用到的滤波器往往是重合的。所以,不需要额外传送对第一色度像素块和第二色度像素块进行滤波的滤波器的滤波系数,减少了传送滤波器的滤波系数所占用的码率。
在第一方面的一种可行的实施方式中,包括:所述第一关系、所述第二关系和所述第三关系互不相同。
在第一方面的一种可行的实施方式中,包括:所述第一色度像素块的尺寸 大于所述亮度像素块的尺寸;所述第二色度像素块的尺寸大于所述亮度像素块的尺寸。
本发明实施例的有益效果在于:可以根据色度和亮度块包含图像细节的不同采用不同的处理方式,提高了处理效率。
在第一方面的一种可行的实施方式中,所述方法用于解码器,在所述获取所述亮度像素块的第一索引之前,还包括:解析码流,获取所述滤波器集合的信息。
在第一方面的一种可行的实施方式中,所述方法用于编码器,在所述获取所述亮度像素块的第一索引之前,还包括:从预设候选滤波器集合中,选择编码代价最小的候选滤波器集合作为所述滤波器集合;编码所述滤波器集合的信息。
在第一方面的一种可行的实施方式中,在所述获取所述亮度像素块的第一索引之前,还包括:将所述待处理图像的亮度像素点按照第一结构分成多个亮度控制块,所述亮度控制块包含一个或多个相邻的所述亮度像素块;确定所述待处理图像中需要进行所述滤波的一个或多个所述亮度控制块。
在第一方面的一种可行的实施方式中,亮度滤波标识代表是否所述待处理图像中的每个所述亮度控制块各自是否执行所述滤波。
本发明实施例的有益效果在于:独立控制图像各个不同区域的滤波,提高了滤波方法的适用性。
在第一方面的一种可行的实施方式中,所述将所述待处理图像的亮度像素点按照第一结构分成多个亮度控制块,包括:将所述待处理图像的亮度像素点按照预设大小划分成一个或多个等尺寸的第一初分块;对所述第一初分块进行四叉树或者二叉树划分,划分成多个所述亮度控制块。
本发明实施例的有益效果在于:使图像区域的划分更加灵活,更有利用区 域性的滤波。
在第一方面的一种可行的实施方式中,所述方法用于解码器,所述确定所述待处理图像中需要进行所述滤波的一个或多个所述亮度控制块,包括:解码所述码流,获得所述亮度滤波标识的信息。
在第一方面的一种可行的实施方式中,所述方法用于编码器,所述确定所述待处理图像中需要进行所述滤波的一个或多个所述亮度控制块,包括:从预设候选亮度滤波标识集合中,选择编码代价最小的候选亮度滤波标识作为所述亮度滤波标识。
在第一方面的一种可行的实施方式中,在所述确定所述待处理图像中需要进行所述滤波的一个或多个所述亮度控制块之后,还包括:编码所述亮度滤波标识的信息。
在第一方面的一种可行的实施方式中,在所述确定所述待处理图像中需要进行所述滤波的一个或多个所述亮度控制块之后,还包括:确定所述待处理图像中需要进行所述滤波的一个或多个所述第一色度控制块,所述第一色度控制块包含一个或多个相邻的所述第一色度像素块。
在第一方面的一种可行的实施方式中,第一色度滤波标识代表所述待处理图像中的每个第一色度控制块各自是否执行所述滤波。
本发明实施例的有益效果在于:独立控制图像各个不同区域的滤波,提高了滤波方法的适用性。
在第一方面的一种可行的实施方式中,在所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第一色度控制块之前,还包括:将所述待处理图像的第一色度像素点按照所述第一结构分成多个所述第一色度控制块;对应的,所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第一色度控制块,包括:根据所述亮度滤波标识映射获得所述第一色度滤波标识。
本发明实施例的有益效果在于:可以使得对亮度像素点和第一色度像素点的划分更容易实现。而且,亮度控制块的亮度滤波标识和第一色度控制块的第一色度滤波标识是相关联的,可以简化滤波标识的设置,也可以减少编码器将滤波标识传输给解码器所占用的码率。
在第一方面的一种可行的实施方式中,在所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第一色度控制块之前,还包括:将所述待处理图像的第一色度像素点按照第二结构分成多个所述第一色度控制块。
本发明实施例的有益效果在于:通过本实施方式,可以实现按照实际需要对亮度像素点和第一色度像素点进行不同结构的划分,从而提高滤波控制的自由度,提高滤波的精度。而且,亮度控制块的亮度滤波标识和第一色度控制块的第一色度滤波标识分别独立设置,可以进一步提高滤波控制的自由度,也进一步提高滤波的精度。
在第一方面的一种可行的实施方式中,所述将所述待处理图像的第一色度像素点按照第二结构分成多个所述第一色度控制块,包括:将所述待处理图像的第一色度像素点按照预设大小划分成一个或多个等尺寸的第二初分块;对所述第二初分块进行四叉树或者二叉树划分,划分成多个所述第一色度控制块。
在第一方面的一种可行的实施方式中,所述方法用于解码器,所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第一色度控制块,包括:解码所述码流,获得所述第一色度滤波标识的信息。
在第一方面的一种可行的实施方式中,所述方法用于编码器,所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第一色度控制块,包括:从预设候选第一色度滤波标识集合中,选择编码代价最小的候选第一色度滤波标识作为所述第一色度滤波标识。
在第一方面的一种可行的实施方式中,在所述确定所述待处理图像中需要 进行所述滤波的一个或多个所述第一色度控制块之后,还包括:编码所述第一色度滤波标识的信息。
在第一方面的一种可行的实施方式中,在所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第一色度控制块之后,还包括:确定所述待处理图像中需要进行所述滤波的一个或多个所述第二色度控制块,所述第二色度控制块包含一个或多个相邻的所述第二色度像素块。
在第一方面的一种可行的实施方式中,所述第二色度滤波标识代表所述待处理图像中的每个第二色度控制块各自是否执行所述滤波。
本发明实施例的有益效果在于:在确定所述待处理图像中需要进行所述滤波的一个或多个所述第一色度控制块之后,还可以将待处理图像的第二色度像素点划分为多个第二色度控制块,然后,确定所述待处理图像中需要进行所述滤波的一个或多个所述第二色度控制块,以确定是否对待处理图像的每个第二色度控制块进行滤波,从而进一步提高图像的滤波精度,减少图像的失真率。
在第一方面的一种可行的实施方式中,在所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第二色度控制块之前,还包括:将所述待处理图像的第二色度像素点按照所述第一结构分成多个所述第二色度控制块;对应的,所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第二色度控制块,包括:根据所述亮度滤波标识映射获得所述第二色度滤波标识。
本发明实施例的有益效果在于:可以使得对亮度像素点和第二色度像素点的划分更容易实现。而且,亮度控制块的亮度滤波标识和第二色度控制块的第二色度滤波标识是相关联的,可以简化滤波标识的设置,也可以减少编码器将滤波标识传输给解码器所占用的码率。
在第一方面的一种可行的实施方式中,在所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第二色度控制块之前,还包括:将所述待处理 图像的第二色度像素点按照所述第二结构分成多个所述第二色度控制块;对应的,所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第二色度控制块,包括:根据所述第一色度滤波标识映射获得所述第二色度滤波标识。
本发明实施例的有益效果在于:可以使得对第一色度像素点和第二色度像素点的划分更容易实现。而且,第一色度控制块的第一色度滤波标识和第二色度控制块的第二色度滤波标识是相关联的,可以简化滤波标识的设置,也可以减少编码器将滤波标识传输给解码器所占用的码率。
在第一方面的一种可行的实施方式中,在所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第二色度控制块之前,还包括:将所述待处理图像的第二色度像素点按照第三结构分成多个所述第二色度控制块。
在第一方面的一种可行的实施方式中,所述将所述待处理图像的第二色度像素点按照第三结构分成多个所述第二色度控制块,包括:将所述待处理图像的第二色度像素点按照预设大小划分成一个或多个等尺寸的第三初分块;对所述第三初分块进行四叉树或者二叉树划分,划分成多个所述第二色度控制块。
在第一方面的一种可行的实施方式中,所述方法用于解码器,所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第二色度控制块,包括:解码所述码流,获得所述第二色度滤波标识的信息。
在第一方面的一种可行的实施方式中,所述方法用于编码器,所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第二色度控制块,包括:从预设候选第二色度滤波标识集合中,选择编码代价最小的候选第二色度滤波标识作为所述第二色度滤波标识。
在第一方面的一种可行的实施方式中,在所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第二色度控制块之后,还包括:编码所述第二色度滤波标识的信息。
在第一方面的一种可行的实施方式中,包括:所述第一结构、所述第二结构和所述第三结构中至少两者相同。
在第一方面的一种可行的实施方式中,包括:所述第一结构、所述第二结构和所述第三结构互不相同。
在本发明实施例的第二方面提供了一种图像滤波装置,待处理图像包括多个亮度像素块和多个第一色度像素块,所述亮度像素块包含多个相邻的亮度像素点,所述第一色度像素块包含多个相邻的第一色度像素点,所述装置包括:获取模块,用于获取所述亮度像素块的第一索引,所述第一索引代表所述亮度像素块对应的图像性质所适用的滤波器类型;所述获取模块,还用于获取所述第一色度像素块的第二索引,所述第二索引代表所述第一色度像素块对应的图像性质所适用的滤波器类型;滤波模块,用于对所述亮度像素块使用所述第一索引在滤波器集合中对应的滤波器进行滤波;所述滤波模块,还用于对所述第一色度像素块使用所述第二索引在所述滤波器集合中对应的滤波器进行所述滤波。
在第二方面的一种可行的实施方式中,还包括:当所述第一索引和所述第二索引相同时,所述第一索引对应的滤波器和所述第二索引对应的滤波器相同。
在第二方面的一种可行的实施方式中,所述待处理图像还包括多个第二色度像素块,所述第二色度像素块包含多个相邻的第二色度像素点,所述获取模块还用于:获取所述第二色度像素块的第三索引,所述第三索引代表所述第二色度像素块对应的图像性质所适用的滤波器类型;对应的,所述滤波模块还用于:对所述第二色度像素块使用所述第三索引在所述滤波器集合中对应的滤波器进行所述滤波。
在第二方面的一种可行的实施方式中,所述获取模块具体用于:根据第一 关系对所述亮度像素块分类,获得所述第一索引,所述第一关系包括所述亮度像素块对应的图像区域的纹理方向性和变化强度。
在第二方面的一种可行的实施方式中,所述亮度像素块对应的图像区域的纹理方向性和变化强度由所述亮度像素块中预设位置的像素点和所述亮度像素块中预置位置的像素点的邻域像素点获得。
在第二方面的一种可行的实施方式中,所述获取模块具体用于:根据第二关系对所述第一色度像素块分类,获得所述第二索引,所述第二关系包括所述第一色度像素块对应的图像区域的纹理方向性和变化强度。
在第二方面的一种可行的实施方式中,所述第一色度像素块对应的图像区域的纹理方向性和变化强度由所述第一色度像素块中预设位置的像素点和所述第一色度像素块中预置位置的像素点的邻域像素点获得。
在第二方面的一种可行的实施方式中,所述获取模块具体用于:将和所述第一色度像素块对应相同图像区域的所述亮度像素块的所述第一索引作为所述第二索引。
在第二方面的一种可行的实施方式中,所述获取模块具体用于:根据第三关系对所述第二色度像素块分类,获得所述第三索引,所述第三关系包括所述第二色度像素块对应的图像区域的纹理方向性和变化强度。
在第二方面的一种可行的实施方式中,所述第二色度像素块对应的图像区域的纹理方向性和变化强度由所述第二色度像素块中预设位置的像素点和所述第二色度像素块中预置位置的像素点的邻域像素点获得。
在第二方面的一种可行的实施方式中,所述获取模块具体用于:将和所述第二色度像素块对应相同图像区域的所述亮度像素块的所述第一索引作为所述第三索引;或者,将和所述第二色度像素块对应相同图像区域的所述第一色度像素块的所述第二索引作为所述第三索引。
在第二方面的一种可行的实施方式中,包括:所述第一关系、所述第二关系和所述第三关系中至少两者相同。
在第二方面的一种可行的实施方式中,包括:所述第一关系、所述第二关系和所述第三关系互不相同。
在第二方面的一种可行的实施方式中,包括:所述第一色度像素块的尺寸大于所述亮度像素块的尺寸;所述第二色度像素块的尺寸大于所述亮度像素块的尺寸。
在第二方面的一种可行的实施方式中,所述装置用于解码器,所述装置还包括解码模块,用于:解析码流,获取所述滤波器集合的信息。
在第二方面的一种可行的实施方式中,所述装置用于编码器,所述装置还包括编码模块,用于:从预设候选滤波器集合中,选择编码代价最小的候选滤波器集合作为所述滤波器集合;编码所述滤波器集合的信息。
在第二方面的一种可行的实施方式中,所述装置还包括:划分模块,用于将所述待处理图像的亮度像素点按照第一结构分成多个亮度控制块,所述亮度控制块包含一个或多个相邻的所述亮度像素块;标识模块,用于确定所述待处理图像中需要进行所述滤波的一个或多个所述亮度控制块。
在第二方面的一种可行的实施方式中,所述标识模块,具体用于确定亮度滤波标识,所述亮度滤波标识代表所述待处理图像中的每个所述亮度控制块各自是否执行所述滤波。
在第二方面的一种可行的实施方式中,所述划分模块具体用于:将所述待处理图像的亮度像素点按照预设大小划分成一个或多个等尺寸的第一初分块;对所述第一初分块进行四叉树或者二叉树划分,划分成多个所述亮度控制块。
在第二方面的一种可行的实施方式中,所述装置用于解码器,所述解码模块还用于:解码所述码流,获得所述亮度滤波标识的信息。
在第二方面的一种可行的实施方式中,所述装置用于编码器,所述编码模块还用于:从预设候选亮度滤波标识集合中,选择编码代价最小的候选亮度滤波标识作为所述亮度滤波标识。
在第二方面的一种可行的实施方式中,在所述编码模块还用于:编码所述亮度滤波标识的信息。
在第二方面的一种可行的实施方式中,所述标识模块还用于:确定所述待处理图像中需要进行所述滤波的一个或多个所述第一色度控制块所述第一色度控制块包含一个或多个相邻的所述第一色度像素块。
在第二方面的一种可行的实施方式中,所述标识模块,具体用于确定第一色度滤波标识,所述第一色度滤波标识代表所述待处理图像中的每个所述第一色度控制块各自是否执行所述滤波。
在第二方面的一种可行的实施方式中,所述划分模块还用于:将所述待处理图像的第一色度像素点按照所述第一结构分成多个所述第一色度控制块;对应的,所述标识模块,还用于:根据所述亮度滤波标识映射获得所述第一色度滤波标识。
在第二方面的一种可行的实施方式中,所述划分模块还用于:将所述待处理图像的第一色度像素点按照第二结构分成多个所述第一色度控制块。
在第二方面的一种可行的实施方式中,所述划分模块还具体用于:将所述待处理图像的第一色度像素点按照预设大小划分成一个或多个等尺寸的第二初分块;对所述第二初分块进行四叉树或者二叉树划分,划分成多个所述第一色度控制块。
在第二方面的一种可行的实施方式中,所述装置用于解码器,所述解码模块还用于:解码所述码流,获得所述第一色度滤波标识的信息。
在第二方面的一种可行的实施方式中,所述装置用于编码器,所述编码模 块还用于:从预设候选第一色度滤波标识集合中,选择编码代价最小的候选第一色度滤波标识作为所述第一色度滤波标识。
在第二方面的一种可行的实施方式中,在所述编码模块还用于:编码所述第一色度滤波标识的信息。
在第二方面的一种可行的实施方式中,在所述标识模块还用于:确定所述待处理图像中需要进行所述滤波的一个或多个所述第二色度控制块所述第二色度控制块包含一个或多个相邻的所述第二色度像素块。
在第二方面的一种可行的实施方式中,所述标识模块,具体用于确定第二色度滤波标识,所述第二色度滤波标识代表所述待处理图像中的每个所述第二色度控制块各自是否执行所述滤波。
在第二方面的一种可行的实施方式中,所述划分模块还用于:将所述待处理图像的第二色度像素点按照所述第一结构分成多个所述第二色度控制块;对应的,所述标识模块还用于:根据所述亮度滤波标识映射获得所述第二色度滤波标识。
在第二方面的一种可行的实施方式中,所述划分模块还用于:将所述待处理图像的第二色度像素点按照所述第二结构分成多个所述第二色度控制块;对应的,所述标识模块还用于:根据所述第一色度滤波标识映射获得所述第二色度滤波标识。
在第二方面的一种可行的实施方式中,所述划分模块还用于:将所述待处理图像的第二色度像素点按照第三结构分成多个所述第二色度控制块。
在第二方面的一种可行的实施方式中,所述划分模块还具体用于:将所述待处理图像的第二色度像素点按照预设大小划分成一个或多个等尺寸的第三初分块;对所述第三初分块进行四叉树或者二叉树划分,划分成多个所述第二色度控制块。
在第二方面的一种可行的实施方式中,所述装置用于解码器,所述解码模块还用于:解码所述码流,获得所述第二色度滤波标识的信息。
在第二方面的一种可行的实施方式中,所述装置用于编码器,所述编码模块还用于:从预设候选第二色度滤波标识集合中,选择编码代价最小的候选第二色度滤波标识作为所述第二色度滤波标识。
在第二方面的一种可行的实施方式中,所述编码模块还用于:编码所述第二色度滤波标识的信息。
在第二方面的一种可行的实施方式中,包括:所述第一结构、所述第二结构和所述第三结构中至少两者相同。
在第二方面的一种可行的实施方式中,包括:所述第一结构、所述第二结构和所述第三结构互不相同。
在本发明实施例的第三方面提供了一种图像滤波方法,待处理图像包括多个亮度像素块和多个第一色度像素块,所述亮度像素块包含多个相邻的亮度像素点,所述第一色度像素块包含多个相邻的第一色度像素点,所述方法包括:获取所述亮度像素块的第一索引,所述第一索引代表所述亮度像素块对应的图像性质所适用的滤波器类型;获取所述第一色度像素块的第二索引,所述第二索引代表所述第一色度像素块对应的图像性质所适用的滤波器类型;对所述亮度像素块使用所述第一索引在滤波器集合中对应的滤波器进行滤波;对所述第一色度像素块使用所述第二索引在所述滤波器集合中对应的滤波器进行所述滤波。
在第三方面的一种可行的实施方式中,还包括:当所述第一索引和所述第二索引相同时,所述第一索引对应的滤波器和所述第二索引对应的滤波器相同。
在第三方面的一种可行的实施方式中,所述待处理图像还包括多个第二色 度像素块,所述第二色度像素块包含多个相邻的第二色度像素点,在所述获取所述第一色度像素块的第二索引之后,还包括:获取所述第二色度像素块的第三索引,所述第三索引代表所述第二色度像素块对应的图像性质所适用的滤波器类型;对应的,在所述对所述第一色度像素块使用所述第二索引在所述滤波器集合中对应的滤波器进行所述滤波之后,还包括:对所述第二色度像素块使用所述第三索引在所述滤波器集合中对应的滤波器进行所述滤波。
在第三方面的一种可行的实施方式中,所述获取所述亮度像素块的第一索引,包括:根据第一关系对所述亮度像素块分类,获得所述第一索引,所述第一关系包括所述亮度像素块对应的图像区域的纹理方向性和变化强度。
在第三方面的一种可行的实施方式中,所述亮度像素块对应的图像区域的纹理方向性和变化强度由所述亮度像素块中预设位置的像素点和所述亮度像素块中预置位置的像素点的邻域像素点获得。
在第三方面的一种可行的实施方式中,所述获取所述第一色度像素块的第二索引,包括:根据第二关系对所述第一色度像素块分类,获得所述第二索引,所述第二关系包括所述第一色度像素块对应的图像区域的纹理方向性和变化强度。
在第三方面的一种可行的实施方式中,所述第一色度像素块对应的图像区域的纹理方向性和变化强度由所述第一色度像素块中预设位置的像素点和所述第一色度像素块中预置位置的像素点的邻域像素点获得。
在第三方面的一种可行的实施方式中,所述获取所述第一色度像素块的第二索引,包括:将和所述第一色度像素块对应相同图像区域的所述亮度像素块的所述第一索引作为所述第二索引。
在第三方面的一种可行的实施方式中,所述获取所述第二色度像素块的第三索引,包括:根据第三关系对所述第二色度像素块分类,获得所述第三索引, 所述第三关系包括所述第二色度像素块对应的图像区域的纹理方向性和变化强度。
在第三方面的一种可行的实施方式中,所述第二色度像素块对应的图像区域的纹理方向性和变化强度由所述第二色度像素块中预设位置的像素点和所述第二色度像素块中预置位置的像素点的邻域像素点获得。
在第三方面的一种可行的实施方式中,所述获取所述第二色度像素块的第三索引,包括:将和所述第二色度像素块对应相同图像区域的所述亮度像素块的所述第一索引作为所述第三索引;或者,将和所述第二色度像素块对应相同图像区域的所述第一色度像素块的所述第二索引作为所述第三索引。
在第三方面的一种可行的实施方式中,包括:所述第一关系、所述第二关系和所述第三关系中至少两者相同。
在第三方面的一种可行的实施方式中,包括:所述第一关系、所述第二关系和所述第三关系互不相同。
在第三方面的一种可行的实施方式中,包括:所述第一色度像素块的尺寸大于所述亮度像素块的尺寸;所述第二色度像素块的尺寸大于所述亮度像素块的尺寸。
在第三方面的一种可行的实施方式中,所述方法用于解码器,在所述获取所述亮度像素块的第一索引之前,还包括:解析码流,获取所述滤波器集合的信息。
在第三方面的一种可行的实施方式中,所述方法用于编码器,在所述获取所述亮度像素块的第一索引之前,还包括:从预设候选滤波器集合中,选择编码代价最小的候选滤波器集合作为所述滤波器集合;编码所述滤波器集合的信息。
在本发明实施例的第四方面提供了一种图像滤波的方法,包括:将待处理图像的亮度像素点按照第一结构分成多个亮度控制块,所述亮度控制块包含一个或多个相邻的所述亮度像素点;确定所述待处理图像的亮度滤波标识,所述亮度滤波标识代表是否对所述待处理图像中的每个所述亮度控制块各自执行所述滤波。
在第四方面的一种可行的实施方式中,所述将所述待处理图像的亮度像素点按照第一结构分成多个亮度控制块,包括:将所述待处理图像的亮度像素点按照预设大小划分成一个或多个等尺寸的第一初分块;对所述第一初分块进行四叉树或者二叉树划分,划分成多个所述亮度控制块。
在第四方面的一种可行的实施方式中,所述方法用于解码器,所述确定所述待处理图像的亮度滤波标识,包括:解码所述码流,获得所述亮度滤波标识的信息。
在第四方面的一种可行的实施方式中,所述方法用于编码器,所述确定所述待处理图像的亮度滤波标识,包括:从预设候选亮度滤波标识集合中,选择编码代价最小的候选亮度滤波标识作为所述亮度滤波标识。
在第四方面的一种可行的实施方式中,在所述确定所述待处理图像的亮度滤波标识之后,还包括:编码所述亮度滤波标识的信息。
在第四方面的一种可行的实施方式中,在所述确定所述待处理图像的亮度滤波标识之后,还包括:确定所述待处理图像的第一色度滤波标识,所述第一色度滤波标识代表是否对所述待处理图像中的每个第一色度控制块各自执行所述滤波,所述第一色度控制块包含一个或多个相邻的第一色度像素点。
在第四方面的一种可行的实施方式中,在所述确定所述待处理图像的第一色度滤波标识之前,还包括:将所述待处理图像的所述第一色度像素点按照所述第一结构分成多个所述第一色度控制块;对应的,所述确定所述待处理图像 的第一色度滤波标识,包括:根据所述亮度滤波标识映射获得所述第一色度滤波标识。
在第四方面的一种可行的实施方式中,在所述确定所述待处理图像的第一色度滤波标识之前,还包括:将所述待处理图像的第一色度像素点按照第二结构分成多个所述第一色度控制块。
在第四方面的一种可行的实施方式中,所述将所述待处理图像的第一色度像素点按照第二结构分成多个所述第一色度控制块,包括:将所述待处理图像的第一色度像素点按照预设大小划分成一个或多个等尺寸的第二初分块;对所述第二初分块进行四叉树或者二叉树划分,划分成多个所述第一色度控制块。
在第四方面的一种可行的实施方式中,所述方法用于解码器,所述确定所述待处理图像的第一色度滤波标识,包括:解码所述码流,获得所述第一色度滤波标识的信息。
在第四方面的一种可行的实施方式中,所述方法用于编码器,所述确定所述待处理图像的第一色度滤波标识,包括:从预设候选第一色度滤波标识集合中,选择编码代价最小的候选第一色度滤波标识作为所述第一色度滤波标识。
在第四方面的一种可行的实施方式中,在所述确定所述待处理图像的第一色度滤波标识之后,还包括:编码所述第一色度滤波标识的信息。
在第四方面的一种可行的实施方式中,在所述确定所述待处理图像的第一色度滤波标识之后,还包括:确定所述待处理图像的第二色度滤波标识,所述第二色度滤波标识代表是否对所述待处理图像中的每个第二色度控制块各自执行所述滤波,所述第二色度控制块包含一个或多个相邻的所述第二色度像素点。
在第四方面的一种可行的实施方式中,在所述确定所述待处理图像的第二色度滤波标识之前,还包括:将所述待处理图像的所述第二色度像素点按照所 述第一结构分成多个所述第二色度控制块;对应的,所述确定所述待处理图像的第二色度滤波标识,包括:根据所述亮度滤波标识映射获得所述第二色度滤波标识。
在第四方面的一种可行的实施方式中,在所述确定所述待处理图像的第二色度滤波标识之前,还包括:将所述待处理图像的第二色度像素点按照所述第二结构分成多个所述第二色度控制块;对应的,所述确定所述待处理图像的第二色度滤波标识,包括:根据所述第一色度滤波标识映射获得所述第二色度滤波标识。
在第四方面的一种可行的实施方式中,在所述确定所述待处理图像的第二色度滤波标识之前,还包括:将所述待处理图像的第二色度像素点按照第三结构分成多个所述第二色度控制块。
在第四方面的一种可行的实施方式中,所述将所述待处理图像的第二色度像素点按照第三结构分成多个所述第二色度控制块,包括:将所述待处理图像的第二色度像素点按照预设大小划分成一个或多个等尺寸的第三初分块;对所述第三初分块进行四叉树或者二叉树划分,划分成多个所述第二色度控制块。
在第四方面的一种可行的实施方式中,所述方法用于解码器,所述确定所述待处理图像的第二色度滤波标识,包括:解码所述码流,获得所述第二色度滤波标识的信息。
在第四方面的一种可行的实施方式中,所述方法用于编码器,所述确定所述待处理图像的第二色度滤波标识,包括:从预设候选第二色度滤波标识集合中,选择编码代价最小的候选第二色度滤波标识作为所述第二色度滤波标识。
在第四方面的一种可行的实施方式中,在所述确定所述待处理图像的第二色度滤波标识之后,还包括:编码所述第二色度滤波标识的信息。
在第四方面的一种可行的实施方式中,包括:所述第一结构、所述第二结 构和所述第三结构中至少两者相同。
在第四方面的一种可行的实施方式中,包括:所述第一结构、所述第二结构和所述第三结构互不相同。
在本发明实施例的第五方面提供了一种图像滤波方法,待处理图像包括多个亮度像素块和多个第一色度像素块,所述亮度像素块包含多个相邻的亮度像素点,所述第一色度像素块包含多个相邻的第一色度像素点,所述方法包括:确定所述待处理图像对应的滤波器集合,所述滤波器集合包括一个或多个滤波器,所述一个或多个滤波器具有各自的滤波器索引;确定所述多个亮度像素块各自的第一索引,所述第一索引代表所述亮度像素块在第一分类中所归属的类别,所述第一索引和所述滤波器索引具有第一对应关系;确定所述多个第一色度像素块各自的第二索引,所述第二索引代表所述第一色度像素块在第二分类中所归属的类别,所述第二索引和所述滤波器索引具有第二对应关系,所述第一对应关系和所述第二对应关系相同;使用所述第一索引对应的滤波器对所述多个亮度像素块进行滤波;使用所述第二索引对应的滤波器对所述多个第一色度像素块进行所述滤波。
在第五方面的一种可行的实施方式中,所述待处理图像还包含多个第二色度像素块,所述第二色度像素块包含多个相邻的第二色度像素点,在所述使用所述第二索引对应的滤波器对所述多个第一色度像素块进行所述滤波之后,还包括:使用目标滤波器对所述多个第二色度像素块进行所述滤波。
本发明实施例的有益效果在于:在使用所述第二索引对应的滤波器对所述多个第一色度像素块进行所述滤波之后,还可以为第二色度像素块确定目标滤波器,并使用目标滤波器对多个第二色度像素块进行滤波,从而进一步提高图像的滤波精度,减少图像的失真率。
在第五方面的一种可行的实施方式中,在所述使用目标滤波器对所述多个第二色度像素块进行所述滤波之前,还包括:将与每个所述第二色度像素块对应相同图像区域的所述第一色度像素块的第二索引对应的滤波器作为所述目标滤波器。
本发明实施例的有益效果在于:第二色度块像素块本身不具有索引,而是直接复用对应相同图像区域的第一色度像素块的第二索引,从而减少了编码器将索引传输给解码器时所占用的码率。
在第五方面的一种可行的实施方式中,在所述使用目标滤波器对所述多个第二色度像素块进行所述滤波之前,还包括:确定所述多个第二色度像素块各自的第三索引,所述第三索引代表所述第二色度像素块在第三分类中所归属的类别,所述第三索引和所述滤波器索引具有第三对应关系,所述第一对应关系和所述第三对应关系相同,所述目标滤波器为所述第三索引对应的滤波器。
本发明实施例的有益效果在于:可以准确地计算出每个第二色度像素块的第三索引,使用更合适的滤波器对对应的第二色度像素块进行滤波,从而提高了滤波的精度。
在第五方面的一种可行的实施方式中,所述方法用于解码器,所述确定所述待处理图像对应的滤波器集合,包括:解码码流,所述码流包含所述滤波器集合的第一信息;根据所述第一信息,确定所述滤波器集合。
在第五方面的一种可行的实施方式中,所述方法用于编码器,所述确定所述待处理图像对应的滤波器集合,包括:在多种预设的所述滤波器集合的候选第二信息中,选择编码代价最小的一种所述候选第二信息作为所述滤波器集合的第二信息;根据所述第二信息,确定所述滤波器集合。
在第五方面的一种可行的实施方式中,所述确定所述多个亮度像素块各自的第一索引,包括:根据第一关系,确定每个所述亮度像素块的第一索引,所 述第一关系根据所述亮度像素块中预设位置的像素点和所述亮度像素块中预置位置的像素点的邻域像素点确定。
在第五方面的一种可行的实施方式中,包括:所述第一关系代表所述亮度像素块对应的图像区域的纹理方向性和变化强度。
在第五方面的一种可行的实施方式中,所述第一索引和所述滤波器索引具有第一对应关系,包括:每个所述第一索引和一个所述滤波器索引相等;对应的,所述第二索引和所述滤波器索引具有第二对应关系,所述第一对应关系和所述第二对应关系相同,包括:每个所述第二索引和一个所述滤波器索引相等。
在第五方面的一种可行的实施方式中,所述确定所述多个第一色度像素块各自的第二索引,包括:根据第二关系,确定每个所述第一色度像素块的第二索引,所述第二关系根据所述第一色度像素块中预设位置的像素点和所述第一色度像素块中预置位置的像素点的邻域像素点确定。
本发明实施例的有益效果在于:可以准确地计算出每个第一色度像素块的第二索引,使用更合适的滤波器对对应的第一色度像素块进行滤波,从而提高了滤波的精度。
在第五方面的一种可行的实施方式中,包括:所述第二关系代表所述第一色度像素块对应的图像区域的纹理方向性和变化强度。
在第五方面的一种可行的实施方式中,所述确定所述多个第一色度像素块各自的第二索引,包括:将和所述第一色度像素块对应相同图像区域的所述亮度像素块的所述第一索引作为所述第二索引。
本发明实施例的有益效果在于:可以避免计算第二索引所产生的计算量,减轻了数字视频装置的计算负荷,提高了处理的速度。
在第五方面的一种可行的实施方式中,所述确定所述多个第二色度像素块各自的第三索引,包括:根据第三关系,确定每个所述第二色度像素块的第三 索引,所述第三关系根据所述第二色度像素块中预设位置的像素点和所述第二色度像素块中预置位置的像素点的邻域像素点确定。
本发明实施例的有益效果在于:可以准确地计算出每个第二色度像素块的第三索引,使用更合适的滤波器对对应的第二色度像素块进行滤波,从而提高了滤波的精度。
在第五方面的一种可行的实施方式中,包括:所述第三关系代表所述第二色度像素块对应的图像区域的纹理方向性和变化强度。
在第五方面的一种可行的实施方式中,所述确定所述多个第二色度像素块各自的第三索引,包括:将和所述第二色度像素块对应相同图像区域的所述亮度像素块的所述第一索引作为所述第三索引;或者,将和所述第二色度像素块对应相同图像区域的所述第一色度像素块的所述第二索引作为所述第三索引。
本发明实施例的有益效果在于:可以避免计算第三索引所产生的计算量,减轻了数字视频装置的计算负荷,提高了处理的速度。
在第五方面的一种可行的实施方式中,包括:所述第一关系、所述第二关系和所述第三关系中至少两者相同。
本发明实施例的有益效果在于:当所述第一对应关系、所述第二对应关系和所述第三关系是相同的时,对第一色度像素块和第二色度像素块进行滤波时所使用到的滤波器与对亮度像素块进行滤波时所使用到的滤波器往往是重合的。所以,不需要额外传送对第一色度像素块和第二色度像素块进行滤波的滤波器的滤波系数,减少了传送滤波器的滤波系数所占用的码率。
在第五方面的一种可行的实施方式中,包括:所述第一关系、所述第二关系和所述第三关系互不相同。
在第五方面的一种可行的实施方式中,包括:所述第一色度像素块的尺寸大于所述亮度像素块的尺寸;所述第二色度像素块的尺寸大于所述亮度像素块 的尺寸。
本发明实施例的有益效果在于:可以根据色度和亮度块包含图像细节的不同采用不同的处理方式,提高了处理效率。
在第五方面的一种可行的实施方式中,在所述使用所述第一索引对应的滤波器对所述多个亮度像素块进行滤波之前,还包括:将所述待处理图像的亮度像素点按照第一结构分成多个亮度控制块,所述亮度控制块包含一个或多个相邻的所述亮度像素点;确定所述待处理图像的亮度滤波标识,所述亮度滤波标识代表是否对所述待处理图像中的每个所述亮度控制块各自执行所述滤波。
本发明实施例的有益效果在于:独立控制图像各个不同区域的滤波,提高了滤波方法的适用性。
在第五方面的一种可行的实施方式中,所述将所述待处理图像的亮度像素按照第一结构分成多个亮度控制块,包括:将所述待处理图像的亮度像素点按照预设大小划分成一个或多个等尺寸的第一初分块;对所述第一初分块进行四叉树或者二叉树划分,划分成多个所述亮度控制块。
本发明实施例的有益效果在于:使图像区域的划分更加灵活,更有利用区域性的滤波。
在第五方面的一种可行的实施方式中,所述方法用于解码器,所述确定所述待处理图像的亮度滤波标识,包括:解码所述码流,获得所述亮度滤波标识。
在第五方面的一种可行的实施方式中,所述方法用于编码器,所述确定所述待处理图像的亮度滤波标识,包括:在多种预设的候选亮度滤波标识中,选择编码代价最小的一种所述候选亮度滤波标识作为所述待处理图像的亮度滤波标识。
在第五方面的一种可行的实施方式中,在所述确定所述待处理图像的亮度滤波标识之后,还包括:确定所述待处理图像的第一色度滤波标识,所述第一 色度滤波标识代表是否对所述待处理图像中的每个第一色度控制块各自执行所述滤波,所述第一色度控制块包含一个或多个相邻的所述第一色度像素点。
本发明实施例的有益效果在于:独立控制图像各个不同区域的滤波,提高了滤波方法的适用性。
在第五方面的一种可行的实施方式中,在所述确定所述待处理图像的第一色度滤波标识之前,还包括:将所述待处理图像的第一色度像素点按照所述第一结构分成多个所述第一色度控制块;对应的,所述确定所述待处理图像的第一色度滤波标识,包括:根据所述亮度滤波标识映射获得所述第一色度滤波标识。
本发明实施例的有益效果在于:可以使得对亮度像素点和第一色度像素点的划分更容易实现。而且,亮度控制块的亮度滤波标识和第一色度控制块的第一色度滤波标识是相关联的,可以简化滤波标识的设置,也可以减少编码器将滤波标识传输给解码器所占用的码率。
在第五方面的一种可行的实施方式中,在所述确定所述待处理图像的第一色度滤波标识之前,还包括:将所述待处理图像的第一色度像素点按照第二结构分成多个所述第一色度控制块。
本发明实施例的有益效果在于:通过本实施方式,可以实现按照实际需要对亮度像素点和第一色度像素点进行不同结构的划分,从而提高滤波控制的自由度,提高滤波的精度。而且,亮度控制块的亮度滤波标识和第一色度控制块的第一色度滤波标识分别独立设置,可以进一步提高滤波控制的自由度,也进一步提高滤波的精度。
在第五方面的一种可行的实施方式中,所述将所述待处理图像的第一色度像素按照第二结构分成多个所述第一色度控制块,包括:将所述待处理图像的第一色度像素点按照预设大小划分成一个或多个等尺寸的第二初分块;对所述 第二初分块进行四叉树或者二叉树划分,划分成多个所述第一色度控制块。
在第五方面的一种可行的实施方式中,所述方法用于解码器,所述确定所述待处理图像的第一色度滤波标识,包括:解码所述码流,获得所述第一色度滤波标识。
在第五方面的一种可行的实施方式中,所述方法用于编码器,所述确定所述待处理图像的第一色度滤波标识,包括:在多种预设的候选第一色度滤波标识中,选择编码代价最小的一种所述候选第一色度滤波标识作为所述待处理图像的第一色度滤波标识。
在第五方面的一种可行的实施方式中,在所述确定所述待处理图像的第一色度滤波标识之后,还包括:确定所述待处理图像的第二色度滤波标识,所述第二色度滤波标识代表是否对所述待处理图像中的每个第二色度控制块各自执行所述滤波,所述第二色度控制块包含一个或多个相邻的所述第二色度像素点。
本发明实施例的有益效果在于:在确定所述待处理图像的第一色度滤波标识之后,还可以将待处理图像的第二色度像素点划分为多个第二色度控制块,然后,确定所述待处理图像的第二色度滤波标识,以确定是否对待处理图像的每个第二色度控制块进行滤波,从而进一步提高图像的滤波精度,减少图像的失真率。
在第五方面的一种可行的实施方式中,在所述确定所述待处理图像的第二色度滤波标识之前,还包括:将所述待处理图像的第二色度像素点按照所述第一结构分成多个所述第二色度控制块;对应的,所述确定所述待处理图像的第二色度滤波标识,包括:根据所述亮度滤波标识映射获得所述第二色度滤波标识。
本发明实施例的有益效果在于:可以使得对亮度像素点和第二色度像素点 的划分更容易实现。而且,亮度控制块的亮度滤波标识和第二色度控制块的第二色度滤波标识是相关联的,可以简化滤波标识的设置,也可以减少编码器将滤波标识传输给解码器所占用的码率。
在第五方面的一种可行的实施方式中,在所述确定所述待处理图像的第二色度滤波标识之前,还包括:将所述待处理图像的第二色度像素点按照所述第二结构分成多个所述第二色度控制块;对应的,所述确定所述待处理图像的第二色度滤波标识,包括:根据所述第一色度滤波标识映射获得所述第二色度滤波标识。
本发明实施例的有益效果在于:可以使得对第一色度像素点和第二色度像素点的划分更容易实现。而且,第一色度控制块的第一色度滤波标识和第二色度控制块的第二色度滤波标识是相关联的,可以简化滤波标识的设置,也可以减少编码器将滤波标识传输给解码器所占用的码率。
在第五方面的一种可行的实施方式中,在所述确定所述待处理图像的第二色度滤波标识之前,还包括:将所述待处理图像的第二色度像素点按照第三结构分成多个所述第二色度控制块。
在第五方面的一种可行的实施方式中,所述将所述待处理图像的第二色度像素按照第三结构分成多个所述第二色度控制块,包括:将所述待处理图像的第二色度像素点按照预设大小划分成一个或多个等尺寸的第三初分块;对所述第三初分块进行四叉树或者二叉树划分,划分成多个所述第二色度控制块。
在第五方面的一种可行的实施方式中,所述方法用于解码器,所述确定所述待处理图像的第二色度滤波标识,包括:解码所述码流,获得所述第二色度滤波标识。
在第五方面的一种可行的实施方式中,所述方法用于编码器,所述确定所述待处理图像的第二色度滤波标识,包括:在多种预设的候选第二色度滤波标 识中,选择编码代价最小的一种所述候选第二色度滤波标识作为所述待处理图像的第二色度滤波标识。
在第五方面的一种可行的实施方式中,包括:所述第一结构、所述第二结构和所述第三结构中至少两者相同。
在第五方面的一种可行的实施方式中,包括:所述第一结构、所述第二结构和所述第三结构互不相同。
在第五方面的一种可行的实施方式中,包括:所述第一结构的最小划分单元为所述亮度像素块;所述第二结构的最小划分单元为所述第一色度像素块;所述第三结构的最小划分单元为所述第三色度像素块。
本发明实施例的有益效果在于:滤波区域的最小控制单元和滤波的最小处理单元相一致,减小了处理中的逻辑判断,提高了处理效率。
本发明实施例的第六方面,提供了一种编解码器,所述编解码器包括处理器以及存储器,所述处理器连接所述存储器,所述存储器用于存储第一方面、第三方面、第四方面或第五方面所述的方法的实现代码,所述处理器用于执行所述存储器中存储的程序代码,即执行第一方面、第三方面、第四方面或第五方面所述的方法。
本发明实施例的第七方面,提供了一种计算机存储介质,用于储存实现第一方面、第三方面、第四方面或第五方面所述的方法的计算机软件指令,所述指令包含用于执行第一方面、第三方面、第四方面或第五方面所述的方法。
应理解,本发明实施例第二至七方面与本发明实施例第一方面的技术方案一致,所取得的有益效果相似,不再赘述。
从以上技术方案可以看出,本发明实施例提供了一种图像滤波的方法及装置,能够提高图像的滤波精度,减少图像的失真率以及减少传输滤波系数所占 用的码率。
附图说明
为了更清楚地说明本发明实施例中的技术方案,下面将对实施例中所需要使用的附图作简单地介绍。
图1是本发明实施例涉及的图像分块的示意图;
图2是本发明实施例涉及的对亮度像素分类进行滤波和对色度像素不分类进行滤波的示意图;
图3是本发明实施例提供的一种视频编解码装置或电子设备50的示意性框图;
图4是根据本发明实施例的用于视频编码的示意性装置图;
图5是根据本发明实施例的另一视频编解码***的示意性框图;
图6是本发明实施例提供的一种图像滤波方法的流程示意图;
图7是本发明实施例公开一种第一索引与亮度像素块的对应关系的示意图;
图8是本发明实施例公开预设像素点的两种方式的示意图;
图9是本发明实施例公开的第一索引和第二索引的对比示意图;
图10是本发明实施例公开的又一种第一索引和第二索引的对比示意图;
图11是本发明实施例公开的一种第一索引、第二索引和第三索引的对比示意图;
图12是本发明实施例公开的另一种第一索引、第二索引和第三索引的对比示意图;
图13是本发明实施例公开的再一种第一索引、第二索引和第三索引的对比示意图;
图14是本发明实施例公开的一种图像分块控制方法的结构示意图;
图15是本发明实施例公开的一种亮度控制块的划分示意图;
图16是本发明实施例公开的一种亮度控制块的划分过程的示意图;
图17是本发明实施例公开的一种亮度控制块的亮度滤波标识的示意图;
图18是本发明实施例公开的一种采用第一结构划分第一色度控制块的示意图;
图19是本发明实施例公开的一种采用第二结构划分第一色度控制块的示意图;
图20是本发明实施例公开的一种采用第二结构划分的第一色度控制块的第一色度滤波标识的示意图;
图21是本发明实施例公开的一种采用第一结构划分的第一色度控制块的一种第一色度滤波标识的示意图;
图22是本发明实施例公开的一种采用第一结构划分的第一色度控制块的另一种第一色度滤波标识的示意图;
图23是本发明实施例公开的一种采用第一结构划分第二色度控制块的示意图;
图24是本发明实施例公开的一种采用第一结构划分的第二色度控制块的一种第二色度滤波标识示意图;
图25是本发明实施例公开的一种采用第一结构划分的第二色度控制块的另一种第二色度滤波标识示意图;
图26是本发明实施例公开的一种采用第二结构划分第二色度控制块的示意图;
图27是本发明实施例公开的一种采用第二结构划分的第二色度控制块的一种第二色度滤波标识示意图;
图28是本发明实施例公开的一种采用第二结构划分的第二色度控制块的另一种第二色度滤波标识示意图;
图29是本发明实施例公开的一种图像滤波装置的结构示意图;
图30是本发明实施例公开的一种图像分块控制装置;
图31是本发明实施例公开的另一种图像滤波装置;
图32是本发明实施例公开的一种图像滤波方法的示意性流程图;
图33是本发明实施例公开的一种图像滤波装置的结构示意图;
图34是本发明实施例公开的一种图像滤波装置的结构示意图。
具体实施方式
下面将结合本发明实施例中的附图对本发明实施例中的技术方案进行清楚、详细的描述。
为了便于理解本发明实施例,首先介绍本发明实施例涉及的YCbCr模型、亮度像素块、第一色度像素块以及第二色度像素块。
YCbCr模型是人为规定的彩色模型(有时也叫颜色空间)。YCbCr模型包括三个分量(Y,Cb,Cr),Y为亮度分量,Cb为第一色度分量,Cr为第二色度分量(当然,也可以Cr为第一色度分量,Cb为第二色度分量),其中,第一色度分量和第二色度分量可以统称为色度分量。相应地,对于基于YCbCr模型的图像,图像中的每个像素点均包括亮度像素点、第一色度像素点以及第二色度像素点,其中,第一色度像素点和第二色度像素点可以统称为色度像素点。
为了提高图像处理的效率,通常会将图像进行分块处理。如图1所示,可以将图像110的像素点划分为多个像素块120(如图中虚线圆框所示),其中,每个像素块120包括多个相邻的像素点。例如,像素块120可以是相邻的2×2大小的像素块,可以是2×3大小的像素块,可以是3×3大小的像素块等等。可以理解的是,当只考虑亮度像素时,像素块120即为亮度像素块,当只考虑第一色度像素时,像素块120即为第一色度像素块,当只考虑第二色度像素时,像素块120即为第二色度像素块。
为了解决分块处理不可避免地导致图像失真的问题,现有技术提出了一种图像滤波方法,该图像滤波方法将亮度像素和色度像素分开进行滤波。具体地,如图2所示,对于亮度像素,该图像滤波方法将图像中的亮度像素块分成多个分类(图中的a至d分类),并对同一分类的亮度像素块采用同一个滤波器进行滤波,但是,对于色度像素(包括第一色度像素以及第二色度像素),该滤波方法使用一个滤波器对图像中的所有色度像素块进行滤波。即,该图像滤波方法对亮度像素采用了分类滤波,但并没有对色度像素采用分类滤波。并且,该图像滤波方法对亮度像素进行滤波时所采用的滤波器与对色度像素进行滤波时所采用的滤波器是不相同的。
可以理解,现有技术的图像滤波方法使用同一个滤波器对图像中的所有色度像素块进行滤波,使得滤波器对图像的滤波精度不高,滤波后的图像的失真率仍然偏大。
并且,该图像滤波方法对亮度像素进行滤波时所采用的滤波器与对色度像素进行滤波时所采用的滤波器是不相同的,而不同的滤波器对应的滤波系数是不同的,故必须要将对亮度像素进行滤波时所采用的滤波器的滤波系数,和对色度像素进行滤波时所采用的滤波器的滤波系数分别传输给解码器,从而增加 了传输滤波系数所占用的码率。
针对现有的技术问题,本发明实施例提供了一种图像滤波方法、装置以及设备,能够提高图像的滤波精度,减少图像的失真率以及减少传输滤波系数所占用的码率。下面将分别进行介绍。
为了便于理解,首先对本发明涉及的数字视频装置进行介绍。其中,数字视频装置可以包括视频编解码装置或电子设备50。图3是视频编解码装置或电子设备50的示意性框图,该装置或者电子设备可以并入根据本发明的实施例的编码解码器,本发明实施例的编码解码器可以执行如图6所示的图像滤波方法、如图14所示的图像分块控制方法以及结合了如图6所示的图像滤波方法以及如图14所示的图像分块控制方法的图像滤波方法,具体请参阅下文,此处先不进行具体的介绍。图4是根据本发明实施例的用于视频编码的示意性装置图。下面将说明图3和图4中的单元。
电子设备50可以例如是无线通信***的移动终端或者用户设备。应理解,可以在可能需要对视频图像进行编码和解码,或者编码,或者解码的任何电子设备或者装置内实施本发明的实施例。
装置50可以包括用于并入和保护设备的壳30。装置50还可以包括形式为液晶显示器的显示器32。在本发明的其它实施例中,显示器可以是适合于显示图像或者视频的任何适当的显示器技术。装置50还可以包括小键盘34。在本发明的其它实施例中,可以运用任何适当的数据或者用户接口机制。例如,可以实施用户接口为虚拟键盘或者数据录入***作为触敏显示器的一部分。装置可以包括麦克风36或者任何适当的音频输入,该音频输入可以是数字或者模拟信号输入。装置50还可以包括如下音频输出设备,该音频输出设备在本 发明的实施例中可以是以下各项中的任何一项:耳机38、扬声器或者模拟音频或者数字音频输出连接。装置50也可以包括电池40,在本发明的其它实施例中,设备可以由任何适当的移动能量设备,比如太阳能电池、燃料电池或者时钟机构生成器供电。装置还可以包括用于与其它设备的近程视线通信的红外线端口42。在其它实施例中,装置50还可以包括任何适当的近程通信解决方案,比如蓝牙无线连接或者USB/火线有线连接。
装置50可以包括用于控制装置50的控制器56或者处理器。控制器56可以连接到存储器58,该存储器在本发明的实施例中可以存储形式为图像的数据和音频的数据,和/或也可以存储用于在控制器56上实施的指令。控制器56还可以连接到适合于实现音频和/或视频数据的编码和解码或者由控制器56实现的辅助编码和解码的编码解码器电路54。
装置50还可以包括用于提供用户信息并且适合于提供用于在网络认证和授权用户的认证信息的读卡器48和智能卡46,例如UICC和UICC读取器。
装置50还可以包括无线电接口电路52,该无线电接口电路连接到控制器并且适合于生成例如用于与蜂窝通信网络、无线通信***或者无线局域网通信的无线通信信号。装置50还可以包括天线44,该天线连接到无线电接口电路52用于向其它(多个)装置发送在无线电接口电路52生成的射频信号并且用于从其它(多个)装置接收射频信号。
在本发明的一些实施例中,装置50包括能够记录或者检测单帧的相机,编码解码器54或者控制器接收到这些单帧并对它们进行处理。在本发明的一些实施例中,装置可以在传输和/或存储之前从另一设备接收待处理的视频图像数据。在本发明的一些实施例中,装置50可以通过无线或者有线连接接收图像用于编码/解码。
图5是根据本发明实施例的另一视频编解码***10的示意性框图。如图 5所示,视频编解码***10包含源装置12及目的地装置14。源装置12产生经编码视频数据。因此,源装置12可被称作视频编码装置或视频编码设备。目的地装置14可解码由源装置12产生的经编码视频数据。因此,目的地装置14可被称作视频解码装置或视频解码设备。源装置12及目的地装置14可为视频编解码装置或视频编解码设备的实例。源装置12及目的地装置14可包括广泛范围的装置,包含台式计算机、移动计算装置、笔记本(例如,膝上型)计算机、平板计算机、机顶盒、智能电话等手持机、电视、相机、显示装置、数字媒体播放器、视频游戏控制台、车载计算机,或其类似者。
目的地装置14可经由信道16接收来自源装置12的编码后的视频数据。信道16可包括能够将经编码视频数据从源装置12移动到目的地装置14的一个或多个媒体及/或装置。在一个实例中,信道16可包括使源装置12能够实时地将编码后的视频数据直接发射到目的地装置14的一个或多个通信媒体。在此实例中,源装置12可根据通信标准(例如,无线通信协议)来调制编码后的视频数据,且可将调制后的视频数据发射到目的地装置14。所述一个或多个通信媒体可包含无线及/或有线通信媒体,例如射频(RF)频谱或一根或多根物理传输线。所述一个或多个通信媒体可形成基于包的网络(例如,局域网、广域网或全球网络(例如,因特网))的部分。所述一个或多个通信媒体可包含路由器、交换器、基站,或促进从源装置12到目的地装置14的通信的其它设备。
在另一实例中,信道16可包含存储由源装置12产生的编码后的视频数据的存储媒体。在此实例中,目的地装置14可经由磁盘存取或卡存取来存取存储媒体。存储媒体可包含多种本地存取式数据存储媒体,例如蓝光光盘、DVD、CD-ROM、快闪存储器,或用于存储经编码视频数据的其它合适数字存储媒体。
在另一实例中,信道16可包含文件服务器或存储由源装置12产生的编码后的视频数据的另一中间存储装置。在此实例中,目的地装置14可经由流式 传输或下载来存取存储于文件服务器或其它中间存储装置处的编码后的视频数据。文件服务器可以是能够存储编码后的视频数据且将所述编码后的视频数据发射到目的地装置14的服务器类型。实例文件服务器包含web服务器(例如,用于网站)、文件传送协议(FTP)服务器、网络附加存储(NAS)装置,及本地磁盘驱动器。
目的地装置14可经由标准数据连接(例如,因特网连接)来存取编码后的视频数据。数据连接的实例类型包含适合于存取存储于文件服务器上的编码后的视频数据的无线信道(例如,Wi-Fi连接)、有线连接(例如,DSL、缆线调制解调器等),或两者的组合。编码后的视频数据从文件服务器的发射可为流式传输、下载传输或两者的组合。
本发明的技术不限于无线应用场景,示例性的,可将所述技术应用于支持以下应用等多种多媒体应用的视频编解码:空中电视广播、有线电视发射、***发射、流式传输视频发射(例如,经由因特网)、存储于数据存储媒体上的视频数据的编码、存储于数据存储媒体上的视频数据的解码,或其它应用。在一些实例中,视频编解码***10可经配置以支持单向或双向视频发射,以支持例如视频流式传输、视频播放、视频广播及/或视频电话等应用。
在图5的实例中,源装置12包含视频源18、视频编码器20及输出接口22。在一些实例中,输出接口22可包含调制器/解调器(调制解调器)及/或发射器。视频源18可包含视频俘获装置(例如,视频相机)、含有先前俘获的视频数据的视频存档、用以从视频内容提供者接收视频数据的视频输入接口,及/或用于产生视频数据的计算机图形***,或上述视频数据源的组合。
视频编码器20可编码来自视频源18的视频数据。在一些实例中,源装置12经由输出接口22将编码后的视频数据直接发射到目的地装置14。编码后的视频数据还可存储于存储媒体或文件服务器上以供目的地装置14稍后存取以 用于解码及/或播放。
在图5的实例中,目的地装置14包含输入接口28、视频解码器30及显示装置32。在一些实例中,输入接口28包含接收器及/或调制解调器。输入接口28可经由信道16接收编码后的视频数据。显示装置32可与目的地装置14整合或可在目的地装置14外部。一般来说,显示装置32显示解码后的视频数据。显示装置32可包括多种显示装置,例如液晶显示器(LCD)、等离子体显示器、有机发光二极管(OLED)显示器或其它类型的显示装置。
视频编码器20及视频解码器30可根据视频压缩标准(例如,高效率视频编解码H.265标准)而操作,且可遵照HEVC测试模型(HM)。H.265标准的文本描述ITU-TH.265(V3)(04/2015)于2015年4月29号发布,可从http://handle.itu.int/11.1002/1000/12455下载,所述文件的全部内容以引用的方式并入本文中。
请参阅图6,图6是本发明实施例提供的一种图像滤波方法的流程示意图。如图6所示,本发明实施例的图像滤波方法包括如下步骤:
301:确定所述待处理图像对应的滤波器集合,所述滤波器集合包括一个或多个滤波器,所述一个或多个滤波器具有各自的滤波器索引。
在本发明实施例中,待处理图像包括多个亮度像素块、多个第一色度像素块以及多个第二色度像素块,所述亮度像素块包含多个相邻的亮度像素点,所述第一色度像素块包含多个相邻的第一色度像素点,所述第二色度像素块包括多个相邻的第二色度像素点。其中,亮度像素块和第一色度像素块的尺寸可以相同,也可以不相同;亮度像素块和第二色度像素块的尺寸可以相同,也可以不相同。由于第一色度像素块以及第二色度像素块一般比亮度像素块反映的图像纹理变化更平滑,细节较少,所以,可以令第一色度像素块的尺寸大于亮度 像素块的尺寸,令第二色度像素块的尺寸大于亮度像素块的尺寸。例如,第一色度像素块的尺寸为4×4,第二色度像素块的尺寸为4×4,亮度像素块的尺寸为2×2等等。
在本发明实施例中,如果本发明实施例的图像滤波方法应用于解码器,则确定所述待处理图像对应的滤波器集合具体为:接收编码器发送的码流,并解码码流,以获得码流中的第一信息,并根据第一信息确定所述待处理图像对应的滤波器集合。
在本发明实施例中,如果本发明实施例的图像滤波方法应用于编码器,则确定所述待处理图像对应的滤波器集合具体为:在多种预设的所述滤波集合的候选第二信息中,选择编码代价最小的一种所述候选第二信息作为所述滤波器集合的第二信息,并根据所述第二信息,确定所述待处理图像对应的滤波器集合。
可以理解的是,亮度像素、第一色度像素以及第二色度像素的采样格式可以是4:2:0,即每2×2个亮度像素的采样位置对于一个第一色度像素的采样位置和一个第二色度像素的采样位置。亮度像素、第一色度像素以及第二色度像素的采样格式可以是4:4:4,即每个亮度像素的采样位置对于一个第一色度像素的采样位置和一个第二色度像素的采样位置。下面的陈述中,均以采样格式为4:2:0为例。
302:确定所述多个亮度像素块各自的第一索引,所述第一索引代表所述亮度像素块在第一分类中所归属的类别,所述第一索引和所述滤波器索引具有第一对应关系。
在本发明实施例中,所述第一索引代表所述亮度像素块在第一分类中所归属的类别。即,第一索引的值相同,表示对应的亮度像素块的类别相同,第一索引的值不同,表示对应的亮度像素块的类别不同。举例说明,如图7所示, 图7(a)中值为“0”的第一索引对应图7(b)中类别为a的亮度像素块,图7(a)中值为“1”的第一索引对应图7(b)中类别为b的亮度像素块,图7(a)中值为“2”的第一索引对应图7(b)中类别为c的亮度像素块,图7(a)中值为“3”的第一索引对应图7(b)中类别为d的亮度像素块。示例仅仅用于解释本发明实施例,不应构成限定。上述例子中,第一索引的取值范围为[0,3],在其他的实施例中,第一索引的取值范围可以是[0,24],或者其他,本发明不作具体限定。
在本发明实施例中,所述滤波器索引用于区分不同的滤波器,即,当滤波器索引的值不同时,对应的滤波器也不相同。其中,不同的滤波器的抽头和滤波系数中的至少一个并不相同。
在本发明实施例中,所述第一索引和所述滤波器索引具有第一对应关系。即,当第一索引的值相同时,对应的滤波器索引的值也相同;当第一索引的值不同时,对应的滤波器索引的值也不相同。在一具体的实施例中,每个所述第一索引和一个所述滤波器索引相等。也就是说,当第一索引的值相同时,对应的滤波器也相同,当第一索引的值不同时,对应的滤波器也不相同。所以,第一索引的值确定了,对应的滤波器也就确定了。
在本发明实施例中,数字视频装置可以根据第一关系确定所述多个亮度像素块各自的第一索引。其中,所述第一关系代表所述亮度像素块对应的图像区域的纹理方向性和变化强度。例如,可以根据
Figure PCTCN2016113973-appb-000001
确定所述多个亮度像素块各自的第一索引,其中,C为亮度像素块的第一索引,D为亮度像素块对应的图像区域的纹理方向性,
Figure PCTCN2016113973-appb-000002
为亮度像素块对应的图像区域的变化强度。
在一具体的实施例中,亮度像素块对应的图像区域的纹理方向性D和亮度像素块对应的图像区域的变化强度
Figure PCTCN2016113973-appb-000003
可以根据所述亮度像素块中预设位置的像素点和所述亮度像素块中预置位置的像素点的邻域像素点确定。其中,预 设位置的像素点可以是亮度像素块中任意一个位置的像素点,例如,如图8(a)所示,预设位置的像素点是亮度像素块112(图中虚线圆框中的块)中左上角的像素点。预设位置的像素点也可以是亮度像素块附近的像素点,即,距离亮度像素块中任意一个亮度像素点的距离小于距离阈值的点(即,图中黑点所在的像素点),例如,如图8(b)所示,预设位置的像素点是亮度像素块112(图中虚线圆框中的块)中左上角的像素点的左上角的像素点(即,图中黑点所在的像素点)。预置位置的像素点的邻域像素点可以是预置位置的像素点的四邻域像素点,或者八邻域像素点等等。示例仅仅用于解释本发明实施例,不应构成限定。
具体地,亮度像素块对应的图像区域的纹理方向性D可以根据以下的步骤计算得到:
(1)、首先计算亮度像素块对应的图像区域的水平方向的梯度gh、竖直方向的梯度gv,及两条对角线方向的梯度gd1,gd2如下:
Figure PCTCN2016113973-appb-000004
其中,Hk,l=|2R(k,l)-R(k-1,l)-R(k+1,l)|;
Figure PCTCN2016113973-appb-000005
其中,Vk,l=|2R(k,l)-R(k,l-1)-R(k,l+1)|;
Figure PCTCN2016113973-appb-000006
其中,D1k,l=|2R(k,l)-R(k-1,l-1)-R(k+1,l+1)|;
Figure PCTCN2016113973-appb-000007
其中,D2k,l=|2R(k,l)-R(k-1,l+1)-R(k+1,l-1)|;
其中,R(k,l)为亮度像素块的预设位置的像素点的坐标,k为预设位置的像素点的横坐标,l为预设位置的像素点的纵坐标,R(k-1,l),R(k+1,l),R(k,l-1),R(k,l+1),R(k-1,l-1),R(k+1,l+1),R(k-1,l+1),R(k+1,l-1)为预设位置的像素点R(k,l)八邻域的像素点,i,j,a,b均为整数,i-a≤k≤i+b,j-a≤l≤j+b。
(2)、计算水平方向和竖直方向梯度的最大值
Figure PCTCN2016113973-appb-000008
以及最小值
Figure PCTCN2016113973-appb-000009
Figure PCTCN2016113973-appb-000010
(3)、计算两条对角线方向梯度的最大值
Figure PCTCN2016113973-appb-000011
最小值
Figure PCTCN2016113973-appb-000012
Figure PCTCN2016113973-appb-000013
(4)、确定两个门限值t1,t2,对梯度的最大最小值进行如下比较,以确定方向性D:
1)如果
Figure PCTCN2016113973-appb-000014
Figure PCTCN2016113973-appb-000015
则D=0;
2)如果
Figure PCTCN2016113973-appb-000016
则进入步骤3),否则进入步骤4)
3)如果
Figure PCTCN2016113973-appb-000017
则D=2,否则D=1;
4)如果
Figure PCTCN2016113973-appb-000018
则D=4,否则D=3。
在一具体的实施例中,亮度像素块对应的图像区域的变化强度
Figure PCTCN2016113973-appb-000019
可以通过以下的方式计算得到:
(1)、计算亮度像素块对应的图像区域的变化强度A:
Figure PCTCN2016113973-appb-000020
(2)、A被进一步量化为[0,4]中的一个整数,量化的值被记做
Figure PCTCN2016113973-appb-000021
303:确定所述多个第一色度像素块各自的第二索引,所述第二索引代表所述第一色度像素块在第二分类中所归属的类别,所述第二索引和所述滤波器索引具有第二对应关系,所述第一对应关系和所述第二对应关系相同。
在本发明实施例中,与第一索引相类似,所述第二索引代表所述第一色度 像素块在第二分类中所归属的类别,并且,第二索引和所述滤波器索引之间的第二对应关系与第一索引和所述滤波器索引之间的第一对应关系相类似,具体请参阅第一索引以及第一索引与所述滤波器索引之间的第一对应关系的描述,此处不再展开描述。
在本发明实施例中,所述第一对应关系和所述第二对应关系是相同的。举例说明,如果第一对应关系为:当第一索引的值为“0”时,对应的为a类滤波器;当第一索引的值为“1”时,对应的为b类滤波器;第一索引的值为“2”时,对应的为c类滤波器;第一索引的值为“3”时,对应的为d类滤波器。第二对应关系为:当第二索引的值为“0”时,对应的为a类滤波器;当第二索引的值为“1”时,对应的为b类滤波器;第二索引的值为“2”时,对应的为c类滤波器;第二索引的值为“3”时,对应的为d类滤波器,则所述第一对应关系和所述第二对应关系是相同的。示例仅仅用于解释本发明实施例,不应构成限定。
可以理解,当所述第一对应关系和所述第二对应关系是相同的时,对第一色度像素块进行滤波时所使用到的滤波器往往是对亮度像素块进行滤波时所使用到的滤波器。所以,不需要额外传送对第一色度像素块进行滤波的滤波器的滤波系数,减少了传送滤波器的滤波系数所占用的码率。
在本发明实施例中,数字视频装置确定所述多个第一色度像素块各自的第二索引的方式可以包括:方式一、数字视频装置根据第二关系,确定每个所述第一色度像素块的第二索引。其中,所述第二关系代表所述第一色度像素块对应的图像区域的纹理方向性和变化强度,所述第二关系根据所述第一色度像素块中预设位置的像素点和所述第一色度像素块中预置位置的像素点的邻域像素点确定。方式二、数字视频装置将和所述第一色度像素块对应相同图像区域的所述亮度像素块的所述第一索引作为所述第二索引。
在方式一中,数字视频装置根据第二关系,确定每个所述第一色度像素块的第二索引与上一步骤中,数字视频装置根据第一关系,确定每个所述亮度像素块的第一索引相类似,此处不在展开描述。举个例子进行说明,如图9所示,数字视频装置根据第一关系确定的每个所述亮度像素块的第一索引如图9(a)所示,根据第二关系确定的每个所述第一色度像素块的第二索引如图9(b)所示。可以看出,通过本实施方式确定的每个所述亮度像素块的第一索引和对应的所述第一色度像素块的第二索引之间没有什么关联。示例仅仅用于解释本发明实施例,不应构成限定。其中,第一关系和第二关系可以是相同的,也可以是不同的。
可以理解的是采用方式一确定第二索引,可以准确地计算出每个第一色度像素块的第二索引,使用更合适的滤波器对对应的第一色度像素块进行滤波,从而提高了滤波的精度。
在方式二中,数字视频装置将和所述第一色度像素块对应相同图像区域的所述亮度像素块的所述第一索引作为所述第二索引。举个例子进行说明,如图10所示,图10(a)左上角的亮度像素块(图中虚线圆框所示)和图10(b)左上角的第一色度像素块(图中虚线圆框所示)对应相同的图像区域,所以,图10(b)左上角的第一色度像素块直接使用图10(a)左上角的亮度像素块的所述第一索引作为所述第二索引。图10(b)中的其他第一色度像素块也同样如此。可以看出,通过本实施方式确定的每个第一色度像素块的第二索引关联于对应的亮度像素块的第一索引。示例仅仅用于解释本发明实施例,不应构成限定。
可以理解的是,采用方式二确定第二索引,可以避免计算第二索引所产生的计算量,减轻了数字视频装置的计算负荷,提高了处理的速度。
304:使用所述第一索引对应的滤波器对所述多个亮度像素块进行滤波。
305:使用所述第二索引对应的滤波器对所述多个第一色度像素块进行所述滤波。
可以理解的是,本发明实施例通过第二索引对应的多个滤波器对所述多个第一色度像素块进行所述滤波,能够提高图像的滤波精度,减少图像的失真率。
进一步地,数字视频装置在使用所述第二索引对应的滤波器对所述多个第一色度像素块进行所述滤波之后,还可以为第二色度像素块确定目标滤波器,并使用目标滤波器对多个第二色度像素块进行滤波,从而进一步提高图像的滤波精度,减少图像的失真率。下面结合将详细说明本发明实施例提供的几种确定目标滤波器的方式。
在第一方式中,数字视频装置将与每个所述第二色度块像素块对应相同图像区域的所述第一色度像素块的第二索引对应的滤波器作为所述目标滤波器。即,在本发明实施例中,第二色度块像素块本身不具有索引,而是直接复用对应相同图像区域的第一色度像素块的第二索引,从而减少了编码器将索引传输给解码器时所占用的码率。
在第二方式中,数字视频装置确定所述多个第二色度像素块各自的第三索引,并将所述第三索引对应的滤波器作为目标滤波器。
在本发明实施例中,与第一索引相类似,所述第三索引代表所述第一色度像素块在第三分类中所归属的类别,并且,第三索引和所述滤波器索引之间的第三对应关系与第一索引和所述滤波器索引之间的第一对应关系相类似,具体请参阅第一索引以及第一索引与所述滤波器索引之间的第一对应关系的描述,此处不再展开描述。
在本发明实施例中,所述第一对应关系、所述第二对应关系和所述第三关 系是相同的。可以理解,当所述第一对应关系、所述第二对应关系和所述第三关系是相同的时,对第一色度像素块和第二色度像素块进行滤波时所使用到的滤波器与对亮度像素块进行滤波时所使用到的滤波器往往是重合的。所以,不需要额外传送对第一色度像素块和第二色度像素块进行滤波的滤波器的滤波系数,减少了传送滤波器的滤波系数所占用的码率。
下面将结合图11至图13对数字视频装置确定所述多个第二色度像素块各自的第三索引的几种方式分别进行说明。
(1)、数字视频装置根据第三关系,确定每个所述第二色度像素块的第三索引,并使用第三索引对应的滤波器作为目标滤波器。其中,所述第三关系根据所述第二色度像素块中预设位置的像素点和所述第二色度像素块中预置位置的像素点的邻域像素点确定。其中,所述第三关系代表所述第二色度像素块对应的图像区域的纹理方向性和变化强度。
在本发明实施例中,数字视频装置根据第三关系,确定每个所述第二色度像素块的第三索引与上一步骤中,数字视频装置根据第三关系,确定每个所述亮度像素块的第一索引相类似,此处不在展开描述。举个例子进行说明,如图11所示,数字视频装置根据第一关系确定的第一索引如图11(a)所示,根据第二关系确定的第二索引如图11(b)所示,根据第三关系确定的第三索引如图11(c)所示。可以看出,通过本实施方式确定的对应于相同图像区域的亮度像素块的第一索引、第一色度像素块的第二索引和第二色度像素块的第三索引之间没有什么关联。
可以理解的是,所述第一关系、所述第二关系和所述第三关系中至少两者相同,或者,所述第一关系、所述第二关系和所述第三关系互不相同。
采用本实施方式,可以准确地计算出每个第二色度像素块的第三索引,使用更合适的滤波器对对应的第二色度像素块进行滤波,从而提高了滤波的精度。
(2)、数字视频装置将和所述第二色度像素块对应相同图像区域的所述亮度像素块的所述第一索引作为所述第三索引,并使用第三索引对应的滤波器作为目标滤波器。举个例子进行说明,如图12所示,图12(a)左上角的亮度像素块(图中虚线圆框所示)和图12(c)左上角的第二色度像素块(图中虚线圆框所示)对应相同的图像区域,所以,图12(c)左上角的第二色度像素块直接使用图12(a)左上角的亮度像素块的所述第一索引作为所述第三索引。图12(c)中的其他第二色度像素块也同样如此。可以看出,通过本实施方式确定的每个第二色度像素块的第三索引关联于对应的亮度像素块的第一索引。
采用本实施方式,可以避免计算第三索引所产生的计算量,减轻了数字视频装置的计算负荷,提高了处理的速度。
(3)、数字视频装置将和所述第二色度像素块对应相同图像区域的所述第一色度像素块的所述第二索引作为所述第三索引,并使用第三索引对应的滤波器作为目标滤波器。举个例子进行说明,如图13所示,图13(b)左上角的第一色度像素块(图中虚线圆框所示)和图13(c)左上角的第二色度像素块(图中虚线圆框所示)对应相同的图像区域,所以,图13(c)左上角的第二色度像素块直接使用图13(b)左上角的第一色度像素块的所述第二索引作为所述第三索引。图13(c)中的其他第二色度像素块也同样如此。可以看出,通过本实施方式确定的每个第二色度像素块的第三索引关联于对应的第一手色度像素块的第二索引。
采用本实施方式,可以避免计算第三索引所产生的计算量,减轻了数字视频装置的计算负荷,提高了处理的速度,并且,对应相同图像区域的第一色度像素块和第二色度像素块的相似性也比较大,将和所述第二色度像素块对应相同图像区域的所述第一色度像素块的所述第二索引作为所述第三索引,也能确保第三索引的精度。
在一个发明实施例中提供了一种图像滤波的方法中基于JVET-D1001,“Algorithm Description of Joint Exploration Test Model 4”,所述的自适应环路滤波器(ALF)的实现方法(可从http://phenix.int-evry.fr/jvet/下载,该参考文献的全部内容以引用的方式并入本文),进行了如下改进:
JVET-D1001中用于自适应环路滤波器块分类的亮度分量的分类方法被分别应用到色度Cb,Cr分量中。当自适应环路滤波器作用于色度分量时,不妨设(i,j)为2x2色度像素块的左上角色度像素点的坐标,设R(i,j)为该(i,j)坐标处色度的重构像素。当对亮度、色度Cb、色度Cr三种分量完成分类以后,具有相同分类索引的不同的亮度、色度Cb、色度Cr分量块被合并在一起作为一个分类,共享同一个自适应环路滤波器。所以,在改进方案中,不需要分别对色度和亮度传输不同的滤波器系数。对于色度分量和亮度分量,用于自适应滤波器块分类的索引和自适应环路滤波器的系数的对应关系是一致的。
另外,在图片级共享的辅助信息中,会编码1个标示,来表明是否适用D1001中的自适应环路滤波器方案还是本发明实施例的方案。
在一种可行的实施方式中,用于色度的自适应环路滤波器以CTU为单位进行开启或关闭的控制,每个CTU中会编码1个表示自适应环路滤波器是否用于该CTU内的两个色度分量。
基于JVET标准组织的通用测试条件,实验表明,本发明实施例,对于色度分量,相同视频质量下可以取得3%左右的码率节省。
本发明实施例还提供了一种图像分块控制方法,通过实施本发明实施例提供的图像分块控制方法,能够分块控制是否进行滤波,从而提高滤波的精度。如图14所示,本发明实施例的图像分块控制方法包括如下步骤:
401:将所述待处理图像的亮度像素点按照第一结构分成多个亮度控制块, 所述亮度控制块包含一个或多个相邻的所述亮度像素点。
在本发明实施例中,数字视频装置将所述待处理图像的亮度像素点按照第一结构分成的多个亮度控制块之间的大小可以是相同的,也可以是不相同的。例如,如图15(a)所示,每个方格代表一个亮度控制块,每个亮度控制块之间大小相同,如图15(b)所示,每个方格代表一个亮度控制块,亮度控制块之间大小不一。
在一具体的实施例中,数字视频装置将所述待处理图像的亮度像素点按照第一结构分成多个亮度控制块的方法具体为:将所述待处理图像的亮度像素点按照预设大小划分成一个或多个等尺寸的第一初分块;对所述第一初分块进行四叉树或者二叉树划分,划分成多个所述亮度控制块。举个例子进行说明,首先,如图16(a)所示,数字视频装置将所述待处理图像的亮度像素点按照预设大小划分成四个等尺寸的第一初分块,然后,对每个第一初分块进行第一次四叉树划分迭代,从而得到如图16(b)所示的结果,最后,对每个第一初分块进行第二次四叉树划分迭代,从而得到如图16(c)所示结果。可以理解的是,上述例子中,以对第一初分块进行两次迭代为例进行说明,在其他的实施例中,对第一初分块进行迭代的次数还可以是1次、3次、4次或者更多,本发明不作具体限定。另外,上述例子中,以对第一初分块进行四叉树为例进行说明,在其他的实施例中,对第一初分块进行迭代划分的方式还可以是不对称的,例如,将第一初分块分成大小不等的两个块等等,本发明不作具体限定。
402:确定所述待处理图像的亮度滤波标识,所述亮度滤波标识代表是否对所述待处理图像中的每个所述亮度控制块各自执行滤波。
在本发明实施例中,亮度滤波标识至少包括第一值和第二值,当所述亮度滤波标识为第一值时,表征对所述待处理图像中的对应的亮度控制块执行滤波,当所述亮度滤波标识为第二值时,表征不对所述待处理图像中的对应的亮度控 制块执行滤波。例如,如图17所示,每个方框代表一个亮度控制块,方框中的数字即为对应的亮度控制块的滤波标识,当亮度滤波标识为“0”时,表示不对对应的亮度控制块的执行滤波,当亮度滤波标识为“1”时,表示对对应的亮度控制块的执行滤波。
在本发明实施例中,数字视频装置确定所述待处理图像的亮度滤波标识包括:如果本发明实施例的图像滤波方法应用于解码器,则可以通过解码码流的方式,获得所述亮度滤波器标识。如果本发明实施例的图像滤波方法应用于编码器,则在多种预设的候选亮度滤波标识中,选择编码代价最小的一种所述候选亮度滤波标识作为所述待处理图像的亮度滤波标识。
403:将所述待处理图像的第一色度像素点分成多个第一色度控制块,所述第一色度控制块包含一个或多个相邻的所述第一色度像素点。
在本发明实施例中,数字视频装置将所述待处理图像的第一色度像素点分成多个第一色度控制块的方式包括:(1)将所述待处理图像的第一色度像素点按照第一结构分成多个第一色度控制块。(2)将所述待处理图像的第一色度像素点按照第二结构分成多个第一色度控制块。其中,数字视频装置将所述待处理图像的第一色度像素点按照第一结构或者第二结构分成多个第一色度控制块的方法均与数字视频装置将所述待处理图像的亮度像素点按照第一结构分成多个亮度控制块的方法相类似,此处不再展开赘述。
可以理解,与亮度控制块相类似,数字视频装置将所述待处理图像的第一色度像素点按照第一结构或者第二结构分成的多个第一色度控制块之间的大小可以是相同的,也可以是不相同的,具体请参阅亮度控制块的描述,此处不再展开描述。
可以理解的是,第一结构和第二结构可以是相同的,也可以是不同的。例如,如图18所示,第一结构和第二结构是相同的,如图19所示,第一结构和 第二结构是不相同的。
404:确定所述待处理图像的第一色度滤波标识,所述第一色度滤波标识代表是否对所述待处理图像中的每个第一色度控制块各自执行所述滤波。
在本发明实施例中,确定所述待处理图像的第一色度滤波标识包括:如果本发明实施例的图像滤波方法应用于解码器,则可以通过解码码流的方式,获得所述第一色度滤波标识。如果本发明实施例的图像滤波方法应用于编码器,则在多种预设的候选第一色度滤波标识中,选择编码代价最小的一种所述候选第一色度滤波标识作为所述待处理图像的第一色度滤波标识。
在本发明实施例中,当第一结构和第二结构是不相同的时候,数字视频装置可以根据上一自然段提供的方法确定所述待处理图像的第一色度滤波标识,举个例子说明,图20所示,图20a中的每个方框用于表示一个亮度控制块,方框中的数字用于表示对应的亮度控制块的亮度滤波标识,图20b中的每个方框用于表示一个第一色度控制块,方框中的数字用于表示对应的第一色度控制块的第一色度滤波标识。可以看出,每个亮度控制块的亮度滤波标识(图20a)和每个第一色度控制块的第一色度滤波标识(图20b)均是独立的,两者之间不存在什么关联。
通过本实施方式,可以实现按照实际需要对亮度像素点和第一色度像素点进行不同结构的划分,从而提高滤波控制的自由度,提高滤波的精度。而且,亮度控制块的亮度滤波标识和第一色度控制块的第一色度滤波标识分别独立设置,可以进一步提高滤波控制的自由度,也进一步提高滤波的精度。
在本发明实施例中,当第一结构和第二结构是相同的时候,数字视频装置可以是根据上两个自然段提供的方法确定所述待处理图像的第一色度滤波标识。例如,如图21所示,图21a中的每个方框用于表示一个亮度控制块,方框中的数字用于表示对应的亮度控制块的亮度滤波标识,图21b中的每个方框 用于表示一个第一色度控制块,方框中的数字用于表示对应的第一色度控制块的第一色度滤波标识。可以看出,每个亮度控制块的亮度滤波标识(图21a)和每个第一色度控制块的第一色度滤波标识(图21b)均是独立的,两者之间不存在什么关联。
通过本实施方式,可以使得对亮度像素点和第一色度像素点的划分更容易实现,而且,亮度控制块的亮度滤波标识和第一色度控制块的第一色度滤波标识分别独立设置,可以提高滤波控制的自由度,提高滤波的精度。
此外,数字视频装置还可以根据所述亮度滤波标识映射获得所述第一色度滤波标识。例如,如图22所示,图22(b)中的每个方框用于表示一个第一色度控制块,方框中的数字用于表示对应的第一色度控制块的第一色度滤波标识,图22(c)中的每个方框用于表示一个第二色度控制块,方框中的数字用于表示对应的第二色度控制块的第二色度滤波标识。图22(b)左上角的第一色度控制块(图中虚线圆框所示)的第一色度滤波标识设置为与对应于相同位置的图22(a)左上角的亮度控制块(图中虚线圆框所示)的亮度滤波标识相同。图22(b)中的其他第一色度控制块也同样如此。可以看出,每个第一色度控制块的第一色度滤波标识关联于对应于相同位置的亮度控制块的亮度滤波标识。
通过本实施方式,可以使得对亮度像素点和第一色度像素点的划分更容易实现。而且,亮度控制块的亮度滤波标识和第一色度控制块的第一色度滤波标识是相关联的,可以简化滤波标识的设置,也可以减少编码器将滤波标识传输给解码器所占用的码率。
进一步地,数字视频装置在确定所述待处理图像的第一色度滤波标识之后,还可以将待处理图像的第二色度像素点划分为多个第二色度控制块,然后,确 定所述待处理图像的第二色度滤波标识,以确定是否对待处理图像的每个第二色度控制块进行滤波,从而进一步提高图像的滤波精度,减少图像的失真率。
在本发明实施例中,将待处理图像的第二色度像素点划分为多个第二色度控制块的方式包括:
(1)、数字视频装置将所述待处理图像的第二色度像素点按照所述第一结构分成多个所述第二色度控制块。举个例子进行说明,如图23所示,图23(a)中每个方格代表一个亮度控制块,图23(b)中每个方格代表一个第一色度控制块,图23(c)中每个方格代表一个第二色度控制块。其中,待处理图像的亮度像素点和第二色度像素点均采用第一结构进行划分从而获得如图23(a)所示的多个亮度控制块以及如图23(c)所示的多个第二色度控制块。
在此时,数字视频装置可以参照步骤402中确定所述待处理图像的亮度滤波标识的方法确定第二色度滤波标识,具体请参见相关描述。举个例子进行说明,如图24所示,图24(a)中每个方格代表一个亮度控制块,方格中的数字代表该亮度控制块的亮度滤波标识,图24(b)中每个方格代表一个第一色度控制块,方格中的数字代表该第一色度控制块的第一色度滤波标识,图24(c)中每个方格代表一个第二色度控制块,方格中的数字代表该第二色度控制块的第二色度滤波标识。可以看出,尽管待处理图像的亮度像素点和第二色度像素点均采用第一结构进行划分从而获得如图24(a)所示的多个亮度控制块以及如图24(c)所示的多个第二色度控制块,但是,每个亮度控制块的亮度滤波标识和每个第一色度控制块的第一色度滤波标识均是独立的,两者之间不存在什么关联。
通过本实施方式,可以使得对亮度像素点和第二色度像素点的划分更容易实现,而且,亮度控制块的亮度滤波标识和第二色度控制块的第二色度滤波标识分别独立设置,可以提高滤波控制的自由度,提高滤波的精度。
数字视频装置还可以根据所述亮度滤波标识映射获得所述第二色度滤波标识。举个例子进行说明,如图25所示,图25(a)中每个方格代表一个亮度控制块,方格中的数字代表该亮度控制块的亮度滤波标识,图25(b)中每个方格代表一个第一色度控制块,方格中的数字代表该第一色度控制块的第一色度滤波标识,图25(c)中每个方格代表一个第二色度控制块,方格中的数字代表该第二色度控制块的第二色度滤波标识。图25(c)左上角的第二色度控制块(图中虚线圆框所示)的第二色度滤波标识设置为与对应于相同位置的图25(a)左上角的亮度控制块(图中虚线圆框所示)的亮度滤波标识相同。图25(c)中的其他第二色度控制块也同样如此。可以看出,待处理图像的亮度像素点和第二色度像素点均采用第一结构进行划分从而获得如图25(a)所示的多个亮度控制块以及如图25(c)所示的多个第二色度控制块,而且,每个第二色度控制块的第二色度滤波标识关联于对应于相同位置的亮度控制块的亮度滤波标识。
通过本实施方式,可以使得对亮度像素点和第二色度像素点的划分更容易实现。而且,亮度控制块的亮度滤波标识和第二色度控制块的第二色度滤波标识是相关联的,可以简化滤波标识的设置,也可以减少编码器将滤波标识传输给解码器所占用的码率。
(2)、数字视频装置将所述待处理图像的第二色度像素点按照所述第二结构分成多个所述第二色度控制块。举个例子进行说明,如图26所示,图26(a)中每个方格代表一个亮度控制块,图26(b)中每个方格代表一个第一色度控制块,图26(c)中每个方格代表一个第二色度控制块。其中,待处理图像的第一色度像素点(图26b)和第二色度像素点(图26c)均采用第二结构进行划分从而获得如图26(b)所示的多个第一色度控制块以及如图26(c)所示的多个第二色度控制块。
在此时,数字视频装置可以参照步骤402中确定所述待处理图像的亮度滤波标识的方法获得第二色度滤波标识,具体请参见相关描述。举个例子进行说明,如图27所示,图27(a)中每个方格代表一个亮度控制块,方格中的数字代表该亮度控制块的亮度滤波标识,图27(b)中每个方格代表一个第一色度控制块,方格中的数字代表该第一色度控制块的第一色度滤波标识,图27(c)中每个方格代表一个第二色度控制块,方格中的数字代表该第二色度控制块的第二色度滤波标识。可以看出,尽管待处理图像的第一色度像素点和第二色度像素点均采用第二结构进行划分从而获得如图27(b)所示的多个第一色度控制块以及如图27(c)所示的多个第二色度控制块,但是,每个第一色度控制块的第一色度滤波标识和每个第二色度控制块的第二色度滤波标识均是独立的,两者之间不存在什么关联。
通过本实施方式,可以使得对第一色度像素点和第二色度像素点的划分更容易实现,而且,第一色度控制块的第一色度滤波标识和第二色度控制块的第二色度滤波标识分别独立设置,可以提高滤波控制的自由度,提高滤波的精度。
数字视频装置还可以根据所述第一色度滤波标识映射获得所述第二色度滤波标识。举个例子进行说明,如图28所示,图28(a)中每个方格代表一个亮度控制块,方格中的数字代表该亮度控制块的亮度滤波标识,图28(b)中每个方格代表一个第一色度控制块,方格中的数字代表该第一色度控制块的第一色度滤波标识,图28(c)中每个方格代表一个第二色度控制块,方格中的数字代表该第二色度控制块的第二色度滤波标识。图28(c)左上角的第二色度控制块(图中虚线圆框所示)的第二色度滤波标识设置为与对应于相同位置的图28(b)左上角的第一色度控制块(图中虚线圆框所示)的第一色度滤波标识相同。图28(c)中的其他第二色度控制块也同样如此。可以看出,待处理图像的第一色度像素点和第二色度像素点均采用第二结构进行划分从而 获得如图28(b)所示的多个第一色度控制块以及如图28(c)所示的多个第二色度控制块,而且,每个第二色度控制块的第二色度滤波标识关联于对应于相同位置的第一色度控制块的第一色度滤波标识。
通过本实施方式,可以使得对第一色度像素点和第二色度像素点的划分更容易实现。而且,第一色度控制块的第一色度滤波标识和第二色度控制块的第二色度滤波标识是相关联的,可以简化滤波标识的设置,也可以减少编码器将滤波标识传输给解码器所占用的码率。
(3)、数字视频装置将所述待处理图像的第二色度像素点按照所述第三结构分成多个所述第二色度控制块。其中,数字视频装置将所述待处理图像的第二色度像素点按照第第三结构分成多个第二色度控制块的方法均与数字视频装置将所述待处理图像的亮度像素点按照第一结构分成多个亮度控制块的方法相类似,此处不再展开赘述。
在本发明实施例中,与亮度控制块相类似,数字视频装置将所述待处理图像的第二色度像素点按照第三结构分成的多个第二色度控制块之间的大小可以是相同的,也可以是不相同的,具体请参阅亮度控制块的描述,此处不再展开描述。
可以理解的是,所述第一结构、第二结构和第三结构中至少两者相同,或者,所述第一结构、所述第二结构和所述第三结构互不相同。在一可选的实施例中,所述第一结构的最小划分单元为图6对应的方法中所述的亮度像素块,所述第二结构的最小划分单元为图6对应的方法中所述的所述第一色度像素块,所述第三结构的最小划分单元为图6对应的方法中所述的所述第二色度像素块。
本发明实施例还提出了一种图像滤波方法,可以先使用图14所示的图像 分块控制方法,对亮度像素点、第一色度像素点以及第二色度像素点进行分块控制,然后,再使用如图6所示的图像滤波方式对待处理图像进行滤波,以获得更加良好的图像滤波精度。需要注意的是,此时,所述第一结构的最小划分单元为图6对应的方法中所述的亮度像素块,所述第二结构的最小划分单元为图6对应的方法中所述的第一色度像素块,所述第三结构的最小划分单元为图6对应的方法中所述的第二色度像素块。
请参阅图29,本发明实施例还提供一种图像滤波装置,用于执行前述图6实施例描述的一种图像滤波方法。
如图29所示,图像滤波装置70可包括:集合确定单元701、第一索引确定单元702、第二索引确定单元703、第一滤波单元704以及第二滤波单元705。其中:
集合确定单元701用于确定所述待处理图像对应的滤波器集合,所述滤波器集合包括一个或多个滤波器,所述一个或多个滤波器具有各自的滤波器索引;
第一索引确定单元702用于确定所述多个亮度像素块各自的第一索引,所述第一索引代表所述亮度像素块在第一分类中所归属的类别,所述第一索引和所述滤波器索引具有第一对应关系;
第二索引确定单元703用于确定所述多个第一色度像素块各自的第二索引,所述第二索引代表所述第一色度像素块在第二分类中所归属的类别,所述第二索引和所述滤波器索引具有第二对应关系,所述第一对应关系和所述第二对应关系相同;
第一滤波单元704用于使用所述第一索引对应的滤波器对所述多个亮度像素块进行滤波;
第二滤波单元705用于使用所述第二索引对应的滤波器对所述多个第一 色度像素块进行所述滤波。
需要说明的,通过前述图6实施例的详细描述,本领域技术人员可以清楚的知道图像滤波装置70所包含的各个功能模块的实现方法,所以为了说明书的简洁,在此不再详述。
请参阅图30,本发明实施例还提供一种图像分块控制装置,用于执行前述图14实施例描述的一种图像分块控制方法。
如图30所示,图像分块控制装置80可包括:亮度分块单元801、亮度标识确定单元802、第一色度分块单元803以及第一色度标识确定单元804。其中:
亮度分块单元801用于将所述待处理图像的亮度像素点按照第一结构分成多个亮度控制块,所述亮度控制块包含一个或多个相邻的所述亮度像素点。
亮度标识确定单元802用于确定所述待处理图像的亮度滤波标识,所述亮度滤波标识代表是否对所述待处理图像中的每个所述亮度控制块各自执行滤波。
第一色度分块单元803用于将所述待处理图像的第一色度像素点分成多个第一色度控制块,所述第一色度控制块包含一个或多个相邻的所述第一色度像素点。
第一色度标识确定单元804用于确定所述待处理图像的第一色度滤波标识,所述第一色度滤波标识代表是否对所述待处理图像中的每个第一色度控制块各自执行所述滤波。
需要说明的,通过前述图14实施例的详细描述,本领域技术人员可以清楚的知道图像分块控制装置80所包含的各个功能模块的实现方法,所以为了说明书的简洁,在此不再详述。
如图31所示,本发明实施例还提供一种图像滤波装置,包括图30所示的图像分块控制装置80以及图29所示的图像滤波装置70。其中,图30所示的图像分块控制装置80用于执行前述图14实施例描述的一种图像分块控制方法,图29所示的图像滤波装置70用于执行前述图6实施例描述的一种图像滤波方法。需要注意的是,此时,所述第一结构的最小划分单元为图6对应的方法中所述的亮度像素块,所述第二结构的最小划分单元为图6对应的方法中所述的第一色度像素块,所述第三结构的最小划分单元为图6对应的方法中所述的第二色度像素块。
如图32所示的一种图像滤波方法1000,待处理图像包括多个亮度像素块和多个第一色度像素块,亮度像素块包含多个相邻的亮度像素点,第一色度像素块包含多个相邻的第一色度像素点,方法包括:S1001、获取亮度像素块的第一索引,第一索引代表亮度像素块对应的图像性质所适用的滤波器类型;
在一种可行的实施方式中,获取亮度像素块的第一索引,包括:根据第一关系对亮度像素块分类,获得第一索引,第一关系包括亮度像素块对应的图像区域的纹理方向性和变化强度。
在一种可行的实施方式中,亮度像素块对应的图像区域的纹理方向性和变化强度由亮度像素块中预设位置的像素点和亮度像素块中预置位置的像素点的邻域像素点确定。
S1002、获取第一色度像素块的第二索引,第二索引代表第一色度像素块对应的图像性质所适用的滤波器类型;
在一种可行的实施方式中,获取第一色度像素块的第二索引,包括:根据第二关系对第一色度像素块分类,获得第二索引,第二关系包括第一色度像素块对应的图像区域的纹理方向性和变化强度。
在一种可行的实施方式中,第一色度像素块对应的图像区域的纹理方向性和变化强度由第一色度像素块中预设位置的像素点和第一色度像素块中预置位置的像素点的邻域像素点确定。
本发明实施例的有益效果在于:可以准确地计算出每个第一色度像素块的第二索引,使用更合适的滤波器对对应的第一色度像素块进行滤波,从而提高了滤波的精度。
在一种可行的实施方式中,获取第一色度像素块的第二索引,包括:将和第一色度像素块对应相同图像区域的亮度像素块的第一索引作为第二索引。
本发明实施例的有益效果在于:第一色度块像素块本身不具有索引,而是直接复用对应相同图像区域的亮度像素块的第一索引,从而减少了编码器将索引传输给解码器时所占用的码率。
S1004、对亮度像素块使用第一索引在滤波器集合中对应的滤波器进行滤波;
S1005、对第一色度像素块使用第二索引在滤波器集合中对应的滤波器进行滤波。
本发明实施例的有益效果在于:对第一色度像素块进行滤波时所使用到的滤波器往往是对亮度像素块进行滤波时所使用到的滤波器。所以,不需要额外传送对第一色度像素块进行滤波的滤波器的滤波系数,减少了传送滤波器的滤波系数所占用的码率。
在一种可行的实施方式中,还包括:当第一索引和第二索引相同时,第一索引对应的滤波器和第二索引对应的滤波器相同。
在一种可行的实施方式中,待处理图像还包括多个第二色度像素块,第二色度像素块包含多个相邻的第二色度像素点,在获取第一色度像素块的第二索引之后,还包括:
S1003、获取第二色度像素块的第三索引,第三索引代表第二色度像素块 对应的图像性质所适用的滤波器类型;
在一种可行的实施方式中,获取第二色度像素块的第三索引,包括:根据第三关系对第二色度像素块分类,获得第三索引,第三关系包括第二色度像素块对应的图像区域的纹理方向性和变化强度。
在一种可行的实施方式中,第二色度像素块对应的图像区域的纹理方向性和变化强度由第二色度像素块中预设位置的像素点和第二色度像素块中预置位置的像素点的邻域像素点确定。
本发明实施例的有益效果在于:可以准确地计算出每个第二色度像素块的第三索引,使用更合适的滤波器对对应的第二色度像素块进行滤波,从而提高了滤波的精度。
在一种可行的实施方式中,获取第二色度像素块的第三索引,包括:将和第二色度像素块对应相同图像区域的亮度像素块的第一索引作为第三索引;或者,将和第二色度像素块对应相同图像区域的第一色度像素块的第二索引作为第三索引。
本发明实施例的有益效果在于:第二色度块像素块本身不具有索引,而是直接复用对应相同图像区域的第一色度像素块的第二索引,从而减少了编码器将索引传输给解码器时所占用的码率。
对应的,在对第一色度像素块使用第二索引在滤波器集合中对应的滤波器进行滤波之后,还包括:
S1006、对第二色度像素块使用第三索引在滤波器集合中对应的滤波器进行滤波。
本发明实施例的有益效果在于:在使用第二索引对应的滤波器对多个第一色度像素块进行滤波之后,还可以为第二色度像素块确定目标滤波器,并使用目标滤波器对多个第二色度像素块进行滤波,从而进一步提高图像的滤波精度, 减少图像的失真率。
在一种可行的实施方式中,包括:第一关系、第二关系和第三关系中至少两者相同。
本发明实施例的有益效果在于:当第一对应关系、第二对应关系和第三关系是相同的时,对第一色度像素块和第二色度像素块进行滤波时所使用到的滤波器与对亮度像素块进行滤波时所使用到的滤波器往往是重合的。所以,不需要额外传送对第一色度像素块和第二色度像素块进行滤波的滤波器的滤波系数,减少了传送滤波器的滤波系数所占用的码率。
在一种可行的实施方式中,包括:第一关系、第二关系和第三关系互不相同。
在一种可行的实施方式中,包括:第一色度像素块的尺寸大于亮度像素块的尺寸;第二色度像素块的尺寸大于亮度像素块的尺寸。
本发明实施例的有益效果在于:可以根据色度和亮度块包含图像细节的不同采用不同的处理方式,提高了处理效率。
在一种可行的实施方式中,方法用于解码器,在获取亮度像素块的第一索引之前,还包括:解析码流,获取滤波器集合的信息。
在一种可行的实施方式中,方法用于编码器,在获取亮度像素块的第一索引之前,还包括:从预设候选滤波器集合中,选择编码代价最小的候选滤波器集合作为滤波器集合;编码滤波器集合的信息。
在一种可行的实施方式中,在获取亮度像素块的第一索引之前,还包括:
S1011、将待处理图像的亮度像素点按照第一结构分成多个亮度控制块,亮度控制块包含一个或多个相邻的亮度像素块;
在一种可行的实施方式中,将待处理图像的亮度像素点按照第一结构分成多个亮度控制块,包括:将待处理图像的亮度像素点按照预设大小划分成一个 或多个等尺寸的第一初分块;对第一初分块进行四叉树或者二叉树划分,划分成多个亮度控制块。
本发明实施例的有益效果在于:使图像区域的划分更加灵活,更有利用区域性的滤波。
S1012、确定待处理图像中需要进行滤波的一个或多个亮度控制块,亮度滤波标识代表是否对待处理图像中的每个亮度控制块各自执行滤波。
在一种可行的实施方式中,方法用于解码器,确定待处理图像中需要进行滤波的一个或多个亮度控制块,包括:解码码流,获得亮度滤波标识的信息。
在一种可行的实施方式中,方法用于编码器,确定待处理图像中需要进行滤波的一个或多个亮度控制块,包括:从预设候选亮度滤波标识集合中,选择编码代价最小的候选亮度滤波标识作为亮度滤波标识。
在一种可行的实施方式中,在确定待处理图像中需要进行滤波的一个或多个亮度控制块之后,还包括:编码亮度滤波标识的信息。
本发明实施例的有益效果在于:独立控制图像各个不同区域的滤波,提高了滤波方法的适用性。
在一种可行的实施方式中,在确定待处理图像中需要进行滤波的一个或多个亮度控制块之后,还包括:
S1014、确定待处理图像中需要进行滤波的一个或多个第一色度控制块,第一色度滤波标识代表是否对待处理图像中的每个第一色度控制块各自执行滤波,第一色度控制块包含一个或多个相邻的第一色度像素块。
在一种可行的实施方式中,方法用于解码器,确定待处理图像中需要进行滤波的一个或多个第一色度控制块,包括:解码码流,获得第一色度滤波标识的信息。
在一种可行的实施方式中,方法用于编码器,确定待处理图像中需要进行 滤波的一个或多个第一色度控制块,包括:从预设候选第一色度滤波标识集合中,选择编码代价最小的候选第一色度滤波标识作为第一色度滤波标识。
在一种可行的实施方式中,在确定待处理图像中需要进行滤波的一个或多个第一色度控制块之后,还包括:编码第一色度滤波标识的信息。
本发明实施例的有益效果在于:独立控制图像各个不同区域的滤波,提高了滤波方法的适用性。
在一种可行的实施方式中,在确定待处理图像中需要进行滤波的一个或多个第一色度控制块之前,还包括:
S1013、将待处理图像的第一色度像素点按照第一结构分成多个第一色度控制块;对应的,确定待处理图像中需要进行滤波的一个或多个第一色度控制块,包括:根据亮度滤波标识映射获得第一色度滤波标识。
本发明实施例的有益效果在于:可以使得对亮度像素点和第一色度像素点的划分更容易实现。而且,亮度控制块的亮度滤波标识和第一色度控制块的第一色度滤波标识是相关联的,可以简化滤波标识的设置,也可以减少编码器将滤波标识传输给解码器所占用的码率。
在一种可行的实施方式中,在确定待处理图像中需要进行滤波的一个或多个第一色度控制块之前,还包括:
S1013’、将待处理图像的第一色度像素点按照第二结构分成多个第一色度控制块。
本发明实施例的有益效果在于:通过本实施方式,可以实现按照实际需要对亮度像素点和第一色度像素点进行不同结构的划分,从而提高滤波控制的自由度,提高滤波的精度。而且,亮度控制块的亮度滤波标识和第一色度控制块的第一色度滤波标识分别独立设置,可以进一步提高滤波控制的自由度,也进一步提高滤波的精度。
在一种可行的实施方式中,将待处理图像的第一色度像素点按照第二结构分成多个第一色度控制块,包括:将待处理图像的第一色度像素点按照预设大小划分成一个或多个等尺寸的第二初分块;对第二初分块进行四叉树或者二叉树划分,划分成多个第一色度控制块。
在一种可行的实施方式中,在确定待处理图像中需要进行滤波的一个或多个第一色度控制块之后,还包括:
S1016、确定待处理图像中需要进行滤波的一个或多个第二色度控制块,第二色度滤波标识代表是否对待处理图像中的每个第二色度控制块各自执行滤波,第二色度控制块包含一个或多个相邻的第二色度像素块。
在一种可行的实施方式中,方法用于解码器,确定待处理图像中需要进行滤波的一个或多个第二色度控制块,包括:解码码流,获得第二色度滤波标识的信息。
在一种可行的实施方式中,方法用于编码器,确定待处理图像中需要进行滤波的一个或多个第二色度控制块,包括:从预设候选第二色度滤波标识集合中,选择编码代价最小的候选第二色度滤波标识作为第二色度滤波标识。
在一种可行的实施方式中,在确定待处理图像中需要进行滤波的一个或多个第二色度控制块之后,还包括:编码第二色度滤波标识的信息。
本发明实施例的有益效果在于:在确定待处理图像中需要进行滤波的一个或多个第一色度控制块之后,还可以将待处理图像的第二色度像素点划分为多个第二色度控制块,然后,确定待处理图像中需要进行滤波的一个或多个第二色度控制块,以确定是否对待处理图像的每个第二色度控制块进行滤波,从而进一步提高图像的滤波精度,减少图像的失真率。
在一种可行的实施方式中,在确定待处理图像中需要进行滤波的一个或多个第二色度控制块之前,还包括:
S1015、将待处理图像的第二色度像素点按照第一结构分成多个第二色度控制块;对应的,确定待处理图像中需要进行滤波的一个或多个第二色度控制块,包括:根据亮度滤波标识映射获得第二色度滤波标识。
本发明实施例的有益效果在于:可以使得对亮度像素点和第二色度像素点的划分更容易实现。而且,亮度控制块的亮度滤波标识和第二色度控制块的第二色度滤波标识是相关联的,可以简化滤波标识的设置,也可以减少编码器将滤波标识传输给解码器所占用的码率。
在一种可行的实施方式中,在确定待处理图像中需要进行滤波的一个或多个第二色度控制块之前,还包括:
S1015’:将待处理图像的第二色度像素点按照第二结构分成多个第二色度控制块;对应的,确定待处理图像中需要进行滤波的一个或多个第二色度控制块,包括:根据第一色度滤波标识映射获得第二色度滤波标识。
本发明实施例的有益效果在于:可以使得对第一色度像素点和第二色度像素点的划分更容易实现。而且,第一色度控制块的第一色度滤波标识和第二色度控制块的第二色度滤波标识是相关联的,可以简化滤波标识的设置,也可以减少编码器将滤波标识传输给解码器所占用的码率。
在一种可行的实施方式中,在确定待处理图像中需要进行滤波的一个或多个第二色度控制块之前,还包括:
S1015”、将待处理图像的第二色度像素点按照第三结构分成多个第二色度控制块。
在一种可行的实施方式中,将待处理图像的第二色度像素点按照第三结构分成多个第二色度控制块,包括:将待处理图像的第二色度像素点按照预设大小划分成一个或多个等尺寸的第三初分块;对第三初分块进行四叉树或者二叉树划分,划分成多个第二色度控制块。
在一种可行的实施方式中,包括:第一结构、第二结构和第三结构中至少两者相同。
在一种可行的实施方式中,包括:第一结构、第二结构和第三结构互不相同。
如图33所示的一种图像滤波装置2000,待处理图像包括多个亮度像素块和多个第一色度像素块,亮度像素块包含多个相邻的亮度像素点,第一色度像素块包含多个相邻的第一色度像素点,装置包括:获取模块2001,用于获取亮度像素块的第一索引,第一索引代表亮度像素块对应的图像性质所适用的滤波器类型;获取模块2001,还用于获取第一色度像素块的第二索引,第二索引代表第一色度像素块对应的图像性质所适用的滤波器类型;滤波模块2002,用于对亮度像素块使用第一索引在滤波器集合中对应的滤波器进行滤波;滤波模块2002,还用于对第一色度像素块使用第二索引在滤波器集合中对应的滤波器进行滤波。
在一种可行的实施方式中,还包括:当第一索引和第二索引相同时,第一索引对应的滤波器和第二索引对应的滤波器相同。
在一种可行的实施方式中,待处理图像还包括多个第二色度像素块,第二色度像素块包含多个相邻的第二色度像素点,获取模块2001还用于:获取第二色度像素块的第三索引,第三索引代表第二色度像素块对应的图像性质所适用的滤波器类型;对应的,滤波模块2002还用于:对第二色度像素块使用第三索引在滤波器集合中对应的滤波器进行滤波。
在一种可行的实施方式中,获取模块2001具体用于:根据第一关系对亮度像素块分类,获得第一索引,第一关系包括亮度像素块对应的图像区域的纹理方向性和变化强度。
在一种可行的实施方式中,亮度像素块对应的图像区域的纹理方向性和变化强度由亮度像素块中预设位置的像素点和亮度像素块中预置位置的像素点的邻域像素点确定。
在一种可行的实施方式中,获取模块2001具体用于:根据第二关系对第一色度像素块分类,获得第二索引,第二关系包括第一色度像素块对应的图像区域的纹理方向性和变化强度。
在一种可行的实施方式中,第一色度像素块对应的图像区域的纹理方向性和变化强度由第一色度像素块中预设位置的像素点和第一色度像素块中预置位置的像素点的邻域像素点确定。
在一种可行的实施方式中,获取模块2001具体用于:将和第一色度像素块对应相同图像区域的亮度像素块的第一索引作为第二索引。
在一种可行的实施方式中,获取模块2001具体用于:根据第三关系对第二色度像素块分类,获得第三索引,第三关系包括第二色度像素块对应的图像区域的纹理方向性和变化强度。
在一种可行的实施方式中,第二色度像素块对应的图像区域的纹理方向性和变化强度由第二色度像素块中预设位置的像素点和第二色度像素块中预置位置的像素点的邻域像素点确定。
在一种可行的实施方式中,获取模块2001具体用于:将和第二色度像素块对应相同图像区域的亮度像素块的第一索引作为第三索引;或者,将和第二色度像素块对应相同图像区域的第一色度像素块的第二索引作为第三索引。
在一种可行的实施方式中,包括:第一关系、第二关系和第三关系中至少两者相同。
在一种可行的实施方式中,包括:第一关系、第二关系和第三关系互不相同。
在一种可行的实施方式中,包括:第一色度像素块的尺寸大于亮度像素块的尺寸;第二色度像素块的尺寸大于亮度像素块的尺寸。
在一种可行的实施方式中,装置用于解码器,装置还包括解码模块2003,用于:解析码流,获取滤波器集合的信息。
在一种可行的实施方式中,装置用于编码器,装置还包括编码模块2004,用于:从预设候选滤波器集合中,选择编码代价最小的候选滤波器集合作为滤波器集合;编码滤波器集合的信息。
在一种可行的实施方式中,装置还包括:划分模块2005,用于将待处理图像的亮度像素点按照第一结构分成多个亮度控制块,亮度控制块包含一个或多个相邻的亮度像素块;标识模块2006,用于确定待处理图像中需要进行滤波的一个或多个亮度控制块,亮度滤波标识代表是否对待处理图像中的每个亮度控制块各自执行滤波。
在一种可行的实施方式中,划分模块2005具体用于:将待处理图像的亮度像素点按照预设大小划分成一个或多个等尺寸的第一初分块;对第一初分块进行四叉树或者二叉树划分,划分成多个亮度控制块。
在一种可行的实施方式中,装置用于解码器,解码模块2003还用于:解码码流,获得亮度滤波标识的信息。
在一种可行的实施方式中,装置用于编码器,编码模块2004还用于:从预设候选亮度滤波标识集合中,选择编码代价最小的候选亮度滤波标识作为亮度滤波标识。
在一种可行的实施方式中,在编码模块2004还用于:编码亮度滤波标识的信息。
在一种可行的实施方式中,标识模块2006还用于:确定待处理图像中需要进行滤波的一个或多个第一色度控制块,第一色度滤波标识代表是否对待处 理图像中的每个第一色度控制块各自执行滤波,第一色度控制块包含一个或多个相邻的第一色度像素块。
在一种可行的实施方式中,划分模块2005还用于:将待处理图像的第一色度像素点按照第一结构分成多个第一色度控制块;对应的,标识模块2006,还用于:根据亮度滤波标识映射获得第一色度滤波标识。
在一种可行的实施方式中,划分模块2005还用于:将待处理图像的第一色度像素点按照第二结构分成多个第一色度控制块。
在一种可行的实施方式中,划分模块2005还具体用于:将待处理图像的第一色度像素点按照预设大小划分成一个或多个等尺寸的第二初分块;对第二初分块进行四叉树或者二叉树划分,划分成多个第一色度控制块。
在一种可行的实施方式中,装置用于解码器,解码模块2003还用于:解码码流,获得第一色度滤波标识的信息。
在一种可行的实施方式中,装置用于编码器,编码模块2004还用于:从预设候选第一色度滤波标识集合中,选择编码代价最小的候选第一色度滤波标识作为第一色度滤波标识。
在一种可行的实施方式中,在编码模块2004还用于:编码第一色度滤波标识的信息。
在一种可行的实施方式中,在标识模块2006还用于:确定待处理图像中需要进行滤波的一个或多个第二色度控制块,第二色度滤波标识代表是否对待处理图像中的每个第二色度控制块各自执行滤波,第二色度控制块包含一个或多个相邻的第二色度像素块。
在一种可行的实施方式中,划分模块2005还用于:将待处理图像的第二色度像素点按照第一结构分成多个第二色度控制块;对应的,标识模块2006还用于:根据亮度滤波标识映射获得第二色度滤波标识。
在一种可行的实施方式中,划分模块2005还用于:将待处理图像的第二色度像素点按照第二结构分成多个第二色度控制块;对应的,标识模块2006还用于:根据第一色度滤波标识映射获得第二色度滤波标识。
在一种可行的实施方式中,划分模块2005还用于:将待处理图像的第二色度像素点按照第三结构分成多个第二色度控制块。
在一种可行的实施方式中,划分模块2005还具体用于:将待处理图像的第二色度像素点按照预设大小划分成一个或多个等尺寸的第三初分块;对第三初分块进行四叉树或者二叉树划分,划分成多个第二色度控制块。
在一种可行的实施方式中,装置用于解码器,解码模块2003还用于:解码码流,获得第二色度滤波标识的信息。
在一种可行的实施方式中,装置用于编码器,编码模块2004还用于:从预设候选第二色度滤波标识集合中,选择编码代价最小的候选第二色度滤波标识作为第二色度滤波标识。
在一种可行的实施方式中,编码模块2004还用于:编码第二色度滤波标识的信息。
在一种可行的实施方式中,包括:第一结构、第二结构和第三结构中至少两者相同。
在一种可行的实施方式中,包括:第一结构、第二结构和第三结构互不相同。
如图34所示,图34是本发明实施例提供的另一种图像滤波装置的示意性框图,具体如下所述。
本发明实施例提供了一种图像滤波的装置900,存储器901和耦合于所述存储器的处理器902;所述存储器用于存储代码和指令;所述处理器依照所述 代码和指令。待处理图像包括多个亮度像素块和多个第一色度像素块,所述亮度像素块包含多个相邻的亮度像素点,所述第一色度像素块包含多个相邻的第一色度像素点,所述处理器902用于执行:获取所述亮度像素块的第一索引,所述第一索引代表所述亮度像素块对应的图像性质所适用的滤波器类型;获取所述第一色度像素块的第二索引,所述第二索引代表所述第一色度像素块对应的图像性质所适用的滤波器类型;对所述亮度像素块使用所述第一索引在滤波器集合中对应的滤波器进行滤波;对所述第一色度像素块使用所述第二索引在所述滤波器集合中对应的滤波器进行所述滤波。处理器902还可以具体执行上述各实施例中的图像滤波方法的各种可行的实施方式,不再赘述。
从以上技术方案可以看出,本发明实施例提供了一种图像滤波的方法及装置,能够提高图像的滤波精度,减少图像的失真率以及减少传输滤波系数所占用的码率。
值得注意的是,上述装置只是按照功能逻辑进行划分的,但并不局限于上述的划分,只要能够实现相应的功能即可;另外,各功能单元的具体名称也只是为了便于相互区分,并不用于限制本发明的保护范围。
在本申请所提供的几个实施例中,应该理解到,所揭露的***,装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个***,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)或处理器执行本发明各个实施例所述方法的全部或部分步骤。所述存储介质是非短暂性(英文:non-transitory)介质,包括:快闪存储器、移动硬盘、只读存储器、随机存取存储器、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述,仅为本发明的具体实施方式,但本发明的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本发明的保护范围之内。因此,本发明的保护范围应所述以权利要求的保护范围为准。

Claims (82)

  1. 一种图像滤波方法,其特征在于,待处理图像包括多个亮度像素块和多个第一色度像素块,所述亮度像素块包含多个相邻的亮度像素点,所述第一色度像素块包含多个相邻的第一色度像素点,所述方法包括:
    获取所述亮度像素块的第一索引,所述第一索引代表所述亮度像素块对应的图像性质所适用的滤波器类型;
    获取所述第一色度像素块的第二索引,所述第二索引代表所述第一色度像素块对应的图像性质所适用的滤波器类型;
    对所述亮度像素块使用所述第一索引在滤波器集合中对应的滤波器进行滤波;
    对所述第一色度像素块使用所述第二索引在所述滤波器集合中对应的滤波器进行所述滤波。
  2. 根据权利要求1所述的方法,其特征在于,还包括:当所述第一索引和所述第二索引相同时,所述第一索引对应的滤波器和所述第二索引对应的滤波器相同。
  3. 根据权利要求1或2所述的方法,其特征在于,所述待处理图像还包括多个第二色度像素块,所述第二色度像素块包含多个相邻的第二色度像素点,在所述获取所述第一色度像素块的第二索引之后,还包括:
    获取所述第二色度像素块的第三索引,所述第三索引代表所述第二色度像素块对应的图像性质所适用的滤波器类型;
    对应的,在所述对所述第一色度像素块使用所述第二索引在所述滤波器集 合中对应的滤波器进行所述滤波之后,还包括:
    对所述第二色度像素块使用所述第三索引在所述滤波器集合中对应的滤波器进行所述滤波。
  4. 根据权利要求1至3任一项所述的方法,其特征在于,所述获取所述亮度像素块的第一索引,包括:
    根据第一关系对所述亮度像素块分类,获得所述第一索引,所述第一关系包括所述亮度像素块对应的图像区域的纹理方向性和变化强度。
  5. 根据权利要求4所述的方法,其特征在于,所述亮度像素块对应的图像区域的纹理方向性和变化强度由所述亮度像素块中预设位置的像素点和所述亮度像素块中预置位置的像素点的邻域像素点获得。
  6. 根据权利要求1至5任一项所述的方法,其特征在于,所述获取所述第一色度像素块的第二索引,包括:
    根据第二关系对所述第一色度像素块分类,获得所述第二索引,所述第二关系包括所述第一色度像素块对应的图像区域的纹理方向性和变化强度。
  7. 根据权利要求6所述的方法,其特征在于,所述第一色度像素块对应的图像区域的纹理方向性和变化强度由所述第一色度像素块中预设位置的像素点和所述第一色度像素块中预置位置的像素点的邻域像素点获得。
  8. 根据权利要求1至5任一项所述的方法,其特征在于,所述获取所述第一色度像素块的第二索引,包括:将和所述第一色度像素块对应相同图像区 域的所述亮度像素块的所述第一索引作为所述第二索引。
  9. 根据权利要求3至8任一项所述的方法,其特征在于,所述获取所述第二色度像素块的第三索引,包括:
    根据第三关系对所述第二色度像素块分类,获得所述第三索引,所述第三关系包括所述第二色度像素块对应的图像区域的纹理方向性和变化强度。
  10. 根据权利要求9所述的方法,其特征在于,所述第二色度像素块对应的图像区域的纹理方向性和变化强度由所述第二色度像素块中预设位置的像素点和所述第二色度像素块中预置位置的像素点的邻域像素点获得。
  11. 根据权利要求3至8任一项所述的方法,其特征在于,所述获取所述第二色度像素块的第三索引,包括:
    将和所述第二色度像素块对应相同图像区域的所述亮度像素块的所述第一索引作为所述第三索引;或者,
    将和所述第二色度像素块对应相同图像区域的所述第一色度像素块的所述第二索引作为所述第三索引。
  12. 根据权利要求9至11任一项所述的方法,其特征在于,包括:所述第一关系、所述第二关系和所述第三关系中至少两者相同。
  13. 根据权利要求9至11任一项所述的方法,其特征在于,包括:所述第一关系、所述第二关系和所述第三关系互不相同。
  14. 根据权利要求3至13任一项所述的方法,其特征在于,包括:
    所述第一色度像素块的尺寸大于所述亮度像素块的尺寸;
    所述第二色度像素块的尺寸大于所述亮度像素块的尺寸。
  15. 根据权利要求1至14任一项所述的方法,其特征在于,所述方法用于解码器,在所述获取所述亮度像素块的第一索引之前,还包括:
    解析码流,获取所述滤波器集合的信息。
  16. 根据权利要求1至14任一项所述的方法,其特征在于,所述方法用于编码器,在所述获取所述亮度像素块的第一索引之前,还包括:
    从预设候选滤波器集合中,选择编码代价最小的候选滤波器集合作为所述滤波器集合;
    编码所述滤波器集合的信息。
  17. 根据权利要求1至16任一项所述的方法,其特征在于,在所述获取所述亮度像素块的第一索引之前,还包括:
    将所述待处理图像的亮度像素点按照第一结构分成多个亮度控制块,所述亮度控制块包含一个或多个相邻的所述亮度像素块;
    确定所述待处理图像中需要进行所述滤波的一个或多个所述亮度控制块。
  18. 根据权利要求17所述的方法,其特征在于,所述确定所述待处理图像中需要进行所述滤波的一个或多个所述亮度控制块,包括:
    确定所述待处理图像的亮度滤波标识,所述亮度滤波标识代表所述待处理图像中的每个所述亮度控制块各自是否执行所述滤波。
  19. 根据权利要求17或18所述的方法,其特征在于,所述将所述待处理图像的亮度像素点按照第一结构分成多个亮度控制块,包括:
    将所述待处理图像的亮度像素点按照预设大小划分成一个或多个等尺寸的第一初分块;
    对所述第一初分块进行四叉树或者二叉树划分,划分成多个所述亮度控制块。
  20. 根据权利要求17至19任一项所述的方法,其特征在于,所述方法用于解码器,所述确定所述待处理图像中需要进行所述滤波的一个或多个所述亮度控制块,还包括:
    解码所述码流,获得所述亮度滤波标识的信息。
  21. 根据权利要求17至19任一项所述的方法,其特征在于,所述方法用于编码器,所述确定所述待处理图像中需要进行所述滤波的一个或多个所述亮度控制块,还包括:
    从预设候选亮度滤波标识集合中,选择编码代价最小的候选亮度滤波标识作为所述亮度滤波标识。
  22. 根据权利要求21所述的方法,其特征在于,在所述确定所述待处理图像中需要进行所述滤波的一个或多个所述亮度控制块之后,还包括:
    编码所述亮度滤波标识的信息。
  23. 根据权利要求17至22任一项所述的方法,其特征在于,在所述确定所述待处理图像中需要进行所述滤波的一个或多个所述亮度控制块之后,还包 括:
    确定所述待处理图像中需要进行所述滤波的一个或多个所述第一色度控制块,所述第一色度控制块包含一个或多个相邻的所述第一色度像素块。
  24. 根据权利要求23所述的方法,其特征在于,所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第一色度控制块,包括:
    确定所述待处理图像的第一色度滤波标识,所述第一色度滤波标识代表所述待处理图像中的每个所述第一色度控制块各自是否执行所述滤波。
  25. 根据权利要求23或24所述的方法,其特征在于,在所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第一色度控制块之前,还包括:
    将所述待处理图像的第一色度像素点按照所述第一结构分成多个所述第一色度控制块;
    对应的,所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第一色度控制块,包括:
    根据所述亮度滤波标识映射获得所述第一色度滤波标识。
  26. 根据权利要求23或24所述的方法,其特征在于,在所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第一色度控制块之前,还包括:
    将所述待处理图像的第一色度像素点按照第二结构分成多个所述第一色度控制块。
  27. 根据权利要求26所述的方法,其特征在于,所述将所述待处理图像的第一色度像素点按照第二结构分成多个所述第一色度控制块,包括:
    将所述待处理图像的第一色度像素点按照预设大小划分成一个或多个等尺寸的第二初分块;
    对所述第二初分块进行四叉树或者二叉树划分,划分成多个所述第一色度控制块。
  28. 根据权利要求23至27任一项所述的方法,其特征在于,所述方法用于解码器,所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第一色度控制块,还包括:
    解码所述码流,获得所述第一色度滤波标识的信息。
  29. 根据权利要求23至27所述的方法,其特征在于,所述方法用于编码器,所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第一色度控制块,还包括:
    从预设候选第一色度滤波标识集合中,选择编码代价最小的候选第一色度滤波标识作为所述第一色度滤波标识。
  30. 根据权利要求29所述的方法,其特征在于,在所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第一色度控制块之后,还包括:
    编码所述第一色度滤波标识的信息。
  31. 根据权利要求23至30任一项所述的方法,其特征在于,在所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第一色度控制块之后,还包括:
    确定所述待处理图像中需要进行所述滤波的一个或多个所述第二色度控 制块,所述第二色度控制块包含一个或多个相邻的所述第二色度像素块。
  32. 根据权利要求31所述的方法,其特征在于,所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第二色度控制块,包括:
    确定所述待处理图像的第二色度滤波标识,所述亮度滤波标识代表所述待处理图像中的每个所述第二色度控制块各自是否执行所述滤波。
  33. 根据权利要求32所述的方法,其特征在于,在所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第二色度控制块之前,还包括:
    将所述待处理图像的第二色度像素点按照所述第一结构分成多个所述第二色度控制块;
    对应的,所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第二色度控制块,包括:
    根据所述亮度滤波标识映射获得所述第二色度滤波标识。
  34. 根据权利要求32所述的方法,其特征在于,在所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第二色度控制块之前,还包括:
    将所述待处理图像的第二色度像素点按照所述第二结构分成多个所述第二色度控制块;
    对应的,所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第二色度控制块,包括:
    根据所述第一色度滤波标识映射获得所述第二色度滤波标识。
  35. 根据权利要求32所述的方法,其特征在于,在所述确定所述待处理 图像中需要进行所述滤波的一个或多个所述第二色度控制块之前,还包括:
    将所述待处理图像的第二色度像素点按照第三结构分成多个所述第二色度控制块。
  36. 根据权利要求35所述的方法,其特征在于,所述将所述待处理图像的第二色度像素点按照第三结构分成多个所述第二色度控制块,包括:
    将所述待处理图像的第二色度像素点按照预设大小划分成一个或多个等尺寸的第三初分块;
    对所述第三初分块进行四叉树或者二叉树划分,划分成多个所述第二色度控制块。
  37. 根据权利要求31至36所述的方法,其特征在于,所述方法用于解码器,所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第二色度控制块,还包括:
    解码所述码流,获得所述第二色度滤波标识的信息。
  38. 根据权利要求31至36任一项所述的方法,其特征在于,所述方法用于编码器,所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第二色度控制块,还包括:
    从预设候选第二色度滤波标识集合中,选择编码代价最小的候选第二色度滤波标识作为所述第二色度滤波标识。
  39. 根据权利要求38所述的方法,其特征在于,在所述确定所述待处理图像中需要进行所述滤波的一个或多个所述第二色度控制块之后,还包括:
    编码所述第二色度滤波标识的信息。
  40. 根据权利要求31至39任一项所述的方法,其特征在于,包括:
    所述第一结构、所述第二结构和所述第三结构中至少两者相同。
  41. 根据权利要求31至39任一项所述的方法,其特征在于,包括:
    所述第一结构、所述第二结构和所述第三结构互不相同。
  42. 一种图像滤波装置,其特征在于,待处理图像包括多个亮度像素块和多个第一色度像素块,所述亮度像素块包含多个相邻的亮度像素点,所述第一色度像素块包含多个相邻的第一色度像素点,所述装置包括:
    获取模块,用于获取所述亮度像素块的第一索引,所述第一索引代表所述亮度像素块对应的图像性质所适用的滤波器类型;
    所述获取模块,还用于获取所述第一色度像素块的第二索引,所述第二索引代表所述第一色度像素块对应的图像性质所适用的滤波器类型;
    滤波模块,用于对所述亮度像素块使用所述第一索引在滤波器集合中对应的滤波器进行滤波;
    所述滤波模块,还用于对所述第一色度像素块使用所述第二索引在所述滤波器集合中对应的滤波器进行所述滤波。
  43. 根据权利要求42所述的装置,其特征在于,还包括:当所述第一索引和所述第二索引相同时,所述第一索引对应的滤波器和所述第二索引对应的滤波器相同。
  44. 根据权利要求32或43所述的装置,其特征在于,所述待处理图像还 包括多个第二色度像素块,所述第二色度像素块包含多个相邻的第二色度像素点,所述获取模块还用于:
    获取所述第二色度像素块的第三索引,所述第三索引代表所述第二色度像素块对应的图像性质所适用的滤波器类型;
    对应的,所述滤波模块还用于:
    对所述第二色度像素块使用所述第三索引在所述滤波器集合中对应的滤波器进行所述滤波。
  45. 根据权利要求42至44任一项所述的装置,其特征在于,所述获取模块具体用于:
    根据第一关系对所述亮度像素块分类,获得所述第一索引,所述第一关系包括所述亮度像素块对应的图像区域的纹理方向性和变化强度。
  46. 根据权利要求45所述的装置,其特征在于,所述亮度像素块对应的图像区域的纹理方向性和变化强度由所述亮度像素块中预设位置的像素点和所述亮度像素块中预置位置的像素点的邻域像素点获得。
  47. 根据权利要求42至46任一项所述的装置,其特征在于,所述获取模块具体用于:
    根据第二关系对所述第一色度像素块分类,获得所述第二索引,所述第二关系包括所述第一色度像素块对应的图像区域的纹理方向性和变化强度。
  48. 根据权利要求47所述的装置,其特征在于,所述第一色度像素块对应的图像区域的纹理方向性和变化强度由所述第一色度像素块中预设位置的 像素点和所述第一色度像素块中预置位置的像素点的邻域像素点获得。
  49. 根据权利要求42至46任一项所述的装置,其特征在于,所述获取模块具体用于:将和所述第一色度像素块对应相同图像区域的所述亮度像素块的所述第一索引作为所述第二索引。
  50. 根据权利要求44至49任一项所述的装置,其特征在于,所述获取模块具体用于:
    根据第三关系对所述第二色度像素块分类,获得所述第三索引,所述第三关系包括所述第二色度像素块对应的图像区域的纹理方向性和变化强度。
  51. 根据权利要求50所述的装置,其特征在于,所述第二色度像素块对应的图像区域的纹理方向性和变化强度由所述第二色度像素块中预设位置的像素点和所述第二色度像素块中预置位置的像素点的邻域像素点获得。
  52. 根据权利要求41至46任一项所述的装置,其特征在于,所述获取模块具体用于:
    将和所述第二色度像素块对应相同图像区域的所述亮度像素块的所述第一索引作为所述第三索引;或者,
    将和所述第二色度像素块对应相同图像区域的所述第一色度像素块的所述第二索引作为所述第三索引。
  53. 根据权利要求50至52任一项所述的装置,其特征在于,包括:所述第一关系、所述第二关系和所述第三关系中至少两者相同。
  54. 根据权利要求50至52任一项所述的装置,其特征在于,包括:所述第一关系、所述第二关系和所述第三关系互不相同。
  55. 根据权利要求3至54任一项所述的装置,其特征在于,包括:
    所述第一色度像素块的尺寸大于所述亮度像素块的尺寸;
    所述第二色度像素块的尺寸大于所述亮度像素块的尺寸。
  56. 根据权利要求42至55任一项所述的装置,其特征在于,所述装置用于解码器,所述装置还包括解码模块,用于:
    解析码流,获取所述滤波器集合的信息。
  57. 根据权利要求42至55任一项所述的装置,其特征在于,所述装置用于编码器,所述装置还包括编码模块,用于:
    从预设候选滤波器集合中,选择编码代价最小的候选滤波器集合作为所述滤波器集合;
    编码所述滤波器集合的信息。
  58. 根据权利要求42至55任一项所述的装置,其特征在于,所述装置还包括:
    划分模块,用于将所述待处理图像的亮度像素点按照第一结构分成多个亮度控制块,所述亮度控制块包含一个或多个相邻的所述亮度像素块;
    标识模块,用于确定所述待处理图像中需要进行所述滤波的一个或多个所述亮度控制块。
  59. 根据权利要求58所述的装置,其特征在于,所述标识模块具体用于:
    确定所述待处理图像的亮度滤波标识,所述亮度滤波标识代表所述待处理图像中的每个所述亮度控制块各自是否执行所述滤波。
  60. 根据权利要求58或59所述的装置,其特征在于,所述划分模块具体用于:
    将所述待处理图像的亮度像素点按照预设大小划分成一个或多个等尺寸的第一初分块;
    对所述第一初分块进行四叉树或者二叉树划分,划分成多个所述亮度控制块。
  61. 根据权利要求58至60任一项所述的装置,其特征在于,所述装置用于解码器,所述解码模块还用于:
    解码所述码流,获得所述亮度滤波标识的信息。
  62. 根据权利要求58至60任一项所述的装置,其特征在于,所述装置用于编码器,所述编码模块还用于:
    从预设候选亮度滤波标识集合中,选择编码代价最小的候选亮度滤波标识作为所述亮度滤波标识。
  63. 根据权利要求62所述的装置,其特征在于,在所述编码模块还用于:
    编码所述亮度滤波标识的信息。
  64. 根据权利要求58至63任一项所述的装置,其特征在于,所述标识模 块还用于:
    确定所述待处理图像中需要进行所述滤波的一个或多个所述第一色度控制块,所述第一色度控制块包含一个或多个相邻的所述第一色度像素块。
  65. 根据权利要求64所述的装置,其特征在于,所述标识模块具体用于:
    确定所述待处理图像的第一色度滤波标识,所述第一色度滤波标识代表所述待处理图像中的每个所述第一色度控制块各自是否执行所述滤波。
  66. 根据权利要求64或65所述的装置,其特征在于,所述划分模块还用于:
    将所述待处理图像的第一色度像素点按照所述第一结构分成多个所述第一色度控制块;
    对应的,所述标识模块,还用于:
    根据所述亮度滤波标识映射获得所述第一色度滤波标识。
  67. 根据权利要求64或65所述的装置,其特征在于,所述划分模块还用于:
    将所述待处理图像的第一色度像素点按照第二结构分成多个所述第一色度控制块。
  68. 根据权利要求67所述的装置,其特征在于,所述划分模块还具体用于:
    将所述待处理图像的第一色度像素点按照预设大小划分成一个或多个等尺寸的第二初分块;
    对所述第二初分块进行四叉树或者二叉树划分,划分成多个所述第一色度控制块。
  69. 根据权利要求64至68任一项所述的装置,其特征在于,所述装置用于解码器,所述解码模块还用于:
    解码所述码流,获得所述第一色度滤波标识的信息。
  70. 根据权利要求64至68任一项所述的装置,其特征在于,所述装置用于编码器,所述编码模块还用于:
    从预设候选第一色度滤波标识集合中,选择编码代价最小的候选第一色度滤波标识作为所述第一色度滤波标识。
  71. 根据权利要求70所述的装置,其特征在于,在所述编码模块还用于:
    编码所述第一色度滤波标识的信息。
  72. 根据权利要求64至71任一项所述的装置,其特征在于,在所述标识模块还用于:
    确定所述待处理图像中需要进行所述滤波的一个或多个所述第二色度控制块,所述第二色度控制块包含一个或多个相邻的所述第二色度像素块。
  73. 根据权利要求72所述的装置,其特征在于,所述标识模块具体用于:
    确定所述待处理图像的第二色度滤波标识,所述第二色度滤波标识代表所述待处理图像中的每个所述第二色度控制块各自是否执行所述滤波。
  74. 根据权利要求73所述的装置,其特征在于,所述划分模块还用于:
    将所述待处理图像的第二色度像素点按照所述第一结构分成多个所述第二色度控制块;
    对应的,所述标识模块还用于:
    根据所述亮度滤波标识映射获得所述第二色度滤波标识。
  75. 根据权利要求73所述的装置,其特征在于,所述划分模块还用于:
    将所述待处理图像的第二色度像素点按照所述第二结构分成多个所述第二色度控制块;
    对应的,所述标识模块还用于:
    根据所述第一色度滤波标识映射获得所述第二色度滤波标识。
  76. 根据权利要求73所述的装置,其特征在于,所述划分模块还用于:
    将所述待处理图像的第二色度像素点按照第三结构分成多个所述第二色度控制块。
  77. 根据权利要求76所述的装置,其特征在于,所述划分模块还具体用于:
    将所述待处理图像的第二色度像素点按照预设大小划分成一个或多个等尺寸的第三初分块;
    对所述第三初分块进行四叉树或者二叉树划分,划分成多个所述第二色度控制块。
  78. 根据权利要求72或77所述的装置,其特征在于,所述装置用于解码器,所述解码模块还用于:
    解码所述码流,获得所述第二色度滤波标识的信息。
  79. 根据权利要求72至77任一项所述的装置,其特征在于,所述装置用于编码器,所述编码模块还用于:
    从预设候选第二色度滤波标识集合中,选择编码代价最小的候选第二色度滤波标识作为所述第二色度滤波标识。
  80. 根据权利要求79所述的装置,其特征在于,所述编码模块还用于:
    编码所述第二色度滤波标识的信息。
  81. 根据权利要求72至80任一项所述的装置,其特征在于,包括:
    所述第一结构、所述第二结构和所述第三结构中至少两者相同。
  82. 根据权利要求72至80任一项所述的装置,其特征在于,包括:
    所述第一结构、所述第二结构和所述第三结构互不相同。
PCT/CN2016/113973 2016-12-30 2016-12-30 图像滤波方法、装置以及设备 WO2018120230A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CN201680088453.1A CN109565604A (zh) 2016-12-30 2016-12-30 图像滤波方法、装置以及设备
EP16925296.2A EP3550842A4 (en) 2016-12-30 2016-12-30 IMAGE FILTERING METHOD, APPARATUS AND DEVICE
PCT/CN2016/113973 WO2018120230A1 (zh) 2016-12-30 2016-12-30 图像滤波方法、装置以及设备
US16/457,041 US11146826B2 (en) 2016-12-30 2019-06-28 Image filtering method and apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/113973 WO2018120230A1 (zh) 2016-12-30 2016-12-30 图像滤波方法、装置以及设备

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/457,041 Continuation US11146826B2 (en) 2016-12-30 2019-06-28 Image filtering method and apparatus

Publications (1)

Publication Number Publication Date
WO2018120230A1 true WO2018120230A1 (zh) 2018-07-05

Family

ID=62706779

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/113973 WO2018120230A1 (zh) 2016-12-30 2016-12-30 图像滤波方法、装置以及设备

Country Status (4)

Country Link
US (1) US11146826B2 (zh)
EP (1) EP3550842A4 (zh)
CN (1) CN109565604A (zh)
WO (1) WO2018120230A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11082708B2 (en) * 2018-01-08 2021-08-03 Qualcomm Incorporated Multiple-model local illumination compensation
KR102642797B1 (ko) * 2019-01-14 2024-03-05 삼성전자주식회사 전자 장치 및 그 제어 방법

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1742281A (zh) * 2002-12-27 2006-03-01 摩托罗拉公司 视频去块效应的方法和设备
CN102131098A (zh) * 2011-04-02 2011-07-20 中兴通讯股份有限公司 视频图像的去块滤波方法及装置
CN103634609A (zh) * 2012-08-23 2014-03-12 飞思卡尔半导体公司 对编码宏块去块滤波的方法和***
WO2016195567A1 (en) * 2015-06-05 2016-12-08 Telefonaktiebolaget Lm Ericsson (Publ) Pixel pre-processing and encoding

Family Cites Families (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002102086A2 (en) * 2001-06-12 2002-12-19 Miranda Technologies Inc. Apparatus and method for adaptive spatial segmentation-based noise reducing for encoded image signal
US7227901B2 (en) * 2002-11-21 2007-06-05 Ub Video Inc. Low-complexity deblocking filter
BRPI0506163B1 (pt) * 2004-09-20 2018-11-13 Divx Inc método de desbloqueio de um quadro de vídeo reconstruído
US20080123750A1 (en) * 2006-11-29 2008-05-29 Michael Bronstein Parallel deblocking filter for H.264 video codec
CN101964863B (zh) * 2010-05-07 2012-10-24 镇江唐桥微电子有限公司 一种自适应的时空域视频图像降噪方法
US9094658B2 (en) * 2010-05-10 2015-07-28 Mediatek Inc. Method and apparatus of adaptive loop filtering
US20120230423A1 (en) * 2011-03-10 2012-09-13 Esenlik Semih Line memory reduction for video coding and decoding
CN103503456B (zh) * 2011-05-10 2017-03-22 联发科技股份有限公司 用于重建视频的环内处理方法及其装置
KR102229157B1 (ko) * 2011-06-24 2021-03-17 엘지전자 주식회사 영상 정보 부호화 및 복호화 방법
US9185404B2 (en) * 2011-10-07 2015-11-10 Qualcomm Incorporated Performing transform dependent de-blocking filtering
US9807403B2 (en) * 2011-10-21 2017-10-31 Qualcomm Incorporated Adaptive loop filtering for chroma components
GB201119206D0 (en) * 2011-11-07 2011-12-21 Canon Kk Method and device for providing compensation offsets for a set of reconstructed samples of an image
US9462275B2 (en) * 2012-01-30 2016-10-04 Qualcomm Incorporated Residual quad tree (RQT) coding for video coding
US9380302B2 (en) * 2012-02-27 2016-06-28 Texas Instruments Incorporated Sample adaptive offset (SAO) parameter signaling
CN106851275A (zh) * 2012-05-29 2017-06-13 寰发股份有限公司 视频数据的自适应采样点偏移的处理装置及方法
CN103281536B (zh) * 2013-05-22 2016-10-26 福建星网视易信息***有限公司 一种兼容avs及h.264的去块滤波方法及装置
CN104284199B (zh) * 2013-07-11 2019-02-01 Nxp股份有限公司 用降低复杂度的去块效应操作进行视频解码方法和装置
US9872022B2 (en) * 2014-01-03 2018-01-16 Mediatek Inc. Method and apparatus for sample adaptive offset processing
US9628822B2 (en) * 2014-01-30 2017-04-18 Qualcomm Incorporated Low complexity sample adaptive offset encoding
FR3018417B1 (fr) * 2014-03-04 2017-07-28 Sagemcom Broadband Sas Procede de modification d'un flux video binaire.
MX365498B (es) * 2014-03-04 2019-06-05 Microsoft Technology Licensing Llc Conmutacion adaptativa de espacios de color, frecuencias de muestreo de color y/o profundidades de bits.
WO2015131330A1 (en) * 2014-03-04 2015-09-11 Microsoft Technology Licensing, Llc Encoding strategies for adaptive switching of color spaces, color sampling rates and/or bit depths
WO2016074147A1 (en) * 2014-11-11 2016-05-19 Mediatek Singapore Pte. Ltd. Separated coding tree for luma and chroma
US10455249B2 (en) * 2015-03-20 2019-10-22 Qualcomm Incorporated Downsampling process for linear model prediction mode
KR20180064423A (ko) * 2015-11-04 2018-06-14 엘지전자 주식회사 영상 코딩 시스템에서 영상 디코딩 방법 및 장치
US10728546B2 (en) * 2016-02-05 2020-07-28 Apple Inc. Sample adaptive offset systems and methods
US10440396B2 (en) * 2017-03-28 2019-10-08 Qualcomm Incorporated Filter information sharing among color components

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1742281A (zh) * 2002-12-27 2006-03-01 摩托罗拉公司 视频去块效应的方法和设备
CN102131098A (zh) * 2011-04-02 2011-07-20 中兴通讯股份有限公司 视频图像的去块滤波方法及装置
CN103634609A (zh) * 2012-08-23 2014-03-12 飞思卡尔半导体公司 对编码宏块去块滤波的方法和***
WO2016195567A1 (en) * 2015-06-05 2016-12-08 Telefonaktiebolaget Lm Ericsson (Publ) Pixel pre-processing and encoding

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3550842A4 *

Also Published As

Publication number Publication date
US11146826B2 (en) 2021-10-12
EP3550842A4 (en) 2020-06-10
US20190387254A1 (en) 2019-12-19
EP3550842A1 (en) 2019-10-09
CN109565604A (zh) 2019-04-02

Similar Documents

Publication Publication Date Title
KR102352085B1 (ko) 크로마 예측 방법 및 디바이스
US20210044839A1 (en) Encoding method and apparatus and decoding method and apparatus
KR102431537B1 (ko) 루마 및 크로마 성분에 대한 ibc 전용 버퍼 및 디폴트 값 리프레싱을 사용하는 인코더, 디코더 및 대응하는 방법들
CN109076246B (zh) 使用图像数据校正掩码的视频编码方法和***
WO2018170801A1 (zh) 图像滤波方法及装置
WO2017129023A1 (zh) 解码方法、编码方法、解码设备和编码设备
US9129409B2 (en) System and method of compressing video content
TW201820875A (zh) 視訊解碼裝置、視訊編碼方法及裝置與電腦可讀儲存媒體
WO2018141116A1 (zh) 编解码方法及装置
US11528507B2 (en) Image encoding and decoding method, apparatus, and system, and storage medium to determine a transform core pair to effectively reduce encoding complexity
CN109996080B (zh) 图像的预测方法、装置及编解码器
US20200304801A1 (en) Inter prediction method and apparatus, and terminal device
CN116828192A (zh) 图像重建方法和装置
EP3547683A1 (en) Chrominance prediction method and device
US10674163B2 (en) Color space compression
US11146826B2 (en) Image filtering method and apparatus
WO2019091372A1 (zh) 图像预测方法和装置
BR112021009833A2 (pt) codificador, decodificador e métodos correspondentes para predição inter
ES2967903T3 (es) Codificador, decodificador y métodos correspondientes utilizando filtrado por interpolación
WO2023246655A1 (zh) 一种图像编码、解码方法及编码、解码装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16925296

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2016925296

Country of ref document: EP

Effective date: 20190705