WO2019011046A1 - Procédé, dispositif et système de traitement d'image - Google Patents

Procédé, dispositif et système de traitement d'image Download PDF

Info

Publication number
WO2019011046A1
WO2019011046A1 PCT/CN2018/085537 CN2018085537W WO2019011046A1 WO 2019011046 A1 WO2019011046 A1 WO 2019011046A1 CN 2018085537 W CN2018085537 W CN 2018085537W WO 2019011046 A1 WO2019011046 A1 WO 2019011046A1
Authority
WO
WIPO (PCT)
Prior art keywords
image block
reconstructed image
current
filter
reconstructed
Prior art date
Application number
PCT/CN2018/085537
Other languages
English (en)
Chinese (zh)
Inventor
高山
张红
杨海涛
刘杉
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2019011046A1 publication Critical patent/WO2019011046A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Definitions

  • the present application relates to image processing technologies, and in particular, to an image processing method, device, and system.
  • FIG. 1 is a schematic diagram of a digital video provided by the present application.
  • the digital video is composed of a multi-frame digital image.
  • 2 is a schematic diagram of a digital image provided by the present application.
  • the image is composed of 12*16 pixels, wherein each pixel is referred to as one pixel, and 12*16 represents image resolution.
  • the image resolution of 2K video is 1920*1080
  • the image resolution of 4K video is 3840*2160.
  • the original video contains a large amount of data, which is not suitable for storage and transmission, and requires efficient video compression coding techniques to compress the original data.
  • FIG. 3 is a schematic diagram of encoding of an encoding end provided by the present application.
  • the encoding process of the encoding end includes: after receiving the video by the encoding end, dividing the image into multiple to-bes for each frame image constituting the video. Encode image blocks.
  • the image block is first reconstructed by reference (the reference reconstructed image block is used to provide a reference pixel required for the current image block to be encoded, and the reference pixel is used to predict the current image block to be encoded).
  • the coded image block is predicted to obtain a prediction signal of the current image block to be coded; the prediction signal is subtracted from the original signal of the current image block to be coded to obtain a residual signal. After prediction, the magnitude of the residual signal is much smaller than the original signal.
  • the residual signal is transformed and quantized. After transform quantization, the transform quantized coefficients are obtained, and the quantized coefficients and other indication information in the encoding are encoded by the entropy coding technique to obtain a code stream. Further, the encoding end further needs to reconstruct the current image block to be encoded, so as to provide reference pixels for encoding the subsequent image block to be encoded.
  • the encoding end needs to perform inverse quantization and inverse transform on the transform quantized coefficients of the current image block to be encoded to obtain a reconstructed residual signal, and the reconstructed residual signal is
  • the prediction signals corresponding to the current image block to be encoded are added to obtain a reconstructed signal of the current image block to be encoded, and the reconstructed image block is obtained according to the reconstructed signal.
  • the reconstructed image block can predict a subsequent image block to be encoded.
  • the residual signal is transformed to obtain a transform coefficient, and the transform coefficient has information loss after being quantized, and the information loss is irreversible.
  • the inversely quantized transform coefficients are distorted, so that the reconstructed signal is inconsistent with the original signal.
  • This compression method is lossy compression. Therefore, for lossy compression, after the reconstructed image block is obtained, the reconstructed image block needs to be filtered to remove some distortion introduced by lossy compression, such as blockiness, ringing effect, and the like.
  • a DBK filter in the H.264, H.265 standard can be used.
  • the SAO filter in H.265, and the ALF filter in the next generation standard, etc. can be used.
  • the residual signal is obtained by using a lossless transform operation to obtain transform coefficients, and the transform coefficients are subjected to entropy coding without performing quantization operations.
  • lossless compression filtering operations are generally not performed. Further, after each image block of the current image is reconstructed, a reconstructed image is obtained, wherein the reconstructed image can predict other subsequent frame images.
  • FIG. 4 is a schematic diagram of decoding of a decoding end provided by the present application. As shown in FIG. 4, after acquiring a code stream, the decoding end first performs entropy decoding on the code stream to obtain a transform quantized coefficient of the current image block to be reconstructed, and then transforms the quantized coefficient. Performing inverse quantization and inverse transform to obtain a reconstructed residual signal of the current image block to be reconstructed.
  • FIG. 5 is a schematic diagram of encoding of the encoding end provided by the present application. As shown in FIG. 5, the encoding end uses downsampling processing on the entire image, and then Each image block to be encoded in the downsampled image is encoded to obtain a code stream. The resolution of the reconstructed image block corresponding to each image block to be encoded is a downsampling resolution.
  • the decoding end parses the code stream, and the resolution of each image block to be reconstructed is the downsampling resolution, and the resolution of the corresponding reconstructed image block is also the downsampling resolution, and the decoding end needs to adopt the reconstructed image block. Sampling processing to obtain a reconstructed image block of the original resolution.
  • the encoding end or the decoding end performs the upsampling process for each reconstructed image block in the entire image by using the same filter.
  • the characteristics of each reconstructed image block may be different.
  • some reconstructed image blocks may be relatively different. It is flat; some reconstructed image blocks may have more details.
  • the prior art is bound to cause some reconstructed image blocks after upsampling to be blurred, and there is a problem that the display effect is not good.
  • the present application provides an image processing method, device, and system, thereby solving the problem that some reconstructed image blocks after the upsampling process are not well displayed.
  • the present application provides an image processing method, including: generating a reconstructed signal of a current image block to be encoded, and reconstructing a current image block to be encoded according to the reconstructed signal to obtain a current reconstructed image block; if the current reconstructed image block is encoded In a manner of downsampling coding, a first filter for performing upsampling processing on the current reconstructed image block is selected from the at least two candidate filters, and the current reconstructed image block is subjected to upsampling processing by the first filter.
  • the utility model has the beneficial effects that the same filter is used for the reconstructed image block in the whole image in the prior art, and the present application selects a corresponding filter for each reconstructed image block, that is, the application adopts The filter is selected in a targeted manner, and the reconstructed image block is upsampled by the selected filter, so that a reconstructed image block with better display effect can be obtained.
  • selecting, from the at least two candidate filters, the first filter for performing the upsampling process on the current reconstructed image block specifically: selecting, according to the texture feature of the currently reconstructed image block, from the at least two candidate filters First filter.
  • selecting the first filter from the at least two candidate filters according to the texture feature of the currently reconstructed image block comprises: selecting the first filter according to the preset mapping relationship and the texture feature of the current reconstructed image block,
  • the mapping relationship is a mapping relationship between a preset texture feature including texture features of the currently reconstructed image block and at least two candidate filters including the first filter.
  • selecting a first filter for performing upsampling processing on the current reconstructed image block from the at least two candidate filters comprises: determining each of at least two adjacent reconstructed image blocks of the currently reconstructed image block. a similarity between the adjacent reconstructed image block and the current reconstructed image block, wherein at least two adjacent reconstructed image blocks are subjected to upsampling processing corresponding to at least two second filters, and at least two candidate filters include at least two second a filter; selecting, as the first filter, a second filter corresponding to the adjacent reconstructed image block having the highest similarity with the current reconstructed image block from the at least two second filters.
  • selecting, from the at least two candidate filters, the first filter for performing the upsampling process on the current reconstructed image block comprises: separately performing the current reconstructed image block by using at least two candidate filters Sampling processing, obtaining an upsampled image block corresponding to at least two candidate filters respectively; respectively calculating an error of the upsampled image block corresponding to the at least two candidate filters and the original image block corresponding to the current reconstructed image block; A corresponding candidate filter is used as the first filter.
  • the first filter can be selected more precisely by this method.
  • performing upsampling processing on the current reconstructed image block by using the first filter including: part of the currently completed reconstruction in the adjacent reconstructed image block required for performing the upsampling process according to the current reconstructed image block
  • a pixel of the adjacent reconstructed image block is subjected to upsampling processing on the current reconstructed image block by a first filter
  • the method further includes: if another part of the currently adjacent reconstructed image block that is not currently reconstructed is required After the adjacent reconstructed image block has been reconstructed, the third filter is used to perform a second upsampling process on the partial boundary of the currently reconstructed image block according to another partial adjacent reconstructed image block, wherein the partial boundary of the currently reconstructed image block is another A portion of the adjacent reconstructed image blocks are contiguous.
  • the current reconstructed image block is upsampled by the first filter, including: a part of the adjacent reconstruction of the currently completed reconstruction in the adjacent reconstructed image block required for performing the upsampling process according to the current reconstructed image block. a pixel of the image block, performing a upsampling process on the current reconstructed image block by using the first filter; correspondingly, the method further includes: if all the image blocks of the current image in which the current reconstructed image block is located have been reconstructed, Performing a second upsampling process on a partial boundary of the currently reconstructed image block according to another partial adjacent reconstructed image block in the adjacent adjacent reconstructed image block by a third filter, wherein another partially adjacent reconstructed image block An image block that is not reconstructed when the current up-sampling process is performed on the current reconstructed image block; a partial boundary of the current reconstructed image block is adjacent to another partially adjacent reconstructed image block.
  • the two alternative methods of the present application can avoid the problem that the reconstructed image block boundaries are not continuous.
  • the third filter is the first filter.
  • the method further includes: according to another part Determining whether a partial boundary of the adjacent reconstructed image block and the current reconstructed image block is subjected to secondary upsampling processing; if it is determined to perform a second upsampling process on a partial boundary of the first reconstructed image block, passing the third filter, A second upsampling process is performed on a partial boundary of the currently reconstructed image block according to another partial adjacent reconstructed image block.
  • the overhead of the decoding end may be reduced.
  • the boundary discontinuity problem of the currently reconstructed image block may be solved.
  • the method further includes: generating a code stream, where the code stream includes: identifier information of the first filter.
  • the code stream further includes first indication information, wherein the first indication information is used to indicate how to select a filter used when performing upsampling processing on the current reconstructed image block from the at least two candidate filters.
  • the code stream is generated, where the code stream includes: second indication information, where the second indication information is used to indicate whether the decoding end needs to perform secondary upsampling processing on the current reconstructed image block.
  • the present application provides an image processing method, including: parsing a code stream, to obtain encoding information of an image block to be reconstructed and an encoding mode of the current image block to be reconstructed; and encoding information according to an image block to be reconstructed currently; Generating a reconstructed signal of the current image block to be reconstructed, and reconstructing the current image block to be reconstructed according to the reconstructed signal to obtain a current reconstructed image block; if the current image mode of the image block to be reconstructed is a downsampling coding mode, according to the first obtained from the code stream An indication information is used to select a first filter for performing upsampling processing on the current reconstructed image block, wherein the first indication information is used to indicate how to use the at least two candidate filter selections to perform upsampling processing on the current reconstructed image block Filter; the current reconstructed image block is upsampled by the first filter.
  • the first indication information is used to indicate that the filter used in the upsampling process of the current reconstructed image block is selected from the at least two candidate filters according to the texture feature selection filter of the current reconstructed image block;
  • the first indication information of the flow acquisition is used to select a first filter for performing the upsampling process on the current reconstructed image block, including: determining a texture feature of the current reconstructed image block according to the first indication information; according to a preset mapping relationship and current Reconstructing a texture feature of the image block to select a first filter, the preset mapping relationship being a mapping relationship between the preset texture feature including the texture feature of the currently reconstructed image block and the at least two candidate filters including the first filter .
  • the first indication information is used to indicate that the filter used when performing upsampling processing on the current reconstructed image block is selected from the at least two candidate filters according to the adjacent reconstructed image block of the current reconstructed image block;
  • the first indication information is used to select a first filter for performing upsampling processing on the current reconstructed image block, comprising: determining a similarity between each of the at least two adjacent reconstructed image blocks and the current reconstructed image block And at least two adjacent reconstructed image blocks are corresponding to at least two second filters when the upsampling process is performed, the at least two candidate filters include at least two second filters; and the similarity is selected from the at least two second filters The second filter corresponding to the highest adjacent reconstructed image block serves as the first filter.
  • the current reconstructed image block is upsampled by the first filter, including: a part of the adjacent reconstruction of the currently completed reconstruction in the adjacent reconstructed image block required for performing the upsampling process according to the current reconstructed image block. a pixel of the image block, performing a upsampling process on the current reconstructed image block by using the first filter; correspondingly, the method further includes: if the required adjacent reconstructed image block is another currently adjacent reconstructed image that is not yet reconstructed After the block has been reconstructed, a partial upsampling process is performed on a portion of the boundary of the currently reconstructed image block according to another partial adjacent reconstructed image block by using a third filter, wherein the partial boundary of the currently reconstructed image block is another A portion of the adjacent reconstructed image blocks are contiguous.
  • the current reconstructed image block is upsampled by the first filter, including: a part of the adjacent reconstruction of the currently completed reconstruction in the adjacent reconstructed image block required for performing the upsampling process according to the current reconstructed image block. a pixel of the image block, performing a upsampling process on the current reconstructed image block by using the first filter; correspondingly, the method further includes: if all the image blocks of the current image in which the current reconstructed image block is located have been reconstructed, a third filter, performing a second upsampling process on a partial boundary of the current reconstructed image block according to another part of the adjacent reconstructed image block in the required adjacent reconstructed image block, wherein another part of the adjacent reconstructed image block is The image block that is not reconstructed when the current up-sampling process is performed for the first reconstructed image block; the partial boundary of the current reconstructed image block is adjacent to another partially adjacent reconstructed image block.
  • the third filter is the first filter.
  • the method further includes: according to another part Determining whether a partial boundary of the adjacent reconstructed image block and the current reconstructed image block is subjected to secondary upsampling processing; if it is determined to perform a second upsampling process on a partial boundary of the first reconstructed image block, passing the third filter, A second upsampling process is performed on a partial boundary of the currently reconstructed image block according to another partial adjacent reconstructed image block.
  • the code stream further includes: second indication information; and correspondingly, a third filter is used to perform a partial boundary of the currently reconstructed image block according to another partially adjacent reconstructed image block in the required adjacent reconstructed image block.
  • the second upsampling process includes: if the second indication information indicates that the current reconstructed image block needs to be subjected to the second upsampling process, passing through the third filter, according to another part of the adjacent adjacent reconstructed image block The reconstructed image block performs a second upsampling process on a portion of the boundary of the currently reconstructed image block.
  • the present application provides an image processing method, including: parsing a code stream to obtain an encoding information of an image block to be reconstructed and an encoding mode of an image block to be reconstructed; and reconstructing a current image block to be reconstructed according to the encoding information. And reconstructing the current image block to be reconstructed according to the reconstructed signal to obtain a current reconstructed image block; if the current image to be reconstructed is in a downsampling coding mode, obtaining the identification information of the first filter from the code stream, and identifying The first filter of the information identification performs upsampling processing on the currently reconstructed image block.
  • the present application provides an image processing apparatus, including: a generating module, configured to generate a reconstructed signal of a current image block to be encoded, and reconstruct a current image block to be encoded according to the reconstructed signal to obtain a current reconstructed image block; And if the coding mode of the current reconstructed image block is a downsampling coding mode, selecting a first filter for performing upsampling processing on the current reconstructed image block from at least two candidate filters; The current reconstructed image block is subjected to upsampling processing by a first filter.
  • the present application provides an image processing apparatus, including: a parsing module, configured to parse a code stream, to obtain an encoding information of an image block to be reconstructed and an encoding mode of an image block to be reconstructed; and a generating module, configured to The coding information of the current image block to be reconstructed generates a reconstruction signal of the current image block to be reconstructed, and reconstructs the current image block to be reconstructed according to the reconstruction signal to obtain a current reconstructed image block.
  • a parsing module configured to parse a code stream, to obtain an encoding information of an image block to be reconstructed and an encoding mode of an image block to be reconstructed
  • a generating module configured to The coding information of the current image block to be reconstructed generates a reconstruction signal of the current image block to be reconstructed, and reconstructs the current image block to be reconstructed according to the reconstruction signal to obtain a current reconstructed image block.
  • the selection module is configured to: if the current image block to be reconstructed is encoded a downsampling coding mode, the first filter for performing upsampling processing on the current reconstructed image block is selected according to the first indication information acquired from the code stream, where the first indication information is used to indicate how to filter from at least two candidates
  • the filter selects a filter used when performing upsampling processing on the current reconstructed image block; and the processing module is configured to perform upsampling processing on the currently reconstructed image block by using the first filter.
  • the present application provides an image processing apparatus, including: a parsing module, configured to parse a code stream, to obtain an encoding information of an image block to be reconstructed currently and an encoding mode of an image block to be reconstructed; and a generating module, configured to The coding information generates a reconstruction signal of the current image block to be reconstructed, and reconstructs the current image block to be reconstructed according to the reconstruction signal to obtain a current reconstructed image block; and the parsing module is further configured to: if the current image to be reconstructed is coded as a downsampling code The method is to obtain the identifier information of the first filter from the code stream, and the processing module is configured to perform the upsampling process on the current reconstructed image block by using the first filter identified by the identifier information.
  • a parsing module configured to parse a code stream, to obtain an encoding information of an image block to be reconstructed currently and an encoding mode of an image block to be re
  • the present application provides an image processing system, comprising: the image processing device according to the fourth aspect and the optional aspect of the fourth aspect, and the fifth aspect and the optional aspect of the fifth aspect Image processing device.
  • the present application provides an image processing system, comprising: the image processing device according to the fourth aspect and the optional aspect of the fourth aspect, and the sixth aspect and the optional aspect of the sixth aspect Image processing device.
  • the application provides an image processing apparatus including an encoder configured to:
  • the application provides an image processing apparatus including a decoder configured to:
  • the image block to be reconstructed is obtained, and the current reconstructed image block is obtained.
  • the upsampling process is performed on the current reconstructed image block according to the first indication information acquired from the code stream.
  • a first filter wherein the first indication information is used to indicate how to select a filter used for upsampling the current reconstructed image block from the at least two candidate filters; and the current reconstructed image block is performed by the first filter Sampling processing.
  • the application provides an image processing apparatus including a decoder configured to:
  • the present application provides a computer storage medium for storing computer software instructions for use in the image processing apparatus of the fourth aspect or the ninth aspect, comprising the fourth aspect or the ninth aspect The program designed.
  • the present application provides a computer program product comprising instructions which, when executed by a computer, cause the computer to perform the functions performed by the image processing apparatus of the fourth aspect or the ninth aspect.
  • the present application provides a computer storage medium for storing computer software instructions for use in the image processing apparatus of the fifth aspect or the tenth aspect, comprising the fifth aspect or the tenth aspect The program designed.
  • the present application provides a computer program product comprising instructions which, when executed by a computer, cause the computer to perform the functions performed by the image processing apparatus of the fifth aspect or the tenth aspect.
  • the present application provides a computer storage medium for storing computer software instructions for use in the image processing apparatus of the sixth aspect or the eleventh aspect, which is for performing the fifth aspect or the tenth Aspect of the program designed.
  • the present application provides a computer program product comprising instructions for causing a computer to perform a function performed by an image processing apparatus of the sixth aspect or the eleventh aspect when the computer program is executed by a computer .
  • the present application provides an image processing method, device, and system.
  • the same filter is used for the reconstructed image block in the entire image in the prior art.
  • the present application selects a corresponding filter for each reconstructed image block. That is, the present application adopts a targeted selection method to select a filter, and the reconstructed image block is upsampled by the selected filter, so that a reconstructed image block with better display effect can be obtained.
  • FIG. 1 is a schematic diagram of a digital video provided by the present application.
  • FIG. 2 is a schematic diagram of a digital image provided by the present application.
  • FIG. 3 is a schematic diagram of coding of an encoding end provided by the present application.
  • FIG. 4 is a schematic diagram of decoding of a decoding end provided by the present application.
  • FIG. 5 is a schematic diagram of coding of an encoding end provided by the present application.
  • FIG. 6 is a schematic diagram of an image being encoded according to an embodiment of the present application.
  • FIG. 7 is a schematic diagram of a reference pixel template according to an embodiment of the present application.
  • FIGS. 8A and 8B are schematic diagrams of a Planar mode according to an embodiment of the present application.
  • FIG. 9 is a schematic diagram of specific directions of 33 kinds of angle prediction modes according to an embodiment of the present application.
  • FIG. 10 is a schematic diagram of image down sampling according to an embodiment of the present application.
  • FIG. 11 is a schematic diagram of image up sampling according to an embodiment of the present application.
  • FIG. 12 is a schematic diagram of image up sampling according to an embodiment of the present application.
  • FIG. 13 is a schematic diagram of an upsampled image according to an embodiment of the present application.
  • FIG. 14 is a flowchart of an image processing method according to an embodiment of the present application.
  • FIG. 15 is a schematic diagram of a 4-neighbor pixel provided by an embodiment of the present application.
  • 16 is a schematic diagram of an 8-neighbor pixel provided by an embodiment of the present application.
  • FIG. 17 is a schematic diagram of image upsampling according to an embodiment of the present disclosure.
  • FIG. 18 is a schematic diagram of image upsampling according to another embodiment of the present application.
  • FIG. 19 is a schematic diagram of image upsampling according to an embodiment of the present disclosure.
  • FIG. 20 is a schematic diagram of image upsampling according to another embodiment of the present application.
  • FIG. 21 is a schematic diagram of a current reconstructed image block and an adjacent reconstructed image block according to an embodiment of the present disclosure
  • FIG. 22 is a schematic diagram of a current reconstructed image block according to an embodiment of the present disclosure.
  • FIG. 23 is a schematic diagram of adjacent boundaries of a right boundary and a right boundary according to an embodiment of the present disclosure
  • FIG. 24 is a flowchart of an image processing method according to another embodiment of the present application.
  • FIG. 25 is a flowchart of an image processing method according to still another embodiment of the present application.
  • FIG. 26 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present disclosure.
  • FIG. 27 is a schematic structural diagram of an image processing apparatus according to another embodiment of the present disclosure.
  • FIG. 28 is a schematic structural diagram of an image processing apparatus according to still another embodiment of the present application.
  • 29 is a schematic structural diagram of an image processing system provided by the present application.
  • FIG. 30 is a schematic structural diagram of an image processing system provided by the present application.
  • Digital video is a video recorded in digital form.
  • Digital video consists of multi-frame digital images. Often the original video contains a large amount of data, which is not suitable for storage and transmission, and requires efficient video compression coding techniques to compress the original data.
  • Video compression technology achieves compression by eliminating video redundancy.
  • Video redundancy mainly includes the following items: spatial redundancy, temporal redundancy, visual redundancy, and information entropy redundancy.
  • Spatial redundancy It is the most important data redundancy for static images. It means that the amplitudes of adjacent pixels are similar in an image. This spatial coherence is called spatial correlation or spatial redundancy. Spatial redundancy is mainly eliminated by the intra prediction method.
  • the intra prediction method refers to using the correlation of the video spatial domain to predict the pixels of the currently reconstructed image block by using the pixels of the reference reconstructed image block to achieve the removal of video spatial redundancy. purpose.
  • Temporal redundancy It is the redundancy that is often included in video sequences. Since adjacent images of video often contain the same or similar background and moving objects, only the spatial position of the moving object is slightly different. The high correlation of data is called time redundancy. Temporal redundancy is mainly eliminated by inter-frame prediction techniques, which refer to the use of pixels of temporally adjacent images to predict the current pixel.
  • Visual redundancy The human visual system is insensitive to changes in image detail, and even if these subtle changes are lost, the human eye does not feel it.
  • the visual redundancy is mainly eliminated by transforming and transforming technology, which refers to transforming the image signal into the frequency domain for processing, and performing data expression and bit redistribution according to the contribution of the different frequency signals to the visual quality, so that the space can be corrected. Unreasonable expression of uniform sampling over a domain.
  • the need to remove visual redundancy is taken into consideration, and the quantization operation is omitted, and the excessively high-frequency component expression is omitted to achieve effective compression.
  • Information entropy redundancy It can be known from information theory that as a pixel representing image data, it is only necessary to allocate the corresponding number of bits according to the size of its information entropy, and for each pixel of image data, it is difficult to obtain its information at the time of image acquisition. Entropy, therefore, is generally expressed by the same number of bits per pixel, so there must be redundancy. Information entropy redundancy is mainly solved by entropy coding technology. Entropy coding technology distributes different bit numbers for data with different information entropy through the information entropy distribution of statistical coefficients.
  • the current mainstream video compression coding architecture is a hybrid coding architecture.
  • different technologies are adopted to eliminate redundancy, and these technologies are combined to form a hybrid architecture of video coding.
  • the encoding side divides the image into image blocks to be encoded for each frame of the image constituting the video.
  • the current image block to be encoded is first predicted by referring to the reconstructed image block to obtain a prediction signal of the current image block to be encoded; and the residual signal is obtained by subtracting the prediction signal from the original signal of the current image block to be encoded. .
  • the magnitude of the residual signal is much smaller than the original signal.
  • the residual signal is transformed and quantized.
  • the transform quantized coefficients are obtained, and the quantized coefficients and other indication information in the encoding are encoded by the entropy coding technique to obtain a code stream. Further, the encoding end further needs to reconstruct the current image block to be encoded, so as to provide reference pixels for encoding the subsequent image block to be encoded.
  • the encoding end needs to perform inverse quantization and inverse transform on the transform quantized coefficients of the current image block to be encoded to obtain a reconstructed residual signal, and the reconstructed residual signal is
  • the prediction signals corresponding to the current image block to be encoded are added to obtain a reconstructed signal of the current image block to be encoded, and the reconstructed image block is obtained according to the reconstructed signal.
  • the decoding end after acquiring the code stream, the decoding end first performs entropy decoding on the code stream to obtain a transformed quantized coefficient of the current image block to be reconstructed, and then inverse quantizes and inverse transforms the transformed quantized coefficient to obtain an image to be reconstructed.
  • the residual signal of the reconstruction of the block Predicting the current image block to be reconstructed by referring to the reconstructed image block, obtaining a prediction signal of the current image block to be reconstructed, and then adding the prediction signal and the reconstructed residual signal to obtain a reconstruction signal of the current image block to be reconstructed, and then according to The reconstructed signal obtains a current reconstructed image block corresponding to the current image block to be reconstructed.
  • the encoding end first downsamples the image of each frame. As shown in FIG. 5, the encoding end uses downsampling processing on the entire image, and then each of the images subjected to the downsampling process.
  • the coded image block is encoded to obtain a code stream.
  • the resolution of the reconstructed image block corresponding to each image block to be encoded is a downsampling resolution.
  • the decoding end parses the code stream, and the resolution of each image block to be reconstructed is the downsampling resolution, and the resolution of the corresponding reconstructed image block is also the downsampling resolution, and the decoding end needs to adopt the reconstructed image block. Sampling processing to obtain a reconstructed image block of the original resolution.
  • the encoding end and the decoding end both involve predicting the current reconstructed image block (the current image block to be encoded or the current image block to be reconstructed) by referring to the reconstructed image block, and obtaining a prediction signal of the current reconstructed image block.
  • the prediction mode (mainly the intra prediction method) of the currently reconstructed image block may adopt the prior art, as follows:
  • FIG. 6 is a schematic diagram of an image being encoded according to an embodiment of the present application.
  • the image includes a plurality of image blocks, where the encoding order of the image is: from top to bottom, from left to right. right.
  • image blocks C, B, D, E, and A represent reconstructed image blocks that have been reconstructed
  • image block F is the current image block to be encoded
  • other regions in the image are uncoded image regions.
  • H.265 supports dividing the current image block to be encoded into smaller sub-image blocks for prediction operations.
  • the partition structure of the sub-image block is a quadtree structure, that is, one image block can be divided into four sub-image blocks, and each sub-image block can be further divided into four sub-image blocks.
  • FIG. 6 it is assumed that the current image block to be encoded is divided into 7 sub-image blocks for prediction operation, and the current image block to be encoded can also be divided into more sub-image blocks for prediction operations.
  • FIG. 7 is a schematic diagram of a reference pixel template according to an embodiment of the present application. As shown in FIG. 7, P 1,1 , P 2,1 ...
  • the sub-image block to be encoded may be the sub-image in FIG. Block 1.
  • other reference pixels R 0,0 , R 1,0 ... R 2N+1,0 ... R 0,2N constitute a reference pixel template, assuming that the image is to be encoded.
  • the sub-image block is the sub-image block 1 in FIG. 6, in which case some of the reference pixels are the pixels of the last row of the reference reconstructed image block B, and the other portion of the pixels are the rightmost side of the reference reconstructed image block A A column of pixels.
  • some of the reference pixels are pixels of the lower plurality of rows included in the reference reconstructed image block B, and the other partial pixels are pixels of the right plurality of columns included in the reference reconstructed image block A. That is, the present application does not limit the reference pixel template.
  • FIG. 8A and FIG. 8B are schematic diagrams of the Planar mode provided by an embodiment of the present application. As shown in FIG. 8, two linear filters in the horizontal and vertical directions are used, respectively. Two predicted values with And with The average value is used as a prediction signal for the pixel (x, y).
  • the DC mode is applicable to a large area flat area, and the prediction signal of the current sub-image block to be encoded can be obtained from the average value of the reference pixels on the left and the top thereof, as shown in FIG. 7, the prediction of each pixel in the sub-image block to be encoded.
  • the signal can be obtained by averaging R 0,1 ,..., R 0,N , R 1,0 ,..., R N,0 .
  • FIG. 9 is a schematic diagram of specific directions of 33 kinds of angle prediction modes according to an embodiment of the present invention. As shown in FIG. 9 , the 33 angle prediction modes are classified into a horizontal type mode (2 to 17) and a vertical type mode (18 to 34). ). Where V0 (mode 26) and H0 (mode 10) represent the vertical and horizontal directions, respectively, and the prediction directions of the remaining angle prediction modes can be regarded as an angular offset in the vertical or horizontal direction.
  • the angle prediction process is illustrated by taking the vertical direction V0 (26) as an example.
  • the vertical direction prediction is to predict the current sub-image block to be encoded using a row of reference pixels adjacent to the sub-image block to be currently encoded, which is currently to be encoded.
  • the position of the reference pixel may be the position between two adjacent reference pixels. If this is the case, a reference pixel needs to be interpolated between the two reference pixels according to the calculated position.
  • a prediction signal is generated from the obtained reference pixels.
  • the application also relates to image downsampling processing and image upsampling processing.
  • the image downsampling process involves three aspects of information: 1. Downsampling ratio; 2. Downsampling position; 3. Filter used for downsampling.
  • the downsampling ratio refers to the ratio of the original image to the downsampled image, which can be described in the horizontal direction and the vertical direction, respectively.
  • the image signal can be downsampled in the horizontal direction by 2:1, the vertical direction is downsampled by 4:1; or the horizontal direction is not downsampled, the vertical direction is downsampled by 2:1; or both horizontal and vertical directions are performed under 2:1. Sampling, etc.
  • the down sampling position refers to the positional relationship between the down sampling point and the original sampling point.
  • the position of the down sampling point may be the same as the position of some of the original sampling points, or the down sampling point falls between several original sampling points.
  • the downsampling filter may be a 3-lobe Lanczos filter, a Bilinear filter, a Bicubic, a Gauss filter, or the like.
  • FIG. 10 is a schematic diagram of image down sampling according to an embodiment of the present invention. It is assumed that the sampling ratios in the horizontal direction and the vertical direction are both 2:1. In the horizontal direction, the position of the down sampling point falls to the left of the two original sampling points. The original sampling point position, in the vertical direction, the down sampling point falls on the original sampling point position above the two original sampling points. As shown in Figure 10, the circled circle indicates the position of the downsampling point.
  • the downsampling filter is as follows:
  • the filter is a simple low-pass filter that can be thought of as a two-dimensional filter or as two one-dimensional filters. If used as a two-dimensional filter, downsampling in both horizontal and vertical directions can be done simultaneously in one filtering operation. As shown in FIG. 10, when downsampling point A is downsampled, eight adjacent original sampling points (circles circled by a triangle) are used, and the pixel value of the down sampling point A is calculated according to the above filter. If it is treated as two one-dimensional filters, it is necessary to first perform down-sampling in the horizontal or vertical direction, and then down-sample the results of the horizontal or vertical down-sampling in the completed horizontal or vertical direction. As shown in FIG.
  • downsampling point A when downsampling point A is down-sampled, firstly, one original sampling point is used to perform horizontal down sampling, and then the down-sampling point A is used to sample one original sample. The point is downsampled in the vertical direction, and the pixel value of the down sample point A is calculated according to the above filter. Using the same method, the entire 16*16 image block is downsampled. The final downsampling result is shown in Figure 10. The position of each downsampled point is shown by the circle in the box, and the pixel value of the downsampled point is The value after passing the filter operation. As shown in FIG. 10, the resolution of the downsampled image block is 8*8.
  • the upsampling process involves three aspects of information: 1. Upsampling ratio; 2. Upsampling position; 3 Filter used for upsampling.
  • the upsampling ratio refers to the ratio of the image before the upsampling to the image after the upsampling, which can be described in the horizontal direction and the vertical direction, respectively.
  • the upsampled image signal can be upsampled in the horizontal direction by 1:2, the vertical direction is 1:4 upsampled; or the horizontal direction is not upsampled, the vertical direction is 1:2 upsampled; or both horizontal and vertical directions are Perform 1:2 upsampling, etc.
  • the upsampling position is a positional relationship between the sampled point after the upsampling and the sampled point before the upsampling.
  • FIG. 11 is a schematic diagram of image upsampling provided in an embodiment of the present application, as shown in FIG.
  • the horizontal 1:2 upsampling ratio is used, and the position of the upsampled sample point can be on the right side of the sample point before the upsampling, where ⁇ represents the position of the sampled point after upsampling, and the circle represents the position of the sampled point before the upsampling.
  • the horizontal 1:2 upsampling ratio is used, and the position of the upsampled sample point can be to the left of the sample point before the upsampling, where ⁇ represents the position of the sampled point after upsampling, and the circle represents the position before the upsampling.
  • the sampling point location It should be noted that the position of the sampled point after the upsampling should correspond to the position selection of the above-mentioned down sampling point. For example, when performing downsampling, the position of the down sampling point is selected as the position of the original sampling point on the left side thereof. Then, when performing upsampling, the position of the sampled point after upsampling is selected as the position of the sampling point (downsampling point) before the upper right sampling.
  • the upsampling filter may be a DCTIF filter, a bilinear interpolation filter, a sinc filter, or the like.
  • the upsampling process will be described below by taking an image block with a resolution of 8*8 (i.e., the image block after downsampling described above) as an example. Assume that the upsampling ratios in the horizontal direction and the vertical direction are both 1:2.
  • the position of the sampled point after upsampling is the position of the sampling point before the right upsampling, and in the vertical direction, the upsampling
  • the position of the subsequent sampling point is the position of the sampling point before the upper upsampling, where the horizontal and vertical directions are respectively sampled as an example, and the DCTIF filter is taken as an example to illustrate the upsampling process.
  • the DCTIF filter is (-1, 4, -11, 40, 40, -11, 4, -1), assuming that the horizontal direction is currently being sampled.
  • Figure 11 assuming that the B3 sample point needs to be inserted, the following is used.
  • the formula determines the pixel value of B3:
  • FIG. 12 is a schematic diagram of image upsampling according to an embodiment of the present invention. As shown in FIG. 12, x represents a sampled point after upsampling, and a circle represents a sample point before upsampling.
  • the upsampling filter may also be a 6-tap Wiener Wiener filter.
  • the process of upsampling the image by the filter is as follows:
  • FIG. 13 is a schematic diagram of an upsampled image according to an embodiment of the present application, as shown in FIG.
  • the unlabeled boxes in the figure represent integer pixels, aa, bb, cc, dd, ee, ff, gg, hh and b, h, s, m, j are all 1/2 position pixels, others are 1/4 Position pixel.
  • the calculation process is to first interpolate 1/2 position pixels with a six-tap filter of (1, -5, 20, 20, -5, 1), and then calculate the interpolation of 1/4 position pixels by the method of adjacent pixel interpolation. To obtain the final upsampled image.
  • the encoding end or the decoding end performs the upsampling process for each reconstructed image block in the entire image by using the same filter.
  • the characteristics of each reconstructed image block may be different.
  • some reconstructed image blocks may be relatively different. It is flat; some reconstructed image blocks may have more details.
  • the prior art is bound to cause some reconstructed image blocks after upsampling to be blurred, and there is a problem that the display effect is not good.
  • the present application provides an image processing method, device, and system.
  • the present application can be based on the coding diagrams of FIG. 3 and FIG. 5, as shown in FIG. 3 and FIG.
  • the encoding mode of the block may be the original resolution encoding method as shown in FIG. 3 or the down sampling encoding method as shown in FIG. 5.
  • the original resolution encoding method refers to directly performing an encoding operation on the current image block to be encoded.
  • the downsampling coding mode refers to performing downsampling processing on the current image block to be encoded, and then performing encoding operation on the currently sampled image block to be coded.
  • the texture image block adopts the original resolution coding mode
  • the smooth image block adopts the down sampling coding mode.
  • the main idea of the present application is to select a filter for the current reconstructed image block and to upsample the current reconstructed image block by using the filter, if the encoding mode of the currently reconstructed image block is the downsampling coding mode, that is, for different To reconstruct an image block, select a filter to perform upsampling.
  • FIG. 14 is a flowchart of an image processing method according to an embodiment of the present disclosure. As shown in FIG. 14, the method includes:
  • Step S1401 Generate a reconstructed signal of the current image block to be encoded, and reconstruct a current image block to be encoded according to the reconstructed signal to obtain a current reconstructed image block.
  • Step S1402 If the coding mode of the current reconstructed image block is a downsampling coding mode, selecting a first filter for performing upsampling processing on the current reconstructed image block from the at least two candidate filters, and passing the first filter The current reconstructed image block is subjected to upsampling processing.
  • the encoding end may acquire the encoding mode of the current image block to be encoded of the current image and the pixel in each reference reconstructed image block; according to the encoding mode of the current image block to be encoded and the M reference reconstructed image blocks.
  • a pixel in the image determining a plurality of reference pixels of the current image block to be encoded; generating a prediction signal of the current image block to be encoded according to the plurality of reference pixels; acquiring an encoded signal of the current image block to be encoded, wherein when the image block to be currently encoded is When the encoding mode is the original resolution encoding mode, the encoded signal is the original signal of the current image block to be encoded.
  • the encoded signal is the original signal of the current image block to be encoded. a signal obtained after the downsampling process; generating a residual signal of the current image block to be encoded according to the prediction signal and the encoded signal; and transforming and quantizing the residual signal.
  • the transform quantized coefficients are obtained, and the encoding end performs inverse quantization and inverse transform on the transform quantized coefficients of the current image block to be encoded, thereby obtaining a reconstructed residual signal, and reconstructing the residual signal with a prediction signal corresponding to the current image block to be encoded. Adding, obtaining a reconstructed signal of the current image block to be encoded, and obtaining a current reconstructed image according to the reconstructed signal.
  • the current image block to be reconstructed corresponds to M reference reconstructed image blocks, and M is a positive integer greater than or equal to 1.
  • the reference reconstructed image block is used to determine a plurality of reference pixels of the image block to be reconstructed, wherein the plurality of reference pixels are used to generate a prediction signal of the current reconstructed image block.
  • the reference reconstructed image block is specifically related to which prediction image block and the prediction mode employed by the decoding end. When any of the above-described prediction modes in 35 is employed, reference may be made to the reference pixel template as shown in FIG.
  • the reference reconstructed image block is specifically related to which prediction image block and the prediction mode employed by the decoding end.
  • any of the above-described prediction modes in 35 reference may be made to the reference pixel template as shown in FIG.
  • the prediction signal of the current image block to be reconstructed is generated according to the plurality of reference pixels, and any one of the prediction modes in the above-mentioned 35 mode may be used.
  • other prediction modes in the prior art may also be used, which is not limited in this application. .
  • the reference reconstructed image block has the same resolution as the current image block to be reconstructed, at least one reference pixel is directly determined in the reference reconstructed image block; if the current image block to be reconstructed is the original resolution, the resolution of the reference reconstructed image block is Subsampling the resolution, obtaining at least one pixel required for reconstructing the current reconstructed image block from the reference reconstructed image block, and performing upsampling processing on at least one pixel required for reconstructing the current reconstructed image block, Obtaining at least one reference pixel of the current image block to be reconstructed; if the current image block to be reconstructed is a downsampling resolution, and the resolution of the reference reconstructed image block is the original resolution, acquiring the current image from the reference reconstructed image block The block performs at least one pixel required for reconstruction, and performs downsampling processing on the pixels to obtain at least one reference pixel of the current image block to be reconstructed.
  • the upsampling process performed by the encoding end on the currently reconstructed image block is performed based on pixels of the adjacent reconstructed image block required for the current reconstructed image block.
  • the pixels of the adjacent reconstructed image blocks are mainly used for upsampling the partial boundaries of the currently reconstructed image block, and the portions of the current reconstructed image block except the above partial boundaries are used.
  • the pixels are upsampled.
  • the first filter is a Discrete Cosine Transform-Based Interpolation Filter (DCTIF).
  • DCTIF Discrete Cosine Transform-Based Interpolation Filter
  • the adjacent reconstructed image block required for reconstructing the image block is as follows: A schematic diagram of a 4-neighbor pixel provided by an embodiment is provided. As shown in FIG.
  • an adjacent reconstructed image block required for a current reconstructed image block includes: an upper image block, a lower image block, and a left image block of the current reconstructed image block.
  • the first filter is a Convolutional Neural Network (CNN) filter.
  • CNN Convolutional Neural Network
  • the adjacent reconstructed image block required for reconstructing the image block is as follows: FIG. 16 is a schematic diagram of an 8-neighbor pixel provided by an embodiment of the present application, as shown in FIG.
  • the adjacent reconstructed image block includes: an upper image block, a lower image block, a left image block, a right image block, an upper left image block, a lower left image block, an upper right image block, and a lower right image block of the current reconstructed image block.
  • the lower image block, the right image block, the lower left image block, and the lower right image block of the current reconstructed image block have not yet been reconstructed.
  • the technique is to achieve upsampling processing by copying the pixels of the current reconstructed image block itself, but this way will cause the current reconstructed image block after the upsampling process to have a problem that the right and lower boundaries are discontinuous.
  • the present application provides the following four options:
  • the upsampling process is performed after all the reconstructed image blocks required for the upsampling process of the current reconstructed image block are reconstructed; correspondingly, the code stream includes: each of the M reference reconstructed image blocks. Referring to the coding mode of the reconstructed image block; determining, according to the current coding mode of the image block to be reconstructed and the pixels in the M reference reconstructed image blocks, the plurality of reference pixels of the current image block to be reconstructed, including: coding according to the current image block to be reconstructed The manner, the coding manner of the M reference reconstructed image blocks, and the pixels in the M reference reconstructed image blocks determine a plurality of reference pixels of the current image block to be reconstructed.
  • the upsampling process is performed after all the image blocks of the current image are reconstructed.
  • the code stream includes: a coding mode of each reference reconstructed image block in the M reference reconstructed image blocks;
  • the coding mode of the image block and the pixels in the M reference reconstructed image blocks determine a plurality of reference pixels of the current image block to be reconstructed, including: coding manner according to the current image block to be reconstructed, coding mode of the M reference reconstructed image blocks, and
  • the M reference reconstructed pixels in the image block determine a plurality of reference pixels of the current image block to be reconstructed.
  • Manner 3 performing a upsampling process on the currently reconstructed image block according to a pixel of a part of the adjacent reconstructed image block that is currently reconstructed in the required adjacent reconstructed image block; if the required adjacent reconstructed image block is in the If another part of the adjacent reconstructed image block that has not been reconstructed has been reconstructed, the partial boundary of the currently reconstructed image block is subjected to a second upsampling process according to another part of the adjacent reconstructed image block, wherein a part of the boundary of the currently reconstructed image block is Another portion of the adjacent reconstructed image blocks are contiguous.
  • Performing upsampling processing on the current reconstructed image block includes: reconstructing the current reconstructed image according to a pixel of a part of the adjacent reconstructed image block of the completed reconstructed image block in the adjacent adjacent reconstructed image block The block performs an upsampling process; if all the image blocks of the current image have been reconstructed, the partial boundary of the currently reconstructed image block is quadraticized according to another partially adjacent reconstructed image block in the adjacent adjacent reconstructed image block.
  • Sampling processing wherein another portion of the adjacent reconstructed image block is an image block that is not reconstructed when the first upsampling process is performed on the current reconstructed image block; a partial boundary of the current reconstructed image block is adjacent to another partially adjacent reconstructed image block .
  • the partial boundary of the current reconstructed image block satisfies the condition that, in the first upsampling process performed on the current reconstructed image block, another part of the adjacent reconstructed image block required for the partial boundary is not reconstructed.
  • a partial boundary of the currently reconstructed image block is a right boundary and a lower boundary of the currently reconstructed image block.
  • the part of the adjacent reconstructed image block is an upper image block and a left image block of the current reconstructed image block
  • the another partial adjacent reconstructed image block is a lower image block and a right side of the current reconstructed image block.
  • the part of the adjacent reconstructed image block is an upper left image block, an upper image block, an upper right image block and a left image block of the current reconstructed image block, and the other partially adjacent reconstructed image block is a right side of the current reconstructed image block.
  • the current reconstructed image block is upsampled by the first filter, and specifically refers to the first upsampling process performed on the currently reconstructed image block.
  • the adjacent reconstructed image blocks required to reconstruct the image block are also different for different filters.
  • the adjacent reconstructed image block required for the current reconstructed image block includes: an upper image block, a lower image block, a left image block, and a right image block of the current reconstructed image block.
  • the adjacent reconstructed image block required for the current reconstructed image block includes: an upper image block, a lower image block, a left image block, a right image block, an upper left image block, a lower left image block, and an upper right of the currently reconstructed image block.
  • Image block and bottom right image block is also different for different filters.
  • FIG. 17 is a schematic diagram of image upsampling provided by an embodiment of the present invention.
  • an adjacent reconstructed image block 1 , an adjacent reconstructed image block 2 , and an adjacent reconstructed image block required for reconstructing an image block B are as shown in FIG. 17 . 3 and the adjacent reconstructed image block 4 have all been reconstructed.
  • the current reconstructed image block B is subjected to upsampling processing, as shown in FIG. 17, in which a circle in B indicates a sampling point before up-sampling, and ⁇ indicates a sampling point after up-sampling.
  • the currently reconstructed image block itself is a boundary image block of an image, in this case, even if the required adjacent reconstructed image block is reconstructed, it is necessary to copy the current reconstructed image when performing the upsampling process.
  • Pixel For example, as shown in FIG. 15, when the current reconstructed image block is the rightmost image block of an image, its right image block does not exist, so the rightmost column included in the currently reconstructed image block can be included.
  • the pixels are copied to achieve upsampling processing.
  • other methods may also be used for the upsampling process, which is not limited in this application.
  • each adjacent reconstructed image block required for reconstructing the image block may be a downsampling coding mode or an original resolution coding mode, when performing the upsampling process on the current reconstructed image block, Divided into the following two cases:
  • the current reconstructed image block may be directly upsampled according to the pixels in the adjacent reconstructed image block.
  • the coding mode of an adjacent reconstructed image block is the original resolution coding mode
  • at least one pixel required for the upsampling process in the pixels of the adjacent reconstructed image block may be acquired, and the pixels are downsampled, and The current reconstructed image block is subjected to upsampling processing according to at least one pixel after the downsampling process.
  • the adjacent reconstructed image block is mainly used for performing upsampling processing on a partial boundary of the currently reconstructed image block (the partial boundary is different according to the filter), for example, as shown in FIG. 17, the adjacent reconstructed image block 3
  • the downsampling coding mode is adopted.
  • the right boundary of the current reconstructed image block B can be upsampled directly by using the pixels included in the adjacent reconstructed image block 3.
  • the adjacent reconstructed image block 4 adopts the original resolution encoding mode, the pixels required for the upsampling process included in the adjacent reconstructed image block 4 need to be downsampled, or the adjacent reconstructed image block 4 is subjected to downsampling processing.
  • FIG. 18 is a schematic diagram of image upsampling according to another embodiment of the present application. As shown in FIG. 18, this is a case of 8 neighborhood pixels, and the decoding side samples the current reconstructed image block C by using an upsampling processing method and 4 neighborhoods. The method in the case of a pixel is similar, and will not be described here.
  • the current reconstructed image block may be subjected to upsampling processing, and the current reconstructed image block may be identified as having completed the upsampling process.
  • the current reconstructed image block is subjected to upsampling processing according to a certain rule.
  • the upsampling process is based on the case of 4 neighborhood pixels
  • the current reconstructed image block may be subjected to upsampling processing.
  • the upsampling process is based on the case of 8 neighborhood pixels, once the lower right image block of the currently reconstructed image block is reconstructed, the current reconstructed image block may be subjected to upsampling processing.
  • the adjacent reconstructed image blocks it needs have been reconstructed, based on which, for any reconstructed image using downsampling coding
  • the blocks can be upsampled.
  • the specific upsampling process is similar to the mode of the foregoing mode 1, and the application is not described herein again.
  • the upsampling process performed on the current reconstructed image block includes two upsampling processes.
  • the first upsampling process is: performing a upsampling process on the currently reconstructed image block according to the pixels of a part of the adjacent reconstructed image blocks of the currently completed reconstructed image in the required adjacent reconstructed image block.
  • the second upsampling process is: if another part of the adjacent reconstructed image block of the currently uncompleted reconstruction in the required adjacent reconstructed image block has been reconstructed, the currently reconstructed image block is reconstructed according to another partial adjacent reconstructed image block.
  • the partial boundary is subjected to a second upsampling process in which the partial boundary of the currently reconstructed image block is contiguous with another partially adjacent reconstructed image block.
  • the current reconstructed image block of the downsampling coding mode is saved, and the reference pixels are provided for subsequent prediction of the other image blocks to be reconstructed.
  • the decoding end may copy the pixels of the rightmost column or columns included in the current reconstructed image block to obtain interpolated pixels. Upsampling processing is performed on the right boundary included in the currently reconstructed image block by these interpolated pixels. The decoding end may also copy the pixels of the lowermost row or rows included in the current reconstructed image block to obtain interpolated pixels. Upsampling processing is performed on the lower boundary included in the currently reconstructed image block by these interpolated pixels.
  • FIG. 19 is a schematic diagram of image upsampling according to an embodiment of the present invention. As shown in FIG. 19, it is assumed that the current reconstructed image block is image block A, and the second upsampling process is performed on the current reconstructed image block A.
  • the DCTIF filter performs upsampling processing.
  • the current reconstructed image block A has completed the first upsampling process.
  • the right four reference pixels required for each x do not exist. If the adjacent reconstructed image block C is reconstructed, the second upsampling process is performed on the right boundary of the currently reconstructed image block according to the adjacent reconstructed image block C.
  • the upsampling processing method here is the same as the above-described upsampling processing method, and details are not described herein again.
  • the current reconstructed image block is the image block B
  • the DCTIF filter is currently used for the upsampling process
  • the current reconstructed image block B has been completed for the first time.
  • the upsampling process when using the DCTIF filter for upsampling processing as described above, requires four pixels above and below, then in the first upsampling process, the lower four rows of the currently reconstructed image block B ⁇ ( ⁇ indicates The four reference pixels required for the sample point after the first upsampling process are incomplete. For example, for the bottom row x, the lower four reference pixels required for each x do not exist.
  • the second upsampling process is performed on the lower boundary of the currently reconstructed image block according to the adjacent reconstructed image block C.
  • the upsampling processing method here is the same as the above-described upsampling processing method, and details are not described herein again.
  • FIG. 20 is a schematic diagram of image upsampling according to another embodiment of the present application. As shown in FIG. 20, this is the case of 8 neighborhood pixels, and the decoding end is on the right boundary of the currently reconstructed image block A and the current reconstructed image block B.
  • the upsampling processing method used in the lower boundary is similar to the method in the case of 4 neighborhood pixels, and will not be described here.
  • the current reconstructed image block may be identified as having completed the upsampling process.
  • the current reconstructed image block is subjected to upsampling processing according to a certain rule.
  • the upsampling process is based on the case of 4 neighborhood pixels
  • the current upsampling image block may be subjected to the second upsampling process.
  • the upsampling process is based on the case of 8 neighborhood pixels
  • the current upsampling image block may be subjected to a second upsampling process.
  • the processed reconstructed image block can be subjected to the second upsampling process.
  • the specific upsampling process is similar to the mode of the foregoing mode 3, and details are not described herein again.
  • the current reconstructed image block of the downsampling coding mode is saved, and the reference pixels are provided for subsequent prediction of the other image blocks to be reconstructed.
  • the current reconstructed image block is upsampled by the above four methods, part of the boundary of the currently reconstructed image block is upsampled by the required adjacent reconstructed image block, and in the prior art, the current reconstructed image block is reconstructed.
  • the partial boundaries are all upsampled by copying the pixels of the currently reconstructed image block. Therefore, the method provided by the present application can avoid the problem that the current reconstructed image block boundary is discontinuous.
  • the same filter is used for the reconstructed image block in the entire image in the prior art, and the present application selects a corresponding filter for each reconstructed image block, that is, the present application adopts a targeted selection.
  • the method selects the filter, and the reconstructed image block is upsampled by the selected filter, so that the reconstructed image block with better display effect can be obtained.
  • the first filter for performing upsampling processing on the currently reconstructed image block may be selected by:
  • selecting, from the at least two candidate filters, the first filter for performing the upsampling process on the current reconstructed image block comprises: each of the at least two adjacent reconstructed image blocks of the currently reconstructed image block. a similarity between the adjacent reconstructed image block and the current reconstructed image block, wherein at least two adjacent reconstructed image blocks are subjected to upsampling processing corresponding to at least two second filters, and at least two candidate filters include at least two second a filter; selecting, as the first filter, a second filter corresponding to the adjacent reconstructed image block having the highest similarity with the current reconstructed image block from the at least two second filters.
  • the second filter as the first filter is not only represented as an assignment relationship, but also indicates that the second filter is directly selected to perform upsampling processing on the currently reconstructed image block.
  • the adjacent reconstructed image block refers to the reconstructed image block that has been subjected to the upsampling process in all the adjacent reconstructed image blocks of the currently reconstructed image block.
  • the adjacent reconstructed image block refers to the reconstructed image block that has completed the first upsampling process or the second upsampling process in all the adjacent reconstructed image blocks of the currently reconstructed image block.
  • the second filter is used for the first upsampling process on the adjacent reconstructed image block, or the second filter is used for the second upsampling process on the adjacent reconstructed image block.
  • the method for calculating the similarity between the current reconstructed image block and the adjacent reconstructed image block may be: if the resolution of the current reconstructed image block and the adjacent reconstructed image block are the same, then each pixel and adjacent reconstruction of the currently reconstructed image block The corresponding pixels in the image block are compared to obtain a corresponding difference, and a weighted average value is obtained for all the differences of the current reconstructed image block, and finally an error between the current reconstructed image block and the adjacent reconstructed image block is obtained, and the smaller the error, the smaller The higher the similarity.
  • the adjacent reconstructed image block is first sampled, so that the resolution of the adjacent reconstructed image block after the sampling process is the same as the resolution of the currently reconstructed image block. Then, each pixel of the current reconstructed image block is compared with a corresponding pixel in the sampled adjacent reconstructed image block to obtain a corresponding difference, and a weighted average value is obtained for all the differences of the current reconstructed image block, and finally the current value is obtained.
  • the error of reconstructing the image block and the adjacent reconstructed image block the smaller the error, the higher the similarity.
  • the present application is not limited to determining the similarity between the current reconstructed image block and the adjacent reconstructed image block.
  • the currently reconstructed image block does not have the adjacent reconstructed image block, that is, for the first mode and the second mode, in all the adjacent reconstructed image blocks of the current reconstructed image block, there is no reconstructed image that has been subjected to the upsampling process.
  • the foregoing mode three and method four in all the adjacent reconstructed image blocks of the current reconstructed image block, there is no reconstructed image block that has completed the first upsampling process and the second upsampling process. Then, the similarity between the adjacent reconstructed image blocks of the adjacent reconstructed image blocks and the currently reconstructed image block can be calculated.
  • the adjacent reconstructed image blocks of the adjacent reconstructed image blocks are subjected to upsampling processing corresponding to at least two filters; and the adjacent reconstructed images of the adjacent reconstructed image blocks having the highest similarity with the current reconstructed image block are selected from the at least two filters.
  • the filter corresponding to the block acts as the first filter. This application does not limit this.
  • the present application may also use a second filter corresponding to any adjacent reconstructed image block of the current reconstructed image block as a first filter. If the currently reconstructed image block does not have the adjacent reconstructed image block, that is, for the first mode and the second mode, in the adjacent reconstructed image block of the current reconstructed image block, there is no reconstructed image block that has been subjected to the upsampling process. Or, for the foregoing mode three and method four, in all the adjacent reconstructed image blocks of the current reconstructed image block, there is no reconstructed image block that has completed the first upsampling process and the second upsampling process.
  • adjacent reconstructed image blocks that need to be upsampled in all adjacent reconstructed image blocks of these adjacent reconstructed image blocks may be selected.
  • the corresponding filter when the selected adjacent reconstructed image block is subjected to the upsampling process is used as the first filter.
  • selecting, from the at least two candidate filters, the first filter for performing upsampling processing on the current reconstructed image block comprises: determining each of at least two adjacent reconstructed image blocks of the current reconstructed image block At least two second filters used when the adjacent reconstructed image blocks are subjected to upsampling processing; at least two candidate filters including the at least two second filters, from at least two in order of numbering of each adjacent reconstructed image block A second filter corresponding to the first adjacent reconstructed image block is selected as the first filter.
  • FIG. 21 is a schematic diagram of a current reconstructed image block and an adjacent reconstructed image block according to an embodiment of the present application.
  • the adjacent reconstructed image blocks A 0 , A 1 , B 0 , B 1 , B are determined.
  • the adjacent reconstructed image blocks of the upsampling process have been completed in 2 , assuming that A 0 , A 1 , B 0 , B 1 , B 2 are adjacent reconstructed image blocks, and their encoding order is: B 1 , A 1 , B 2 , B 0 , A 0 , according to the coding order, the second filter corresponding to B 1 is selected as the first filter of the current reconstructed image block.
  • Case 3 selecting, from the at least two candidate filters, the first filter for performing upsampling processing on the current reconstructed image block comprises: determining each adjacent one of the at least two adjacent reconstructed image blocks of the current reconstructed image block Reconstructing the image block to perform at least two second filters used in the upsampling process; the at least two candidate filters include the at least two second filters, and selecting the second filter having the highest probability of use as the first filter.
  • selecting a first filter for performing upsampling processing on the current reconstructed image block from the at least two candidate filters includes: selecting a first filter from the at least two candidate filters according to a texture feature of the currently reconstructed image block Device.
  • the selecting the first filter from the at least two candidate filters according to the texture feature of the current reconstructed image block comprises: selecting the first filter according to the preset mapping relationship and the texture feature of the currently reconstructed image block, where the preset mapping relationship is And a mapping relationship between the preset texture feature of the texture feature of the current reconstructed image block and the at least two candidate filters including the first filter.
  • detecting texture features of the currently reconstructed image block includes: an edge detection mode or a manner of determining texture features in the frequency domain, and the like. The following is the second way:
  • FIG. 22 is a schematic diagram of a current reconstructed image block according to an embodiment of the present invention.
  • the current reconstructed image block is an image block with a resolution of 8*8.
  • DCT Discrete Cosine Transform
  • the current reconstructed image block When the current reconstructed image block satisfies the formula ⁇ AC 2 ⁇ a*DC 2 in the frequency domain, it indicates that the texture feature of the current reconstructed image block is flat, otherwise, it indicates that the texture feature of the current reconstructed image block is a texture.
  • the left side of the above formula represents the sum of the squares of the alternating currents (AC) of all the pixels in the currently reconstructed image block
  • the right side is the sum of the squares of the direct currents (DC) of all the pixels in the currently reconstructed image block.
  • a can take an empirical value of 0.02.
  • the preset mapping relationship between the texture feature and the filter may be the mapping relationship shown in Table 1.
  • the present application does not limit the preset mapping relationship.
  • the first filter may be selected according to the preset mapping relationship and the texture feature of the currently reconstructed image block. Assuming that the texture feature of the currently reconstructed image block is a platform, and the preset mapping relationship is as shown in Table 1, the selected first filter is a DCTIF filter.
  • selecting, from the at least two candidate filters, the first filter for performing upsampling processing on the current reconstructed image block comprises: selecting the first filter from the at least two candidate filters according to the texture feature of the currently reconstructed image block Device.
  • selecting the first filter from the at least two candidate filters according to the texture feature of the currently reconstructed image block comprises: determining, in all adjacent reconstructed image blocks, at least two adjacent reconstructions that are identical to the current reconstructed image block texture feature And an image block, when at least two adjacent reconstructed image blocks are subjected to upsampling processing, corresponding to at least two second filters, and at least two candidate filters include at least two second filters, from the at least two second filters A second filter corresponding to the adjacent reconstructed image block having the same reconstructed image block texture feature is selected as the first filter.
  • mapping relationship between the texture feature of the adjacent reconstructed image block and the second filter may refer to the preset mapping relationship in Table 1 above. This application does not limit this.
  • Case 6 selecting a first filter for performing upsampling processing on the current reconstructed image block from the at least two candidate filters, comprising: performing upsampling processing on the current reconstructed image block by using at least two candidate filters respectively, And corresponding to the upsampled image blocks respectively corresponding to the at least two candidate filters; respectively calculating an error of the original image block corresponding to the upsampled image block corresponding to the at least two candidate filters and the current reconstructed image block; and using the candidate filter corresponding to the minimum error as First filter.
  • Calculating the error between the upsampled image block and the original image block includes: calculating a difference between each pixel of the upsampled image block and a corresponding pixel in the original image block, obtaining a corresponding difference, and weighting the average value of all the differences, and finally obtaining The error between the upsampled image block and the original image block.
  • the smaller the error between the upsampled image block and the original image block the better the upsampling processing effect of the corresponding filter of the upsampled image block.
  • the greater the error between the upsampled image block and the original image block the worse the upsampling processing effect of the filter corresponding to the upsampled image block.
  • the filter may also be selected according to the luminance component and the chrominance component in the present application.
  • the present application can select a first filter for the current reconstructed image block according to the above six conditions. Compared with the prior art, the same filter is used for the reconstructed image block in the entire image. The present application selects a corresponding filter for each reconstructed image block, so that a reconstructed image block with better display effect can be obtained.
  • the present application provides an image processing method, wherein the third filter may be the first filter described above, or the third filter may be selected by referring to the manner of selecting the first filter, and it is emphasized that the third filter It is upsampled for the partial boundary of the currently reconstructed image block.
  • the method before performing a second upsampling process on a partial boundary of the currently reconstructed image block according to another partial adjacent reconstructed image block in the required adjacent reconstructed image block by using a third filter, includes: determining, according to another partial adjacent reconstructed image block and a partial boundary of the currently reconstructed image block, whether to perform a second upsampling process on the partial boundary, and if determining to perform a second upsampling process on a part of the boundary of the first reconstructed image block, The third filter performs a second upsampling process on a partial boundary of the currently reconstructed image block according to another partial adjacent reconstructed image block.
  • a part of the boundary of the currently reconstructed image block includes: its right boundary and lower boundary. Then, one or more columns of pixels adjacent to the right border are determined in another portion of the second adjacent reconstructed image block. Determining whether to perform secondary upsampling processing on the right boundary according to the right boundary after the first upsampling process and the pixels of the one or more columns (adjacent boundary constituting the right boundary), when determining to perform secondary upsampling on the right boundary At the time of processing, it is also considered that the lower boundary is subjected to secondary upsampling processing.
  • the boundary of the currently reconstructed image block includes: its right and lower boundaries. Then, one or more rows of pixels adjacent to the lower boundary are determined in another portion of the second adjacent reconstructed image block. Determining whether to perform secondary upsampling on the lower boundary according to the lower boundary after the first upsampling process and the pixels of the one or more rows (adjacent boundaries constituting the lower boundary), and determining to perform secondary upsampling on the lower boundary At the time of processing, it is also considered that the right boundary is subjected to secondary upsampling processing.
  • FIG. 23 is a schematic diagram of adjacent boundaries of a right boundary and a right boundary according to an embodiment of the present disclosure, as shown in FIG. 23,
  • p0 to p3 represent pixel values of respective pixels of the right border
  • q0 to q3 represent pixel values of respective pixels of adjacent boundaries of the right border
  • TH1, TH2, and TH3 are preset thresholds, respectively, which may be the same or different.
  • the method further includes: generating a code stream, where the code stream includes: identifier information of the first filter.
  • the filters that can implement the upsampling process are generally one or more, and they may be different types of filters with different number of taps. It can also be a filter of the same type and different number of taps. Or a filter of the same type, the same number of taps, and different coefficients. Each filter has corresponding identification information. See Table 2, Table 3 and Table 4 for details.
  • the decoding end can perform the upsampling process on the current reconstructed image block by using the first filter.
  • generating a code stream where the code stream includes: first indication information, where the first indication information is used to indicate how to select a filter used when performing upsampling processing on the current reconstructed image block from the at least two candidate filters.
  • the method for selecting a filter includes: mode 1: selecting, according to a texture feature of the currently reconstructed image block, a filter used for performing upsampling processing on the current reconstructed image block from at least two candidate filters;
  • the adjacent reconstructed image block of the current reconstructed image block selects a filter used when up-sampling the current reconstructed image block from at least two candidate filters.
  • the code stream is generated, where the code stream includes: second indication information, where the second indication information is used to indicate whether the decoding end needs to perform secondary upsampling processing on the current reconstructed image block.
  • the foregoing code stream may include at least one of the following: identifier information of the first filter, first indication information, second indication information, and the like.
  • the code stream further includes: an image block to be currently encoded.
  • the decoding end may obtain the transform quantized coefficients of the current image block to be encoded by entropy decoding the encoded information, and obtain a prediction signal or the like by using the encoded information.
  • the code stream may further include: an encoding mode of the image block to be currently encoded, and the like.
  • the above mainly introduces the image processing method of the encoding end, and the image processing method of the decoding end will be described below.
  • FIG. 24 is a flowchart of an image processing method according to another embodiment of the present application. As shown in FIG. 24, the method includes:
  • Step S2401 Parsing the code stream to obtain the coding information of the current image block to be reconstructed and the coding mode of the current image block to be reconstructed;
  • Step S2402 Generate a reconstruction signal of the current image block to be reconstructed according to the coding information of the current image block to be reconstructed;
  • Step S2403 reconstruct the current image block to be reconstructed according to the reconstructed signal, and obtain a current reconstructed image block.
  • Step S2404 If the encoding mode of the image block to be reconstructed is the downsampling coding mode, selecting a first filter for performing upsampling processing on the current reconstructed image block according to the first indication information acquired from the code stream;
  • Step S2405 Perform upsampling processing on the currently reconstructed image block by using the first filter.
  • the first indication information is used to indicate how to select a filter used when performing upsampling processing on the current reconstructed image block from at least two candidate filters.
  • the code stream further includes: an encoding mode of the image block to be reconstructed, and a coding mode of the reconstructed image block that has been reconstructed in the current image in the current image block to be reconstructed.
  • the code stream includes some coding parameters, by which the coding mode of the current image block to be reconstructed, the coding mode of the reconstructed image block that has been reconstructed in the current image of the current image block to be reconstructed, and the like may be determined.
  • the coding information is used to generate a reconstructed signal of the image block to be reconstructed.
  • the decoding end performs entropy decoding on the encoded information to obtain a transformed quantized coefficient of the current image block to be reconstructed, and then inverse quantizes and inverse transforms the transformed quantized coefficient to obtain The reconstructed residual signal of the current image block to be reconstructed.
  • the image block to be reconstructed is predicted by the reference reconstructed image block (the information of the reconstructed image block belongs to the encoded information), the predicted signal of the current image block to be reconstructed is obtained, and then the predicted signal and the reconstructed residual signal are added together. Obtain a reconstruction signal of the current image block to be reconstructed.
  • the code stream also includes more coding information related to the prior art, which is not limited in this application.
  • the method for selecting a filter includes: mode 1: selecting, according to the texture feature of the current reconstructed image block, a filter used for performing upsampling processing on the current reconstructed image block from at least two candidate filters; Filters used when up-sampling the current reconstructed image block are selected from at least two candidate filters according to adjacent reconstructed image blocks of the current reconstructed image block.
  • the first filter for performing the upsampling process on the current reconstructed image block is selected according to the first indication information, and the current reconstructed image block is used by the first filter. Perform upsampling processing.
  • the same filter is used for the reconstructed image block in the entire image in the prior art, and the present application selects a corresponding filter for each reconstructed image block, that is, the present application adopts a targeted selection.
  • the method selects the filter, and the reconstructed image block is upsampled by the selected filter, so that the reconstructed image block with better display effect can be obtained.
  • the first indication information is used to indicate that a filter used when performing upsampling processing on the current reconstructed image block from the at least two candidate filters according to the texture feature of the currently reconstructed image block; the first obtained according to the obtained from the code stream
  • the indicating information is used to select a first filter for performing the upsampling process on the current reconstructed image block, including: selecting a first filter according to a preset mapping relationship and a texture feature of the currently reconstructed image block, where the preset mapping relationship includes the current Reconstructing a mapping relationship between a predetermined texture feature of the texture feature of the image block and at least two candidate filters including the first filter.
  • the first indication information is used to indicate that the filter used when performing upsampling processing on the current reconstructed image block is selected from the at least two candidate filters according to the adjacent reconstructed image block of the current reconstructed image block; Determining, by the first indication information, a first filter for performing upsampling processing on the current reconstructed image block, comprising: determining each adjacent reconstructed image block of the at least two adjacent reconstructed image blocks and the current reconstructed image block Similarity, when at least two adjacent reconstructed image blocks are subjected to upsampling processing, corresponding to at least two second filters, at least two candidate filters including at least two second filters; and selecting from at least two second filters A second filter corresponding to the adjacent reconstructed image block having the highest similarity is used as the first filter.
  • the current reconstructed image block is upsampled by the first filter, including: a part of the adjacent reconstruction of the currently completed reconstruction in the adjacent reconstructed image block required for performing the upsampling process according to the current reconstructed image block. a pixel of the image block, wherein the current reconstructed image block is subjected to upsampling processing by the first filter; correspondingly, the method further comprises: if another portion of the adjacent reconstructed image block that is currently incompletely reconstructed is adjacent to each other After the reconstructed image block has been reconstructed, the third filter is used to perform a second upsampling process on a part of the boundary of the currently reconstructed image block according to another part of the adjacent reconstructed image block, wherein a part of the boundary of the currently reconstructed image block is compared with another part. Neighbor reconstructed image blocks are contiguous.
  • the current reconstructed image block is upsampled by the first filter, including: a part of the adjacent reconstruction of the currently completed reconstruction in the adjacent reconstructed image block required for performing the upsampling process according to the current reconstructed image block. a pixel of the image block, performing a upsampling process on the current reconstructed image block by using the first filter; correspondingly, the method further includes: if all the image blocks of the current image in which the current reconstructed image block is located have been reconstructed, a third filter that performs a second upsampling process on a partial boundary of the currently reconstructed image block according to another partially adjacent reconstructed image block in the desired adjacent reconstructed image block, wherein another portion of the adjacent reconstructed image block is in the pair The image block that is not reconstructed when the current reconstructed image block is subjected to the first upsampling process; the partial boundary of the current reconstructed image block is adjacent to another partially adjacent reconstructed image block.
  • the third filter may be the first filter described above, or the third filter may be selected by referring to the manner of selecting the first filter, and it is emphasized that the third filter is for the current reconstructed image. Partial boundaries of the block are upsampled.
  • the method further includes: according to another part Determining whether a partial boundary of the adjacent reconstructed image block and the current reconstructed image block is subjected to secondary upsampling processing; if it is determined to perform a second upsampling process on a partial boundary of the first reconstructed image block, passing the third filter, A second upsampling process is performed on a partial boundary of the currently reconstructed image block according to another partial adjacent reconstructed image block.
  • the code stream further includes: second indication information; correspondingly, by using a third filter, according to another part of the adjacent reconstructed image block that is required to reconstruct the image block, the part of the current reconstructed image block Performing a second upsampling process on the boundary includes: if the second indication information indicates that the current reconstructed image block needs to be subjected to the second upsampling process, passing the third filter according to another part in the desired adjacent reconstructed image block The adjacent reconstructed image block performs secondary upsampling on a part of the boundary of the currently reconstructed image block
  • FIG. 25 is a flowchart of an image processing method according to still another embodiment of the present application. As shown in FIG. 25, the method includes:
  • Step S2501 Parsing the code stream to obtain the coding information of the current image block to be reconstructed and the coding mode of the current image block to be reconstructed;
  • Step S2502 Generate a reconstruction signal of the current image block to be reconstructed according to the encoding information, and reconstruct the current image block to be reconstructed according to the reconstruction signal to obtain a current reconstructed image block.
  • Step S2503 If the coding mode of the image block to be reconstructed is the downsampling coding mode, the identification information of the first filter is obtained from the code stream, and the current reconstructed image block is upsampled by the first filter identified by the identification information. .
  • the code stream further includes: an encoding mode of the image block to be reconstructed, and a coding mode of the reconstructed image block that has been reconstructed in the current image in the current image block to be reconstructed.
  • the coding information is used to generate a reconstructed signal of the image block to be reconstructed.
  • the decoding end performs entropy decoding on the encoded information to obtain a transformed quantized coefficient of the current image block to be reconstructed, and then inverse quantizes and inverse transforms the transformed quantized coefficient to obtain The reconstructed residual signal of the current image block to be reconstructed.
  • the image block to be reconstructed is predicted by the reference reconstructed image block (the information of the reconstructed image block belongs to the encoded information), the predicted signal of the current image block to be reconstructed is obtained, and then the predicted signal and the reconstructed residual signal are added together. Obtain a reconstruction signal of the current image block to be reconstructed.
  • the code stream also includes more coding information related to the prior art, which is not limited in this application.
  • the current reconstructed image block is subjected to upsampling processing by the first filter.
  • the same filter is used for the reconstructed image block in the entire image in the prior art, and the present application selects a corresponding filter for each reconstructed image block, that is, the present application adopts a targeted selection.
  • the method selects the filter, and the reconstructed image block is upsampled by the selected filter, so that the reconstructed image block with better display effect can be obtained.
  • the current reconstructed image block is upsampled by the first filter, including: a part of the adjacent reconstruction of the currently completed reconstruction in the adjacent reconstructed image block required for performing the upsampling process according to the current reconstructed image block. a pixel of the image block, wherein the current reconstructed image block is subjected to upsampling processing by the first filter; correspondingly, the method further comprises: if another portion of the adjacent reconstructed image block that is currently incompletely reconstructed is adjacent to each other After the reconstructed image block has been reconstructed, the third filter is used to perform a second upsampling process on a part of the boundary of the currently reconstructed image block according to another part of the adjacent reconstructed image block, wherein a part of the boundary of the currently reconstructed image block is compared with another part. Neighbor reconstructed image blocks are contiguous.
  • the current reconstructed image block is upsampled by the first filter, including: a part of the adjacent reconstruction of the currently completed reconstruction in the adjacent reconstructed image block required for performing the upsampling process according to the current reconstructed image block. a pixel of the image block, performing a upsampling process on the current reconstructed image block by using the first filter; correspondingly, the method further includes: if all the image blocks of the current image in which the current reconstructed image block is located have been reconstructed, a third filter, performing a second upsampling process on a partial boundary of the currently reconstructed image block according to another part of the adjacent reconstructed image block in the adjacent reconstructed image block, wherein another part of the adjacent reconstructed image block is in the opposite The image block that is not reconstructed when the current reconstructed image block is subjected to the first upsampling process; the partial boundary of the current reconstructed image block is adjacent to another partially adjacent reconstructed image block.
  • the third filter Determining, according to the partial boundary of the another partial adjacent reconstructed image block and the current reconstructed image block, whether to perform a second upsampling process on the partial boundary; if it is determined that the partial boundary of the first reconstructed image block is performed twice For the sampling process, the third filter is used to perform a second upsampling process on the partial boundary of the currently reconstructed image block according to another partial adjacent reconstructed image block.
  • the code stream further includes: second indication information; and correspondingly, through the third filter, the current reconstructed image block according to another part of the adjacent reconstructed image block in the required adjacent reconstructed image block Performing a second upsampling process on the partial boundary, including: if the second indication information indicates that the current reconstructed image block needs to be subjected to the second upsampling process, passing through the third filter according to the desired adjacent reconstructed image block Another portion of the adjacent reconstructed image block performs a second upsampling process on a portion of the boundary of the currently reconstructed image block.
  • the encoding end and the decoding end of the present application may also perform upsampling processing on the currently reconstructed image block by using a previously negotiated filter.
  • FIG. 26 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present disclosure.
  • the apparatus includes: a generating module 2601, configured to generate a reconstruction signal of a current image block to be encoded, and according to the reconstruction Reconstructing the current image block to be encoded to obtain a current reconstructed image block; and selecting a module 2602, configured to select, from the at least two candidate filters, if the encoding mode of the current reconstructed image block is a downsampling coding mode a first filter for performing upsampling processing on the current reconstructed image block; and a processing module 2603, configured to perform upsampling processing on the current reconstructed image block by using the first filter.
  • the selecting module 2602 is configured to select the first filter from the at least two candidate filters according to the texture feature of the current reconstructed image block.
  • the selecting module 2602 is specifically configured to: specifically, select the first filter according to a preset mapping relationship and a texture feature of the current reconstructed image block, where the preset mapping relationship includes the current reconstructed image a predetermined texture feature of the texture feature of the block and a mapping relationship between the at least two candidate filters including the first filter.
  • the selecting module 2602 is configured to determine a similarity between each adjacent reconstructed image block of the at least two adjacent reconstructed image blocks of the current reconstructed image block and the current reconstructed image block, where the at least two And the adjacent reconstructed image blocks are subjected to upsampling processing corresponding to at least two second filters, the at least two candidate filters including the at least two second filters; and from the at least two second filters A second filter corresponding to the adjacent reconstructed image block having the highest similarity to the current reconstructed image block is selected as the first filter.
  • the selecting module 2602 is configured to: perform upsampling processing on the current reconstructed image block by using the at least two candidate filters, respectively, to obtain an upsampled image corresponding to the at least two candidate filters respectively. a block; respectively calculating an error of the original image block corresponding to the upsampled image block corresponding to the at least two candidate filters and the current reconstructed image block; and using the candidate filter corresponding to the minimum error as the first filter.
  • the processing module 2603 is specifically configured to: use, according to the currently reconstructed image block of the currently reconstructed image in the adjacent reconstructed image block that is required for performing the upsampling process on the current reconstructed image block, by using the The first filter performs an upsampling process on the current reconstructed image block; the processing module 2603 is further configured to: if the currently adjacent reconstructed image block in the desired adjacent reconstructed image block is another currently adjacent reconstructed image After the block has been reconstructed, a second upsampling process is performed on a partial boundary of the current reconstructed image block according to the another partial adjacent reconstructed image block by a third filter, wherein the current reconstructed image block is A partial boundary is adjacent to the other partially adjacent reconstructed image block.
  • the processing module 2603 is specifically configured to: use, according to the currently reconstructed image block of the currently reconstructed image in the adjacent reconstructed image block that is required for performing the upsampling process on the current reconstructed image block, by using the The first filter performs an upsampling process on the current reconstructed image block, where the required adjacent reconstructed image block is an adjacent reconstructed image block required for performing upsampling processing on the current reconstructed image block;
  • the processing module 2603 if all the image blocks of the current image in which the current reconstructed image block is located have been reconstructed, pass the third filter, according to another part of the required adjacent reconstructed image block
  • the neighboring reconstructed image block performs a second upsampling process on a partial boundary of the current reconstructed image block, wherein the another partial adjacent reconstructed image block is not subjected to the first upsampling process of the current reconstructed image block Completing the reconstructed image block; the partial boundary of the current reconstructed image block is con
  • the third filter is the first filter.
  • the method further includes: a determining module 2604, configured to determine, according to the partial boundary of the another partial adjacent reconstructed image block and the current reconstructed image block, whether to perform secondary upsampling processing on the partial boundary;
  • the module 2602 is specifically configured to: if the determining module 2604 determines to perform a second upsampling process on a partial boundary of the first reconstructed image block, using the third filter to reconstruct the image block according to the another portion Performing a second upsampling process on a partial boundary of the current reconstructed image block.
  • the generating module 2601 is further configured to generate a code stream, where the code stream includes: identifier information of the first filter.
  • the generating module 2601 is further configured to generate a code stream, where the code stream includes: first indication information, where the first indication information is used to indicate how to select the current reconstructed image from the at least two candidate filters. The filter used when the block performs the upsampling process.
  • the generating module 2601 is further configured to generate a code stream, where the code stream includes: second indication information, where the second indication information is used to indicate whether the decoding end needs to perform the current reconstruction.
  • the image block is subjected to secondary upsampling processing.
  • the image processing device provided by the present application can perform the image processing method corresponding to FIG. 14 and the optional method of the method, and the implementation principle and technical effects are similar, and details are not described herein again.
  • FIG. 27 is a schematic structural diagram of an image processing apparatus according to another embodiment of the present disclosure. As shown in FIG. 27, the apparatus includes: a parsing module 2701, configured to parse a code stream to obtain encoding information of an image block to be reconstructed.
  • a parsing module 2701 configured to parse a code stream to obtain encoding information of an image block to be reconstructed.
  • a coding mode of the current image block to be reconstructed a generating module 2702, configured to generate a reconstruction signal of the current image block to be reconstructed according to the coding information of the current image block to be reconstructed, and reconstruct the current image to be reconstructed according to the reconstruction signal a block, the current reconstructed image block is obtained;
  • the selecting module 2703 is configured to: if the encoding mode of the current image block to be reconstructed is a down sampling encoding mode, select, according to the first indication information acquired from the code stream, to perform the current reconstructed image block.
  • the processing module 2704 is configured to pass the first The filter performs upsampling processing on the currently reconstructed image block.
  • the first indication information is used to indicate that the filter used in the upsampling process of the current reconstructed image block is selected from the at least two candidate filters according to the texture feature of the current reconstructed image block;
  • the selecting module 2703 is specifically configured to: Selecting, by the preset mapping relationship and the texture feature of the current reconstructed image block, the first filter, the preset mapping relationship being a preset texture feature including a texture feature of the current reconstructed image block, and including the first A mapping relationship between the at least two candidate filters of the filter.
  • the first indication information is used to indicate that a filter used when performing upsampling processing on the current reconstructed image block from the at least two candidate filters according to the adjacent reconstructed image block of the current reconstructed image block;
  • the module 2703 is specifically configured to: determine a similarity between each of the at least two adjacent reconstructed image blocks and the current reconstructed image block, where the at least two adjacent reconstructed image blocks correspond to the upsampling process At least two second filters, the at least two candidate filters including the at least two second filters; selecting, from the at least two second filters, corresponding to the adjacent reconstructed image blocks having the highest similarity A second filter is used as the first filter.
  • the processing module 2704 is configured to: use, according to the currently reconstructed image block of the currently reconstructed image block, the pixel of the adjacent reconstructed image block that is currently reconstructed according to the current reconstructed image block.
  • the first filter performs an upsampling process on the current reconstructed image block
  • the processing module 2704 is further configured to: if another part of the adjacent reconstructed image block in the required adjacent reconstructed image block is reconstructed, the adjacent reconstructed image block has been reconstructed.
  • the processing module 2704 is configured to: use, according to the currently reconstructed image block of the currently reconstructed image block, the pixel of the adjacent reconstructed image block that is currently reconstructed according to the current reconstructed image block.
  • the first filter performs an upsampling process on the current reconstructed image block;
  • the processing module 2704 is further configured to: if all the image blocks of the current image in which the currently reconstructed image block is located have been reconstructed, pass the first a third filter, performing a second upsampling process on a partial boundary of the current reconstructed image block according to another part of the adjacent reconstructed image block in the required adjacent reconstructed image block, wherein the another part is adjacently reconstructed
  • the image block is an image block that is not reconstructed when the first upsampling process is performed on the current reconstructed image block; the partial boundary of the current reconstructed image block is adjacent to the another partial adjacent reconstructed image block.
  • the third filter is the first filter.
  • the method further includes: a determining module 2705, configured to determine, according to the partial boundary of the another partial adjacent reconstructed image block and the current reconstructed image block, whether to perform secondary upsampling processing on the partial boundary;
  • the module 2704 is specifically configured to: if the determining module 2705 determines to perform a second upsampling process on a partial boundary of the first reconstructed image block, using the third filter to reconstruct the image block according to the another portion Performing a second upsampling process on a partial boundary of the current reconstructed image block.
  • the code stream further includes: second indication information; correspondingly, the processing module 2704 is specifically configured to: if the second indication information indicates that the current reconstructed image block needs to be subjected to secondary upsampling processing, The third filter performs a second upsampling process on a partial boundary of the currently reconstructed image block according to another partially adjacent reconstructed image block in the desired adjacent reconstructed image block.
  • the image processing device provided by the present application can perform the image processing method corresponding to FIG. 24 and the optional manner of the method, and the implementation principle and technical effects are similar, and details are not described herein again.
  • FIG. 28 is a schematic structural diagram of an image processing device according to another embodiment of the present disclosure. As shown in FIG. 28, the device includes: a parsing module 2801, configured to parse a code stream to obtain coding information of an image block to be reconstructed.
  • a parsing module 2801 configured to parse a code stream to obtain coding information of an image block to be reconstructed.
  • a coding mode of the current image block to be reconstructed a generating module 2802, configured to generate a reconstruction signal of the current image block to be reconstructed according to the coded information, and reconstruct the current image block to be reconstructed according to the reconstruction signal, to obtain a current Reconstructing the image block;
  • the parsing module 2801 is further configured to: if the encoding mode of the current image block to be reconstructed is a down sampling coding mode, obtain identification information of the first filter from the code stream; and the processing module 2803 is configured to pass The first filter identified by the identification information performs upsampling processing on the current reconstructed image block.
  • the image processing device provided by the present application can perform the image processing method corresponding to FIG. 25 and the optional manner of the method, and the implementation principle and technical effects are similar, and details are not described herein again.
  • the present application provides an image processing apparatus including: a processor and a memory for storing executable instructions of the processor; wherein the processor can execute the image processing method corresponding to FIG. 14 and an optional manner of the method .
  • the implementation principle and technical effect are similar, and will not be described here.
  • the present application provides an image processing apparatus including: a processor and a memory for storing executable instructions of the processor; wherein the processor can execute the image processing method corresponding to FIG. 24 and an optional manner of the method .
  • the implementation principle and technical effect are similar, and will not be described here.
  • the present application provides an image processing apparatus including: a processor and a memory for storing executable instructions of the processor; wherein the processor can execute the image processing method corresponding to FIG. 25 and an optional manner of the method .
  • the implementation principle and technical effect are similar, and will not be described here.
  • FIG. 29 is a schematic structural diagram of an image processing system provided by the present application. As shown in FIG. 29, the system includes: an image processing device 2901 of the above decoding end, and an image processing device 2902 of the encoding end.
  • the image processing device of the decoding end of the image processing system provided by the present application may perform the image processing method corresponding to the above-mentioned FIG. 14 and an optional manner of the method, and the image processing device including the encoding end may perform the image processing method corresponding to FIG. 24 described above and The optional method and the technical effect of the method are similar, and are not described here.
  • FIG. 30 is a schematic structural diagram of an image processing system provided by the present application. As shown in FIG. 30, the system includes: an image processing device 3001 of the above decoding end, and an image processing device 3002 of the encoding end.
  • the image processing device of the decoding end of the image processing system provided by the present application may perform the image processing method corresponding to FIG. 14 and the optional method of the method, and the image processing device of the encoding end may perform the image processing method corresponding to FIG. 25 described above and
  • the optional method and the technical effect of the method are similar, and are not described here.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

La présente invention concerne un procédé, un dispositif et un système de traitement d'image, comprenant les étapes consistant à : générer un signal de reconstruction pour un bloc d'image courant à coder, et reconstruire le bloc d'image courant à coder selon le signal de reconstruction de façon à obtenir un bloc d'image reconstruit courant; si le mode de codage pour le bloc d'image reconstruit courant est un codage de sous-échantillonnage, alors sélectionner à partir d'au moins deux filtres candidats un premier filtre pour effectuer un suréchantillonnage sur le bloc d'image reconstruit courant, et effectuer un suréchantillonnage sur le bloc d'image reconstruit courant au moyen du premier filtre. Par rapport à une technologie existante qui utilise le même filtre pour tous les blocs d'image reconstruits dans l'image entière, la présente invention consiste à sélectionner un filtre correspondant pour chaque bloc d'image reconstruit, ou en d'autres termes, la présente invention utilise la sélection de filtres d'une manière ciblée, et un sur-échantillonnage est effectué sur des blocs d'image reconstruits au moyen des filtres sélectionnés, ce qui permet d'obtenir des blocs d'image reconstruits ayant de meilleurs qualités d'affichage.
PCT/CN2018/085537 2017-07-13 2018-05-04 Procédé, dispositif et système de traitement d'image WO2019011046A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710571640.1A CN109257605B (zh) 2017-07-13 2017-07-13 图像处理方法、设备及***
CN201710571640.1 2017-07-13

Publications (1)

Publication Number Publication Date
WO2019011046A1 true WO2019011046A1 (fr) 2019-01-17

Family

ID=65001554

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/085537 WO2019011046A1 (fr) 2017-07-13 2018-05-04 Procédé, dispositif et système de traitement d'image

Country Status (3)

Country Link
CN (1) CN109257605B (fr)
TW (1) TWI681672B (fr)
WO (1) WO2019011046A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113822815A (zh) * 2021-09-24 2021-12-21 广州光锥元信息科技有限公司 使用gpu渲染进行高性能图片杂物消除的方法和装置
TWI780482B (zh) * 2020-02-28 2022-10-11 大陸商北京市商湯科技開發有限公司 圖像處理方法、電子設備和電腦可讀儲存介質
WO2022237899A1 (fr) * 2021-05-14 2022-11-17 Beijing Bytedance Network Technology Co., Ltd. Procédé, dispositif et support pour traitement vidéo
WO2023019567A1 (fr) * 2021-08-20 2023-02-23 深圳传音控股股份有限公司 Procédé de traitement d'images, terminal mobile et support de stockage

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20210125086A (ko) * 2019-02-22 2021-10-15 후아웨이 테크놀러지 컴퍼니 리미티드 선형 모델을 사용한 인트라 예측을 위한 방법 및 장치

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1939066A (zh) * 2004-04-02 2007-03-28 汤姆森许可贸易公司 用于复杂度可伸缩视频解码器的方法和设备
CN101742321A (zh) * 2010-01-12 2010-06-16 浙江大学 基于图层分解的视频编、解码方法及装置
CN102387366A (zh) * 2005-03-18 2012-03-21 夏普株式会社 用于空间可缩放视频编码的具有降低的复杂度的减少块伪像的方法和***
CN103916676A (zh) * 2012-12-31 2014-07-09 华为技术有限公司 一种边界强度确定方法、去块效应滤波方法、及装置
WO2016154008A1 (fr) * 2015-03-20 2016-09-29 Qualcomm Incorporated Procédé de sous-échantillonnage pour mode de prédiction de modèle linéaire

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10448032B2 (en) * 2012-09-04 2019-10-15 Qualcomm Incorporated Signaling of down-sampling location information in scalable video coding
CN103716622B (zh) * 2012-09-29 2017-02-08 华为技术有限公司 用于图像处理的方法和装置
KR20140089487A (ko) * 2013-01-04 2014-07-15 삼성전자주식회사 위상차를 고려한 영상 업샘플링을 이용하는 스케일러블 비디오 부호화 방법 및 장치, 스케일러블 비디오 복호화 방법 및 장치

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1939066A (zh) * 2004-04-02 2007-03-28 汤姆森许可贸易公司 用于复杂度可伸缩视频解码器的方法和设备
CN102387366A (zh) * 2005-03-18 2012-03-21 夏普株式会社 用于空间可缩放视频编码的具有降低的复杂度的减少块伪像的方法和***
CN101742321A (zh) * 2010-01-12 2010-06-16 浙江大学 基于图层分解的视频编、解码方法及装置
CN103916676A (zh) * 2012-12-31 2014-07-09 华为技术有限公司 一种边界强度确定方法、去块效应滤波方法、及装置
WO2016154008A1 (fr) * 2015-03-20 2016-09-29 Qualcomm Incorporated Procédé de sous-échantillonnage pour mode de prédiction de modèle linéaire

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI780482B (zh) * 2020-02-28 2022-10-11 大陸商北京市商湯科技開發有限公司 圖像處理方法、電子設備和電腦可讀儲存介質
WO2022237899A1 (fr) * 2021-05-14 2022-11-17 Beijing Bytedance Network Technology Co., Ltd. Procédé, dispositif et support pour traitement vidéo
WO2023019567A1 (fr) * 2021-08-20 2023-02-23 深圳传音控股股份有限公司 Procédé de traitement d'images, terminal mobile et support de stockage
CN113822815A (zh) * 2021-09-24 2021-12-21 广州光锥元信息科技有限公司 使用gpu渲染进行高性能图片杂物消除的方法和装置
CN113822815B (zh) * 2021-09-24 2024-02-06 广州光锥元信息科技有限公司 使用gpu渲染进行高性能图片杂物消除的方法和装置

Also Published As

Publication number Publication date
TW201909643A (zh) 2019-03-01
CN109257605B (zh) 2021-11-19
CN109257605A (zh) 2019-01-22
TWI681672B (zh) 2020-01-01

Similar Documents

Publication Publication Date Title
CN109302608B (zh) 图像处理方法、设备及***
JP6929907B2 (ja) 省略符号化を用いた映像符号化及び復号化装置及びその方法
TWI681672B (zh) 圖像處理方法、設備及系統
JP6356912B2 (ja) 最適化関数を用いてグラフベース予測を実行する方法及び装置
CN108028941B (zh) 用于通过超像素编码和解码数字图像的方法和装置
Wu et al. Low bit-rate image compression via adaptive down-sampling and constrained least squares upconversion
TWI672941B (zh) 影像處理方法、設備及系統
TW201204046A (en) Hybrid video decoder, hybrid video encoder, data stream
CN111586410B (zh) 视频编码方法、解码方法及其相关装置
CN112335245A (zh) 视频图像分量预测方法及装置、计算机存储介质
KR101059649B1 (ko) 적응적 보간 필터를 이용한 부호화 장치, 그 방법 및 복호화 장치
WO2019190342A1 (fr) Dispositif et procédé de traitement d'image
US20230044603A1 (en) Apparatus and method for applying artificial intelligence-based filtering to image
Drynkin et al. Video images compression and restoration methods based on optimal sampling
Moses et al. A survey on adaptive image interpolation based on quantitative measures

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18831229

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18831229

Country of ref document: EP

Kind code of ref document: A1