WO2019011046A1

WO2019011046A1 - Image processing method, device and system

Info

Publication number: WO2019011046A1
Application number: PCT/CN2018/085537
Authority: WO
Inventors: 高山; 张红; 杨海涛; 刘杉
Original assignee: 华为技术有限公司
Priority date: 2017-07-13
Filing date: 2018-05-04
Publication date: 2019-01-17
Also published as: TW201909643A; CN109257605B; TWI681672B; CN109257605A

Abstract

Provided by the present application are an image processing method, device and system, comprising: generating a reconstructing signal for a current image block to be coded, and reconstructing the current image block to be coded according to the reconstructing signal so as to obtain a current reconstructed image block; if the coding mode for the current reconstructed image block is down-sampling coding, then selecting from at least two candidate filters a first filter for performing up-sampling on the current reconstructed image block, and performing up-sampling on the current reconstructed image block by means of the first filter. Relative to existing technology that uses the same filter for all reconstructed image blocks in the entire image, the present application involves selecting a corresponding filter for each reconstructed image block, or in other words, the present application employs the selection of filters in a targeted manner, and up-sampling is performed on reconstructed image blocks by means of the selected filters, thereby being able to obtain reconstructed image blocks having better display effects.

Description

图像处理方法、设备及***Image processing method, device and system

本申请要求于2017年7月13日提交中国专利局、申请号为201710571640.1、申请名称为“图像处理方法、设备及***”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。The present application claims the priority of the Chinese Patent Application, filed on Jan. 13, 2017, the application number of .

技术领域Technical field

本申请涉及图像处理技术，尤其涉及一种图像处理方法、设备及***。The present application relates to image processing technologies, and in particular, to an image processing method, device, and system.

背景技术Background technique

数字视频是以数字形式记录的视频。图1为本申请提供的数字视频的示意图，如图1所示，数字视频由多帧数字图像组成。图2为本申请提供的数字图像的示意图，如图2所示，图像由12*16个像素组成，其中，每个像素被称为一个像素，12*16表示图像分辨率。例如2K视频的图像分辨率是1920*1080，4K视频的图像分辨率是3840*2160。通常原始视频包括的数据量较大，不适合存储和传输，需要利用高效的视频压缩编码技术来压缩原始数据。Digital video is a video recorded in digital form. FIG. 1 is a schematic diagram of a digital video provided by the present application. As shown in FIG. 1, the digital video is composed of a multi-frame digital image. 2 is a schematic diagram of a digital image provided by the present application. As shown in FIG. 2, the image is composed of 12*16 pixels, wherein each pixel is referred to as one pixel, and 12*16 represents image resolution. For example, the image resolution of 2K video is 1920*1080, and the image resolution of 4K video is 3840*2160. Often the original video contains a large amount of data, which is not suitable for storage and transmission, and requires efficient video compression coding techniques to compress the original data.

具体地，图3为本申请提供的编码端的编码示意图，如图3所示，编码端的编码流程包括：编码端接收到视频之后，对于构成视频的每帧图像，将该图像划分成多个待编码图像块。对于当前待编码图像块，首先通过参考重建图像块(该参考重建图像块用于提供当前待编码图像块所需的参考像素，该参考像素用于对当前待编码图像块进行预测)对当前待编码图像块进行预测，得到当前待编码图像块的预测信号；用当前待编码图像块的原始信号减去预测信号，得到残差信号。经过预测后，残差信号的幅值远小于原始信号。将残差信号进行变换和量化操作。经过变换量化后，得到变换量化系数，再通过熵编码技术编码量化系数以及编码中的其他指示信息，得到码流。进一步地，编码端还需要重建当前待编码图像块，以实现对后续待编码图像块的编码提供参考像素。具体地，在得到当前待编码图像块的变换量化系数之后，编码端需要对当前待编码图像块的变换量化系数进行反量化和反变换，得到重建的残差信号，将重建的残差信号与当前待编码图像块对应的预测信号相加，得到当前待编码图像块的重建信号，根据该重建信号得到重建图像块。其中，该重建图像块可以对后续待编码图像块进行预测。可选地，残差信号经过变换后得到变换系数，变换系数通过量化后会有信息损失，该信息损失不可逆。即经过反量化后的变换系数会有失真，从而使得重建信号与原始信号不一致，这种压缩方式为有损压缩。因此，对于有损压缩，在得到重建图像块后，需要对该重建图像块进行滤波，从而去除有损压缩引入的一些失真，例如块效应，振铃效应等。为了去除块效应，可以使用H.264、H.265标准中的DBK滤波器。为了去除振铃效应，可以使用H.265中的SAO滤波器，以及下一代标准中的ALF滤波器等。也有无损压缩方法，即残差信号使用无损的变换操作得到变换系数，不进行量化操作，将变换系数进行熵编。对于无损压缩，一般不再进行滤波操作。进一步地，当前图像的各个图像块都完成重建之后，得到重建图像，其中，该重建图像可以对后续其他帧图像进行预测。Specifically, FIG. 3 is a schematic diagram of encoding of an encoding end provided by the present application. As shown in FIG. 3, the encoding process of the encoding end includes: after receiving the video by the encoding end, dividing the image into multiple to-bes for each frame image constituting the video. Encode image blocks. For the current image block to be encoded, the image block is first reconstructed by reference (the reference reconstructed image block is used to provide a reference pixel required for the current image block to be encoded, and the reference pixel is used to predict the current image block to be encoded). The coded image block is predicted to obtain a prediction signal of the current image block to be coded; the prediction signal is subtracted from the original signal of the current image block to be coded to obtain a residual signal. After prediction, the magnitude of the residual signal is much smaller than the original signal. The residual signal is transformed and quantized. After transform quantization, the transform quantized coefficients are obtained, and the quantized coefficients and other indication information in the encoding are encoded by the entropy coding technique to obtain a code stream. Further, the encoding end further needs to reconstruct the current image block to be encoded, so as to provide reference pixels for encoding the subsequent image block to be encoded. Specifically, after obtaining the transform quantized coefficients of the current image block to be encoded, the encoding end needs to perform inverse quantization and inverse transform on the transform quantized coefficients of the current image block to be encoded to obtain a reconstructed residual signal, and the reconstructed residual signal is The prediction signals corresponding to the current image block to be encoded are added to obtain a reconstructed signal of the current image block to be encoded, and the reconstructed image block is obtained according to the reconstructed signal. The reconstructed image block can predict a subsequent image block to be encoded. Optionally, the residual signal is transformed to obtain a transform coefficient, and the transform coefficient has information loss after being quantized, and the information loss is irreversible. That is, the inversely quantized transform coefficients are distorted, so that the reconstructed signal is inconsistent with the original signal. This compression method is lossy compression. Therefore, for lossy compression, after the reconstructed image block is obtained, the reconstructed image block needs to be filtered to remove some distortion introduced by lossy compression, such as blockiness, ringing effect, and the like. In order to remove the block effect, a DBK filter in the H.264, H.265 standard can be used. In order to remove the ringing effect, the SAO filter in H.265, and the ALF filter in the next generation standard, etc. can be used. There is also a lossless compression method, that is, the residual signal is obtained by using a lossless transform operation to obtain transform coefficients, and the transform coefficients are subjected to entropy coding without performing quantization operations. For lossless compression, filtering operations are generally not performed. Further, after each image block of the current image is reconstructed, a reconstructed image is obtained, wherein the reconstructed image can predict other subsequent frame images.

图4为本申请提供的解码端的解码示意图，如图4所示，解码端获取到码流之后，首先对码流进行熵解码，得到当前待重建图像块的变换量化系数，然后对变换量化系数进行反量化和反变换，得到当前待重建图像块的重建的残差信号。通过它的参考重建图像块对当前待重建图像块进行预测，得到当前待重建图像块的预测信号，然后将预测信号和上述重建的残差信号相加，得到当前待重建图像块的重建信号，然后根据该重建信号得到当前待重建图像块对应的当前重建图像块，其中，该当前重建图像块可以对后续其他待重建图像块进行预测。类似于上述编码端的情况，可选地，在解码端需要对当前重建图像块进行滤波。进一步地，当前图像的各个图像块都完成重建之后，得到重建图像，其中，该重建图像可以对后续其他帧图像进行预测。4 is a schematic diagram of decoding of a decoding end provided by the present application. As shown in FIG. 4, after acquiring a code stream, the decoding end first performs entropy decoding on the code stream to obtain a transform quantized coefficient of the current image block to be reconstructed, and then transforms the quantized coefficient. Performing inverse quantization and inverse transform to obtain a reconstructed residual signal of the current image block to be reconstructed. Predicting the current image block to be reconstructed by using the reference reconstructed image block, obtaining a prediction signal of the current image block to be reconstructed, and then adding the prediction signal and the reconstructed residual signal to obtain a reconstruction signal of the current image block to be reconstructed, Then, the current reconstructed image block corresponding to the current image block to be reconstructed is obtained according to the reconstructed signal, wherein the current reconstructed image block can predict other subsequent image blocks to be reconstructed. Similar to the case of the above encoding end, optionally, the current reconstructed image block needs to be filtered at the decoding end. Further, after each image block of the current image is reconstructed, a reconstructed image is obtained, wherein the reconstructed image can predict other subsequent frame images.

为了降低编解码复杂度，编码端对每帧图像先进行下采样处理，图5为本申请提供的编码端的编码示意图，如图5所示，编码端对整幅图像采用下采样处理，然后对经过下采样处理后的图像中的每个待编码图像块进行编码，得到码流。其中，每个待编码图像块对应的重建图像块的分辨率为下采样分辨率。相应的，解码端解析码流，每个待重建图像块的分辨率均为下采样分辨率，得到对应的重建图像块的分辨率也为下采样分辨率，解码端需要对重建图像块采用上采样处理，以得到原始分辨率的重建图像块。In order to reduce the complexity of coding and decoding, the encoding end first performs downsampling processing on each frame of image. FIG. 5 is a schematic diagram of encoding of the encoding end provided by the present application. As shown in FIG. 5, the encoding end uses downsampling processing on the entire image, and then Each image block to be encoded in the downsampled image is encoded to obtain a code stream. The resolution of the reconstructed image block corresponding to each image block to be encoded is a downsampling resolution. Correspondingly, the decoding end parses the code stream, and the resolution of each image block to be reconstructed is the downsampling resolution, and the resolution of the corresponding reconstructed image block is also the downsampling resolution, and the decoding end needs to adopt the reconstructed image block. Sampling processing to obtain a reconstructed image block of the original resolution.

现有技术中，编码端或者解码端对于整幅图像中每个重建图像块均采用相同的滤波器进行上采样处理，然而，各个重建图像块的特性可能不同，例如，有些重建图像块可能较为平坦；有些重建图像块可能细节比较多，现有技术势必导致有些经过上采样处理之后的重建图像块比较模糊，存在显示效果不佳的问题。In the prior art, the encoding end or the decoding end performs the upsampling process for each reconstructed image block in the entire image by using the same filter. However, the characteristics of each reconstructed image block may be different. For example, some reconstructed image blocks may be relatively different. It is flat; some reconstructed image blocks may have more details. The prior art is bound to cause some reconstructed image blocks after upsampling to be blurred, and there is a problem that the display effect is not good.

发明内容Summary of the invention

本申请提供图像处理方法、设备及***，从而解决有些经过上采样处理之后的重建图像块显示效果不佳的问题。The present application provides an image processing method, device, and system, thereby solving the problem that some reconstructed image blocks after the upsampling process are not well displayed.

第一方面，本申请提供一种图像处理方法，包括：生成当前待编码图像块的重建信号，并根据重建信号重建当前待编码图像块，以得到当前重建图像块；若当前重建图像块的编码方式为下采样编码方式，则从至少两个候选滤波器中选择用于对当前重建图像块进行上采样处理的第一滤波器，并通过第一滤波器对当前重建图像块进行上采样处理。In a first aspect, the present application provides an image processing method, including: generating a reconstructed signal of a current image block to be encoded, and reconstructing a current image block to be encoded according to the reconstructed signal to obtain a current reconstructed image block; if the current reconstructed image block is encoded In a manner of downsampling coding, a first filter for performing upsampling processing on the current reconstructed image block is selected from the at least two candidate filters, and the current reconstructed image block is subjected to upsampling processing by the first filter.

本申请的有益效果为：相对于现有技术中对整幅图像中的重建图像块都采用相同的滤波器，本申请针对每个重建图像块都要选择对应的滤波器，即本申请采用具有针对性的选择方式来选择滤波器，通过选择的滤波器对重建图像块进行上采样处理，从而可以得到显示效果更佳的重建图像块。The utility model has the beneficial effects that the same filter is used for the reconstructed image block in the whole image in the prior art, and the present application selects a corresponding filter for each reconstructed image block, that is, the application adopts The filter is selected in a targeted manner, and the reconstructed image block is upsampled by the selected filter, so that a reconstructed image block with better display effect can be obtained.

可选地，从至少两个候选滤波器中选择用于对当前重建图像块进行上采样处理的第一滤波器，具体包括：根据当前重建图像块的纹理特征从至少两个候选滤波器中选择第一滤波器。Optionally, selecting, from the at least two candidate filters, the first filter for performing the upsampling process on the current reconstructed image block, specifically: selecting, according to the texture feature of the currently reconstructed image block, from the at least two candidate filters First filter.

可选地，根据当前重建图像块的纹理特征从至少两个候选滤波器中选择第一滤波器，包括：根据预设映射关系和所述当前重建图像块的纹理特征选择第一滤波器，预设映射关系是包括当前重建图像块的纹理特征的预设纹理特征和包括第一滤波器的至少两个候选滤波器之间的映射关系。Optionally, selecting the first filter from the at least two candidate filters according to the texture feature of the currently reconstructed image block comprises: selecting the first filter according to the preset mapping relationship and the texture feature of the current reconstructed image block, The mapping relationship is a mapping relationship between a preset texture feature including texture features of the currently reconstructed image block and at least two candidate filters including the first filter.

通过根据当前重建图像块的纹理特征为当前重建图像块选择第一滤波器，通过选择的滤波器对重建图像块进行上采样处理，从而可以得到显示效果更佳的重建图像块。By selecting a first filter for the current reconstructed image block according to the texture feature of the currently reconstructed image block, and performing upsampling processing on the reconstructed image block by the selected filter, a reconstructed image block with better display effect can be obtained.

可选地，从至少两个候选滤波器中选择用于对当前重建图像块进行上采样处理的第一滤波器，具体包括：确定当前重建图像块的至少两个相邻重建图像块中每个相邻重建图像块与当前重建图像块的相似度，其中，至少两个相邻重建图像块进行上采样处理时对应至少两个第二滤波器，至少两个候选滤波器包括至少两个第二滤波器；从至少两个第二滤波器中选择与当前重建图像块相似度最高的相邻重建图像块对应的第二滤波器作为第一滤波器。Optionally, selecting a first filter for performing upsampling processing on the current reconstructed image block from the at least two candidate filters comprises: determining each of at least two adjacent reconstructed image blocks of the currently reconstructed image block. a similarity between the adjacent reconstructed image block and the current reconstructed image block, wherein at least two adjacent reconstructed image blocks are subjected to upsampling processing corresponding to at least two second filters, and at least two candidate filters include at least two second a filter; selecting, as the first filter, a second filter corresponding to the adjacent reconstructed image block having the highest similarity with the current reconstructed image block from the at least two second filters.

通过根据当前重建图像块的相邻重建图像块选择第一滤波器，通过选择的滤波器对重建图像块进行上采样处理，从而可以得到显示效果更佳的重建图像块。By selecting the first filter according to the adjacent reconstructed image block of the currently reconstructed image block, and performing upsampling processing on the reconstructed image block by the selected filter, a reconstructed image block with better display effect can be obtained.

可选地，从至少两个候选滤波器中选择用于对当前重建图像块进行上采样处理的第一滤波器包括，包括：通过至少两个候选滤波器分别对所述当前重建图像块进行上采样处理，得到至少两个候选滤波器分别对应的上采样图像块；分别计算至少两个候选滤波器对应的上采样图像块与所述当前重建图像块对应的原始图像块的误差；将最小误差对应的候选滤波器作为第一滤波器。通过该方法可以更加精确的选择第一滤波器。Optionally, selecting, from the at least two candidate filters, the first filter for performing the upsampling process on the current reconstructed image block comprises: separately performing the current reconstructed image block by using at least two candidate filters Sampling processing, obtaining an upsampled image block corresponding to at least two candidate filters respectively; respectively calculating an error of the upsampled image block corresponding to the at least two candidate filters and the original image block corresponding to the current reconstructed image block; A corresponding candidate filter is used as the first filter. The first filter can be selected more precisely by this method.

可选地，通过第一滤波器对所述当前重建图像块进行上采样处理，包括：根据当前重建图像块进行上采样处理时所需的相邻重建图像块中的当前已完成重建的一部分相邻重建图像块的像素，通过第一滤波器对所述当前重建图像块进行一次上采样处理；相应的，方法还包括：若所需的相邻重建图像块中的当前未完成重建的另一部分相邻重建图像块已完成重建，则通过第三滤波器，根据另一部分相邻重建图像块对当前重建图像块的部分边界进行二次上采样处理，其中，当前重建图像块的部分边界与另一部分相邻重建图像块邻接。Optionally, performing upsampling processing on the current reconstructed image block by using the first filter, including: part of the currently completed reconstruction in the adjacent reconstructed image block required for performing the upsampling process according to the current reconstructed image block A pixel of the adjacent reconstructed image block is subjected to upsampling processing on the current reconstructed image block by a first filter; correspondingly, the method further includes: if another part of the currently adjacent reconstructed image block that is not currently reconstructed is required After the adjacent reconstructed image block has been reconstructed, the third filter is used to perform a second upsampling process on the partial boundary of the currently reconstructed image block according to another partial adjacent reconstructed image block, wherein the partial boundary of the currently reconstructed image block is another A portion of the adjacent reconstructed image blocks are contiguous.

可选地，通过第一滤波器对当前重建图像块进行上采样处理，包括：根据当前重建图像块进行上采样处理时所需的相邻重建图像块中的当前已完成重建的一部分相邻重建图像块的像素，通过第一滤波器对当前重建图像块进行一次上采样处理；相应的，所述方法还包括：若当前重建图像块所处的当前图像的所有图像块均已完成重建，则通过第三滤波器，根据所需的相邻重建图像块中的另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理，其中，另一部分相邻重建图像块是在对当前重建图像块进行第一次上采样处理时未完成重建的图像块；当前重建图像块的部分边界与另一部分相邻重建图像块邻接。Optionally, the current reconstructed image block is upsampled by the first filter, including: a part of the adjacent reconstruction of the currently completed reconstruction in the adjacent reconstructed image block required for performing the upsampling process according to the current reconstructed image block. a pixel of the image block, performing a upsampling process on the current reconstructed image block by using the first filter; correspondingly, the method further includes: if all the image blocks of the current image in which the current reconstructed image block is located have been reconstructed, Performing a second upsampling process on a partial boundary of the currently reconstructed image block according to another partial adjacent reconstructed image block in the adjacent adjacent reconstructed image block by a third filter, wherein another partially adjacent reconstructed image block An image block that is not reconstructed when the current up-sampling process is performed on the current reconstructed image block; a partial boundary of the current reconstructed image block is adjacent to another partially adjacent reconstructed image block.

本申请这两种可选方法可以避免当前重建图像块边界不连续的问题。The two alternative methods of the present application can avoid the problem that the reconstructed image block boundaries are not continuous.

可选地，第三滤波器为所述第一滤波器。Optionally, the third filter is the first filter.

可选地，通过第三滤波器，根据所需的相邻重建图像块中的另一部分相邻重建图像块对当前重建图像块的部分边界进行二次上采样处理之前，还包括：根据另一部分相邻重建图像块和当前重建图像块的部分边界判断是否对部分边界进行二次上采样处理；若确定对第一重建图像块的部分边界进行二次上采样处理，则通过第三滤波器，根据另一部分相邻重建图像块对当前重建图像块的部分边界进行二次上采样处理。Optionally, before the second upsampling process is performed on the partial boundary of the currently reconstructed image block according to the other neighboring reconstructed image block in the adjacent adjacent reconstructed image block by using the third filter, the method further includes: according to another part Determining whether a partial boundary of the adjacent reconstructed image block and the current reconstructed image block is subjected to secondary upsampling processing; if it is determined to perform a second upsampling process on a partial boundary of the first reconstructed image block, passing the third filter, A second upsampling process is performed on a partial boundary of the currently reconstructed image block according to another partial adjacent reconstructed image block.

当确定不对当前重建图像块进行二次上采样处理时，可以降低解码端的开销，当确定需要对当前重建图像块进行二次上采样处理时，可以解决当前重建图像块的边界不连续问题。When it is determined that the current reconstructed image block is not subjected to the second upsampling process, the overhead of the decoding end may be reduced. When it is determined that the current reconstructed image block needs to be subjected to the second upsampling process, the boundary discontinuity problem of the currently reconstructed image block may be solved.

可选地，还包括：生成码流，该码流包括：第一滤波器的标识信息。Optionally, the method further includes: generating a code stream, where the code stream includes: identifier information of the first filter.

可选地，码流还包括第一指示信息，其中，第一指示信息用于指示如何从至少两个候选滤波器选择对当前重建图像块进行上采样处理时使用的滤波器。Optionally, the code stream further includes first indication information, wherein the first indication information is used to indicate how to select a filter used when performing upsampling processing on the current reconstructed image block from the at least two candidate filters.

可选地，生成码流，码流包括：第二指示信息，其中，第二指示信息用于指示解码端是否需要对当前重建图像块进行二次上采样处理。Optionally, the code stream is generated, where the code stream includes: second indication information, where the second indication information is used to indicate whether the decoding end needs to perform secondary upsampling processing on the current reconstructed image block.

下面将介绍解码端的图像处理方法，其效果与编码端对应效果类似，下面不再赘述。The image processing method at the decoding end will be described below, and the effect thereof is similar to that of the encoding end, and will not be described below.

第二方面，本申请提供一种图像处理方法，包括：解析码流，以获取当前待重建图像块的编码信息和所述当前待重建图像块的编码方式；根据当前待重建图像块的编码信息生成当前待重建图像块的重建信号，并根据重建信号重建当前待重建图像块，得到当前重建图像块；若当前待重建图像块的编码方式为下采样编码方式，则根据从码流获取的第一指示信息选择用于对当前重建图像块进行上采样处理的第一滤波器，其中，第一指示信息用于指示如何从至少两个候选滤波器选择对当前重建图像块进行上采样处理时使用的滤波器；通过第一滤波器对当前重建图像块进行上采样处理。In a second aspect, the present application provides an image processing method, including: parsing a code stream, to obtain encoding information of an image block to be reconstructed and an encoding mode of the current image block to be reconstructed; and encoding information according to an image block to be reconstructed currently; Generating a reconstructed signal of the current image block to be reconstructed, and reconstructing the current image block to be reconstructed according to the reconstructed signal to obtain a current reconstructed image block; if the current image mode of the image block to be reconstructed is a downsampling coding mode, according to the first obtained from the code stream An indication information is used to select a first filter for performing upsampling processing on the current reconstructed image block, wherein the first indication information is used to indicate how to use the at least two candidate filter selections to perform upsampling processing on the current reconstructed image block Filter; the current reconstructed image block is upsampled by the first filter.

可选地，第一指示信息用于指示根据当前重建图像块的纹理特征选择滤波器从至少两个候选滤波器选择对当前重建图像块进行上采样处理时使用的滤波器；根据从所述码流获取的第一指示信息选择用于对所述当前重建图像块进行上采样处理的第一滤波器，包括：根据第一指示信息确定当前重建图像块的纹理特征；根据预设映射关系和当前重建图像块的纹理特征选择第一滤波器，预设映射关系是包括当前重建图像块的纹理特征的预设纹理特征和包括第一滤波器的所述至少两个候选滤波器之间的映射关系。Optionally, the first indication information is used to indicate that the filter used in the upsampling process of the current reconstructed image block is selected from the at least two candidate filters according to the texture feature selection filter of the current reconstructed image block; The first indication information of the flow acquisition is used to select a first filter for performing the upsampling process on the current reconstructed image block, including: determining a texture feature of the current reconstructed image block according to the first indication information; according to a preset mapping relationship and current Reconstructing a texture feature of the image block to select a first filter, the preset mapping relationship being a mapping relationship between the preset texture feature including the texture feature of the currently reconstructed image block and the at least two candidate filters including the first filter .

可选地，第一指示信息用于指示根据当前重建图像块的相邻重建图像块从至少两个候选滤波器选择对当前重建图像块进行上采样处理时使用的滤波器；根据从码流获取的第一指示信息选择用于对当前重建图像块进行上采样处理的第一滤波器，包括：确定至少两个相邻重建图像块中每个相邻重建图像块与当前重建图像块的相似度，至少两个相邻重建图像块进行上采样处理时对应至少两个第二滤波器，至少两个候选滤波器包括至少两个第二滤波器；从至少两个第二滤波器中选择相似度最高的相邻重建图像块对应的第二滤波器作为所述第一滤波器。Optionally, the first indication information is used to indicate that the filter used when performing upsampling processing on the current reconstructed image block is selected from the at least two candidate filters according to the adjacent reconstructed image block of the current reconstructed image block; The first indication information is used to select a first filter for performing upsampling processing on the current reconstructed image block, comprising: determining a similarity between each of the at least two adjacent reconstructed image blocks and the current reconstructed image block And at least two adjacent reconstructed image blocks are corresponding to at least two second filters when the upsampling process is performed, the at least two candidate filters include at least two second filters; and the similarity is selected from the at least two second filters The second filter corresponding to the highest adjacent reconstructed image block serves as the first filter.

可选地，通过第一滤波器对当前重建图像块进行上采样处理，包括：根据当前重建图像块进行上采样处理时所需的相邻重建图像块中的当前已完成重建的一部分相邻重建图像块的像素，通过第一滤波器对当前重建图像块进行一次上采样处理；相应的，方法还包括：若所需的相邻重建图像块中的当前未完成重建的另一部分相邻重建图像块已完成重建，则通过第三滤波器，根据另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理，其中，当前重建图像块的所述部分边界与另一部分相邻重建图像块邻接。Optionally, the current reconstructed image block is upsampled by the first filter, including: a part of the adjacent reconstruction of the currently completed reconstruction in the adjacent reconstructed image block required for performing the upsampling process according to the current reconstructed image block. a pixel of the image block, performing a upsampling process on the current reconstructed image block by using the first filter; correspondingly, the method further includes: if the required adjacent reconstructed image block is another currently adjacent reconstructed image that is not yet reconstructed After the block has been reconstructed, a partial upsampling process is performed on a portion of the boundary of the currently reconstructed image block according to another partial adjacent reconstructed image block by using a third filter, wherein the partial boundary of the currently reconstructed image block is another A portion of the adjacent reconstructed image blocks are contiguous.

可选地，通过第一滤波器对当前重建图像块进行上采样处理，包括：根据当前重建图像块进行上采样处理时所需的相邻重建图像块中的当前已完成重建的一部分相邻重建图像块的像素，通过第一滤波器对当前重建图像块进行一次上采样处理；相应的，方法还包括：若当前重建图像块所处的当前图像的所有图像块均已完成重建，则通过第三滤波器，根据所需的相邻重建图像块中的另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理，其中，另一部分相邻重建图像块是在对当前重建图像块进行第一次上采样处理时未完成重建的图像块；当前重建图像块的部分边界与另一部分相邻重建图像块邻接。Optionally, the current reconstructed image block is upsampled by the first filter, including: a part of the adjacent reconstruction of the currently completed reconstruction in the adjacent reconstructed image block required for performing the upsampling process according to the current reconstructed image block. a pixel of the image block, performing a upsampling process on the current reconstructed image block by using the first filter; correspondingly, the method further includes: if all the image blocks of the current image in which the current reconstructed image block is located have been reconstructed, a third filter, performing a second upsampling process on a partial boundary of the current reconstructed image block according to another part of the adjacent reconstructed image block in the required adjacent reconstructed image block, wherein another part of the adjacent reconstructed image block is The image block that is not reconstructed when the current up-sampling process is performed for the first reconstructed image block; the partial boundary of the current reconstructed image block is adjacent to another partially adjacent reconstructed image block.

可选地，所述第三滤波器为所述第一滤波器。Optionally, the third filter is the first filter.

可选地，码流还包括：第二指示信息；相应的，通过第三滤波器，根据所需的相邻重建图像块中的另一部分相邻重建图像块对当前重建图像块的部分边界进行二次上采样处理，包括：若第二指示信息指示需要对当前重建图像块进行二次上采样处理，则通过第三滤波器，根据在所需的相邻重建图像块中的另一部分相邻重建图像块对当前重建图像块的部分边界进行二次上采样处理。Optionally, the code stream further includes: second indication information; and correspondingly, a third filter is used to perform a partial boundary of the currently reconstructed image block according to another partially adjacent reconstructed image block in the required adjacent reconstructed image block. The second upsampling process includes: if the second indication information indicates that the current reconstructed image block needs to be subjected to the second upsampling process, passing through the third filter, according to another part of the adjacent adjacent reconstructed image block The reconstructed image block performs a second upsampling process on a portion of the boundary of the currently reconstructed image block.

第三方面，本申请提供一种图像处理方法，包括：解析码流，以获取当前待重建图像块的编码信息和当前待重建图像块的编码方式；根据编码信息生成当前待重建图像块的重建信号，并根据重建信号重建当前待重建图像块，得到当前重建图像块；若当前待重建图像块的编码方式为下采样编码方式，则从码流获取第一滤波器的标识信息，并通过标识信息标识的第一滤波器对当前重建图像块进行上采样处理。In a third aspect, the present application provides an image processing method, including: parsing a code stream to obtain an encoding information of an image block to be reconstructed and an encoding mode of an image block to be reconstructed; and reconstructing a current image block to be reconstructed according to the encoding information. And reconstructing the current image block to be reconstructed according to the reconstructed signal to obtain a current reconstructed image block; if the current image to be reconstructed is in a downsampling coding mode, obtaining the identification information of the first filter from the code stream, and identifying The first filter of the information identification performs upsampling processing on the currently reconstructed image block.

下面对图像处理设备及***进行介绍，其实现原理和技术效果与上述原理和技术效果类似，此处不再赘述。The image processing device and system are described below, and the implementation principle and technical effects thereof are similar to the above principles and technical effects, and are not described herein again.

第四方面，本申请提供一种图像处理设备，包括：生成模块，用于生成当前待编码图像块的重建信号，并根据重建信号重建当前待编码图像块，以得到当前重建图像块；选择模块，用于若当前重建图像块的编码方式为下采样编码方式，则从至少两个候选滤波器中选择用于对所述当前重建图像块进行上采样处理的第一滤波器；处理模块，用于通过第一滤波器对所述当前重建图像块进行上采样处理。In a fourth aspect, the present application provides an image processing apparatus, including: a generating module, configured to generate a reconstructed signal of a current image block to be encoded, and reconstruct a current image block to be encoded according to the reconstructed signal to obtain a current reconstructed image block; And if the coding mode of the current reconstructed image block is a downsampling coding mode, selecting a first filter for performing upsampling processing on the current reconstructed image block from at least two candidate filters; The current reconstructed image block is subjected to upsampling processing by a first filter.

第五方面，本申请提供一种图像处理设备，包括：解析模块，用于解析码流，以获取当前待重建图像块的编码信息和当前待重建图像块的编码方式；生成模块，用于根据当前待重建图像块的编码信息生成当前待重建图像块的重建信号，并根据重建信号重建当前待重建图像块，得到当前重建图像块；选择模块，用于若当前待重建图像块的编码方式为下采样编码方式，则根据从码流获取的第一指示信息选择用于对当前重建图像块进行上采样处理的第一滤波器，其中，第一指示信息用于指示如何从至少两个候选滤波器选择对当前重建图像块进行上采样处理时使用的滤波器；处理模块，用于通过第一滤波器对当前重建图像块进行上采样处理。In a fifth aspect, the present application provides an image processing apparatus, including: a parsing module, configured to parse a code stream, to obtain an encoding information of an image block to be reconstructed and an encoding mode of an image block to be reconstructed; and a generating module, configured to The coding information of the current image block to be reconstructed generates a reconstruction signal of the current image block to be reconstructed, and reconstructs the current image block to be reconstructed according to the reconstruction signal to obtain a current reconstructed image block. The selection module is configured to: if the current image block to be reconstructed is encoded a downsampling coding mode, the first filter for performing upsampling processing on the current reconstructed image block is selected according to the first indication information acquired from the code stream, where the first indication information is used to indicate how to filter from at least two candidates The filter selects a filter used when performing upsampling processing on the current reconstructed image block; and the processing module is configured to perform upsampling processing on the currently reconstructed image block by using the first filter.

第六方面，本申请提供一种图像处理设备，包括：解析模块，用于解析码流，以获取当前待重建图像块的编码信息和当前待重建图像块的编码方式；生成模块，用于根据编码信息生成当前待重建图像块的重建信号，并根据重建信号重建所述当前待重建图像块，得到当前重建图像块；解析模块，还用于若当前待重建图像块的编码方式为下采样编码方式，则从码流获取第一滤波器的标识信息；处理模块，用于通过标识信息标识的第一滤波器对所述当前重建图像块进行上采样处理。In a sixth aspect, the present application provides an image processing apparatus, including: a parsing module, configured to parse a code stream, to obtain an encoding information of an image block to be reconstructed currently and an encoding mode of an image block to be reconstructed; and a generating module, configured to The coding information generates a reconstruction signal of the current image block to be reconstructed, and reconstructs the current image block to be reconstructed according to the reconstruction signal to obtain a current reconstructed image block; and the parsing module is further configured to: if the current image to be reconstructed is coded as a downsampling code The method is to obtain the identifier information of the first filter from the code stream, and the processing module is configured to perform the upsampling process on the current reconstructed image block by using the first filter identified by the identifier information.

第七方面，本申请提供一种图像处理***，包括：如第四方面以及第四方面的可选方式所述的图像处理设备，以及如第五方面以及第五方面的可选方式所述的图像处理设备。In a seventh aspect, the present application provides an image processing system, comprising: the image processing device according to the fourth aspect and the optional aspect of the fourth aspect, and the fifth aspect and the optional aspect of the fifth aspect Image processing device.

第八方面，本申请提供一种图像处理***，包括：如第四方面以及第四方面的可选方式所述的图像处理设备，以及如第六方面以及第六方面的可选方式所述的图像处理设备。In an eighth aspect, the present application provides an image processing system, comprising: the image processing device according to the fourth aspect and the optional aspect of the fourth aspect, and the sixth aspect and the optional aspect of the sixth aspect Image processing device.

第九方面，本申请提供一种图像处理设备，该设备包括经配置以进行以下操作的编码器：In a ninth aspect, the application provides an image processing apparatus including an encoder configured to:

生成当前待编码图像块的重建信号，并根据重建信号重建所述当前待编码图像块，以得到当前重建图像块；若当前重建图像块的编码方式为下采样编码方式，则从至少两个候选滤波器中选择用于对当前重建图像块进行上采样处理的第一滤波器，并通过第一滤波器对当前重建图像块进行上采样处理。Generating a reconstructed signal of the current image block to be encoded, and reconstructing the current image block to be encoded according to the reconstructed signal to obtain a current reconstructed image block; if the encoding mode of the current reconstructed image block is a downsampling coding mode, from at least two candidates A first filter for performing upsampling processing on the current reconstructed image block is selected in the filter, and the current reconstructed image block is subjected to upsampling processing by the first filter.

第十方面，本申请提供一种图像处理设备，该设备包括经配置以进行以下操作的解码器：In a tenth aspect, the application provides an image processing apparatus including a decoder configured to:

解析码流，以获取当前待重建图像块的编码信息和所述当前待重建图像块的编码方式；根据当前待重建图像块的编码信息生成当前待重建图像块的重建信号；根据重建信号重建当前待重建图像块，得到当前重建图像块；若当前待重建图像块的编码方式为下采样编码方式，则根据从码流获取的第一指示信息选择用于对当前重建图像块进行上采样处理的第一滤波器，其中，第一指示信息用于指示如何从至少两个候选滤波器选择对当前重建图像块进行上采样处理时使用的滤波器；通过第一滤波器对当前重建图像块进行上采样处理。Parsing the code stream to obtain the coding information of the current image block to be reconstructed and the coding mode of the current image block to be reconstructed; generating a reconstruction signal of the current image block to be reconstructed according to the coding information of the current image block to be reconstructed; reconstructing the current image according to the reconstruction signal The image block to be reconstructed is obtained, and the current reconstructed image block is obtained. If the encoding mode of the current image block to be reconstructed is the down sampling coding mode, the upsampling process is performed on the current reconstructed image block according to the first indication information acquired from the code stream. a first filter, wherein the first indication information is used to indicate how to select a filter used for upsampling the current reconstructed image block from the at least two candidate filters; and the current reconstructed image block is performed by the first filter Sampling processing.

第十一方面，本申请提供一种图像处理设备，该设备包括经配置以进行以下操作的解码器：In an eleventh aspect, the application provides an image processing apparatus including a decoder configured to:

解析码流，以获取当前待重建图像块的编码信息和所述当前待重建图像块的编码方式；根据编码信息生成当前待重建图像块的重建信号，并根据重建信号重建当前待重建图像块，得到当前重建图像块；若当前待重建图像块的编码方式为下采样编码方式，则从码流获取第一滤波器的标识信息，并通过标识信息标识的第一滤波器对当前重建图像块进行上采样处理。Parsing the code stream to obtain the coding information of the current image block to be reconstructed and the coding mode of the current image block to be reconstructed; generating a reconstruction signal of the current image block to be reconstructed according to the coded information, and reconstructing the current image block to be reconstructed according to the reconstruction signal, Obtaining a current reconstructed image block; if the encoding mode of the current image block to be reconstructed is a down sampling encoding mode, obtaining identification information of the first filter from the code stream, and performing, by using the first filter identified by the identification information, the current reconstructed image block Upsampling processing.

第十二方面，本申请提供一种计算机存储介质，用于储存为上述第四方面或者第九方面涉及的图像处理设备所用的计算机软件指令，其包含用于执行上述第四方面或者第九方面所设计的程序。According to a twelfth aspect, the present application provides a computer storage medium for storing computer software instructions for use in the image processing apparatus of the fourth aspect or the ninth aspect, comprising the fourth aspect or the ninth aspect The program designed.

第十三方面，本申请提供一种计算机程序产品，其包含指令，当所述计算机程序被计算机所执行时，该指令使得计算机执行第四方面或者第九方面中图像处理设备所执行的功能。In a thirteenth aspect, the present application provides a computer program product comprising instructions which, when executed by a computer, cause the computer to perform the functions performed by the image processing apparatus of the fourth aspect or the ninth aspect.

第十四方面，本申请提供一种计算机存储介质，用于储存为上述第五方面或者第十方面涉及的图像处理设备所用的计算机软件指令，其包含用于执行上述第五方面或者第十方面所设计的程序。In a fourteenth aspect, the present application provides a computer storage medium for storing computer software instructions for use in the image processing apparatus of the fifth aspect or the tenth aspect, comprising the fifth aspect or the tenth aspect The program designed.

第十五方面，本申请提供一种计算机程序产品，其包含指令，当所述计算机程序被计算机所执行时，该指令使得计算机执行第五方面或者第十方面中图像处理设备所执行的功能。In a fifteenth aspect, the present application provides a computer program product comprising instructions which, when executed by a computer, cause the computer to perform the functions performed by the image processing apparatus of the fifth aspect or the tenth aspect.

第十六方面，本申请提供一种计算机存储介质，用于储存为上述第六方面或者第十一方面涉及的图像处理设备所用的计算机软件指令，其包含用于执行上述第五方面或者第十方面所设计的程序。In a sixteenth aspect, the present application provides a computer storage medium for storing computer software instructions for use in the image processing apparatus of the sixth aspect or the eleventh aspect, which is for performing the fifth aspect or the tenth Aspect of the program designed.

第十七方面，本申请提供一种计算机程序产品，其包含指令，当所述计算机程序被计算机所执行时，该指令使得计算机执行第六方面或者第十一方面中图像处理设备所执行的功能。In a seventeenth aspect, the present application provides a computer program product comprising instructions for causing a computer to perform a function performed by an image processing apparatus of the sixth aspect or the eleventh aspect when the computer program is executed by a computer .

本申请提供一种图像处理方法、设备及***，相对于现有技术中对整幅图像中的重建图像块都采用相同的滤波器，本申请针对每个重建图像块都要选择对应的滤波器，即本申请采用具有针对性的选择方式来选择滤波器，通过选择的滤波器对重建图像块进行上采样处理，从而可以得到显示效果更佳的重建图像块。The present application provides an image processing method, device, and system. The same filter is used for the reconstructed image block in the entire image in the prior art. The present application selects a corresponding filter for each reconstructed image block. That is, the present application adopts a targeted selection method to select a filter, and the reconstructed image block is upsampled by the selected filter, so that a reconstructed image block with better display effect can be obtained.

附图说明DRAWINGS

图1为本申请提供的数字视频的示意图；1 is a schematic diagram of a digital video provided by the present application;

图2为本申请提供的数字图像的示意图；2 is a schematic diagram of a digital image provided by the present application;

图3为本申请提供的编码端的编码示意图；FIG. 3 is a schematic diagram of coding of an encoding end provided by the present application; FIG.

图4为本申请提供的解码端的解码示意图；4 is a schematic diagram of decoding of a decoding end provided by the present application;

图5为本申请提供的编码端的编码示意图；FIG. 5 is a schematic diagram of coding of an encoding end provided by the present application; FIG.

图6为本申请一实施例提供的正在编码的图像的示意图；FIG. 6 is a schematic diagram of an image being encoded according to an embodiment of the present application; FIG.

图7为本申请一实施例提供的参考像素模板的示意图；FIG. 7 is a schematic diagram of a reference pixel template according to an embodiment of the present application;

图8A和图8B为本申请一实施例提供的Planar模式的示意图；8A and 8B are schematic diagrams of a Planar mode according to an embodiment of the present application;

图9为本申请一实施例提供的33种角度预测模式的具体方向示意图；FIG. 9 is a schematic diagram of specific directions of 33 kinds of angle prediction modes according to an embodiment of the present application;

图10为本申请一实施例提供的图像下采样示意图；FIG. 10 is a schematic diagram of image down sampling according to an embodiment of the present application;

图11为本申请一实施例提供的图像上采样示意图；FIG. 11 is a schematic diagram of image up sampling according to an embodiment of the present application;

图12为本申请一实施例提供的图像上采样示意图；FIG. 12 is a schematic diagram of image up sampling according to an embodiment of the present application;

图13为本申请一实施例提供的上采样图像示意图；FIG. 13 is a schematic diagram of an upsampled image according to an embodiment of the present application;

图14为本申请一实施例提供的一种图像处理方法的流程图；FIG. 14 is a flowchart of an image processing method according to an embodiment of the present application;

图15为本申请一实施例提供的4邻域像素的示意图；FIG. 15 is a schematic diagram of a 4-neighbor pixel provided by an embodiment of the present application;

图16为本申请一实施例提供的8邻域像素的示意图；16 is a schematic diagram of an 8-neighbor pixel provided by an embodiment of the present application;

图17为本申请一实施例提供的图像上采样示意图；FIG. 17 is a schematic diagram of image upsampling according to an embodiment of the present disclosure;

图18为本申请另一实施例提供的图像上采样示意图；FIG. 18 is a schematic diagram of image upsampling according to another embodiment of the present application; FIG.

图19为本申请一实施例提供的图像上采样示意图；FIG. 19 is a schematic diagram of image upsampling according to an embodiment of the present disclosure;

图20为本申请另一实施例提供的图像上采样示意图；FIG. 20 is a schematic diagram of image upsampling according to another embodiment of the present application; FIG.

图21为本申请一实施例提供的当前重建图像块和相邻重建图像块的示意图；FIG. 21 is a schematic diagram of a current reconstructed image block and an adjacent reconstructed image block according to an embodiment of the present disclosure;

图22为本申请一实施例提供的当前重建图像块的示意图；FIG. 22 is a schematic diagram of a current reconstructed image block according to an embodiment of the present disclosure;

图23为本申请一实施例提供的右边界和右边界的邻接边界的示意图；23 is a schematic diagram of adjacent boundaries of a right boundary and a right boundary according to an embodiment of the present disclosure;

图24为本申请另一实施例提供的一种图像处理方法的流程图；FIG. 24 is a flowchart of an image processing method according to another embodiment of the present application;

图25为本申请再一实施例提供的一种图像处理方法的流程图；FIG. 25 is a flowchart of an image processing method according to still another embodiment of the present application;

图26为本申请一实施例提供的一种图像处理设备的结构示意图；FIG. 26 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present disclosure;

图27为本申请另一实施例提供的一种图像处理设备的结构示意图；FIG. 27 is a schematic structural diagram of an image processing apparatus according to another embodiment of the present disclosure;

图28为本申请再一实施例提供的一种图像处理设备的结构示意图；FIG. 28 is a schematic structural diagram of an image processing apparatus according to still another embodiment of the present application;

图29为本申请提供的一种图像处理***的结构示意图；29 is a schematic structural diagram of an image processing system provided by the present application;

图30为本申请提供的一种图像处理***的结构示意图。FIG. 30 is a schematic structural diagram of an image processing system provided by the present application.

具体实施方式Detailed ways

以下，对本申请中的部分专业用语进行解释说明，以便于本领域技术人员理解。Hereinafter, some of the professional terms in the present application will be explained to facilitate understanding by those skilled in the art.

数字视频是以数字形式记录的视频。数字视频由多帧数字图像组成。通常原始视频包括的数据量较大，不适合存储和传输，需要利用高效的视频压缩编码技术来压缩原始数据。Digital video is a video recorded in digital form. Digital video consists of multi-frame digital images. Often the original video contains a large amount of data, which is not suitable for storage and transmission, and requires efficient video compression coding techniques to compress the original data.

视频压缩技术是通过消除视频冗余来达到压缩的目的。视频冗余主要包括如下几项：空间冗余，时间冗余，视觉冗余和信息熵冗余。Video compression technology achieves compression by eliminating video redundancy. Video redundancy mainly includes the following items: spatial redundancy, temporal redundancy, visual redundancy, and information entropy redundancy.

空间冗余：它是静态图像存在的最主要的数据冗余。它是指在一幅图像中，相邻的像素的幅值都比较相近，这种空间连贯性被称为空间相关或空间冗余。空间冗余主要是通过帧内预测方法来消除，帧内预测方法是指利用视频空间域的相关性，使用参考重建图像块的像素预测当前重建图像块的像素，以达到去除视频空间冗余的目的。Spatial redundancy: It is the most important data redundancy for static images. It means that the amplitudes of adjacent pixels are similar in an image. This spatial coherence is called spatial correlation or spatial redundancy. Spatial redundancy is mainly eliminated by the intra prediction method. The intra prediction method refers to using the correlation of the video spatial domain to predict the pixels of the currently reconstructed image block by using the pixels of the reference reconstructed image block to achieve the removal of video spatial redundancy. purpose.

时间冗余：它是视频序列中经常包含的冗余，由于视频的相邻图像往往包含相同或类似的背景和运动物体，只是运动物体所在的空间位置略有不同，这种相邻图像间的数据的高度相关性就称为时间冗余。时间冗余主要是通过帧间预测技术来消除，帧间预测技术是指利用时间上相邻图像的像素来预测当前像素。Temporal redundancy: It is the redundancy that is often included in video sequences. Since adjacent images of video often contain the same or similar background and moving objects, only the spatial position of the moving object is slightly different. The high correlation of data is called time redundancy. Temporal redundancy is mainly eliminated by inter-frame prediction techniques, which refer to the use of pixels of temporally adjacent images to predict the current pixel.

视觉冗余：人眼视觉***对图像细节的变化不敏感，这些细微变化信息即使丢失，人眼也感受不到。而在记录原始视频数据时，通常假定视觉***是对各种内容的敏感度是一致的，这样就产生了比理想编码更多的数据，称为视觉冗余。视觉冗余主要是通过变换，量化技术来消除，该变换技术是指将图像信号变换到频率域进行处理，根据不同频率信号对视觉质量的贡献大小进行数据表达和比特再分配，这样可以纠正空间域上均匀采样的不合理表达。同时在比特再分配过程中融合考虑去除视觉冗余的需要，通过量化操作，省略过分精细的高频分量表达，实现有效压缩。Visual redundancy: The human visual system is insensitive to changes in image detail, and even if these subtle changes are lost, the human eye does not feel it. When recording raw video data, it is generally assumed that the visual system is consistent in sensitivity to various content, which results in more data than ideal coding, called visual redundancy. The visual redundancy is mainly eliminated by transforming and transforming technology, which refers to transforming the image signal into the frequency domain for processing, and performing data expression and bit redistribution according to the contribution of the different frequency signals to the visual quality, so that the space can be corrected. Unreasonable expression of uniform sampling over a domain. At the same time, in the process of bit redistribution, the need to remove visual redundancy is taken into consideration, and the quantization operation is omitted, and the excessively high-frequency component expression is omitted to achieve effective compression.

信息熵冗余：由信息论可知，为表示图像数据的一个像素，只要按其信息熵的大小分配相应比特数即可，而对于图像数据的每个像素，在图像获取时很难得到它的信息熵，因此一般是对每个像素采用相同的比特数来表示，这样必然存在冗余。信息熵冗余主要是通过熵编码技术来消除熵编码技术是通过统计系数的信息熵分布，为具有不同信息熵的数据分配不同的比特数。Information entropy redundancy: It can be known from information theory that as a pixel representing image data, it is only necessary to allocate the corresponding number of bits according to the size of its information entropy, and for each pixel of image data, it is difficult to obtain its information at the time of image acquisition. Entropy, therefore, is generally expressed by the same number of bits per pixel, so there must be redundancy. Information entropy redundancy is mainly solved by entropy coding technology. Entropy coding technology distributes different bit numbers for data with different information entropy through the information entropy distribution of statistical coefficients.

当前主流的视频压缩编码架构是混合编码架构，针对上述冗余，采取不同的技术来消除冗余，并将这些技术结合在一起，形成了视频编码的混合架构。如图3所示，编码端接收到视频之后，对于构成视频的每帧图像，将该图像划分成待编码图像块。对于当前待编码图像块，首先通过参考重建图像块对当前待编码图像块进行预测，得到当前待编码图像块的预测信号；用当前待编码图像块的原始信号减去预测信号，得到残差信号。经过预测后，残差信号的幅值远小于原始信号。将残差信号进行变换和量化操作。经过变换量化后，得到变换量化系数，再通过熵编码技术编码量化系数以及编码中的其他指示信息，得到码流。进一步地，编码端还需要重建当前待编码图像块，以实现对后续待编码图像块的编码提供参考像素。具体地，在得到当前待编码图像块的变换量化系数之后，编码端需要对当前待编码图像块的变换量化系数进行反量化和反变换，得到重建的残差信号，将重建的残差信号与当前待编码图像块对应的预测信号相加，得到当前待编码图像块的重建信号，根据该重建信号得到重建图像块。The current mainstream video compression coding architecture is a hybrid coding architecture. For the above redundancy, different technologies are adopted to eliminate redundancy, and these technologies are combined to form a hybrid architecture of video coding. As shown in FIG. 3, after receiving the video, the encoding side divides the image into image blocks to be encoded for each frame of the image constituting the video. For the current image block to be encoded, the current image block to be encoded is first predicted by referring to the reconstructed image block to obtain a prediction signal of the current image block to be encoded; and the residual signal is obtained by subtracting the prediction signal from the original signal of the current image block to be encoded. . After prediction, the magnitude of the residual signal is much smaller than the original signal. The residual signal is transformed and quantized. After transform quantization, the transform quantized coefficients are obtained, and the quantized coefficients and other indication information in the encoding are encoded by the entropy coding technique to obtain a code stream. Further, the encoding end further needs to reconstruct the current image block to be encoded, so as to provide reference pixels for encoding the subsequent image block to be encoded. Specifically, after obtaining the transform quantized coefficients of the current image block to be encoded, the encoding end needs to perform inverse quantization and inverse transform on the transform quantized coefficients of the current image block to be encoded to obtain a reconstructed residual signal, and the reconstructed residual signal is The prediction signals corresponding to the current image block to be encoded are added to obtain a reconstructed signal of the current image block to be encoded, and the reconstructed image block is obtained according to the reconstructed signal.

如图4所示，解码端获取到码流之后，首先对码流进行熵解码，得到当前待重建图像块的变换量化系数，然后对变换量化系数进行反量化和反变换，得到当前待重建图像块的重建的残差信号。通过参考重建图像块对当前待重建图像块进行预测，得到当前待重建图像块的预测信号，然后将预测信号和上述重建的残差信号相加，得到当前待重建图像块的重建信号，然后根据该重建信号得到当前待重建图像块对应的当前重建图像块。As shown in FIG. 4, after acquiring the code stream, the decoding end first performs entropy decoding on the code stream to obtain a transformed quantized coefficient of the current image block to be reconstructed, and then inverse quantizes and inverse transforms the transformed quantized coefficient to obtain an image to be reconstructed. The residual signal of the reconstruction of the block. Predicting the current image block to be reconstructed by referring to the reconstructed image block, obtaining a prediction signal of the current image block to be reconstructed, and then adding the prediction signal and the reconstructed residual signal to obtain a reconstruction signal of the current image block to be reconstructed, and then according to The reconstructed signal obtains a current reconstructed image block corresponding to the current image block to be reconstructed.

为了降低编解码复杂度，编码端对每帧图像先进行下采样处理，如图5所示，编码端对整幅图像采用下采样处理，然后对经过下采样处理后的图像中的每个待编码图像块进行编码，得到码流。其中，每个待编码图像块对应的重建图像块的分辨率为下采样分辨率。相应的，解码端解析码流，每个待重建图像块的分辨率均为下采样分辨率，得到对应的重建图像块的分辨率也为下采样分辨率，解码端需要对重建图像块采用上采样处理，以得到原始分辨率的重建图像块。In order to reduce the complexity of codec, the encoding end first downsamples the image of each frame. As shown in FIG. 5, the encoding end uses downsampling processing on the entire image, and then each of the images subjected to the downsampling process. The coded image block is encoded to obtain a code stream. The resolution of the reconstructed image block corresponding to each image block to be encoded is a downsampling resolution. Correspondingly, the decoding end parses the code stream, and the resolution of each image block to be reconstructed is the downsampling resolution, and the resolution of the corresponding reconstructed image block is also the downsampling resolution, and the decoding end needs to adopt the reconstructed image block. Sampling processing to obtain a reconstructed image block of the original resolution.

其中，在编码端和解码端均涉及通过参考重建图像块对当前重建图像块(当前待编码图像块或者当前待重建图像块)进行预测，得到当前重建图像块的预测信号。在本申请中，对当前重建图像块的预测模式(主要是帧内预测方法)可以采用现有技术，具体如下：The encoding end and the decoding end both involve predicting the current reconstructed image block (the current image block to be encoded or the current image block to be reconstructed) by referring to the reconstructed image block, and obtaining a prediction signal of the current reconstructed image block. In the present application, the prediction mode (mainly the intra prediction method) of the currently reconstructed image block may adopt the prior art, as follows:

例如：图6为本申请一实施例提供的正在编码的图像的示意图，如图6所示，该图像包括多个图像块，其中，该图像的编码顺序是：从上到下，从左到右。在图6中，图像块C、B、D、E和A表示已经完成重建的重建图像块，图像块F为当前待编码图像块，该图像中的其他区域为未编码的图像区域。For example, FIG. 6 is a schematic diagram of an image being encoded according to an embodiment of the present application. As shown in FIG. 6 , the image includes a plurality of image blocks, where the encoding order of the image is: from top to bottom, from left to right. right. In FIG. 6, image blocks C, B, D, E, and A represent reconstructed image blocks that have been reconstructed, and image block F is the current image block to be encoded, and other regions in the image are uncoded image regions.

这里以H.265标准来说明帧内预测方法的具体过程，H.265支持将当前待编码图像块划分成更小的子图像块进行预测操作。子图像块的划分结构为四叉树结构，即一个图像块可以划分成四个子图像块，每个子图像块可以继续划分成四个子图像块。如图6所示，假设当前待编码图像块被划分成7个子图像块进行预测操作，当前待编码图像块也可以划分成更多的子图像块进行预测操作。对于每个子图像块，先进行预测操作，获得预测信号，然后根据预测信号获得子图像块的残差信号，进一步对残差信号进行变换、量化和熵编码。对于预测操作，每个子图像块可选的帧内预测方法有35种，包括Planar模式、DC模式以及33种角度预测模式。所有预测模式都使用相同的参考像素模板(由多个参考像素构成)，图7为本申请一实施例提供的参考像素模板的示意图，如图7所示，P _1，1，P _2，1……P _N，1……P _1，N，P _2，N……P _N，N这些像素构成待编码的子图像块，例如：该待编码的子图像块可以是图6中的子图像块1。如图7所示，除了待编码的子图像块，其他参考像素R _0，0，R _1，0……R _2N+1，0……R _0，2N构成参考像素模板，假设该待编码的子图像块是图6中的子图像块1，这种情况下，这些参考像素中的一部分像素为参考重建图像块B的最后一行的像素，另一部分像素为参考重建图像块A的最右侧一列的像素。对于其他标准，这些参考像素中的一部分像素为参考重建图像块B包括的下方多行的像素，另一部分像素为参考重建图像块A包括的右侧多列的像素。即本申请对参考像素模板不做限制。 Here, the specific process of the intra prediction method is described by the H.265 standard, and H.265 supports dividing the current image block to be encoded into smaller sub-image blocks for prediction operations. The partition structure of the sub-image block is a quadtree structure, that is, one image block can be divided into four sub-image blocks, and each sub-image block can be further divided into four sub-image blocks. As shown in FIG. 6, it is assumed that the current image block to be encoded is divided into 7 sub-image blocks for prediction operation, and the current image block to be encoded can also be divided into more sub-image blocks for prediction operations. For each sub-image block, a prediction operation is first performed to obtain a prediction signal, and then a residual signal of the sub-image block is obtained according to the prediction signal, and the residual signal is further transformed, quantized, and entropy encoded. For prediction operations, there are 35 optional intra prediction methods for each sub-picture block, including Planar mode, DC mode, and 33 angle prediction modes. All of the prediction modes use the same reference pixel template (consisting of a plurality of reference pixels). FIG. 7 is a schematic diagram of a reference pixel template according to an embodiment of the present application. As shown in FIG. 7, P _1,1 , P _2,1 ... P _N,1 ......P _1,N ,P _2,N ......P _N,N These pixels constitute a sub-image block to be encoded, for example, the sub-image block to be encoded may be the sub-image in FIG. Block 1. As shown in FIG. 7, in addition to the sub-image block to be encoded, other reference pixels R _0,0 , R _1,0 ... R _2N+1,0 ... R _0,2N constitute a reference pixel template, assuming that the image is to be encoded. The sub-image block is the sub-image block 1 in FIG. 6, in which case some of the reference pixels are the pixels of the last row of the reference reconstructed image block B, and the other portion of the pixels are the rightmost side of the reference reconstructed image block A A column of pixels. For other standards, some of the reference pixels are pixels of the lower plurality of rows included in the reference reconstructed image block B, and the other partial pixels are pixels of the right plurality of columns included in the reference reconstructed image block A. That is, the present application does not limit the reference pixel template.

Planar模式Planar mode

Planar模式适用于像素值缓慢变化的区域，图8A和图8B为本申请一实施例提供的Planar模式的示意图，如图8所示，使用水平和竖直方向的两个线性滤波器，分别得到两个预测值

和

并将

和

的平均值作为像素(x,y)的预测信号。 The Planar mode is applicable to the area where the pixel value changes slowly. FIG. 8A and FIG. 8B are schematic diagrams of the Planar mode provided by an embodiment of the present application. As shown in FIG. 8, two linear filters in the horizontal and vertical directions are used, respectively. Two predicted values

with

And

with

The average value is used as a prediction signal for the pixel (x, y).

DC模式DC mode

DC模式适用于大面积平坦区域，当前待编码的子图像块的预测信号可由其左侧和上方的参考像素的平均值得到，如图7所示，待编码的子图像块中各个像素的预测信号可以通过R _0,1,…,R _0,N,R _1,0,…,R _N,0的平均值得到。 The DC mode is applicable to a large area flat area, and the prediction signal of the current sub-image block to be encoded can be obtained from the average value of the reference pixels on the left and the top thereof, as shown in FIG. 7, the prediction of each pixel in the sub-image block to be encoded. The signal can be obtained by averaging R _0,1 ,..., R _0,N , R _1,0 ,..., R _N,0 .

角度模式Angle mode

H.265/HEVC规定了33种角度预测模式，以更好地适应视频内容中不同方向的纹理。图9为本申请一实施例提供的33种角度预测模式的具体方向示意图，如图9所示，33种角度预测模式分为水平类模式(2～17)和竖直类模式(18～34)。其中V0(模式26)和H0(模式10)分别表示竖直和水平方向，其余角度预测模式的预测方向都可以看作是在竖直或水平方向上做一个角度偏移。这里以竖直方向V0(26)为例说明角度预测过程，竖直方向预测是使用当前待编码的子图像块上方相邻的一行参考像素来预测当前待编码的子图像块，当前待编码的子图像块内每个像素的预测信号等于该像素所在列对应的参考像素的像素值，即P _x,y＝R _y,0。对于其他角度预测模式，会与水平或竖直方向有一个角度偏移，根据这个角度偏移可以计算参考像素的位置。该参考像素的位置可能是两个相邻参考像素之间的位置，若是这种情况，则需要在两个参考像素之间根据计算出来的位置插值得到一个参考像素。通过得到的参考像素生成预测信号。 H.265/HEVC specifies 33 angle prediction modes to better accommodate textures in different directions in the video content. FIG. 9 is a schematic diagram of specific directions of 33 kinds of angle prediction modes according to an embodiment of the present invention. As shown in FIG. 9 , the 33 angle prediction modes are classified into a horizontal type mode (2 to 17) and a vertical type mode (18 to 34). ). Where V0 (mode 26) and H0 (mode 10) represent the vertical and horizontal directions, respectively, and the prediction directions of the remaining angle prediction modes can be regarded as an angular offset in the vertical or horizontal direction. Here, the angle prediction process is illustrated by taking the vertical direction V0 (26) as an example. The vertical direction prediction is to predict the current sub-image block to be encoded using a row of reference pixels adjacent to the sub-image block to be currently encoded, which is currently to be encoded. The prediction signal of each pixel in the sub-image block is equal to the pixel value of the reference pixel corresponding to the column in which the pixel is located, that is, P _{x, y} = R _{y, 0} . For other angle prediction modes, there is an angular offset from the horizontal or vertical direction, from which the position of the reference pixel can be calculated. The position of the reference pixel may be the position between two adjacent reference pixels. If this is the case, a reference pixel needs to be interpolated between the two reference pixels according to the calculated position. A prediction signal is generated from the obtained reference pixels.

需要说明的是，上述帧内预测方法同样适用于解码端，本申请在此不再赘述。It should be noted that the foregoing intra prediction method is also applicable to the decoding end, and details are not described herein again.

本申请还涉及到图像下采样处理和图像上采样处理。The application also relates to image downsampling processing and image upsampling processing.

其中，图像下采样处理涉及三个方面的信息：1、下采样比例；2、下采样位置；3、下采样所使用的滤波器。Among them, the image downsampling process involves three aspects of information: 1. Downsampling ratio; 2. Downsampling position; 3. Filter used for downsampling.

下采样比例是指原图像与下采样后的图像的比例，可以分别在水平方向和竖直方向来描述。例如可以对图像信号进行水平方向2:1下采样，竖直方向4:1下采样；或者水平方向不下采样，竖直方向2:1下采样；或者水平和竖直方向都进行2:1下采样等。The downsampling ratio refers to the ratio of the original image to the downsampled image, which can be described in the horizontal direction and the vertical direction, respectively. For example, the image signal can be downsampled in the horizontal direction by 2:1, the vertical direction is downsampled by 4:1; or the horizontal direction is not downsampled, the vertical direction is downsampled by 2:1; or both horizontal and vertical directions are performed under 2:1. Sampling, etc.

下采样位置是指下采样点与原采样点的位置关系，例如，下采样点的位置可以与部分原采样点位置一样，或者下采样点落在几个原采样点之间。The down sampling position refers to the positional relationship between the down sampling point and the original sampling point. For example, the position of the down sampling point may be the same as the position of some of the original sampling points, or the down sampling point falls between several original sampling points.

下采样滤波器可以是3-lobe Lanczos滤波器，Bilinear滤波器，Bicubic，Gauss滤波器等。The downsampling filter may be a 3-lobe Lanczos filter, a Bilinear filter, a Bicubic, a Gauss filter, or the like.

下面以分辨率为16*16的图像块(实际的图像会比这大很多，例如1920*1080)为例来说明下采样过程。图10为本申请一实施例提供的图像下采样示意图，假设水平方向和竖直方向的采样比例均为2:1，水平方向上，下采样点的位置落在两个原采样点的左侧原采样点位置，竖直方向上，下采样点落在两个原采样点的上方原采样点位置。如图10所示，框出来的圆圈表示下采样点的位置，下采样的滤波器如下：The following is an example of an image block with a resolution of 16*16 (the actual image will be much larger than this, for example, 1920*1080) to illustrate the downsampling process. FIG. 10 is a schematic diagram of image down sampling according to an embodiment of the present invention. It is assumed that the sampling ratios in the horizontal direction and the vertical direction are both 2:1. In the horizontal direction, the position of the down sampling point falls to the left of the two original sampling points. The original sampling point position, in the vertical direction, the down sampling point falls on the original sampling point position above the two original sampling points. As shown in Figure 10, the circled circle indicates the position of the downsampling point. The downsampling filter is as follows:

该滤波器是简单的低通滤波器，该低通滤波器可以被看作是一个二维滤波器，也可以被看作是两个一维滤波器。如果当作一个二维滤波器，可以在一次滤波操作中同时完成水平和竖直方向上的下采样。如图10所示，对下采样点A进行下采样时，用到了邻近的8个原采样点(用三角形框起的圆圈)，根据上面滤波器计算出该下采样点A的像素值。如果当作是两个一维滤波器，需要先完成水平或者竖直方向的下采样，再对已完成水平或者竖直方向下采样的结果进行竖直或水平方向下采样。如图10所示，对下采样点A进行下采样时，先利用下采样点A左右各一个原采样点进行水平下采样，然后对下采样后的结果利用下采样点A上下各一个原采样点进行竖直方向上的下采样，根据上述滤波器计算出下采样点A的像素值。采用相同的方法，对整个16*16的图像块进行下采样处理，最终下采样的结果如图10所示，各个下采样点的位置如框出来的圆圈所示，下采样点的像素值为通过滤波器操作后的数值。如图10所示，下采样后的图像块的分辨率为8*8。The filter is a simple low-pass filter that can be thought of as a two-dimensional filter or as two one-dimensional filters. If used as a two-dimensional filter, downsampling in both horizontal and vertical directions can be done simultaneously in one filtering operation. As shown in FIG. 10, when downsampling point A is downsampled, eight adjacent original sampling points (circles circled by a triangle) are used, and the pixel value of the down sampling point A is calculated according to the above filter. If it is treated as two one-dimensional filters, it is necessary to first perform down-sampling in the horizontal or vertical direction, and then down-sample the results of the horizontal or vertical down-sampling in the completed horizontal or vertical direction. As shown in FIG. 10, when downsampling point A is down-sampled, firstly, one original sampling point is used to perform horizontal down sampling, and then the down-sampling point A is used to sample one original sample. The point is downsampled in the vertical direction, and the pixel value of the down sample point A is calculated according to the above filter. Using the same method, the entire 16*16 image block is downsampled. The final downsampling result is shown in Figure 10. The position of each downsampled point is shown by the circle in the box, and the pixel value of the downsampled point is The value after passing the filter operation. As shown in FIG. 10, the resolution of the downsampled image block is 8*8.

通常编码端或者解码端需要对经过下采样后的图像进行上采样处理，目的是为了得到原分辨率的图像。上采样处理涉及三个方面的信息：1、上采样比例；2、上采样位置；3上采样所使用的滤波器。Usually, the encoding end or the decoding end needs to perform upsampling on the downsampled image in order to obtain the original resolution image. The upsampling process involves three aspects of information: 1. Upsampling ratio; 2. Upsampling position; 3 Filter used for upsampling.

上采样比例是指上采样前的图像与上采样后的图像的比例，可以分别在水平方向和竖直方向来描述。例如可以对上采样才的图像信号进行水平方向1:2上采样，竖直方向1:4上采样；或者水平方向不上采样，竖直方向1:2上采样；或者水平和竖直方向都进行1:2上采样等。The upsampling ratio refers to the ratio of the image before the upsampling to the image after the upsampling, which can be described in the horizontal direction and the vertical direction, respectively. For example, the upsampled image signal can be upsampled in the horizontal direction by 1:2, the vertical direction is 1:4 upsampled; or the horizontal direction is not upsampled, the vertical direction is 1:2 upsampled; or both horizontal and vertical directions are Perform 1:2 upsampling, etc.

上采样位置是指上采样后的采样点与上采样前的采样点的位置关系，例如，图11为本申请一实施例提供的图像上采样示意图，如图11所示，在第一行，采用水平1:2上采样比例，上采样后的采样点的位置可以在上采样前的采样点的右侧，其中×表示上采样后的采样点位置，圆圈表示上采样前的采样点位置。在第二行，采用水平1:2上采样比例，上采样后的采样点的位置可以在上采样前的采样点的左侧，其中×表示上采样后的采样点位置，圆圈表示上采样前的采样点位置。需要说明的是，上采样后的采样点的位置应与上述下采样点的位置选取相对应，例如：在进行下采样时，选择下采样点的位置为它的左侧原采样点的位置，那么在进行上采样时，选择上采样后的采样点的位置为它的右侧上采样前的采样点(下采样点)的位置。The upsampling position is a positional relationship between the sampled point after the upsampling and the sampled point before the upsampling. For example, FIG. 11 is a schematic diagram of image upsampling provided in an embodiment of the present application, as shown in FIG. The horizontal 1:2 upsampling ratio is used, and the position of the upsampled sample point can be on the right side of the sample point before the upsampling, where × represents the position of the sampled point after upsampling, and the circle represents the position of the sampled point before the upsampling. In the second line, the horizontal 1:2 upsampling ratio is used, and the position of the upsampled sample point can be to the left of the sample point before the upsampling, where × represents the position of the sampled point after upsampling, and the circle represents the position before the upsampling. The sampling point location. It should be noted that the position of the sampled point after the upsampling should correspond to the position selection of the above-mentioned down sampling point. For example, when performing downsampling, the position of the down sampling point is selected as the position of the original sampling point on the left side thereof. Then, when performing upsampling, the position of the sampled point after upsampling is selected as the position of the sampling point (downsampling point) before the upper right sampling.

上采样滤波器可以是DCTIF滤波器，双线性插值滤波器，sinc滤波器等。下面以分辨率为8*8的图像块(即上述下采样后的图像块)为例来说明上采样过程。假设水平方向和竖直方向的上采样比例均为1:2，在水平方向上，上采样后的采样点的位置为右侧上采样前的采样点的位置，在竖直方向上，上采样后的采样点的位置为下方上采样前的采样点的位置，这里以水平方向和竖直方向分别上采样为例，以及以DCTIF滤波器为例来说明上采样处理过程。DCTIF滤波器为(-1,4,-11,40,40,-11,4,-1)，假设当前要进行水平方向上采样，在图11中，假设需要***B3采样点，则采用如下公式确定B3的像素值：The upsampling filter may be a DCTIF filter, a bilinear interpolation filter, a sinc filter, or the like. The upsampling process will be described below by taking an image block with a resolution of 8*8 (i.e., the image block after downsampling described above) as an example. Assume that the upsampling ratios in the horizontal direction and the vertical direction are both 1:2. In the horizontal direction, the position of the sampled point after upsampling is the position of the sampling point before the right upsampling, and in the vertical direction, the upsampling The position of the subsequent sampling point is the position of the sampling point before the upper upsampling, where the horizontal and vertical directions are respectively sampled as an example, and the DCTIF filter is taken as an example to illustrate the upsampling process. The DCTIF filter is (-1, 4, -11, 40, 40, -11, 4, -1), assuming that the horizontal direction is currently being sampled. In Figure 11, assuming that the B3 sample point needs to be inserted, the following is used. The formula determines the pixel value of B3:

B ₃＝(-A ₀+4*A ₁-11*A ₂+40*A ₃+40*A ₄-11*A ₅+4*A ₆-A ₇)＞＞6 B ₃ =(-A ₀ +4*A ₁ -11*A ₂ +40*A ₃ +40*A ₄ -11*A ₅ +4*A ₆ -A ₇ )>>6

对于其他位置的插值采样点，例如B7，需要用到B7右边的四个像素，这些像素目前不可得，实际中一般会将A7重复4次，以用于计算B7的像素值。在竖直方向上的上采样与在水平方向上的上采样类似，在此不再赘述。也可以先进行竖直方向上的上采样，再进行水平方向上的上采样。图12为本申请一实施例提供的图像上采样示意图，如图12所示，×表示上采样后的采样点，圆圈表示上采样前的采样点。For interpolated sampling points at other locations, such as B7, four pixels to the right of B7 are needed. These pixels are currently unavailable. In practice, A7 is usually repeated 4 times to calculate the pixel value of B7. The upsampling in the vertical direction is similar to the upsampling in the horizontal direction, and will not be described again here. It is also possible to perform upsampling in the vertical direction and then upsampling in the horizontal direction. FIG. 12 is a schematic diagram of image upsampling according to an embodiment of the present invention. As shown in FIG. 12, x represents a sampled point after upsampling, and a circle represents a sample point before upsampling.

上采样滤波器还可以是6抽头的维纳Wiener滤波器，通过滤波器对图像进行上采样处理的过程如下：图13为本申请一实施例提供的上采样图像示意图，如图13所示，图中没有标号的方框表示整数像素，aa，bb，cc，dd，ee，ff，gg，hh和b，h，s，m，j均是1/2位置像素，其他都是1/4位置像素。计算过程是先用(1，-5，20，20，-5，1)的六抽头滤波器进行1/2位置像素的插值，然后再通过临近像素插值的方法计算1/4位置像素的插值，从而获得最终上采样图像。像素有三种类型：水平像素、竖直像素和对角线像素。具体如下：The upsampling filter may also be a 6-tap Wiener Wiener filter. The process of upsampling the image by the filter is as follows: FIG. 13 is a schematic diagram of an upsampled image according to an embodiment of the present application, as shown in FIG. The unlabeled boxes in the figure represent integer pixels, aa, bb, cc, dd, ee, ff, gg, hh and b, h, s, m, j are all 1/2 position pixels, others are 1/4 Position pixel. The calculation process is to first interpolate 1/2 position pixels with a six-tap filter of (1, -5, 20, 20, -5, 1), and then calculate the interpolation of 1/4 position pixels by the method of adjacent pixel interpolation. To obtain the final upsampled image. There are three types of pixels: horizontal pixels, vertical pixels, and diagonal pixels. details as follows:

水平1/2位置像素：如b＝(E-5F+20G+20H-5I+J)，b＝Clip1((b+16)>>5)；Clip1的作用是限制结果在0～255，右移5相当于除以32，加16是为了结果的四舍五入。 Horizontal 1/2 position pixel: such as b=(E-5F+20G+20H-5I+J), b=Clip1((b+16)>>5); the role of Clip1 is to limit the result from 0 to 255, right Shifting 5 is equivalent to dividing by 32, and adding 16 is for rounding off the result.

竖直1/2位置像素：如h＝(A-5C+20G+20M-5R+T)，h＝Clip1((h+16)>>5)；Vertical 1/2 position pixels: such as h = (A-5C + 20G + 20M-5R + T), h = Clip1 ((h + 16)>> 5);

对角1/2位置像素：如j＝(cc-5dd+20h+20m-5ee+ff)＝(aa-5bb+20b+20q-5gg+hh)，j＝Clip1((j+16)>>5)；Diagonal 1/2 position pixel: such as j=(cc-5dd+20h+20m-5ee+ff)=(aa-5bb+20b+20q-5gg+hh), j=Clip1((j+16)>> 5);

水平1/4位置像素：如a＝(G+b+1)>>1；i＝(h+j+1)>>1； Horizontal 1/4 position pixel: such as a=(G+b+1)>>1; i=(h+j+1)>>1;

竖直1/4位置像素：如d＝(G+h+1)>>1；f＝(b+j+1)>>1；Vertical 1/4 position pixel: such as d = (G + h + 1) >> 1; f = (b + j + 1) >> 1;

对角1/4位置像素：如e＝(h+b+1)>>1；g＝(b+m+1)>>1；p＝(h+s+1)>>1；r＝(s+m+1)>>1。Diagonal 1/4 position pixel: eg e=(h+b+1)>>1; g=(b+m+1)>>1; p=(h+s+1)>>1;r= (s+m+1)>>1.

为了解决上述技术问题，本申请提供一种图像处理方法、设备及***，本申请可以基于如图3和图5的编码示意图，如图3和图5所示，一幅图像包括的待编码图像块的编码方式可以是如图3所示的原分辨率编码方式或者是如图5所示的下采样编码方式。其中，原分辨率编码方式是指对当前待编码图像块直接进行编码操作。下采样编码方式是指对当前待编码图像块先进行下采样处理，然后对下采样后的当前待编码图像块进行编码操作。一般情况下，纹理图像块采用原分辨率编码方式，平滑图像块采用下采样编码方式。本申请的主旨思想在于：若当前重建图像块的编码方式为下采样编码方式，则为当前重建图像块选择滤波器，并通过该滤波器对当前重建图像块进行上采样处理，即针对不同的重建图像块，都要选择滤波器，以进行上采样处理。In order to solve the above technical problem, the present application provides an image processing method, device, and system. The present application can be based on the coding diagrams of FIG. 3 and FIG. 5, as shown in FIG. 3 and FIG. The encoding mode of the block may be the original resolution encoding method as shown in FIG. 3 or the down sampling encoding method as shown in FIG. 5. The original resolution encoding method refers to directly performing an encoding operation on the current image block to be encoded. The downsampling coding mode refers to performing downsampling processing on the current image block to be encoded, and then performing encoding operation on the currently sampled image block to be coded. In general, the texture image block adopts the original resolution coding mode, and the smooth image block adopts the down sampling coding mode. The main idea of the present application is to select a filter for the current reconstructed image block and to upsample the current reconstructed image block by using the filter, if the encoding mode of the currently reconstructed image block is the downsampling coding mode, that is, for different To reconstruct an image block, select a filter to perform upsampling.

具体地，图14为本申请一实施例提供的一种图像处理方法的流程图，如图14所示，该方法包括：Specifically, FIG. 14 is a flowchart of an image processing method according to an embodiment of the present disclosure. As shown in FIG. 14, the method includes:

步骤S1401：生成当前待编码图像块的重建信号，并根据重建信号重建当前待编码图像块，以得到当前重建图像块；Step S1401: Generate a reconstructed signal of the current image block to be encoded, and reconstruct a current image block to be encoded according to the reconstructed signal to obtain a current reconstructed image block.

步骤S1402：若当前重建图像块的编码方式为下采样编码方式，则从至少两个候选滤波器中选择用于对当前重建图像块进行上采样处理的第一滤波器，并通过第一滤波器对当前重建图像块进行上采样处理。Step S1402: If the coding mode of the current reconstructed image block is a downsampling coding mode, selecting a first filter for performing upsampling processing on the current reconstructed image block from the at least two candidate filters, and passing the first filter The current reconstructed image block is subjected to upsampling processing.

具体地，在步骤S1401中：编码端可以获取当前图像的当前待编码图像块的编码方式和每个参考重建图像块中的像素；根据当前待编码图像块的编码方式和M个参考重建图像块中的像素，确定当前待编码图像块的多个参考像素；根据多个参考像素生成当前待编码图像块的预测信号；获取当前待编码图像块的编码信号，其中，当当前待编码图像块的编码方式是原分辨率编码方式时，编码信号为当前待编码图像块的原始信号，当当前待编码图像块的编码方式是下采样编码方式时，编码信号为当前待编码图像块的原始信号经过下采样处理后得到的信号；根据预测信号和编码信号生成当前待编码图像块的残差信号；将残差信号进行变换和量化操作。经过变换量化后，得到变换量化系数，编码端对当前待编码图像块的变换量化系数进行反量化和反变换，得到重建残差信号，将重建残差信号与当前待编码图像块对应的预测信号相加，得到当前待编码图像块的重建信号，根据该重建信号得到当前重建图像。Specifically, in step S1401, the encoding end may acquire the encoding mode of the current image block to be encoded of the current image and the pixel in each reference reconstructed image block; according to the encoding mode of the current image block to be encoded and the M reference reconstructed image blocks. a pixel in the image, determining a plurality of reference pixels of the current image block to be encoded; generating a prediction signal of the current image block to be encoded according to the plurality of reference pixels; acquiring an encoded signal of the current image block to be encoded, wherein when the image block to be currently encoded is When the encoding mode is the original resolution encoding mode, the encoded signal is the original signal of the current image block to be encoded. When the encoding mode of the current image block to be encoded is the down sampling encoding mode, the encoded signal is the original signal of the current image block to be encoded. a signal obtained after the downsampling process; generating a residual signal of the current image block to be encoded according to the prediction signal and the encoded signal; and transforming and quantizing the residual signal. After transform quantization, the transform quantized coefficients are obtained, and the encoding end performs inverse quantization and inverse transform on the transform quantized coefficients of the current image block to be encoded, thereby obtaining a reconstructed residual signal, and reconstructing the residual signal with a prediction signal corresponding to the current image block to be encoded. Adding, obtaining a reconstructed signal of the current image block to be encoded, and obtaining a current reconstructed image according to the reconstructed signal.

其中，当前待重建图像块对应M个参考重建图像块，M为大于或者等于1的正整数。参考重建图像块用于确定待重建图像块的多个参考像素，其中，多个参考像素用于生成当前重建图像块的预测信号。实际上，参考重建图像块具体是哪个重建图像块和解码端采用的预测模式有关。当采用上述35中预测模式中的任一种时，可以参考如图7所示的参考像素模板。The current image block to be reconstructed corresponds to M reference reconstructed image blocks, and M is a positive integer greater than or equal to 1. The reference reconstructed image block is used to determine a plurality of reference pixels of the image block to be reconstructed, wherein the plurality of reference pixels are used to generate a prediction signal of the current reconstructed image block. In fact, the reference reconstructed image block is specifically related to which prediction image block and the prediction mode employed by the decoding end. When any of the above-described prediction modes in 35 is employed, reference may be made to the reference pixel template as shown in FIG.

实际上，参考重建图像块具体是哪个重建图像块和解码端采用的预测模式有关。当采用上述35中预测模式中的任一种时，可以参考如图7所示的参考像素模板。根据多个参考像素生成当前待重建图像块的预测信号，可以采用上述35中预测模式中的任一种预测模式，当然也可以采用现有技术中其他的预测模式，本申请对此不做限制。In fact, the reference reconstructed image block is specifically related to which prediction image block and the prediction mode employed by the decoding end. When any of the above-described prediction modes in 35 is employed, reference may be made to the reference pixel template as shown in FIG. The prediction signal of the current image block to be reconstructed is generated according to the plurality of reference pixels, and any one of the prediction modes in the above-mentioned 35 mode may be used. Of course, other prediction modes in the prior art may also be used, which is not limited in this application. .

若参考重建图像块与当前待重建图像块的分辨率相同，则直接在该参考重建图像块中确定至少一个参考像素；若当前待重建图像块是原分辨率，参考重建图像块的分辨率为下采样分辨率，则从该参考重建图像块中获取对当前重建图像块进行重建时所需的至少一个像素，并对当前重建图像块进行重建时所需的至少一个像素进行上采样处理，以得到当前待重建图像块的至少一个参考像素；若当前待重建图像块是下采样分辨率，参考重建图像块的分辨率为原分辨率，则从该参考重建图像块中获取对所述当前图像块进行重建时所需的至少一个像素，对这些像素进行下采样处理，以得到当前待重建图像块的至少一个参考像素。If the reference reconstructed image block has the same resolution as the current image block to be reconstructed, at least one reference pixel is directly determined in the reference reconstructed image block; if the current image block to be reconstructed is the original resolution, the resolution of the reference reconstructed image block is Subsampling the resolution, obtaining at least one pixel required for reconstructing the current reconstructed image block from the reference reconstructed image block, and performing upsampling processing on at least one pixel required for reconstructing the current reconstructed image block, Obtaining at least one reference pixel of the current image block to be reconstructed; if the current image block to be reconstructed is a downsampling resolution, and the resolution of the reference reconstructed image block is the original resolution, acquiring the current image from the reference reconstructed image block The block performs at least one pixel required for reconstruction, and performs downsampling processing on the pixels to obtain at least one reference pixel of the current image block to be reconstructed.

进一步地，编码端对当前重建图像块进行的上采样处理是基于当前重建图像块所需的相邻重建图像块的像素进行的。需要说明的是，所需的相邻重建图像块的像素主要用于对当前重建图像块的部分边界进行上采样处理，对于当前重建图像块中除上述部分边界之外的部分，均采用自己的像素进行上采样处理。假设第一滤波器是基于离散余弦变换的插值滤波器(Discrete Cosine Transform-Based Interpolation Filter，DCTIF)，这种情况下，当前重建图像块所需的相邻重建图像块具体如下：图15为本申请一实施例提供的4邻域像素的示意图，如图15所示，当前重建图像块所需的相邻重建图像块包括：当前重建图像块的上边图像块、下边图像块、左边图像块和右边图像块。假设第一滤波器是卷积神经网络(Convolutional Neural Network，CNN)滤波器。这种情况下，当前重建图像块所需的相邻重建图像块具体如下：图16为本申请一实施例提供的8邻域像素的示意图，如图16所示，当前重建图像块所需的相邻重建图像块包括：当前重建图像块的上边图像块、下边图像块、左边图像块、右边图像块、左上图像块、左下图像块、右上图像块和右下图像块。按照目前的编码顺序(从上至下，从左至右的编码顺序)，目前当前重建图像块的下边图像块、右边图像块、左下图像块和右下图像块都还没有完成重建，现有技术是通过复制当前重建图像块自己的像素以实现上采样处理，但是这种方式将导致经过上采样处理后的当前重建图像块存在右边界和下边界不连续的问题。为了解决这一问题，本申请提供如下四种可选方式：Further, the upsampling process performed by the encoding end on the currently reconstructed image block is performed based on pixels of the adjacent reconstructed image block required for the current reconstructed image block. It should be noted that the pixels of the adjacent reconstructed image blocks are mainly used for upsampling the partial boundaries of the currently reconstructed image block, and the portions of the current reconstructed image block except the above partial boundaries are used. The pixels are upsampled. It is assumed that the first filter is a Discrete Cosine Transform-Based Interpolation Filter (DCTIF). In this case, the adjacent reconstructed image block required for reconstructing the image block is as follows: A schematic diagram of a 4-neighbor pixel provided by an embodiment is provided. As shown in FIG. 15, an adjacent reconstructed image block required for a current reconstructed image block includes: an upper image block, a lower image block, and a left image block of the current reconstructed image block. The image block on the right. It is assumed that the first filter is a Convolutional Neural Network (CNN) filter. In this case, the adjacent reconstructed image block required for reconstructing the image block is as follows: FIG. 16 is a schematic diagram of an 8-neighbor pixel provided by an embodiment of the present application, as shown in FIG. The adjacent reconstructed image block includes: an upper image block, a lower image block, a left image block, a right image block, an upper left image block, a lower left image block, an upper right image block, and a lower right image block of the current reconstructed image block. According to the current coding order (from top to bottom, from left to right coding order), the lower image block, the right image block, the lower left image block, and the lower right image block of the current reconstructed image block have not yet been reconstructed. The technique is to achieve upsampling processing by copying the pixels of the current reconstructed image block itself, but this way will cause the current reconstructed image block after the upsampling process to have a problem that the right and lower boundaries are discontinuous. In order to solve this problem, the present application provides the following four options:

方式一、上采样处理是在当前重建图像块进行上采样处理时所需的所有相邻重建图像块都重建完成后进行的；相应的，码流包括：M个参考重建图像块中的每个参考重建图像块的编码方式；根据当前待重建图像块的编码方式和M个参考重建图像块中的像素，确定当前待重建图像块的多个参考像素，包括：根据当前待重建图像块的编码方式、M个参考重建图像块的编码方式和M个参考重建图像块中的像素，确定当前待重建图像块的多个参考像素。In the first method, the upsampling process is performed after all the reconstructed image blocks required for the upsampling process of the current reconstructed image block are reconstructed; correspondingly, the code stream includes: each of the M reference reconstructed image blocks. Referring to the coding mode of the reconstructed image block; determining, according to the current coding mode of the image block to be reconstructed and the pixels in the M reference reconstructed image blocks, the plurality of reference pixels of the current image block to be reconstructed, including: coding according to the current image block to be reconstructed The manner, the coding manner of the M reference reconstructed image blocks, and the pixels in the M reference reconstructed image blocks determine a plurality of reference pixels of the current image block to be reconstructed.

方式二、上采样处理是在当前图像的所有图像块都重建完成后进行的；相应的，码流包括：M个参考重建图像块中的每个参考重建图像块的编码方式；根据当前待重建图像块的编码方式和M个参考重建图像块中的像素，确定当前待重建图像块的多个参考像素，包括：根据当前待重建图像块的编码方式、M个参考重建图像块的编码方式和M个参考重建图像块中的像素，确定当前待重建图像块的多个参考像素。In the second method, the upsampling process is performed after all the image blocks of the current image are reconstructed. Correspondingly, the code stream includes: a coding mode of each reference reconstructed image block in the M reference reconstructed image blocks; The coding mode of the image block and the pixels in the M reference reconstructed image blocks determine a plurality of reference pixels of the current image block to be reconstructed, including: coding manner according to the current image block to be reconstructed, coding mode of the M reference reconstructed image blocks, and The M reference reconstructed pixels in the image block determine a plurality of reference pixels of the current image block to be reconstructed.

方式三、根据所需的相邻重建图像块中的当前已完成重建的一部分相邻重建图像块的像素，对当前重建图像块进行一次上采样处理；若所需的相邻重建图像块中的当前未完成重建的另一部分相邻重建图像块已完成重建，则根据另一部分相邻重建图像块对当前重建图像块的部分边界进行二次上采样处理，其中，当前重建图像块的部分边界与另一部分相邻重建图像块邻接。Manner 3: performing a upsampling process on the currently reconstructed image block according to a pixel of a part of the adjacent reconstructed image block that is currently reconstructed in the required adjacent reconstructed image block; if the required adjacent reconstructed image block is in the If another part of the adjacent reconstructed image block that has not been reconstructed has been reconstructed, the partial boundary of the currently reconstructed image block is subjected to a second upsampling process according to another part of the adjacent reconstructed image block, wherein a part of the boundary of the currently reconstructed image block is Another portion of the adjacent reconstructed image blocks are contiguous.

方式四、对当前重建图像块进行上采样处理包括：根据所需的相邻重建图像块中的当前当前重建图像块所处的已完成重建的一部分相邻重建图像块的像素，对当前重建图像块进行一次上采样处理；若当前图像的所有图像块均已完成重建，则根据所需的相邻重建图像块中的另一部分相邻重建图像块对当前重建图像块的部分边界进行二次上采样处理，其中，另一部分相邻重建图像块是在对当前重建图像块进行第一次上采样处理时未完成重建的图像块；当前重建图像块的部分边界与另一部分相邻重建图像块邻接。Manner 4: Performing upsampling processing on the current reconstructed image block includes: reconstructing the current reconstructed image according to a pixel of a part of the adjacent reconstructed image block of the completed reconstructed image block in the adjacent adjacent reconstructed image block The block performs an upsampling process; if all the image blocks of the current image have been reconstructed, the partial boundary of the currently reconstructed image block is quadraticized according to another partially adjacent reconstructed image block in the adjacent adjacent reconstructed image block. Sampling processing, wherein another portion of the adjacent reconstructed image block is an image block that is not reconstructed when the first upsampling process is performed on the current reconstructed image block; a partial boundary of the current reconstructed image block is adjacent to another partially adjacent reconstructed image block .

其中，所述当前重建图像块的部分边界满足条件：在对当前重建图像块进行的第一次上采样处理中，该部分边界所需的另一部分相邻重建图像块未完成重建。The partial boundary of the current reconstructed image block satisfies the condition that, in the first upsampling process performed on the current reconstructed image block, another part of the adjacent reconstructed image block required for the partial boundary is not reconstructed.

可选地，当前重建图像块的部分边界为当前重建图像块的右边界和下边界。Optionally, a partial boundary of the currently reconstructed image block is a right boundary and a lower boundary of the currently reconstructed image block.

可选地，所述一部分相邻重建图像块为所述当前重建图像块的上边图像块和左边图像块，所述另一部分相邻重建图像块为所述当前重建图像块的下边图像块和右边图像块。Optionally, the part of the adjacent reconstructed image block is an upper image block and a left image block of the current reconstructed image block, and the another partial adjacent reconstructed image block is a lower image block and a right side of the current reconstructed image block. Image block.

或者，or,

所述一部分相邻重建图像块为所述当前重建图像块的左上图像块，上边图像块，右上图像块和左边图像块，所述另一部分相邻重建图像块为所述当前重建图像块的右边图像块，左下图像块，下边图像块和右下图像块。The part of the adjacent reconstructed image block is an upper left image block, an upper image block, an upper right image block and a left image block of the current reconstructed image block, and the other partially adjacent reconstructed image block is a right side of the current reconstructed image block. Image block, lower left image block, lower image block, and lower right image block.

针对方式三和方式四，步骤S1402中通过第一滤波器对当前重建图像块进行上采样处理，特指对当前重建图像块进行的第一次上采样处理。For the third mode and the fourth mode, in step S1402, the current reconstructed image block is upsampled by the first filter, and specifically refers to the first upsampling process performed on the currently reconstructed image block.

针对方式一进行详细说明：Detailed description of the first method:

具体地，针对不同的滤波器，当前重建图像块所需的相邻重建图像块也不同。例如：如图15所示，当前重建图像块所需的相邻重建图像块包括：当前重建图像块的上边图像块、下边图像块、左边图像块和右边图像块。如图16所示，当前重建图像块所需的相邻重建图像块包括：当前重建图像块的上边图像块、下边图像块、左边图像块、右边图像块、左上图像块、左下图像块、右上图像块和右下图像块。In particular, the adjacent reconstructed image blocks required to reconstruct the image block are also different for different filters. For example, as shown in FIG. 15, the adjacent reconstructed image block required for the current reconstructed image block includes: an upper image block, a lower image block, a left image block, and a right image block of the current reconstructed image block. As shown in FIG. 16, the adjacent reconstructed image block required for the current reconstructed image block includes: an upper image block, a lower image block, a left image block, a right image block, an upper left image block, a lower left image block, and an upper right of the currently reconstructed image block. Image block and bottom right image block.

其中，可以采用现有技术的上采样处理方法对当前重建图像块进行处理。例如：图17为本申请一实施例提供的图像上采样示意图，如图17所示，当前重建图像块B所需的相邻重建图像块1、相邻重建图像块2、相邻重建图像块3和相邻重建图像块4均已完成重建。基于此，对当前重建图像块B进行上采样处理，如图17所示，其中B中的圆圈表示上采样前的采样点，×表示上采样后的采样点。对B进行上采样处理时，可以先对B进行水平方向上的上采样，再对上采样后的信号进行竖直方向上的上采样；或者，可以先对B进行竖直方向上的上采样，再对上采样后的信号进行水平方向上的上采样。The current reconstructed image block may be processed by using a prior art upsampling processing method. For example, FIG. 17 is a schematic diagram of image upsampling provided by an embodiment of the present invention. As shown in FIG. 17 , an adjacent reconstructed image block 1 , an adjacent reconstructed image block 2 , and an adjacent reconstructed image block required for reconstructing an image block B are as shown in FIG. 17 . 3 and the adjacent reconstructed image block 4 have all been reconstructed. Based on this, the current reconstructed image block B is subjected to upsampling processing, as shown in FIG. 17, in which a circle in B indicates a sampling point before up-sampling, and × indicates a sampling point after up-sampling. When performing upsampling on B, you can first upsample B in the horizontal direction and then upsample the upsampled signal in the vertical direction. Alternatively, you can first upsample B in the vertical direction. Then, the upsampled signal is upsampled in the horizontal direction.

特别的，若当前重建图像块本身是一幅图像的边界图像块，这种情况下，即使所需的相邻重建图像块都重建完成，在进行上采样处理时，还是需要复制当前重建图像的像素。例如：如图15所示，当当前重建图像块是一幅图像的最右侧的一个图像块时，它的右边图像块是不存在的，因此可以对当前重建图像块包括的最右侧一列的像素进行复制，以实现上采样处理。当然，也可以采用其他方法进行上采样处理，本申请对此不做限制。In particular, if the currently reconstructed image block itself is a boundary image block of an image, in this case, even if the required adjacent reconstructed image block is reconstructed, it is necessary to copy the current reconstructed image when performing the upsampling process. Pixel. For example, as shown in FIG. 15, when the current reconstructed image block is the rightmost image block of an image, its right image block does not exist, so the rightmost column included in the currently reconstructed image block can be included. The pixels are copied to achieve upsampling processing. Of course, other methods may also be used for the upsampling process, which is not limited in this application.

进一步地，由于当前重建图像块所需的各个相邻重建图像块的编码方式可以是下采样编码方式，也可以是原分辨率编码方式，因此在对当前重建图像块进行上采样处理时，具体分为以下两种情况：Further, since the coding mode of each adjacent reconstructed image block required for reconstructing the image block may be a downsampling coding mode or an original resolution coding mode, when performing the upsampling process on the current reconstructed image block, Divided into the following two cases:

1、若某相邻重建图像块的编码方式为下采样编码方式，则可以直接根据该相邻重建图像块中的像素对当前重建图像块进行上采样处理。1. If the coding mode of an adjacent reconstructed image block is the downsampling coding mode, the current reconstructed image block may be directly upsampled according to the pixels in the adjacent reconstructed image block.

2、若某相邻重建图像块的编码方式为原分辨率编码方式，则可以获取该相邻重建图像块的像素中上采样处理所需的至少一个像素，对这些像素进行下采样处理，并根据下采样处理后的至少一个像素对当前重建图像块进行上采样处理。2. If the coding mode of an adjacent reconstructed image block is the original resolution coding mode, at least one pixel required for the upsampling process in the pixels of the adjacent reconstructed image block may be acquired, and the pixels are downsampled, and The current reconstructed image block is subjected to upsampling processing according to at least one pixel after the downsampling process.

具体地，相邻重建图像块主要用于对当前重建图像块的部分边界进行上采样处理(该部分边界根据滤波器的不同而不同)，例如：如图17所示，相邻重建图像块3采用下采样编码方式，这种情况下，可以直接利用相邻重建图像块3包括的像素对当前重建图像块B的右边界进行上采样处理。而相邻重建图像块4采用原分辨率编码方式，则需要对相邻重建图像块4包括的上采样处理所需的像素进行下采样处理，或者对相邻重建图像块4采用下采样处理，并根据下采样处理后的像素对当前重建图像块B的下边界进行上采样处理。其中，对相邻重建图像块4采用下采样处理，具体可以是直接取图16中被框圈出的像素作为下采样后的采样点。或者是对相邻重建图像块4进行竖直方向上的下采样处理。图18为本申请另一实施例提供的图像上采样示意图，如图18所示，这种是8邻域像素的情况，解码端对当前重建图像块C采样的上采样处理方法与4邻域像素情况下的方法类似，在此不再赘述。Specifically, the adjacent reconstructed image block is mainly used for performing upsampling processing on a partial boundary of the currently reconstructed image block (the partial boundary is different according to the filter), for example, as shown in FIG. 17, the adjacent reconstructed image block 3 The downsampling coding mode is adopted. In this case, the right boundary of the current reconstructed image block B can be upsampled directly by using the pixels included in the adjacent reconstructed image block 3. If the adjacent reconstructed image block 4 adopts the original resolution encoding mode, the pixels required for the upsampling process included in the adjacent reconstructed image block 4 need to be downsampled, or the adjacent reconstructed image block 4 is subjected to downsampling processing. And performing upsampling processing on the lower boundary of the currently reconstructed image block B according to the pixels after the downsampling process. The adjacent reconstructed image block 4 is subjected to downsampling processing, and specifically, the pixel circled in FIG. 16 is directly taken as the downsampled sampling point. Alternatively, the adjacent reconstructed image block 4 is subjected to downsampling processing in the vertical direction. FIG. 18 is a schematic diagram of image upsampling according to another embodiment of the present application. As shown in FIG. 18, this is a case of 8 neighborhood pixels, and the decoding side samples the current reconstructed image block C by using an upsampling processing method and 4 neighborhoods. The method in the case of a pixel is similar, and will not be described here.

需要说明的是，为了避免对当前重建图像块的重复上采样处理，可以对当前重建图像块进行上采样处理后，标识当前重建图像块已完成上采样处理。或者，按照一定的规则对当前重建图像块进行上采样处理。当上采样处理是基于4邻域像素的情况时，当前重建图像块的下边图像块一旦完成重建，则可以对当前重建图像块进行上采样处理。当上采样处理是基于8邻域像素的情况时，当前重建图像块的右下图像块一旦完成重建，则可以对当前重建图像块进行上采样处理。It should be noted that, in order to avoid repeated upsampling processing on the currently reconstructed image block, the current reconstructed image block may be subjected to upsampling processing, and the current reconstructed image block may be identified as having completed the upsampling process. Alternatively, the current reconstructed image block is subjected to upsampling processing according to a certain rule. When the upsampling process is based on the case of 4 neighborhood pixels, once the lower image block of the currently reconstructed image block is reconstructed, the current reconstructed image block may be subjected to upsampling processing. When the upsampling process is based on the case of 8 neighborhood pixels, once the lower right image block of the currently reconstructed image block is reconstructed, the current reconstructed image block may be subjected to upsampling processing.

针对方式二进行详细说明：For the second method, please explain in detail:

当当前图像的所有图像块都已经完成重建之后，则对于每个重建图像块来讲，它所需的相邻重建图像块都已经完成重建，基于此，对任一采用下采样编码的重建图像块都可以进行上采样处理。具体上采样处理过程类似于上述方式一的方式，本申请在此不再赘述。After all the image blocks of the current image have been reconstructed, for each reconstructed image block, the adjacent reconstructed image blocks it needs have been reconstructed, based on which, for any reconstructed image using downsampling coding The blocks can be upsampled. The specific upsampling process is similar to the mode of the foregoing mode 1, and the application is not described herein again.

针对方式三进行详细说明：Detailed description of mode three:

在方式三中，对当前重建图像块进行的上采样处理包括两次上采样处理过程。第一次上采样处理过程为：根据所需的相邻重建图像块中的当前已完成重建的一部分相邻重建图像块的像素，对当前重建图像块进行一次上采样处理。第二次上采样处理过程为：若所需的相邻重建图像块中的当前未完成重建的另一部分相邻重建图像块已完成重建，则根据另一部分相邻重建图像块对当前重建图像块的部分边界进行二次上采样处理，其中，当前重建图像块的所述部分边界与另一部分相邻重建图像块邻接。In mode three, the upsampling process performed on the current reconstructed image block includes two upsampling processes. The first upsampling process is: performing a upsampling process on the currently reconstructed image block according to the pixels of a part of the adjacent reconstructed image blocks of the currently completed reconstructed image in the required adjacent reconstructed image block. The second upsampling process is: if another part of the adjacent reconstructed image block of the currently uncompleted reconstruction in the required adjacent reconstructed image block has been reconstructed, the currently reconstructed image block is reconstructed according to another partial adjacent reconstructed image block. The partial boundary is subjected to a second upsampling process in which the partial boundary of the currently reconstructed image block is contiguous with another partially adjacent reconstructed image block.

可选地，在对当前重建图像块进行第一次上采样处理之前，保存下采样编码方式的当前重建图像块，为后续对其他待重建图像块进行预测时提供参考像素。Optionally, before performing the first upsampling process on the current reconstructed image block, the current reconstructed image block of the downsampling coding mode is saved, and the reference pixels are provided for subsequent prediction of the other image blocks to be reconstructed.

具体地，假设采用从上至下、从左至右的编码顺序，对于基于4邻域像素或者8邻域像素进行上采样处理的情况，在对当前重建图像块进行第一次上采样处理时，它的右边图像块、下边图像块、左下图像块和右下图像块都还没有完成重建。这种情况下，解码端可以复制当前重建图像块包括的最右侧一列或者多列的像素，得到插值像素。通过这些插值像素对当前重建图像块包括的右边界进行上采样处理。解码端还可以复制当前重建图像块包括的最下方一行或者多行的像素，得到插值像素。通过这些插值像素对当前重建图像块包括的下边界进行上采样处理。Specifically, assuming a coding order from top to bottom and from left to right, for the case of performing upsampling processing on a 4 neighborhood pixel or an 8 neighborhood pixel, when performing the first upsampling process on the currently reconstructed image block The right image block, the lower image block, the lower left image block, and the lower right image block have not yet been reconstructed. In this case, the decoding end may copy the pixels of the rightmost column or columns included in the current reconstructed image block to obtain interpolated pixels. Upsampling processing is performed on the right boundary included in the currently reconstructed image block by these interpolated pixels. The decoding end may also copy the pixels of the lowermost row or rows included in the current reconstructed image block to obtain interpolated pixels. Upsampling processing is performed on the lower boundary included in the currently reconstructed image block by these interpolated pixels.

图19为本申请一实施例提供的图像上采样示意图，如图19所示，假设当前重建图像块为图像块A，在对当前重建图像块A进行第二次上采样处理时，假设目前采用DCTIF滤波器进行上采样处理，当前重建图像块A已完成第一次上采样处理，如上面所述使用DCTIF滤波器进行上采样处理时，需要用到左右各四个像素，那么在第一次上采样处理时，当前重建图像块A的右边四列×(×表示第一次上采样处理后的采样点)所需的四个参考像素均是不全的。例如，对于最右侧的一列×，每个×所需要的右边四个参考像素都不存在。若相邻重建图像块C完成了重建，则根据相邻重建图像块C对当前重建图像块的右边界进行第二次上采样处理。这里的上采样处理方法与上述上采样处理方法相同，在此不再赘述。FIG. 19 is a schematic diagram of image upsampling according to an embodiment of the present invention. As shown in FIG. 19, it is assumed that the current reconstructed image block is image block A, and the second upsampling process is performed on the current reconstructed image block A. The DCTIF filter performs upsampling processing. The current reconstructed image block A has completed the first upsampling process. When using the DCTIF filter for upsampling processing as described above, it is necessary to use four pixels on the left and right, then the first time During the upsampling process, the four reference pixels required for the right four columns of the currently reconstructed image block A (x represents the sample points after the first upsampling process) are incomplete. For example, for the rightmost column ×, the right four reference pixels required for each x do not exist. If the adjacent reconstructed image block C is reconstructed, the second upsampling process is performed on the right boundary of the currently reconstructed image block according to the adjacent reconstructed image block C. The upsampling processing method here is the same as the above-described upsampling processing method, and details are not described herein again.

同样地，假设当前重建图像块为图像块B，在对当前重建图像块B进行第二次上采样处理时，假设目前采用DCTIF滤波器进行上采样处理，当前重建图像块B已完成第一次上采样处理，如上面所述使用DCTIF滤波器进行上采样处理时，需要用到上下各四个像素，那么在第一次上采样处理时，当前重建图像块B的下方四行×(×表示第一次上采样处理后的采样点)所需的四个参考像素均是不全的。例如，对于最下方的一行×，每个×所需要的下方四个参考像素都不存在。若相邻重建图像块C完成了重建，则根据相邻重建图像块C对当前重建图像块的下边界进行第二次上采样处理。这里的上采样处理方法与上述上采样处理方法相同，在此不再赘述。Similarly, assuming that the current reconstructed image block is the image block B, when the second upsampling process is performed on the current reconstructed image block B, it is assumed that the DCTIF filter is currently used for the upsampling process, and the current reconstructed image block B has been completed for the first time. The upsampling process, when using the DCTIF filter for upsampling processing as described above, requires four pixels above and below, then in the first upsampling process, the lower four rows of the currently reconstructed image block B × (× indicates The four reference pixels required for the sample point after the first upsampling process are incomplete. For example, for the bottom row x, the lower four reference pixels required for each x do not exist. If the adjacent reconstructed image block C is reconstructed, the second upsampling process is performed on the lower boundary of the currently reconstructed image block according to the adjacent reconstructed image block C. The upsampling processing method here is the same as the above-described upsampling processing method, and details are not described herein again.

图20为本申请另一实施例提供的图像上采样示意图，如图20所示，这种是8邻域像素的情况，解码端对当前重建图像块A的右边界以及当前重建图像块B的下边界采用的上采样处理方法与4邻域像素情况下的方法类似，在此不再赘述。FIG. 20 is a schematic diagram of image upsampling according to another embodiment of the present application. As shown in FIG. 20, this is the case of 8 neighborhood pixels, and the decoding end is on the right boundary of the currently reconstructed image block A and the current reconstructed image block B. The upsampling processing method used in the lower boundary is similar to the method in the case of 4 neighborhood pixels, and will not be described here.

需要说明的是，为了避免对当前重建图像块的重复上采样处理，可以对当前重建图像块完成第二次上采样处理后，标识当前重建图像块已完成上采样处理。或者，按照一定的规则对当前重建图像块进行上采样处理。当上采样处理是基于4邻域像素的情况时，当前重建图像块的下边图像块一旦完成重建，则可以对当前重建图像块进行第二次上采样处理。当上采样处理是基于8邻域像素的情况时，当前重建图像块的右下图像块一旦完成重建，则可以对当前重建图像块进行第二次上采样处理。It should be noted that, in order to avoid repeated upsampling processing on the currently reconstructed image block, after the second upsampling process is performed on the current reconstructed image block, the current reconstructed image block may be identified as having completed the upsampling process. Alternatively, the current reconstructed image block is subjected to upsampling processing according to a certain rule. When the upsampling process is based on the case of 4 neighborhood pixels, once the lower image block of the current reconstructed image block is reconstructed, the current upsampling image block may be subjected to the second upsampling process. When the upsampling process is based on the case of 8 neighborhood pixels, once the lower right image block of the currently reconstructed image block is reconstructed, the current upsampling image block may be subjected to a second upsampling process.

针对方式四进行详细说明：Detailed description of method four:

当当前图像的所有图像块都已经完成重建之后，则对于每个重建图像块来讲，它所需的相邻重建图像块都已经完成重建，基于此，对任一已完成第一次上采样处理后的重建图像块都可以进行第二次上采样处理。具体上采样处理过程类似于上述方式三的方式，本申请在此不再赘述。After all the image blocks of the current image have been reconstructed, for each reconstructed image block, the adjacent reconstructed image blocks it needs have been reconstructed, based on which the first upsampling is completed for either The processed reconstructed image block can be subjected to the second upsampling process. The specific upsampling process is similar to the mode of the foregoing mode 3, and details are not described herein again.

通过上述四种方式对当前重建图像块进行上采样处理时，当前重建图像块的部分边界都是通过所需的相邻重建图像块进行上采样处理的，而现有技术中，当前重建图像块的部分边界都是通过复制当前重建图像块的像素进行上采样处理的，因此，本申请提供的方法可以避免当前重建图像块边界不连续的问题。When the current reconstructed image block is upsampled by the above four methods, part of the boundary of the currently reconstructed image block is upsampled by the required adjacent reconstructed image block, and in the prior art, the current reconstructed image block is reconstructed. The partial boundaries are all upsampled by copying the pixels of the currently reconstructed image block. Therefore, the method provided by the present application can avoid the problem that the current reconstructed image block boundary is discontinuous.

综上，相对于现有技术中对整幅图像中的重建图像块都采用相同的滤波器，本申请针对每个重建图像块都要选择对应的滤波器，即本申请采用具有针对性的选择方式来选择滤波器，通过选择的滤波器对重建图像块进行上采样处理，从而可以得到显示效果更佳的重建图像块。In summary, the same filter is used for the reconstructed image block in the entire image in the prior art, and the present application selects a corresponding filter for each reconstructed image block, that is, the present application adopts a targeted selection. The method selects the filter, and the reconstructed image block is upsampled by the selected filter, so that the reconstructed image block with better display effect can be obtained.

可选地，可以通过如下几种情况选择用于对当前重建图像块进行上采样处理的第一滤波器：Optionally, the first filter for performing upsampling processing on the currently reconstructed image block may be selected by:

具体地，情况一：从至少两个候选滤波器中选择用于对当前重建图像块进行上采样处理的第一滤波器具体包括：当前重建图像块的至少两个相邻重建图像块中每个相邻重建图像块与当前重建图像块的相似度，其中，至少两个相邻重建图像块进行上采样处理时对应至少两个第二滤波器，至少两个候选滤波器包括至少两个第二滤波器；从至少两个第二滤波器中选择与当前重建图像块相似度最高的相邻重建图像块对应的第二滤波器作为第一滤波器。Specifically, the first case: selecting, from the at least two candidate filters, the first filter for performing the upsampling process on the current reconstructed image block comprises: each of the at least two adjacent reconstructed image blocks of the currently reconstructed image block. a similarity between the adjacent reconstructed image block and the current reconstructed image block, wherein at least two adjacent reconstructed image blocks are subjected to upsampling processing corresponding to at least two second filters, and at least two candidate filters include at least two second a filter; selecting, as the first filter, a second filter corresponding to the adjacent reconstructed image block having the highest similarity with the current reconstructed image block from the at least two second filters.

其中，将第二滤波器作为第一滤波器不仅仅表示为一种赋值关系，还表示直接选择第二滤波器对当前重建图像块进行上采样处理。Wherein, the second filter as the first filter is not only represented as an assignment relationship, but also indicates that the second filter is directly selected to perform upsampling processing on the currently reconstructed image block.

针对上述方式一和方式二，相邻重建图像块是指：在当前重建图像块的所有相邻重建图像块中，已经完成上采样处理的重建图像块。针对上述方式三和方式四，相邻重建图像块是指：在当前重建图像块的所有相邻重建图像块中，已经完成第一次上采样处理或者第二次上采样处理的重建图像块。针对方式三和方式四，第二滤波器用于对相邻重建图像块进行的第一次上采样处理，或者，第二滤波器用于对相邻重建图像块进行的第二次上采样处理，本申请对此不做限制。For the first mode and the second mode, the adjacent reconstructed image block refers to the reconstructed image block that has been subjected to the upsampling process in all the adjacent reconstructed image blocks of the currently reconstructed image block. For the third mode and the fourth mode, the adjacent reconstructed image block refers to the reconstructed image block that has completed the first upsampling process or the second upsampling process in all the adjacent reconstructed image blocks of the currently reconstructed image block. For mode 3 and mode 4, the second filter is used for the first upsampling process on the adjacent reconstructed image block, or the second filter is used for the second upsampling process on the adjacent reconstructed image block. There is no restriction on the application.

计算为当前重建图像块与相邻重建图像块的相似度的方法可以是：若当前重建图像块与相邻重建图像块的分辨率相同，则对当前重建图像块的每个像素与相邻重建图像块中对应的像素求差，得到对应差值，对当前重建图像块的所有差值求加权平均值，最终得到当前重建图像块与相邻重建图像块的误差，该误差越小，则表示相似度越高。若当前重建图像块与相邻重建图像块的分辨率不同，则先对相邻重建图像块进行采样处理，使得采样处理后的相邻重建图像块的分辨率与当前重建图像块的分辨率相同，然后对当前重建图像块的每个像素与采样处理后的相邻重建图像块中对应的像素求差，得到对应差值，对当前重建图像块的所有差值求加权平均值，最终得到当前重建图像块与相邻重建图像块的误差，该误差越小，则表示相似度越高。The method for calculating the similarity between the current reconstructed image block and the adjacent reconstructed image block may be: if the resolution of the current reconstructed image block and the adjacent reconstructed image block are the same, then each pixel and adjacent reconstruction of the currently reconstructed image block The corresponding pixels in the image block are compared to obtain a corresponding difference, and a weighted average value is obtained for all the differences of the current reconstructed image block, and finally an error between the current reconstructed image block and the adjacent reconstructed image block is obtained, and the smaller the error, the smaller The higher the similarity. If the resolutions of the currently reconstructed image block and the adjacent reconstructed image block are different, the adjacent reconstructed image block is first sampled, so that the resolution of the adjacent reconstructed image block after the sampling process is the same as the resolution of the currently reconstructed image block. Then, each pixel of the current reconstructed image block is compared with a corresponding pixel in the sampled adjacent reconstructed image block to obtain a corresponding difference, and a weighted average value is obtained for all the differences of the current reconstructed image block, and finally the current value is obtained. The error of reconstructing the image block and the adjacent reconstructed image block, the smaller the error, the higher the similarity.

需要说明的是，本申请对确定当前重建图像块与相邻重建图像块的相似度不限于此。It should be noted that the present application is not limited to determining the similarity between the current reconstructed image block and the adjacent reconstructed image block.

进一步地，若当前重建图像块不存在上述相邻重建图像块，即针对上述方式一和方式二，在当前重建图像块的所有相邻重建图像块中，不存在已经完成上采样处理的重建图像块。或者，针对上述方式三和方式四，在当前重建图像块的所有相邻重建图像块中，不存在已经完成第一次上采样处理和第二次上采样处理的重建图像块。则可以计算这些相邻重建图像块的相邻重建图像块与当前重建图像块的相似度。相邻重建图像块的相邻重建图像块进行上采样处理时对应至少两个滤波器；从至少两个滤波器中选择与当前重建图像块相似度最高的相邻重建图像块的相邻重建图像块对应的滤波器作为第一滤波器。本申请对此不做限制。Further, if the currently reconstructed image block does not have the adjacent reconstructed image block, that is, for the first mode and the second mode, in all the adjacent reconstructed image blocks of the current reconstructed image block, there is no reconstructed image that has been subjected to the upsampling process. Piece. Or, for the foregoing mode three and method four, in all the adjacent reconstructed image blocks of the current reconstructed image block, there is no reconstructed image block that has completed the first upsampling process and the second upsampling process. Then, the similarity between the adjacent reconstructed image blocks of the adjacent reconstructed image blocks and the currently reconstructed image block can be calculated. The adjacent reconstructed image blocks of the adjacent reconstructed image blocks are subjected to upsampling processing corresponding to at least two filters; and the adjacent reconstructed images of the adjacent reconstructed image blocks having the highest similarity with the current reconstructed image block are selected from the at least two filters. The filter corresponding to the block acts as the first filter. This application does not limit this.

可选地，本申请还可以将当前重建图像块的任一个相邻重建图像块进行上采样处理时对应的第二滤波器作为第一滤波器。若当前重建图像块不存在上述相邻重建图像块，即针对上述方式一和方式二，在当前重建图像块的所有相邻重建图像块中，不存在已经完成上采样处理的重建图像块。或者，针对上述方式三和方式四，在当前重建图像块的所有相邻重建图像块中，不存在已经完成第一次上采样处理和第二次上采样处理的重建图像块。则可以选择这些相邻重建图像块的所有相邻重建图像块中需要进行上采样处理的相邻重建图像块。最后，将选择的相邻重建图像块进行上采样处理时对应的滤波器作为第一滤波器本申请对此不做限制。Optionally, the present application may also use a second filter corresponding to any adjacent reconstructed image block of the current reconstructed image block as a first filter. If the currently reconstructed image block does not have the adjacent reconstructed image block, that is, for the first mode and the second mode, in the adjacent reconstructed image block of the current reconstructed image block, there is no reconstructed image block that has been subjected to the upsampling process. Or, for the foregoing mode three and method four, in all the adjacent reconstructed image blocks of the current reconstructed image block, there is no reconstructed image block that has completed the first upsampling process and the second upsampling process. Then, adjacent reconstructed image blocks that need to be upsampled in all adjacent reconstructed image blocks of these adjacent reconstructed image blocks may be selected. Finally, the corresponding filter when the selected adjacent reconstructed image block is subjected to the upsampling process is used as the first filter.

情况二、从至少两个候选滤波器中选择用于对所述当前重建图像块进行上采样处理的第一滤波器包括：确定对当前重建图像块的至少两个相邻重建图像块中每个相邻重建图像块进行上采样处理时使用的至少两个第二滤波器；至少两个候选滤波器包括所述至少两个第二滤波器，按照各个相邻重建图像块的编号顺序从至少两个第二滤波器中选择第一个相邻重建图像块对应的第二滤波器，作为第一滤波器。 Case 2, selecting, from the at least two candidate filters, the first filter for performing upsampling processing on the current reconstructed image block comprises: determining each of at least two adjacent reconstructed image blocks of the current reconstructed image block At least two second filters used when the adjacent reconstructed image blocks are subjected to upsampling processing; at least two candidate filters including the at least two second filters, from at least two in order of numbering of each adjacent reconstructed image block A second filter corresponding to the first adjacent reconstructed image block is selected as the first filter.

例如：图21为本申请一实施例提供的当前重建图像块和相邻重建图像块的示意图，如图21所示，判断相邻重建图像块A ₀、A ₁、B ₀、B ₁、B ₂中已经完成上采样处理的相邻重建图像块，假设A ₀、A ₁、B ₀、B ₁、B ₂都是相邻重建图像块，并且它们的编码顺序是：B ₁，A ₁，B ₂，B ₀，A ₀，按照编码顺序，则选择B ₁对应的第二滤波器作为当前重建图像块的第一滤波器。 For example, FIG. 21 is a schematic diagram of a current reconstructed image block and an adjacent reconstructed image block according to an embodiment of the present application. As shown in FIG. 21, the adjacent reconstructed image blocks A ₀ , A ₁ , B ₀ , B ₁ , B are determined. The adjacent reconstructed image blocks of the upsampling process have been completed in ₂ , assuming that A ₀ , A ₁ , B ₀ , B ₁ , B ₂ are adjacent reconstructed image blocks, and their encoding order is: B ₁ , A ₁ , B ₂ , B ₀ , A ₀ , according to the coding order, the second filter corresponding to B ₁ is selected as the first filter of the current reconstructed image block.

情况三、从至少两个候选滤波器中选择用于对当前重建图像块进行上采样处理的第一滤波器包括：确定对当前重建图像块的至少两个相邻重建图像块中每个相邻重建图像块进行上采样处理时使用的至少两个第二滤波器；至少两个候选滤波器包括所述至少两个第二滤波器，选择使用概率最高的第二滤波器作为第一滤波器。Case 3: selecting, from the at least two candidate filters, the first filter for performing upsampling processing on the current reconstructed image block comprises: determining each adjacent one of the at least two adjacent reconstructed image blocks of the current reconstructed image block Reconstructing the image block to perform at least two second filters used in the upsampling process; the at least two candidate filters include the at least two second filters, and selecting the second filter having the highest probability of use as the first filter.

情况四、从至少两个候选滤波器中选择用于对当前重建图像块进行上采样处理的第一滤波器包括：根据当前重建图像块的纹理特征从至少两个候选滤波器中选择第一滤波器。其中，根据当前重建图像块的纹理特征从至少两个候选滤波器中选择第一滤波器，包括：根据预设映射关系和当前重建图像块的纹理特征选择第一滤波器，预设映射关系是包括当前重建图像块的纹理特征的预设纹理特征和包括第一滤波器的所述至少两个候选滤波器之间的映射关系。Case 4: selecting a first filter for performing upsampling processing on the current reconstructed image block from the at least two candidate filters includes: selecting a first filter from the at least two candidate filters according to a texture feature of the currently reconstructed image block Device. The selecting the first filter from the at least two candidate filters according to the texture feature of the current reconstructed image block comprises: selecting the first filter according to the preset mapping relationship and the texture feature of the currently reconstructed image block, where the preset mapping relationship is And a mapping relationship between the preset texture feature of the texture feature of the current reconstructed image block and the at least two candidate filters including the first filter.

具体地，检测当前重建图像块的纹理特征包括：边缘检测方式或者在频域中判断纹理特征的方式等。下面以第二种方式为例：Specifically, detecting texture features of the currently reconstructed image block includes: an edge detection mode or a manner of determining texture features in the frequency domain, and the like. The following is the second way:

图22为本申请一实施例提供的当前重建图像块的示意图，如图22所示，该当前重建图像块是一个分辨率为8*8的图像块。当对当前重建图像块经过离散余弦变换(Discrete Cosine Transform，DCT)变换之后，会生成如图22所示的0～63个系数，横向用i表示，i＝0～7；纵向用j表示，j＝0～7。FIG. 22 is a schematic diagram of a current reconstructed image block according to an embodiment of the present invention. As shown in FIG. 22, the current reconstructed image block is an image block with a resolution of 8*8. When the current reconstructed image block is subjected to Discrete Cosine Transform (DCT) transformation, 0 to 63 coefficients as shown in FIG. 22 are generated, and the horizontal direction is represented by i, i=0 to 7; the vertical direction is represented by j. j=0~7.

当当前重建图像块在频域上满足公式∑AC ²＜a*DC ²，则表示该当前重建图像块的纹理特征为平坦，否则，则表示该当前重建图像块的纹理特征为纹理。 When the current reconstructed image block satisfies the formula ∑AC ² <a*DC ² in the frequency domain, it indicates that the texture feature of the current reconstructed image block is flat, otherwise, it indicates that the texture feature of the current reconstructed image block is a texture.

其中，上述公式左侧表示当前重建图像块中所有像素的交流电流(Alternating Current，AC)的平方和，右侧为当前重建图像块中所有像素的直流电流(Direct Current t，DC)的平方和与系数a之积，其中，a大于0且小于等于1。例如：a可以取经验值0.02。Wherein, the left side of the above formula represents the sum of the squares of the alternating currents (AC) of all the pixels in the currently reconstructed image block, and the right side is the sum of the squares of the direct currents (DC) of all the pixels in the currently reconstructed image block. The product of the coefficient a, where a is greater than 0 and less than or equal to 1. For example: a can take an empirical value of 0.02.

进一步地，纹理特征和滤波器之间的预设映射关系可以是表1所示的映射关系，本申请对预设映射关系不做限制。Further, the preset mapping relationship between the texture feature and the filter may be the mapping relationship shown in Table 1. The present application does not limit the preset mapping relationship.

表1Table 1

纹理特征Texture feature	滤波器filter
平坦flat	DCTIF滤波器DCTIF filter
纹理Texture	CNN滤波器CNN filter

最后，可以根据上述预设映射关系和当前重建图像块的纹理特征选择第一滤波器。假设当前重建图像块的纹理特征是平台，预设映射关系如表1，则选择的第一滤波器为DCTIF滤波器。Finally, the first filter may be selected according to the preset mapping relationship and the texture feature of the currently reconstructed image block. Assuming that the texture feature of the currently reconstructed image block is a platform, and the preset mapping relationship is as shown in Table 1, the selected first filter is a DCTIF filter.

情况五、从至少两个候选滤波器中选择用于对当前重建图像块进行上采样处理的第一滤波器包括：根据当前重建图像块的纹理特征从至少两个候选滤波器中选择第一滤波器。其中，根据当前重建图像块的纹理特征从至少两个候选滤波器中选择第一滤波器，包括：在所有相邻重建图像块中确定与当前重建图像块纹理特征相同的至少两个相邻重建图像块，至少两个相邻重建图像块进行上采样处理时对应至少两个第二滤波器，至少两个候选滤波器包括至少两个第二滤波器，从所述至少两个第二滤波器中选择与当前重建图像块纹理特征相同的相邻重建图像块对应的第二滤波器作为第一滤波器。Case 5: selecting, from the at least two candidate filters, the first filter for performing upsampling processing on the current reconstructed image block comprises: selecting the first filter from the at least two candidate filters according to the texture feature of the currently reconstructed image block Device. Wherein selecting the first filter from the at least two candidate filters according to the texture feature of the currently reconstructed image block comprises: determining, in all adjacent reconstructed image blocks, at least two adjacent reconstructions that are identical to the current reconstructed image block texture feature And an image block, when at least two adjacent reconstructed image blocks are subjected to upsampling processing, corresponding to at least two second filters, and at least two candidate filters include at least two second filters, from the at least two second filters A second filter corresponding to the adjacent reconstructed image block having the same reconstructed image block texture feature is selected as the first filter.

其中，相邻重建图像块的纹理特征与第二滤波器的映射关系可以参考上述表1中的预设映射关系。本申请对此不做限制。The mapping relationship between the texture feature of the adjacent reconstructed image block and the second filter may refer to the preset mapping relationship in Table 1 above. This application does not limit this.

情况六、从至少两个候选滤波器中选择用于对当前重建图像块进行上采样处理的第一滤波器，包括：通过至少两个候选滤波器分别对当前重建图像块进行上采样处理，得到至少两个候选滤波器分别对应的上采样图像块；分别计算至少两个候选滤波器对应的上采样图像块与当前重建图像块对应的原始图像块的误差；将最小误差对应的候选滤波器作为第一滤波器。Case 6: selecting a first filter for performing upsampling processing on the current reconstructed image block from the at least two candidate filters, comprising: performing upsampling processing on the current reconstructed image block by using at least two candidate filters respectively, And corresponding to the upsampled image blocks respectively corresponding to the at least two candidate filters; respectively calculating an error of the original image block corresponding to the upsampled image block corresponding to the at least two candidate filters and the current reconstructed image block; and using the candidate filter corresponding to the minimum error as First filter.

其中，通过滤波器对当前重建图像块进行上采样处理的方法可以参考上述上采样过程，在此不再赘述。计算上采样图像块与原始图像块的误差，包括：对上采样图像块的每个像素与原始图像块中对应的像素求差，得到对应差值，对所有差值求加权平均值，最终得到上采样图像块与原始图像块的误差。其中，上采样图像块与原始图像块的误差越小，表示上采样图像块对应滤波器的上采样处理效果越好。相反，上采样图像块与原始图像块的误差越大，表示上采样图像块对应滤波器的上采样处理效果越差。For the method of performing the upsampling process on the current reconstructed image block by the filter, reference may be made to the above-mentioned upsampling process, and details are not described herein again. Calculating the error between the upsampled image block and the original image block includes: calculating a difference between each pixel of the upsampled image block and a corresponding pixel in the original image block, obtaining a corresponding difference, and weighting the average value of all the differences, and finally obtaining The error between the upsampled image block and the original image block. The smaller the error between the upsampled image block and the original image block, the better the upsampling processing effect of the corresponding filter of the upsampled image block. Conversely, the greater the error between the upsampled image block and the original image block, the worse the upsampling processing effect of the filter corresponding to the upsampled image block.

需要说明的是，本申请中还可以根据亮度分量和色度分量选择滤波器。It should be noted that the filter may also be selected according to the luminance component and the chrominance component in the present application.

综上，本申请可以根据上述六种情况为当前重建图像块选择第一滤波器。相对于现有技术中对整幅图像中的重建图像块都采用相同的滤波器，本申请针对每个重建图像块都要选择对应的滤波器，从而可以得到显示效果更佳的重建图像块。In summary, the present application can select a first filter for the current reconstructed image block according to the above six conditions. Compared with the prior art, the same filter is used for the reconstructed image block in the entire image. The present application selects a corresponding filter for each reconstructed image block, so that a reconstructed image block with better display effect can be obtained.

当对当前重建图像块采用上述方式三或者方式四进行上采样处理时，由于存在第二次上采样处理，因此，需要通过第三滤波器对当前重建图像块进行第二次上采样处理。When the current reconstructed image block is subjected to the upsampling process in the above manner three or four, since there is a second upsampling process, the second upsampling process is required on the currently reconstructed image block by the third filter.

本申请提供一种图像处理方法，其中第三滤波器可以是上述的第一滤波器，或者可以参照上述选择第一滤波器的方式选择第三滤波器，需要强调的是，该第三滤波器是针对当前重建图像块的部分边界进行上采样处理的。The present application provides an image processing method, wherein the third filter may be the first filter described above, or the third filter may be selected by referring to the manner of selecting the first filter, and it is emphasized that the third filter It is upsampled for the partial boundary of the currently reconstructed image block.

可选地，通过第三滤波器，根据在所述所需的相邻重建图像块中的另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理之前，还包括：根据另一部分相邻重建图像块和当前重建图像块的部分边界判断是否对部分边界进行二次上采样处理，若确定对第一重建图像块的部分边界进行二次上采样处理，则通过第三滤波器，根据另一部分相邻重建图像块对当前重建图像块的部分边界进行二次上采样处理。Optionally, before performing a second upsampling process on a partial boundary of the currently reconstructed image block according to another partial adjacent reconstructed image block in the required adjacent reconstructed image block by using a third filter, The method includes: determining, according to another partial adjacent reconstructed image block and a partial boundary of the currently reconstructed image block, whether to perform a second upsampling process on the partial boundary, and if determining to perform a second upsampling process on a part of the boundary of the first reconstructed image block, The third filter performs a second upsampling process on a partial boundary of the currently reconstructed image block according to another partial adjacent reconstructed image block.

具体地，若当前重建图像块的部分边界包括：它的右边界和下边界。则在另一部分第二相邻重建图像块中确定与右边界邻接的一列或者多列像素。根据经过第一次上采样处理后的右边界与该一列或者多列的像素(构成右边界的邻接边界)确定是否对右边界进行二次上采样处理，当确定对右边界进行二次上采样处理时，也认为对下边界进行二次上采样处理。Specifically, if a part of the boundary of the currently reconstructed image block includes: its right boundary and lower boundary. Then, one or more columns of pixels adjacent to the right border are determined in another portion of the second adjacent reconstructed image block. Determining whether to perform secondary upsampling processing on the right boundary according to the right boundary after the first upsampling process and the pixels of the one or more columns (adjacent boundary constituting the right boundary), when determining to perform secondary upsampling on the right boundary At the time of processing, it is also considered that the lower boundary is subjected to secondary upsampling processing.

或者，or,

若当前重建图像块的部分边界包括：它的右边界和下边界。则在另一部分第二相邻重建图像块中确定与下边界邻接的一行或者多行像素。根据经过第一次上采样处理后的下边界与该一行或者多行的像素(构成下边界的邻接边界)确定是否对下边界进行二次上采样处理，当确定对下边界进行二次上采样处理时，也认为对右边界进行二次上采样处理。If the boundary of the currently reconstructed image block includes: its right and lower boundaries. Then, one or more rows of pixels adjacent to the lower boundary are determined in another portion of the second adjacent reconstructed image block. Determining whether to perform secondary upsampling on the lower boundary according to the lower boundary after the first upsampling process and the pixels of the one or more rows (adjacent boundaries constituting the lower boundary), and determining to perform secondary upsampling on the lower boundary At the time of processing, it is also considered that the right boundary is subjected to secondary upsampling processing.

其中，根据经过第一次上采样处理后的右边界与该一列或者多列的像素确定是否对右边界进行二次上采样处理，具体如下：Wherein, according to the right boundary after the first upsampling process and the pixels of the one or more columns, whether to perform the second upsampling process on the right boundary is as follows:

图23为本申请一实施例提供的右边界和右边界的邻接边界的示意图，如图23所示，FIG. 23 is a schematic diagram of adjacent boundaries of a right boundary and a right boundary according to an embodiment of the present disclosure, as shown in FIG. 23,

如果满足下面所有条件时，则确定对右边界进行二次上采样处理，否则，不对右边界进行二次上采样处理。If all of the following conditions are satisfied, it is determined that the right boundary is subjected to the second upsampling process; otherwise, the right boundary is not subjected to the second upsampling process.

|p0–q0|<TH1|p0–q0|<TH1

|p1–p0|<TH2|p1–p0|<TH2

|q1–q0|<TH3|q1–q0|<TH3

其中，p0至p3表示右边界的各个像素的像素值，q0至q3表示右边界的邻接边界的各个像素的像素值。TH1、TH2、TH3分别是预设阈值，它们可以相同，也可以不同。Wherein, p0 to p3 represent pixel values of respective pixels of the right border, and q0 to q3 represent pixel values of respective pixels of adjacent boundaries of the right border. TH1, TH2, and TH3 are preset thresholds, respectively, which may be the same or different.

通过上述方法可以有效确定是否对部分边界进行二次上采样处理。Through the above method, it is possible to effectively determine whether or not to perform a second upsampling process on a part of the boundary.

可选地，上述方法还包括：生成码流，该码流包括：第一滤波器的标识信息。Optionally, the method further includes: generating a code stream, where the code stream includes: identifier information of the first filter.

其中，可以实现上采样处理的滤波器一般为一个或多个，它们可以是不同类型，不同抽头数的滤波器。也可以是相同类型，不同抽头数的滤波器。又或者是相同类型，相同抽头数，不同系数的滤波器。其中，每个滤波器都具有对应的标识信息。具体见表2、表3和表4。The filters that can implement the upsampling process are generally one or more, and they may be different types of filters with different number of taps. It can also be a filter of the same type and different number of taps. Or a filter of the same type, the same number of taps, and different coefficients. Each filter has corresponding identification information. See Table 2, Table 3 and Table 4 for details.

表2：Table 2:

标识信息 Identification information		滤波器filter
00	DCTIF滤波器 DCTIF filter
11	神经网络卷积(CNN)滤波器Neural network convolution (CNN) filter

22	维纳Wiener滤波器 Wiener Wiener filter
33	双线性插值滤波器Bilinear interpolation filter

表3：table 3:

标识信息Identification information	滤波器filter
00	[-1 0 9 16 9 0 -1]/16[-1 0 9 16 9 0 -1]/16
11	[1 -5 20 20 -5 1]/32[1 -5 20 20 -5 1]/32
22	[l -1 -4 9 22 9 -4 -1 1]/32[l -1 -4 9 22 9 -4 -1 1]/32
33	[-8 1 72 126 72 1 -8]/128[-8 1 72 126 72 1 -8]/128

表4：Table 4:

标识信息Identification information	滤波器filter
00	[-1 0 9 16 9 0 -1]/16[-1 0 9 16 9 0 -1]/16
11	[1 -5 20 20 -5 1]/32[1 -5 20 20 -5 1]/32
22	[l -1 -4 9 22 9 -4 -1 1]/32[l -1 -4 9 22 9 -4 -1 1]/32
33	[-5 0 21 32 21 0 -5]/32[-5 0 21 32 21 0 -5]/32

通过携带第一滤波器的标识信息的方式，使得解码端可以通过第一滤波器对当前重建图像块进行上采样处理。By carrying the identification information of the first filter, the decoding end can perform the upsampling process on the current reconstructed image block by using the first filter.

可选地，生成码流，该码流包括：第一指示信息，其中，第一指示信息用于指示如何从至少两个候选滤波器选择对当前重建图像块进行上采样处理时使用的滤波器。Optionally, generating a code stream, where the code stream includes: first indication information, where the first indication information is used to indicate how to select a filter used when performing upsampling processing on the current reconstructed image block from the at least two candidate filters. .

可选地，对滤波器的选择方式包括：方式一、根据当前重建图像块的纹理特征从至少两个候选滤波器选择对当前重建图像块进行上采样处理时使用的滤波器；方式二、根据当前重建图像块的相邻重建图像块从至少两个候选滤波器选择对当前重建图像块进行上采样处理时使用的滤波器。Optionally, the method for selecting a filter includes: mode 1: selecting, according to a texture feature of the currently reconstructed image block, a filter used for performing upsampling processing on the current reconstructed image block from at least two candidate filters; The adjacent reconstructed image block of the current reconstructed image block selects a filter used when up-sampling the current reconstructed image block from at least two candidate filters.

可选地，生成码流，该码流包括：第二指示信息，其中，第二指示信息用于指示解码端是否需要对当前重建图像块进行二次上采样处理。Optionally, the code stream is generated, where the code stream includes: second indication information, where the second indication information is used to indicate whether the decoding end needs to perform secondary upsampling processing on the current reconstructed image block.

需要说明的是，上述码流可以包括以下至少一项：第一滤波器的标识信息、第一指示信息、第二指示信息等，可选地，该码流还包括：当前待编码图像块的编码信息等，解码端可以通过对该编码信息进行熵解码得到当前待编码图像块的变换量化系数，还可以通过该编码信息得到预测信号等。该码流还可以包括：当前待编码图像块的编码方式等。It should be noted that the foregoing code stream may include at least one of the following: identifier information of the first filter, first indication information, second indication information, and the like. Optionally, the code stream further includes: an image block to be currently encoded. For encoding information and the like, the decoding end may obtain the transform quantized coefficients of the current image block to be encoded by entropy decoding the encoded information, and obtain a prediction signal or the like by using the encoded information. The code stream may further include: an encoding mode of the image block to be currently encoded, and the like.

上面主要介绍了编码端的图像处理方法，下面将介绍解码端的图像处理方法。The above mainly introduces the image processing method of the encoding end, and the image processing method of the decoding end will be described below.

具体地，图24为本申请另一实施例提供的一种图像处理方法的流程图，如图24所示，该方法包括：Specifically, FIG. 24 is a flowchart of an image processing method according to another embodiment of the present application. As shown in FIG. 24, the method includes:

步骤S2401：解析码流，以获取当前待重建图像块的编码信息和当前待重建图像块的编码方式；Step S2401: Parsing the code stream to obtain the coding information of the current image block to be reconstructed and the coding mode of the current image block to be reconstructed;

步骤S2402：根据当前待重建图像块的编码信息生成当前待重建图像块的重建信号；Step S2402: Generate a reconstruction signal of the current image block to be reconstructed according to the coding information of the current image block to be reconstructed;

步骤S2403：根据重建信号重建当前待重建图像块，得到当前重建图像块；Step S2403: reconstruct the current image block to be reconstructed according to the reconstructed signal, and obtain a current reconstructed image block.

步骤S2404：若当前待重建图像块的编码方式为下采样编码方式，则根据从码流获取的第一指示信息选择用于对当前重建图像块进行上采样处理的第一滤波器；Step S2404: If the encoding mode of the image block to be reconstructed is the downsampling coding mode, selecting a first filter for performing upsampling processing on the current reconstructed image block according to the first indication information acquired from the code stream;

步骤S2405：通过第一滤波器对当前重建图像块进行上采样处理。Step S2405: Perform upsampling processing on the currently reconstructed image block by using the first filter.

其中，第一指示信息用于指示如何从至少两个候选滤波器选择对当前重建图像块进行上采样处理时使用的滤波器。The first indication information is used to indicate how to select a filter used when performing upsampling processing on the current reconstructed image block from at least two candidate filters.

该码流还包括：当前待重建图像块的编码方式、当前待重建图像块所述的当前图像中已完成重建的重建图像块的编码方式。或者，该码流包括一些编码参数，通过这些编码参数可以确定当前待重建图像块的编码方式、当前待重建图像块所述的当前图像中已完成重建的重建图像块的编码方式等。The code stream further includes: an encoding mode of the image block to be reconstructed, and a coding mode of the reconstructed image block that has been reconstructed in the current image in the current image block to be reconstructed. Alternatively, the code stream includes some coding parameters, by which the coding mode of the current image block to be reconstructed, the coding mode of the reconstructed image block that has been reconstructed in the current image of the current image block to be reconstructed, and the like may be determined.

该编码信息用于生成待重建图像块的重建信号，比如：解码端通过对编码信息进行熵解码，得到当前待重建图像块的变换量化系数，然后对变换量化系数进行反量化和反变换，得到当前待重建图像块的重建的残差信号。通过它的参考重建图像块(参考重建图像块的信息属于编码信息)对当前待重建图像块进行预测，得到当前待重建图像块的预测信号，然后将预测信号和上述重建的残差信号相加，得到当前待重建图像块的重建信号。该码流还包括现有技术涉及的更多的编码信息，本申请对此不做限制。The coding information is used to generate a reconstructed signal of the image block to be reconstructed. For example, the decoding end performs entropy decoding on the encoded information to obtain a transformed quantized coefficient of the current image block to be reconstructed, and then inverse quantizes and inverse transforms the transformed quantized coefficient to obtain The reconstructed residual signal of the current image block to be reconstructed. The image block to be reconstructed is predicted by the reference reconstructed image block (the information of the reconstructed image block belongs to the encoded information), the predicted signal of the current image block to be reconstructed is obtained, and then the predicted signal and the reconstructed residual signal are added together. Obtain a reconstruction signal of the current image block to be reconstructed. The code stream also includes more coding information related to the prior art, which is not limited in this application.

可选地，对滤波器的选择方式包括：方式一、根据所述当前重建图像块的纹理特征从至少两个候选滤波器选择对当前重建图像块进行上采样处理时使用的滤波器；方式二、根据当前重建图像块的相邻重建图像块从至少两个候选滤波器选择对当前重建图像块进行上采样处理时使用的滤波器。Optionally, the method for selecting a filter includes: mode 1: selecting, according to the texture feature of the current reconstructed image block, a filter used for performing upsampling processing on the current reconstructed image block from at least two candidate filters; Filters used when up-sampling the current reconstructed image block are selected from at least two candidate filters according to adjacent reconstructed image blocks of the current reconstructed image block.

最后，若当前重建图像块的编码方式为下采样编码方式，则根据第一指示信息选择用于对当前重建图像块进行上采样处理的第一滤波器，通过第一滤波器对当前重建图像块进行上采样处理。Finally, if the coding mode of the current reconstructed image block is the downsampling coding mode, the first filter for performing the upsampling process on the current reconstructed image block is selected according to the first indication information, and the current reconstructed image block is used by the first filter. Perform upsampling processing.

需要说明的是，解码端和编码端涉及的重建当前待重建图像块方法类似，并且解码端和编码端涉及的对当前重建图像块进行上采样处理地方法也类似。在此不再赘述这两个方法。It should be noted that the method for reconstructing the current image block to be reconstructed involved in the decoding end and the encoding end is similar, and the method of performing upsampling processing on the current reconstructed image block involved in the decoding end and the encoding end is also similar. These two methods will not be described here.

可选地，第一指示信息用于指示根据当前重建图像块的纹理特征从至少两个候选滤波器选择对当前重建图像块进行上采样处理时使用的滤波器；根据从码流获取的第一指示信息选择用于对所述当前重建图像块进行上采样处理的第一滤波器，包括：根据预设映射关系和当前重建图像块的纹理特征选择第一滤波器，预设映射关系是包括当前重建图像块的纹理特征的预设纹理特征和包括第一滤波器的至少两个候选滤波器之间的映射关系。Optionally, the first indication information is used to indicate that a filter used when performing upsampling processing on the current reconstructed image block from the at least two candidate filters according to the texture feature of the currently reconstructed image block; the first obtained according to the obtained from the code stream The indicating information is used to select a first filter for performing the upsampling process on the current reconstructed image block, including: selecting a first filter according to a preset mapping relationship and a texture feature of the currently reconstructed image block, where the preset mapping relationship includes the current Reconstructing a mapping relationship between a predetermined texture feature of the texture feature of the image block and at least two candidate filters including the first filter.

可选地，第一指示信息用于指示根据当前重建图像块的相邻重建图像块从至少两个候选滤波器选择对当前重建图像块进行上采样处理时使用的滤波器；根据从码流获取的第一指示信息选择用于对当前重建图像块进行上采样处理的第一滤波器，包括：确定至少两个相邻重建图像块中每个相邻重建图像块与所述当前重建图像块的相似度，至少两个相邻重建图像块进行上采样处理时对应至少两个第二滤波器，至少两个候选滤波器包括至少两个第二滤波器；从至少两个第二滤波器中选择相似度最高的相邻重建图像块对应的第二滤波器作为所述第一滤波器。Optionally, the first indication information is used to indicate that the filter used when performing upsampling processing on the current reconstructed image block is selected from the at least two candidate filters according to the adjacent reconstructed image block of the current reconstructed image block; Determining, by the first indication information, a first filter for performing upsampling processing on the current reconstructed image block, comprising: determining each adjacent reconstructed image block of the at least two adjacent reconstructed image blocks and the current reconstructed image block Similarity, when at least two adjacent reconstructed image blocks are subjected to upsampling processing, corresponding to at least two second filters, at least two candidate filters including at least two second filters; and selecting from at least two second filters A second filter corresponding to the adjacent reconstructed image block having the highest similarity is used as the first filter.

可选地，通过第一滤波器对当前重建图像块进行上采样处理，包括：根据当前重建图像块进行上采样处理时所需的相邻重建图像块中的当前已完成重建的一部分相邻重建图像块的像素，通过第一滤波器对当前重建图像块进行一次上采样处理；相应的，所述方法还包括：若所需的相邻重建图像块中的当前未完成重建的另一部分相邻重建图像块已完成重建，则通过第三滤波器，根据另一部分相邻重建图像块对当前重建图像块的部分边界进行二次上采样处理，其中，当前重建图像块的部分边界与另一部分相邻重建图像块邻接。Optionally, the current reconstructed image block is upsampled by the first filter, including: a part of the adjacent reconstruction of the currently completed reconstruction in the adjacent reconstructed image block required for performing the upsampling process according to the current reconstructed image block. a pixel of the image block, wherein the current reconstructed image block is subjected to upsampling processing by the first filter; correspondingly, the method further comprises: if another portion of the adjacent reconstructed image block that is currently incompletely reconstructed is adjacent to each other After the reconstructed image block has been reconstructed, the third filter is used to perform a second upsampling process on a part of the boundary of the currently reconstructed image block according to another part of the adjacent reconstructed image block, wherein a part of the boundary of the currently reconstructed image block is compared with another part. Neighbor reconstructed image blocks are contiguous.

可选地，通过第一滤波器对当前重建图像块进行上采样处理，包括：根据当前重建图像块进行上采样处理时所需的相邻重建图像块中的当前已完成重建的一部分相邻重建图像块的像素，通过第一滤波器对当前重建图像块进行一次上采样处理；相应的，方法还包括：若当前重建图像块所处的当前图像的所有图像块均已完成重建，则通过第三滤波器，根据在所需的相邻重建图像块中的另一部分相邻重建图像块对当前重建图像块的部分边界进行二次上采样处理，其中，另一部分相邻重建图像块是在对所述当前重建图像块进行第一次上采样处理时未完成重建的图像块；当前重建图像块的部分边界与另一部分相邻重建图像块邻接。Optionally, the current reconstructed image block is upsampled by the first filter, including: a part of the adjacent reconstruction of the currently completed reconstruction in the adjacent reconstructed image block required for performing the upsampling process according to the current reconstructed image block. a pixel of the image block, performing a upsampling process on the current reconstructed image block by using the first filter; correspondingly, the method further includes: if all the image blocks of the current image in which the current reconstructed image block is located have been reconstructed, a third filter that performs a second upsampling process on a partial boundary of the currently reconstructed image block according to another partially adjacent reconstructed image block in the desired adjacent reconstructed image block, wherein another portion of the adjacent reconstructed image block is in the pair The image block that is not reconstructed when the current reconstructed image block is subjected to the first upsampling process; the partial boundary of the current reconstructed image block is adjacent to another partially adjacent reconstructed image block.

可选的，其中第三滤波器可以是上述的第一滤波器，或者可以参照上述选择第一滤波器的方式选择第三滤波器，需要强调的是，该第三滤波器是针对当前重建图像块的部分边界进行上采样处理的。Optionally, wherein the third filter may be the first filter described above, or the third filter may be selected by referring to the manner of selecting the first filter, and it is emphasized that the third filter is for the current reconstructed image. Partial boundaries of the block are upsampled.

其中，上述方法与编码端的对应方法相同，对应内容和效果在此不再赘述。The above method is the same as the corresponding method of the encoding end, and the corresponding content and effect are not described herein again.

可选地，所述码流还包括：第二指示信息；相应的，通过第三滤波器，根据所需的相邻重建图像块中的另一部分相邻重建图像块对当前重建图像块的部分边界进行二次上采样处理，包括：若第二指示信息指示需要对当前重建图像块进行二次上采样处理，则通过第三滤波器，根据在所需的相邻重建图像块中的另一部分相邻重建图像块对当前重建图像块的部分边界进行二次上采样处理Optionally, the code stream further includes: second indication information; correspondingly, by using a third filter, according to another part of the adjacent reconstructed image block that is required to reconstruct the image block, the part of the current reconstructed image block Performing a second upsampling process on the boundary includes: if the second indication information indicates that the current reconstructed image block needs to be subjected to the second upsampling process, passing the third filter according to another part in the desired adjacent reconstructed image block The adjacent reconstructed image block performs secondary upsampling on a part of the boundary of the currently reconstructed image block

通过这两种可选方式可以判断是否对当前重建图像块进行二次上采样处理。当确定不对当前重建图像块进行二次上采样处理时，可以降低解码端的开销，当确定需要对当前重建图像块进行二次上采样处理时，可以解决当前重建图像块的边界不连续问题。Through these two alternative methods, it can be determined whether the current reconstructed image block is subjected to secondary upsampling processing. When it is determined that the current reconstructed image block is not subjected to the second upsampling process, the overhead of the decoding end may be reduced. When it is determined that the current reconstructed image block needs to be subjected to the second upsampling process, the boundary discontinuity problem of the currently reconstructed image block may be solved.

图25为本申请再一实施例提供的一种图像处理方法的流程图，如图25所示，该方法包括：FIG. 25 is a flowchart of an image processing method according to still another embodiment of the present application. As shown in FIG. 25, the method includes:

步骤S2501：解析码流，以获取当前待重建图像块的编码信息和当前待重建图像块的编码方式；Step S2501: Parsing the code stream to obtain the coding information of the current image block to be reconstructed and the coding mode of the current image block to be reconstructed;

步骤S2502：根据编码信息生成当前待重建图像块的重建信号，并根据重建信号重建当前待重建图像块，得到当前重建图像块；Step S2502: Generate a reconstruction signal of the current image block to be reconstructed according to the encoding information, and reconstruct the current image block to be reconstructed according to the reconstruction signal to obtain a current reconstructed image block.

步骤S2503：若当前待重建图像块的编码方式为下采样编码方式，则从码流获取第一滤波器的标识信息，并通过标识信息标识的第一滤波器对当前重建图像块进行上采样处理。Step S2503: If the coding mode of the image block to be reconstructed is the downsampling coding mode, the identification information of the first filter is obtained from the code stream, and the current reconstructed image block is upsampled by the first filter identified by the identification information. .

其中，该码流还包括：当前待重建图像块的编码方式、当前待重建图像块所述的当前图像中已完成重建的重建图像块的编码方式。该编码信息用于生成待重建图像块的重建信号，比如：解码端通过对编码信息进行熵解码，得到当前待重建图像块的变换量化系数，然后对变换量化系数进行反量化和反变换，得到当前待重建图像块的重建的残差信号。通过它的参考重建图像块(参考重建图像块的信息属于编码信息)对当前待重建图像块进行预测，得到当前待重建图像块的预测信号，然后将预测信号和上述重建的残差信号相加，得到当前待重建图像块的重建信号。该码流还包括现有技术涉及的更多的编码信息，本申请对此不做限制。The code stream further includes: an encoding mode of the image block to be reconstructed, and a coding mode of the reconstructed image block that has been reconstructed in the current image in the current image block to be reconstructed. The coding information is used to generate a reconstructed signal of the image block to be reconstructed. For example, the decoding end performs entropy decoding on the encoded information to obtain a transformed quantized coefficient of the current image block to be reconstructed, and then inverse quantizes and inverse transforms the transformed quantized coefficient to obtain The reconstructed residual signal of the current image block to be reconstructed. The image block to be reconstructed is predicted by the reference reconstructed image block (the information of the reconstructed image block belongs to the encoded information), the predicted signal of the current image block to be reconstructed is obtained, and then the predicted signal and the reconstructed residual signal are added together. Obtain a reconstruction signal of the current image block to be reconstructed. The code stream also includes more coding information related to the prior art, which is not limited in this application.

最后，若当前重建图像块的编码方式为下采样编码方式，则通过第一滤波器对当前重建图像块进行上采样处理。Finally, if the encoding mode of the currently reconstructed image block is the down sampling encoding mode, the current reconstructed image block is subjected to upsampling processing by the first filter.

可选地，通过第一滤波器对当前重建图像块进行上采样处理，包括：根据当前重建图像块进行上采样处理时所需的相邻重建图像块中的当前已完成重建的一部分相邻重建图像块的像素，通过第一滤波器对当前重建图像块进行一次上采样处理；相应的，方法还包括：若当前重建图像块所处的当前图像的所有图像块均已完成重建，则通过第三滤波器，根据所需的相邻重建图像块中的另一部分相邻重建图像块对当前重建图像块的部分边界进行二次上采样处理，其中，另一部分相邻重建图像块是在对所述当前重建图像块进行第一次上采样处理时未完成重建的图像块；当前重建图像块的部分边界与另一部分相邻重建图像块邻接。Optionally, the current reconstructed image block is upsampled by the first filter, including: a part of the adjacent reconstruction of the currently completed reconstruction in the adjacent reconstructed image block required for performing the upsampling process according to the current reconstructed image block. a pixel of the image block, performing a upsampling process on the current reconstructed image block by using the first filter; correspondingly, the method further includes: if all the image blocks of the current image in which the current reconstructed image block is located have been reconstructed, a third filter, performing a second upsampling process on a partial boundary of the currently reconstructed image block according to another part of the adjacent reconstructed image block in the adjacent reconstructed image block, wherein another part of the adjacent reconstructed image block is in the opposite The image block that is not reconstructed when the current reconstructed image block is subjected to the first upsampling process; the partial boundary of the current reconstructed image block is adjacent to another partially adjacent reconstructed image block.

可选地，通过第三滤波器，根据所述所需的相邻重建图像块中的另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理之前，还包括：根据所述另一部分相邻重建图像块和所述当前重建图像块的部分边界判断是否对所述部分边界进行二次上采样处理；若确定对第一重建图像块的部分边界进行二次上采样处理，则通过第三滤波器，根据另一部分相邻重建图像块对当前重建图像块的部分边界进行二次上采样处理。Optionally, before the second upsampling process of the partial boundary of the current reconstructed image block according to another partial adjacent reconstructed image block in the required adjacent reconstructed image block by using the third filter, Determining, according to the partial boundary of the another partial adjacent reconstructed image block and the current reconstructed image block, whether to perform a second upsampling process on the partial boundary; if it is determined that the partial boundary of the first reconstructed image block is performed twice For the sampling process, the third filter is used to perform a second upsampling process on the partial boundary of the currently reconstructed image block according to another partial adjacent reconstructed image block.

可选地，所述码流还包括：第二指示信息；相应的，通过第三滤波器，根据所需的相邻重建图像块中的另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理，包括：若第二指示信息指示需要对当前重建图像块进行二次上采样处理，则通过第三滤波器，根据在所需的相邻重建图像块中的另一部分相邻重建图像块对当前重建图像块的部分边界进行二次上采样处理。Optionally, the code stream further includes: second indication information; and correspondingly, through the third filter, the current reconstructed image block according to another part of the adjacent reconstructed image block in the required adjacent reconstructed image block Performing a second upsampling process on the partial boundary, including: if the second indication information indicates that the current reconstructed image block needs to be subjected to the second upsampling process, passing through the third filter according to the desired adjacent reconstructed image block Another portion of the adjacent reconstructed image block performs a second upsampling process on a portion of the boundary of the currently reconstructed image block.

需要说明的是，本申请编码端和解码端还可以通过预先已协商的滤波器对当前重建图像块进行上采样处理。It should be noted that the encoding end and the decoding end of the present application may also perform upsampling processing on the currently reconstructed image block by using a previously negotiated filter.

图26为本申请一实施例提供的一种图像处理设备的结构示意图，如图26所示，该设备包括：生成模块2601，用于生成当前待编码图像块的重建信号，并根据所述重建信号重建所述当前待编码图像块，以得到当前重建图像块；选择模块2602，用于若所述当前重建图像块的编码方式为下采样编码方式，则从至少两个候选滤波器中选择用于对当前重建图像块进行上采样处理的第一滤波器；处理模块2603，用于通过所述第一滤波器对所述当前重建图像块进行上采样处理。FIG. 26 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present disclosure. As shown in FIG. 26, the apparatus includes: a generating module 2601, configured to generate a reconstruction signal of a current image block to be encoded, and according to the reconstruction Reconstructing the current image block to be encoded to obtain a current reconstructed image block; and selecting a module 2602, configured to select, from the at least two candidate filters, if the encoding mode of the current reconstructed image block is a downsampling coding mode a first filter for performing upsampling processing on the current reconstructed image block; and a processing module 2603, configured to perform upsampling processing on the current reconstructed image block by using the first filter.

可选地，选择模块2602，具体用于根据所述当前重建图像块的纹理特征从至少两个候选滤波器中选择所述第一滤波器。Optionally, the selecting module 2602 is configured to select the first filter from the at least two candidate filters according to the texture feature of the current reconstructed image block.

可选地，选择模块2602具体用于：具体用于根据预设映射关系和所述当前重建图像块的纹理特征选择所述第一滤波器，所述预设映射关系是包括所述当前重建图像块的纹理特征的预设纹理特征和包括所述第一滤波器的所述至少两个候选滤波器之间的映射关系。Optionally, the selecting module 2602 is specifically configured to: specifically, select the first filter according to a preset mapping relationship and a texture feature of the current reconstructed image block, where the preset mapping relationship includes the current reconstructed image a predetermined texture feature of the texture feature of the block and a mapping relationship between the at least two candidate filters including the first filter.

可选地，选择模块2602，具体用于确定当前重建图像块的至少两个相邻重建图像块中每个相邻重建图像块与所述当前重建图像块的相似度，其中，所述至少两个相邻重建图像块进行上采样处理时对应至少两个第二滤波器，所述至少两个候选滤波器包括所述至少两个第二滤波器；从所述至少两个第二滤波器中选择与所述当前重建图像块相似度最高的相邻重建图像块对应的第二滤波器作为所述第一滤波器。Optionally, the selecting module 2602 is configured to determine a similarity between each adjacent reconstructed image block of the at least two adjacent reconstructed image blocks of the current reconstructed image block and the current reconstructed image block, where the at least two And the adjacent reconstructed image blocks are subjected to upsampling processing corresponding to at least two second filters, the at least two candidate filters including the at least two second filters; and from the at least two second filters A second filter corresponding to the adjacent reconstructed image block having the highest similarity to the current reconstructed image block is selected as the first filter.

可选地，所述选择模块2602具体用于：通过所述至少两个候选滤波器分别对所述当前重建图像块进行上采样处理，得到所述至少两个候选滤波器分别对应的上采样图像块；分别计算所述至少两个候选滤波器对应的上采样图像块与所述当前重建图像块对应的原始图像块的误差；将最小误差对应的候选滤波器作为所述第一滤波器。Optionally, the selecting module 2602 is configured to: perform upsampling processing on the current reconstructed image block by using the at least two candidate filters, respectively, to obtain an upsampled image corresponding to the at least two candidate filters respectively. a block; respectively calculating an error of the original image block corresponding to the upsampled image block corresponding to the at least two candidate filters and the current reconstructed image block; and using the candidate filter corresponding to the minimum error as the first filter.

可选地，所述处理模块2603具体用于：根据当前重建图像块进行上采样处理时所需的相邻重建图像块中的当前已完成重建的一部分相邻重建图像块的像素，通过所述第一滤波器对所述当前重建图像块进行一次上采样处理；所述处理模块2603，还用于若所述所需的相邻重建图像块中的当前未完成重建的另一部分相邻重建图像块已完成重建，则通过第三滤波器，根据所述另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理，其中，所述当前重建图像块的所述部分边界与所述另一部分相邻重建图像块邻接。Optionally, the processing module 2603 is specifically configured to: use, according to the currently reconstructed image block of the currently reconstructed image in the adjacent reconstructed image block that is required for performing the upsampling process on the current reconstructed image block, by using the The first filter performs an upsampling process on the current reconstructed image block; the processing module 2603 is further configured to: if the currently adjacent reconstructed image block in the desired adjacent reconstructed image block is another currently adjacent reconstructed image After the block has been reconstructed, a second upsampling process is performed on a partial boundary of the current reconstructed image block according to the another partial adjacent reconstructed image block by a third filter, wherein the current reconstructed image block is A partial boundary is adjacent to the other partially adjacent reconstructed image block.

可选地，所述处理模块2603具体用于：根据当前重建图像块进行上采样处理时所需的相邻重建图像块中的当前已完成重建的一部分相邻重建图像块的像素，通过所述第一滤波器对所述当前重建图像块进行一次上采样处理，其中，所述所需的相邻重建图像块为所述当前重建图像块进行上采样处理时所需的相邻重建图像块；所述处理模块2603，若所述当前重建图像块所处的当前图像的所有图像块均已完成重建，则通过第三滤波器，根据所述所需的相邻重建图像块中的另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理，其中，所述另一部分相邻重建图像块是在对所述当前重建图像块进行第一次上采样处理时未完成重建的图像块；所述当前重建图像块的所述部分边界与所述另一部分相邻重建图像块邻接。Optionally, the processing module 2603 is specifically configured to: use, according to the currently reconstructed image block of the currently reconstructed image in the adjacent reconstructed image block that is required for performing the upsampling process on the current reconstructed image block, by using the The first filter performs an upsampling process on the current reconstructed image block, where the required adjacent reconstructed image block is an adjacent reconstructed image block required for performing upsampling processing on the current reconstructed image block; The processing module 2603, if all the image blocks of the current image in which the current reconstructed image block is located have been reconstructed, pass the third filter, according to another part of the required adjacent reconstructed image block The neighboring reconstructed image block performs a second upsampling process on a partial boundary of the current reconstructed image block, wherein the another partial adjacent reconstructed image block is not subjected to the first upsampling process of the current reconstructed image block Completing the reconstructed image block; the partial boundary of the current reconstructed image block is contiguous with the other partially adjacent reconstructed image block.

可选地，还包括：判断模块2604，用于根据所述另一部分相邻重建图像块和所述当前重建图像块的部分边界判断是否对所述部分边界进行二次上采样处理；所述选择模块2602，具体用于若所述判断模块2604确定对所述第一重建图像块的部分边界进行二次上采样处理，则通过所述第三滤波器，根据所述另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理。Optionally, the method further includes: a determining module 2604, configured to determine, according to the partial boundary of the another partial adjacent reconstructed image block and the current reconstructed image block, whether to perform secondary upsampling processing on the partial boundary; The module 2602 is specifically configured to: if the determining module 2604 determines to perform a second upsampling process on a partial boundary of the first reconstructed image block, using the third filter to reconstruct the image block according to the another portion Performing a second upsampling process on a partial boundary of the current reconstructed image block.

可选地，所述生成模块2601，还用于生成码流，所述码流包括：所述第一滤波器的标识信息。Optionally, the generating module 2601 is further configured to generate a code stream, where the code stream includes: identifier information of the first filter.

可选地，所述生成模块2601，还用于生成码流，所述码流包括：第一指示信息，第一指示信息用于指示如何从至少两个候选滤波器选择对所述当前重建图像块进行上采样处理时使用的滤波器。Optionally, the generating module 2601 is further configured to generate a code stream, where the code stream includes: first indication information, where the first indication information is used to indicate how to select the current reconstructed image from the at least two candidate filters. The filter used when the block performs the upsampling process.

可选地，所述生成模块2601，还用于生成码流，所述码流包括：第二指示信息，其中，所述第二指示信息用于指示所述解码端是否需要对所述当前重建图像块进行二次上采样处理。Optionally, the generating module 2601 is further configured to generate a code stream, where the code stream includes: second indication information, where the second indication information is used to indicate whether the decoding end needs to perform the current reconstruction. The image block is subjected to secondary upsampling processing.

本申请提供的图像处理设备可以执行上述图14对应的图像处理方法以及该方法的可选方式，其实现原理和技术效果类似，此处不再赘述。The image processing device provided by the present application can perform the image processing method corresponding to FIG. 14 and the optional method of the method, and the implementation principle and technical effects are similar, and details are not described herein again.

图27为本申请另一实施例提供的一种图像处理设备的结构示意图，如图27所示，该设备包括：解析模块2701，用于解析码流，以获取当前待重建图像块的编码信息和所述当前待重建图像块的编码方式；生成模块2702，用于根据所述当前待重建图像块的编码信息生成当前待重建图像块的重建信号，并根据所述重建信号重建当前待重建图像块，得到当前重建图像块；选择模块2703，用于若当前待重建图像块的编码方式为下采样编码方式，则根据从码流获取的第一指示信息选择用于对当前重建图像块进行上采样处理的第一滤波器，其中，第一指示信息用于指示如何从至少两个候选滤波器选择对当前重建图像块进行上采样处理时使用的滤波器；处理模块2704，用于通过第一滤波器对当前重建图像块进行上采样处理。FIG. 27 is a schematic structural diagram of an image processing apparatus according to another embodiment of the present disclosure. As shown in FIG. 27, the apparatus includes: a parsing module 2701, configured to parse a code stream to obtain encoding information of an image block to be reconstructed. And a coding mode of the current image block to be reconstructed; a generating module 2702, configured to generate a reconstruction signal of the current image block to be reconstructed according to the coding information of the current image block to be reconstructed, and reconstruct the current image to be reconstructed according to the reconstruction signal a block, the current reconstructed image block is obtained; the selecting module 2703 is configured to: if the encoding mode of the current image block to be reconstructed is a down sampling encoding mode, select, according to the first indication information acquired from the code stream, to perform the current reconstructed image block. a first filter of the sampling process, wherein the first indication information is used to indicate how to select a filter used for upsampling the current reconstructed image block from the at least two candidate filters; the processing module 2704 is configured to pass the first The filter performs upsampling processing on the currently reconstructed image block.

可选地，第一指示信息用于指示根据当前重建图像块的纹理特征从至少两个候选滤波器选择对当前重建图像块进行上采样处理时使用的滤波器；选择模块2703具体用于：根据预设映射关系和所述当前重建图像块的纹理特征选择所述第一滤波器，所述预设映射关系是包括所述当前重建图像块的纹理特征的预设纹理特征和包括所述第一滤波器的所述至少两个候选滤波器之间的映射关系。Optionally, the first indication information is used to indicate that the filter used in the upsampling process of the current reconstructed image block is selected from the at least two candidate filters according to the texture feature of the current reconstructed image block; the selecting module 2703 is specifically configured to: Selecting, by the preset mapping relationship and the texture feature of the current reconstructed image block, the first filter, the preset mapping relationship being a preset texture feature including a texture feature of the current reconstructed image block, and including the first A mapping relationship between the at least two candidate filters of the filter.

可选地，第一指示信息用于指示根据当前重建图像块的相邻重建图像块从所述至少两个候选滤波器选择对所述当前重建图像块进行上采样处理时使用的滤波器；选择模块2703具体用于：确定至少两个相邻重建图像块中每个相邻重建图像块与所述当前重建图像块的相似度，所述至少两个相邻重建图像块进行上采样处理时对应至少两个第二滤波器，所述至少两个候选滤波器包括所述至少两个第二滤波器；从所述至少两个第二滤波器中选择相似度最高的相邻重建图像块对应的第二滤波器作为所述第一滤波器。Optionally, the first indication information is used to indicate that a filter used when performing upsampling processing on the current reconstructed image block from the at least two candidate filters according to the adjacent reconstructed image block of the current reconstructed image block; The module 2703 is specifically configured to: determine a similarity between each of the at least two adjacent reconstructed image blocks and the current reconstructed image block, where the at least two adjacent reconstructed image blocks correspond to the upsampling process At least two second filters, the at least two candidate filters including the at least two second filters; selecting, from the at least two second filters, corresponding to the adjacent reconstructed image blocks having the highest similarity A second filter is used as the first filter.

可选地，所述处理模块2704具体用于：根据当前重建图像块进行上采样处理时所需的相邻重建图像块中的当前已完成重建的一部分相邻重建图像块的像素，通过所述第一滤波器对所述当前重建图像块进行一次上采样处理、处理模块2704，还用于若所需的相邻重建图像块中的当前未完成重建的另一部分相邻重建图像块已完成重建，则通过第三滤波器，根据另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理，其中，当前重建图像块的所述部分边界与另一部分相邻重建图像块邻接。Optionally, the processing module 2704 is configured to: use, according to the currently reconstructed image block of the currently reconstructed image block, the pixel of the adjacent reconstructed image block that is currently reconstructed according to the current reconstructed image block. The first filter performs an upsampling process on the current reconstructed image block, and the processing module 2704 is further configured to: if another part of the adjacent reconstructed image block in the required adjacent reconstructed image block is reconstructed, the adjacent reconstructed image block has been reconstructed. And performing, by the third filter, performing a second upsampling process on a partial boundary of the current reconstructed image block according to another partial adjacent reconstructed image block, where the partial boundary of the current reconstructed image block is adjacent to another portion of the reconstructed image block Image blocks are contiguous.

可选地，所述处理模块2704具体用于：根据当前重建图像块进行上采样处理时所需的相邻重建图像块中的当前已完成重建的一部分相邻重建图像块的像素，通过所述第一滤波器对所述当前重建图像块进行一次上采样处理；所述处理模块2704，还用于若当前重建图像块所处的所述当前图像的所有图像块均已完成重建，则通过第三滤波器，根据所述所需的相邻重建图像块中的另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理，其中，所述另一部分相邻重建图像块是在对所述当前重建图像块进行第一次上采样处理时未完成重建的图像块；所述当前重建图像块的所述部分边界与所述另一部分相邻重建图像块邻接。Optionally, the processing module 2704 is configured to: use, according to the currently reconstructed image block of the currently reconstructed image block, the pixel of the adjacent reconstructed image block that is currently reconstructed according to the current reconstructed image block. The first filter performs an upsampling process on the current reconstructed image block; the processing module 2704 is further configured to: if all the image blocks of the current image in which the currently reconstructed image block is located have been reconstructed, pass the first a third filter, performing a second upsampling process on a partial boundary of the current reconstructed image block according to another part of the adjacent reconstructed image block in the required adjacent reconstructed image block, wherein the another part is adjacently reconstructed The image block is an image block that is not reconstructed when the first upsampling process is performed on the current reconstructed image block; the partial boundary of the current reconstructed image block is adjacent to the another partial adjacent reconstructed image block.

可选地，还包括：判断模块2705，用于根据所述另一部分相邻重建图像块和所述当前重建图像块的部分边界判断是否对所述部分边界进行二次上采样处理；所述处理模块2704，具体用于若所述判断模块2705确定对所述第一重建图像块的部分边界进行二次上采样处理，则通过所述第三滤波器，根据所述另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理。Optionally, the method further includes: a determining module 2705, configured to determine, according to the partial boundary of the another partial adjacent reconstructed image block and the current reconstructed image block, whether to perform secondary upsampling processing on the partial boundary; The module 2704 is specifically configured to: if the determining module 2705 determines to perform a second upsampling process on a partial boundary of the first reconstructed image block, using the third filter to reconstruct the image block according to the another portion Performing a second upsampling process on a partial boundary of the current reconstructed image block.

可选地，所述码流还包括：第二指示信息；相应的，所述处理模块2704，具体用于若第二指示信息指示需要对当前重建图像块进行二次上采样处理，则通过第三滤波器，根据在所需的相邻重建图像块中的另一部分相邻重建图像块对当前重建图像块的部分边界进行二次上采样处理。Optionally, the code stream further includes: second indication information; correspondingly, the processing module 2704 is specifically configured to: if the second indication information indicates that the current reconstructed image block needs to be subjected to secondary upsampling processing, The third filter performs a second upsampling process on a partial boundary of the currently reconstructed image block according to another partially adjacent reconstructed image block in the desired adjacent reconstructed image block.

本申请提供的图像处理设备可以执行上述图24对应的图像处理方法以及该方法的可选方式，其实现原理和技术效果类似，此处不再赘述。The image processing device provided by the present application can perform the image processing method corresponding to FIG. 24 and the optional manner of the method, and the implementation principle and technical effects are similar, and details are not described herein again.

图28为本申请再一实施例提供的一种图像处理设备的结构示意图，如图28所示，该设备包括：解析模块2801，用于解析码流，以获取当前待重建图像块的编码信息和所述当前待重建图像块的编码方式；生成模块2802，用于根据所述编码信息生成当前待重建图像块的重建信号，并根据所述重建信号重建所述当前待重建图像块，得到当前重建图像块；解析模块2801，还用于若所述当前待重建图像块的编码方式为下采样编码方式，则从所述码流获取第一滤波器的标识信息；处理模块2803，用于通过所述标识信息标识的第一滤波器对所述当前重建图像块进行上采样处理。FIG. 28 is a schematic structural diagram of an image processing device according to another embodiment of the present disclosure. As shown in FIG. 28, the device includes: a parsing module 2801, configured to parse a code stream to obtain coding information of an image block to be reconstructed. And a coding mode of the current image block to be reconstructed; a generating module 2802, configured to generate a reconstruction signal of the current image block to be reconstructed according to the coded information, and reconstruct the current image block to be reconstructed according to the reconstruction signal, to obtain a current Reconstructing the image block; the parsing module 2801 is further configured to: if the encoding mode of the current image block to be reconstructed is a down sampling coding mode, obtain identification information of the first filter from the code stream; and the processing module 2803 is configured to pass The first filter identified by the identification information performs upsampling processing on the current reconstructed image block.

本申请提供的图像处理设备可以执行上述图25对应的图像处理方法以及该方法的可选方式，其实现原理和技术效果类似，此处不再赘述。The image processing device provided by the present application can perform the image processing method corresponding to FIG. 25 and the optional manner of the method, and the implementation principle and technical effects are similar, and details are not described herein again.

本申请提供一种图像处理设备，该设备包括：处理器和用于存储所述处理器的可执行指令的存储器；其中该处理器可以执行图14对应的图像处理方法以及该方法的可选方式。其实现原理和技术效果类似，此处不再赘述。The present application provides an image processing apparatus including: a processor and a memory for storing executable instructions of the processor; wherein the processor can execute the image processing method corresponding to FIG. 14 and an optional manner of the method . The implementation principle and technical effect are similar, and will not be described here.

本申请提供一种图像处理设备，该设备包括：处理器和用于存储所述处理器的可执行指令的存储器；其中该处理器可以执行图24对应的图像处理方法以及该方法的可选方式。其实现原理和技术效果类似，此处不再赘述。The present application provides an image processing apparatus including: a processor and a memory for storing executable instructions of the processor; wherein the processor can execute the image processing method corresponding to FIG. 24 and an optional manner of the method . The implementation principle and technical effect are similar, and will not be described here.

本申请提供一种图像处理设备，该设备包括：处理器和用于存储所述处理器的可执行指令的存储器；其中该处理器可以执行图25对应的图像处理方法以及该方法的可选方式。其实现原理和技术效果类似，此处不再赘述。The present application provides an image processing apparatus including: a processor and a memory for storing executable instructions of the processor; wherein the processor can execute the image processing method corresponding to FIG. 25 and an optional manner of the method . The implementation principle and technical effect are similar, and will not be described here.

图29为本申请提供的一种图像处理***的结构示意图，如图29所示，该***包括：上述解码端的图像处理设备2901，以及编码端的图像处理设备2902。FIG. 29 is a schematic structural diagram of an image processing system provided by the present application. As shown in FIG. 29, the system includes: an image processing device 2901 of the above decoding end, and an image processing device 2902 of the encoding end.

本申请提供的图像处理***包括的解码端的图像处理设备可以执行上述图14对应的图像处理方法以及该方法的可选方式，包括的编码端的图像处理设备可以执行上述图24对应的图像处理方法以及该方法的可选方式，其实现原理和技术效果类似，此处不再赘述。The image processing device of the decoding end of the image processing system provided by the present application may perform the image processing method corresponding to the above-mentioned FIG. 14 and an optional manner of the method, and the image processing device including the encoding end may perform the image processing method corresponding to FIG. 24 described above and The optional method and the technical effect of the method are similar, and are not described here.

图30为本申请提供的一种图像处理***的结构示意图，如图30所示，该***包括：上述解码端的图像处理设备3001，以及编码端的图像处理设备3002。FIG. 30 is a schematic structural diagram of an image processing system provided by the present application. As shown in FIG. 30, the system includes: an image processing device 3001 of the above decoding end, and an image processing device 3002 of the encoding end.

本申请提供的图像处理***包括的解码端的图像处理设备可以执行上述图14对应的图像处理方法以及该方法的可选方式，包括的编码端的图像处理设备可以执行上述图25对应的图像处理方法以及该方法的可选方式，其实现原理和技术效果类似，此处不再赘述。The image processing device of the decoding end of the image processing system provided by the present application may perform the image processing method corresponding to FIG. 14 and the optional method of the method, and the image processing device of the encoding end may perform the image processing method corresponding to FIG. 25 described above and The optional method and the technical effect of the method are similar, and are not described here.

Claims

一种图像处理方法，其特征在于，包括：An image processing method, comprising:

生成当前待编码图像块的重建信号，并根据所述重建信号重建所述当前待编码图像块，以得到当前重建图像块；Generating a reconstructed signal of the current image block to be encoded, and reconstructing the current image block to be encoded according to the reconstructed signal to obtain a current reconstructed image block;

若所述当前重建图像块的编码方式为下采样编码方式，则从至少两个候选滤波器中选择用于对所述当前重建图像块进行上采样处理的第一滤波器，并通过所述第一滤波器对所述当前重建图像块进行上采样处理。And if the coding mode of the current reconstructed image block is a downsampling coding mode, selecting a first filter for performing upsampling processing on the current reconstructed image block from the at least two candidate filters, and passing the A filter performs upsampling processing on the current reconstructed image block.
根据权利要求1所述的方法，其特征在于，所述从至少两个候选滤波器中选择用于对所述当前重建图像块进行上采样处理的第一滤波器，具体包括：The method according to claim 1, wherein the selecting, by the at least two candidate filters, the first filter for performing the upsampling process on the current reconstructed image block comprises:

根据所述当前重建图像块的纹理特征从至少两个候选滤波器中选择所述第一滤波器。The first filter is selected from at least two candidate filters according to a texture feature of the current reconstructed image block.
根据权利要求2所述的方法，其特征在于，所述根据所述当前重建图像块的纹理特征从至少两个候选滤波器中选择所述第一滤波器，包括：The method according to claim 2, wherein the selecting the first filter from at least two candidate filters according to a texture feature of the current reconstructed image block comprises:

根据预设映射关系和所述当前重建图像块的纹理特征选择所述第一滤波器，所述预设映射关系是包括所述当前重建图像块的纹理特征的预设纹理特征和包括所述第一滤波器的所述至少两个候选滤波器之间的映射关系。Selecting the first filter according to a preset mapping relationship and a texture feature of the current reconstructed image block, where the preset mapping relationship is a preset texture feature including a texture feature of the current reconstructed image block, and including the A mapping relationship between the at least two candidate filters of a filter.
根据权利要求1所述的方法，其特征在于，所述从至少两个候选滤波器中选择用于对所述当前重建图像块进行上采样处理的第一滤波器，具体包括：The method according to claim 1, wherein the selecting, by the at least two candidate filters, the first filter for performing the upsampling process on the current reconstructed image block comprises:

确定所述当前重建图像块的至少两个相邻重建图像块中每个相邻重建图像块与所述当前重建图像块的相似度，其中，所述至少两个相邻重建图像块进行上采样处理时对应至少两个第二滤波器，所述至少两个候选滤波器包括所述至少两个第二滤波器；Determining a similarity of each of the at least two adjacent reconstructed image blocks of the current reconstructed image block and the current reconstructed image block, wherein the at least two adjacent reconstructed image blocks are upsampled Processing at least two second filters, the at least two candidate filters including the at least two second filters;

从所述至少两个第二滤波器中选择与所述当前重建图像块相似度最高的相邻重建图像块对应的第二滤波器作为所述第一滤波器。And selecting, as the first filter, a second filter corresponding to the adjacent reconstructed image block having the highest similarity with the current reconstructed image block from the at least two second filters.
根据权利要求1所述的方法，其特征在于，所述从至少两个候选滤波器中选择用于对所述当前重建图像块进行上采样处理的第一滤波器包括：The method according to claim 1, wherein the selecting, by the at least two candidate filters, the first filter for performing upsampling processing on the current reconstructed image block comprises:

通过所述至少两个候选滤波器分别对所述当前重建图像块进行上采样处理，得到所述至少两个候选滤波器分别对应的上采样图像块；Performing upsampling processing on the current reconstructed image block by using the at least two candidate filters, respectively, to obtain an upsampled image block corresponding to the at least two candidate filters respectively;

分别计算所述至少两个候选滤波器对应的上采样图像块与所述当前重建图像块对应的原始图像块的误差；Calculating, respectively, an error of the upsampled image block corresponding to the at least two candidate filters and the original image block corresponding to the current reconstructed image block;

将最小误差对应的候选滤波器作为所述第一滤波器。A candidate filter corresponding to the minimum error is used as the first filter.
根据权利要求1-5任一项所述的方法，其特征在于，所述通过所述第一滤波器对所述当前重建图像块进行上采样处理，包括：The method according to any one of claims 1-5, wherein the performing upsampling processing on the current reconstructed image block by using the first filter comprises:

根据所述当前重建图像块进行上采样处理时所需的相邻重建图像块中的当前已完成重建的一部分相邻重建图像块的像素，通过所述第一滤波器对所述当前重建图像块进行一次上采样处理；Pixel of a portion of the adjacent reconstructed image block of the currently completed reconstruction in the adjacent reconstructed image block required for the up-sampling process in the current reconstructed image block, the current reconstructed image block being paired by the first filter Perform an upsampling process;

相应的，所述方法还包括：若所述所需的相邻重建图像块中的当前未完成重建的另一部分相邻重建图像块已完成重建，则通过第三滤波器，根据所述另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理，其中，所述当前重建图像块的所述部分边界与所述另一部分相邻重建图像块邻接。Correspondingly, the method further comprises: if another part of the adjacent reconstructed image block of the currently uncompleted reconstruction in the required adjacent reconstructed image block has been reconstructed, passing the third filter according to the other part The adjacent reconstructed image block performs a second upsampling process on a partial boundary of the current reconstructed image block, wherein the partial boundary of the current reconstructed image block is adjacent to the another partial adjacent reconstructed image block.
根据权利要求1-5任一项所述的方法，其特征在于，所述通过所述第一滤波器对所述当前重建图像块进行上采样处理，包括：The method according to any one of claims 1-5, wherein the performing upsampling processing on the current reconstructed image block by using the first filter comprises:

根据所述当前重建图像块进行上采样处理时所需的相邻重建图像块中的当前已完成重建的一部分相邻重建图像块的像素，通过所述第一滤波器对所述当前重建图像块进行一次上采样处理；Pixel of a portion of the adjacent reconstructed image block of the currently completed reconstruction in the adjacent reconstructed image block required for the up-sampling process in the current reconstructed image block, the current reconstructed image block being paired by the first filter Perform an upsampling process;

相应的，所述方法还包括：若所述当前重建图像块所处的当前图像的所有图像块均已完成重建，则通过第三滤波器，根据所述所需的相邻重建图像块中的另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理，其中，所述另一部分相邻重建图像块是在对所述当前重建图像块进行第一次上采样处理时未完成重建的图像块；所述当前重建图像块的所述部分边界与所述另一部分相邻重建图像块邻接。Correspondingly, the method further includes: if all the image blocks of the current image in which the current reconstructed image block is located have been reconstructed, by using a third filter, according to the desired adjacent reconstructed image block Another portion of the adjacent reconstructed image block performs a second upsampling process on a portion of the boundary of the current reconstructed image block, wherein the another portion of the adjacent reconstructed image block is subjected to the first upsampling of the current reconstructed image block The reconstructed image block is not completed at the time of processing; the partial boundary of the current reconstructed image block is contiguous with the other partially adjacent reconstructed image block.
根据权利要求6或7所述的方法，其特征在于，所述第三滤波器为所述第一滤波器。The method according to claim 6 or 7, wherein said third filter is said first filter.
根据权利要求6-8任一项所述的方法，其特征在于，所述通过第三滤波器，根据所述所需的相邻重建图像块中的另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理之前，还包括：The method according to any one of claims 6 to 8, wherein said third through said filter reconstructs an image block according to another portion of said desired adjacent reconstructed image block Before reconstructing the partial boundary of the image block for secondary upsampling, it also includes:

根据所述另一部分相邻重建图像块和所述当前重建图像块的部分边界判断是否对所述部分边界进行二次上采样处理；Determining whether to perform secondary upsampling processing on the partial boundary according to the partial boundary of the another partial adjacent reconstructed image block and the current reconstructed image block;

若确定对所述第一重建图像块的部分边界进行二次上采样处理，则通过所述第三滤波器，根据所述另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理。If it is determined that the partial boundary of the first reconstructed image block is subjected to the second upsampling process, the partial boundary of the currently reconstructed image block is performed according to the another partial adjacent reconstructed image block by using the third filter Secondary upsampling process.
根据权利要求1-9任一项所述的方法，其特征在于，还包括：The method of any of claims 1-9, further comprising:

生成码流，所述码流包括：所述第一滤波器的标识信息。Generating a code stream, the code stream comprising: identification information of the first filter.
根据权利要求1-9任一项所述的方法，其特征在于，还包括：The method of any of claims 1-9, further comprising:

生成码流，所述码流包括：第一指示信息，所述第一指示信息用于指示如何从至少两个候选滤波器选择对所述当前重建图像块进行上采样处理时使用的滤波器。Generating a code stream, the code stream comprising: first indication information, the first indication information being used to indicate how to select a filter used when performing upsampling processing on the current reconstructed image block from at least two candidate filters.
根据权利要求6-9任一所述的方法，其特征在于，还包括：The method according to any one of claims 6-9, further comprising:

生成码流，所述码流包括：第二指示信息，其中，所述第二指示信息用于指示所述解码端是否需要对所述当前重建图像块进行二次上采样处理。And generating a code stream, where the code stream includes: second indication information, where the second indication information is used to indicate whether the decoding end needs to perform secondary upsampling processing on the current reconstructed image block.
一种图像处理方法，其特征在于，包括：An image processing method, comprising:

解析码流，以获取当前待重建图像块的编码信息和所述当前待重建图像块的编码方式；Parsing the code stream to obtain the coding information of the current image block to be reconstructed and the coding mode of the current image block to be reconstructed;

根据所述当前待重建图像块的编码信息生成当前待重建图像块的重建信号；Generating a reconstruction signal of the current image block to be reconstructed according to the encoding information of the current image block to be reconstructed;

根据所述重建信号重建当前待重建图像块，得到当前重建图像块；Reconstructing the current image block to be reconstructed according to the reconstructed signal to obtain a current reconstructed image block;

若所述当前待重建图像块的编码方式为下采样编码方式，则根据从所述码流获取的第一指示信息选择用于对所述当前重建图像块进行上采样处理的第一滤波器，其中，所述第一指示信息用于指示如何从至少两个候选滤波器选择对所述当前重建图像块进行上采样处理时使用的滤波器；If the encoding mode of the current image block to be reconstructed is a down sampling coding mode, selecting a first filter for performing upsampling processing on the current reconstructed image block according to the first indication information acquired from the code stream, The first indication information is used to indicate how to select a filter used when performing upsampling processing on the current reconstructed image block from at least two candidate filters;

通过所述第一滤波器对所述当前重建图像块进行上采样处理。The current reconstructed image block is subjected to upsampling processing by the first filter.
根据权利要求13所述的方法，其特征在于，所述第一指示信息用于指示根据当前重建图像块的纹理特征从所述至少两个候选滤波器选择对所述当前重建图像块进行上采样处理时使用的滤波器；The method according to claim 13, wherein the first indication information is used to indicate that the current reconstructed image block is upsampled from the at least two candidate filter selections according to a texture feature of a current reconstructed image block. a filter used in processing;

所述根据从所述码流获取的第一指示信息选择用于对所述当前重建图像块进行上采样处理的第一滤波器，包括：And selecting, by the first indication information acquired from the code stream, a first filter for performing upsampling processing on the current reconstructed image block, including:

根据预设映射关系和所述当前重建图像块的纹理特征选择所述第一滤波器，所述预设映射关系是包括所述当前重建图像块的纹理特征的预设纹理特征和包括所述第一滤波器的所述至少两个候选滤波器之间的映射关系。Selecting the first filter according to a preset mapping relationship and a texture feature of the current reconstructed image block, where the preset mapping relationship is a preset texture feature including a texture feature of the current reconstructed image block, and including the A mapping relationship between the at least two candidate filters of a filter.
根据权利要求13所述的方法，其特征在于，所述第一指示信息用于指示根据当前重建图像块的相邻重建图像块从所述至少两个候选滤波器选择对所述当前重建图像块进行上采样处理时使用的滤波器；The method according to claim 13, wherein the first indication information is used to indicate that the currently reconstructed image block is selected from the at least two candidate filters according to adjacent reconstructed image blocks of the current reconstructed image block. a filter used in the upsampling process;

所述根据从所述码流获取的第一指示信息选择用于对所述当前重建图像块进行上采样处理的第一滤波器，包括：And selecting, by the first indication information acquired from the code stream, a first filter for performing upsampling processing on the current reconstructed image block, including:

确定至少两个相邻重建图像块中每个相邻重建图像块与所述当前重建图像块的相似度，所述至少两个相邻重建图像块进行上采样处理时对应至少两个第二滤波器，所述至少两个候选滤波器包括所述至少两个第二滤波器；Determining a similarity between each of the at least two adjacent reconstructed image blocks and the current reconstructed image block, where the at least two adjacent reconstructed image blocks are subjected to upsampling processing corresponding to at least two second filters The at least two candidate filters include the at least two second filters;

从所述至少两个第二滤波器中选择相似度最高的相邻重建图像块对应的第二滤波器作为所述第一滤波器。A second filter corresponding to the adjacent reconstructed image block having the highest similarity is selected from the at least two second filters as the first filter.
根据权利要求13-15任一项所述的方法，其特征在于，所述通过所述第一滤波器对所述当前重建图像块进行上采样处理，包括：The method according to any one of claims 13 to 15, wherein the upsampling processing of the current reconstructed image block by the first filter comprises:

根据所述当前重建图像块进行上采样处理时所需的相邻重建图像块中的当前已完成重建的一部分相邻重建图像块的像素，通过所述第一滤波器对所述当前重建图像块进行一次上采样处理；Pixel of a portion of the adjacent reconstructed image block of the currently completed reconstruction in the adjacent reconstructed image block required for the up-sampling process in the current reconstructed image block, the current reconstructed image block being paired by the first filter Perform an upsampling process;

相应的，所述方法还包括：若所述所需的相邻重建图像块中的当前未完成重建的另一部分相邻重建图像块已完成重建，则通过第三滤波器，根据所述另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理，其中，所述当前重建图像块的所述部分边界与所述另一部分相邻重建图像块邻接。Correspondingly, the method further comprises: if another part of the adjacent reconstructed image block of the currently uncompleted reconstruction in the required adjacent reconstructed image block has been reconstructed, passing the third filter according to the other part The adjacent reconstructed image block performs a second upsampling process on a partial boundary of the current reconstructed image block, wherein the partial boundary of the current reconstructed image block is adjacent to the another partial adjacent reconstructed image block.
根据权利要求13-15任一项所述的方法，其特征在于，所述通过所述第一滤波器对所述当前重建图像块进行上采样处理，包括：The method according to any one of claims 13 to 15, wherein the upsampling processing of the current reconstructed image block by the first filter comprises:

根据所述当前重建图像块进行上采样处理时所需的相邻重建图像块中的当前已完成重建的一部分相邻重建图像块的像素，通过所述第一滤波器对所述当前重建图像块进行一次上采样处理；Pixel of a portion of the adjacent reconstructed image block of the currently completed reconstruction in the adjacent reconstructed image block required for the up-sampling process in the current reconstructed image block, the current reconstructed image block being paired by the first filter Perform an upsampling process;

相应的，所述方法还包括：若所述当前重建图像块所处的当前图像的所有图像块均已完成重建，则通过第三滤波器，根据所述所需的相邻重建图像块中的另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理，其中，所述另一部分相邻重建图像块是在对所述当前重建图像块进行第一次上采样处理时未完成重建的图像块；所述当前重建图像块的所述部分边界与所述另一部分相邻重建图像块邻接。Correspondingly, the method further includes: if all the image blocks of the current image in which the current reconstructed image block is located have been reconstructed, by using a third filter, according to the desired adjacent reconstructed image block Another portion of the adjacent reconstructed image block performs a second upsampling process on a portion of the boundary of the current reconstructed image block, wherein the another portion of the adjacent reconstructed image block is subjected to the first upsampling of the current reconstructed image block The reconstructed image block is not completed at the time of processing; the partial boundary of the current reconstructed image block is contiguous with the other partially adjacent reconstructed image block.
根据权利要求16或17所述的方法，其特征在于，所述第三滤波器为所述第一滤波器。The method according to claim 16 or 17, wherein said third filter is said first filter.
根据权利要求16-18任一项所述的方法，其特征在于，所述通过第三滤波器，根据所述所需的相邻重建图像块中的另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理之前，还包括：The method according to any one of claims 16 to 18, wherein said third through said filter reconstructs an image block according to another portion of said desired adjacent reconstructed image block Before reconstructing the partial boundary of the image block for secondary upsampling, it also includes:

根据所述另一部分相邻重建图像块和所述当前重建图像块的部分边界判断是否对所述部分边界进行二次上采样处理；Determining whether to perform secondary upsampling processing on the partial boundary according to the partial boundary of the another partial adjacent reconstructed image block and the current reconstructed image block;

若确定对所述第一重建图像块的部分边界进行二次上采样处理，则通过所述第三滤波器，根据所述另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理。If it is determined that the partial boundary of the first reconstructed image block is subjected to the second upsampling process, the partial boundary of the currently reconstructed image block is performed according to the another partial adjacent reconstructed image block by using the third filter Secondary upsampling process.
根据权利要求16-18任一项所述的方法，其特征在于，所述码流还包括：第二指示信息；The method according to any one of claims 16 to 18, wherein the code stream further comprises: second indication information;

相应的，所述通过第三滤波器，根据所述所需的相邻重建图像块中的另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理，包括：Correspondingly, the third filter is used to perform a second upsampling process on a part of the boundary of the currently reconstructed image block according to another part of the adjacent reconstructed image block in the required adjacent reconstructed image block, including:

若所述第二指示信息指示需要对所述当前重建图像块进行二次上采样处理，则通过所述第三滤波器，根据在所述所需的相邻重建图像块中的另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理。And if the second indication information indicates that the current reconstructed image block needs to be subjected to the second upsampling process, by using the third filter, according to another part of the required adjacent reconstructed image block adjacent to The reconstructed image block performs a second upsampling process on a portion of the boundary of the current reconstructed image block.
一种图像处理方法，其特征在于，包括：An image processing method, comprising:

解析码流，以获取当前待重建图像块的编码信息和所述当前待重建图像块的编码方式；Parsing the code stream to obtain the coding information of the current image block to be reconstructed and the coding mode of the current image block to be reconstructed;

根据所述编码信息生成当前待重建图像块的重建信号，并根据所述重建信号重建所述当前待重建图像块，得到当前重建图像块；Generating a reconstructed signal of the current image block to be reconstructed according to the coded information, and reconstructing the current image block to be reconstructed according to the reconstructed signal to obtain a current reconstructed image block;

若所述当前待重建图像块的编码方式为下采样编码方式，则从所述码流获取第一滤波器的标识信息，并通过所述标识信息标识的所述第一滤波器对所述当前重建图像块进行上采样处理。And if the coding mode of the current image block to be reconstructed is a downsampling coding mode, obtaining identification information of the first filter from the code stream, and using the first filter identified by the identifier information to the current The image block is reconstructed for upsampling processing.
一种图像处理设备，其特征在于，包括：An image processing device, comprising:

生成模块，用于生成当前待编码图像块的重建信号，并根据所述重建信号重建所述当前待编码图像块，以得到当前重建图像块；a generating module, configured to generate a reconstructed signal of the current image block to be encoded, and reconstruct the current image block to be encoded according to the reconstructed signal to obtain a current reconstructed image block;

选择模块，用于若所述当前重建图像块的编码方式为下采样编码方式，则从至少两个候选滤波器中选择用于对所述当前重建图像块进行上采样处理的第一滤波器；a selection module, configured to: if the encoding mode of the current reconstructed image block is a downsampling coding mode, select a first filter for performing upsampling processing on the current reconstructed image block from at least two candidate filters;

处理模块，用于通过所述第一滤波器对所述当前重建图像块进行上采样处理。And a processing module, configured to perform upsampling processing on the current reconstructed image block by using the first filter.
根据权利要求22所述的设备，其特征在于，The device according to claim 22, characterized in that

所述选择模块，具体用于根据所述当前重建图像块的纹理特征从至少两个候选滤波器中选择所述第一滤波器。The selecting module is specifically configured to select the first filter from at least two candidate filters according to a texture feature of the current reconstructed image block.
根据权利要求23所述的设备，其特征在于，The device according to claim 23, wherein

所述选择模块，具体用于根据预设映射关系和所述当前重建图像块的纹理特征选择所述第一滤波器，所述预设映射关系是包括所述当前重建图像块的纹理特征的预设纹理特征和包括所述第一滤波器的所述至少两个候选滤波器之间的映射关系。The selecting module is specifically configured to select the first filter according to a preset mapping relationship and a texture feature of the current reconstructed image block, where the preset mapping relationship is a pre-pattern including a texture feature of the current reconstructed image block. A mapping relationship between the texture feature and the at least two candidate filters including the first filter is set.
根据权利要求22所述的设备，其特征在于，所述选择模块具体用于：The device according to claim 22, wherein the selection module is specifically configured to:

确定所述当前重建图像块的至少两个相邻重建图像块中每个相邻重建图像块与所述当前重建图像块的相似度，其中，所述至少两个相邻重建图像块进行上采样处理时对应至少两个第二滤波器，所述至少两个候选滤波器包括所述至少两个第二滤波器；Determining a similarity of each of the at least two adjacent reconstructed image blocks of the current reconstructed image block and the current reconstructed image block, wherein the at least two adjacent reconstructed image blocks are upsampled Processing at least two second filters, the at least two candidate filters including the at least two second filters;

从所述至少两个第二滤波器中选择与所述当前重建图像块相似度最高的相邻重建图像块对应的第二滤波器作为所述第一滤波器。And selecting, as the first filter, a second filter corresponding to the adjacent reconstructed image block having the highest similarity with the current reconstructed image block from the at least two second filters.
根据权利要求22所述的设备，其特征在于，所述选择模块具体用于：The device according to claim 22, wherein the selection module is specifically configured to:

通过所述至少两个候选滤波器分别对所述当前重建图像块进行上采样处理，得到所述至少两个候选滤波器分别对应的上采样图像块；Performing upsampling processing on the current reconstructed image block by using the at least two candidate filters, respectively, to obtain an upsampled image block corresponding to the at least two candidate filters respectively;

分别计算所述至少两个候选滤波器对应的上采样图像块与所述当前重建图像块对应的原始图像块的误差；Calculating, respectively, an error of the upsampled image block corresponding to the at least two candidate filters and the original image block corresponding to the current reconstructed image block;

将最小误差对应的候选滤波器作为所述第一滤波器。A candidate filter corresponding to the minimum error is used as the first filter.
根据权利要求22-26任一项所述的设备，其特征在于，Apparatus according to any one of claims 22-26, wherein

所述处理模块，具体用于根据所述当前重建图像块进行上采样处理时所需的相邻重建图像块中的当前已完成重建的一部分相邻重建图像块的像素，通过所述第一滤波器对所述当前重建图像块进行一次上采样处理；The processing module is specifically configured to: according to the pixel of a part of the adjacent reconstructed image block that is currently reconstructed in the adjacent reconstructed image block required for performing the upsampling process according to the current reconstructed image block, by using the first filtering Performing an upsampling process on the current reconstructed image block;

所述处理模块，还用于若所述所需的相邻重建图像块中的当前未完成重建的另一部分相邻重建图像块已完成重建，则通过第三滤波器，根据所述另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理，其中，所述当前重建图像块的所述部分边界与所述另一部分相邻重建图像块邻接。The processing module is further configured to: if another part of the adjacent reconstructed image block of the currently uncompleted reconstruction in the required adjacent reconstructed image block has been reconstructed, pass the third filter according to the another part of the phase The neighbor reconstructed image block performs a second upsampling process on a partial boundary of the current reconstructed image block, wherein the partial boundary of the current reconstructed image block is adjacent to the another partial adjacent reconstructed image block.
根据权利要求22-26任一项所述的设备，其特征在于，Apparatus according to any one of claims 22-26, wherein

所述处理模块，具体用于根据所述当前重建图像块进行上采样处理时所需的相邻重建图像块中的当前已完成重建的一部分相邻重建图像块的像素，通过所述第一滤波器对所述当前重建图像块进行一次上采样处理；The processing module is specifically configured to: according to the pixel of a part of the adjacent reconstructed image block that is currently reconstructed in the adjacent reconstructed image block required for performing the upsampling process according to the current reconstructed image block, by using the first filtering Performing an upsampling process on the current reconstructed image block;

所述处理模块，还用于若所述当前重建图像块所处的当前图像的所有图像块均已完成重建，则通过第三滤波器，根据所述所需的相邻重建图像块中的另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理，其中，所述另一部分相邻重建图像块是在对所述当前重建图像块进行第一次上采样处理时未完成重建的图像块；所述当前重建图像块的所述部分边界与所述另一部分相邻重建图像块邻接。The processing module is further configured to: if all the image blocks of the current image in which the current reconstructed image block is located have been reconstructed, pass the third filter, according to another one of the required adjacent reconstructed image blocks Part of the adjacent reconstructed image block performs a second upsampling process on a partial boundary of the current reconstructed image block, wherein the another partial adjacent reconstructed image block is subjected to the first upsampling process on the current reconstructed image block The reconstructed image block is not completed; the partial boundary of the current reconstructed image block is contiguous with the other partially adjacent reconstructed image block.
根据权利要求27或28所述的设备，其特征在于，所述第三滤波器为所述第一滤波器。The apparatus according to claim 27 or 28, wherein said third filter is said first filter.
根据权利要求27-29任一项所述的设备，其特征在于，还包括：The device according to any one of claims 27-29, further comprising:

判断模块，用于根据所述另一部分相邻重建图像块和所述当前重建图像块的部分边界判断是否对所述部分边界进行二次上采样处理；a determining module, configured to determine, according to the partial boundary of the another partial adjacent reconstructed image block and the current reconstructed image block, whether to perform secondary upsampling processing on the partial boundary;

所述选择模块，具体用于若所述判断模块确定对所述第一重建图像块的部分边界进行二次上采样处理，则通过所述第三滤波器，根据所述另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理。The selecting module is specifically configured to: if the determining module determines to perform a second upsampling process on a part of the boundary of the first reconstructed image block, use the third filter to reconstruct an image according to the another part of the neighboring image The block performs a second upsampling process on a portion of the boundary of the current reconstructed image block.
根据权利要求22-30任一项所述的设备，其特征在于，Apparatus according to any of claims 22-30, wherein

所述生成模块，还用于生成码流，所述码流包括：所述第一滤波器的标识信息。The generating module is further configured to generate a code stream, where the code stream includes: identifier information of the first filter.
根据权利要求22-30任一项所述的设备，其特征在于，Apparatus according to any of claims 22-30, wherein

所述生成模块，还用于生成码流，所述码流包括：第一指示信息，所述第一指示信息用于指示如何从至少两个候选滤波器选择对所述当前重建图像块进行上采样处理时使用的滤波器。The generating module is further configured to generate a code stream, where the code stream includes: first indication information, where the first indication information is used to indicate how to select the current reconstructed image block from at least two candidate filter selections. The filter used in the sampling process.
根据权利要求27-30任一项所述的设备，其特征在于，Apparatus according to any one of claims 27-30, wherein

所述生成模块，还用于生成码流，所述码流包括：第二指示信息，其中，所述第二指示信息用于指示所述解码端是否需要对所述当前重建图像块进行二次上采样处理。The generating module is further configured to generate a code stream, where the code stream includes: second indication information, where the second indication information is used to indicate whether the decoding end needs to perform the current reconstructed image block twice. Upsampling processing.
一种图像处理设备，其特征在于，包括：An image processing device, comprising:

解析模块，用于解析码流，以获取当前待重建图像块的编码信息和所述当前待重建图像块的编码方式；a parsing module, configured to parse the code stream, to obtain encoding information of the current image block to be reconstructed and an encoding mode of the current image block to be reconstructed;

生成模块，用于根据所述当前待重建图像块的编码信息生成当前待重建图像块的重建信号，并根据所述重建信号重建当前待重建图像块，得到当前重建图像块；a generating module, configured to generate a reconstructed signal of the current image block to be reconstructed according to the encoding information of the current image block to be reconstructed, and reconstruct a current image block to be reconstructed according to the reconstructed signal to obtain a current reconstructed image block;

选择模块，用于若所述当前待重建图像块的编码方式为下采样编码方式，则根据从所述码流获取的第一指示信息选择用于对所述当前重建图像块进行上采样处理的第一滤波器，其中，所述第一指示信息用于指示如何从至少两个候选滤波器选择对所述当前重建图像块进行上采样处理时使用的滤波器；a selection module, configured to select, according to the first indication information acquired from the code stream, to perform upsampling processing on the current reconstructed image block, if the encoding mode of the current image block to be reconstructed is a downsampling coding mode a first filter, wherein the first indication information is used to indicate how to select a filter used when performing upsampling processing on the current reconstructed image block from at least two candidate filters;

处理模块，用于通过所述第一滤波器对所述当前重建图像块进行上采样处理。And a processing module, configured to perform upsampling processing on the current reconstructed image block by using the first filter.
根据权利要求34所述的设备，其特征在于，所述第一指示信息用于指示根据当前重建图像块的纹理特征从所述至少两个候选滤波器选择对所述当前重建图像块进行上采样处理时使用的滤波器；The device according to claim 34, wherein the first indication information is used to indicate that the current reconstructed image block is upsampled from the at least two candidate filter selections according to a texture feature of a current reconstructed image block. a filter used in processing;

所述选择模块，具体用于根据预设映射关系和所述当前重建图像块的纹理特征选择所述第一滤波器，所述预设映射关系是包括所述当前重建图像块的纹理特征的预设纹理特征和包括所述第一滤波器的所述至少两个候选滤波器之间的映射关系。The selecting module is specifically configured to select the first filter according to a preset mapping relationship and a texture feature of the current reconstructed image block, where the preset mapping relationship is a pre-pattern including a texture feature of the current reconstructed image block. A mapping relationship between the texture feature and the at least two candidate filters including the first filter is set.
根据权利要求34所述的设备，其特征在于，所述第一指示信息用于指示根据当前重建图像块的相邻重建图像块从所述至少两个候选滤波器选择对所述当前重建图像块进行上采样处理时使用的滤波器；The device according to claim 34, wherein the first indication information is used to indicate that the currently reconstructed image block is selected from the at least two candidate filters according to adjacent reconstructed image blocks of the current reconstructed image block. a filter used in the upsampling process;

所述选择模块具体用于：The selection module is specifically configured to:

确定至少两个相邻重建图像块中每个相邻重建图像块与所述当前重建图像块的相似度，所述至少两个相邻重建图像块进行上采样处理时对应至少两个第二滤波器，所述至少两个候选滤波器包括所述至少两个第二滤波器；Determining a similarity between each of the at least two adjacent reconstructed image blocks and the current reconstructed image block, where the at least two adjacent reconstructed image blocks are subjected to upsampling processing corresponding to at least two second filters The at least two candidate filters include the at least two second filters;

从所述至少两个第二滤波器中选择相似度最高的相邻重建图像块对应的第二滤波器作为所述第一滤波器。A second filter corresponding to the adjacent reconstructed image block having the highest similarity is selected from the at least two second filters as the first filter.
根据权利要求34-36任一项所述的设备，其特征在于，Apparatus according to any of claims 34-36, wherein

所述处理模块，具体用于根据所述当前重建图像块进行上采样处理时所需的相邻重建图像块中的当前已完成重建的一部分相邻重建图像块的像素，通过所述第一滤波器对所述当前重建图像块进行一次上采样处理；The processing module is specifically configured to: according to the pixel of a part of the adjacent reconstructed image block that is currently reconstructed in the adjacent reconstructed image block required for performing the upsampling process according to the current reconstructed image block, by using the first filtering Performing an upsampling process on the current reconstructed image block;

所述处理模块，还用于若所述所需的相邻重建图像块中的当前未完成重建的另一部分相邻重建图像块已完成重建，则通过第三滤波器，根据所述另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理，其中，所述当前重建图像块的所述部分边界与所述另一部分相邻重建图像块邻接。The processing module is further configured to: if another part of the adjacent reconstructed image block of the currently uncompleted reconstruction in the required adjacent reconstructed image block has been reconstructed, pass the third filter according to the another part of the phase The neighbor reconstructed image block performs a second upsampling process on a partial boundary of the current reconstructed image block, wherein the partial boundary of the current reconstructed image block is adjacent to the another partial adjacent reconstructed image block.
根据权利要求34-36任一项所述的设备，其特征在于，Apparatus according to any of claims 34-36, wherein

所述处理模块，具体用于根据所述当前重建图像块进行上采样处理时所需的相邻重建图像块中的当前已完成重建的一部分相邻重建图像块的像素，通过所述第一滤波器对所述当前重建图像块进行一次上采样处理；The processing module is specifically configured to: according to the pixel of a part of the adjacent reconstructed image block that is currently reconstructed in the adjacent reconstructed image block required for performing the upsampling process according to the current reconstructed image block, by using the first filtering Performing an upsampling process on the current reconstructed image block;

所述处理模块，还用于若所述当前重建图像块所处的当前图像的所有图像块均已完成重建，则通过第三滤波器，根据所述所需的相邻重建图像块中的另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理，其中，所述另一部分相邻重建图像块是在对所述当前重建图像块进行第一次上采样处理时未完成重建的图像块；所述当前重建图像块的所述部分边界与所述另一部分相邻重建图像块邻接。The processing module is further configured to: if all the image blocks of the current image in which the current reconstructed image block is located have been reconstructed, pass the third filter, according to another one of the required adjacent reconstructed image blocks Part of the adjacent reconstructed image block performs a second upsampling process on a partial boundary of the current reconstructed image block, wherein the another partial adjacent reconstructed image block is subjected to the first upsampling process on the current reconstructed image block The reconstructed image block is not completed; the partial boundary of the current reconstructed image block is contiguous with the other partially adjacent reconstructed image block.
根据权利要求37或38所述的设备，其特征在于，所述第三滤波器为所述第一滤波器。The apparatus according to claim 37 or 38, wherein said third filter is said first filter.
根据权利要求37-39任一项所述的设备，其特征在于，还包括：The device according to any one of claims 37 to 39, further comprising:

判断模块，用于根据所述另一部分相邻重建图像块和所述当前重建图像块的部分边界判断是否对所述部分边界进行二次上采样处理；a determining module, configured to determine, according to the partial boundary of the another partial adjacent reconstructed image block and the current reconstructed image block, whether to perform secondary upsampling processing on the partial boundary;

所述处理模块，具体用于若所述判断模块确定对所述第一重建图像块的部分边界进行二次上采样处理，则通过所述第三滤波器，根据所述另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理。The processing module is specifically configured to: if the determining module determines to perform a second upsampling process on a partial boundary of the first reconstructed image block, use the third filter to reconstruct an image according to the another portion of the neighboring image The block performs a second upsampling process on a portion of the boundary of the current reconstructed image block.
根据权利要求37-39任一项所述的设备，其特征在于，所述码流还包括：第二指示信息；The device according to any one of claims 37 to 39, wherein the code stream further comprises: second indication information;

所述处理模块，具体用于若所述第二指示信息指示需要对所述当前重建图像块进行二次上采样处理，则通过所述第三滤波器，根据在所述所需的相邻重建图像块中的另一部分相邻重建图像块对所述当前重建图像块的部分边界进行二次上采样处理。The processing module is specifically configured to: if the second indication information indicates that the current reconstructed image block needs to be subjected to secondary upsampling processing, pass the third filter, according to the required adjacent reconstruction Another portion of the adjacent reconstructed image block in the image block performs a second upsampling process on a portion of the boundary of the current reconstructed image block.
一种图像处理设备，其特征在于，包括：An image processing device, comprising:

解析模块，用于解析码流，以获取当前待重建图像块的编码信息和所述当前待重建图像块的编码方式；a parsing module, configured to parse the code stream, to obtain encoding information of the current image block to be reconstructed and an encoding mode of the current image block to be reconstructed;

生成模块，用于根据所述编码信息生成当前待重建图像块的重建信号，并根据所述重建信号重建所述当前待重建图像块，得到当前重建图像块；a generating module, configured to generate a reconstructed signal of the current image block to be reconstructed according to the encoding information, and reconstruct the current image block to be reconstructed according to the reconstructed signal to obtain a current reconstructed image block;

所述解析模块，还用于若所述当前待重建图像块的编码方式为下采样编码方式，则从所述码流获取第一滤波器的标识信息；The parsing module is further configured to: if the coding mode of the current image block to be reconstructed is a downsampling coding mode, obtain identification information of the first filter from the code stream;

处理模块，用于通过所述标识信息标识的所述第一滤波器对所述当前重建图像块进行上采样处理。And a processing module, configured to perform upsampling processing on the current reconstructed image block by using the first filter identified by the identifier information.
一种图像处理***，其特征在于，包括：如权利要求22至33任一项所述的图像处理设备，以及如权利要求34至41所述的图像处理设备。An image processing system comprising: the image processing apparatus according to any one of claims 22 to 33, and the image processing apparatus according to claims 34 to 41.
一种图像处理***，其特征在于，包括：如权利要求22至33任一项所述的图像处理设备，以及如权利要求42所述的图像处理设备。An image processing system comprising: the image processing apparatus according to any one of claims 22 to 33, and the image processing apparatus according to claim 42.