WO2019091196A1

WO2019091196A1 - Image processing method and apparatus

Info

Publication number: WO2019091196A1
Application number: PCT/CN2018/103351
Authority: WO
Inventors: 李蒙; 陈海; 郑建铧; 余全合
Original assignee: 华为技术有限公司
Priority date: 2017-11-13
Filing date: 2018-08-30
Publication date: 2019-05-16
Also published as: CN109785239A; CN109785239B

Abstract

Provided are an image processing method and apparatus. The method comprises: acquiring a first image; processing the first image according to a spatial filter function so as to generate a first base layer; executing a subtraction operation or a division operation on the first image and the first base layer so as to generate a first detail layer; according to the first image, determining a detail layer adjustment function, wherein an independent variable of the detail layer adjustment function is a nonlinear signal of the first image; according to the detail layer adjustment function, adjusting the first detail layer so as to acquire a second detail layer; and executing an addition operation or a multiplication operation on the first base layer and the second detail layer so as to generate a second image. By means of establishing a detail layer adjustment function with regard to a nonlinear signal of an image and adjusting a detail layer of the image by means of the detail layer adjustment function, an image quality problem that can be perceived by human eyes is prevented from appearing in the adjusted image.

Description

图像处理的方法和装置Image processing method and device

本申请要求于2017年11月13日提交中国专利局、申请号为201711112510.8、申请名称为“图像处理的方法和装置”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。The present application claims the priority of the Chinese Patent Application, filed on Jan. 13, 2017, the filing date of

技术领域Technical field

本申请涉及图像处理领域，并且更具体地，涉及一种图像处理的方法和装置。The present application relates to the field of image processing and, more particularly, to a method and apparatus for image processing.

背景技术Background technique

在图像处理领域，通常会通过空间滤波函数对图像进行滤波处理，从而获得图像中基本层信息，通过图像信息和图像基本层信息进行处理，获取图像的细节层(纹理)信息。In the field of image processing, the image is usually filtered by a spatial filter function to obtain the basic layer information in the image, and processed by the image information and the image base layer information to obtain the detail layer (texture) information of the image.

在获取图像的基本层(中、低频信息)时，空间滤波函数会对图像进行处理，获取图像的基本层(中、低频信息)，通过图像与图像基本层的减法、或除法操作，将图像进行拆分，获取图像的细节层(图像的中、高频信息)，并对细节层进行调整操作，以提高图像的对比度、清晰度，最终将经过调整操作的细节层与基本层进行减法或乘法的叠加，并输出处理后的图像。When acquiring the basic layer (middle and low frequency information) of the image, the spatial filtering function processes the image, acquires the basic layer of the image (medium and low frequency information), and performs image subtraction or division operation of the image and image base layer. Splitting, obtaining the detail layer of the image (medium and high frequency information of the image), and adjusting the detail layer to improve the contrast and sharpness of the image, and finally subtracting the detail layer and the base layer of the adjusted operation or Multiply the multiplication and output the processed image.

现有常见的图像调整方法，该方法通过一个固定的调整系数对图像的细节层进行调整，即，对图像的各个像素点均进行相同程度的调整。There is a common image adjustment method which adjusts the detail layer of an image by a fixed adjustment coefficient, that is, the same degree of adjustment is performed on each pixel of the image.

对于高动态范围(High Dynamic Range，HDR)图像，其光电转移函数不同于传统的标准动态范围(Stand Dynamic Range，SDR)图像的光电转移函数(Gamma函数)，在通过上述调整方法对HDR图像进行调整操作之后，如果使用较大的调整值，会导致图像中的部分亮度范围的像素的韦伯weber分数超过施赖伯Schreiber阈值限制，如果使用较小的调整值又不能达到高质量提升图像对比度、清晰度的目的。Schreiber阈值与人眼的视觉特性相关联，当像素的韦伯weber分数超过施赖伯Schreiber阈值时，图像中就会出现人眼能够感知的图像质量问题，进而影响人眼的视觉体验。For high dynamic range (HDR) images, the photoelectric transfer function is different from the traditional standard dynamic range (SDR) image photoelectric transfer function (Gamma function), and the HDR image is performed by the above adjustment method. After the adjustment operation, if a larger adjustment value is used, the Weber weber score of the pixel in the brightness range of the image exceeds the Schreiber threshold of the Schreiber threshold. If a small adjustment value is used, the image contrast and sharpness cannot be improved. the goal of. The Schreiber threshold is related to the visual characteristics of the human eye. When the Weber weber score of the pixel exceeds the Schreiber threshold, the image quality problem that the human eye can perceive appears in the image, which affects the visual experience of the human eye.

发明内容Summary of the invention

本申请提供一种图像处理的方法和装置，通过建立关于图像的非线性信号的细节层调整函数，并通过该细节层调整函数对图像的细节层进行调整，能够避免由于细节层调整系数的选取不当，导致调整后的图像中出现人眼能够感知的图像质量问题(例如，由于调整不足造成的图像对比度、清晰度不足的问题)，进而影响人眼的视觉体验。The present application provides a method and apparatus for image processing. By establishing a detail layer adjustment function for a nonlinear signal of an image, and adjusting the detail layer of the image by the detail layer adjustment function, the selection of the adjustment coefficient of the detail layer can be avoided. Improper, resulting in image quality problems that the human eye can perceive in the adjusted image (for example, image contrast due to insufficient adjustment, insufficient clarity), thereby affecting the visual experience of the human eye.

第一方面，提供了一种图像处理的方法，包括：获取第一图像；根据空间滤波函数对所述第一图像进行处理，以生成第一基本层；对所述第一图像与所述第一基本层进行减法操作或除法操作，以生成第一细节层；根据所述第一图像，确定细节层调整函数，所述细节层调整函数的自变量为所述第一图像的非线性信号；根据所述细节层调整函数，对所述第一细节层进行调整，以获取第二细节层；对所述第一基本层与所述第二细节层进行加法操作或乘法操作，以生成第二图像。In a first aspect, a method of image processing is provided, comprising: acquiring a first image; processing the first image according to a spatial filter function to generate a first base layer; and the first image and the first image a base layer performs a subtraction operation or a division operation to generate a first detail layer; and according to the first image, a detail layer adjustment function is determined, wherein an independent variable of the detail layer adjustment function is a nonlinear signal of the first image; Adjusting the first detail layer to obtain a second detail layer according to the detail layer adjustment function; performing an addition operation or a multiplication operation on the first base layer and the second detail layer to generate a second image.

可选地，所述空间滤波函数包括以下滤波函数中的至少一项：高斯滤波函数、双边滤波函数或指导滤波函数。Optionally, the spatial filtering function comprises at least one of the following filtering functions: a Gaussian filtering function, a bilateral filtering function or a guiding filtering function.

因此，通过建立关于图像的非线性信号的细节层调整函数，即将作用在图像中每一像素点的细节层调整系数与对应像素点的非线性信号进行关联，并通过该细节层调整函数对图像的细节层进行调整，使得能够根据对应像素点的非线性信号，灵活地对细节层中对应像素点进行调整，避免由于细节层调整系数的选取不当，导致调整后的图像中出现人眼能够感知的图像质量问题，进而影响人眼的视觉体验。Therefore, by establishing a detail layer adjustment function for the nonlinear signal of the image, the detail layer adjustment coefficient acting on each pixel in the image is associated with the nonlinear signal of the corresponding pixel point, and the image is adjusted by the detail layer adjustment function. The detail layer is adjusted so that the corresponding pixel points in the detail layer can be flexibly adjusted according to the nonlinear signal of the corresponding pixel point, so as to avoid the improper selection of the detail layer adjustment coefficient, and the human eye can be perceived in the adjusted image. The image quality problem, which in turn affects the visual experience of the human eye.

结合第一方面，在第一方面的一种可能的实现方式中，所述确定细节层调整函数，包括：根据所述第一图像的光电转移函数，确定所述光电转移函数对应的韦伯weber分数函数；确定施赖伯Schreiber阈值函数与所述weber分数函数之间的比值函数；根据所述比值函数，确定所述细节层调整函数。With reference to the first aspect, in a possible implementation manner of the first aspect, the determining a detail layer adjustment function includes: determining a Weber weber score corresponding to the photoelectric transfer function according to a photoelectric transfer function of the first image a function; determining a ratio function between the Schreiber Schreiber threshold function and the weber score function; determining the detail layer adjustment function based on the ratio function.

结合第一方面，在第一方面的一种可能的实现方式中，所述细节层调整函数以第一非线性信号为自变量时对应的函数值小于或等于所述比值函数以所述第一非线性信号为自变量时对应的函数值，所述第一非线性信号为所述第一图像的任意一个非线性信号。With reference to the first aspect, in a possible implementation manner of the first aspect, the detail layer adjustment function is, when the first non-linear signal is an independent variable, the corresponding function value is less than or equal to the ratio function to the first The non-linear signal is a corresponding function value when the argument is independent, and the first non-linear signal is any non-linear signal of the first image.

因此，通过根据weber分数函数与施赖伯Schreiber阈值函数之间的比值函数确定细节层调整函数，并使得该细节层调整函数关于任一非线性信号的函数值小于或者等于比值函数在对应非线性信号处的函数值，使得在通过本申请实施例确定的细节层调整函数对图像的细节层进行调整时，使得调整后的图像的韦伯weber分数不会超过施赖伯Schreiber阈值，从而避免由于细节层调整系数的选取不当，导致调整后的图像中出现人眼能够感知的图像质量问题，进而影响人眼的视觉体验。Therefore, the detail layer adjustment function is determined by a ratio function between the weber score function and the Schreiber Schreiber threshold function, and the function value of the detail layer adjustment function with respect to any nonlinear signal is less than or equal to the ratio function at the corresponding nonlinear signal The function value is such that when the detail layer of the image is adjusted by the detail layer adjustment function determined by the embodiment of the present application, the Weber weber score of the adjusted image is not exceeded by the Schreiber threshold, thereby avoiding the adjustment factor due to the detail layer. Improper selection leads to image quality problems that the human eye can perceive in the adjusted image, which in turn affects the visual experience of the human eye.

结合第一方面，在第一方面的一种可能的实现方式中，所述细节层调整函数的单调性与所述比值函数的单调性一致。In conjunction with the first aspect, in a possible implementation of the first aspect, the monotonicity of the detail layer adjustment function is consistent with the monotonicity of the ratio function.

结合第一方面，在第一方面的一种可能的实现方式中，所述细节层调整函数为分段函数，所述分段函数包括至少一个分界点，其中，所述至少一个分界点为所述比值函数的极值点对应的所述第一图像的非线性信号，或所述至少一个分界点为所述weber分数函数与所述Schreiber阈值函数的交点对应的所述第一图像的非线性信号。With reference to the first aspect, in a possible implementation manner of the first aspect, the detail layer adjustment function is a piecewise function, the segmentation function includes at least one demarcation point, wherein the at least one demarcation point is a non-linear signal of the first image corresponding to an extreme point of the ratio function, or the at least one demarcation point is a nonlinearity of the first image corresponding to an intersection of the weber score function and the Schreiber threshold function signal.

可选地，该分段函数中的函数形式包括以下函数形式中的至少一项：指数函数、对数函数、幂函数或线性函数。Optionally, the functional form in the piecewise function includes at least one of the following functional forms: an exponential function, a logarithmic function, a power function, or a linear function.

结合第一方面，在第一方面的一种可能的实现方式中，所述方法还包括：获取所述第一图像的统计数据；根据所述统计数据，确定修正系数a，0＜a≤1；根据所述修正系数a，对所述细节层调整函数F(V)进行修正：With reference to the first aspect, in a possible implementation manner of the first aspect, the method further includes: acquiring statistical data of the first image; determining, according to the statistical data, a correction coefficient a, 0<a≤1 Correcting the detail layer adjustment function F(V) according to the correction coefficient a:

F′(V)＝a*F(V)F'(V)=a*F(V)

其中，F′(V)为修正后的细节层调整函数，V为所述第一图像的非线性信号。Where F'(V) is the modified detail layer adjustment function, and V is the nonlinear signal of the first image.

可选地，确定所述修正系数a，包括：根据下述函数关系式确定所述修正系数a为：Optionally, determining the correction coefficient a includes: determining the correction coefficient a according to the following functional relationship:

g(M)＝M ^r g(M)=M ^r

其中，g(M)为修正系数函数，M为所述第一图像的统计数据，r为所述修正系数函数g(M)的参数，r＞0。Where g(M) is a correction coefficient function, M is statistical data of the first image, and r is a parameter of the correction coefficient function g(M), r>0.

因此，通过根据图像的统计数据，确定修正系数a，并根据该修正系数a对图像的细节层调整函数进行修正，即动态地调整不同场景下的图像的细节层调整函数，使得调整后的图像能够更加符合人眼的视觉特性，从而改善人眼的视觉体验。Therefore, the correction coefficient a is determined according to the statistical data of the image, and the detail layer adjustment function of the image is corrected according to the correction coefficient a, that is, the detail layer adjustment function of the image in different scenes is dynamically adjusted, so that the adjusted image is obtained. It can better meet the visual characteristics of the human eye, thus improving the visual experience of the human eye.

结合第一方面，在第一方面的一种可能的实现方式中，所述统计数据包括以下信息中的至少一项：所述第一图像的最大像素亮度、所述第一图像的平均像素亮度、所述第一图像的像素的非线性Y分量的最小值、所述第一图像的像素的非线性Y分量的最大值或所述第一图像的像素的非线性Y分量平均值。With reference to the first aspect, in a possible implementation manner of the first aspect, the statistical data includes at least one of: a maximum pixel brightness of the first image, and an average pixel brightness of the first image a minimum value of a nonlinear Y component of a pixel of the first image, a maximum value of a nonlinear Y component of a pixel of the first image, or an average value of a nonlinear Y component of a pixel of the first image.

结合第一方面，在第一方面的一种可能的实现方式中，所述光电转移函数包括以下光电转移函数中的至少一项：感知量化PQ光电转移函数、场景亮度保真SLF光电转移函数或混合对数伽马HLG光电转移函数。In conjunction with the first aspect, in a possible implementation of the first aspect, the photoelectric transfer function comprises at least one of the following photoelectric transfer functions: a perceptually quantized PQ photoelectric transfer function, a scene brightness fidelity SLF photoelectric transfer function, or Mixed log gamma HLG photoelectric transfer function.

结合第一方面，在第一方面的一种可能的实现方式中，所述细节层调整函数包括以下函数类型中的至少一项：指数函数、对数函数、幂函数或线性函数。In conjunction with the first aspect, in a possible implementation of the first aspect, the detail layer adjustment function comprises at least one of the following function types: an exponential function, a logarithmic function, a power function, or a linear function.

结合第一方面，在第一方面的一种可能的实现方式中，所述细节层调整函数为连续函数。In conjunction with the first aspect, in a possible implementation of the first aspect, the detail layer adjustment function is a continuous function.

第二方面，提供一种图像处理的装置，所述装置用于执行上述第一方面或第一方面的任一可能的实现方式中的方法。具体地，所述装置可以包括用于执行第一方面或第一方面的任一可能的实现方式中的方法的模块。In a second aspect, an apparatus for image processing is provided for performing the method of any of the first aspect or the first aspect of the first aspect. In particular, the apparatus may comprise means for performing the method of the first aspect or any of the possible implementations of the first aspect.

第三方面，提供一种图像处理的装置，所述装置包括存储器和处理器，所述存储器用于存储指令，所述处理器用于执行所述存储器存储的指令，并且对所述存储器中存储的指令的执行使得所述处理器执行第一方面或第一方面的任一可能的实现方式中的方法。In a third aspect, an apparatus for image processing is provided, the apparatus comprising a memory for storing instructions, the processor for executing the instructions stored by the memory, and for storing in the memory Execution of the instructions causes the processor to perform the method of the first aspect or any of the possible implementations of the first aspect.

第四方面，提供一种计算机可读存储介质，所述计算机可读存储介质中存储有指令，当所述指令在计算机上运行时，使得计算机执行第一方面或第一方面的任一可能的实现方式中的方法。In a fourth aspect, a computer readable storage medium is provided, the computer readable storage medium storing instructions that, when executed on a computer, cause the computer to perform any of the first aspect or the first aspect The method in the implementation.

第五方面，提供一种包含指令的计算机程序产品，当该计算机程序产品在计算机上运行时，使得计算机执行第一方面或第一方面的任一可能的实现方式中的方法。In a fifth aspect, a computer program product comprising instructions for causing a computer to perform the method of the first aspect or any of the possible implementations of the first aspect, when the computer program product is run on a computer.

附图说明DRAWINGS

图1为根据本申请的显示设备的示意性框图。FIG. 1 is a schematic block diagram of a display device according to the present application.

图2为本申请实施例提供的图像处理的方法的示意性流程图。FIG. 2 is a schematic flowchart of a method for image processing according to an embodiment of the present application.

图3为本申请实施例提供的图像处理的方法的另一示意性流程图。FIG. 3 is another schematic flowchart of a method for image processing according to an embodiment of the present application.

图4为本申请实施例提供的图像处理的装置的示意性框图。FIG. 4 is a schematic block diagram of an apparatus for image processing according to an embodiment of the present application.

图5为本申请实施例提供的图像处理的装置的另一示意性框图。FIG. 5 is another schematic block diagram of an apparatus for image processing according to an embodiment of the present application.

具体实施方式Detailed ways

下面将结合附图，对本申请中的技术方案进行描述。The technical solutions in the present application will be described below with reference to the accompanying drawings.

为了清楚起见，首先对本申请中所使用的术语作以解释。For the sake of clarity, the terms used in this application are first explained.

1、高动态范围、标准动态范围1, high dynamic range, standard dynamic range

动态范围(Dynamic Range)在很多领域被用来表示某个变量的最大值与最小值的比率，自然界场景中光动态范围可以达到(10 ^-3～10 ⁶)nits，然而相机等拍摄设备能记录的图像线性信号值(例如，光信号值)的能力有限，一般将图像线性信号值的动态范围超过(0.01～1000)nits的称为高动态范围(High Dynamic Range，HDR)线性信号值，将对应的图像称为HDR图像，将图像线性信号值的动态范围不足(0.1～400nits)的称为标准动态范围(Standard Dynamic Range，SDR)线性信号值，并将对应的图像称为SDR图像。 Dynamic Range is used in many fields to represent the ratio of the maximum value to the minimum value of a variable. In the natural scene, the dynamic range of light can reach (10 ^-3 ~ 10 ⁶ ) nits, but cameras and other shooting equipment can record The linear signal value (for example, optical signal value) has a limited ability. Generally, the dynamic range of the linear signal value of the image exceeds (0.01 to 1000) nits, which is called the high dynamic range (HDR) linear signal value. The corresponding image is called an HDR image, and the dynamic range of the linear signal value of the image is less than (0.1 to 400 nits), which is called a standard dynamic range (SDR) linear signal value, and the corresponding image is referred to as an SDR image.

2、光电转移函数2, photoelectric transfer function

光电转移函数(Optical-Electro Transfer Function，OETF)用于将图像的线性信号(例如，光信号值)转换为非线性信号(例如，电信号值)。光电转移函数的数学表达形式为V＝F(L)，其中L表示线性信号，V表示非线性信号。An Optical-Electro Transfer Function (OETF) is used to convert a linear signal (eg, an optical signal value) of an image into a non-linear signal (eg, an electrical signal value). The mathematical expression of the photoelectric transfer function is V = F(L), where L represents a linear signal and V represents a nonlinear signal.

光电转移函数的数学表达形式为V＝F(L)，其中L表示线性信号，V表示非线性信号。对于SDR图像，其对应的光电转移函数为伽马Gamma光电转移函数，其函数V＝F(L)的形式为：The mathematical expression of the photoelectric transfer function is V = F(L), where L represents a linear signal and V represents a nonlinear signal. For the SDR image, the corresponding photoelectric transfer function is a gamma Gamma photoelectric transfer function, and its function V=F(L) is of the form:

其中，L为图像像素的线性信号，V为图像像素的对应像素点的非线性信号。Where L is a linear signal of an image pixel, and V is a nonlinear signal of a corresponding pixel of the image pixel.

对于HDR图像(例如，本申请中的第一图像)，其对应的HDR光电转移函数至少包括感知量化(Perceptio Quantization，PQ)光电转移函数、场景亮度保真(Scene Luminance Fidelity，SLF)光电转移函数或混合对数伽马(Hybrid Log-Gamma，HLG)光电转移函数中的任意一种。For an HDR image (eg, the first image in this application), its corresponding HDR phototransfer function includes at least Perceptio Quantization (PQ) photoelectric transfer function, Scene Luminance Fidelity (SLF) photoelectric transfer function. Or mix any of the Hybrid Log-Gamma (HLG) photoelectric transfer functions.

通过上述HDR光电转移函数对该HDR图像进行转换，该HDR光电转移函数对应的光电转移曲线也相应地至少包括感知量化(Perceptio Quantization，PQ)光电转移曲线、场景亮度保真(Scene Luminance Fidelity，SLF)光电转移曲线或混合对数伽马(Hybrid Log-Gamma，HLG)光电转移曲线中的任意一种。The HDR image is converted by the HDR photoelectric transfer function, and the photoelectric transfer curve corresponding to the HDR photoelectric transfer function correspondingly includes at least a Perceptio Quantization (PQ) photoelectric transfer curve and a Scene Luminance Fidelity (SLF). A photoelectric transfer curve or a mixed logarithmic gamma (HLG) photoelectric transfer curve.

下面对该三种光电转移函数分别进行说明。The three photoelectric transfer functions will be described separately below.

(1)PQ光电转移函数(1) PQ photoelectric transfer function

PQ光电转移函数不同于传统的伽马(Gamma)转换函数，其根据人眼的亮度感知模型，提出了感知量化转移函数，PQ光电转移函数表示图像像素的线性信号到PQ域非线性信号的转换关系。PQ光电转移函数V _PQ＝F _PQ(L)形式为： The PQ photoelectric transfer function is different from the traditional gamma transfer function. According to the human eye's brightness perception model, the perceptual quantization transfer function is proposed. The PQ photoelectric transfer function represents the conversion of the linear signal of the image pixel to the nonlinear signal of the PQ domain. relationship. The PQ photoelectric transfer function V _PQ =F _PQ (L) is of the form:

其中，L表示线性信号，对线性信号进行归一化后，其取值范围为[0，1]，1表示10000nits，V表示非线性信号，其归一化后的取值范围为[0，1]。Where L is a linear signal. After normalizing the linear signal, the value range is [0, 1], 1 is 10000 nits, and V is a nonlinear signal. The normalized value range is [0, 1].

m ₁、m ₂、c ₁、c ₂、c ₃为PQ光电转移系数，其取值分别为： m ₁ , m ₂ , c ₁ , c ₂ , and c ₃ are PQ photoelectric transfer coefficients, and their values are as follows:

m ₁＝0.1593017578125、m ₂＝78.84375、c ₁＝0.8359375、c ₂＝18.8515625、c ₃＝18.6875。 m ₁ =0.1593017578125, m ₂ =78.84375, c ₁ =0.8359375, c ₂ =18.8515625, c ₃ =18.6875.

(2)SLF光电转移函数(2) SLF photoelectric transfer function

SLF光电转移函数表示图像像素的线性信号到SLF域非线性信号的转换关系。SLF光电转移函数V _SLF＝F _SLF(L)形式为： The SLF photoelectric transfer function represents a conversion relationship between a linear signal of an image pixel and a nonlinear signal of the SLF domain. The SLF photoelectric transfer function V _SLF =F _SLF (L) is of the form:

p、m ₃、a、b为SLF光电转移系数，其取值分别为： p, m ₃ , a, b are SLF photoelectric transfer coefficients, and their values are:

p＝2.3、m ₃＝0.14、a＝1.12762、b＝-0.12762。 p = 2.3, m ₃ = 0.14, a = 1.12762, b = -0.12762.

(3)HLG光电转移曲线(3) HLG photoelectric transfer curve

HLG光电转移函数是在传统的Gamma曲线的基础上改进得到的。HLG光电转移函数在低段应用传统的Gamma曲线，在高段补充了log曲线，HLG光电转移函数表示图像像素的线性信号到HLG域非线性信号的转换关系。HLG光电转移函数V _HLG＝F _HLG(L)形式为： The HLG photoelectric transfer function is improved based on the traditional Gamma curve. The HLG photoelectric transfer function applies the traditional Gamma curve in the low stage and the log curve in the high stage. The HLG photoelectric transfer function represents the conversion relationship between the linear signal of the image pixel and the nonlinear signal of the HLG domain. The HLG photoelectric transfer function V _HLG =F _HLG (L) is of the form:

其中，L表示线性信号，对线性信号进行归一化后，其取值范围为[0，12]，1表示10000nits，V表示非线性信号，其归一化后的取值范围为[0，1]。Where L is a linear signal. After normalizing the linear signal, the value range is [0, 12], 1 is 10000 nits, and V is a nonlinear signal. The normalized value range is [0, 1].

a、b、c为HLG光电转移系数，其取值分别为：a, b, c are HLG photoelectric transfer coefficients, and their values are:

a＝0.17883277、b＝0.28466892、c＝0.55991073。a=0.17883277, b=0.28466892, c=0.55991073.

图1是根据本申请实施例的显示设备100的示意性框图。如图1所示，显示设备100包括输入接口101、视频解码器102、处理器103以及显示器104。FIG. 1 is a schematic block diagram of a display device 100 in accordance with an embodiment of the present application. As shown in FIG. 1, display device 100 includes an input interface 101, a video decoder 102, a processor 103, and a display 104.

输入接口101可以包含接收器及/或调制解调器，输入接口101用于接收编码后的视频数据。The input interface 101 can include a receiver and/or a modem for receiving encoded video data.

视频解码器102可解码来自输入接口101的视频数据，并将经解码的视频数据送至处理器103进行处理，例如，处理器103对经解码的视频数据对应的图像数据进行细节层调整，并将调整后获得的视频数据送至显示器104进行显示。The video decoder 102 can decode the video data from the input interface 101 and send the decoded video data to the processor 103 for processing, for example, the processor 103 performs detail layer adjustment on the image data corresponding to the decoded video data, and The video data obtained after the adjustment is sent to the display 104 for display.

其中，显示器104可与显示设备100整合或可在显示设备100外部。作为示例而非限定，显示器104至少为以下任意一种：Among other things, the display 104 can be integrated with the display device 100 or can be external to the display device 100. By way of example and not limitation, display 104 is at least one of the following:

液晶显示器(Liquid Crystal Display，LCD)、等离子体显示器、有机发光二极管(Organic Light-Emitting Diode，OLED)显示器或其它类型的显示器。Liquid crystal display (LCD), plasma display, Organic Light-Emitting Diode (OLED) display or other type of display.

作为示例而非限定，显示设备100至少为以下任意一种：By way of example and not limitation, display device 100 is at least one of the following:

台式计算机、移动计算设备、笔记本(例如，膝上型)计算机、平板计算机、机顶盒、智能电话等手持机、电视、相机、显示设备、数字媒体播放器、视频游戏控制台、车载计算机，或其类似者。A desktop computer, a mobile computing device, a notebook (eg, a laptop) computer, a tablet computer, a set top box, a smart phone, etc., a television, a camera, a display device, a digital media player, a video game console, an onboard computer, or Similar.

图2为本申请实施例提供的图像处理的方法200的示意性流程图。如图2所示，该方法200至少包括以下步骤。FIG. 2 is a schematic flowchart of a method 200 for image processing according to an embodiment of the present application. As shown in FIG. 2, the method 200 includes at least the following steps.

210，获取第一图像。210: Acquire a first image.

220，根据空间滤波函数对该第一图像进行处理，以生成第一基本层。220. The first image is processed according to a spatial filter function to generate a first base layer.

230，对该第一图像与该第一基本层进行减法操作或除法操作，以生成第一细节层。230. Perform a subtraction operation or a division operation on the first image and the first base layer to generate a first detail layer.

具体地，通过空间滤波函数对获取的第一图像进行滤波处理，生成第一图像的基本层 (例如，第一基本层)，并根据生成的第一基本层与第一图像生成第一图像的细节层(例如，第一细节层)。Specifically, the obtained first image is filtered by a spatial filter function to generate a base layer (eg, a first base layer) of the first image, and the first image is generated according to the generated first base layer and the first image. Detail layer (eg, first detail layer).

可选地，对于第一细节层的生成，可以至少包括以下两种方法：Optionally, for the generation of the first detail layer, the following two methods may be included:

方法1method 1

该第一细节层为对该第一图像与该第一基本层进行减法操作后生成的；或者The first detail layer is generated after performing a subtraction operation on the first image and the first base layer; or

方法2Method 2

该第一细节层为对该第一图像与该第一基本层进行除法操作后生成的。The first detail layer is generated after the first image and the first base layer are divided.

可选地，该空间滤波函数包括以下滤波函数中的至少一项：高斯滤波函数、双边滤波函数或指导滤波函数。Optionally, the spatial filtering function comprises at least one of the following filtering functions: a Gaussian filtering function, a bilateral filtering function or a guiding filtering function.

需要说明的是，在本申请实施例中，仅以上述列举的几种空间滤波函数为例进行说明，但本申请并不限于此，空间滤波函数还可以包括其他能够实现生成第一图像的基本层的滤波函数。It should be noted that, in the embodiment of the present application, only the spatial filtering functions listed above are taken as an example for description, but the application is not limited thereto, and the spatial filtering function may further include other basics capable of generating the first image. The filter function of the layer.

240，根据该第一图像，确定细节层调整函数，该细节层调整函数的自变量为该第一图像的非线性信号。240. Determine, according to the first image, a detail layer adjustment function, where the independent variable of the detail layer adjustment function is a nonlinear signal of the first image.

具体地，对于获取的该第一图像，需要确定该第一图像的细节层调整函数，该细节层调整函数为关于该第一图像的非线性信号(例如，第一图像的非线性信号为PQ非线性信号)的函数，对于确定的细节层调整函数而言，该细节层调整函数对于第一图像上的每一像素点的非线性信号而言，均对应一个细节层调整函数值。Specifically, for the acquired first image, a detail layer adjustment function of the first image needs to be determined, where the detail layer adjustment function is a nonlinear signal about the first image (for example, the nonlinear signal of the first image is PQ The function of the nonlinear signal), for the determined detail layer adjustment function, the detail layer adjustment function corresponds to a detail layer adjustment function value for the nonlinear signal of each pixel point on the first image.

250，根据该细节层调整函数，对该第一细节层进行调整，以获取第二细节层。250. Adjust the first detail layer according to the detail layer adjustment function to obtain a second detail layer.

具体地，在步骤220与230中确定了第一图像的细节层(例如，第一细节层)，并且在步骤240中确定了细节层调整函数，在步骤250中，通过该细节层调整函数，对该第一细节层的每个像素点的非线性信号通过该细节层调整函数在对应像素点处的函数值进行调整，并获取调整后生成的细节层(例如，第二细节层)。Specifically, a detail layer (eg, a first detail layer) of the first image is determined in

steps

220 and 230, and a detail layer adjustment function is determined in step 240, in which the detail layer adjustment function is passed, The nonlinear signal of each pixel of the first detail layer is adjusted by the function value of the detail layer adjustment function at the corresponding pixel point, and the adjusted detail layer (for example, the second detail layer) is obtained.

例如，第一图像被拆分为第一细节层(Detial)与第一基本层(Base)，该第一图像的细节层调整函数为F(V)，V代表第一图像像素的非线性信号，则通过该细节层调整函数F(V)对第一图像的细节层(Detial)进行调整时，表达式为：For example, the first image is split into a first detail layer (Detial) and a first base layer (Base), the detail layer adjustment function of the first image is F(V), and V represents a nonlinear signal of the first image pixel. Then, when the detail layer (Detial) of the first image is adjusted by the detail layer adjustment function F(V), the expression is:

Detail′＝Detail*F(V) (5)Detail'=Detail*F(V) (5)

其中，Detail′为通过细节层调整函数对该第一图像的细节层进行调整后生成的细节层。Wherein' is a detail layer generated by adjusting the detail layer of the first image by the detail layer adjustment function.

260，对该第一基本层与该第二细节层进行加法操作或乘法操作，以生成第二图像。260. Perform an addition operation or a multiplication operation on the first base layer and the second detail layer to generate a second image.

具体地，在步骤250中，通过细节层调整函数对第一图像的细节层进行调整后，根据调整后生成的细节层(例如，第二细节层)与第一图像的第一基本层，生成第二图像，并将生成的第二图像输出至显示设备，供人眼观看。Specifically, in step 250, the detail layer of the first image is adjusted by the detail layer adjustment function, and then generated according to the adjusted detail layer (for example, the second detail layer) and the first base layer of the first image. The second image is output to the display device for viewing by the human eye.

可选地，对于第二图像的生成，可以至少包括以下两种方法：Optionally, for the generation of the second image, the following two methods may be included:

方法1method 1

该第二图像为对该第一基本层与该第二细节层进行加法操作后生成的，或者The second image is generated by adding the first base layer and the second detail layer, or

方法2Method 2

该第二图像为对该第一基本层与该第二细节层进行乘法操作后生成的。The second image is generated after multiplying the first base layer and the second detail layer.

因此，在本申请实施例中，通过建立关于图像的非线性信号的细节层调整函数，即将作用在图像中每一像素点的细节层调整系数与对应像素点的非线性信号进行关联，并通过该细节层调整函数对图像的细节层进行调整，使得能够根据对应像素点的非线性信号，灵活地对细节层中对应像素点进行调整，避免由于细节层调整系数的选取不当，导致调整后的图像中出现人眼能够感知的图像质量问题，进而影响人眼的视觉体验。Therefore, in the embodiment of the present application, by establishing a detail layer adjustment function for the nonlinear signal of the image, the detail layer adjustment coefficient applied to each pixel point in the image is associated with the nonlinear signal of the corresponding pixel point, and is passed through The detail layer adjustment function adjusts the detail layer of the image, so that the corresponding pixel points in the detail layer can be flexibly adjusted according to the nonlinear signal of the corresponding pixel point, thereby avoiding the adjustment due to improper selection of the detail layer adjustment coefficient. Image quality problems that the human eye can perceive in the image, which in turn affects the visual experience of the human eye.

下面对本申请实施例中的确定细节层调整函数的具体方法进行介绍。The specific method for determining the detail layer adjustment function in the embodiment of the present application is introduced below.

首先对该方法涉及到的术语进行说明。First, the terminology involved in the method will be explained.

1、韦伯weber分数函数1, Weber weber score function

图像存储的信号为非线性信号，并且需要使用整数N对图像的非线性信号进行量化，其中量化值N的取值一般可以为255、1023或65535等，相邻两个量化误差的比值叫作weber分数，weber分数用来衡量光电转移函数的优劣，weber分数函数形式如下The signal stored in the image is a non-linear signal, and the non-linear signal of the image needs to be quantized by using an integer N. The value of the quantized value N can generally be 255, 1023 or 65535, etc., and the ratio of the adjacent two quantization errors is called Weber score, weber score is used to measure the pros and cons of the photoelectric transfer function, the weber score function is as follows

其中N为量化值、V表示非线性信号、L表示线性信号，F(L)为上述三种光电转移函数中的任意一种光电转移函数，F'(L)为光电转移函数F(L)的导函数。Where N is the quantized value, V is the nonlinear signal, L is the linear signal, F(L) is the photoelectric transfer function of any of the above three photoelectric transfer functions, and F'(L) is the photoelectric transfer function F(L) The derivative function.

2、施赖伯Schreiber阈值函数2, Schreiber Schreiber threshold function

施赖伯Schreiber阈值函数是通过实验测量(例如，实验定标)的方式获得的weber分数函数的限制函数，即当webber分数值小于施赖伯Schreiber阈值函数值时，则人眼不会看出由于图像量化带来的视觉问题，由于施赖伯Schreiber阈值函数是通过实验标定的方式获得的，因此，施赖伯Schreiber阈值函数可以近似地确定为如下的函数形式：The Schreiber Threshold function is a limit function of the weber fractional function obtained by experimental measurements (eg, experimental calibration), ie when the webber score is less than the Schreiber threshold function value, the human eye does not see the image quantization band. The visual problem that comes from Schreiber's Schreiber threshold function is obtained by experimental calibration. Therefore, the Schreiber threshold function can be approximated as the following functional form:

可选地，该确定细节层调整函数，包括：根据该第一图像的光电转移函数，确定该光电转移函数对应的韦伯weber分数函数；确定该weber分数函数与施赖伯Schreiber阈值函数之间的比值函数；根据该比值函数，确定该细节层调整函数。Optionally, determining the detail layer adjustment function comprises: determining a Weber weber score function corresponding to the photoelectric transfer function according to the photoelectric transfer function of the first image; determining a ratio function between the weber score function and the Schreiber threshold function According to the ratio function, the detail layer adjustment function is determined.

其中，比值函数R(L)的形式可以为：Wherein, the form of the ratio function R(L) can be:

具体地，在确定第一图像的细节层调整函数时，先确定第一图像的光电转移函数，并根据该第一图像的光电转移函数，确定该光电转移函数对应的韦伯weber分数函数，同时计算出该weber分数函数与施赖伯Schreiber阈值函数之间的比值函数，最终根据该比值函数，确定细节层调整函数。Specifically, when determining the detail layer adjustment function of the first image, determining a photoelectric transfer function of the first image, and determining a Weber weber score function corresponding to the photoelectric transfer function according to the photoelectric transfer function of the first image, and calculating The ratio function between the weber score function and the Schreiber Schreiber threshold function is finally determined, and finally the detail layer adjustment function is determined according to the ratio function.

作为示例而非限定，关于确定比值函数的方法，下面以第一图像的光电转移函数满足PQ光电转移函数的特性的情况为例进行说明。As an example and not a limitation, regarding the method of determining the ratio function, a case where the photoelectric transfer function of the first image satisfies the characteristics of the PQ photoelectric transfer function will be described below as an example.

在该第一图像的光电转移函数满足PQ光电转移函数的特性的情况下，进一步根据第一图像的PQ光电转移函数确定该PQ光电转移函数对应的韦伯weber分数函数，同时计算出该weber分数函数与施赖伯Schreiber阈值函数之间的比值函数，例如，该PQ光电转移函数对应的韦伯weber分数函数的形式为：In the case that the photoelectric transfer function of the first image satisfies the characteristics of the PQ photoelectric transfer function, the Weber weber fractional function corresponding to the PQ photoelectric transfer function is further determined according to the PQ photoelectric transfer function of the first image, and the weber fractional function is calculated. The ratio function between the Schreiber threshold function and the Schreiber threshold function, for example, the form of the Weber weber fractional function corresponding to the PQ photoelectric transfer function is:

该施赖伯Schreiber阈值函数的形式为:The Schreiber Schreiber threshold function takes the form:

根据该weber分数函数与施赖伯Schreiber阈值函数，确定的比值函数的形式为：According to the weber score function and the Schreiber Schreiber threshold function, the form of the ratio function is determined as:

最终根据该比值函数，确定细节层调整函数。Finally, according to the ratio function, the detail layer adjustment function is determined.

可选地，该细节层调整函数以第一非线性信号为自变量时对应的函数值小于或等于该比值函数以该第一非线性信号为自变量时对应的函数值，该第一非线性信号为该第一图像的任意一个非线性信号。Optionally, the detail layer adjustment function takes the first nonlinear signal as an independent variable, and the corresponding function value is less than or equal to a function value corresponding to the ratio function when the first nonlinear signal is an independent variable, the first nonlinearity The signal is any non-linear signal of the first image.

具体地，在确定了比值函数之后，进而根据该比值函数，确定该细节层调整函数，使得该细节层调整函数与比值函数以同一像素点处的非线性信号为自变量(例如，第一非线性信号)时，细节层调整函数的函数值小于或者等于比值函数的函数值。Specifically, after determining the ratio function, and further determining the detail layer adjustment function according to the ratio function, the detail layer adjustment function and the ratio function function as independent variables at the same pixel point (for example, the first non- In the case of a linear signal), the function value of the detail layer adjustment function is less than or equal to the function value of the ratio function.

可选地，在满足该细节层调整函数与比值函数以同一像素点处的非线性信号为自变量时，细节层调整函数的函数值小于或者等于比值函数的函数值的前提下，该细节层调整函数包括以下函数类型中的至少一项：指数函数、对数函数、幂函数或线性函数。Optionally, when the detail layer adjustment function and the ratio function function are independent variables at the same pixel point, and the function value of the detail layer adjustment function is less than or equal to the function value of the ratio function, the detail layer The adjustment function includes at least one of the following function types: an exponential function, a logarithmic function, a power function, or a linear function.

作为示例而非限定，该细节层调整函数的函数形式为：As an example and not by way of limitation, the functional form of the detail layer adjustment function is:

F(V)＝V ^q+1 (12) F(V)=V ^q +1 (12)

其中，q为该细节层调整函数的参数，且q＞0，作为示例而非限定，q＝1.2，V为第一图像像素的线性信号L对应的非线性信号；Where q is the parameter of the detail layer adjustment function, and q>0, as an example and not a limitation, q=1.2, where V is a nonlinear signal corresponding to the linear signal L of the first image pixel;

作为示例而非限定，该细节层调整函数的函数形式还可以为：As an example and not by way of limitation, the functional form of the detail layer adjustment function may also be:

F(V)＝e ^kV (13) F(V)=e ^kV (13)

其中，k为该细节层调整函数的参数，且k＞0，作为示例而非限定，k＝0.6，V为第一图像像素的线性信号L对应的非线性信号。Where k is a parameter of the detail layer adjustment function, and k>0, by way of example and not limitation, k=0.6, where V is a nonlinear signal corresponding to the linear signal L of the first image pixel.

可选地，该细节层调整函数的单调性与该比值函数的单调性一致。Optionally, the monotonicity of the detail layer adjustment function is consistent with the monotonicity of the ratio function.

具体地，在根据该比值函数确定细节层调整函数时，除了使得该细节层调整函数与比值函数以同一像素点处的非线性信号为自变量(例如，第一非线性信号)时，细节层调整函数的函数值小于或者等于比值函数的函数值以外，同时还可以使该比值函数与细节层调整函数的单调性一致，即使得比值函数与细节层调整函数的增、减区间一致。Specifically, when determining the detail layer adjustment function according to the ratio function, the detail layer is used except that the detail layer adjustment function and the ratio function function are independent variables (for example, the first nonlinear signal) at the same pixel point. The function value of the adjustment function is less than or equal to the function value of the ratio function, and the ratio function can also be made uniform with the monotonicity of the detail layer adjustment function, that is, the ratio function is consistent with the increase and decrease intervals of the detail layer adjustment function.

可选地，在本申请实施例中，该细节层调整函数可以为该比值函数本身。Optionally, in the embodiment of the present application, the detail layer adjustment function may be the ratio function itself.

可选地，在满足该细节层调整函数与比值函数以同一像素点处的非线性信号为自变量时，细节层调整函数的函数值小于或者等于比值函数的函数值的前提下，该细节层调整函数还可以为分段函数，该分段函数包括至少一个分界点，其中，该至少一个分界点为该比值函数的极值点对应的该第一图像的非线性信号，或该至少一个分界点为该weber分数函数与该Schreiber阈值函数的交点对应的该第一图像的非线性信号。Optionally, when the detail layer adjustment function and the ratio function function are independent variables at the same pixel point, and the function value of the detail layer adjustment function is less than or equal to the function value of the ratio function, the detail layer The adjustment function may also be a piecewise function comprising at least one demarcation point, wherein the at least one demarcation point is a non-linear signal of the first image corresponding to an extreme point of the ratio function, or the at least one demarcation The point is a non-linear signal of the first image corresponding to the intersection of the weber score function and the Schreiber threshold function.

具体地，该细节层调整函数为分段函数，该分段函数的分界点可以为比值函数的极值点处的第一图像的非线性信号；或者该分段函数的分界点还可以为第一图像的weber分数函数与该Schreiber阈值函数的交点处的该第一图像的非线性信号。Specifically, the detail layer adjustment function is a piecewise function, and the boundary point of the piecewise function may be a nonlinear signal of the first image at the extreme point of the ratio function; or the boundary point of the piecewise function may also be A non-linear signal of the first image at the intersection of the weber score function of the image and the Schreiber threshold function.

作为示例而非限定，在该第一图像的光电转移函数满足PQ光电转移函数的特性的情况下，例如，该比值函数的极值点对应的第一图像的PQ非线性信号的数值为0.15，即，该细节层调整函数的分界点为0.15，将该细节层调整函数的分界点记为x ₁，则该细节层调整函数的函数形式为： By way of example and not limitation, in the case where the photoelectric transfer function of the first image satisfies the characteristics of the PQ photoelectric transfer function, for example, the value of the PQ nonlinear signal of the first image corresponding to the extreme point of the ratio function is 0.15, That is, the boundary point of the detail layer adjustment function is 0.15, and the boundary point of the detail layer adjustment function is denoted as x ₁ , then the function form of the detail layer adjustment function is:

其中，A ₁、B ₁、C ₁为该细节层调整函数的参数，且作为示例而非限定，A ₁＝1.0、B ₁＝0.95、C ₁＝1.1，分界点x ₁＝0.15，V为第一图像像素的PQ线性信号L对应的PQ非线性信号。 Wherein, A ₁ , B ₁ , and C ₁ are parameters of the detail layer adjustment function, and by way of example and not limitation, A ₁ =1.0, B ₁ =0.95, C ₁ =1.1, and the boundary point x ₁ =0.15, V is The PQ nonlinear signal corresponding to the PQ linear signal L of the first image pixel.

作为示例而非限定，在该第一图像的光电转移函数满足PQ光电转移函数的特性的情况下，例如，该比值函数的极值点对应的第一图像的PQ非线性信号的数值为0.15，weber分数函数与该Schreiber阈值函数的交点处对应的PQ非线性信号的数值为0.04，即，该细节层调整函数的分界点分别为0.15、0.04，将该细节层调整函数的分界点分别记为x ₁、x ₂，则该细节层调整函数的函数形式为： By way of example and not limitation, in the case where the photoelectric transfer function of the first image satisfies the characteristics of the PQ photoelectric transfer function, for example, the value of the PQ nonlinear signal of the first image corresponding to the extreme point of the ratio function is 0.15, The value of the PQ nonlinear signal corresponding to the intersection of the weber score function and the Schreiber threshold function is 0.04, that is, the boundary points of the detail layer adjustment function are respectively 0.15 and 0.04, and the boundary points of the detail layer adjustment function are respectively recorded as x ₁ , x ₂ , then the function form of the detail layer adjustment function is:

其中，A ₂、B ₂、C ₂、B ₃、C ₃分别为该细节层调整函数的参数，且作为示例而非限定，C ₂＝1.0、A ₂＝0.5、B ₂＝0.98、A ₃＝1.0、B ₃＝0.905，分界点x ₁＝0.15、x ₂＝0.04，V为第一图像像素的PQ线性信号L对应的PQ非线性信号。 Wherein A ₂ , B ₂ , C ₂ , B ₃ , C ₃ are parameters of the detail layer adjustment function, respectively, and by way of example and not limitation, C ₂ =1.0, A ₂ =0.5, B ₂ =0.98, A ₃ = 1.0, B ₃ = 0.905, the demarcation point x ₁ = 0.15, x ₂ = 0.04, and V is the PQ nonlinear signal corresponding to the PQ linear signal L of the first image pixel.

作为示例而非限定，在该第一图像的光电转移函数满足SLF光电转移函数的特性的情况下，例如，该比值函数的极值点为Schreiber阈值函数的函数曲线的转折点，则该比值函数的极值点对应的第一图像的非线性信号的数值为0.22，即，该细节层调整函数的分界点为0.22，将该细节层调整函数的分界点记为x ₃，则该细节层调整函数的函数形式为： By way of example and not limitation, in the case where the photoelectric transfer function of the first image satisfies the characteristics of the SLF photoelectric transfer function, for example, the extreme point of the ratio function is a turning point of a function curve of the Schreiber threshold function, then the ratio function The value of the nonlinear signal of the first image corresponding to the extreme point is 0.22, that is, the boundary point of the detail layer adjustment function is 0.22, and the boundary point of the detail layer adjustment function is recorded as x ₃ , then the detail layer adjustment function The function form is:

其中，A ₄、B ₄、C ₄为该细节层调整函数的参数，且作为示例而非限定，C ₄＝1.3、A ₄＝1.0、B ₄＝1.08，分界点x ₃＝0.22，V为第一图像像素的SLF线性信号L对应的SLF非线性信号。 Where A ₄ , B ₄ , C ₄ are the parameters of the detail layer adjustment function, and by way of example and not limitation, C ₄ =1.3, A ₄ =1.0, B ₄ =1.08, demarcation point x ₃ =0.22, V is The SLF nonlinear signal corresponding to the SLF linear signal L of the first image pixel.

还例如，该比值函数的极值点为Schreiber阈值函数的函数曲线的转折点与SLF光电转移函数对应的weber分数函数的函数曲线的转折点，则该比值函数的极值点对应的第一图像的非线性信号的数值分别为0.22、0.77，即，该细节层调整函数的分界点分别为0.22、0.77，将该细节层调整函数的分界点分别记为x ₄、x ₅，则该细节层调整函数的函数形式为： For example, the extreme point of the ratio function is the turning point of the function curve of the turning point of the Schreiber threshold function and the weber fractional function corresponding to the SLF photoelectric transfer function, and the extreme value of the extreme value corresponding to the extreme value of the ratio function The values of the linear signals are respectively 0.22 and 0.77, that is, the demarcation points of the detail layer adjustment function are respectively 0.22 and 0.77, and the boundary points of the detail layer adjustment function are respectively recorded as x ₄ and x ₅ , and the detail layer adjustment function is The function form is:

其中，A ₅、A ₆、B ₅、C ₅分别为该细节层调整函数的参数，且作为示例而非限定，A ₅＝1.0、C ₅＝1.3、A ₆＝-3.0、B ₅＝1.18、B ₆＝4.26、x ₄＝0.22、x ₅＝0.77，V为第一图像像素的SLF线性信号L对应的SLF非线性信号。 Wherein, A ₅ , A ₆ , B ₅ , and C ₅ are parameters of the detail layer adjustment function, respectively, and are by way of example and not limitation, A ₅ =1.0, C ₅ =1.3, A ₆ =-3.0, B ₅ =1.18 B ₆ = 4.26, x ₄ = 0.22, x ₅ = 0.77, and V is the SLF nonlinear signal corresponding to the SLF linear signal L of the first image pixel.

作为示例而非限定，在该第一图像的光电转移函数满足HLG光电转移函数的特性的情况下，例如，该比值函数的极值点为Schreiber阈值函数的函数曲线的转折点与HLG光电转移函数对应的weber分数函数的函数曲线的转折点，则该比值函数的极值点对应的第一图像的非线性信号的数值分别为0.026、0.05、以及0.5，即，该细节层调整函数的分界点分别为0.026、0.05、以及0.5，将该细节层调整函数的分界点分别记x ₆、x ₇、x ₈，则该细节层调整函数的函数形式为： By way of example and not limitation, in the case where the photoelectric transfer function of the first image satisfies the characteristics of the HLG photoelectric transfer function, for example, the turning point of the function curve of the extreme value point of the ratio function is the Schreiber threshold function corresponding to the HLG photoelectric transfer function The turning point of the function curve of the weber fractional function, the values of the nonlinear signals of the first image corresponding to the extreme points of the ratio function are respectively 0.026, 0.05, and 0.5, that is, the demarcation points of the detail layer adjustment function are respectively 0.026, 0.05, and 0.5, the boundary points of the detail layer adjustment function are respectively recorded as x ₆ , x ₇ , and x ₈ , and the function form of the detail layer adjustment function is:

其中，A ₇、A ₈、B ₇、B ₈、C ₆、C ₇分别为该细节层调整函数的参数，且作为示例而非限定，A ₇＝(-150)/13、B ₇＝1.5、A ₈＝2/3、B ₈＝35/30、C ₆＝1.2、C ₇＝1.5、x _6＝0.026、x _7＝0.05、x _8＝0.5，V为第一图像像素的HLG线性信号对应的HLG非线性信号。 Wherein A ₇ , A ₈ , B ₇ , B ₈ , C ₆ , C ₇ are parameters of the detail layer adjustment function, respectively, and by way of example and not limitation, A ₇ = (-150) / 13, B ₇ = 1.5 , A ₈ =2/3, B ₈ =35/30, C ₆ =1.2, C ₇ =1.5, x ₆₌ 0.026, x ₇₌ 0.05, x ₈₌ 0.5, V is the HLG linear signal of the first image pixel Corresponding HLG nonlinear signal.

需要说明的是，上述仅以分段函数中的函数形式为线性函数为例进行说明，但本申请实施例并不限于此，例如，上述分段函数中的函数还可以为指数函数、幂函数或者对数函数等。It should be noted that the above description is only taken as an example of a linear function in a piecewise function, but the embodiment of the present application is not limited thereto. For example, the function in the piecewise function may also be an exponential function and a power function. Or logarithmic functions, etc.

因此，通过根据weber分数函数与施赖伯Schreiber阈值函数之间的比值函数确定细节层调整函数，并使得该细节层调整函数在与比值函数相对应的像素点处的非线性信号的函数值小于或者等于比值函数的函数值，使得在通过本申请实施例确定的细节层调整函数对图像的细节层进行调整时，使得调整后的图像的韦伯weber分数不会超过施赖伯Schreiber阈值，从而避免由于细节层调整系数的选取不当，导致调整后的图像中出现人眼能够感知的图像质量问题，进而影响人眼的视觉体验。Therefore, the detail layer adjustment function is determined by a ratio function between the weber score function and the Schreiber Schreiber threshold function, and the function value of the nonlinear signal at the pixel point corresponding to the ratio function is less than or equal to The function value of the ratio function is such that when the detail layer of the image is adjusted by the detail layer adjustment function determined by the embodiment of the present application, the Weber weber score of the adjusted image is not exceeded by the Schreiber threshold, thereby avoiding adjustment due to the detail layer Improper selection of coefficients results in image quality problems that the human eye can perceive in the adjusted image, which in turn affects the visual experience of the human eye.

可选地，如图3所示，该方法200还包括：Optionally, as shown in FIG. 3, the method 200 further includes:

270，获取该第一图像的统计数据；270. Obtain statistics of the first image.

280，根据该统计数据，确定修正系数a，0＜a≤1；280, according to the statistical data, determining a correction coefficient a, 0 < a ≤ 1;

290，根据该修正系数a，对该细节层调整函数进行修正。290. Correct the detail layer adjustment function according to the correction coefficient a.

具体地，根据获取的第一图像的统计数据，确定修正系数a，其中，0＜a≤1，并根据该修正系数a，对第一图像的细节层调整函数进行调整。因此，通过根据图像的统计数据，确定修正系数a，并根据该修正系数a对图像的细节层调整函数进行修正，即动态地调整不同场景下的图像的细节层调整函数，使得调整后的图像能够更加符合人眼的视觉特性，从而改善人眼的视觉体验。Specifically, according to the acquired statistical data of the first image, the correction coefficient a is determined, where 0<a≤1, and the detail layer adjustment function of the first image is adjusted according to the correction coefficient a. Therefore, the correction coefficient a is determined according to the statistical data of the image, and the detail layer adjustment function of the image is corrected according to the correction coefficient a, that is, the detail layer adjustment function of the image in different scenes is dynamically adjusted, so that the adjusted image is obtained. It can better meet the visual characteristics of the human eye, thus improving the visual experience of the human eye.

可选地，该统计数据包括以下信息中的至少一项：该第一图像的最大像素亮度、该第一图像的平均像素亮度、该第一图像的像素的非线性Y分量的最小值、该第一图像的像素的非线性Y分量的最大值或该第一图像的像素的非线性Y分量平均值。Optionally, the statistical data includes at least one of the following: a maximum pixel brightness of the first image, an average pixel brightness of the first image, a minimum value of a nonlinear Y component of a pixel of the first image, The maximum value of the nonlinear Y component of the pixel of the first image or the average of the nonlinear Y component of the pixel of the first image.

需要说明的是，上述统计数据可以在第一图像所在的视频码流中携带。It should be noted that the foregoing statistical data may be carried in the video code stream in which the first image is located.

作为示例而非限定，该第一图像的统计数据为第一图像的像素非线性Y分量平均值，则根据该第一图像的像素非线性Y分量平均值，确定细节层调整函数的修正系数a＝a ₁，并通过该修正系数a ₁，对第一图像的细节层调整函数进行修正。 As an example and not by way of limitation, the statistical data of the first image is the average value of the pixel nonlinear Y component of the first image, and the correction coefficient a of the detail layer adjustment function is determined according to the average value of the pixel nonlinear Y component of the first image. =a ₁ , and the detail layer adjustment function of the first image is corrected by the correction coefficient a ₁ .

该修正系数a可以通过以下两种方法确定：The correction factor a can be determined by the following two methods:

方法1method 1

g(M)＝M (19)g(M)=M (19)

其中，g(M)为修正系数函数，M为给第一图像的统计数据。Where g(M) is a correction coefficient function and M is a statistical data for the first image.

方法2Method 2

g(M)＝M ^r (20) g(M)=M ^r (20)

其中，g(M)为修正系数函数，M为该第一图像的统计数据，r为该修正系数函数g(M)的参数，r＞0，作为示例而非限定，r＝1.2。Where g(M) is a correction coefficient function, M is the statistical data of the first image, r is a parameter of the correction coefficient function g(M), r>0, as an example and not a limitation, r=1.2.

其中，修正后的细节层调整函数F′(V)的形式为：Wherein, the modified detail layer adjustment function F'(V) is of the form:

F′(V)＝a*F(V) (21)F'(V)=a*F(V) (21)

需要说明的是，上述仅以统计数据包括上述信息为例进行说明，该统计数据还可以包括其他能够确定该修正系数的统计数据，本申请实施例并不限于此。It should be noted that the foregoing is only an example in which the statistical data includes the foregoing information, and the statistical data may further include other statistical data that can determine the correction coefficient, and the embodiment of the present application is not limited thereto.

可选地，在本申请实施例中，该细节层调整函数为连续函数。Optionally, in the embodiment of the present application, the detail layer adjustment function is a continuous function.

需要说明的是，在本申请实施例中，上述各过程的序号的大小并不意味着执行顺序的先后，各过程的执行顺序应以其功能和内在逻辑确定，而不应对本申请实施例的实施过程构成任何限定。It should be noted that, in the embodiment of the present application, the size of the sequence numbers of the foregoing processes does not mean the order of execution sequence, and the execution order of each process should be determined by its function and internal logic, and should not be taken by the embodiment of the present application. The implementation process constitutes any qualification.

上文描述了本申请实施例提供的图像处理的方法，下文将描述本申请实施例提供的图像处理的装置。The method of image processing provided by the embodiment of the present application is described above, and the apparatus for image processing provided by the embodiment of the present application will be described below.

图4为本申请实施例提供的图像处理的装置300的示意性框图，该装置300包括：FIG. 4 is a schematic block diagram of an apparatus 300 for image processing according to an embodiment of the present disclosure. The apparatus 300 includes:

获取模块310，用于获取第一图像。The obtaining module 310 is configured to acquire the first image.

处理模块320，用于根据空间滤波函数对该第一图像进行处理，以生成第一基本层。The processing module 320 is configured to process the first image according to a spatial filter function to generate a first base layer.

该处理模块还320还用于，对该第一图像与该第一基本层进行减法操作或除法操作，以生成第一细节层。The processing module is further configured to perform a subtraction operation or a division operation on the first image and the first base layer to generate a first detail layer.

该处理模块320还用于，根据该第一图像，确定细节层调整函数，该细节层调整函数的自变量为该第一图像的非线性信号。The processing module 320 is further configured to determine, according to the first image, a detail layer adjustment function, where the independent variable of the detail layer adjustment function is a nonlinear signal of the first image.

该处理模块320还用于，根据该细节层调整函数，对该第一细节层进行调整，以获取第二细节层。The processing module 320 is further configured to adjust the first detail layer according to the detail layer adjustment function to obtain the second detail layer.

该处理模块320还用于，对该第一基本层与该第二细节层进行加法操作或乘法操作，以生成第二图像。The processing module 320 is further configured to perform an adding operation or a multiplication operation on the first base layer and the second detail layer to generate a second image.

在本实施例中，通过建立关于图像的非线性信号的细节层调整函数，即将作用在图像中每一像素点的细节层调整系数与对应像素点的非线性信号进行关联，并通过该细节层调整函数对图像的细节层进行调整，使得能够根据对应像素点的非线性信号，灵活地对细节层中对应像素点进行调整，避免由于细节层调整系数的选取不当，导致调整后的图像中出现人眼能够感知的图像质量问题，进而影响人眼的视觉体验。In this embodiment, by establishing a detail layer adjustment function for the nonlinear signal of the image, the detail layer adjustment coefficient acting on each pixel in the image is associated with the nonlinear signal of the corresponding pixel point, and passes through the detail layer. The adjustment function adjusts the detail layer of the image, so that the corresponding pixel points in the detail layer can be flexibly adjusted according to the nonlinear signal of the corresponding pixel point, thereby avoiding the selection of the adjustment layer of the detail layer, resulting in the image being adjusted. The image quality problem that the human eye can perceive, which in turn affects the visual experience of the human eye.

可选地，该处理模块320具体用于，根据该第一图像的光电转移函数，确定该光电转移函数对应的韦伯weber分数函数；确定该weber分数函数与施赖伯Schreiber阈值函数之间的比值函数；根据该比值函数，确定该细节层调整函数。Optionally, the processing module 320 is configured to determine, according to the photoelectric transfer function of the first image, a Weber weber score function corresponding to the photoelectric transfer function; and determine a ratio function between the weber score function and the Schreiber threshold function; Based on the ratio function, the detail layer adjustment function is determined.

可选地，该细节层调整函数为分段函数，该分段函数包括至少一个分界点，其中，该至少一个分界点为该比值函数的极值点对应的该第一图像的非线性信号，或该至少一个分界点为该weber分数函数与该Schreiber阈值函数的交点对应的该第一图像的非线性信号。Optionally, the detail layer adjustment function is a piecewise function, the piecewise function includes at least one demarcation point, wherein the at least one demarcation point is a non-linear signal of the first image corresponding to an extreme point of the ratio function, Or the at least one demarcation point is a non-linear signal of the first image corresponding to the intersection of the weber score function and the Schreiber threshold function.

可选地，该获取模块310还用于，获取该第一图像的统计数据；该处理模块320还用于，根据该统计数据，确定修正系数a，0＜a≤1；根据该修正系数a，对该细节层调整函数进行修正：Optionally, the obtaining module 310 is further configured to: obtain statistics of the first image; the processing module 320 is further configured to: according to the statistical data, determine a correction coefficient a, 0<a≤1; according to the correction coefficient a , modify the detail layer adjustment function:

F′(V)＝a*F(V)F'(V)=a*F(V)

其中，F′(V)为修正后的细节层调整函数，V为该第一图像的非线性信号。Where F'(V) is the modified detail layer adjustment function, and V is the nonlinear signal of the first image.

可选地，该处理模块320具体用于，根据下述函数关系式确定该修正系数a为：Optionally, the processing module 320 is specifically configured to: determine, according to the following functional relationship, the correction coefficient a is:

g(M)＝M ^r g(M)=M ^r

其中，g(M)为修正系数函数，M为该第一图像的统计数据，r为该修正系数函数g(M)的参数，r＞0。Where g(M) is a correction coefficient function, M is the statistical data of the first image, and r is a parameter of the correction coefficient function g(M), r>0.

可选地，该光电转移函数包括以下光电转移函数中的至少一项：感知量化PQ光电转移函数、场景亮度保真SLF光电转移函数或混合对数伽马HLG光电转移函数。Optionally, the phototransfer function comprises at least one of the following photo transfer functions: a perceptually quantized PQ phototransfer function, a scene luminance fidelity SLF phototransfer function, or a mixed log gamma HLG phototransfer function.

可选地，该细节层调整函数包括以下函数类型中的至少一项：指数函数、对数函数、幂函数或线性函数。Optionally, the detail layer adjustment function comprises at least one of the following function types: an exponential function, a logarithmic function, a power function, or a linear function.

可选地，该细节层调整函数为连续函数。Optionally, the detail layer adjustment function is a continuous function.

具体地，本申请实施例提供的图像处理的装置300中的各个模块均可以由处理器或处理器相关电路组件实现。该装置300中还可以包括存储器，存储器中存储有指令，处理器通过执行存储器存储的指令，以执行装置300中的各个模块的动作。Specifically, each module in the apparatus 300 for image processing provided by the embodiment of the present application may be implemented by a processor or a processor-related circuit component. The apparatus 300 can also include a memory in which instructions are stored, the processor executing the instructions stored in the memory to perform the actions of the various modules in the apparatus 300.

如图5所示，本申请实施例还提供一种图像处理的装置400，该装置400包括处理器410、存储器420与通信接口430，存储器420中存储有指令，处理器410用于执行存储器320中的指令，当该指令被执行时，该处理器410用于执行上述方法实施例提供的方法，处理器410还用于控制通信接口430与外界进行通信。As shown in FIG. 5, the embodiment of the present application further provides an apparatus 400 for image processing. The apparatus 400 includes a processor 410, a memory 420, and a communication interface 430. The memory 420 stores instructions, and the processor 410 is configured to execute the memory 320. The processor 410 is configured to execute the method provided by the foregoing method embodiment, and the processor 410 is further configured to control the communication interface 430 to communicate with the outside world.

应理解，图4所示的装置300，图5所示的装置400可用于执行上述方法实施例中的操作或流程，并且装置300或装置400中的各个模块的操作和/或功能分别为了实现上述方法实施例中的相应流程，为了简洁，在此不再赘述。It should be understood that the apparatus 300 shown in FIG. 4, the apparatus 400 shown in FIG. 5 can be used to perform the operations or processes in the foregoing method embodiments, and the operations and/or functions of the respective modules in the apparatus 300 or the apparatus 400 are respectively implemented. The corresponding processes in the foregoing method embodiments are not described herein for brevity.

本申请实施例还提供一种计算机可读存储介质，该计算机可读存储介质包括计算机程序，当其在计算机上运行时，使得该计算机执行上述方法实施例提供的方法。The embodiment of the present application further provides a computer readable storage medium, comprising a computer program, when executed on a computer, causing the computer to execute the method provided by the foregoing method embodiment.

本申请实施例还提供一种包含指令的计算机程序产品，当该计算机程序产品在计算机上运行时，使得该计算机执行上述方法实施例提供的方法。The embodiment of the present application further provides a computer program product comprising instructions, when the computer program product is run on a computer, causing the computer to execute the method provided by the foregoing method embodiment.

应理解，本发明实施例中提及的处理器可以是中央处理模块(Central Processing Unit，CPU)，还可以是其他通用处理器、数字信号处理器(Digital Signal Processor，DSP)、专用集成电路(Application Specific Integrated Circuit，ASIC)、现成可编程门阵列(Field Programmable Gate Array，FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。It should be understood that the processor mentioned in the embodiment of the present invention may be a central processing unit (CPU), or may be other general-purpose processors, a digital signal processor (DSP), an application specific integrated circuit ( Application Specific Integrated Circuit (ASIC), Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, etc. The general purpose processor may be a microprocessor or the processor or any conventional processor or the like.

还应理解，本申请实施例中提及的存储器可以是易失性存储器或非易失性存储器，或可包括易失性和非易失性存储器两者。其中，非易失性存储器可以是只读存储器(Read-Only Memory，ROM)、可编程只读存储器(Programmable ROM，PROM)、可擦除可编程只读存储器(Erasable PROM，EPROM)、电可擦除可编程只读存储器(Electrically EPROM，EEPROM)或闪存。易失性存储器可以是随机存取存储器(Random Access Memory，RAM)，其用作外部高速缓存。通过示例性但不是限制性说明，许多形式的RAM可用，例如静态随机存取存储器(Static RAM，SRAM)、动态随机存取存储器(Dynamic RAM，DRAM)、同步动态随机存取存储器(Synchronous DRAM，SDRAM)、双倍数据速率同步动态随机存取存储器(Double Data Rate SDRAM，DDR SDRAM)、增强型同步动态随机存取存储器(Enhanced SDRAM，ESDRAM)、同步连接动态随机存取存储器(Synchlink DRAM，SLDRAM)和直接内存总线随机存取存储器(Direct Rambus RAM，DR RAM)。It should also be understood that the memory referred to in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory may be a read-only memory (ROM), a programmable read only memory (PROM), an erasable programmable read only memory (Erasable PROM, EPROM), or an electric Erase programmable read only memory (EEPROM) or flash memory. The volatile memory can be a Random Access Memory (RAM) that acts as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (Synchronous DRAM). SDRAM), Double Data Rate SDRAM (DDR SDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), Synchronous Connection Dynamic Random Access Memory (Synchlink DRAM, SLDRAM) ) and direct memory bus random access memory (DR RAM).

需要说明的是，当处理器为通用处理器、DSP、ASIC、FPGA或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件时，存储器(存储模块)集成在处理器中。It should be noted that when the processor is a general-purpose processor, DSP, ASIC, FPGA or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, the memory (storage module) is integrated in the processor.

应注意，本文描述的存储器旨在包括但不限于这些和任意其它适合类型的存储器。It should be noted that the memories described herein are intended to comprise, without being limited to, these and any other suitable types of memory.

本领域普通技术人员可以意识到，结合本文中所公开的实施例描述的各示例的模块及算法步骤，能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本申请的范围。Those of ordinary skill in the art will appreciate that the modules and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods to implement the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present application.

所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，上述描述的***、装置和模块的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。A person skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the system, the device and the module described above can refer to the corresponding process in the foregoing method embodiment, and details are not described herein again.

在本申请所提供的几个实施例中，应该理解到，所揭露的***、装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述模块的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个模块或组件可以结合或者可以集成到另一个***，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或模块的间接耦合或通信连接，可以是电性，机械或其它的形式。In the several embodiments provided by the present application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the modules is only a logical function division. In actual implementation, there may be another division manner, for example, multiple modules or components may be combined or Can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or module, and may be electrical, mechanical or otherwise.

所述作为分离部件说明的模块可以是或者也可以不是物理上分开的，作为模块显示的部件可以是或者也可以不是物理模块，即可以位于一个地方，或者也可以分布到多个网络模块上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。The modules described as separate components may or may not be physically separated. The components displayed as modules may or may not be physical modules, that is, may be located in one place, or may be distributed to multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

另外，在本申请各个实施例中的各功能模块可以集成在一个处理模块中，也可以是各个模块单独物理存在，也可以两个或两个以上模块集成在一个模块中。In addition, each functional module in each embodiment of the present application may be integrated into one processing module, or each module may exist physically separately, or two or more modules may be integrated into one module.

所述功能如果以软件功能模块的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(Read-Only Memory，ROM)、随机存取存储器(Random Access Memory，RAM)、磁碟或者光盘等各种可以存储程序代码的介质。The functions, if implemented in the form of software functional modules and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application, which is essential or contributes to the prior art, or a part of the technical solution, may be embodied in the form of a software product, which is stored in a storage medium, including The instructions are used to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present application. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes. .

以上所述，仅为本申请的具体实施方式，但本申请的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本申请揭露的技术范围内，可轻易想到变化或替换，都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应以所述权利要求的保护范围为准。The foregoing is only a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto, and any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present application. It should be covered by the scope of protection of this application. Therefore, the scope of protection of the present application should be determined by the scope of the claims.

Claims

一种图像处理的方法，其特征在于，包括：A method of image processing, comprising:

获取第一图像；Obtaining the first image;

根据空间滤波函数对所述第一图像进行处理，以生成第一基本层；Processing the first image according to a spatial filter function to generate a first base layer;

对所述第一图像与所述第一基本层进行减法操作或除法操作，以生成第一细节层；Performing a subtraction operation or a division operation on the first image and the first base layer to generate a first detail layer;

根据所述第一图像，确定细节层调整函数，所述细节层调整函数的自变量为所述第一图像的非线性信号；Determining, according to the first image, a detail layer adjustment function, wherein an independent variable of the detail layer adjustment function is a nonlinear signal of the first image;

根据所述细节层调整函数，对所述第一细节层进行调整，以获取第二细节层；Adjusting the first detail layer according to the detail layer adjustment function to obtain a second detail layer;

对所述第一基本层与所述第二细节层进行加法操作或乘法操作，以生成第二图像。Adding or multiplying the first base layer and the second detail layer to generate a second image.
根据权利要求1所述的方法，其特征在于，所述确定细节层调整函数，包括：The method of claim 1 wherein said determining a level of detail adjustment function comprises:

根据所述第一图像的光电转移函数，确定所述光电转移函数对应的韦伯weber分数函数；Determining, according to the photoelectric transfer function of the first image, a Weber weber score function corresponding to the photoelectric transfer function;

确定施赖伯Schreiber阈值函数与weber分数函数之间的比值函数；Determining a ratio function between the Schreiber Schreiber threshold function and the weber score function;

根据所述比值函数，确定所述细节层调整函数。The detail layer adjustment function is determined based on the ratio function.
根据权利要求2所述的方法，其特征在于，所述细节层调整函数以第一非线性信号为自变量时对应的函数值小于或等于所述比值函数以所述第一非线性信号为自变量时对应的函数值，所述第一非线性信号为所述第一图像的任意一个非线性信号。The method according to claim 2, wherein the detail layer adjustment function takes the first nonlinear signal as an independent variable and the corresponding function value is less than or equal to the ratio function as the first nonlinear signal The variable corresponds to a function value, and the first nonlinear signal is any one of the nonlinear signals of the first image.
根据权利要求3所述的方法，其特征在于，所述细节层调整函数的单调性与所述比值函数的单调性一致。The method of claim 3 wherein the monotonicity of the detail layer adjustment function is consistent with the monotonicity of the ratio function.
根据权利要求2至4中任一项所述的方法，其特征在于，所述细节层调整函数为分段函数，所述分段函数包括至少一个分界点，其中，所述至少一个分界点为所述比值函数的极值点对应的所述第一图像的非线性信号，或The method according to any one of claims 2 to 4, wherein the detail layer adjustment function is a piecewise function, the segmentation function includes at least one demarcation point, wherein the at least one demarcation point is a non-linear signal of the first image corresponding to an extreme point of the ratio function, or

所述至少一个分界点为所述weber分数函数的函数曲线与所述Schreiber阈值函数的函数曲线的交点对应的所述第一图像的非线性信号。The at least one demarcation point is a non-linear signal of the first image corresponding to an intersection of a function curve of the weber score function and a function curve of the Schreiber threshold function.
根据权利要求1至5中任一项所述的方法，其特征在于，还包括：The method according to any one of claims 1 to 5, further comprising:

获取所述第一图像的统计数据；Obtaining statistical data of the first image;

根据所述统计数据，确定修正系数a，0＜a≤1；Determining a correction coefficient a, 0 < a ≤ 1 according to the statistical data;

根据所述修正系数a，对所述细节层调整函数F(V)进行修正：Correcting the detail layer adjustment function F(V) according to the correction coefficient a:

F′(V)＝a*F(V)F'(V)=a*F(V)

其中，F′(V)为修正后的细节层调整函数，V为所述第一图像的非线性信号。Where F'(V) is the modified detail layer adjustment function, and V is the nonlinear signal of the first image.
根据权利要求6所述的方法，其特征在于，所述根据所述统计数据，确定修正系数a，包括：The method according to claim 6, wherein the determining the correction coefficient a according to the statistical data comprises:

根据下述函数关系式确定所述修正系数a为：The correction coefficient a is determined according to the following functional relationship:

g(M)＝M ^r g(M)=M ^r

其中，g(M)为修正系数函数，M为所述第一图像的统计数据，r为所述修正系数函数g(M)的参数，r＞0。Where g(M) is a correction coefficient function, M is statistical data of the first image, and r is a parameter of the correction coefficient function g(M), r>0.
根据权利要求6或7所述的方法，其特征在于，所述统计数据包括以下信息中的至少一项：The method according to claim 6 or 7, wherein said statistical data comprises at least one of the following information:

所述第一图像的最大像素亮度、所述第一图像的平均像素亮度、所述第一图像的像素的非线性Y分量的最小值、所述第一图像的像素的非线性Y分量的最大值或所述第一图像的像素的非线性Y分量平均值。a maximum pixel brightness of the first image, an average pixel brightness of the first image, a minimum value of a nonlinear Y component of a pixel of the first image, a maximum of a nonlinear Y component of a pixel of the first image A value or an average of the nonlinear Y components of the pixels of the first image.
根据权利要求2至8中任一项所述的方法，其特征在于，所述光电转移函数包括以下光电转移函数中的至少一项：The method according to any one of claims 2 to 8, wherein the photoelectric transfer function comprises at least one of the following photoelectric transfer functions:

感知量化PQ光电转移函数、场景亮度保真SLF光电转移函数或混合对数伽马HLG光电转移函数。Perceptually quantized PQ photoelectric transfer function, scene luminance fidelity SLF photoelectric transfer function or mixed log gamma HLG photoelectric transfer function.
根据权利要求1至4中任一项所述的方法，其特征在于，所述细节层调整函数包括以下函数类型中的至少一项：The method according to any one of claims 1 to 4, wherein the detail layer adjustment function comprises at least one of the following types of functions:

指数函数、对数函数、幂函数或线性函数。An exponential function, a logarithmic function, a power function, or a linear function.
根据权利要求1至10中任一项所述的方法，其特征在于，所述细节层调整函数为连续函数。The method according to any one of claims 1 to 10, wherein the detail layer adjustment function is a continuous function.
根据权利要求1至11中任一项所述的方法，其特征在于，所述空间滤波函数包括以下滤波函数中的至少一项：The method according to any one of claims 1 to 11, wherein the spatial filtering function comprises at least one of the following filtering functions:

高斯滤波函数、双边滤波函数或指导滤波函数。Gaussian filter function, bilateral filter function or guide filter function.
一种图像处理的装置，其特征在于，包括：An apparatus for image processing, comprising:

获取模块，用于获取第一图像；Obtaining a module, configured to acquire a first image;

处理模块，用于根据空间滤波函数对所述第一图像进行处理，以生成第一基本层；a processing module, configured to process the first image according to a spatial filter function to generate a first base layer;

所述处理模块还用于，对所述第一图像与所述第一基本层进行减法操作或除法操作，以生成第一细节层；The processing module is further configured to perform a subtraction operation or a division operation on the first image and the first base layer to generate a first detail layer;

所述处理模块还用于，根据所述第一图像，确定细节层调整函数，所述细节层调整函数的自变量为所述第一图像的非线性信号；The processing module is further configured to determine a detail layer adjustment function according to the first image, where an independent variable of the detail layer adjustment function is a nonlinear signal of the first image;

所述处理模块还用于，根据所述细节层调整函数，对所述第一细节层进行调整，以获取第二细节层；The processing module is further configured to: adjust the first detail layer according to the detail layer adjustment function to obtain a second detail layer;

所述处理模块还用于，对所述第一基本层与所述第二细节层进行加法操作或乘法操作，以生成第二图像。The processing module is further configured to perform an adding operation or a multiplication operation on the first base layer and the second detail layer to generate a second image.
根据权利要求13所述的装置，其特征在于，所述处理模块具体用于，根据所述第一图像的光电转移函数，确定所述光电转移函数对应的韦伯weber分数函数；确定所述weber分数函数与施赖伯Schreiber阈值函数之间的比值函数；根据所述比值函数，确定所述细节层调整函数。The apparatus according to claim 13, wherein the processing module is configured to: determine a Weber weber score function corresponding to the photoelectric transfer function according to a photoelectric transfer function of the first image; and determine the weber score A ratio function between the function and the Schreiber Schreiber threshold function; determining the detail layer adjustment function based on the ratio function.
根据权利要求14所述的装置，其特征在于，所述细节层调整函数以第一非线性信号为自变量时对应的函数值小于或等于所述比值函数以所述第一非线性信号为自变量时对应的函数值，所述第一非线性信号为所述第一图像的任意一个非线性信号。The apparatus according to claim 14, wherein the detail layer adjustment function takes a first nonlinear signal as an independent variable and a corresponding function value is less than or equal to the ratio function as the first nonlinear signal The variable corresponds to a function value, and the first nonlinear signal is any one of the nonlinear signals of the first image.
根据权利要求15所述的装置，其特征在于，所述细节层调整函数的单调性与所述比值函数的单调性一致。The apparatus of claim 15 wherein the monotonicity of the detail layer adjustment function is consistent with the monotonicity of the ratio function.
根据权利要求14至16中任一项所述的装置，其特征在于，所述细节层调整函数为分段函数，所述分段函数包括至少一个分界点，其中，所述至少一个分界点为所述比值函数的极值点对应的所述第一图像的非线性信号，或The apparatus according to any one of claims 14 to 16, wherein the detail layer adjustment function is a piecewise function, the segmentation function includes at least one demarcation point, wherein the at least one demarcation point is a non-linear signal of the first image corresponding to an extreme point of the ratio function, or

所述至少一个分界点为所述weber分数函数与所述Schreiber阈值函数的交点对应的所述第一图像的非线性信号。The at least one demarcation point is a non-linear signal of the first image corresponding to an intersection of the weber score function and the Schreiber threshold function.
根据权利要求13至17中任一项所述的装置，其特征在于，所述获取模块还用于，获取所述第一图像的统计数据；The device according to any one of claims 13 to 17, wherein the obtaining module is further configured to acquire statistical data of the first image;

所述处理模块还用于，The processing module is further configured to

根据所述统计数据，确定修正系数a，0＜a≤1；Determining a correction coefficient a, 0 < a ≤ 1 according to the statistical data;

根据所述修正系数a，对所述细节层调整函数进行修正：Correcting the detail layer adjustment function according to the correction coefficient a:

F′(V)＝a*F(V)F'(V)=a*F(V)

其中，F′(V)为修正后的细节层调整函数，V为所述第一图像的非线性信号。Where F'(V) is the modified detail layer adjustment function, and V is the nonlinear signal of the first image.
根据权利要求18所述的装置，其特征在于，所述处理模块还用于，The device according to claim 18, wherein said processing module is further configured to:

根据下述函数关系式确定所述修正系数a为：The correction coefficient a is determined according to the following functional relationship:

g(M)＝M ^r g(M)=M ^r

其中，g(M)为修正系数函数，M为所述第一图像的统计数据，r为所述修正系数函数g(M)的参数，r＞0。Where g(M) is a correction coefficient function, M is statistical data of the first image, and r is a parameter of the correction coefficient function g(M), r>0.
根据权利要求18或19所述的装置，其特征在于，所述统计数据包括以下信息中的至少一项：The apparatus according to claim 18 or 19, wherein said statistical data comprises at least one of the following information:

所述第一图像的最大像素亮度、所述第一图像的平均像素亮度、所述第一图像的像素的非线性Y分量的最小值、所述第一图像的像素的非线性Y分量的最大值或所述第一图像的像素的非线性Y分量平均值。a maximum pixel brightness of the first image, an average pixel brightness of the first image, a minimum value of a nonlinear Y component of a pixel of the first image, a maximum of a nonlinear Y component of a pixel of the first image A value or an average of the nonlinear Y components of the pixels of the first image.
根据权利要求14至20中任一项所述的装置，其特征在于，所述光电转移函数包括以下光电转移函数中的至少一项：The apparatus according to any one of claims 14 to 20, wherein the photoelectric transfer function comprises at least one of the following photoelectric transfer functions:

感知量化PQ光电转移函数、场景亮度保真SLF光电转移函数或混合对数伽马HLG光电转移函数。Perceptually quantized PQ photoelectric transfer function, scene luminance fidelity SLF photoelectric transfer function or mixed log gamma HLG photoelectric transfer function.
根据权利要求13至16中任一项所述的装置，其特征在于，所述细节层调整函数包括以下函数类型中的至少一项：The apparatus according to any one of claims 13 to 16, wherein the detail layer adjustment function comprises at least one of the following types of functions:

指数函数、对数函数、幂函数或线性函数。An exponential function, a logarithmic function, a power function, or a linear function.
根据权利要求13至22中任一项所述的方法，其特征在于，所述细节层调整函数为连续函数。The method according to any one of claims 13 to 22, wherein the detail layer adjustment function is a continuous function.
根据权利要求13至23中任一项所述的装置，其特征在于，所述第一细节层为对所述第一图像与所述第一基本层进行处理后生成的，包括：The device according to any one of claims 13 to 23, wherein the first detail layer is generated after processing the first image and the first base layer, and comprises:

所述第一细节层为对所述第一图像与所述第一基本层进行减法操作后生成的，或，The first detail layer is generated after performing a subtraction operation on the first image and the first base layer, or

所述第一细节层为对所述第一图像与所述第一基本层进行除法操作后生成的。The first detail layer is generated after performing a division operation on the first image and the first base layer.
根据权利要求14至24中任一项所述的装置，其特征在于，所述第二图像为对第一基本层与第二细节层进行处理后生成的，包括：The device according to any one of claims 14 to 24, wherein the second image is generated after processing the first base layer and the second detail layer, and comprises:

所述第二图像为对所述第一基本层与所述第二细节层进行加法操作后生成的，或，The second image is generated after adding the first base layer and the second detail layer, or

所述第二图像为对所述第一基本层与所述第二细节层进行乘法操作后生成的。The second image is generated after multiplying the first base layer and the second detail layer.
根据权利要求14至25中任一项所述的装置，其特征在于，所述空间滤波函数包括以下滤波函数中的至少一项：Apparatus according to any one of claims 14 to 25, wherein the spatial filtering function comprises at least one of the following filtering functions:

高斯滤波函数、双边滤波函数或指导滤波函数。Gaussian filter function, bilateral filter function or guide filter function.
一种计算机可读存储介质，其特征在于，包括计算机程序，当所述计算机程序在计算机上运行时，使得所述计算机执行如权利要求1-12中任一项所述的方法。A computer readable storage medium, comprising a computer program, when the computer program is run on a computer, causing the computer to perform the method of any one of claims 1-12.
一种包含指令的计算机程序产品，其特征在于，当所述计算机程序产品在计算机上运行时，使得所述计算机执行如权利要求1-12中任一项所述的方法。A computer program product comprising instructions, wherein the computer program product, when run on a computer, causes the computer to perform the method of any one of claims 1-12.