CN115761015A - Tone mapping method, device and related equipment - Google Patents
Tone mapping method, device and related equipment Download PDFInfo
- Publication number
- CN115761015A CN115761015A CN202211433422.9A CN202211433422A CN115761015A CN 115761015 A CN115761015 A CN 115761015A CN 202211433422 A CN202211433422 A CN 202211433422A CN 115761015 A CN115761015 A CN 115761015A
- Authority
- CN
- China
- Prior art keywords
- target frame
- tone mapping
- brightness
- mapping
- value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000013507 mapping Methods 0.000 title claims abstract description 294
- 238000000034 method Methods 0.000 title claims abstract description 56
- 238000013139 quantization Methods 0.000 claims abstract description 69
- 238000004364 calculation method Methods 0.000 claims abstract description 12
- 238000009826 distribution Methods 0.000 claims description 52
- 230000011218 segmentation Effects 0.000 claims description 12
- 238000006243 chemical reaction Methods 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 8
- 230000004048 modification Effects 0.000 claims description 4
- 238000012986 modification Methods 0.000 claims description 4
- 239000000126 substance Substances 0.000 claims description 2
- 230000000007 visual effect Effects 0.000 abstract description 6
- 230000006870 function Effects 0.000 description 12
- 238000012545 processing Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 241000023320 Luma <angiosperm> Species 0.000 description 6
- OSWPMRLSEDHDFF-UHFFFAOYSA-N methyl salicylate Chemical compound COC(=O)C1=CC=CC=C1O OSWPMRLSEDHDFF-UHFFFAOYSA-N 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 239000000047 product Substances 0.000 description 6
- 230000003068 static effect Effects 0.000 description 6
- 238000012937 correction Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 5
- 239000000463 material Substances 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000006835 compression Effects 0.000 description 3
- 238000007906 compression Methods 0.000 description 3
- 230000009467 reduction Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000007795 chemical reaction product Substances 0.000 description 1
- 238000013506 data mapping Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 239000012769 display material Substances 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/40—Image enhancement or restoration using histogram techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T9/00—Image coding
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Processing (AREA)
Abstract
The invention relates to a tone mapping method, a tone mapping device and related equipment, and belongs to the technical field of tone mapping. The method, the device and the related equipment are characterized in that after a color coding signal, a brightness characteristic parameter and a characteristic parameter of a display terminal of each target frame are obtained, the brightness characteristic parameter and the display characteristic parameter of the display terminal of the target frame are considered, and a tone mapping curve is obtained through calculation; and calculating to obtain a detail loss quantization value of the current target frame based on the color coding signals before and after tone mapping curve mapping, so as to correct the tone mapping curve of the target frame according to the detail loss quantization value and the brightness characteristic parameter. By adopting the technical scheme provided by the invention, the corrected tone mapping curve can reduce the detail loss before and after mapping under different brightness characteristic parameters, thereby solving the technical problem that the dark part details are smoothed to a certain extent in the prior art, improving the image information quality and the visual effect, and improving the adaptability of the final mapping image and the brightness peak value of the display terminal.
Description
Technical Field
The invention relates to the technical field of tone mapping, in particular to a tone mapping method, a tone mapping device and related equipment.
Background
Technological advances have led to the development of information Display material technology, and for example, end products, LCDs (Liquid Crystal displays) and OLEDs (Organic Light-Emitting semiconductors) have been widely used. Currently, the peak brightness of mainstream LCD and OLED devices can reach 500nit, which is significantly different from some industry standards. For example, the HDR (High-Dynamic Range) Standard developed by the SDR (Standard Dynamic Range) Standard specifies a maximum luminance of 10000nit, and the maximum luminance of HDR material is generally over 1000nit, which is significantly larger than the peak luminance of mainstream LCD and OLED devices.
In order to perfectly present the HDR effect on a display terminal and solve the matching problem between high dynamics and low dynamics, a tone mapping technique is developed in the related art. Tone Mapping technology, which is a computer graphics technology for approximately displaying high Dynamic range images on a medium with limited Dynamic range, includes static Tone Mapping and Dynamic Tone Mapping (Dynamic Tone-Mapping). Static tone mapping means that the form of a mapping curve is fixed for a certain video sequence, and dynamic tone mapping dynamically generates a mapping curve according to a video scene and the display performance of a terminal. Thus, in general, the effect of dynamic tone mapping can be significantly better than static tone mapping.
Currently, the dynamic tone mapping standards mainly used in the world include ST2094-20, ST2094-40, T/UWA005.1-2022, and the like. However, mapping curves corresponding to these standards still present problems in large-scale applications. For example, when the overall brightness difference is large and the dark details are rich, the dark details will be smoothed to some extent by processing the tone mapping curves, thereby causing the loss of screen information and leading to poor visual effect.
Disclosure of Invention
In view of the above, the present invention provides a tone mapping method, a device and a related apparatus, so as to overcome the problem that the current dynamic tone mapping technology risks smoothing the details of the dark portion, so that the picture information is lost.
In order to achieve the purpose, the invention adopts the following technical scheme:
in one aspect, a tone mapping method is applied to a display terminal, and the method includes:
acquiring a color coding signal and a brightness characteristic parameter of a target frame; acquiring display characteristic parameters of the display terminal;
calculating a tone mapping curve of the current target frame according to the brightness characteristic parameter and the display characteristic parameter;
mapping the color coding signal of the target frame according to the tone mapping curve to obtain a mapped color coding signal;
calculating a detail loss quantization value of the current target frame based on color coding signals before and after mapping;
modifying the tone mapping curve based on the detail loss quantization value and the brightness characteristic parameter;
and tone mapping is carried out on the current target frame according to the corrected preset tone mapping curve.
In another aspect, a tone mapping apparatus applied to a display terminal includes:
the acquisition module is used for acquiring a color coding signal and a brightness characteristic parameter of a target frame; acquiring display characteristic parameters of the display terminal;
the first calculation module is used for calculating a tone mapping curve of the current target frame according to the brightness characteristic parameter and the display characteristic parameter;
the first mapping module is used for mapping the color coding signal of the target frame according to the tone mapping curve to obtain a mapped color coding signal;
the second calculation module is used for calculating a detail loss quantization value of the current target frame based on the color coding signals before and after mapping;
a modification module for modifying the tone mapping curve based on the detail loss quantization value and the luminance characteristic parameter;
and the second mapping module is used for carrying out tone mapping on the current target frame according to the corrected preset tone mapping curve.
In yet another aspect, an electronic device includes:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the tone mapping method of any one of the above.
In yet another aspect, a non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the tone mapping method of any of the above.
In a further aspect, a computer program product comprising a computer program which, when executed by a processor, implements a tone mapping method according to any of the above.
The technical scheme provided by the invention at least has the following beneficial effects:
after acquiring the color coding signal, the brightness characteristic parameter and the characteristic parameter of the display terminal of each target frame, calculating to obtain a tone mapping curve by considering the brightness characteristic parameter of the target frame and the display characteristic parameter of the display terminal; and calculating to obtain a detail loss quantization value of the current target frame based on the color coding signals before and after tone mapping curve mapping, so as to correct the tone mapping curve of the target frame according to the detail loss quantization value and the brightness characteristic parameter. By adopting the technical scheme provided by the invention, when the detail loss quantization value is calculated, the difference of color coding signals of the target frame before and after mapping is considered, and the tone mapping curve is synchronously corrected according to the brightness characteristic parameter and the detail loss quantization value, so that the corrected tone mapping curve can reduce the detail loss before and after mapping under different brightness characteristic parameters, thereby solving the technical problem that the dark part detail in the prior art is smoothed to a certain extent, improving the image information quality and the visual effect, and improving the adaptability of the final mapping image and the brightness peak value of the display terminal.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a flowchart illustrating a tone mapping method according to an embodiment of the present invention;
FIG. 2 is a diagram illustrating a standard S-shaped mapping curve according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a tone mapping curve according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of a tone mapping apparatus according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be described in detail below. It should be apparent that the described embodiments are only some embodiments of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the examples given herein without any inventive step, are within the scope of the present invention.
Currently, the peak brightness of mainstream LCD and OLED devices can reach 500nit, which is significantly different from some industry standards. For example, the SDR (Standard Dynamic Range) Standard specifies a maximum luminance of 100nit, significantly less than the peak luminance of mainstream LCD and OLED devices; whereas the HDR (High-Dynamic Range) standard specifies a maximum luminance of 10000nit, the maximum luminance of HDR material is generally over 1000nit, which is significantly larger than the peak luminance of mainstream LCD and OLED devices.
In order to improve the display effect of the terminal device and solve the matching problem between the high dynamic state and the low dynamic state, a tone mapping technique is usually adopted to complete the matching between the high dynamic state and the low dynamic state. Tone mapping technology, which is a computer graphics technology for approximately displaying high dynamic range images on a medium with limited dynamic range, includes static tone mapping and dynamic tone mapping. Static tone mapping means that the form of a mapping curve is fixed for a certain video sequence, and dynamic tone mapping dynamically generates a mapping curve according to a video scene and the display performance of a terminal. Thus, in general, the effect of dynamic tone mapping will be significantly better than static tone mapping.
However, in the related art, the dynamic tone mapping technique generally performs linear compression processing on a dark portion of a video, and it is difficult to determine the intensity of dark portion compression, and there is a risk that details of the dark portion are smoothed, so that screen information is lost.
In the embodiment of the present invention, a tone mapping curve is explained: currently, the dynamic tone mapping standards which are mainstream internationally include ST2094-20, ST2094-40, T/UWA005.1-2022 and the like. In each of the three standards, a tone mapping curve composed of a linear straight line and a curved line is included.
However, when the overall brightness difference is large and the dark details are rich, the dark details are smoothed to some extent by processing the tone mapping curves, which results in loss of picture information and poor visual effect.
Based on this, the embodiment of the invention provides a tone mapping method, a tone mapping device and related equipment.
Fig. 1 is a flowchart illustrating a tone mapping method according to an embodiment of the present invention, where the tone mapping method can be applied to various display terminals, for example, the method may include, but is not limited to: notebook computers, mobile phones, televisions, tablet computers, calculators, telephone watches, and the like.
It can be understood that, at present, the playing technology of the SDR/HDR video does not leave the tone mapping curve, and the technical scheme provided by the embodiment can adaptively correct the tone mapping curve, and avoid the loss of the detail information in the mapping process, thereby ensuring the playing effect of the SDR/HDR video.
Referring to fig. 1, the technical solution provided by the present invention may include the following steps:
s1, acquiring a color coding signal and a brightness characteristic parameter of a target frame; and acquiring the display characteristic parameters of the display terminal.
And S2, calculating a tone mapping curve of the current target frame according to the brightness characteristic parameter and the display characteristic parameter.
And S3, mapping the color coding signal of the target frame according to the tone mapping curve to obtain a mapped color coding signal.
And S4, calculating a detail loss quantization value of the current target frame based on the color coding signals before and after mapping.
And S5, correcting the tone mapping curve based on the detail loss quantization value and the brightness characteristic parameter.
And S6, tone mapping is carried out on the current target frame according to the corrected preset tone mapping curve.
In a specific tone mapping process, sequentially determining each frame image as a target frame according to the arrangement sequence of the frame images in the video stream, thereby carrying out tone mapping on each frame image and finally realizing the tone mapping on the video stream; each target frame is composed of a plurality of pixel points. The video stream may be an HDR video or an SDR video.
As for step S1, in an embodiment of the present invention, the specific process of "acquiring the color-coded signal of the target frame" in step S1 may include the following steps:
s11, receiving a video stream, and decoding the video stream to obtain YUV electric signals of a target frame;
step S12, converting the YUV electric signal into an RGB electric signal based on a color gamut conversion standard;
and S13, taking the YUV electric signal and the RGB electric signal as color coding signals.
And determining the received video stream, decoding the video stream, and directly obtaining the YUV electric signals of the target frame by decoding. YUV, which is a color coding method, "Y" represents brightness (Luma) and can be used to identify brightness; "U" and "V" denote Chrominance (Chroma) which is used to describe the color and saturation of an image for a given pixel color. And decoding to obtain a YUV electric signal of a target frame, namely Y, U and V information of each pixel point in the target frame, and converting the YUV electric signal into an RGB electric signal according to a color gamut conversion standard.
It is worth noting that the gamut conversion standard may be the industry gamut standard BT709 or BT2020. Specifically, the YUV electrical signal may be converted into an RGB electrical signal according to formula (1):
in the formula (1), a, b, c, d and e are all coefficients, and after Y, U and V of each pixel point are determined, the Y, U and V of each point are input into the formula (1) to obtain RGB electric signals of each pixel point. Under different standards, a, b, c, d and e are different values. For example, under the BT709 standard, then a =0.2126, b =0.7152, c =0.0722, d =1.8556, e =1.5748; under the BT2020 standard, a =0.2627, b =0.6780, c =0.0593, d =1.8814, e =1.4746.
It can be understood that, according to the method for determining pixel information of a target frame provided by the embodiment of the present invention, by converting a YUV electrical signal of the target frame into an RGB electrical signal, rapid processing of information is realized, which is convenient and fast, so as to facilitate subsequent calculation of a detail loss quantization value.
The luminance characteristics may include a luminance intensity StrengthL, an average luminance Midluma, a median luminance MeanLuma, a segmentation point RegionD of a bright area and a dark area, a maximum luminance, a minimum luminance, and the like, among others. The display features may include: maximum screen brightness MaxDisplay, minimum screen brightness MinDisplay, screen resolution RES, and the like.
It should be noted that the luminance characteristic may be obtained by calculation, and the specific processing procedure of "acquiring the luminance characteristic parameter" in step S1 may include the following steps:
step one, calculating the brightness intensity of a target frame, specifically comprising:
counting the pixel distribution of a brightness component Y in the YUV electric signal, determining a histogram distribution HistY of the YUV brightness component Y, and determining a middle gray value MildGray of the histogram distribution HistY, wherein the pixel distribution comprises the following steps:
the middle gray value of the histogram distribution HistY is taken as a fixed value, for example, as midgray =118;
determining the square root of the product of the maximum and minimum luminance values in HistY as the middle gray value of HistY, e.g. taking
Where maxY is the maximum value of luminance in the histogram distribution HistY (i.e., the maximum value of coordinates on the abscissa), and minY is the minimum value of luminance in the histogram distribution HistY (i.e., the minimum value of coordinates on the abscissa).
Calculating the expectation of the pixel points with the brightness value i larger than the middle gray value MildGray in the histogram distribution HistY, and recording the expectation as the brightness intensity Strength L, wherein the expectation specifically comprises the following steps:
Strength L＝∑ i＞MildGray HisyY[I]*I∑ i＞MildGray HistY[i]。
step two, calculating the average brightness of the target frame, specifically comprising:
converting the electric signal of the target frame into an optical signal according to a preset electro-optical conversion function;
luma [ i ] = EOTF709 (i/255); i/255 represents a pixel value of the normalized electric signal, and Luma [ i ] represents a pixel value after conversion into an optical signal; the function EOTF709 () represents the electro-optical conversion function specified by the rec.709 standard, specifically:
Traversing all brightness values of the optical signal, and calculating the sum of products of each brightness value Luma [ i ] and the number HistY [ i ] of pixels corresponding to the brightness value Luma [ i ] in the histogram distribution HistY;
determining the ratio of the sum of the products to the screen resolution RES of the terminal device as the average brightness midcolumn, specifically:
Midluma＝∑HistY[i]*Luma[i]/RES。
step three: calculating a median brightness value of the target frame, specifically comprising:
the MeanLuma of the target frame is the brightness value of each pixel point in the target frame which is arranged from small to large according to the brightness value, and the middle brightness value is taken as the brightness median. For example, it may be the median luminance value (i.e., the horizontal-vertical median value) of the histogram HistY.
Step four: calculating segmentation points of a bright part area and a dark part area of a target frame, specifically comprising:
calculating the expectation of pixel points with the brightness value i between zero and the middle gray value [ 0-MildGray ] in the histogram distribution HistY, and marking as the average darkness Meandark;
MeanDark＝∑ i∈[0,MildGray] HistY[i]*i/∑ i∈[0,MildGray] HistY[i]；
calculating the average value of the average darkness and the middle gray value, and determining the average value as a segmentation point RegionD, wherein the method specifically comprises the following steps:
for step S2, in an embodiment of the present invention, the bright area and the dark area may be specifically distinguished, and an S-shaped mapping curve of the bright area of the current target frame and a linear mapping straight line of the dark area of the current target frame are determined according to the display characteristic parameter and the brightness characteristic parameter; and combining the S-shaped mapping curve and the linear mapping straight line to obtain the tone mapping curve of the current target frame.
Specifically, a standard S-type mapping curve can be selected and determined from preset standards (such as ST2094-20, ST2094-40, and T/UWA 005.1-2022). After a standard S-shaped mapping curve is determined, inputting the brightness characteristic parameters and the display characteristic parameters obtained in the invention into a parameter calculation formula specified by a standard so as to calculate the parameters of the S-shaped mapping curve, and substituting the parameters into the standard S-shaped mapping curve to obtain the S-shaped mapping curve of the brightness area of the current target frame; similarly, the linear mapping straight line of the dark region of the current target frame is obtained through calculation, and the linear mapping straight line of the dark region of the current target frame and the functional relation of the S-shaped mapping curve of the brightness region of the current target frame are combined to obtain a piecewise function, namely the tone mapping curve of the current target frame.
For example, a schematic diagram of a standard S-type mapping curve shown in fig. 2 is taken as an example for explanation.
Referring to fig. 2, the abscissa and the ordinate both represent normalized pixel values, where "1" represents a pixel value of 255, "0.1" represents a pixel value of 0.1 × 255, "0.2" represents a pixel value of 0.2 × 255, and so on.
Assume that the functional expression of the standard S-type mapping curve is F (L) = ((mp. L)/((mp-1). L + 1)) 3.2+deltaM (2). Wherein, L represents the normalized pixel value of the original RGB electrical signal, L = i/255, F (L) represents the normalized pixel value of the RGB electrical signal after mapping correction; the upper limit value of the parameter mp is solved according to the following equation (3):
wherein strengthL' represents the normalized brightness intensity, and mpMax represents the upper limit value of mp; the specific value of the parameter mp is updated according to the following equation (5):
MidLuma' denotes the normalized average luminance.
The parameter deltaM is solved according to equation (6) as follows:
MinDisplay represents the default value of minimum screen brightness, regionD' represents the segment points of the normalized light and dark regions, and EOTF709 () represents the electro-optic conversion function specified by the REC.709 standard.
Similarly, a function expression of the linear straight line of the dark area can be calculated according to the brightness characteristic parameter and the display characteristic parameter.
For example, the product of the reciprocal of the default value of the maximum screen brightness MaxDisplay and a preset fixed constant (e.g., 100) is calculated; a preset power of the product, for example, C0, is raised and the result is determined as the limit value SlopeLimit of the slope of the linear mapping straight line, the preset power C0 being related to a default value of the minimum screen brightness, specifically:
determining the ordinate corresponding to the normalized segmentation point on the bright part S-shaped mapping curve, specifically:
the value F (RegionD ') is obtained by substituting RegionD' into the above formula (3).
The ratio F (RegionD ')/(RegionD') of the ordinate to the normalized segmentation point is determined as the reference slope.
Comparing the limit value of the Slope with the reference Slope, and determining the minimum value of the limit value and the reference Slope as the Slope of the dark part linear mapping straight line, specifically:
determining a function expression of a linear mapping straight line of a dark part area of the current frame video image according to the slope and the normalized segmentation point, wherein the function expression specifically comprises the following steps:
TM(L)＝Slope*L，L≤RegionD′ (10)。
fig. 3 is a schematic diagram of a tone mapping curve according to an embodiment of the present invention, referring to fig. 3, in which the abscissa and the ordinate both represent normalized pixel values, where "1" represents a pixel value of 255, "0.1" represents a pixel value of 0.1 × 255, "0.2" represents a pixel value of 0.2 × 255, and so on. When the abscissa is [0,0.2], a linear mapping straight line corresponding to the dark part region; at abscissa (0.2, 1), combining the linear mapping straight line and the function expression of the S-shaped mapping curve obtained by the above calculation, corresponding to the S-shaped mapping curve of the highlight region, to obtain the tone mapping curve TM (L) of the current target frame:
Specifically, in step S3, the YUV electrical signal and the RGB electrical signal of the target frame are mapped according to the calculated tone mapping curve, so as to obtain a YUV electrical signal and a RGB electrical signal after mapping.
In an embodiment of the present invention, the step S3 maps the color-coded signal of the target frame according to the tone mapping curve to obtain a mapped color-coded signal, and the specific processing procedure may include the following steps:
step S31, mapping the brightness component Y in the YUV electric signals of the current target frame into a brightness component Y' according to the calculated tone mapping curve; according to the tone mapping curve, mapping the red component R in the RGB electric signal of the current target frame into a red component R ', mapping the green component G in the RGB electric signal of the current target frame into a green component G ', and mapping the blue component B in the RGB electric signal of the current target frame into a blue component B ';
step S32 is to use the brightness component Y ', the red component R', the green component G ', and the blue component B' as the mapped color-coded signals.
Specifically, in step S4, after the YUV electrical signal and the RGB electrical signal are mapped according to the tone mapping curve, the detail loss quantization value of the current target frame is calculated according to the YUV electrical signal and the RGB electrical signal before and after mapping.
In an embodiment of the present invention, the specific processing procedure of step S4 may include the following steps:
s41, calculating an information entropy loss quantization value of brightness according to the YUV electric signals before and after the mapping of the target frame;
s42, calculating an information entropy loss quantization value of the chromaticity according to the RGB electric signals before and after the target frame mapping;
and S43, calculating a detail loss quantization value of the current target frame according to the information entropy loss quantization value of the brightness and the information entropy loss quantization value of the chromaticity based on the preset loss coefficient.
In some embodiments, step S41 may specifically include the following steps:
step S411, counting pixel distribution of brightness component Y in YUV electric signals, and determining histogram distribution HistY of the YUV brightness component Y; counting the pixel distribution of the brightness component Y 'in the mapped YUV electric signals, and determining the histogram distribution HistYtm of the mapped brightness component Y';
step S412, respectively calculating the information entropy of the histogram distribution HistY and the information entropy of the histogram distribution HistYtm;
in step S413, the absolute value of the difference between the information entropy of HistY and the information entropy of HistYtm is determined as the information entropy loss quantization value of brightness.
In some embodiments, step S42 may specifically include the following steps:
step S421, respectively counting the pixel distribution of the red component R and the mapped red component R' in the RGB electric signal, and determining the histogram distribution HistR and HistRtm of the red component before and after mapping; respectively counting the pixel distribution of a green component G and a mapped red component G' in the RGB electric signal, and determining the histogram distribution HistG and HistGtm of the green component before and after mapping; respectively counting the pixel distribution of the blue component B and the mapped blue component B' in the RGB electric signal, and determining the histogram distribution HistB and HistBtm of the blue component before and after mapping;
step S422, respectively calculating the information entropy of histogram distribution HistR and HistRtm, and determining that the absolute value of the difference value between the information entropy of HistR and the information entropy of HistRtm is the information entropy loss quantization value of the red component R; respectively calculating the information entropy of histogram distribution HistG and HistGtm, and determining the absolute value of the difference value between the information entropy of HistG and the information entropy of HistGtm as the information entropy loss quantization value of the green component G; determining the absolute value of the difference value between the information entropy of HistB and the information entropy of HistBtm as the information entropy loss quantization value of the blue component B;
step S423, the sum of the information entropy loss quantized value of the red component R, the information entropy loss quantized value of the green component G, and the information entropy loss quantized value of the blue component B is used as the information entropy loss quantized value of the chroma.
In some embodiments, step S43 may specifically include the following steps:
and calculating the sum of the information entropy loss quantized value of the brightness and the information entropy loss quantized value of the chromaticity of the current target frame, and modifying the sum on the basis of a preset loss coefficient to obtain the detail loss quantized value of the current target frame.
The preset loss coefficient can be optimally valued according to multiple experimental data or set according to experience, and can be set to be 0.1.
Specifically, the detail loss quantization value can be expressed by a formula:
in formula (12) and formula (13), delatnfo is a detail loss quantization value, res is a total number of pixels of the target frame, en (HistX) represents information entropy of X, abs () represents an absolute value, res represents a total number of pixels of the target frame, N represents a maximum pixel value of the target frame, and N =1023 for HDR video; for SDR video, N =255.L represents the normalized pixel value, L = i/255 for SDR video; for HDR video, L = i/1023,i represents the pixel values.
In some embodiments, the luminance characteristic parameters include a median luminance value and an average luminance value; step S5 may include the steps of:
if the median brightness value of the target frame is smaller than the average brightness value, increasing the slope of a linear mapping straight line of a dark part area in the tone mapping curve based on the detail loss quantization value;
and updating the segmentation points of the S-shaped mapping curve of the bright part area and the linear mapping straight line of the dark part area of the current target frame according to the increased slope, and taking the updated tone mapping curve of the current target frame as the modified tone mapping curve of the current target frame.
For example, when the MeanLuma < MidLuma, the overall brightness of the bright target frame screen is low, and only the slope of the linear mapping straight line in the dark portion region of the preset tone mapping curve is corrected. For example, taking a tone mapping curve provided in standard ST2094-20 as an example, if the slope of the linear mapping straight line of the dark region is slopo, the slope of the dark region is increased, and the slope slopon of the mapping straight line of the dark region after correction is:
SlopeN＝SlopeO+deltaInfo；
correspondingly, after the slope of the mapping straight line of the dark part area is adjusted, the S-shaped mapping curve of the bright part area of the current target frame and the segment points of the linear mapping straight line of the dark part area are synchronously updated, and the segment points P can satisfy the following conditions:
SlopeN＝TM(P)/P；
at the segment point P, the slope is the same as the slope of the mapping straight line of the dark portion region after correction.
It can be understood that, in the technical solution provided by the embodiment of the present invention, the dark slope of the preset tone mapping curve is increased by the detail loss quantization value, so as to improve the picture quality. In some scenarios, when the corrected slope is close to 1, there is hardly any compression processing on the dark portion, so that the picture loss amount is minimized.
In some embodiments, the luminance characteristic parameters include a median luminance value and an average luminance value; step S5 may include the steps of:
if the median brightness value of the target frame is larger than or equal to the average brightness value, reducing the curvature of an S-shaped mapping curve of a bright part area in the tone mapping curve based on the detail loss quantization value;
and updating the segmentation points of the linear mapping straight line of the S-shaped mapping curve and the dark part region of the bright part region and the dark part region of the current target frame according to the reduced curvature, and taking the updated tone mapping curve of the current target frame as the modified tone mapping curve of the current target frame.
For example, when MeanLuma ≧ MidLuma indicates that the overall brightness of the screen is high, the S-shaped curve portion may be corrected to reduce the curvature of the S-shaped curve. Because a standard sigmoid curve is used in constructing the tone mapping curve, different tone mapping curves generally have different sigmoid curves.
For example, taking a tone mapping curve provided by the ST2094-40 standard as an example, in the S-shaped curve portion, P0 is modified to achieve the purpose of reducing the curvature of the S-shaped curve. The standard sigmoid curve of the ST2094-40 standard tone mapping curve is of the form:
F(L)＝P0*L 2 *(1-L) 2 +P1*L 3 *(1-L)+P2*L 4 ；
the curvature reduction can be achieved by correcting P0, and the curvature P0N of the corrected preset tone mapping curve can be expressed as:
P0 N ＝P0-beta*deltaInfo。
wherein, beta is the influence parameter of the S-shaped curve of the tone mapping curve of the ST2094-40 standard, and can be calculated and set according to the standard introduction.
As another example, for the T/UWA005.1-2022 standard tone mapping curve, the S-shaped curve of the T/UWA005.1-2022 standard tone mapping curve is in the form:
F(L)＝((mp*L mn )/((k1*mp-k2)*L mn +k3)) mm ；
the curvature reduction is achieved by the modified mp, and therefore the curvature mpN of the modified preset tone mapping curve can be expressed as:
mpN＝mp-alpha*deltaInfo。
wherein, the influence parameters of the tone mapping curve with alpha being T/UWA005.1-2022 standard can be calculated and set according to the standard introduction.
It can be understood that, in the technical solution provided in the embodiment of the present invention, when the brightness of the target frame picture is bright, the S-shaped curve portion of the bright portion of the preset tone mapping curve is modified, that is, the curvature of the preset tone mapping curve is reduced by the detail loss quantization value, so that the data mapping of the bright portion in the mapping process is reduced, and the picture quality is improved.
It can be understood that, with the tone mapping method according to the embodiment of the present invention, after the color coding signal, the luminance characteristic parameter, and the characteristic parameter of the display terminal of each target frame are obtained, the luminance characteristic parameter of the target frame and the display characteristic parameter of the display terminal are considered, and a tone mapping curve is obtained through calculation; and calculating to obtain a detail loss quantization value of the current target frame based on the color coding signals before and after tone mapping curve mapping, so as to correct the tone mapping curve of the target frame according to the detail loss quantization value and the brightness characteristic parameter. By adopting the technical scheme provided by the invention, when the detail loss quantization value is calculated, the difference of color coding signals of the target frame before and after mapping is considered, and the tone mapping curve is synchronously corrected according to the brightness characteristic parameter and the detail loss quantization value, so that the corrected tone mapping curve can reduce the detail loss before and after mapping under different brightness characteristic parameters, thereby solving the technical problem that the dark part detail in the prior art is smoothed to a certain extent, improving the image information quality and the visual effect, and improving the adaptability of the final mapping image and the brightness peak value of the display terminal.
Based on one general inventive concept, an embodiment of the present invention further provides a tone mapping apparatus for implementing the above method embodiments.
Fig. 4 is a schematic structural diagram of a tone mapping apparatus according to an embodiment of the present invention, and referring to fig. 4, the apparatus according to an embodiment of the present invention may include the following structures:
an obtaining module 41, configured to obtain a color coding signal and a brightness characteristic parameter of a target frame; acquiring display characteristic parameters of the display terminal;
a first calculating module 42, configured to calculate a tone mapping curve of the current target frame according to the luminance characteristic parameter and the display characteristic parameter;
a first mapping module 43, configured to map a color-coded signal of a target frame according to a tone mapping curve to obtain a mapped color-coded signal;
a second calculating module 44, configured to calculate a detail loss quantization value of the current target frame based on the color coding signals before and after mapping;
a correction module 45, configured to correct the tone mapping curve based on the detail loss quantization value and the luminance characteristic parameter;
and a second mapping module 46, configured to perform tone mapping on the current target frame according to the modified preset tone mapping curve.
Optionally, the obtaining module is specifically configured to determine a video stream, and decode the video stream to obtain YUV electrical signals of a target frame;
converting the YUV electrical signal into an RGB electrical signal based on a color gamut conversion standard;
the YUV electric signal and the RGB electric signal are used as color coding signals.
Optionally, the first mapping module is specifically configured to map a brightness component Y in the YUV electrical signals of the current target frame into a brightness component Y' according to the tone mapping curve; and (c) a second step of,
mapping the red component R in the RGB electric signal of the current target frame into a red component R ', mapping the green component G in the RGB electric signal of the current target frame into a green component G ', and mapping the blue component B in the RGB electric signal of the current target frame into a blue component B ' according to the tone mapping curve;
the brightness component Y ', the red component R', the green component G ', and the blue component B' are used as mapped color-coded signals.
Optionally, the second calculating module is specifically configured to calculate an information entropy loss quantization value of brightness according to the YUV electrical signals before and after the mapping of the target frame;
calculating an information entropy loss quantization value of the chromaticity according to the RGB electric signals before and after the target frame is mapped;
and calculating the detail loss quantized value of the current target frame according to the information entropy loss quantized value of the brightness and the information entropy loss quantized value of the chromaticity on the basis of a preset loss coefficient.
Optionally, the second calculating module is specifically configured to count pixel distribution of a brightness component Y in the YUV electrical signal, and determine histogram distribution HistY of the YUV brightness component Y; counting the pixel distribution of the brightness component Y 'in the mapped YUV electric signals, and determining the histogram distribution HistYtm of the mapped brightness component Y';
respectively calculating the information entropy of the histogram distribution HistY and the information entropy of the histogram distribution HistYtm;
the absolute value of the difference between the information entropy of HistY and the information entropy of HistYtm is determined as the information entropy loss quantization value of brightness.
Optionally, the second calculating module is specifically configured to separately count pixel distributions of the red component R and the mapped red component R' in the RGB electrical signal, and determine histogram distributions HistR and HistRtm of the red component before and after mapping; respectively counting the pixel distribution of a green component G and a mapped red component G' in the RGB electric signal, and determining histogram distribution HistG and HistGtm of the green component before and after mapping; respectively counting the pixel distribution of the blue component B and the mapped blue component B' in the RGB electric signal, and determining the histogram distribution HistB and HistBtm of the blue component before and after mapping;
respectively calculating the information entropy of histogram distribution HistR and HistRtm, and determining the absolute value of the difference value between the information entropy of HistR and the information entropy of HistRtm as the information entropy loss quantization value of the red component R; respectively calculating the information entropy of histogram distribution HistG and HistGtm, and determining the absolute value of the difference between the information entropy of HistG and the information entropy of HistGtm as the information entropy loss quantization value of the green component G; determining the absolute value of the difference value between the information entropy of HistB and the information entropy of HistBtm as the information entropy loss quantization value of the blue component B;
the sum of the information entropy loss quantized value of the red component R, the information entropy loss quantized value of the green component G, and the information entropy loss quantized value of the blue component B is taken as the information entropy loss quantized value of the chroma.
Optionally, the second calculating module is specifically configured to calculate a sum of an information entropy loss quantization value of brightness and an information entropy loss quantization value of chromaticity of the current target frame, and modify the sum based on a preset loss coefficient to obtain a detail loss quantization value of the current target frame.
Optionally, the first calculating module is specifically configured to determine, according to the display characteristic parameter and the brightness characteristic parameter, an S-shaped mapping curve of a brightness region of the current target frame and a linear mapping straight line of a dark portion region of the current target frame;
and combining the S-shaped mapping curve and the linear mapping straight line to obtain the tone mapping curve of the current target frame.
Optionally, the correction module is specifically configured to increase, based on the detail loss quantization value, a slope of a linear mapping straight line in a dark portion area in the tone mapping curve if the median brightness value of the target frame is smaller than the average brightness value;
and updating the segmentation points of the S-shaped mapping curve of the bright part area and the linear mapping straight line of the dark part area of the current target frame according to the increased slope, and taking the updated tone mapping curve of the current target frame as the modified tone mapping curve of the current target frame.
Optionally, the modification module is specifically configured to reduce a curvature of an S-shaped mapping curve of a bright portion region in the tone mapping curve based on the detail loss quantization value if the median brightness value of the target frame is greater than or equal to the average brightness value;
and updating the segmentation points of the linear mapping straight line of the S-shaped mapping curve and the dark part region of the bright part region and the dark part region of the current target frame according to the reduced curvature, and taking the updated tone mapping curve of the current target frame as the modified tone mapping curve of the current target frame.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
It can be understood that, in the tone mapping apparatus according to the embodiment of the present invention, after the color coding signal, the luminance characteristic parameter, and the characteristic parameter of the display terminal of each target frame are obtained, the luminance characteristic parameter of the target frame and the display characteristic parameter of the display terminal are considered, and a tone mapping curve is obtained through calculation; and calculating to obtain a detail loss quantization value of the current target frame based on the color coding signals before and after tone mapping curve mapping, so as to correct the tone mapping curve of the target frame according to the detail loss quantization value and the brightness characteristic parameter. By adopting the technical scheme provided by the invention, when the detail loss quantization value is calculated, the difference of color coding signals of the target frame before and after mapping is considered, and the tone mapping curve is synchronously corrected according to the brightness characteristic parameter and the detail loss quantization value, so that the corrected tone mapping curve can reduce the detail loss before and after mapping under different brightness characteristic parameters, thereby solving the technical problem that the dark part detail in the prior art is smoothed to a certain extent, improving the image information quality and the visual effect, and improving the adaptability of the final mapping image and the brightness peak value of the display terminal.
An embodiment of the present invention also provides an electronic device based on one general inventive concept.
Fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention, and referring to fig. 5, the electronic device according to the present invention includes: at least one processor 51; and a memory 52 communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the tone mapping method of any of the embodiments described above.
Optionally, the electronic device may be a display terminal, configured to display the target frame subjected to tone mapping according to the corrected preset tone mapping curve.
An embodiment of the present invention also provides a non-transitory computer-readable storage medium storing computer instructions, in accordance with a general inventive concept.
Embodiments of the present invention provide a non-transitory computer-readable storage medium storing computer instructions for causing a computer to execute the tone mapping method described in any of the above embodiments.
An embodiment of the present invention also provides a computer program product based on one general inventive concept.
A computer program product according to an embodiment of the present invention includes a computer program, and the computer program, when executed by a processor, implements the tone mapping method according to any of the embodiments described above.
It is understood that the same or similar parts in the above embodiments may be mutually referred to, and the same or similar parts in other embodiments may be referred to for the content which is not described in detail in some embodiments.
It should be noted that the terms "first," "second," and the like in the description of the present invention are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. Further, in the description of the present invention, the meaning of "a plurality" means at least two unless otherwise specified.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and alternate implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present invention.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried out in the method of implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and the program, when executed, includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention.
Claims (15)
1. A tone mapping method applied to a display terminal, the method comprising:
acquiring a color coding signal and a brightness characteristic parameter of a target frame; acquiring display characteristic parameters of the display terminal;
calculating a tone mapping curve of the current target frame according to the brightness characteristic parameter and the display characteristic parameter;
mapping the color coding signal of the target frame according to the tone mapping curve to obtain a mapped color coding signal;
calculating a detail loss quantization value of the current target frame based on the color coding signals before and after mapping;
modifying the tone mapping curve based on the detail loss quantization value and the brightness characteristic parameter;
and tone mapping is carried out on the current target frame according to the corrected preset tone mapping curve.
2. The method of claim 1, wherein obtaining the color-coded signal of the target frame comprises:
determining a video stream, and decoding the video stream to obtain a YUV electric signal of a target frame;
converting the YUV electrical signal into an RGB electrical signal based on a color gamut conversion standard;
and taking the YUV electric signal and the RGB electric signal as the color coding signal.
3. The method of claim 2, wherein said mapping the color-coded signal of the target frame according to the tone mapping curve to obtain a mapped color-coded signal comprises:
mapping a brightness component Y in the YUV electric signals of the current target frame into a brightness component Y' according to the tone mapping curve; and the number of the first and second groups,
according to the tone mapping curve, mapping a red component R in the RGB electric signals of the current target frame into a red component R ', mapping a green component G in the RGB electric signals of the current target frame into a green component G ', and mapping a blue component B in the RGB electric signals of the current target frame into a blue component B ';
and taking the brightness component Y ', the red component R', the green component G 'and the blue component B' as mapped color coding signals.
4. The method according to claim 2, wherein said calculating the detail loss quantization value of the current target frame based on the color-coded signals before and after mapping comprises:
calculating an information entropy loss quantization value of brightness according to the YUV electric signals before and after the mapping of the target frame;
calculating an information entropy loss quantization value of the chromaticity according to the RGB electric signals before and after the target frame is mapped;
and calculating a detail loss quantized value of the current target frame according to the information entropy loss quantized value of the brightness and the information entropy loss quantized value of the chromaticity on the basis of a preset loss coefficient.
5. The method according to claim 4, wherein said calculating a quantized value of entropy loss of brightness from the YUV electrical signals before and after the mapping of the target frame comprises:
counting the pixel distribution of a brightness component Y in the YUV electric signals, and determining the histogram distribution HistY of the YUV brightness component Y; counting the pixel distribution of the brightness component Y 'in the mapped YUV electric signals, and determining the histogram distribution HistYtm of the brightness component Y' after mapping;
respectively calculating the information entropy of the histogram HistY and the information entropy of the histogram HistYtm;
and determining the absolute value of the difference value between the information entropy of HistY and the information entropy of HistYtm as the information entropy loss quantization value of the brightness.
6. The method as claimed in claim 4, wherein said calculating the information entropy loss quantization value of chroma according to the RGB electrical signals before and after the target frame mapping comprises:
respectively counting the pixel distribution of a red component R and a mapped red component R' in the RGB electric signal, and determining the histogram distribution HistR and HistRtm of the red component before and after mapping; respectively counting the pixel distribution of a green component G and a mapped red component G' in the RGB electric signal, and determining the histogram distribution HistG and HistGtm of the green component before and after mapping; respectively counting the pixel distribution of a blue component B and a mapped blue component B' in the RGB electric signal, and determining histogram distribution HistB and HistBtm of the blue component before and after mapping;
respectively calculating the information entropy of the histogram distribution HistR and the information entropy of the histogram distribution HistRtm, and determining that the absolute value of the difference value between the information entropy of HistR and the information entropy of HistRtm is the information entropy loss quantization value of the red component R; respectively calculating the information entropy of the histogram distribution HistG and the information entropy of the histogram distribution HistGtm, and determining the absolute value of the difference value between the information entropy of HistG and the information entropy of HistGtm as the information entropy loss quantization value of the green component G; determining the absolute value of the difference value between the information entropy of HistB and the information entropy of HistBtm as the information entropy loss quantization value of blue component B;
and taking the sum of the information entropy loss quantized value of the red component R, the information entropy loss quantized value of the green component G and the information entropy loss quantized value of the blue component B as the information entropy loss quantized value of the chroma.
7. The method according to claim 4, wherein the calculating the detail loss quantization value of the current target frame according to the information entropy loss quantization value of the brightness and the information entropy loss quantization value of the chroma based on a preset loss coefficient comprises:
and calculating the sum of the information entropy loss quantized value of the brightness and the information entropy loss quantized value of the chromaticity of the current target frame, and modifying the sum on the basis of the preset loss coefficient to obtain the detail loss quantized value of the current target frame.
8. The method according to claim 1, wherein the calculating a tone mapping curve of the current target frame according to the brightness characteristic parameter and the display characteristic parameter comprises:
determining an S-shaped mapping curve of a brightness area of the current target frame and a linear mapping straight line of a dark part area of the current target frame according to the display characteristic parameters and the brightness characteristic parameters;
and combining the S-shaped mapping curve and the linear mapping straight line to obtain the tone mapping curve of the current target frame.
9. The method according to claim 8, wherein the luminance characteristic parameters comprise a median luminance value and an average luminance value; the modifying the tone mapping curve based on the detail loss quantization value and the luminance characteristic parameter includes:
if the median brightness value of the target frame is smaller than the average brightness value, increasing the slope of a linear mapping straight line of a dark part area in the tone mapping curve based on the detail loss quantization value;
and updating the segmentation points of the S-shaped mapping curve of the bright part area and the linear mapping straight line of the dark part area of the current target frame according to the increased slope, and taking the updated tone mapping curve of the current target frame as the modified tone mapping curve of the current target frame.
10. The method of claim 8, wherein the brightness characteristic parameter comprises a brightness value; the modifying the tone mapping curve based on the detail loss quantization value and the luminance characteristic parameter includes:
if the median brightness value of the target frame is larger than or equal to the average brightness value, reducing the curvature of an S-shaped mapping curve of a bright part area in the tone mapping curve based on the detail loss quantization value;
and updating the segmentation points of the linear mapping straight line of the S-shaped mapping curve of the bright part area and the dark part area of the current target frame according to the reduced curvature, and taking the updated tone mapping curve of the current target frame as the modified tone mapping curve of the current target frame.
11. A tone mapping apparatus applied to a display terminal, the apparatus comprising:
the acquisition module is used for acquiring a color coding signal and a brightness characteristic parameter of the target frame; acquiring display characteristic parameters of the display terminal;
the first calculation module is used for calculating a tone mapping curve of the current target frame according to the brightness characteristic parameter and the display characteristic parameter;
the first mapping module is used for mapping the color coding signal of the target frame according to the tone mapping curve to obtain a mapped color coding signal;
the second calculation module is used for calculating a detail loss quantization value of the current target frame based on the color coding signals before and after mapping;
a modification module for modifying the tone mapping curve based on the detail loss quantization value and the luminance characteristic parameter;
and the second mapping module is used for carrying out tone mapping on the current target frame according to the corrected preset tone mapping curve.
12. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the tone mapping method of any one of claims 1-9.
13. The electronic device of claim 12, wherein the electronic device is a display terminal.
14. A non-transitory computer readable storage medium storing computer instructions for causing a computer to perform the tone mapping method of any one of claims 1-10.
15. A computer program product, characterized in that it comprises a computer program which, when being executed by a processor, implements the tone mapping method according to any one of claims 1-10.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211433422.9A CN115761015A (en) | 2022-11-16 | 2022-11-16 | Tone mapping method, device and related equipment |
| PCT/CN2023/130701 WO2024104245A1 (en) | 2022-11-16 | 2023-11-09 | Tone mapping method and apparatus, and related device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211433422.9A CN115761015A (en) | 2022-11-16 | 2022-11-16 | Tone mapping method, device and related equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115761015A true CN115761015A (en) | 2023-03-07 |
Family
ID=85372172
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211433422.9A Pending CN115761015A (en) | 2022-11-16 | 2022-11-16 | Tone mapping method, device and related equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN115761015A (en) |
| WO (1) | WO2024104245A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024104245A1 (en) * | 2022-11-16 | 2024-05-23 | 北京奇艺世纪科技有限公司 | Tone mapping method and apparatus, and related device |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011027944A (en) * | 2009-07-24 | 2011-02-10 | Samsung Electronics Co Ltd | Device, method and program for processing video signal, and display device |
| CN113596428B (en) * | 2020-04-30 | 2022-12-06 | 华为技术有限公司 | Method and device for acquiring mapping curve parameters |
| CN116132648A (en) * | 2020-04-30 | 2023-05-16 | 华为技术有限公司 | Dynamic range mapping method and device |
| CN113099201B (en) * | 2021-03-30 | 2022-12-02 | 北京奇艺世纪科技有限公司 | Video signal processing method and device and electronic equipment |
| CN113453082A (en) * | 2021-06-16 | 2021-09-28 | 深圳创维－Rgb电子有限公司 | Intelligent television image automatic adjustment processing method and device, intelligent television and medium |
| CN115761015A (en) * | 2022-11-16 | 2023-03-07 | 北京奇艺世纪科技有限公司 | Tone mapping method, device and related equipment |
-
2022
- 2022-11-16 CN CN202211433422.9A patent/CN115761015A/en active Pending
-
2023
- 2023-11-09 WO PCT/CN2023/130701 patent/WO2024104245A1/en unknown
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024104245A1 (en) * | 2022-11-16 | 2024-05-23 | 北京奇艺世纪科技有限公司 | Tone mapping method and apparatus, and related device |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2024104245A1 (en) | 2024-05-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11647213B2 (en) | Method and device for decoding a color picture | |
| RU2665211C1 (en) | Device and method of improving perceptual luminance nonlinearity-based image data exchange across different display capabilities | |
| US10390027B2 (en) | Method and apparatus of encoding and decoding a color picture | |
| CN109274985B (en) | Video transcoding method and device, computer equipment and storage medium | |
| KR101998531B1 (en) | Real-time video enhancement methods, terminals, and non-transitory computer readable storage media | |
| US11070830B2 (en) | Coding and decoding method with color conversion and corresponding devices | |
| US20180005358A1 (en) | A method and apparatus for inverse-tone mapping a picture | |
| EP3318063A1 (en) | Method and device for encoding both a hdr picture and a sdr picture obtained from said hdr picture using color mapping functions | |
| JP2022539683A (en) | Image processing method and apparatus | |
| WO2021073304A1 (en) | Image processing method and apparatus | |
| WO2024104245A1 (en) | Tone mapping method and apparatus, and related device | |
| US20190130546A1 (en) | Method and device for obtaining a second image from a first image when the dynamic range of the luminance of said first image is greater than the dynamic range of the luminance of said second image | |
| US10257542B1 (en) | Compression encoding of images | |
| WO2024099388A1 (en) | Video data processing method and apparatus, video display method and apparatus, and electronic device and readable storage medium | |
| CN114051126A (en) | Video processing method and video processing device | |
| CN114467298A (en) | Image signal conversion processing method and device and terminal equipment | |
| CN115801969A (en) | Video data processing method, video display method and device, electronic equipment and readable storage medium | |
| CN115643385A (en) | Video data processing method, video display method and device, electronic equipment and readable storage medium | |
| CN114999363A (en) | Color shift correction method, device, equipment, storage medium and program product | |
| US10298932B1 (en) | Compression encoding of images | |
| CN109685859B (en) | Three-dimensional color automatic adjustment method based on 3D lookup table | |
| WO2023134235A1 (en) | Image processing method and electronic device | |
| Jung et al. | Power constrained contrast enhancement based on brightness compensated contrast-tone mapping operation | |
| CN115966161A (en) | Image equalization method and device for display, storage medium and chip | |
| CN115472135A (en) | Backlight control method, apparatus and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |