CN116959381A

CN116959381A - Image enhancement display method, display device and electronic device

Info

Publication number: CN116959381A
Application number: CN202310876896.9A
Authority: CN
Inventors: 吴聪睿
Original assignee: BOE Technology Group Co Ltd
Current assignee: BOE Technology Group Co Ltd
Priority date: 2023-07-17
Filing date: 2023-07-17
Publication date: 2023-10-27

Abstract

The disclosure provides an image enhancement display method, display equipment and electronic equipment, which are used for improving the phenomena of weakening of dark field video details and information loss, improving the details of dark parts of images and improving the watching experience of users. The method comprises the following steps: acquiring an image to be displayed, and determining the backlight brightness of a backlight partition corresponding to each sub-image according to the gray data of each sub-image contained in the image to be displayed; the backlight brightness of the current backlight partition is adjusted by utilizing the backlight brightness of other backlight partitions adjacent to the current backlight partition, so that the backlight adjustment brightness of each backlight partition is obtained; according to the backlight adjustment brightness of the backlight partition adjacent to the current backlight partition, determining the backlight brightness of each pixel corresponding to the current backlight partition, and determining the brightness enhancement coefficient of each pixel according to the backlight brightness of each pixel; and carrying out enhancement processing on the image to be displayed according to the brightness enhancement coefficient of each pixel to obtain an enhanced image, and displaying the enhanced image on a display screen.

Description

Image enhancement display method, display device and electronic device

Technical Field

The disclosure relates to the technical field of partition light control, and in particular relates to a method for enhancing display of images, display equipment and electronic equipment.

Background

Mini LEDs are LED chips with the size of 100 mu m, and the size is between a small-pitch LED and a Micro LED, so that the small-pitch LED is further refined. The small-spacing LEDs refer to LED backlights or display products with the spacing between adjacent lamp bead points below 2.5 millimeters. With the rapid development of Mini LED display technology, the Mini LED display product has been applied to the field of ultra-large screen high definition display.

In a Mini LED backlight display module, a zonal light control algorithm (Local Dimming algorithm) is generally used to control and light a backlight. However, in the conventional partition light control algorithm, due to the fact that the brightness of the backlight partition is reduced, dark field video details are weakened, information is lost, and the viewing experience of a user is reduced.

Disclosure of Invention

The disclosure provides an image enhancement display method, display equipment and electronic equipment, which are used for improving the phenomena of weakening of dark field video details and information loss, improving the details of dark parts of images and improving the watching experience of users.

In a first aspect, an embodiment of the present disclosure provides a method for enhancing display of an image, the method including:

Acquiring an image to be displayed, and determining the backlight brightness of a backlight partition corresponding to each sub-image according to the gray data of each sub-image contained in the image to be displayed;

the backlight brightness of the current backlight partition is adjusted by utilizing the backlight brightness of other backlight partitions adjacent to the current backlight partition, so that the backlight adjustment brightness of each backlight partition is obtained, wherein the other backlight partitions adjacent to the current backlight partition represent the backlight partitions except the current backlight partition in the backlight area containing the current backlight partition;

according to the backlight adjustment brightness of the backlight partition adjacent to the current backlight partition, determining the backlight brightness of each pixel corresponding to the current backlight partition, and determining the brightness enhancement coefficient of each pixel according to the backlight brightness of each pixel;

and carrying out enhancement processing on the image to be displayed according to the brightness enhancement coefficient of each pixel to obtain an enhanced image, and displaying the enhanced image on a display screen.

As an optional implementation manner, the determining the backlight brightness of the backlight partition corresponding to each sub-image according to the gray data of each sub-image included in the image to be displayed includes:

for each sub-image, determining gray data of the sub-image according to a maximum gray value and an average gray value in each single-channel image contained in the sub-image;

And determining the backlight brightness of the backlight partition corresponding to the gray data of the sub-image according to the mapping relation between the gray data and the backlight brightness.

As an alternative embodiment, after determining the gray data of each sub-image, the method further includes:

traversing each sub-image by using a filtering window, and filtering the gray data of the current sub-image in the filtering window to obtain the gray data of the current sub-image after filtering;

and determining the backlight brightness of the backlight subarea corresponding to each sub-image according to the gray data after filtering the sub-images.

As an optional implementation manner, the determining the gray data of the sub-image according to the maximum gray value and the average gray value in each single-channel image included in the sub-image includes:

according to the weights corresponding to the maximum gray value and the average gray value, carrying out weighted summation on the maximum gray value and the average gray value;

and determining gray data of the sub-images according to the summation value.

As an alternative embodiment, the weights corresponding to the maximum gray value and the average gray value are fixed respectively; or alternatively, the first and second heat exchangers may be,

the weights corresponding to the maximum gray value and the average gray value respectively change along with the change of the backlight brightness of the backlight layer before the image to be displayed is acquired.

As an optional implementation manner, the adjusting the backlight brightness of the current backlight partition by using the backlight brightness of other backlight partitions adjacent to the current backlight partition to obtain the backlight adjusted brightness of each backlight partition includes:

determining backlight adjustment parameters of the current backlight partition according to the backlight brightness and brightness attenuation coefficients of other backlight partitions adjacent to the current backlight partition;

and determining the backlight adjustment brightness of each backlight partition according to the backlight adjustment parameters and the backlight brightness corresponding to each backlight partition.

As an optional implementation manner, the determining the backlight adjustment parameter of the current backlight partition according to the backlight brightness and the brightness attenuation coefficient of the other backlight partitions adjacent to the current backlight partition includes:

determining a product value of backlight brightness and brightness attenuation coefficient of each other backlight partition adjacent to the current backlight partition;

and summing the product values corresponding to other backlight partitions adjacent to the current backlight partition to obtain the backlight adjustment parameters of the current backlight partition.

As an optional implementation manner, the determining the backlight brightness of each pixel corresponding to the current backlight partition according to the backlight adjustment brightness of the backlight partition adjacent to the current backlight partition includes:

For each pixel corresponding to the current backlight partition, determining the backlight brightness of the pixel according to the backlight adjustment brightness of the backlight partition adjacent to the current backlight partition based on a bilinear interpolation method.

As an optional implementation manner, the determining the backlight brightness of the pixel according to the backlight adjustment brightness of the backlight partition adjacent to the current backlight partition based on the bilinear interpolation method includes:

determining the distance from the pixel to the central pixel corresponding to each adjacent backlight partition according to the pixel position of the pixel of the current backlight partition and the central pixel position corresponding to the center of the adjacent backlight partition;

and determining the backlight brightness of the pixel according to the backlight adjustment brightness of the adjacent backlight partitions and the distance.

As an optional implementation manner, the determining the backlight brightness of the pixel according to the backlight adjustment brightness of the adjacent backlight partitions and the distance includes:

determining interpolation coefficients corresponding to each adjacent backlight partition according to the distances between the pixels and the central pixels corresponding to each adjacent backlight partition;

and summing the product value of the interpolation coefficient corresponding to each adjacent backlight partition and the backlight superposition brightness to obtain the backlight brightness of the pixel.

As an alternative embodiment, the brightness enhancement coefficient of the pixel varies with the variation of the backlight brightness of the pixel within a preset range; the luminance enhancement coefficient of the pixel is inversely related to the backlight luminance of the pixel.

As an optional implementation manner, the determining the brightness enhancement coefficient of each pixel according to the backlight brightness of each pixel includes:

and determining the brightness enhancement coefficient of each pixel according to the comparison result of the backlight brightness of the pixel and the brightness threshold value.

As an optional implementation manner, the determining the brightness enhancement coefficient of each pixel according to the comparison result of the backlight brightness of the pixel and the brightness threshold value includes:

if the backlight brightness of the pixel is greater than or equal to the brightness threshold value, the brightness enhancement coefficient of the pixel is the minimum value in a preset range;

and if the backlight brightness of the pixel is smaller than the brightness threshold value and larger than or equal to the upper limit threshold value, determining the brightness enhancement coefficient of the pixel according to the ratio of the brightness threshold value to the backlight brightness of the pixel.

As an optional implementation manner, the enhancing the image to be displayed according to the brightness enhancement coefficient of each pixel to obtain an enhanced image includes:

Converting the image to be displayed into a color image of Lab space, and determining an L-channel image of the color image;

extracting detail information of the L channel image to obtain a detail image;

and carrying out enhancement processing on the detail image according to the brightness enhancement coefficient of each pixel to obtain an enhanced image.

As an optional implementation manner, the extracting the detail information of the L-channel image to obtain a detail image includes:

performing low-pass filtering on the L-channel image to obtain a filtered L-channel image;

and determining the detail image according to the difference value between the L-channel image and the filtered L-channel image.

As an optional implementation manner, the enhancing the detail image according to the brightness enhancement coefficient of each pixel to obtain an enhanced image includes:

determining the product value of the brightness enhancement coefficient of each pixel and the detail image;

and determining the enhanced image according to the product value and the sum value of the L channel image.

In a second aspect, a display device provided in an embodiment of the present disclosure includes a display screen and a controller;

the display screen is configured to perform display of content;

the controller is configured to perform the steps of:

As an alternative embodiment, the controller is specifically configured to perform:

As an alternative embodiment, after determining the gray data of each sub-image, the controller is specifically further configured to perform:

and determining gray data of the sub-images according to the summation value.

extracting detail information of the L channel image to obtain a detail image;

In a third aspect, an embodiment of the present disclosure further provides an electronic device, including a processor and a memory, where the memory is configured to store a program executable by the processor, and the processor is configured to read the program in the memory and perform the following steps:

As an alternative embodiment, the processor is specifically configured to perform:

As an alternative embodiment, after determining the gray data of each sub-image, the processor is specifically further configured to perform:

and determining gray data of the sub-images according to the summation value.

extracting detail information of the L channel image to obtain a detail image;

In a fourth aspect, an embodiment of the present disclosure further provides an apparatus for enhancing display of an image, including:

the backlight brightness determining module is used for acquiring an image to be displayed and determining the backlight brightness of the backlight partition corresponding to each sub-image according to the gray data of each sub-image contained in the image to be displayed;

the backlight brightness adjusting module is used for adjusting the backlight brightness of the current backlight partition by utilizing the backlight brightness of other backlight partitions adjacent to the current backlight partition to obtain the backlight adjusting brightness of each backlight partition, wherein the other backlight partitions adjacent to the current backlight partition represent the backlight partitions except the current backlight partition in the backlight area containing the current backlight partition;

the enhancement coefficient determining module is used for determining the backlight brightness of each pixel corresponding to the current backlight partition according to the backlight adjustment brightness of the backlight partition adjacent to the current backlight partition, and determining the brightness enhancement coefficient of each pixel according to the backlight brightness of each pixel;

and the enhancement processing module is used for carrying out enhancement processing on the image to be displayed according to the brightness enhancement coefficient of each pixel to obtain an enhanced image, and displaying the enhanced image on a display screen.

As an optional implementation manner, the backlight brightness determining module is specifically configured to:

As an optional implementation manner, after determining the gray data of each sub-image, the backlight brightness determining module is specifically further configured to:

and determining gray data of the sub-images according to the summation value.

As an optional implementation manner, the backlight brightness adjusting module is specifically configured to:

As an optional implementation manner, the enhancement coefficient determining module is specifically configured to:

As an alternative embodiment, the enhancement processing module is specifically configured to:

extracting detail information of the L channel image to obtain a detail image;

In a fifth aspect, embodiments of the present disclosure also provide a computer storage medium having stored thereon a computer program for carrying out the steps of the method of the first aspect described above when executed by a processor.

These and other aspects of the disclosure will be more readily apparent from the following description of the embodiments.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings that are needed in the description of the embodiments will be briefly described below, it will be apparent that the drawings in the following description are only some embodiments of the present disclosure, and that other drawings may be obtained according to these drawings without inventive effort to a person of ordinary skill in the art.

FIG. 1 is a flowchart of a method for enhancing display of an image according to an embodiment of the present disclosure;

FIG. 2 is a schematic diagram of luminance calculation of bilinear interpolation according to an embodiment of the present disclosure;

FIG. 3 is a system diagram of an image enhancement display provided by an embodiment of the present disclosure;

FIG. 4 is a flowchart of an implementation of a backlight computing module according to an embodiment of the disclosure;

FIG. 5 is a flowchart of a backlight diffusion module according to an embodiment of the disclosure;

FIG. 6 is a flowchart of an embodiment of an image enhancement display according to an embodiment of the present disclosure;

fig. 7 is a schematic diagram of a display device according to an embodiment of the disclosure;

fig. 8 is a schematic diagram of an electronic device according to an embodiment of the disclosure;

fig. 9 is a schematic diagram of an apparatus for image enhancement display according to an embodiment of the present disclosure.

Detailed Description

For the purpose of promoting an understanding of the principles and advantages of the disclosure, reference will now be made in detail to the drawings, in which it is apparent that the embodiments described are only some, but not all embodiments of the disclosure. Based on the embodiments in this disclosure, all other embodiments that a person of ordinary skill in the art would obtain without making any inventive effort are within the scope of protection of this disclosure.

The term "and/or" in the embodiments of the present disclosure describes an association relationship of association objects, which indicates that three relationships may exist, for example, a and/or B may indicate: a exists alone, A and B exist together, and B exists alone. The character "/" generally indicates that the context-dependent object is an "or" relationship.

The application scenario described in the embodiments of the present disclosure is for more clearly describing the technical solution of the embodiments of the present disclosure, and does not constitute a limitation on the technical solution provided by the embodiments of the present disclosure, and as a person of ordinary skill in the art can know that, with the appearance of a new application scenario, the technical solution provided by the embodiments of the present disclosure is equally applicable to similar technical problems. In the description of the present disclosure, unless otherwise indicated, the meaning of "a plurality" is two or more.

Mini LEDs are LED chips with the size of 100 mu m, and the size is between a small-pitch LED and a Micro LED, so that the small-pitch LED is further refined. The small-spacing LEDs refer to LED backlights or display products with the spacing between adjacent lamp bead points below 2.5 millimeters. With the rapid development of Mini LED display technology, the Mini LED display product has been applied to the field of ultra-large screen high definition display. In a Mini LED backlight display module, a zonal light control algorithm is generally used to control and light the backlight. Usually, the Mini LED backlight is divided into tens to thousands of partitions, and each partition can independently control the lighting brightness, so that the lighting brightness of each partition Mini LED lamp of the backlight can be calculated according to a video image displayed in real time by adopting a partition light control algorithm (Local Dimming algorithm), a frame of backlight image is obtained, and the Mini LED backlight is lighted according to the backlight image, so that the effects of increasing the contrast and improving the display image quality are realized. However, in the conventional partition light control algorithm, since a dark field region (RGB values are smaller) exists in the video image, the backlight partition below the region can realize driving lighting with lower brightness, so that the low gray level detail information content in the dark field region is difficult to observe, and the viewing experience of a user is reduced.

According to the image enhancement display method provided by the embodiment, based on the luminance diffusion principle that the luminance of the backlight adjacent to the backlight partition is diffused to the current backlight partition, the luminance of the backlight partition is adjusted by counting the luminance of the backlight of different backlight partitions, the luminance is adjusted to be the actual luminance of the backlight partition (backlight adjustment luminance) based on the luminance diffusion, the luminance of the backlight of the pixel is determined according to the backlight adjustment luminance of the backlight partition, the compensation coefficient of the pixel is dynamically generated according to the luminance of the backlight of the pixel, and the detail enhancement calculation is carried out on the pixel, so that the effect of enhancing the detail of the dark part is achieved. The image enhancement method provided by the embodiment can effectively improve the phenomena of dark field video detail weakening and information loss caused by too low brightness of the local backlight subareas under the image display condition on the Mini LED module, and enhances the detail information in the area in real time by identifying the dark field area and the low brightness subareas in the video image without influencing the display effects of the images and the backlight in other areas, so that the overall display image quality level is improved.

Optionally, the display screen in this embodiment includes a backlight layer and an LCD layer, where the backlight layer includes a plurality of backlight partitions, and the LCD layer includes a plurality of pixels, each backlight partition corresponds to a plurality of pixels, and each pixel is used for displaying gray data of an image.

As shown in fig. 1, the embodiment provides a method for enhancing image display, and the specific implementation flow of the method is as follows:

step 100, acquiring an image to be displayed, and determining the backlight brightness of a backlight partition corresponding to each sub-image according to the gray data of each sub-image contained in the image to be displayed;

wherein one sub-image corresponds to one backlight partition of the display screen backlight layer;

optionally, the image to be displayed in this embodiment is an RGB image, the image to be displayed is divided into a plurality of sub-images, one sub-image corresponds to one backlight partition, and the size of the sub-image and the size of the backlight partition are the same. The backlight brightness of the backlight partition corresponding to each sub-image is determined by the following steps:

step 1a, determining gray data of each sub-image according to a maximum gray value and an average gray value in each single-channel image contained in the sub-image;

in an embodiment, for each backlight partition, statistics is performed on each sub-image included in the image to be displayed by using the maximum gray value and the average gray value of the sub-image corresponding to the backlight partition, so as to obtain the maximum gray value bl_max and the average gray value bl_avg corresponding to each sub-image.

Since the image to be displayed is an RGB image, when calculating the maximum gray value and the average gray value of each sub-image, the maximum value (maximum gray value) and the average value (average gray value) of all gray values in three single channels of R, G, B of the sub-image are calculated.

In some embodiments, the gray data of the sub-image is determined by:

according to the weights corresponding to the maximum gray value and the average gray value, carrying out weighted summation on the maximum gray value and the average gray value; and determining gray data of the sub-images according to the summation value.

It should be noted that, the weights corresponding to the maximum gray value and the average gray value may be determined based on the actual requirement, where the weights corresponding to the maximum gray value and the average gray value affect the brightness and darkness of the final displayed sub-image, when the weight of the maximum gray value is higher than the weight of the average gray value, the backlight corresponding to the sub-image is brighter, and when the weight of the average gray value is higher than the weight of the maximum gray value, the backlight corresponding to the sub-image is darker, and the display screen is darker. Accordingly, the weights corresponding to the maximum gray value and the average gray value can be determined based on the brightness level of the display screen actually required.

In the implementation, for each sub-image, the maximum gray value and the average gray value of the sub-image are weighted and summed to obtain the gray data of the sub-image.

In some embodiments, the weights for each of the maximum gray value and the average gray value are fixed; or the weights corresponding to the maximum gray value and the average gray value respectively change along with the change of the backlight brightness of the backlight layer before the image to be displayed is acquired.

In implementation, the histogram statistics of the backlight brightness of the backlight layer corresponding to the image displayed before the current image to be displayed can be performed, and the statistical result of the histogram obtained by statistics is utilized to dynamically adjust the weights corresponding to the maximum gray value and the average gray value based on the brightness degree of the display picture actually required, so that the display effect of the display picture of the adjusted image to be displayed better meets the display requirement required by the user.

It should be noted that, the larger the weight corresponding to the maximum gray value, the brighter the display frame of the sub-image, whereas, the larger the weight corresponding to the average gray value, the darker the display frame of the sub-image. Wherein the sum of the weight corresponding to the maximum gray value and the weight corresponding to the average gray value is 1.

Optionally, after determining the gray data of each sub-image, the present embodiment may further perform the following steps:

traversing each sub-image by using a filtering window, and filtering the gray data of the current sub-image in the filtering window to obtain the gray data of the current sub-image after filtering; and determining the backlight brightness of the backlight subarea corresponding to each sub-image according to the gray data after filtering the sub-images.

In implementation, in order to make the gray data of each adjacent sub-image smoother and reduce the partition splitting phenomenon, the gray data of the sub-images may be subjected to smooth filtering, for example, a 3×3 or 5×5 filter window may be adopted, one filter window may include 3×3 or 5×5 sub-images, each sub-image is traversed by using the filter window, and smooth filtering processing is performed on each sub-image, so that the gray data of each sub-image changes more smoothly, and thus the backlight brightness of each backlight partition is smoother.

And after the gray data of each sub-image is subjected to filtering processing, determining the backlight brightness of the backlight partition corresponding to the sub-image by using the mapping relation between the gray data of the filtered sub-image and the backlight brightness.

And step 1b, determining the backlight brightness of the backlight partition corresponding to the gray data of the sub-image according to the mapping relation between the gray data and the backlight brightness.

In practice, the mapping relation between gray data and backlight brightness is obtained through testing, and the mapping relation is related to the display screen and the highest brightness displayed by the display screen. And converting the gray data into backlight brightness of the corresponding backlight subarea according to the gray data of each sub-image, and driving the backlight subarea to output the corresponding brightness data. Wherein the gray data of one sub-image corresponds to the backlight brightness of one backlight partition.

When the mapping relationship between the gray data and the backlight brightness is determined, the display effect of the sample image displayed on the display screen can be utilized to test, and according to the corresponding relationship between the gray data and the backlight brightness under different display effects when a plurality of sample images are displayed, the corresponding relationship between the gray data and the backlight brightness which are finally required is determined based on the display requirement of a user, wherein the corresponding relationship is the mapping relationship between the gray data and the backlight brightness, and the mapping relationship can be represented in a table form.

Step 101, adjusting the backlight brightness of the current backlight partition by utilizing the backlight brightness of other backlight partitions adjacent to the current backlight partition to obtain the backlight adjustment brightness of each backlight partition;

Wherein the other backlight partitions adjacent to the current backlight partition represent backlight partitions other than the current backlight partition in the backlight area including the current backlight partition;

in some embodiments, the backlight brightness of the backlight partitions is adjusted by:

step 2a, determining the backlight adjustment parameters of the current backlight partition according to the backlight brightness and brightness attenuation coefficients of other backlight partitions adjacent to the current backlight partition;

in implementation, due to the light leakage characteristic of the display screen, the brightness attenuation condition of the display screen can be detected through testing, so that the brightness attenuation coefficients of different backlight partitions are obtained, the actual brightness of each backlight partition can be utilized when a sample image is displayed on the display screen, the brightness attenuation conditions of different backlight partitions are detected, and the brightness attenuation coefficients of different backlight partitions of the display screen are counted based on a preset rule.

And 2b, determining the backlight adjustment brightness of each backlight partition according to the backlight adjustment parameters and the backlight brightness corresponding to each backlight partition.

In some embodiments, the backlight adjustment parameters for the current backlight partition are determined by:

Determining a product value of backlight brightness and brightness attenuation coefficient of each other backlight partition adjacent to the current backlight partition; and summing the product values corresponding to other backlight partitions adjacent to the current backlight partition to obtain the backlight adjustment parameters of the current backlight partition.

In implementation, the backlight brightness of the backlight partitions may be adjusted using an optical diffusion model of, for example, 7×7, 9×9, and 11×11 backlight partition sizes, where each backlight partition is traversed by the optical diffusion model, and the actual brightness (backlight adjustment brightness) of each backlight partition after brightness superposition is calculated.

The luminance decay factor in this embodiment is obtained from a test. And inputting the backlight brightness of each backlight partition into an optical diffusion model, and calculating the backlight adjustment brightness of each input backlight partition based on the brightness diffusion coefficient of the optical diffusion model to obtain the backlight adjustment brightness of each backlight partition.

The optical diffusion model in this embodiment needs to be actually tested according to the display module of the display screen, and the specification of the optical diffusion model in this embodiment is not limited too much, for example, 7×7, 9×9, 11×11, etc.

102, determining the backlight brightness of each pixel corresponding to the current backlight partition according to the backlight adjustment brightness of the backlight partition adjacent to the current backlight partition, and determining the brightness enhancement coefficient of each pixel according to the backlight brightness of each pixel;

After the backlight adjustment brightness of each backlight partition is obtained through the above steps, the backlight brightness corresponding to each pixel in each backlight partition needs to be calculated, and the specific calculation mode is as follows:

In some embodiments, the backlight brightness of the pixel is determined specifically by:

step 3a, determining the distance from the pixel to the central pixel corresponding to each adjacent backlight partition according to the pixel position of the pixel of the current backlight partition and the central pixel position corresponding to the adjacent backlight partition center;

in practice, the calculated distance in this embodiment is the normalized distance. The adjacent backlight partitions in the present embodiment may include 4 adjacent backlight partitions, 8 backlight partitions, and the like, which is not excessively limited in the present embodiment.

As shown in fig. 2, the present embodiment provides a bilinear interpolation luminance calculation schematic diagram, taking backlight partitions B1, B2, B3, and B4 as examples, to calculate the backlight luminance of the target pixel Blpix, where a, (1-a), B, (1-B) are normalized distances between the target pixel Blpix and centers of four adjacent backlight partitions (B1, B2, B3, and B4), respectively.

And 3b, determining the backlight brightness of the pixel according to the backlight adjustment brightness of the adjacent backlight partitions and the distance.

In some embodiments, the backlight brightness of each pixel is determined by:

determining interpolation coefficients corresponding to each adjacent backlight partition according to the distances between the pixels and the central pixels corresponding to each adjacent backlight partition; and summing the product value of the interpolation coefficient corresponding to each adjacent backlight partition and the backlight superposition brightness to obtain the backlight brightness of the pixel.

In practice, taking fig. 2 as an example, the backlight luminance of the target pixel Blpix is calculated by the following formula:

Bl _pix ＝b×(a×Bl ₁ +(1-a)×Bl ₂ )+(1-b)×(a×Bl ₃ +(1-a)×Bl ₄ ) Formula (1);

wherein a, (1-a), b, (1-b) are the target pixel Blpix and the adjacent four pixels respectivelyNormalized distance of center of each backlight partition (B1, B2, B3, B4), bl ₁ 、Bl ₂ 、Bl ₃ And Bl ₄ The backlight adjustment luminance of the four backlight partitions (B1, B2, B3, B4) is shown, respectively.

In some embodiments, after the backlight brightness of each pixel is obtained through the above steps, the brightness enhancement coefficient of each pixel is calculated as follows:

In implementation, the brightness threshold is set as bl_base, which is a super parameter, and can be modified according to the backlight diffusion characteristic of the actual module, which is a determination threshold of the backlight dark field.

In some embodiments, the luminance enhancement coefficients for the pixels are determined by:

(1) If the backlight brightness of the pixel is greater than or equal to the brightness threshold value, the brightness enhancement coefficient of the pixel is the minimum value in a preset range;

(2) And if the backlight brightness of the pixel is smaller than the brightness threshold value and larger than or equal to the upper limit threshold value, determining the brightness enhancement coefficient of the pixel according to the ratio of the brightness threshold value to the backlight brightness of the pixel.

In practice, when the backlight luminance of a pixel is greater than or equal to the luminance threshold, it is indicated that the pixel is not in the dark field region, and the enhancement process may not be performed, that is, the luminance enhancement coefficient is 0 at this time. When the backlight brightness of a pixel is less than the brightness threshold and greater than or equal to the upper threshold, it is indicated that the pixel is in a dark field region and detail enhancement is required.

In addition, the maximum enhancement amplitude is set to be alpha, that is, the brightness enhancement coefficient is selected between [0, alpha ].

Optionally, the luminance enhancement coefficient of the pixel in the embodiment changes along with the change of the backlight luminance of the pixel in a preset range; the luminance enhancement coefficient of the pixel is inversely related to the backlight luminance of the pixel.

The calculation formula of the luminance enhancement coefficient in the present embodiment is as follows:

wherein p represents a luminance enhancement coefficient, BL_base represents a luminance threshold, and Bl _pix The backlight brightness of the pixel is represented, alpha represents the maximum brightness enhancement factor, and gamma represents a fixed parameter.

The brightness enhancement coefficient p of each pixel is inversely related to the backlight brightness directly below the pixel, when the backlight brightness is lower, the p value is larger, the upper limit is alpha, and the enhancement degree is stronger; when the backlight brightness is larger, the p value is smaller, the enhancement degree is weaker, and the lower limit is 0, which indicates that the backlight is not enhanced.

And 103, carrying out enhancement processing on the image to be displayed according to the brightness enhancement coefficients of the pixels to obtain an enhanced image, and displaying the enhanced image on a display screen.

In some embodiments, the enhanced image is obtained by:

step 4a, converting the image to be displayed into a color image of Lab space, and determining an L-channel image of the color image;

in the implementation, lab space is adopted for brightness enhancement, wherein L is the brightness space, so that detail information on image brightness can be represented better, and meanwhile, image color information can be kept better by enhancing based on L channels, and color deviation can not be generated.

Step 4b, extracting detail information of the L channel image to obtain a detail image;

optionally, the detail information is determined by:

performing low-pass filtering on the L-channel image to obtain a filtered L-channel image; and determining the detail image according to the difference value between the L-channel image and the filtered L-channel image.

In implementation, first, an L-channel image is filtered by a low-pass filter to obtain base layer information (filtered L-channel image) of the image to be displayed, and a specific formula is as follows:

vb=f (Vi) formula (3);

where Vb denotes the filtered L-channel image, vi denotes the L-channel image, and f (x) is the low-pass rate wave operation. The low-pass filter may employ mean filtering, gaussian filtering, etc., which is not excessively limited in this embodiment. The high-frequency information, namely texture details, of the image to be displayed after low-pass filtering is wiped off, and only the low-frequency information, namely information of a video image basal layer, is reserved.

Then, the detail layer information (detail image) is obtained by adopting a method of making difference between the L-channel image and the base layer information (filtered L-channel image), and the specific formula is as follows:

vd=vi-Vb formula (4);

where Vb denotes a filtered L-channel image, vi denotes an L-channel image, and Vd denotes a detail image, i.e., image detail information.

And 4c, carrying out enhancement processing on the detail image according to the brightness enhancement coefficient of each pixel to obtain an enhanced image.

Optionally, the enhancement process is performed by:

determining the product value of the brightness enhancement coefficient of each pixel and the detail image; and determining the enhanced image according to the product value and the sum value of the L channel image.

In implementation, for each pixel corresponding to the backlight partition, a dynamic additive enhancement mode is adopted to improve the detail level, and the specific formula is as follows:

vo=vi+vd×p formula (5);

where Vi denotes an L-channel image, vd denotes a detail image, p denotes a luminance enhancement coefficient, and Vo denotes an enhancement image.

In the implementation, the brightness enhancement coefficient is adjusted by the brightness of the backlight immediately below the pixel, the image detail is multiplied by the coefficient, and the brightness enhancement coefficient and the L-channel image of the image to be displayed are additively enhanced, so that the dynamic enhancement effect aiming at different backlight brightness areas can be realized.

As shown in fig. 3, this embodiment provides a system diagram of image enhancement display, and after a video is input to a display device, backlight processing and pixel processing are performed synchronously, where specific functions of each module are as follows:

The backlight processing comprises backlight calculation, backlight diffusion, enhancement coefficient generation and other modules, and the backlight calculation is used for calculating the backlight brightness of each backlight partition corresponding to the input video (namely the image to be displayed); in implementation, the backlight calculation is used for determining the backlight brightness of the backlight partition corresponding to each sub-image according to the gray data of each sub-image contained in the image to be displayed. As shown in fig. 4, this embodiment provides a flowchart for implementing a backlight calculation module, which performs partition statistics on an input video by using an average value method and a maximum value method, and calculates a maximum gray value and an average gray value of each sub-image. And then adopting gray characteristic weighting statistics, carrying out weighted summation on the maximum gray value and the average gray value according to the weights corresponding to the maximum gray value and the average gray value, and determining the gray data of the sub-image according to the summation value. Smoothing the gray data by adopting a mode of adjacent area smoothing filtering (area filtering) to reduce the partition splitting phenomenon, wherein in the implementation, the filtering window is utilized to traverse each sub-image, and the gray data of the current sub-image in the filtering window is subjected to filtering treatment to obtain the gray data of the current sub-image after filtering; and determining the backlight brightness of the backlight subarea corresponding to each sub-image according to the gray data after filtering the sub-images. Finally, the gray data is converted into backlight brightness driving data (backlight brightness) by using the actually measured gray-brightness mapping table, and the driving data is output.

The backlight diffusion is used for calculating the backlight adjustment brightness of each backlight partition and the backlight brightness of each pixel; in implementation, the backlight diffusion is used for adjusting the backlight brightness of the current backlight partition by using the backlight brightness of other backlight partitions adjacent to the current backlight partition to obtain the backlight adjustment brightness of each backlight partition, and determining the backlight brightness of each pixel corresponding to the current backlight partition according to the backlight adjustment brightness of the backlight partition adjacent to the current backlight partition. As shown in fig. 5, according to the actually measured optical diffusion model, calculating the actual brightness of each backlight partition after brightness superposition; the optical diffusion model needs to be actually measured according to the display module, and a typical diffusion model specification is 7×7, 9×9, 11×11, etc. The optical diffusion model is used for calculating the regional light diffusion, namely calculating the backlight adjustment brightness of each backlight regional area, the brightness interpolation parameter is used for calculating the regional brightness distribution, namely calculating the backlight brightness of each pixel, and in the implementation, a bilinear interpolation method is adopted to calculate the directly-below backlight brightness value in each pixel.

Generating a luminance enhancement coefficient for calculating each pixel; in an implementation, the enhancement coefficients are generated for determining luminance enhancement coefficients for each pixel from the backlight luminance of each pixel. The pixel processing comprises low-pass filtering, detail layer extraction and detail dynamic enhancement, wherein the low-pass filtering is used for converting an input video (namely an image to be displayed) into a color image of Lab space, and the L-channel image is subjected to low-pass filtering to obtain a filtered L-channel image; the detail layer is used for extracting detail information of the L channel image to obtain a detail image; in practice, the detail image may be determined according to a difference between the L-channel image and the filtered L-channel image; the detail dynamic enhancement is used for enhancing the detail image according to the brightness enhancement coefficient of each pixel to obtain an enhanced image; in practice, an enhanced image is determined from the sum of the product value of the luminance enhancement coefficient of each pixel and the detail image and the L-channel image.

As shown in fig. 6, the embodiment further provides a specific implementation flow of image enhancement display, which is as follows:

step 600, obtaining an image to be displayed;

step 601, for each sub-image, according to the maximum gray value and the average gray value in each single-channel image contained in the sub-image, weighting and summing the maximum gray value and the average gray value by using the weights corresponding to the maximum gray value and the average gray value, and determining gray data of the sub-image according to the sum value;

step 602, traversing each sub-image by using a filtering window, and performing filtering processing on the gray data of the current sub-image in the filtering window to obtain the gray data of the current sub-image after filtering;

step 603, determining the backlight brightness of the backlight partition corresponding to the gray data after filtering each sub-image according to the mapping relation between the gray data and the backlight brightness;

step 604, determining the backlight adjustment parameters of the current backlight partition according to the backlight brightness and brightness attenuation coefficients of other backlight partitions adjacent to the current backlight partition;

step 605, determining the backlight adjustment brightness of each backlight partition according to the backlight adjustment parameters and the backlight brightness corresponding to each backlight partition;

step 606, for each pixel corresponding to the current backlight partition, determining the backlight brightness of the pixel based on the bilinear interpolation method according to the backlight adjustment brightness of the backlight partition adjacent to the current backlight partition;

Step 607, determining the brightness enhancement coefficient of each pixel according to the comparison result of the backlight brightness and the brightness threshold value of the pixel;

step 608, converting the image to be displayed into a color image of Lab space, and determining an L-channel image of the color image;

step 609, performing low-pass filtering on the L-channel image to obtain a filtered L-channel image; determining a detail image according to the difference value between the L-channel image and the filtered L-channel image;

step 610, determining a product value of the brightness enhancement coefficient of each pixel and the detail image; and determining an enhanced image according to the product value and the sum value of the L channel image.

Steps 601 to 607 are executed in synchronization with steps 608 to 609.

The method for enhancing the display of the image comprises backlight processing and pixel processing, wherein backlight data are generated according to original video calculation in a backlight processing flow, backlight brightness below each pixel in each partition is obtained according to optical diffusion model calculation, threshold value judgment is carried out on the brightness, and enhancement coefficients of the pixel are generated. In the pixel processing flow, firstly, low-pass filtering is carried out on a source video to obtain video basal layer information, and additive decomposition is carried out on the video basal layer information and the source video to obtain image detail layer information. And carrying out pixel detail enhancement on the source video according to the enhancement coefficient of each pixel by using the obtained detail layer data to obtain compensated pixel data (enhanced image). The actual backlight brightness of each pixel in different backlight partitions is calculated through statistics, the compensation coefficient of the pixel is dynamically generated according to the brightness, and detail enhancement calculation is carried out on the pixel, so that the effect of dark detail enhancement is achieved. The dark field area and the low-brightness subarea in the video image can be identified, the detailed information in the area is enhanced in real time, and meanwhile, the display effects of the images and the backlight in other areas are not influenced, so that the overall display image quality level is improved.

In this embodiment, luminance diffusion calculation may be performed on luminance of each backlight partition, and actual backlight luminance (i.e., backlight adjustment luminance) of each pixel in each partition after luminance diffusion superposition is counted. The actual backlight brightness (namely backlight adjustment brightness) of the pixel is used as an input parameter of a detail lifting threshold value, and the enhancement coefficient of the pixel is generated, so that the effect of improving the details of the dark part is realized.

Based on the same inventive concept, the embodiments of the present disclosure further provide a display device, and since the display device is the display device in the method in the embodiments of the present disclosure, and the principle of the display device to solve the problem is similar to that of the method, the implementation of the display device may refer to the implementation of the method, and the repetition is omitted.

As shown in fig. 7, the display device includes a display screen 700 and a controller 701;

the display screen 700 is configured to perform display of content;

the controller 701 is configured to perform the steps of:

acquiring an image to be displayed, and determining the backlight brightness of a backlight partition corresponding to each sub-image according to the gray data of each sub-image contained in the image to be displayed; wherein one sub-image corresponds to one backlight partition of the display screen backlight layer;

As an alternative embodiment, the controller 701 is specifically configured to perform:

As an alternative embodiment, after determining the gray data of each sub-image, the controller 701 is specifically further configured to perform:

and determining gray data of the sub-images according to the summation value.

extracting detail information of the L channel image to obtain a detail image;

Based on the same inventive concept, the embodiments of the present disclosure further provide an electronic device, and since the electronic device is the electronic device in the method in the embodiments of the present disclosure, and the principle of the electronic device for solving the problem is similar to that of the method, implementation of the electronic device may refer to implementation of the method, and repeated descriptions are omitted.

As shown in fig. 8, the electronic device includes a processor 800 and a memory 901, the memory is used for storing a program executable by the processor, and the processor is used for reading the program in the memory and executing the following steps:

As an alternative embodiment, the processor 800 is specifically configured to perform:

As an alternative embodiment, after determining the gray data of each sub-image, the processor 800 is specifically further configured to perform:

and determining gray data of the sub-images according to the summation value.

extracting detail information of the L channel image to obtain a detail image;

Based on the same inventive concept, the embodiments of the present disclosure further provide an apparatus for enhancing display of an image, and since the apparatus is an apparatus in the method of the embodiments of the present disclosure and the principle of the apparatus for solving the problem is similar to that of the method, the implementation of the apparatus may refer to the implementation of the method, and the repetition is omitted.

As shown in fig. 9, the apparatus includes:

the backlight brightness determining module 900 is configured to obtain an image to be displayed, and determine backlight brightness of a backlight partition corresponding to each sub-image according to gray data of each sub-image included in the image to be displayed; one of the sub-images corresponds to one backlight partition of the backlight layer of the display screen;

the backlight brightness adjustment module 901 is configured to adjust the backlight brightness of the current backlight partition by using the backlight brightness of other backlight partitions adjacent to the current backlight partition, so as to obtain the backlight adjustment brightness of each backlight partition, where the other backlight partitions adjacent to the current backlight partition represent backlight partitions except the current backlight partition in the backlight area including the current backlight partition;

An enhancement coefficient determining module 902, configured to determine, according to the backlight adjustment luminance of the backlight partition adjacent to the current backlight partition, the backlight luminance of each pixel corresponding to the current backlight partition, and determine, according to the backlight luminance of each pixel, the luminance enhancement coefficient of each pixel;

the enhancement processing module 903 is configured to perform enhancement processing on the image to be displayed according to the brightness enhancement coefficient of each pixel, obtain an enhanced image, and display the enhanced image on a display screen.

As an optional implementation manner, the backlight brightness determining module 900 is specifically configured to:

As an alternative embodiment, after determining the gray data of each sub-image, the backlight brightness determining module 900 is specifically further configured to:

and determining gray data of the sub-images according to the summation value.

As an optional implementation manner, the backlight brightness adjusting module 901 is specifically configured to:

As an alternative embodiment, the enhancement factor determining module 902 is specifically configured to:

As an alternative embodiment, the enhancement processing module 903 is specifically configured to:

extracting detail information of the L channel image to obtain a detail image;

Based on the same inventive concept, embodiments of the present disclosure provide a computer storage medium, the computer storage medium including: computer program code which, when run on a computer, causes the computer to perform the method of image enhanced display as any of the previous discussions. Since the principle of the above-mentioned computer storage medium for solving the problem is similar to that of the image enhancement display method, the implementation of the above-mentioned computer storage medium can refer to the implementation of the method, and the repetition is omitted.

In a specific implementation, the computer storage medium may include: a universal serial bus flash disk (USB, universal Serial Bus Flash Drive), a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk or an optical disk, or the like, which can store program codes.

Based on the same inventive concept, the disclosed embodiments also provide a computer program product comprising: computer program code which, when run on a computer, causes the computer to perform the method of image enhanced display as any of the previous discussions. Since the principle of the solution of the problem of the computer program product is similar to that of the image enhancement display method, the implementation of the computer program product can refer to the implementation of the method, and the repetition is omitted.

The computer program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

It will be apparent to those skilled in the art that embodiments of the present disclosure may be provided as a method, system, or computer program product. Accordingly, the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present disclosure may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, magnetic disk storage, optical storage, and the like) having computer-usable program code embodied therein.

The present disclosure is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the disclosure. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

It will be apparent to those skilled in the art that various modifications and variations can be made to the present disclosure without departing from the spirit or scope of the disclosure. Thus, the present disclosure is intended to include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.

Claims

1. A method of image enhanced display, wherein the method comprises:

2. The method of claim 1, wherein the determining the backlight brightness of the backlight partition corresponding to each sub-image according to the gray data of each sub-image included in the image to be displayed comprises:

3. The method of claim 2, wherein after determining the gray data of each sub-image, further comprising:

4. The method of claim 2, wherein the determining the gray data of the sub-image according to the maximum gray value and the average gray value in each single-channel image included in the sub-image comprises:

and determining gray data of the sub-images according to the summation value.

5. The method of claim 4, wherein the weights for the maximum gray value and average gray value are fixed, respectively; or alternatively, the first and second heat exchangers may be,

6. The method of claim 1, wherein adjusting the backlight brightness of the current backlight partition by using the backlight brightness of other backlight partitions adjacent to the current backlight partition, to obtain the backlight adjusted brightness of each backlight partition, comprises:

7. The method of claim 6, wherein the determining the backlight adjustment parameters of the current backlight partition according to the backlight brightness and brightness decay coefficients of other backlight partitions adjacent to the current backlight partition comprises:

8. The method of claim 1, wherein the determining the backlight brightness of each pixel corresponding to the current backlight partition according to the backlight adjustment brightness of the backlight partition adjacent to the current backlight partition comprises:

9. The method of claim 8, wherein the determining the backlight brightness of the pixel based on the bilinear interpolation method according to the backlight adjustment brightness of the backlight partition adjacent to the current backlight partition comprises:

10. The method of claim 8, wherein the determining the backlight brightness of the pixel from the backlight adjustment brightness of the adjacent backlight partitions and the distance comprises:

11. The method of claim 1, wherein the brightness enhancement coefficient of the pixel varies with a variation in backlight brightness of the pixel within a preset range; the luminance enhancement coefficient of the pixel is inversely related to the backlight luminance of the pixel.

12. The method of claim 1, wherein the determining the luminance enhancement coefficient of each pixel from the backlight luminance of each pixel comprises:

13. The method of claim 12, wherein the determining the brightness enhancement factor of each pixel according to the comparison result of the backlight brightness of the pixel and the brightness threshold value comprises:

14. The method according to claim 1, wherein the enhancing the image to be displayed according to the brightness enhancement coefficient of each pixel to obtain an enhanced image comprises:

extracting detail information of the L channel image to obtain a detail image;

15. The method of claim 14, wherein the extracting the detail information of the L-channel image to obtain a detail image includes:

16. The method of claim 14, wherein the enhancing the detail image according to the brightness enhancement coefficient of each pixel to obtain an enhanced image comprises:

17. A display device, comprising a display screen and a controller;

the display screen is configured to perform display of content;

the controller is configured to perform the steps of the method of any one of claims 1 to 16.

18. An electronic device comprising a processor and a memory for storing a program executable by the processor, the processor being arranged to read the program in the memory and to perform the steps of the method according to any one of claims 1 to 16.

19. A computer storage medium having stored thereon a computer program, wherein the program when executed by a processor realizes the steps of the method according to any of claims 1 to 16.