CN113783996A - Screen defect optimization method, device and equipment and computer storage medium - Google Patents

Screen defect optimization method, device and equipment and computer storage medium Download PDF

Info

Publication number
CN113783996A
CN113783996A CN202110945825.0A CN202110945825A CN113783996A CN 113783996 A CN113783996 A CN 113783996A CN 202110945825 A CN202110945825 A CN 202110945825A CN 113783996 A CN113783996 A CN 113783996A
Authority
CN
China
Prior art keywords
screen
shot image
defect
image
screen shot
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110945825.0A
Other languages
Chinese (zh)
Other versions
CN113783996B (en
Inventor
李立锋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Migu Cultural Technology Co Ltd
China Mobile Communications Group Co Ltd
Original Assignee
Migu Cultural Technology Co Ltd
China Mobile Communications Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Migu Cultural Technology Co Ltd, China Mobile Communications Group Co Ltd filed Critical Migu Cultural Technology Co Ltd
Priority to CN202110945825.0A priority Critical patent/CN113783996B/en
Publication of CN113783996A publication Critical patent/CN113783996A/en
Application granted granted Critical
Publication of CN113783996B publication Critical patent/CN113783996B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72439User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Abstract

The invention relates to the technical field of screens, and discloses a screen defect optimization method, a device, equipment and a storage medium, wherein the method comprises the following steps: setting a display picture of a screen to be optimized as a preset picture containing a preset regular graph, shooting the display picture of the screen to be optimized through an under-screen camera of the screen to be optimized to obtain a first screen shot image, and acquiring a screenshot image of the display picture; adjusting the pixel size of the first screen shot image according to a preset regular graph to obtain a second screen shot image, wherein the image proportion of the second screen shot image is the same as that of the screenshot image; performing image characteristic overlapping processing on the second screen shot image and the screen shot image, and determining the defect pixel coordinates of the screen defect area in the second screen shot image in the screen shot image; and performing visual optimization on the screen defects according to the defective pixel coordinates. The position of the screen defect is determined by using the under-screen camera of the equipment, so that the cost for optimizing the screen defect is reduced.

Description

Screen defect optimization method, device and equipment and computer storage medium
Technical Field
The invention relates to the technical field of screens, in particular to a screen defect optimization method, a device, equipment and a computer storage medium.
Background
With the development of science and technology, people have a wider and wider application range of mobile terminals, and the frequency of using mobile terminals is higher and higher, so that a user can drop the mobile terminal to the ground due to carelessness in the process of using the mobile terminal, or the screen is scratched by a hard object, so that the screen is cracked or scratched, when the screen is cracked, the user cannot use a mobile phone and the cost for repairing the screen is high, the user cannot replace the screen generally, but the screen is cracked or scratched during use to visually influence the use impression of the screen, and therefore a scheme for visually optimizing screen defects is urgently needed.
At present, when visual optimization is performed on a screen defect, a relative position of a screen defect area in a screen needs to be determined first, and then visual optimization is performed on pixels at the relative position, a scheme for determining the position of the screen defect area is to detect a depth value of each pixel point of the screen from the outer surface of the screen through a distance sensor, and the pixel point with the depth value larger than 0 is a place with cracks or depressions. The detection mode has extremely high precision requirement on the distance sensor, the common smart phone is not provided with the distance sensor generally, and even if the distance sensor is arranged, the precision requirement of screen defect detection is difficult to meet.
Disclosure of Invention
The invention mainly aims to provide a screen defect optimization method, a screen defect optimization device, screen defect optimization equipment and a computer storage medium, and aims to solve the technical problem that the existing screen defect optimization scheme is high in cost.
In order to achieve the above object, the present invention provides a screen defect optimization method, which comprises the following steps:
setting a display picture of a screen to be optimized into a preset picture containing a preset regular graph, shooting the display picture of the screen to be optimized through an under-screen camera of the screen to be optimized to obtain a first screen shot image, and acquiring a screenshot image of the display picture;
adjusting the pixel size of the first screen shot image according to the preset rule graph to obtain a second screen shot image, wherein the image proportion of the second screen shot image is the same as that of the screen shot image;
performing image feature overlapping processing on the second screen shot image and the screen shot image, and determining the defect pixel coordinates of the screen defect area in the second screen shot image in the screen shot image;
and performing visual optimization on the screen defects according to the defective pixel coordinates.
Optionally, the step of adjusting the pixel size of the first screen shot image according to the preset rule graph to obtain a second screen shot image includes:
determining a first pixel size of the preset regular pattern in the screenshot image and a second pixel size of the preset regular pattern in the first screenshot image, and calculating a ratio of the first pixel size to the second pixel size;
and adjusting the pixel size of the first screen shot image according to the ratio to obtain a second screen shot image.
Optionally, the step of performing image feature overlapping processing on the second screenshot image and the screenshot image includes:
partitioning the second screen shot image and the screenshot image according to the size of a preset pixel;
calculating the image fingerprints of all the partitions of the second screen shot image and the screen shot image, and determining the target partitions with the same image fingerprints in the second screen shot image and the screen shot image;
and correspondingly overlapping the target partitions in the second screen shot image and the screenshot image so as to overlap the second screen shot image and the screenshot image.
Optionally, the step of visually optimizing the screen defect according to the defective pixel coordinate includes:
setting the display picture of the screen to be optimized as a preset pure-color picture, and shooting the display picture of the screen to be optimized to obtain a third screen shot image;
determining a first color value of a screen defect area in the third screen shot image and a second color value of a non-screen defect area in the third screen shot image;
adjusting the color value of the defective pixel coordinate according to the sizes of the first color value and the second color value;
and recording a color value adjustment difference value before and after the color value adjustment of the defective pixel coordinate, so as to optimize the screen defect according to the color value adjustment difference value.
Optionally, the step of adjusting the color value of the defective pixel coordinate according to the sizes of the first color value and the second color value includes:
if the difference value between the first color value and the second color value is larger than or equal to a first preset difference value, reducing the color value of the defective pixel coordinate according to the size of a preset color value, and returning to the execution step: shooting a display picture of the screen to be optimized to obtain a third screen shot image; wherein the first preset difference is greater than zero;
if the difference value between the first color value and the second color value is smaller than or equal to a second preset difference value, increasing the color value of the defective pixel coordinate according to the size of the preset color value, and returning to the execution step: shooting a display picture of the screen to be optimized to obtain a third screen shot image; wherein the second preset difference is less than zero;
and if the difference value between the first color value and the second color value is greater than a second preset difference value and smaller than a first preset difference value, finishing the color value adjustment of the defective pixel coordinate.
Optionally, the step of visually optimizing the screen defect according to the defective pixel coordinate includes:
setting the display picture of the screen to be optimized as a preset pure-color picture, and shooting the display picture of the screen to be optimized to obtain a fourth screen shot image;
determining a first brightness of a screen defect area in the fourth screen shot image and a second brightness of a non-screen defect area in the fourth screen shot image;
adjusting the brightness of the defective pixel coordinate according to the first brightness and the second brightness;
and recording a brightness adjustment difference value before and after the brightness adjustment of the defective pixel coordinate so as to optimize the screen defect according to the brightness adjustment difference value.
Optionally, the step of visually optimizing the screen defect according to the defective pixel coordinate includes:
detecting the defect screen thickness of the screen defect corresponding to the defect pixel coordinate through an ultrasonic transmitter;
determining the light transmittance of the defect screen at the position of the screen defect according to the thickness of the defect screen;
and obtaining third brightness of the adjacent coordinate of the defective pixel coordinate, determining the optimized output brightness of the defective pixel coordinate according to the defective screen light transmittance, the preset screen light transmittance and the third brightness, and adjusting the brightness of the defective pixel coordinate according to the optimized output brightness.
In addition, to achieve the above object, the present invention also provides a screen defect optimizing apparatus, including:
the system comprises a shooting screenshot module, a display module and a control module, wherein the shooting screenshot module is used for setting a display picture of a screen to be optimized into a preset picture containing a preset regular graph, shooting the display picture of the screen to be optimized through an under-screen camera of the screen to be optimized to obtain a first screenshot image, and acquiring the screenshot image of the display picture;
the size adjusting module is used for adjusting the pixel size of the first screen shot image according to the preset rule graph to obtain a second screen shot image, and the image proportion of the second screen shot image is the same as that of the screen shot image;
the characteristic overlapping module is used for carrying out image characteristic overlapping processing on the second screen shot image and the screenshot image and determining the defect pixel coordinates of the screen defect area in the second screen shot image in the screenshot image;
and the visual optimization module is used for carrying out visual optimization on the screen defects according to the defective pixel coordinates.
In addition, to achieve the above object, the present invention also provides a screen defect optimizing apparatus, including: the screen defect optimization method comprises a memory, a processor and a screen defect optimization program stored on the memory and capable of running on the processor, wherein the screen defect optimization program realizes the steps of the screen defect optimization method when being executed by the processor.
In addition, to achieve the above object, the present invention also provides a computer storage medium having a screen defect optimization program stored thereon, which when executed by a processor implements the steps of the screen defect optimization method as described above.
Furthermore, to achieve the above object, the present invention also provides a computer program product comprising a screen defect optimization program, which when executed by a processor implements the steps of the screen defect optimization method as described above.
The method comprises the steps that a display picture of a screen to be optimized is set to be a preset picture containing a preset regular graph, the display picture of the screen to be optimized is shot through an under-screen camera of the screen to be optimized to obtain a first screen shot image, and a screenshot image of the display picture is obtained; adjusting the pixel size of the first screen shot image according to the preset rule graph to obtain a second screen shot image, wherein the image proportion of the second screen shot image is the same as that of the screen shot image; performing image feature overlapping processing on the second screen shot image and the screen shot image, and determining the defect pixel coordinates of the screen defect area in the second screen shot image in the screen shot image; and performing visual optimization on the screen defects according to the defective pixel coordinates.
According to the invention, the screen shot image of the display picture containing the preset regular pattern is shot through the screen lower camera, the screen shot image of the display picture containing the preset regular pattern is shot, the proportion consistency adjustment is carried out based on the preset regular pattern, then the image characteristic overlapping processing is carried out on the screen shot image and the screen shot image, so that the pixel coordinate of the screen defect in the screen shot image is determined, then the visual optimization is carried out on the screen defect according to the pixel coordinate, the accurate determination of the position of the screen defect by using the screen lower camera of the equipment is realized, and the cost of the optimization of the screen defect is reduced.
Drawings
FIG. 1 is a schematic diagram of a screen defect optimization device of a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a screen defect optimization method according to a first embodiment of the present invention;
FIG. 3 is a block diagram of a screen defect optimizing apparatus according to the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
As shown in fig. 1, fig. 1 is a schematic structural diagram of a screen defect optimization device of a hardware operating environment according to an embodiment of the present invention.
The screen defect optimization equipment of the embodiment of the invention can be a PC (personal computer) or server equipment, and a virtual machine runs on the equipment.
As shown in fig. 1, the screen defect optimizing apparatus may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the screen defect optimizing device configuration shown in fig. 1 does not constitute a limitation of the device and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a screen defect optimization program.
In the screen defect optimization device shown in fig. 1, the network interface 1004 is mainly used for connecting to a background server and performing data communication with the background server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the processor 1001 may be configured to call a screen defect optimization program stored in the memory 1005 and perform operations in the screen defect optimization method described below.
Based on the hardware structure, the embodiment of the screen defect optimization method is provided.
Referring to fig. 2, fig. 2 is a schematic flow chart of a first embodiment of a screen defect optimization method of the present invention, the method includes:
step S10, setting a display picture of a screen to be optimized as a preset picture containing a preset regular graph, shooting the display picture of the screen to be optimized through an under-screen camera of the screen to be optimized to obtain a first screen shot image, and acquiring a screenshot image of the display picture;
the screen defect optimization method is applied to equipment with an off-screen camera, and the equipment can be a terminal, a robot or PC equipment.
In the prior art, when performing visual optimization on a screen defect, it is necessary to determine a relative position of a screen defect area in a screen first, and then perform visual optimization on a pixel at the relative position, where a scheme of determining the position of the screen defect area is to detect a depth value of each pixel point of the screen from an outer surface of the screen through a distance sensor, and a pixel point with a depth value greater than 0 is a place with a crack or a dent. The detection mode has extremely high precision requirement on the distance sensor, the common smart phone is not provided with the distance sensor generally, and even if the distance sensor is arranged, the precision requirement of screen defect detection is difficult to meet.
Against this background, the present embodiment provides a screen defect optimization scheme.
In this embodiment, when screen optimization needs to be performed on a device with a screen defect, a display picture of a screen to be optimized is first set as a preset picture, then a current display picture of the screen is shot by a sub-screen camera under the screen to obtain a first screen shot image, and a screenshot is performed on the current display picture to obtain a screenshot image. The preset pictures comprise preset regular graphs, and the preset regular graphs refer to graphs with obvious preset characteristics, such as squares, rectangles and the like, so that the efficiency of extracting the preset regular graphs from the images shot by the camera under the screen is improved; the screen defect in the present embodiment may be a scratch, a crack, a dent, or the like.
It can be understood that an image obtained by directly shooting a display picture by the off-screen camera is a mirror image of the screen display picture and the screen defect, so that the image obtained by directly shooting the display picture by the off-screen camera needs to be subjected to mirror image inversion to obtain a first screen shot image, wherein the first screen shot image comprises the screen display picture and the screen defect, and specifically, the first screen shot image comprises a preset picture and the screen defect; the screenshot image only includes the preset picture, so that whether the screen has defects and the positions of the screen defects cannot be determined only according to the screenshot image, and the screen defects need to be determined by combining the first screenshot image containing the screen defects.
Step S20, adjusting the pixel size of the first screen shot image according to the preset rule graph to obtain a second screen shot image, wherein the image proportion of the second screen shot image is the same as that of the screenshot image;
due to the influences of factors such as a certain distance between the screen lower camera and the screen, different resolutions between the screen lower camera and the screen and the like, the proportion of the first screen shot image and the screen shot image may be inconsistent, which is embodied as that the pixel size of the same preset regular pattern in the first screen shot image and the screen shot image is inconsistent, correspondingly, the size of the screen defect area in the first screen shot image may be larger or smaller than that of the actual screen defect area, if the inconsistency is not considered, the screen defect coordinates in the screen shot image are directly determined according to the position of the screen defect in the first screen shot image, the screen defect area is inaccurately positioned due to the inconsistent proportion, and further the visual optimization effect is poor.
In order to avoid such a defect, in this embodiment, the pixel size of the first screen shot image is adjusted according to the relative size of the preset regular image in the first screen shot image and the screen shot image to obtain a second screen shot image, so that the pixel size of the preset regular pattern in the second screen shot image is the same as the pixel size of the preset regular pattern in the screen shot image, and further, the image proportion of the second screen shot image is the same as the screen shot image.
Further, the step S20 includes:
a1, determining a first pixel size of the preset regular pattern in the screenshot image and a second pixel size of the preset regular pattern in the first screenshot image, and calculating a ratio of the first pixel size to the second pixel size;
step a2, adjusting the pixel size of the first screen shot image according to the ratio to obtain a second screen shot image.
After the ratio is determined, the pixel size of the first screen shot image can be amplified or reduced according to the ratio to obtain a second screen shot image, and thus the image proportion of the second screen shot image is the same as that of the screenshot image. For example, if the ratio N>1, amplifying the pixel size of the first screen shot image by N times; if the ratio N is<1, reducing the pixel size of the first screen shot image by N times; if N is 1, the pixel size of the first screen captured image does not need to be adjusted.
Step S30, performing image feature overlapping processing on the second screen shot image and the screenshot image, and determining a defect pixel coordinate of a screen defect area in the second screen shot image in the screenshot image;
in this embodiment, considering the influence of factors such as a certain distance between the off-screen camera and the screen, and a difference in resolution between the off-screen camera and the screen, the captured image may include only a part of the preset image, or further include an image in a non-screen area, which results in that the content of the captured image is partially the same as that of the screenshot image, and the part of the captured image is not the same.
After the pixel size adjustment and the image anchoring, a screen defect area in the second screen shot image can be identified, then the screen defect area in the second screen shot image is mapped into the screen shot image, and the coordinate of the screen defect area in the screen shot image, namely the coordinate of the defect pixel, is determined.
Further, in step S30, the step of performing image feature overlapping processing on the second captured image and the screenshot image includes:
b1, partitioning the second screen shot image and the screenshot image according to the preset pixel size;
step b2, calculating the image fingerprints of each subarea of the second screen shot image and the screen shot image, and determining the target subarea with the same image fingerprint in the second screen shot image and the screen shot image;
step b3, correspondingly overlapping the target sections in the second screen shot image and the screenshot image, so that the second screen shot image and the screenshot image are overlapped.
In this embodiment, determining the areas of the two images that have the same content is accomplished by image fingerprints. The second screen shot image is divided into N partitions according to the size of a preset pixel, the screenshot image is divided into M partitions according to the size of the preset pixel, and the pixel size of each partition is the size of the preset pixel.
Calculating the image fingerprint of each partition in each image, matching the image fingerprints of the second screen shot image with the image fingerprints of each partition in the screen shot image, determining the partition with the same image fingerprint as a target partition, overlapping a first target partition in the second screen shot image with a second target partition in the screen shot image with the same image fingerprint of the first target partition, and overlapping the second screen shot image with the screen shot image.
The embodiment provides a scheme for realizing image anchoring according to image fingerprints, and the complexity of image feature overlapping processing is reduced, so that the efficiency of screen defect optimization is improved.
In another embodiment, the preset picture further includes a preset feature pattern, and the step of performing image feature overlapping processing on the second screenshot image and the screenshot image includes: and overlapping preset characteristic patterns in the second screen shot image and the screenshot image so as to overlap the second screen shot image and the screenshot image.
And step S40, visually optimizing the screen defect according to the defect pixel coordinate.
Through the steps, the defect pixel coordinates of the screen defect area in the screenshot image are determined, namely the screen physical coordinates of the screen defect area are determined, and the display parameters of the pixel coordinates in the screen are adjusted according to the screen physical coordinates by the equipment, so that the display parameters of the screen defect position can be adjusted according to the defect pixel coordinates in a targeted mode to weaken the visual effect brought by the screen defect, the screen defect is not easy to see by a user, and the effect of visually hiding the screen defect is achieved.
The method includes the steps that a display picture of a screen to be optimized is set to be a preset picture containing a preset regular graph, the display picture of the screen to be optimized is shot through an under-screen camera of the screen to be optimized to obtain a first screen shot image, and a screenshot image of the display picture is obtained; adjusting the pixel size of the first screen shot image according to the preset rule graph to obtain a second screen shot image, wherein the image proportion of the second screen shot image is the same as that of the screen shot image; performing image feature overlapping processing on the second screen shot image and the screen shot image, and determining the defect pixel coordinates of the screen defect area in the second screen shot image in the screen shot image; and performing visual optimization on the screen defects according to the defective pixel coordinates. In the embodiment, the screen shot image of the display picture containing the preset regular pattern is shot through the off-screen camera, the screen shot image of the display picture containing the preset regular pattern is shot, the proportion consistency adjustment is carried out based on the preset regular pattern, and then the image feature overlapping processing is carried out on the screen shot image and the screen shot image, so that the pixel coordinate of the screen defect in the screen shot image is determined, then the visual optimization is carried out on the screen defect according to the pixel coordinate, the accurate determination of the position of the screen defect by using the off-screen camera of the equipment is realized, and the cost of the screen defect optimization is reduced.
Further, based on the above embodiment, a second embodiment of the screen defect optimization method of the present invention is provided.
The step S40 includes:
step c1, setting the display picture of the screen to be optimized as a preset pure color picture, and shooting the display picture of the screen to be optimized to obtain a third screen shot image;
a step c2 of determining a first color value of a screen defect area in the third screen shot image and a second color value of a non-screen defect area in the third screen shot image;
step c3, adjusting the color value of the defect pixel coordinate according to the size of the first color value and the second color value;
and c4, recording the color value adjustment difference value before and after the color value adjustment of the defective pixel coordinate, so as to optimize the screen defect according to the color value adjustment difference value.
In this embodiment, a scheme for optimizing a screen defect by adjusting a color value is provided. Firstly, a display picture of a screen to be optimized is set as a preset pure color picture, for example, the preset pure color picture may be a pure Red (Red), a pure Green (Green) and/or a pure Blue (Blue) picture, and the setting of the display picture as the pure color can reduce the complexity of the content color of the picture. The current display picture of the screen to be optimized is shot through the screen lower camera of the screen to be optimized to obtain a third screen shot image, then the color value of the defect pixel coordinate of the screen to be optimized is adjusted according to the color value of the screen defect area and the color value of the non-screen defect area in the third screen shot image, and the adjustment principle is that when the adjusted display picture is shot by the screen lower camera again, the color value of the screen defect area and the color value of the non-screen defect area in the shot image are close to each other as much as possible, so that the visual effect of the screen defect area is weakened. It should be noted that, a display picture captured by the off-screen camera is similar to a display picture seen by human eyes of a user, and if a color value of a screen defect area in the display picture captured by the off-screen camera is as close as possible to a color value of a non-screen defect area, a sharp feeling caused by a screen defect can be reduced, and a visual effect of the screen defect seen by the human eyes of the user is weakened.
And after the adjustment of the color value of the defective pixel coordinate is finished, recording a color value adjustment difference value before and after the adjustment of the color value, so that when other pictures are displayed on the screen to be optimized subsequently, the color value of the defective pixel coordinate is optimized according to the color value adjustment difference value. Specifically, when other pictures are displayed, the color value to be output of the defect pixel coordinate when other pictures are displayed is obtained; subtracting the color value adjustment difference value from the color value to be output to obtain an optimized output color value; and controlling the coordinates of the defective pixels to display other pictures according to the optimized output color values.
Further, the step c4 includes:
step d1, if the difference between the first color value and the second color value is greater than or equal to the first preset difference, reducing the color value of the defective pixel coordinate according to the preset color value, and returning to execute the steps of: shooting a display picture of the screen to be optimized to obtain a third screen shot image; wherein the first preset difference is greater than zero;
step d2, if the difference between the first color value and the second color value is less than or equal to a second preset difference, increasing the color value of the defective pixel coordinate according to the preset color value, and returning to execute the steps of: shooting a display picture of the screen to be optimized to obtain a third screen shot image; wherein the second preset difference is less than zero;
and d3, if the difference between the first color value and the second color value is greater than a second preset difference and smaller than the first preset difference, ending the color value adjustment of the defective pixel coordinate.
In this embodiment, when the color value of the defective pixel coordinate of the screen to be optimized is adjusted, the color value adjustment direction of the defective pixel coordinate is determined according to the difference value between the first color value and the second color value, where the color value adjustment direction includes decreasing, increasing, and maintaining.
If the difference value is larger than or equal to a first preset difference value, reducing the color value of the defective pixel coordinate according to the preset color value, and then returning to the step: and shooting the display picture with the reduced color value to obtain a new screen shot image, determining the difference value of the new color value of the screen defect area and the color value of the non-screen defect area in the new screen shot image, if the difference value is still larger than or equal to a first preset difference value, continuing to reduce the color value of the defect pixel coordinate according to the preset color value until the color value difference value is larger than a second preset difference value and smaller than the first preset difference value, and finishing the color value adjustment of the defect pixel coordinate. Wherein the first predetermined difference is greater than zero.
If the difference value is less than or equal to a second preset difference value, increasing the color value of the defective pixel coordinate according to the preset color value, and then returning to the step: and if the difference value is still less than or equal to a second preset difference value, continuing to increase the color value of the defective pixel coordinate according to the preset color value until the color value difference value is greater than the second preset difference value and less than the first preset difference value, and finishing the color value adjustment of the defective pixel coordinate. Wherein the second predetermined difference is less than zero.
Of course, if the difference is greater than the second preset difference and smaller than the first preset difference, it indicates that the difference between the color values observed by the human eye in the screen defect region and the color values observed in the non-screen defect region is very small, and even the difference cannot be observed by the human eye, the color value adjustment process is completed without continuously adjusting the color value of the screen defect region.
The color value of screen defect department is through increasing or reducing gradually to this embodiment, then shoots the screen display picture through camera under the screen, when the difference between the color value of screen defect department and non-screen defect department in shooting the picture satisfies the preset condition, finishes the color value adjustment, has realized that the limit is optimized the limit and is compared to reduce the visual effect of screen defect to minimum.
Further, based on the first embodiment or the second embodiment, a third embodiment of the screen defect optimization method of the present invention is provided.
The step S40 includes:
step e1, setting the display picture of the screen to be optimized as a preset pure color picture, and shooting the display picture of the screen to be optimized to obtain a fourth screen shot image;
a step e2 of determining a first brightness of a screen defect area in the fourth screen shot image and a second brightness of a non-screen defect area in the fourth screen shot image;
step e3, adjusting the brightness of the defective pixel coordinate according to the first brightness and the second brightness;
and e4, recording the brightness adjustment difference value before and after the brightness adjustment of the defective pixel coordinate, so as to optimize the screen defect according to the brightness adjustment difference value.
In the present embodiment, a scheme for optimizing the screen defect by adjusting the brightness is proposed. Firstly, a display picture of a screen to be optimized is set as a preset pure color picture, for example, the preset pure color picture may be a pure Red (Red), a pure Green (Green) and/or a pure Blue (Blue) picture, and the setting of the display picture as the pure color can reduce the complexity of the brightness of the content of the picture. The current display picture of the screen to be optimized is shot through the under-screen camera of the screen to be optimized to obtain a fourth screen shot image, then the brightness of the defect pixel coordinate of the screen to be optimized is adjusted according to the brightness of the screen defect area and the brightness of the non-screen defect area in the fourth screen shot image, and the adjustment principle is that when the adjusted display picture is shot by the under-screen camera again, the brightness of the screen defect area and the brightness of the non-screen defect area in the shot image are close to each other as much as possible, so that the visual effect of the screen defect area is weakened. It should be noted that, a display picture captured by the off-screen camera is similar to a display picture seen by human eyes of a user, and if the brightness of the screen defect area in the display picture captured by the off-screen camera is as close as possible to the brightness of the non-screen defect area, the obtrusive feeling caused by the screen defect can be reduced, and the visual effect of the screen defect seen by the human eyes of the user is weakened.
And after the brightness adjustment of the defective pixel coordinate is finished, recording a brightness adjustment difference value before and after the brightness adjustment so as to optimize the brightness of the defective pixel coordinate according to the brightness adjustment difference value when other pictures are displayed on the screen to be optimized subsequently. Specifically, when other pictures are displayed, the output brightness of the defective pixel coordinate when other pictures are displayed is obtained; subtracting the brightness adjustment difference value from the output brightness to obtain optimized output brightness; and controlling the coordinates of the defective pixels to display other pictures according to the optimized output brightness.
Further, the step e4 includes:
step f1, if the difference between the first brightness and the second brightness is greater than or equal to a third preset difference, reducing the brightness of the defective pixel coordinate according to the preset brightness, and returning to execute the steps of: shooting a display picture of the screen to be optimized to obtain a fourth screen shot image; wherein the third preset difference is greater than zero;
step f2, if the difference between the first brightness and the second brightness is less than or equal to the fourth preset difference, increasing the brightness of the defective pixel coordinate according to the preset brightness, and returning to execute the steps of: shooting a display picture of the screen to be optimized to obtain a third screen shot image; wherein the fourth preset difference is less than zero;
and f3, if the difference between the first brightness and the second brightness is greater than a fourth preset difference and smaller than a third preset difference, ending the brightness adjustment of the defective pixel coordinate.
In this embodiment, when the brightness of the defective pixel coordinate of the screen to be optimized is adjusted, the brightness adjustment direction of the defective pixel coordinate is determined according to the difference value between the first brightness and the second brightness, and the brightness adjustment direction includes decreasing, increasing, and maintaining.
If the difference value is larger than or equal to a third preset difference value, reducing the brightness of the defective pixel coordinate according to the preset brightness, and then returning to the step: and if the difference value is still larger than or equal to a third preset difference value, the brightness of the defective pixel coordinate is continuously reduced according to the preset brightness until the brightness difference value is larger than a fourth preset difference value and smaller than the third preset difference value, and the brightness adjustment of the defective pixel coordinate is finished. Wherein the third predetermined difference is greater than zero.
If the difference value is less than or equal to a fourth preset difference value, increasing the brightness of the defective pixel coordinate according to the preset brightness, and then returning to the step: and if the difference value is still less than or equal to a fourth preset difference value, the brightness of the defective pixel coordinate is continuously increased according to the preset brightness until the brightness difference value is greater than the fourth preset difference value and less than a third preset difference value, and the brightness adjustment of the defective pixel coordinate is finished. Wherein the fourth predetermined difference is less than zero.
Of course, if the difference is greater than the fourth preset difference and smaller than the third preset difference, it indicates that the difference between the brightness of the screen defect region observed by the human eye and the brightness of the non-screen defect region is very small, and even the difference cannot be observed by the human eye, the brightness of the screen defect region does not need to be continuously adjusted, and the brightness adjustment process is completed.
According to the embodiment, the brightness of the screen defect is gradually increased or reduced, then the screen display picture is shot through the camera under the screen, when the difference between the brightness of the screen defect and the brightness of the non-screen defect in the shot picture meets the preset condition, the brightness adjustment is finished, the optimization and comparison are realized, and therefore the visual effect of the screen defect is reduced to the minimum.
It is understood that the schemes for optimizing screen defects by adjusting brightness and adjusting color values can be implemented individually or in combination.
Further, the step S40 includes:
step g1, detecting the defect screen thickness of the screen defect corresponding to the defect pixel coordinate by an ultrasonic transmitter;
step g2, determining the defect screen light transmittance at the screen defect position according to the defect screen thickness;
step g3, obtaining a third brightness of a near coordinate of the defective pixel coordinate, determining an optimized output brightness of the defective pixel coordinate according to the defective screen light transmittance, a preset screen light transmittance and the third brightness, and adjusting the brightness of the defective pixel coordinate according to the optimized output brightness.
In the present embodiment, another scheme for optimizing the screen defect by adjusting the brightness is proposed. First, an ultrasonic wave is transmitted to a screen to be optimized by an ultrasonic wave transmitter of the apparatus itself, and the thickness of the screen is determined according to the transmission time of the ultrasonic wave and the reception time of the reflected wave, wherein the thickness of the screen at a screen defect is generally different from the thickness of the screen at a non-screen defect.
Since the model, material, etc. of the screen are known, the transmittance of the screen defect and the non-screen defect can be calculated according to the lambert beer's law mathematical expression, wherein the lambert beer's law mathematical expression is as follows:
-log(T)=K*I*C;
wherein T is the light transmittance;
k is a molar absorption coefficient, and is related to the properties of the screen and the wavelength of incident light;
i is the screen thickness;
c is the concentration of the light absorbing species, determined by the nature of the screen.
After the light transmittance at the screen defect position, namely the defect screen light transmittance T1, and the light transmittance at the non-screen defect position, namely the preset screen light transmittance T2, are determined, when the screen to be optimized displays any picture, the third brightness L2 of the adjacent coordinate of the defect pixel coordinate is obtained, wherein the adjacent coordinate can be the coordinate of a preset number of pixels around the defect pixel coordinate, and the preset number of pixels can be any value of 1-5 pixels.
Calculating the optimized output brightness L1 of the defective pixel coordinates according to T1, T2, L2 and a first calculation formula, wherein the first calculation formula is as follows:
L1/L2=T2/T1。
considering that the screen defect is generally a scratch or a crack, and no matter the scratch or the crack, the screen thickness at the screen defect is thinned, so that the light transmittance at the screen defect is greater than that at the non-screen defect, and further the brightness at the screen defect observed by human eyes is greater than that at the non-screen defect, therefore, the brightness at the screen defect needs to be reduced, the optimal output brightness of the defective pixel coordinate can be calculated according to the first calculation formula, and the brightness of the defective pixel coordinate is adjusted to the optimal output brightness.
Therefore, the flow of screen defect optimization can be simplified, and the efficiency of screen defect optimization is improved.
The present invention also provides a screen defect optimizing apparatus, referring to fig. 3, the screen defect optimizing apparatus including:
the screen capture module 10 is configured to set a display picture of a screen to be optimized to a preset picture including a preset regular pattern, capture the display picture of the screen to be optimized through an off-screen camera of the screen to be optimized to obtain a first screen capture image, and obtain a screen capture image of the display picture;
a size adjusting module 20, configured to adjust a pixel size of the first screen shot image according to the preset rule pattern to obtain a second screen shot image, where an image proportion of the second screen shot image is the same as that of the screenshot image;
a feature overlapping module 30, configured to perform image feature overlapping processing on the second screen shot image and the screenshot image, and determine a defect pixel coordinate of a screen defect area in the second screen shot image in the screenshot image;
and the visual optimization module 40 is used for carrying out visual optimization on the screen defects according to the defective pixel coordinates.
The method executed by each program unit can refer to each embodiment of the screen defect optimization method of the present invention, and is not described herein again.
The present invention also provides a screen defect optimizing apparatus, which includes: the method for implementing the screen defect optimization program when being executed by the processor can refer to each embodiment of the screen defect optimization method of the invention, and details are not repeated herein.
The invention also provides a computer storage medium.
The computer storage medium of the present invention has stored thereon a screen defect optimization program that, when executed by a processor, implements the steps of the screen defect optimization method described above.
The method implemented when the screen defect optimization program running on the processor is executed may refer to each embodiment of the screen defect optimization method of the present invention, and details are not described herein again.
The invention also provides a computer program product.
The computer program product of the invention comprises a screen defect optimization program which, when executed by a processor, implements the steps of the screen defect optimization method as described above.
The method implemented when the screen defect optimization program running on the processor is executed may refer to each embodiment of the screen defect optimization method of the present invention, and details are not described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims (10)

1. A screen defect optimization method is characterized by comprising the following steps:
setting a display picture of a screen to be optimized into a preset picture containing a preset regular graph, shooting the display picture of the screen to be optimized through an under-screen camera of the screen to be optimized to obtain a first screen shot image, and acquiring a screenshot image of the display picture;
adjusting the pixel size of the first screen shot image according to the preset rule graph to obtain a second screen shot image, wherein the image proportion of the second screen shot image is the same as that of the screen shot image;
performing image feature overlapping processing on the second screen shot image and the screen shot image, and determining the defect pixel coordinates of the screen defect area in the second screen shot image in the screen shot image;
and performing visual optimization on the screen defects according to the defective pixel coordinates.
2. The screen defect optimization method of claim 1, wherein the step of adjusting the pixel size of the first screen shot image according to the preset rule pattern to obtain a second screen shot image comprises:
determining a first pixel size of the preset regular pattern in the screenshot image and a second pixel size of the preset regular pattern in the first screenshot image, and calculating a ratio of the first pixel size to the second pixel size;
and adjusting the pixel size of the first screen shot image according to the ratio to obtain a second screen shot image.
3. The screen defect optimization method of claim 1, wherein said step of performing image feature overlap processing on said second screen shot image and said screenshot image comprises:
partitioning the second screen shot image and the screenshot image according to the size of a preset pixel;
calculating the image fingerprints of all the partitions of the second screen shot image and the screen shot image, and determining the target partitions with the same image fingerprints in the second screen shot image and the screen shot image;
and correspondingly overlapping the target partitions in the second screen shot image and the screenshot image so as to overlap the second screen shot image and the screenshot image.
4. The screen defect optimization method of claim 1, wherein said visually optimizing the screen defect according to the defective pixel coordinates comprises:
setting the display picture of the screen to be optimized as a preset pure-color picture, and shooting the display picture of the screen to be optimized to obtain a third screen shot image;
determining a first color value of a screen defect area in the third screen shot image and a second color value of a non-screen defect area in the third screen shot image;
adjusting the color value of the defective pixel coordinate according to the sizes of the first color value and the second color value;
and recording a color value adjustment difference value before and after the color value adjustment of the defective pixel coordinate, so as to optimize the screen defect according to the color value adjustment difference value.
5. The screen defect optimization method of claim 4, wherein said step of adjusting the color values of the defective pixel coordinates based on the size of the first color value and the second color value comprises:
if the difference value between the first color value and the second color value is larger than or equal to a first preset difference value, reducing the color value of the defective pixel coordinate according to the size of a preset color value, and returning to the execution step: shooting a display picture of the screen to be optimized to obtain a third screen shot image; wherein the first preset difference is greater than zero;
if the difference value between the first color value and the second color value is smaller than or equal to a second preset difference value, increasing the color value of the defective pixel coordinate according to the size of the preset color value, and returning to the execution step: shooting a display picture of the screen to be optimized to obtain a third screen shot image; wherein the second preset difference is less than zero;
and if the difference value between the first color value and the second color value is greater than a second preset difference value and smaller than a first preset difference value, finishing the color value adjustment of the defective pixel coordinate.
6. The screen defect optimization method of claim 1, wherein said visually optimizing the screen defect according to the defective pixel coordinates comprises:
setting the display picture of the screen to be optimized as a preset pure-color picture, and shooting the display picture of the screen to be optimized to obtain a fourth screen shot image;
determining a first brightness of a screen defect area in the fourth screen shot image and a second brightness of a non-screen defect area in the fourth screen shot image;
adjusting the brightness of the defective pixel coordinate according to the first brightness and the second brightness;
and recording a brightness adjustment difference value before and after the brightness adjustment of the defective pixel coordinate so as to optimize the screen defect according to the brightness adjustment difference value.
7. The screen defect optimization method of claim 1, wherein said visually optimizing the screen defect according to the defective pixel coordinates comprises:
detecting the defect screen thickness of the screen defect corresponding to the defect pixel coordinate through an ultrasonic transmitter;
determining the light transmittance of the defect screen at the position of the screen defect according to the thickness of the defect screen;
and obtaining third brightness of the adjacent coordinate of the defective pixel coordinate, determining the optimized output brightness of the defective pixel coordinate according to the defective screen light transmittance, the preset screen light transmittance and the third brightness, and adjusting the brightness of the defective pixel coordinate according to the optimized output brightness.
8. A screen defect optimizing apparatus, comprising:
the system comprises a shooting screenshot module, a display module and a control module, wherein the shooting screenshot module is used for setting a display picture of a screen to be optimized into a preset picture containing a preset regular graph, shooting the display picture of the screen to be optimized through an under-screen camera of the screen to be optimized to obtain a first screenshot image, and acquiring the screenshot image of the display picture;
the size adjusting module is used for adjusting the pixel size of the first screen shot image according to the preset rule graph to obtain a second screen shot image, and the image proportion of the second screen shot image is the same as that of the screen shot image;
the characteristic overlapping module is used for carrying out image characteristic overlapping processing on the second screen shot image and the screenshot image and determining the defect pixel coordinates of the screen defect area in the second screen shot image in the screenshot image;
and the visual optimization module is used for carrying out visual optimization on the screen defects according to the defective pixel coordinates.
9. A screen defect optimizing apparatus, comprising: a memory, a processor and a screen defect optimization program stored on the memory and executable on the processor, the screen defect optimization program when executed by the processor implementing the steps of the screen defect optimization method of any one of claims 1 to 7.
10. A computer storage medium, characterized in that the computer storage medium has stored thereon a computer program which, when being executed by a processor, carries out the steps of the screen defect optimization method of any one of claims 1 to 7.
CN202110945825.0A 2021-08-17 2021-08-17 Screen defect optimization method, device and equipment and computer storage medium Active CN113783996B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110945825.0A CN113783996B (en) 2021-08-17 2021-08-17 Screen defect optimization method, device and equipment and computer storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110945825.0A CN113783996B (en) 2021-08-17 2021-08-17 Screen defect optimization method, device and equipment and computer storage medium

Publications (2)

Publication Number Publication Date
CN113783996A true CN113783996A (en) 2021-12-10
CN113783996B CN113783996B (en) 2023-01-17

Family

ID=78838204

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110945825.0A Active CN113783996B (en) 2021-08-17 2021-08-17 Screen defect optimization method, device and equipment and computer storage medium

Country Status (1)

Country Link
CN (1) CN113783996B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114429464A (en) * 2022-01-25 2022-05-03 众安在线财产保险股份有限公司 Screen-breaking identification method of terminal and related equipment

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170256051A1 (en) * 2016-03-07 2017-09-07 Hyla, Inc. Screen damage detection for devices
CN109254815A (en) * 2018-08-21 2019-01-22 奇酷互联网络科技(深圳)有限公司 Display methods, mobile terminal and the storage medium of display interface
CN112040223A (en) * 2020-08-25 2020-12-04 RealMe重庆移动通信有限公司 Image processing method, terminal device and storage medium

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170256051A1 (en) * 2016-03-07 2017-09-07 Hyla, Inc. Screen damage detection for devices
CN109254815A (en) * 2018-08-21 2019-01-22 奇酷互联网络科技(深圳)有限公司 Display methods, mobile terminal and the storage medium of display interface
CN112040223A (en) * 2020-08-25 2020-12-04 RealMe重庆移动通信有限公司 Image processing method, terminal device and storage medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114429464A (en) * 2022-01-25 2022-05-03 众安在线财产保险股份有限公司 Screen-breaking identification method of terminal and related equipment

Also Published As

Publication number Publication date
CN113783996B (en) 2023-01-17

Similar Documents

Publication Publication Date Title
JP6754843B2 (en) Device screen damage detection
US11182885B2 (en) Method and apparatus for implementing image enhancement, and electronic device
Navarrete et al. Color smoothing for RGB-D data using entropy information
US20180115705A1 (en) Contrast-enhanced combined image generation systems and methods
EP2884457B1 (en) Image evaluation device and image evaluation program
KR20190040962A (en) Detecting spoofing attacks during live image capture
KR20110124965A (en) Apparatus and method for generating bokeh in out-of-focus shooting
CN110596120A (en) Glass boundary defect detection method, device, terminal and storage medium
WO2014173145A1 (en) Image enhancement method and device
JP2007285754A (en) Flaw detection method and flaw detector
CN112396050B (en) Image processing method, device and storage medium
CN113783996B (en) Screen defect optimization method, device and equipment and computer storage medium
WO2020051792A1 (en) Fingerprint identification method and apparatus, and device and storage medium
CN112419420B (en) Camera calibration method and device, electronic equipment and storage medium
JP2017130794A (en) Information processing apparatus, evaluation chart, evaluation system, and performance evaluation method
CN111539902A (en) Image processing method, system, equipment and computer readable storage medium
JP6801366B2 (en) Line width measurement method, line width measurement program, storage medium and information processing device
CN113888509A (en) Method, device and equipment for evaluating image definition and storage medium
JP2003167529A (en) Method and device for picture defect detection, and program for picture defect detection
JP2017012384A (en) Wrinkle state analysis device and wrinkle state analysis method
US9536162B2 (en) Method for detecting an invisible mark on a card
JP2015222316A (en) Information display device, information display method, and information display program
JP2005326323A (en) Image quality inspection device
JP2019168930A (en) Image processing device, image processing method and program
KR102050590B1 (en) Method for digital image judging and system tereof, application system, and authentication system thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant