CN113170031A - Display device, terminal and shooting method - Google Patents

Display device, terminal and shooting method Download PDF

Info

Publication number
CN113170031A
CN113170031A CN201980075083.1A CN201980075083A CN113170031A CN 113170031 A CN113170031 A CN 113170031A CN 201980075083 A CN201980075083 A CN 201980075083A CN 113170031 A CN113170031 A CN 113170031A
Authority
CN
China
Prior art keywords
light
transmitting
display
display device
region
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201980075083.1A
Other languages
Chinese (zh)
Inventor
谭桂财
金志河
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Royole Display Technology Co ltd
Original Assignee
Shenzhen Royole Display Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Royole Display Technology Co ltd filed Critical Shenzhen Royole Display Technology Co ltd
Publication of CN113170031A publication Critical patent/CN113170031A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95Computational photography systems, e.g. light-field imaging systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265Mixing
    • HELECTRICITY
    • H10SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
    • H10KORGANIC ELECTRIC SOLID-STATE DEVICES
    • H10K59/00Integrated devices, or assemblies of multiple devices, comprising at least one organic light-emitting element covered by group H10K50/00
    • H10K59/60OLEDs integrated with inorganic light-sensitive elements, e.g. with inorganic solar cells or inorganic photodiodes
    • H10K59/65OLEDs integrated with inorganic image sensors

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Abstract

The application discloses display device includes: a display panel having at least two light-transmissive portions, the light-transmissive portions including a light-transmissive region and a non-transmissive region; and the image pickup unit is used for shooting images through the light transmission areas of the at least two light transmission parts and performing complementary synthesis. Through above mode for when setting up the camera under the display panel screen, can see through light, need not the trompil, thereby effectively improve screen utilization ratio.

Description

Display device, terminal and shooting method Technical Field
The embodiment of the application relates to the technical field of display devices, in particular to a display device, a terminal and a shooting method.
Background
With the development of science and technology, the requirements of people on the performance of mobile phones are higher and higher, and the requirements on the screen occupation ratio of the mobile phones are also higher and higher. In order to meet market needs and also meet space requirements of front cameras, a number of special-shaped full-face screens for opening the front plate to place the cameras appear now, for example: bang screens, drip screens, etc.
In the process of implementing the embodiment of the present application, the inventor finds that: the current full-screen mobile phone cannot display the perforated area for placing the front camera, and the screen utilization rate is not high.
Disclosure of Invention
The embodiment of the application provides a display device, a terminal and a shooting method, which can effectively improve the screen utilization rate.
The embodiment of the application solves the technical problem and provides the following technical scheme:
a display device, comprising:
a display panel having at least two light-transmissive portions, the light-transmissive portions including a light-transmissive region and a non-transmissive region;
and the image pickup unit is used for shooting images through the light transmission areas of the at least two light transmission parts and performing complementary synthesis.
The embodiment of the application also provides the following technical scheme for solving the technical problems:
a terminal, comprising: the display device is embedded in the shell.
The embodiment of the application also provides the following technical scheme for solving the technical problems:
a shooting method is applied to the display device, and the method comprises the following steps:
receiving a camera shooting instruction;
receiving light rays penetrating through light transmitting areas of at least two light transmitting parts through a camera shooting unit according to the camera shooting instruction so as to generate corresponding original images;
and performing complementary synthesis processing on the original image to obtain a shot image.
Compared with the prior art, through setting up two at least printing opacity portions at display panel at the display device that this application embodiment provided, printing opacity portion includes printing opacity district and non-printing opacity district, and the unit of making a video recording is distinguished through the printing opacity of two at least printing opacity portions and is shot the image and carry out complementary synthesis for when setting up the camera under the display panel screen, can see through light, need not the trompil, thereby effectively improve screen utilization ratio.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required to be used in the embodiments of the present application will be briefly described below. It is obvious that the drawings described below are only some embodiments of the application, and that for a person skilled in the art, other drawings can be derived from them without inventive effort.
Fig. 1 is a schematic structural diagram of a display device according to an embodiment of the present disclosure;
FIG. 2 is a schematic view of the display device shown in FIG. 1 at another angle;
FIG. 3 is a schematic diagram of a structure of a thin film transistor layer of the display device in FIG. 1;
FIG. 4 is a schematic diagram of an image captured in an embodiment of the present application;
fig. 5a to 5e are schematic views illustrating arrangement of a transparent region and a non-transparent region in a transparent portion of a display panel according to an embodiment of the present disclosure;
fig. 6a to 6b are schematic diagrams of image information synthesizing processing in the embodiment of the present application;
fig. 7 is a schematic structural diagram of a terminal according to an embodiment of the present application;
fig. 8 is a schematic flowchart of a shooting method according to an embodiment of the present application.
Detailed Description
In order to facilitate an understanding of the present application, the present application is described in more detail below with reference to the accompanying drawings and specific embodiments. It will be understood that when an element is referred to as being "secured to" another element, it can be directly on the other element or intervening elements may also be present. When an element is referred to as being "connected" to another element, it can be directly connected to the other element or intervening elements may be present. The terms "vertical", "horizontal", "left", "right", "inside", "outside" and the like used in the present specification are for illustrative purposes only and express only a substantial positional relationship, for example, with respect to "vertical", if a positional relationship is not strictly vertical for the purpose of achieving a certain object, but is substantially vertical, or utilizes the property of being vertical, it belongs to the category of "vertical" described in the present specification.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used in the description of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.
It is to be understood that, as shown herein, the positional relationship between one or more layers of the substance involved in the embodiments of the present application, such as the terms "stacked" or "formed" or "applied" or "disposed", is expressed using terms such as: any terms such as "stacked" or "formed" or "applied" may cover all manner, kinds and techniques of "stacked". For example, sputtering, plating, molding, Chemical Vapor Deposition (CVD), Physical Vapor Deposition (PVD), evaporation, Hybrid Physical-Chemical Vapor Deposition (HPCVD), Plasma Enhanced Chemical Vapor Deposition (PECVD), Low Pressure Chemical Vapor Deposition (LPCVD), and the like.
In addition, the technical features mentioned in the different embodiments of the present application described below may be combined with each other as long as they do not conflict with each other.
Referring to fig. 1, a display device 100 according to an embodiment of the present disclosure includes: the display device comprises a display panel 10 and an image pickup unit 20, wherein the image pickup unit 20 is arranged on the backlight side of the display panel 10.
The display panel 10 has at least two light-transmitting portions 11, and each light-transmitting portion 11 includes a light-transmitting region 1101 and a non-light-transmitting region 1102. The image pickup unit 20 picks up images through the light transmitting regions 1101 of at least two light transmitting portions 11 and performs complementary composition. Through above mode for when setting up the camera under the display panel screen, can see through light, need not the trompil, thereby effectively improve screen utilization ratio.
The display panel 10 is used to display an image. The display panel 10 may be an LCD display panel, an Organic Light Emitting Diode (OLED) display panel, or the like, wherein the OLED display panel has advantages of self-luminescence, low driving voltage, high luminous efficiency, short response time, high definition and contrast, a viewing angle of approximately 180 °, a wide temperature range, and the like, and can realize various advantages of flexible display and large-area full-color display.
Specifically, referring to fig. 2, the display panel 10 includes a pixel layer 101 and a thin film transistor device layer 102 stacked together, and the image capturing unit 20 is disposed on a side of the thin film transistor device layer 102 away from the pixel layer 101.
The pixel layer 101 is made of a transparent material. The pixel layer 101 may include: a cathode 1011, an organic light emitting layer 1012, an anode 1013, and a substrate 1014. The organic light emitting layer 1012 includes an organic light emitting material. In some embodiments, the organic light emitting material may include a material emitting red, green, or blue light and a fluorescent material or a phosphorescent material. In some embodiments, the organic light emitting layer 1012 may include two or more light emitting materials. The organic light emitting layer is used to emit light, and to emit light electrically under the control of the thin film transistor device layer 102, for display. The light emitting color may be white light or any color in any color proportion. The organic light emitting layer 1012 further includes an electron transport layer and a hole transport layer (not shown). The base 1014 is a flexible transparent substrate such as a material including thin glass or a plastic base, etc. having flexibility, for example, the plastic base has a flexible structure including resin such as Polyimide (PI), Polycarbonate (PC), polyethylene glycol terephthalate (PET), Polyethersulfone (PES), polyethylene film (PEN), Fiber Reinforced Plastic (FRP), etc. coated on both sides of a base film. It is understood that in some other embodiments, the substrate 1014 may be omitted in order to reduce the thickness of the display panel 10.
The Thin Film Transistor device layer 102 includes a plurality of Thin Film Transistors (TFTs), and may include, for example, Low Temperature Poly-Si Thin Film transistors (LTP-Si TFTs), amorphous silicon TFTs, polysilicon TFTs, oxide semiconductor TFTs, or organic TFTs. The thin film transistor device layer 102 is used to drive the pixel unit on the pixel layer 101. Specifically, the thin film transistor device layer 102 is used to implement display control, controlling the electroluminescence of the organic light emitting layer 1012. The thin film transistor device layer 102 is disposed on the side of the substrate 1014 away from the anode 1013, or the thin film transistor device layer 102 is disposed in the substrate 1014, which can be selected according to the actual use situation.
It is understood that in some other embodiments, the display panel 10 may be further provided with a polarizing layer, a protective layer, and the like as needed.
Referring to fig. 1 to fig. 3, the display panel 10 includes a plurality of first pixel units 110 and a plurality of second pixel units 120 distributed in an array, where the first pixel units 110 form a light-transmitting portion 11, and the second pixel units 120 form a display portion 12 of the display panel.
Each of the light-transmitting portion 11 and the display portion 12 is composed of a pixel layer 101 and a thin film transistor device layer 102, but the structure of the thin film transistor device layer 102 corresponding to the light-transmitting portion 11 is different from the structure of the thin film transistor device layer 102 corresponding to the display portion 12.
The light-transmitting portion 11 is for transmitting light so that the light can enter the image pickup unit 20; the light-transmitting portion 11 is also used to display an image when the image pickup unit 200 is in the non-operating state. Specifically, each first pixel unit 110 in the light-transmitting portion 11 includes a sub light-transmitting region 11011 and a wiring region 11021. The sub light-transmitting region 11011 and the circuit region 11021 refer to regions in the thin film transistor device layer 102 corresponding to one first pixel unit 110, the sub light-transmitting region 11011 is made of a light-transmitting material, and the sub light-transmitting region 11011 is not provided with a thin film transistor device or a metal wire, so that the sub light-transmitting region 11011 can transmit light; the wiring region 11021 is provided with a thin film transistor device and/or a metal line for displaying the first pixel unit 110 so as to display an image, and the wiring region 11021 is not capable of transmitting light. The plurality of sub light transmission regions 11011 distributed in an array form a light transmission region 1101 of the light transmission portion 11, and the plurality of circuit regions 11021 distributed in an array form a non-light transmission region 1102 of the light transmission portion 11.
In the first pixel unit 110, the proportion of the sub light-transmitting region 11011 may be greater than or equal to the proportion of the circuit region 11021. When the proportion of the sub light-transmitting region 11011 is larger than that of the circuit region 11021, the captured image can be made finer.
The sub-transmissive region 11011 or the circuit region 11021 may be regular or irregular, such as rectangular, etc.
The first pixel units 110 may be arrayed in the same order, such that the transmissive region 1101 is adjacent to the non-transmissive region 1102, and the transmissive region 1101 and the non-transmissive region 1102 are alternately arranged.
It should be understood that the display panel 10 only needs to have the light-transmitting area 1101, and the display panel 10 may be configured by adopting an organic light-emitting diode (OLED) technology, a MICRO light-emitting diode (MICRO LED) technology, an active-matrix organic light-emitting diode (AMOLED) or the like according to actual requirements.
Referring to fig. 1 and 2 again, the camera unit 20 is configured to receive light incident from the light-transmitting area 1101 for imaging. The number of the image pickup units 20 may be one or more, and when the image pickup unit 20 is plural, the number of the image pickup units 20 may be the same as the number of the light-transmitting portions 11, and each image pickup unit 20 is provided corresponding to the light-transmitting portion 11, for example: the display device 100 includes two image capturing units 20 and two light-transmitting portions 11, each image capturing unit 20 corresponds to one light-transmitting portion 11, so that light transmitted by each light-transmitting portion 11 can enter a photosensitive element of each image capturing unit 20; when the image pickup unit 20 is one, the image pickup unit 20 may include a plurality of photosensitive elements, the number of which may be the same as the number of the light-transmitting portions 11, each photosensitive element being provided corresponding to the light-transmitting portion 11, for example: the display device 100 includes an image capturing unit 20 and two light-transmitting portions 11, and the image capturing unit 20 includes two photosensitive elements, each corresponding to one of the light-transmitting portions 11, so that light transmitted by each light-transmitting portion 11 can enter each photosensitive element of the image capturing unit 20.
The central axes of the photosensitive elements may or may not be on the same horizontal plane.
It should be noted that, in this embodiment, the photosensitive element of the image capturing unit 20 refers to a device for receiving light in the image capturing unit 20, and may be, for example, a lens, when the lens receives light, the light enters an image sensor of the image capturing unit 20 to form an image, and the central axis of the photosensitive element is the central optical axis of the lens.
In the present embodiment, the photosensitive elements of the image pickup unit 20 are disposed at different positions on the backlight side of the display panel 10, each corresponding to the light-transmitting portion 11, so that the photosensitive elements partially or entirely cover the light-transmitting portion 11. Also, the image pickup unit 20 complementarily synthesizes complete image information through partial image information transmitted through at least two light-transmitting areas 1101. For example, as shown in fig. 4, assuming that the object to be photographed includes four portions a, b, c, and d, the display panel 10 includes two light-transmitting portions 11, partial image information photographed by the image pickup unit 20 through one of the light-transmitting portions 11 includes only the portion a and the portion c, and partial image information photographed by the image pickup unit 20 through the other light-transmitting portion 11 includes only the portion b and the portion d, the two partial image information are combined and can be complementarily merged into the four portions a, b, c, and d, so that complete image information is obtained.
Of course, there are many ways to arrange the transparent region 1101 and the non-transparent region 1102 in the transparent portion 11, and in some other embodiments, it is sufficient that there is at least two partial image information transmitted by the transparent region 1101 combined and then complementary combination can be performed. For example, as shown in fig. 4, assuming that the object to be photographed includes four portions a, b, c, and d, the display panel 10 includes two light-transmitting portions 11, partial image information photographed by the image pickup unit 20 through one of the light-transmitting portions 11 includes only the portion a and the portion c, and partial image information photographed by the image pickup unit 20 through the other light-transmitting portion 11 includes only the portion b, the two partial image information are combined and complementarily combined to a portion a, b, and c, so as to obtain a portion of the complete image.
In this embodiment, the display device 100 is provided with at least two light-transmitting portions 11 on the display panel 10, each light-transmitting portion 11 includes a light-transmitting region 1101 and a non-light-transmitting region 1102, and the image capturing unit 20 captures images through the light-transmitting regions 1101 of the at least two light-transmitting portions 11 and performs complementary synthesis, so that when a camera is disposed under a display panel screen, light can be transmitted without opening holes, thereby effectively improving screen utilization.
In some embodiments, as shown in fig. 5a to 5e, the light-transmitting portion 11 includes a first light-transmitting portion 111 and a second light-transmitting portion 112, and the image pickup unit 20 includes a first photosensitive element 21 and a second photosensitive element 22.
The first transparent portion 111 and the second transparent portion 112 may be provided adjacent to each other, or may be provided with the display portion 12 therebetween (fig. 5a to 5e illustrate an example in which the display portion is provided between the first transparent portion and the second transparent portion). The arrangement of the light-transmitting region 1101 and the non-light-transmitting region 1102 in the first light-transmitting portion 111 and the second light-transmitting portion 112 may be the same or different.
The first photosensitive element 21 corresponds to the first light-transmitting portion 111, and the second photosensitive element 22 corresponds to the second light-transmitting portion 112, so that the first photosensitive element 21 can receive the light transmitted by the light-transmitting area 1101 in the first light-transmitting portion 111, and the second photosensitive element 22 can receive the light transmitted by the light-transmitting area 1101 in the second light-transmitting portion 112, so that partial image information transmitted by the light-transmitting areas of the two light-transmitting portions of the image pickup unit 20 is complemented and synthesized into complete image information.
Specifically, as shown in fig. 5a and 5b, the central axis of the first photosensitive element 21 and the central axis of the second photosensitive element 22 are located on the same horizontal plane, so that the first photosensitive element 21 and the second photosensitive element 22 perform the photosensitive on the same horizontal line. The first and second light-transmitting portions 111 and 112 may be composed of sub light-transmitting regions 11011 and wiring regions 11021 in different arrangements. In the first light-transmitting portion 111, the non-light-transmitting region 1102 and the light-transmitting region 1101 are sequentially alternated; in the second light-transmitting portion 112, light-transmitting regions 1101 and non-light-transmitting regions 1102 sequentially alternate.
In the present embodiment, if the vertical downward direction is set as the preset reference direction X, in the light incoming region of the first photosensitive element 21, the non-light-transmitting regions 1102 and the light-transmitting regions 1101 sequentially alternate according to the preset reference direction X, and in the light incoming region of the second photosensitive element 22, the light-transmitting regions 1101 and the non-light-transmitting regions 1102 sequentially alternate according to the preset reference direction X. The light-entering area of the photosensitive element is the whole area of the mirror surface of the photosensitive element into which light can be incident.
In the actual manufacturing process of the display device 100 shown in fig. 5a and 5b, the first light-transmitting portion 111 and the second light-transmitting portion 112 may be formed by the sub light-transmitting regions 11011 and the circuit region 11021 in different arrangement manners, and the first light-transmitting portion 111 and the second light-transmitting portion 112 may be formed in the same shape, the first photosensitive element 21 and the second photosensitive element 22 may have the same cross section, the center of the first photosensitive element 21 may be opposite to the center of the first light-transmitting portion 111, and the center of the second photosensitive element 22 may be opposite to the center of the second light-transmitting portion 112.
The area of the transmissive region 1101 may be greater than or equal to the area of the non-transmissive region 1102. For example, in fig. 5a, the area of the transmissive region 1101 is equal to the area of the non-transmissive region 1102; for another example, in fig. 5b, the area of the transmissive region 1101 is larger than the area of the non-transmissive region 1102.
Alternatively, in some other embodiments, as shown in fig. 5c, the central axis of the first photosensitive element 21 and the central axis of the second photosensitive element 22 are not on the same horizontal plane, so that the first photosensitive element 21 and the second photosensitive element 22 do not perform photosensitive on the same horizontal line. The first and second transmissive portions 111 and 112 may be formed of the sub transmissive region 11011 and the wiring region 11021 in the same arrangement. In the first and second light-transmitting portions 111 and 112, the non-light-transmitting region 1102 and the light-transmitting region 1101 are sequentially alternated. Of course, in some other embodiments, it may also be: the transparent regions 1101 and the opaque regions 1102 are sequentially alternated, and can be set according to actual requirements.
In the present embodiment, if the vertical direction is set as the predetermined reference direction X, the non-light-transmitting areas 1102 and the light-transmitting areas 1101 are sequentially alternated according to the predetermined reference direction X in the light-incoming areas of the first photosensitive element 21 and the second photosensitive element 22. Each adjacent light-transmitting region 1101 and one non-light-transmitting region 1102 form a pair of combined regions, and the planar distance between the horizontal plane on which the central axis of the first photosensitive element 21 is located and the horizontal plane on which the central axis of the second photosensitive element 22 is located is the length distance of one non-light-transmitting region 1102. For example, as shown in fig. 5c, the plane distance between the horizontal plane of the central axis of the first photosensitive element 21 and the horizontal plane of the central axis of the second photosensitive element 22 is the length M of one non-light-transmitting region 1102.
In the actual manufacturing process of the display device 100 shown in fig. 5c, the first light-transmitting portion 111 and the second light-transmitting portion 112 may be preset to be composed of the circuit region 11021 and one sub light-transmitting portion 11011 in the same arrangement, the shapes of the first light-transmitting portion 111 and the second light-transmitting portion 112 are the same, the cross sections of the first photosensitive element 21 and the second photosensitive element 22 are the same, the center of the first photosensitive element 21 corresponds to a certain point a on the first light-transmitting portion 111, a 'point corresponding to the first light-transmitting portion 111 is found in the second block 112, the point a' is moved by the length distance of one non-light-transmitting portion in the preset reference direction to obtain a "point, and the center of the second photosensitive element 22 corresponds to the point a".
It should be noted that, in this embodiment, the area where the light enters the photosensitive element through the light-transmitting area is a light area, the area where the light does not enter the photosensitive element but does not pass through the non-light-transmitting area is a non-light area, and the area of the light area of the first photosensitive element 21 may be greater than or equal to the area of the non-light area of the first photosensitive element 21; alternatively, the area of the light-ray region of the second light-sensing element 22 may be greater than or equal to the area of the non-light-ray region of the second light-sensing element 22. For example, as shown in fig. 5a, the area of the light ray region of the first photosensitive element 21 is equal to the area of the non-light ray region of the first photosensitive element 21, and the area of the light ray region of the second photosensitive element 22 is equal to the area of the non-light ray region of the second photosensitive element 22; for another example, as shown in fig. 5b, the area of the light region of the first photosensitive element 21 is larger than the area of the non-light region of the first photosensitive element 21, and the area of the light region of the second photosensitive element 22 is larger than the area of the non-light region of the second photosensitive element 22, and for another example, as shown in fig. 5c, the area of the light region of the first photosensitive element 21 is smaller than the area of the non-light region of the first photosensitive element 21, and the area of the light region of the second photosensitive element 22 is larger than the area of the non-light region of the second photosensitive element 22.
Wherein, the light ray regions of all the combined photosensitive elements are equivalent to a light entering region of one photosensitive element. For example, as shown in fig. 5a and fig. 6a, the light ray region of the first photosensitive element 21 and the light ray region of the second photosensitive element 22 can be equivalent to the light entering region of the first photosensitive element 21 or the light entering region of the second photosensitive element 22, and then partial image information captured by the first photosensitive element 21 and the second photosensitive element 22 is just complementary to be synthesized into complete image information.
The light ray area combining all the photosensitive elements can be larger than the light inlet area of one photosensitive element. When the light area of the first photosensitive element 21 is combined with the light area of the second photosensitive element 22, there may be an overlapping light area between the light area of the first photosensitive element 21 and the light area of the second photosensitive element 22. The "overlapped light ray region" means: when the centers of the first photosensitive element 21 and the second photosensitive element 22 are located on the same horizontal line, if there is a horizontal straight line that can simultaneously pass through the light ray region of the first photosensitive element 21 and the light ray region of the second photosensitive element 22, there is an overlapping light ray region between the light ray region of the first photosensitive element 21 and the light ray region of the second photosensitive element 22. For example, as shown in fig. 5b and 6b, the centers of the first photosensitive element 21 and the second photosensitive element 22 are located on the same horizontal line, and a horizontal straight line can simultaneously pass through the light area of the first photosensitive element 21 and the light area of the second photosensitive element head 22, so that there is an overlapped light area between the light area of the first photosensitive element 21 and the light area of the second photosensitive element 22, and the light area of the first photosensitive element 21 and the light area of the second photosensitive element 22 are combined to be larger than the light area of the first photosensitive element 21 or the light area of the second photosensitive element 22, so that there is an overlapped part of partial image information photographed by the first photosensitive element 21 and the second photosensitive element 22, and the photographed image can be made finer.
It should be further noted that fig. 6a and 6b are only schematic diagrams of image information synthesis processing, and in the actual imaging process, effective imaging points or ineffective imaging points are formed according to the resolution of the cameras and whether corresponding points are transparent, and the effective imaging points of a plurality of cameras are complementarily synthesized to compensate for the resolution loss of the cameras.
Alternatively, in some embodiments, as shown in fig. 5d and 5e, the light-transmitting portion 11 may further include a third light-transmitting portion 113, and the image pickup unit 20 may further include a third photosensitive element 23.
The third light transmission section 113 may be provided adjacent to the first light transmission section 111 and the second light transmission section 112, or may be provided at the distance display section 12 (fig. 5d and 5e illustrate an example where the distance display section is provided between the third light transmission section and the second light transmission section).
The third photosensitive element 23 corresponds to the third light-transmitting portion 113, and the light ray regions combining the first photosensitive element 21, the second photosensitive element 22 and the third photosensitive element 23 are at least equivalent to a light entering region of one photosensitive element, so that the images taken by the first photosensitive element 21, the second photosensitive element 22 and the third photosensitive element 23 can be at least complementarily combined into a complete image.
Alternatively, the first, second, and third light-transmitting portions 111, 112, and 113 may each be composed of the sub light-transmitting region 11011 and the wiring region 11021 in different arrangements. For example, in the first light-transmitting portion 111, the non-light-transmitting region and the light-transmitting region are formed to alternate in order; in the second light-transmitting portion 112, light-transmitting regions and non-light-transmitting regions are formed alternately in order; in the third light transmission portion 113, the non-light transmission region, the light transmission region, and the non-light transmission region are formed to sequentially alternate, so that each first pixel unit 110 in the third light transmission portion 113 is composed of two wiring regions 11021 and one sub-light transmission region 11011.
Specifically, as shown in fig. 5d, the central axis of the first photosensitive element 21 and the central axis of the second photosensitive element 22 are located on the same horizontal plane, and in the first light-transmitting portion 111 and the second light-transmitting portion 112, the area of the light-transmitting region 1101 is equal to the area of the non-light-transmitting region 1102, so that the light ray regions combining the first photosensitive element 21 and the second photosensitive element 22 can be equivalent to the light entering region of one photosensitive element, and the light ray regions of the third photosensitive element 23 and the light ray regions of the first photosensitive element 21 and the second photosensitive element 22 have overlapping light ray regions, respectively, so that the combined picture taken by the first photosensitive element 21, the second photosensitive element 22 and the third photosensitive element 23 can be finer.
As shown in fig. 5e, the central axis of the first photosensitive element 21 is located on the same horizontal plane as the central axis of the second photosensitive element 22, the area of the light-transmitting region 1101 of the first light-transmitting portion 111 and the second light-transmitting portion 112 is smaller than the area of the non-light-transmitting region 1102, meanwhile, the area of the light-transmitting region 1101 in the third light-transmitting portion 113 is greater than or equal to the area of the non-light-transmitting region 1102, and the total area of all light transmission regions 1101 of the first light transmission portion 111, the second light transmission portion 112 and the third light transmission portion 113 is made larger than or equal to the area of one of the light transmission portions (the first light transmission portion 111, the second light transmission portion 112 or the third light transmission portion 113), so that the light ray area combining the first photosensitive element 21, the second photosensitive element 22 and the third photosensitive element 23 can be equivalent to the light entering area of one photosensitive element, so that the images taken by the first photosensitive element 21, the second photosensitive element 22 and the third photosensitive element 23 can be at least complementarily synthesized into a complete image.
Of course, in some other embodiments, the image capturing unit 20 may further include N (N is a positive integer, and N is greater than or equal to 3) photosensitive elements, the number of the light-transmitting portions 11 may also be N, each photosensitive element corresponds to each light-transmitting portion, and the light areas of the N photosensitive elements are combined to be equivalent to the light-entering area of one photosensitive element, so that the image capturing unit 20 can synthesize a complete image. Further, the light ray regions of any M (M is a positive integer, and 2. ltoreq. M.ltoreq.N) light sensitive elements in the N light sensitive elements have overlapping light ray regions, so that the image pickup unit 20 can synthesize a complete image and the image is finer.
It should be noted that fig. 5a to 5e are only an illustration of the arrangement manner of the light-transmitting region 1101 and the non-light-transmitting region 1102 in the light-transmitting portion 11 of the display panel 10, and the specific arrangement manner, size and shape of the light-transmitting region and the non-light-transmitting region are not limited, and a common RGB arrangement manner, an RGBB arrangement manner, a PenTile arrangement manner, or the like may be selected according to actual requirements.
In this embodiment, the display device 100 includes the first light-transmitting portion 111 and the second light-transmitting portion 112 disposed on the display panel 10, where the first light-transmitting portion 111 and the second light-transmitting portion 112 both include the light-transmitting region 1101 and the non-light-transmitting region 1102, and the first photosensitive element 21 corresponds to the first light-transmitting portion 111, and the second photosensitive element 22 corresponds to the second light-transmitting portion 112, so that partial image information transmitted through the light-transmitting regions 1101 of the first light-transmitting portion 111 and the second light-transmitting portion 112 can be complemented and combined into complete image information, and when a camera is disposed under a display panel screen, light can be transmitted without opening holes, thereby effectively improving screen utilization.
Referring to fig. 7, a terminal 200 according to an embodiment of the present application includes: a display device 100 and a housing 210.
The display device 100 may be any one of the display devices 100 in the above embodiments, and fig. 7 illustrates the display device shown in fig. 5a as an example.
The display device 100 is embedded in the housing 210, so that the display device 100 and the housing 210 form a sealed space, and the side of the display device 100 where the camera unit 20 is disposed is accommodated in the sealed space. Preferably, the light-transmitting portion of the display device 100 may have a difference in display effect from the display portion, and thus the light-transmitting portion is disposed at a corner of the housing 210 so that the light-transmitting portion does not occupy the center of the user's view, thereby improving the user experience.
The housing 210 may be a housing of a terminal device, wherein the terminal device exists in various forms, including but not limited to: smart phones, functional phones, tablets, audio, video players, handheld game consoles, electronic books, and the like. Optionally, the housing 210 has a curvature to increase the display screen when the display device 100 is disposed on the housing 210.
Optionally, the terminal 200 may further include a processor and a memory (not shown). The processor may include an Application-Specific Integrated Circuit (ASIC) having a control processing function, a Field Programmable Gate Array (FPGA), a single chip microcomputer, and the like. The memory is connected to the processor, and the processor executes various functions of the terminal 200 by executing software programs and modules stored in the memory. The Memory may include a volatile Memory (RAM), such as a Random-Access Memory (SRAM), a Double Data Rate Synchronous Dynamic Random Access Memory (DDR SDRAM), and the like; the memory may also include a non-volatile memory (e.g., flash memory), a hard disk (HDD) or a solid-state drive (SSD), an Electrically Erasable Programmable read-only memory (EEPROM); the memory may also comprise a combination of memories of the kind described above. The memory may be a stand-alone memory, or a memory inside a chip (e.g., a processor chip) or a module having a memory function. The memory may have stored therein computer programs (e.g., control programs for the positioning module, vehicle diagnostic programs, function modules, etc.), computer instructions, an operating system, data, databases, etc. The memory may store it in partitions.
It can be understood that the terminal 200 may further include more other modules, for example, a touch module, a WIFI module, a sensor, and the like, and the embodiment is not limited thereto.
In this embodiment, terminal 200 is through setting up display device 100 for when setting up the camera under the display panel screen, can see through light, need not the trompil, thereby effectively improve screen utilization ratio.
Referring to fig. 8, the photographing method provided in the embodiment of the present application can be applied to the display device 100 or the terminal 200, and the method includes:
and S310, receiving an image pickup command.
In this embodiment, the image capturing instruction is a control instruction triggered when the user needs to capture an image. The user triggers the camera shooting instruction, and may trigger a corresponding menu item, or call a corresponding shortcut, or press a certain icon for a long time, and so on. The user triggers the camera shooting instruction, the camera shooting instruction can be directly received through the display device, the next step is directly executed by the display device, and the camera shooting instruction can also be received through the controller connected with the display device, and the next step is instructed by the controller controlling the display device.
And S320, receiving the light rays penetrating through the light transmission areas of the at least two light transmission parts through the camera shooting unit according to the camera shooting instruction to generate corresponding original images.
In this embodiment, after receiving the image capturing instruction, the display device (or a controller connected to the display device) controls the image capturing unit to capture an image, and the image capturing unit receives light from an external object through a light-transmitting area of a corresponding light-transmitting portion of the image capturing unit, so as to generate an original image corresponding to the image capturing unit.
Since the image capturing unit simultaneously corresponds to the opaque region, the opaque region cannot receive the optics of the external object, and thus the original image generated by each lens has a certain occlusion region (as shown in fig. 6a or fig. 6 b).
During shooting, the display area block can display normally, and the light-transmitting part corresponding to the camera shooting unit can display or can not display.
And S330, performing complementary synthesis processing on the original image to obtain a shot image.
In this embodiment, since the light ray regions of the photosensitive elements that combine all the imaging regions are at least equivalent to the light entering region of one lens, the original images captured by the imaging unit are at least complementary, and the blocking regions of all the original images are complementary through an image processing algorithm, so that a complete captured image can be obtained. The complete shot image is an image obtained when a single camera without occlusion and with the same parameters is used for shooting at the same position. For example, as shown in fig. 6a, two original images are obtained by shooting, and the two original images are just complementary, then the two original images are combined to obtain a complete shot image. For another example, as shown in fig. 6b, when two original images are captured and the two original images are complementary and partially overlapped, a complete captured image with higher quality can be obtained after the combination.
In some other embodiments, because the positions of the light sensing elements of the image capturing units are different, the capturing angles thereof are also different, and the contents of the captured original images may be different. When the contents of the original images obtained by shooting are different, cutting the parts with the same contents and carrying out complementary synthesis to obtain the shot images.
Wherein the display device is operable to display an image, the method further comprising:
s341, receiving a display instruction, wherein the display instruction comprises a target image;
and S342, controlling a display panel of the display device to display the target image according to the display instruction.
In S341, the display command is a control command transmitted when the display is necessary. The display instruction can be triggered by a user or a system, and the display instruction can be directly received by the display device or received by a controller connected with the display device. The target image is an image needing to be displayed; the display instruction includes a target image, and may be address information, display information, and the like including the target image.
In S342, the display panel of the display device is controlled to display the target image, specifically: the light transmission part and the display part of the display panel are controlled to simultaneously display the target image, so that the screen utilization rate can be effectively improved when the camera is arranged under the screen.
When the display device displays an image, the display panel has a light-transmitting area, a non-light-transmitting area and a low-light area, so that the imaging effects of different areas are different, and therefore, the method further comprises the following steps:
s351, acquiring preset correction parameters;
and S352, compensating the brightness of the display panel according to the preset correction parameters.
The preset correction parameters are preset correction parameters, and can be fixed values for correction compensation measured before delivery. When the image is displayed, the preset correction parameters are obtained simultaneously, and then the brightness of the display panel can be compensated according to the preset correction parameters, so that different areas of the display panel can show uniform brightness, and a better display effect can be obtained.
Wherein the display panel has at least two light-transmitting portions, and before S351, the method further includes:
s353, respectively acquiring the brightness of the light-transmitting part and the brightness of other display areas of the display panel;
s354, determining preset correction parameters according to the brightness of the light-transmitting part and the brightness of the rest display areas of the display panel.
In this embodiment, the specific implementation manner may be: the brightness of the light-transmitting portion and the brightness of the display portion of the display panel are acquired by means of image sensor shooting and the like, the difference between the brightnesses of the light-transmitting portion and the display portion is calculated, and the preset correction parameter is generated according to the difference between the brightnesses.
In this embodiment, in the shooting method, after receiving a shooting instruction, the shooting unit receives light penetrating through the light-transmitting area of the light-transmitting portion to a small amount, so as to generate corresponding original images, and the original images are subjected to complementary synthesis to obtain complete image information, so that when a camera is arranged under a display panel screen, the light can penetrate through the original images without opening holes, and therefore, the screen utilization rate is effectively improved.
Those skilled in the art will appreciate that the processes and materials described in the various embodiments herein are merely exemplary and that the embodiments herein may be used with any processes or materials developed in the future that are suitable for use herein.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; within the context of the present application, where technical features in the above embodiments or in different embodiments can also be combined, the steps can be implemented in any order and there are many other variations of the different aspects of the present application as described above, which are not provided in detail for the sake of brevity; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

Claims (15)

  1. A display device, comprising:
    a display panel having at least two light-transmissive portions, the light-transmissive portions including a light-transmissive region and a non-transmissive region;
    and the image pickup unit is used for shooting images through the light transmission areas of the at least two light transmission parts and performing complementary synthesis.
  2. The display device according to claim 1, wherein the number of the image pickup units is the same as the number of the light-transmitting portions, and each of the image pickup units is provided corresponding to the light-transmitting portion.
  3. The display device according to claim 2, wherein the light receiving element of the image pickup unit covers the light transmitting portion, and partial image information transmitted through the at least two light transmitting regions is complementarily combined into complete image information.
  4. The display device according to claim 1, wherein the number of the photosensitive elements of the image pickup unit is two, and central axes of the two photosensitive elements are located on the same horizontal plane.
  5. The display device according to any one of claims 1 to 4, wherein the display panel includes a plurality of first pixel units and second pixel units arranged in an array, the first pixel units constituting the light-transmitting portion, and the second pixel units constituting a display portion of the display panel.
  6. The display device according to claim 5, wherein the light-transmitting portion is configured to display an image when the image pickup unit is in a non-operating state.
  7. The display device according to claim 6, wherein each of the first pixel units comprises a sub-transmissive region and a line region, the sub-transmissive region of the plurality of arrays constitutes a transmissive region of the transmissive portion, and the line region of the plurality of arrays constitutes a non-transmissive region of the transmissive portion.
  8. The display device according to claim 7, wherein the proportion of the sub-transmissive region in the first pixel unit is greater than or equal to the proportion of the line region.
  9. The display device according to claim 7, wherein the light-transmitting region is adjacent to the non-light-transmitting region.
  10. The display device according to any one of claims 1 to 9, wherein the image pickup unit is provided on a backlight side of the display panel.
  11. A terminal, comprising: a housing and a display device as claimed in any one of claims 1 to 10, the display device being embedded in the housing.
  12. A photographing method applied to the display device according to any one of claims 1 to 10, the method comprising:
    receiving a camera shooting instruction;
    receiving light rays penetrating through light transmission areas of at least two light transmission parts through a camera shooting unit according to the camera shooting instruction so as to generate corresponding original images;
    and performing complementary synthesis processing on the original image to obtain a shot image.
  13. The method of claim 12, further comprising:
    receiving a display instruction, wherein the display instruction comprises a target image;
    and controlling a display panel of the display device to display the target image according to the display instruction.
  14. The method of claim 13, further comprising:
    acquiring a preset correction parameter;
    and compensating the brightness of the display panel according to the preset correction parameters.
  15. The method of claim 14, wherein the display panel has at least two light-transmitting portions,
    the method further comprises the following steps:
    respectively acquiring the brightness of the light-transmitting part and the brightness of other display areas of the display panel;
    and determining the preset correction parameters according to the brightness of the light-transmitting part and the brightness of the rest display areas of the display panel.
CN201980075083.1A 2019-03-15 2019-03-15 Display device, terminal and shooting method Pending CN113170031A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/078229 WO2020186375A1 (en) 2019-03-15 2019-03-15 Display device, terminal and photographing method

Publications (1)

Publication Number Publication Date
CN113170031A true CN113170031A (en) 2021-07-23

Family

ID=72519504

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201980075083.1A Pending CN113170031A (en) 2019-03-15 2019-03-15 Display device, terminal and shooting method

Country Status (2)

Country Link
CN (1) CN113170031A (en)
WO (1) WO2020186375A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112383700B (en) * 2020-10-13 2021-10-22 云谷(固安)科技有限公司 Display device and control method thereof
CN113437123A (en) * 2021-06-22 2021-09-24 合肥维信诺科技有限公司 Array substrate, OLED display panel, display device and imaging control method

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108650343A (en) * 2018-04-11 2018-10-12 深圳市海派通讯科技有限公司 A kind of structure and hidden method that intelligent terminal preceding camera is hiding
CN108810201A (en) * 2018-06-04 2018-11-13 Oppo广东移动通信有限公司 Electronic device and the method for shooting photo using electronic device
CN108984139A (en) * 2018-06-22 2018-12-11 昆山国显光电有限公司 The control method of display module, terminal and terminal
CN108983872A (en) * 2018-06-04 2018-12-11 Oppo广东移动通信有限公司 Electronic device and its control method
CN208271897U (en) * 2018-03-16 2018-12-21 华为技术有限公司 A kind of display screen and display terminal
CN208384467U (en) * 2018-06-04 2019-01-15 Oppo广东移动通信有限公司 Electronic device
CN208386634U (en) * 2018-06-04 2019-01-15 Oppo广东移动通信有限公司 Electronic device
CN208384468U (en) * 2018-06-04 2019-01-15 Oppo广东移动通信有限公司 Electronic device
CN109743430A (en) * 2019-03-14 2019-05-10 Oppo广东移动通信有限公司 Display component and electronic device
CN109981842A (en) * 2019-03-14 2019-07-05 Oppo广东移动通信有限公司 The manufacturing method of display component, electronic device and display component

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108600472A (en) * 2018-07-18 2018-09-28 苏州天为幕烟花科技有限公司 A kind of mobile phone of the complementary realization of dot matrix shields technology comprehensively

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN208271897U (en) * 2018-03-16 2018-12-21 华为技术有限公司 A kind of display screen and display terminal
CN108650343A (en) * 2018-04-11 2018-10-12 深圳市海派通讯科技有限公司 A kind of structure and hidden method that intelligent terminal preceding camera is hiding
CN108810201A (en) * 2018-06-04 2018-11-13 Oppo广东移动通信有限公司 Electronic device and the method for shooting photo using electronic device
CN108983872A (en) * 2018-06-04 2018-12-11 Oppo广东移动通信有限公司 Electronic device and its control method
CN208384467U (en) * 2018-06-04 2019-01-15 Oppo广东移动通信有限公司 Electronic device
CN208386634U (en) * 2018-06-04 2019-01-15 Oppo广东移动通信有限公司 Electronic device
CN208384468U (en) * 2018-06-04 2019-01-15 Oppo广东移动通信有限公司 Electronic device
CN108984139A (en) * 2018-06-22 2018-12-11 昆山国显光电有限公司 The control method of display module, terminal and terminal
CN109743430A (en) * 2019-03-14 2019-05-10 Oppo广东移动通信有限公司 Display component and electronic device
CN109981842A (en) * 2019-03-14 2019-07-05 Oppo广东移动通信有限公司 The manufacturing method of display component, electronic device and display component

Also Published As

Publication number Publication date
WO2020186375A1 (en) 2020-09-24

Similar Documents

Publication Publication Date Title
US10756136B1 (en) Display panel and display device
US11342390B2 (en) Display panel, display device and a method for manufacturing a display panel
JP6246292B2 (en) OLED display device with light detection function
CN110114816B (en) Organic light-emitting display OLED screen and terminal
JP7007268B2 (en) Display panel and its manufacturing method, and display device
KR102031648B1 (en) Organic light emitting display apparatus
US10678043B2 (en) Display panel, display device and method for controlling the same
JP6393838B2 (en) LCD panel, terminal, photosensitive control method, program, and recording medium
US8520114B2 (en) Apparatus for displaying and sensing images
US7321672B2 (en) Image reading apparatus and image reading system equipped with the image reading apparatus
CN107819018A (en) Electroluminescent display panel and display device
CN113348496A (en) Display device, terminal and shooting method
CN101510043B (en) Digital single lens reflex (dslr) camera
JP7111793B2 (en) Pixel array substrate and display device having the same
US20210376033A1 (en) Display panel and electronic apparatus
JP7329688B2 (en) Display devices and electronic devices
CN113170031A (en) Display device, terminal and shooting method
US20130127363A1 (en) Display device and electronic apparatus
KR20220032782A (en) Display device
WO2022116866A1 (en) Under-screen camera apparatus, display device, and method for generating image by under-screen camera apparatus
US20230047907A1 (en) Light emitting device, photoelectric conversion device, electronic equipment, illumination device, and moving body
US20230099550A1 (en) Display device
US20230216943A1 (en) Electronic device including under display camera
CN114374750A (en) Electronic device
KR20230103470A (en) Electronic device including under display camera

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20210723