WO2021218374A1

WO2021218374A1 - Control method, electronic device, and computer readable storage medium

Info

Publication number: WO2021218374A1
Application number: PCT/CN2021/079072
Authority: WO
Inventors: 王路
Original assignee: Oppo广东移动通信有限公司
Priority date: 2020-04-29
Filing date: 2021-03-04
Publication date: 2021-11-04
Also published as: CN111461069B; CN111461069A; TW202141972A; TWI791208B

Abstract

A control method, an electronic device (100), and a computer readable storage medium (200). The control method comprises: (01) when a display screen (10) is refreshed, a transmitter (31) transmits a detection signal to the display screen (10), and a receiver (32) receives the detection signal which penetrates through the display screen (10) and is reflected by an object under detection so as to obtain a depth information image of the object under detection, wherein the refresh frequency of the display screen (10) is the same as the projection frequency of the transmitter (31).

Description

控制方法、电子设备及计算机可读存储介质Control method, electronic equipment and computer readable storage medium

优先权信息Priority information

本申请请求2020年4月29日向中国国家知识产权局提交的、专利申请号为202010353593.5的专利申请的优先权和权益，并且通过参照将其全文并入此处。This application requests the priority and rights of the patent application with the patent application number 202010353593.5 filed with the State Intellectual Property Office of China on April 29, 2020, and the full text is incorporated herein by reference.

技术领域Technical field

本申请涉及影像技术领域，特别涉及一种控制方法、电子设备及计算机可读存储介质。This application relates to the field of imaging technology, and in particular to a control method, electronic equipment, and computer-readable storage medium.

背景技术Background technique

随着市场对手机大屏占比的要求越来越高，各手机厂商都在尝试把各电子元器件，例如摄像头放置到屏幕下方，既不影响拍照效果，也能正常显示。另外，由于3D解锁的盛行，越来越多的手机厂商开始考虑把3D解锁用的深度相机放置在屏幕下方。As the market has higher and higher requirements for the proportion of large screens in mobile phones, various mobile phone manufacturers are trying to place various electronic components, such as cameras, under the screen, which will not affect the photographing effect, but can also display normally. In addition, due to the prevalence of 3D unlocking, more and more mobile phone manufacturers are considering placing the depth camera for 3D unlocking under the screen.

发明内容Summary of the invention

本申请实施方式提供了一种控制方法、电子设备及非易失性计算机可读存储介质。The embodiments of the present application provide a control method, an electronic device, and a non-volatile computer-readable storage medium.

本申请提供一种控制方法。控制方法用于电子设备，所述电子设备包括深度图像获取模组、壳体及显示屏。所述深度图像获取模组设置在所述壳体内并位于所述显示屏的下方，所述深度图像获取模组包括发射器及接收器。所述控制方法包括：在所述显示屏刷新的同时，所述发射器向所述显示屏方向发射检测信号，所述接收器接收穿过所述显示屏后经待检测物反射后的所述检测信号，以获得所述待检测物的深度信息图像。所述显示屏的刷新频率与所述发射器的投射频率相同。This application provides a control method. The control method is used for electronic equipment, which includes a depth image acquisition module, a housing and a display screen. The depth image acquisition module is arranged in the housing and located below the display screen, and the depth image acquisition module includes a transmitter and a receiver. The control method includes: while the display screen is refreshed, the transmitter transmits a detection signal to the direction of the display screen, and the receiver receives the reflection of the object to be detected after passing through the display screen. The detection signal is used to obtain the depth information image of the object to be detected. The refresh frequency of the display screen is the same as the projection frequency of the transmitter.

本申请提供一种电子设备。所述电子设备包括壳体、显示屏及深度图像获取模组。所述显示屏设置在所述壳体上。所述深度图像获取模组设置在所述壳体内并位于所述显示屏的下方，所述深度图像获取模组包括发射器及接收器。所述显示屏显示图像的同时，所述发射器向所述显示屏方向发射检测信号，所述接收器接收穿过所述显示屏后被待检测物反射回的所述检测信号以获得所述待检测物的深度信息图像。所述显示屏的刷新频率与所述发射器的投射频率相同。This application provides an electronic device. The electronic device includes a housing, a display screen, and a depth image acquisition module. The display screen is arranged on the housing. The depth image acquisition module is arranged in the housing and located below the display screen, and the depth image acquisition module includes a transmitter and a receiver. While the display screen is displaying an image, the transmitter transmits a detection signal in the direction of the display screen, and the receiver receives the detection signal reflected by the object to be detected after passing through the display screen to obtain the Depth information image of the object to be inspected. The refresh frequency of the display screen is the same as the projection frequency of the transmitter.

本申请提供一种非易失性计算机可读存储介质。所述非易失性计算机可读存储介质包含计算机程序，所述计算机程序被处理器执行时，使得所述处理器执行：在所述显示屏刷新的同时，所述发射器向所述显示屏方向发射检测信号，所述接收器接收穿过所述显示屏后经待检测物反射后的所述检测信号，以获得所述待检测物的深度信息图像；所述显示屏的刷新频率与所述发射器的投射频率相同。The application provides a non-volatile computer-readable storage medium. The non-volatile computer-readable storage medium contains a computer program, and when the computer program is executed by a processor, the processor executes: while the display screen is refreshed, the transmitter sends a message to the display screen. The detection signal is transmitted in the direction, and the receiver receives the detection signal reflected by the object to be detected after passing through the display screen to obtain the depth information image of the object to be detected; The projection frequencies of the transmitters are the same.

本申请实施方式的附加方面和优点将在下面的描述中部分给出，部分将从下面的描述中变得明显，或通过本申请的实践了解到。The additional aspects and advantages of the embodiments of the present application will be partly given in the following description, and part of them will become obvious from the following description, or be understood through the practice of the present application.

附图说明Description of the drawings

本申请的上述和/或附加的方面和优点可以从结合下面附图对实施方式的描述中将变得明显和容易理解，其中：The above-mentioned and/or additional aspects and advantages of the present application will become obvious and easy to understand from the description of the embodiments in conjunction with the following drawings, in which:

图1是本申请某些实施方式的电子设备的立体结构示意图；FIG. 1 is a schematic diagram of a three-dimensional structure of an electronic device according to some embodiments of the present application;

图2是本申请某些实施方式的电子设备的分解示意图；FIG. 2 is an exploded schematic diagram of an electronic device according to some embodiments of the present application;

图3是图2的电子设备沿III-III线的部分截面示意图；3 is a schematic partial cross-sectional view of the electronic device of FIG. 2 along the line III-III;

图4是本申请某些实施方式的显示屏的刷新频率与发射器发射检测信号的发射频率的示意图；4 is a schematic diagram of the refresh frequency of the display screen and the transmission frequency of the detection signal transmitted by the transmitter according to some embodiments of the present application;

图5是本申请某些实施方式的控制方法的流程示意图；FIG. 5 is a schematic flowchart of a control method of certain embodiments of the present application;

图6是本申请某些实施方式的控制方法的流程示意图；FIG. 6 is a schematic flowchart of a control method of certain embodiments of the present application;

图7是本申请某些实施方式的控制方法的流程示意图；FIG. 7 is a schematic flowchart of a control method according to some embodiments of the present application;

图8是本申请某些实施方式的计算机可读存储介质与处理器的交互示意图。Fig. 8 is a schematic diagram of interaction between a computer-readable storage medium and a processor in some embodiments of the present application.

具体实施方式Detailed ways

下面详细描述本申请的实施方式，所述实施方式的示例在附图中示出，其中，相同或类似的标号自始至终表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施方式是示例性的，仅用于解释本申请的实施方式，而不能理解为对本申请的实施方式的限制。The embodiments of the present application are described in detail below. Examples of the embodiments are shown in the accompanying drawings, in which the same or similar reference numerals indicate the same or similar elements or elements with the same or similar functions throughout. The following embodiments described with reference to the drawings are exemplary, and are only used to explain the embodiments of the present application, and should not be understood as limitations on the embodiments of the present application.

请参阅图1、图2及图5，本申请提供一种用于电子设备100的控制方法。电子设备100包括深度图像获取模组30、壳体20及显示屏10，深度图像获取模组30设置在壳体20内并位于显示屏10的下方，深度图像获取模组30包括发射器31及接收器32；控制方法包括步骤：Please refer to FIG. 1, FIG. 2 and FIG. 5. The present application provides a control method for the electronic device 100. The electronic device 100 includes a depth image acquisition module 30, a housing 20, and a display screen 10. The depth image acquisition module 30 is disposed in the housing 20 and located below the display screen 10. The depth image acquisition module 30 includes a transmitter 31 and Receiver 32; the control method includes the steps:

01：在显示屏10刷新的同时，发射器31向显示屏10方向发射检测信号，接收器32接收穿过显示屏10后经待检测物反射后的检测信号，以获得待检测物的深度信息图像；其中，显示屏10的刷新频率与发射器31的投射频率相同。01: While the display screen 10 is refreshed, the transmitter 31 transmits a detection signal to the display screen 10, and the receiver 32 receives the detection signal reflected by the object to be detected after passing through the display screen 10 to obtain the depth information of the object to be detected Image; Among them, the refresh frequency of the display screen 10 is the same as the projection frequency of the transmitter 31.

请参阅图6，在某些实施例中，步骤01：在显示屏10刷新的同时，发射器31向显示屏10方向发射检测信号，接收器32接收穿过显示屏10后经待检测物反射后的检测信号，以获得待检测物的深度信息图像包括：Referring to FIG. 6, in some embodiments, step 01: While the display screen 10 is being refreshed, the transmitter 31 transmits a detection signal to the display screen 10, and the receiver 32 receives the reflection from the object to be detected after passing through the display screen 10. The subsequent detection signal to obtain the depth information image of the object to be detected includes:

011：以第一功率朝待检测物发射第一检测信号；011: Transmit a first detection signal to the object to be detected with the first power;

012：接收穿过显示屏10后被待检测物反射回的第一检测信号以获取待检测物与电子设备100的距离；012: Receive the first detection signal reflected by the object to be detected after passing through the display screen 10 to obtain the distance between the object to be detected and the electronic device 100;

013：以第二功率朝待检测物发射第二检测信号，第二功率是根据距离从预存的距离-功率对应关系中获取的；013: Transmit a second detection signal to the object to be detected with the second power, the second power is obtained from the pre-stored distance-power correspondence according to the distance;

014：接收穿过显示屏10后被待检测物反射回的第二检测信号以获取待检测物的深度信息图像。014: Receive the second detection signal reflected by the object to be detected after passing through the display screen 10 to obtain the depth information image of the object to be detected.

在某些实施例中，所述第一功率小于所述第二功率；或所述第二功率等于所述第一功率。In some embodiments, the first power is less than the second power; or the second power is equal to the first power.

请参阅图7，在某些实施例中，控制方法还包括：Referring to FIG. 7, in some embodiments, the control method further includes:

015：在发射第一检测信号的同时，显示屏10以第一刷新频率显示图像，第一检测信号的投射频率与第一刷新频率相同；及015: While transmitting the first detection signal, the display screen 10 displays an image at the first refresh frequency, and the projection frequency of the first detection signal is the same as the first refresh frequency; and

016：在发射第二检测信号的同时，显示屏10以第二刷新频率显示图像，第二检测信号的投射频率与第二刷新频率相同，第一刷新频率小于第二刷新频率。016: While transmitting the second detection signal, the display screen 10 displays an image at the second refresh frequency. The projection frequency of the second detection signal is the same as the second refresh frequency, and the first refresh frequency is less than the second refresh frequency.

在某些实施例中，所述第一检测信号的投射频率等于所述第二检测信号的投射频率，且第一检测信号的第一功率小于所述第二检测信号的第二功率。In some embodiments, the projection frequency of the first detection signal is equal to the projection frequency of the second detection signal, and the first power of the first detection signal is less than the second power of the second detection signal.

请参阅图5，在某些实施例中，控制方法还包括：Referring to FIG. 5, in some embodiments, the control method further includes:

02：获取待检测物的二维图像信息；及02: Obtain the two-dimensional image information of the object to be detected; and

03：在二维图像信息中存在人脸时，则启动深度图像获取模组30。03: When there is a human face in the two-dimensional image information, the depth image acquisition module 30 is activated.

04：比对深度信息图像与预设深度图像；04: Compare the depth information image with the preset depth image;

05：在深度信息图像与预设图像的相似度大于预定值时，解锁电子设备100。05: Unlock the electronic device 100 when the similarity between the depth information image and the preset image is greater than a predetermined value.

请参阅图2，本申请实施例还提供一种电子设备100。电子设备100包括壳体20、显示屏10及深度图像获取模组30。显示屏10设置在壳体20上，深度图像获取模组30设置在壳体20内并位于显示屏10的下方，深度图像获取模组30包括发射器31及接收器32；在显示屏10显示图像的同时，发射器31向显示屏10方向发射检测信号，接收器32接收穿过显示屏10后被待检测物反射回的检测信号以获得待检测物的深度信息图像；其中，显示屏10的刷新频率与发射器31的投射频率相同。Please refer to FIG. 2, an embodiment of the present application also provides an electronic device 100. The electronic device 100 includes a housing 20, a display screen 10 and a depth image acquisition module 30. The display screen 10 is arranged on the housing 20, and the depth image acquisition module 30 is arranged in the housing 20 and is located below the display screen 10. The depth image acquisition module 30 includes a transmitter 31 and a receiver 32; At the same time as the image, the transmitter 31 transmits the detection signal to the display screen 10, and the receiver 32 receives the detection signal reflected by the object to be detected after passing through the display screen 10 to obtain the depth information image of the object to be detected; wherein, the display screen 10 The refresh frequency of is the same as the projection frequency of the transmitter 31.

请参阅图2及图6，在某些实施例中，发射器31用于以第一功率朝待检测物发射第一检测信号；接收器32用于接收穿过显示屏10后被待检测物反射回的第一检测信号以获取待检测物与电子设备100的距离；深度图像获取模组30还用于根据距离从预存的距离-功率对应关系中获取第二功率；发射器31还用于以第二功率朝待检测物发射第二检测信号；接收器32还用于接收穿过显示屏后被待检测物反射回的第二检测信号以获取待检测物的深度信息图像。2 and 6, in some embodiments, the transmitter 31 is used to transmit a first detection signal to the object to be detected with a first power; the receiver 32 is used to receive the object to be detected after passing through the display screen 10 The first detection signal reflected back is used to obtain the distance between the object to be detected and the electronic device 100; the depth image acquisition module 30 is also used to obtain the second power from the pre-stored distance-power correspondence according to the distance; the transmitter 31 is also used to The second detection signal is transmitted toward the object to be detected with the second power; the receiver 32 is also used to receive the second detection signal reflected by the object to be detected after passing through the display screen to obtain the depth information image of the object to be detected.

在一些实施例中，第一功率小于所述第二功率；或第二功率等于所述第一功率。In some embodiments, the first power is less than the second power; or the second power is equal to the first power.

请参阅图2及图7，在某些实施例中，发射器31在发射第一检测信号的同时，显示屏10以第一刷新频率显示图像，第一检测信号的投射频率与第一刷新频率相同；发射器31在发射第二检测信号的同时，显示屏10以第二刷新频率显示图像，第二检测信号的投射频率与第二刷新频率相同，第一刷新频率小于第二刷新频率。Referring to FIGS. 2 and 7, in some embodiments, while the transmitter 31 transmits the first detection signal, the display screen 10 displays the image at the first refresh frequency. The projection frequency of the first detection signal is the same as the first refresh frequency. Same; while the transmitter 31 transmits the second detection signal, the display screen 10 displays an image at the second refresh frequency. The projection frequency of the second detection signal is the same as the second refresh frequency, and the first refresh frequency is less than the second refresh frequency.

在一些实施例中，第一检测信号的投射频率等于第二检测信号的投射频率，且第一检测信号的第一功率小于第二检测信号的第二功率。In some embodiments, the projection frequency of the first detection signal is equal to the projection frequency of the second detection signal, and the first power of the first detection signal is less than the second power of the second detection signal.

请参阅图1及图5，在某些实施例中，电子设备100还包括摄像模组40。摄像模组40用于获取待检测物的二维图像信息。其中，在二维图像信息中存在人脸时，深度图像获取模组30启动。Please refer to FIG. 1 and FIG. 5. In some embodiments, the electronic device 100 further includes a camera module 40. The camera module 40 is used to obtain two-dimensional image information of the object to be inspected. Wherein, when there is a human face in the two-dimensional image information, the depth image acquisition module 30 is activated.

请参阅图2及图5，在某些实施例中，电子设备100还包括处理器50。处理器50用于比对深度信息图像与预设深度图像。其中，在深度信息图像与预设图像的相似度大于预定值时，电子设备100解锁。Please refer to FIG. 2 and FIG. 5. In some embodiments, the electronic device 100 further includes a processor 50. The processor 50 is used to compare the depth information image with the preset depth image. Wherein, when the similarity between the depth information image and the preset image is greater than a predetermined value, the electronic device 100 is unlocked.

请参阅图1、图2及图3，在某些实施例中，显示屏10包括第一基板11、第二基板13及连接层12，第二基板13设置在第一基板11的一侧，第二基板13上开设有至少一个通孔133，深度图像获取模组30设置在通孔133中。连接层12用于连接第一基板11及第二基板13，连接层12的折射率与通孔133内空气的折射率之前的差值在预定范围内。Please refer to FIG. 1, FIG. 2 and FIG. 3. In some embodiments, the display screen 10 includes a first substrate 11, a second substrate 13 and a connection layer 12. The second substrate 13 is disposed on one side of the first substrate 11. At least one through hole 133 is opened on the second substrate 13, and the depth image acquisition module 30 is disposed in the through hole 133. The connection layer 12 is used to connect the first substrate 11 and the second substrate 13, and the difference between the refractive index of the connection layer 12 and the refractive index of the air in the through hole 133 is within a predetermined range.

请参阅图5及图8，本申请还提供一种计算机可读存储介质200，其上存储有计算机程序210，计算机程序210被处理器50执行时，使得处理器50执行控制方法。控制方法包括步骤：Referring to FIG. 5 and FIG. 8, the present application also provides a computer-readable storage medium 200 on which a computer program 210 is stored. When the computer program 210 is executed by the processor 50, the processor 50 executes the control method. The control method includes steps:

下面结合附图做进一步说明。A further description will be given below in conjunction with the drawings.

需要说明的是，在显示屏10开启并显示画面后，显示屏10会以一定的刷新频率进行刷新，刷新的过程就是显示图像、不显示图像、显示图像、不显示图像交替重复出现的过程，由于刷新过程中显示屏10不显示图像的时间很短可以忽略不计，所以在用户看来显示屏10开启后是持续显示图像的。It should be noted that after the display screen 10 is turned on and displays a picture, the display screen 10 will be refreshed at a certain refresh rate. The refreshing process is the process of displaying images, not displaying images, displaying images, and not displaying images alternately and repeatedly. Since the display screen 10 does not display images for a short period of time during the refresh process and can be ignored, it appears to the user that the display screen 10 continues to display images after being turned on.

请参阅图1及图2，本申请还提供一种电子设备100。本申请实施方式的控制方法可以由本申请实施方式的电子设备100实现。电子设备100包括显示屏10、壳体20及深度图像获取模组30。显示屏10设置在壳体20上，深度图像获取模组30设置在壳体20内并位于显示屏10的下方，深度图像获取模30包括发射器31及接收器32；在显示屏10显示图像的同时，发射器31向显示屏10方向发射检测信号，接收器32接收穿过显示屏10后被待检测物反射回的检测信号以获得待检测物的深度信息图像，显示屏10的刷新频率与发射器31的投射频率相同。Please refer to FIG. 1 and FIG. 2, this application also provides an electronic device 100. The control method of the embodiment of the present application can be implemented by the electronic device 100 of the embodiment of the present application. The electronic device 100 includes a display screen 10, a housing 20 and a depth image acquisition module 30. The display screen 10 is arranged on the housing 20, the depth image acquisition module 30 is arranged in the housing 20 and is located below the display screen 10. The depth image acquisition module 30 includes a transmitter 31 and a receiver 32; the image is displayed on the display screen 10. At the same time, the transmitter 31 transmits the detection signal to the display screen 10, and the receiver 32 receives the detection signal reflected by the object to be detected after passing through the display screen 10 to obtain the depth information image of the object to be detected. The refresh frequency of the display screen 10 The projection frequency of the transmitter 31 is the same.

需要说明的是，电子设备100可以是手机、平板电脑、笔记本电脑、智能手环、智能手表、智能眼镜等。本申请以电子设备100是手机为例进行说明。It should be noted that the electronic device 100 may be a mobile phone, a tablet computer, a notebook computer, a smart bracelet, a smart watch, a smart glasses, and the like. In this application, the electronic device 100 is a mobile phone as an example for description.

具体地，请参阅图1、图2及图3，壳体20包括相背设置的第一面21及第二面22。显示屏10包括第一基板11及第二基板13，第二基板13设置在第一基板11的一侧，第二基板13上开设有至少一个通孔133。显示屏10设置在壳体20的第一面21上，并且显示屏10与壳体20形成收容空间23。Specifically, referring to FIGS. 1, 2 and 3, the housing 20 includes a first surface 21 and a second surface 22 disposed opposite to each other. The display screen 10 includes a first substrate 11 and a second substrate 13, the second substrate 13 is disposed on one side of the first substrate 11, and at least one through hole 133 is opened on the second substrate 13. The display screen 10 is disposed on the first surface 21 of the casing 20, and the display screen 10 and the casing 20 form a receiving space 23.

深度图像获取模组30设置在壳体20内并位于显示屏10的下方，即深度图像获取模组30收容于显示屏10与壳体20形成的收容空间23内。深度图像获取模组30包括发射器31及接收器32，当通孔133的数量为一个时，发射器31与接收器32均收容在通过133内。当通孔133的数量为两个时，发射器31与接收器32分别收容在两个通过133内。The depth image acquisition module 30 is disposed in the housing 20 and located below the display screen 10, that is, the depth image acquisition module 30 is accommodated in the housing space 23 formed by the display screen 10 and the housing 20. The depth image acquisition module 30 includes a transmitter 31 and a receiver 32. When the number of through holes 133 is one, both the transmitter 31 and the receiver 32 are accommodated in the through 133. When the number of through holes 133 is two, the transmitter 31 and the receiver 32 are respectively accommodated in the two through holes 133.

在显示屏10显示图像的同时，即显示屏10刷新的同时，发射器31向显示屏10方向发射检测信号，接收器32接收穿过显示屏10后被待检测物反射回的检测信号以获得待检测物的深度信息图像。示例地，图4是显示屏10的刷新频率与发射器31发射检测信号的发射频率的示意图。如图4所示，在第T0时刻，显示屏10不显示图像，发射器31也不发射检测信号；在第T1时刻，显示屏10开始显示图像，发射器31开始发射检测信号；在T2时刻，显示屏10结束显示图像，发射器31结束发射检测信号。由于在显示屏10刷新(显示屏10显示图像)的同时驱动深度图像获取模组30中的发射器31发射检测信号，避免显示屏10与深度图像获取模组30相对应的区域出现明显闪烁，从而提升用户体验。While the display screen 10 displays an image, that is, when the display screen 10 is refreshed, the transmitter 31 transmits a detection signal to the display screen 10, and the receiver 32 receives the detection signal reflected by the object to be detected after passing through the display screen 10 to obtain Depth information image of the object to be inspected. Illustratively, FIG. 4 is a schematic diagram of the refresh frequency of the display screen 10 and the transmission frequency of the detection signal transmitted by the transmitter 31. As shown in Figure 4, at time T0, the display screen 10 does not display images, and the transmitter 31 does not emit detection signals; at time T1, the display screen 10 starts to display images, and the transmitter 31 starts to emit detection signals; at time T2 , The display screen 10 ends displaying images, and the transmitter 31 ends emitting detection signals. Since the transmitter 31 in the depth image acquisition module 30 is driven to emit the detection signal while the display screen 10 is refreshed (the display screen 10 displays an image), the area corresponding to the display screen 10 and the depth image acquisition module 30 is prevented from flickering significantly, Thereby improving the user experience.

在一些实施例中，显示屏10还包括连接层12。连接层12用于连接第一基板11及第二基板13，并且连接层12折射率与通孔133内空气的折射率几乎接近，二者之间的差值在预定范围(小范围)内。例如，假设预定范围为(-0.5，0.5)，则连接层12的折射率可以与空气的折射率之间的差值可以为：-0.49、-0.2、-0.1、-0.23、0、0.11、0.2、0.33、0.45等等。由于连接层12的折射率与通孔133内空气的折射率之间的差值在预定范围内，显示屏10内部光线在未开设通孔133区域朝向显示屏10内部反射的光线量与光线在开设通孔133区域朝向显示屏10内部反射的光线量相同，从而避免显示屏10在设置有深度图像获取模组30的区域与其他区域出现显示不一致的现象，由此进一步能减少明显闪烁现象。In some embodiments, the display screen 10 further includes a connection layer 12. The connection layer 12 is used to connect the first substrate 11 and the second substrate 13, and the refractive index of the connection layer 12 is almost close to the refractive index of the air in the through hole 133, and the difference between the two is within a predetermined range (small range). For example, assuming that the predetermined range is (-0.5, 0.5), the difference between the refractive index of the connecting layer 12 and the refractive index of air may be: -0.49, -0.2, -0.1, -0.23, 0, 0.11, 0.2, 0.33, 0.45 and so on. Since the difference between the refractive index of the connection layer 12 and the refractive index of the air in the through hole 133 is within a predetermined range, the amount of light reflected toward the inside of the display screen 10 in the area where the through hole 133 is not opened in the display screen 10 The area where the through hole 133 is opened has the same amount of light reflected toward the inside of the display screen 10, thereby avoiding the display inconsistency of the display screen 10 in the area where the depth image acquisition module 30 is provided with other areas, thereby further reducing the obvious flicker phenomenon.

请参阅图6，步骤01：在显示屏10刷新的同时，发射器31向显示屏10方向发射检测信号，接收器32接收穿过显示屏10后经待检测物反射后的检测信号，以获得待检测物的深度信息图像包括：Please refer to Fig. 6, step 01: While the display screen 10 is being refreshed, the transmitter 31 transmits a detection signal to the direction of the display screen 10, and the receiver 32 receives the detection signal reflected by the object to be detected after passing through the display screen 10 to obtain The depth information image of the object to be inspected includes:

具体地，请参阅图2及图6，深度图像获取模组30包括发射器31及接收器32。发射器31用于以第一功率朝待检测物发射第一检测信号；接收器32用于接收穿过显示屏10后被待检测物反射回的第一检测信号以获取待检测物与电子设备100的距离；深度图像获取模组30还用于根据距离从预存的距离-功率对应关系中获取第二功率；发射器31还用于以第二功率朝待检测物发射第二检测信号；接收器32还用于接收穿过显示屏后被待检测物反射回的第二检测信号以获取待检测物的深度信息图像。Specifically, referring to FIGS. 2 and 6, the depth image acquisition module 30 includes a transmitter 31 and a receiver 32. The transmitter 31 is used to transmit a first detection signal to the object to be detected with a first power; the receiver 32 is used to receive the first detection signal reflected by the object to be detected after passing through the display screen 10 to obtain the object to be detected and the electronic device The depth image acquisition module 30 is also used to acquire the second power from the pre-stored distance-power correspondence relationship according to the distance; the transmitter 31 is also used to transmit the second detection signal to the object to be detected at the second power; receive The device 32 is also used to receive the second detection signal reflected by the object to be detected after passing through the display screen to obtain the depth information image of the object to be detected.

需要说明的是，深度图像获取模组30中的存储器(图未示)预先存储有距离-功率对应关系，距离-功率对应关系表征了待检测物与电子设备100在不同的距离下，与其对应的深度图像获取模组30发射第二检测信号需要用到的最佳功率(第二功率)的大小。其中，距离与功率呈正相关，即，距离越远，发射器31的功率越大。该距离-功率对应关系可以是电子设备100出厂时由厂商设置，是固定的，用户在使用时无法更改，可以任意更改。该距离-功率对应关系也可以是用户自己设定，在此不作限制。It should be noted that the memory (not shown) in the depth image acquisition module 30 pre-stores the distance-power correspondence relationship. The distance-power correspondence relationship represents that the object to be detected is at different distances from the electronic device 100 and corresponds to it. The magnitude of the optimal power (second power) required for the depth image acquisition module 30 to transmit the second detection signal. Among them, the distance is positively correlated with the power, that is, the farther the distance, the greater the power of the transmitter 31. The distance-power correspondence relationship may be set by the manufacturer when the electronic device 100 leaves the factory, and is fixed, and cannot be changed by the user during use, but can be changed arbitrarily. The distance-power correspondence relationship can also be set by the user, which is not limited here.

例如，假设距离-功率对应关系记录了第一距离对应的最佳功率的大小为第一预设值；第二距离对应的最佳功率的大小为第二预设值，其中第一距离小于第二距离，第一预设值小于第二预设值。当深度图像获取模组30获取到待检测物100与电子设备100之间的距离为第一距离时，根据距离-功率对应关系中第一距离对应的最佳功率的大小为第一预设值，则深度图像获取模组30中的发射器31以功率大小为第一预设值发射第二检测信号；当深度图像获取模组30获取到待检测物100与电子设备100之间的距离为第二距离时，根据距离-功率对应关系中第二距离对应的最佳率的大小为第二预设值，则深度图像获取模组30中的发射器31以功率大小为第二预设发射第二检测信号。For example, suppose that the distance-power correspondence records that the magnitude of the optimal power corresponding to the first distance is the first preset value; the magnitude of the optimum power corresponding to the second distance is the second preset value, where the first distance is smaller than the first distance Two distances, the first preset value is less than the second preset value. When the depth image acquisition module 30 acquires that the distance between the object to be detected 100 and the electronic device 100 is the first distance, the magnitude of the optimal power corresponding to the first distance in the distance-power correspondence is the first preset value , The transmitter 31 in the depth image acquisition module 30 transmits the second detection signal with the power as the first preset value; when the depth image acquisition module 30 acquires the distance between the object to be detected 100 and the electronic device 100 At the second distance, according to the magnitude of the optimal rate corresponding to the second distance in the distance-power correspondence relationship as the second preset value, the transmitter 31 in the depth image acquisition module 30 transmits with the power level as the second preset value. The second detection signal.

在一个例子中，第一功率小于第二功率。由于深度图像获取模组30先发射一个低功率(第一功率)的第一检测信号判断待检测物与电子设备100之间的距离，再根据待检测物与电子设备100之间的距离选用该距离下对应的最佳功率(第二功率)的大小来发射第二检测信号，以获得深度信息图像。一方面，避免了深度图像获取模组30长期发射大功率的检测信号并使该信号穿过显示屏10，可以降低发射器31发射的检测信号对显示屏10造成损坏，从而提高显示屏10的寿命。另一方面，当设置在显示屏10下方的深度图像获取模组30用于人脸识别的时候，根据待检测物(人脸)与电子设备100之间的距离来调整第二检测信号的第二功率大小，在实际距离大于与低功率对应的测试距离时，则第二功率可以调整为大于第一功率，如此可以避免深度图像获取模组30长期发射大功率的检测信号并使该信号穿过显示屏10射到人眼，从而保护人眼，保证人眼安全。在实际距离小于与低功率对应的测试距离时，则第二功率可以调整为小于第一功率，也能避免深度图像获取模组30长期发射大功率的检测信号并使该信号穿过显示屏10射到人眼，从而保护人眼，保证人眼安全。In one example, the first power is less than the second power. Since the depth image acquisition module 30 first transmits a low-power (first power) first detection signal to determine the distance between the object to be detected and the electronic device 100, and then selects the distance between the object to be detected and the electronic device 100 The second detection signal is transmitted by the magnitude of the optimal power (second power) corresponding to the distance to obtain the depth information image. On the one hand, it prevents the depth image acquisition module 30 from emitting a high-power detection signal for a long time and makes the signal pass through the display screen 10, which can reduce the damage to the display screen 10 caused by the detection signal emitted by the transmitter 31, thereby improving the display screen 10 performance. life. On the other hand, when the depth image acquisition module 30 provided under the display screen 10 is used for face recognition, the second detection signal is adjusted according to the distance between the object to be detected (human face) and the electronic device 100. The second power level, when the actual distance is greater than the test distance corresponding to the low power, the second power can be adjusted to be greater than the first power, which can prevent the depth image acquisition module 30 from emitting high-power detection signals for a long time and make the signal pass through It is shot to human eyes through the display screen 10, thereby protecting the human eyes and ensuring the safety of the human eyes. When the actual distance is less than the test distance corresponding to the low power, the second power can be adjusted to be less than the first power, which can also prevent the depth image acquisition module 30 from emitting a high-power detection signal for a long time and make the signal pass through the display screen 10. Shot into the human eye, thereby protecting the human eye and ensuring the safety of the human eye.

需要说明的是，当待检测物与电子设备100之间的距离很近的时候，第二功率可以等于第一功率。It should be noted that when the distance between the object to be detected and the electronic device 100 is very close, the second power may be equal to the first power.

请参阅图7，控制方法还包括：Please refer to Figure 7, the control method also includes:

请参阅图2及图7，发射器31在发射第一检测信号的同时，显示屏10以第一刷新频率显示图像，第一检测信号的投射频率与第一刷新频率相同；发射器31在发射第二检测信号的同时，显示屏10以第二刷新频率显示图像，第二检测信号的投射频率与第二刷新频率相同，第一刷新频率小于第二刷新频率。2 and 7, while the transmitter 31 transmits the first detection signal, the display screen 10 displays an image at the first refresh frequency, and the projection frequency of the first detection signal is the same as the first refresh frequency; the transmitter 31 is transmitting Simultaneously with the second detection signal, the display screen 10 displays an image at the second refresh frequency. The projection frequency of the second detection signal is the same as the second refresh frequency, and the first refresh frequency is less than the second refresh frequency.

在一些实施例中，发射器31以第一功率朝待检测物发射第一检测信号，同时显示屏10以第一刷新频率显示图像，第一检测信号的投射频率与第一刷新频率相同。接收器32接收穿过显示屏10后被待检测物反射回的第一检测信号以获取待检测物与电子设备100的距离；电子设备100的处理器50还用于根据距离从预存的距离-功率对应关系中获取第二功率。发射器31再以第二功率发射第二检测信号，同时显示屏10以第二刷新频率显示图像，第二检测信号的投射频率与第二刷新频率相同。并且第一刷新频率小于第二刷新频率，也即使是说，第一检测信号的投射频率小于第二检测信号的投射频率。一方面，由于用于检测距离的第一检测信号的投射频率较小，对于显示屏10的损坏能量较弱，从而延长显示屏10的使用寿命；另一方面，由于用于获取深度信息图像的第二检测信号的投射频率较大，获取到待检测物的深度图像信息也更详细，从而提高深度信息图像的精确度。In some embodiments, the transmitter 31 transmits the first detection signal to the object to be detected at the first power, and the display screen 10 displays the image at the first refresh frequency, and the projection frequency of the first detection signal is the same as the first refresh frequency. The receiver 32 receives the first detection signal reflected by the object to be detected after passing through the display screen 10 to obtain the distance between the object to be detected and the electronic device 100; The second power is obtained from the power correspondence relationship. The transmitter 31 then transmits the second detection signal at the second power, and at the same time the display screen 10 displays the image at the second refresh frequency, and the projection frequency of the second detection signal is the same as the second refresh frequency. And the first refresh frequency is less than the second refresh frequency, even if the projection frequency of the first detection signal is less than the projection frequency of the second detection signal. On the one hand, because the projection frequency of the first detection signal used to detect the distance is relatively small, the damage energy to the display screen 10 is weak, thereby prolonging the service life of the display screen 10; The projection frequency of the second detection signal is larger, and the depth image information of the object to be detected is also more detailed, thereby improving the accuracy of the depth information image.

在另一些实施例中，电子设备100中的存储器(图未示)还预先存储有距离-投射频率对应关系，距离-投射频率对应关系表征了待检测物与电子设备100在不同的距离下，与其对应的深度图像获取模组30发射第二检测信号需要用到的最佳投射频率的大小。其中，距离与投射频率也呈正相关，即，距离越远，发射器31的投射频率越大。该距离-投射频率对应关系可以是电子设备100出厂时由厂商设置，是固定的，用户在使用时无法更改。该距离-投射频率对应关系也可以是用户自己设定，可以任意更改，在此不作限制。In some other embodiments, the memory (not shown) in the electronic device 100 also pre-stores the distance-projection frequency correspondence relationship, and the distance-projection frequency correspondence relationship represents that the object to be detected is at different distances from the electronic device 100. The size of the optimal projection frequency required for the corresponding depth image acquisition module 30 to transmit the second detection signal. Among them, the distance and the projection frequency are also positively correlated, that is, the farther the distance is, the greater the projection frequency of the transmitter 31 is. The distance-projection frequency correspondence relationship may be set by the manufacturer when the electronic device 100 leaves the factory, is fixed, and cannot be changed by the user during use. The distance-projection frequency correspondence relationship can also be set by the user and can be changed arbitrarily, which is not limited here.

发射器31可根据待检测物与电子设备100之间的距离选择具有对应投射频率及对应功率的第二检测信号。待检测物与电子设备100之间的距离越远，第二检测信号的投射频率越大。在投射第二检测信号的同时，显示屏10具有第二刷新频率，并且第二刷新频率与第二检测信号的投射频率相同。也即是说，待检测物与电子设备100之间的距离越远，在发射第二检测信号时显示屏10的刷新频率越大。具体地，发射器31以第一功率朝待检测物发射第一检测信号，同时显示屏10以第一刷新频率显示图像，第一检测信号的投射频率与第一刷新频率相同。接收器32接收穿过显示屏10后被待检测物反射回的第一检测信号以获取待检测物与电子设备100的距离；深度图像获取模组30还用于根据距离从预存的距离-功率对应关系中获取第二功率的大小，再根据距离从预存的距离-频率对应关系中获取第二检测信号的投射频率的大小。发射器31根据获取到的第二功率的大小及投射频率的大小发射第二检测信号，同时显示屏10以第二刷新频率显示图像，第二刷新频率与第二检测信号的投射频率相同。The transmitter 31 can select a second detection signal having a corresponding projection frequency and a corresponding power according to the distance between the object to be detected and the electronic device 100. The greater the distance between the object to be detected and the electronic device 100, the greater the projection frequency of the second detection signal. While projecting the second detection signal, the display screen 10 has a second refresh frequency, and the second refresh frequency is the same as the projection frequency of the second detection signal. In other words, the farther the distance between the object to be detected and the electronic device 100 is, the greater the refresh frequency of the display screen 10 when the second detection signal is transmitted. Specifically, the transmitter 31 emits the first detection signal to the object to be detected at the first power, and at the same time the display screen 10 displays the image at the first refresh frequency, and the projection frequency of the first detection signal is the same as the first refresh frequency. The receiver 32 receives the first detection signal reflected by the object to be detected after passing through the display screen 10 to obtain the distance between the object to be detected and the electronic device 100; The magnitude of the second power is obtained from the correspondence relationship, and the magnitude of the projection frequency of the second detection signal is obtained from the pre-stored distance-frequency correspondence relationship according to the distance. The transmitter 31 emits a second detection signal according to the acquired second power and projection frequency, and the display screen 10 displays an image at the second refresh frequency, which is the same as the projection frequency of the second detection signal.

在一些实施例中，在距离-功率对应关系中，可以是一个距离值对应一个功率值，可以是一个距离值对应一个功率范围，也可以是一个距离范围对应一个功率值，还可以是一个距离范围对应一个功率范围。当通过低功率的第一检测信号检测出待检测物与电子设备100之间的距离后，若通过查表法，在距离-功率对应关系中，查出与该检测出的距离对应的功率为多个，那么可从中任选一个功率作为第二检测信号的第二功率。同样地，在距离-投射频率对应关系中，可以是一个距离值对应一个投射频率值，可以是一个距离值对应一个投射频率范围，也可以是一个距离范围对应一个投射频率值，还可以是一个距离范围对应一个投射频率范围。当通过低功率的第一检测信号检测出待检测物与电子设备100之间的距离后，若通过查表法，在距离-投射频率对应关系中，查出与该检测出的距离对应的投射频率为多个，那么可从中任选一个投射频率作为第二检测信号的投射频率。In some embodiments, in the distance-power correspondence relationship, a distance value may correspond to a power value, a distance value may correspond to a power range, a distance range may correspond to a power value, or a distance value may correspond to a power value. The range corresponds to a power range. When the distance between the object to be detected and the electronic device 100 is detected by the low-power first detection signal, if the table look-up method is used, in the distance-power correspondence relationship, the power corresponding to the detected distance is found to be If there are multiple, one power can be selected as the second power of the second detection signal. Similarly, in the distance-projection frequency correspondence relationship, a distance value can correspond to a projection frequency value, a distance value can correspond to a projection frequency range, a distance range can correspond to a projection frequency value, or a distance range corresponds to a projection frequency value. The distance range corresponds to a projection frequency range. When the distance between the object to be detected and the electronic device 100 is detected by the low-power first detection signal, if the table look-up method is used, in the distance-projection frequency correspondence relationship, the projection corresponding to the detected distance is found If there are multiple frequencies, one of the projection frequencies can be selected as the projection frequency of the second detection signal.

需要说明的是，一个例子中，第一检测信号的第一功率可以等于第二检测信号的第二功率，但第一检测信号的投射频率可以小于第二检测信号的投射频率。一方面，由于用于检测距离的第一检测信号的投射频率较小，对于显示屏10的损坏能量较弱，从而延长显示屏10的使用寿命；另一方面，由于用于获取深度信息图像的第二检测信号的投射频率较大，获取到待检测物的深度图像信息也更详细，从而提高深度信息图像的精确度。It should be noted that, in an example, the first power of the first detection signal may be equal to the second power of the second detection signal, but the projection frequency of the first detection signal may be less than the projection frequency of the second detection signal. On the one hand, because the projection frequency of the first detection signal used to detect the distance is relatively small, the damage energy to the display screen 10 is weak, thereby prolonging the service life of the display screen 10; The projection frequency of the second detection signal is larger, and the depth image information of the object to be detected is also more detailed, thereby improving the accuracy of the depth information image.

在一个例子中，第一检测信号的投射频率可以等于第二检测信号的投射频率，但第一检测信号的第一功率小于第二检测信号的第二功率。一方面，由于用于检测距离的第一检测信号的功率较小，对于显示屏10的损坏能量较弱，从而延长显示屏10的使用寿命；另一方面，由于用于获取深度信息图像的第二检测信号的功率较大，获取到待检测物的深度图像信息也更详细，从而提高深度信息图像的精确度。In an example, the projection frequency of the first detection signal may be equal to the projection frequency of the second detection signal, but the first power of the first detection signal is less than the second power of the second detection signal. On the one hand, because the power of the first detection signal used to detect the distance is relatively small, the damage energy to the display screen 10 is weak, thereby prolonging the service life of the display screen 10; on the other hand, due to the first detection signal used to obtain the depth information image Second, the power of the detection signal is larger, and the depth image information of the object to be detected is also more detailed, thereby improving the accuracy of the depth information image.

在又一个例子中，第一检测信号的第一功率小于第二检测信号的第二功率，第一检测信号的投射频率也小于第二检测信号的投射频率。一方面，由于用于检测距离的第一检测信号的能量(包括功率及投射频率)较小，对于显示屏10的损坏能量较弱，从而延长显示屏10的使用寿命；另一方面，由于用于获取深度信息图像的第二检测信号的能量(包括功率及投射频率)较大，获取到待检测物的深度图像信息也更详细，从而提高深度信息图像的精确度。In another example, the first power of the first detection signal is less than the second power of the second detection signal, and the projection frequency of the first detection signal is also less than the projection frequency of the second detection signal. On the one hand, since the energy (including power and projection frequency) of the first detection signal used to detect the distance is small, the damage energy to the display screen 10 is weak, thereby prolonging the service life of the display screen 10; on the other hand, due to the use of The energy (including power and projection frequency) of the second detection signal used to obtain the depth information image is larger, and the depth image information of the object to be detected is also more detailed, thereby improving the accuracy of the depth information image.

请参阅图5，在一些实施例中，控制方法还包括：Referring to FIG. 5, in some embodiments, the control method further includes:

请参阅图1、图2及图5，电子设备100还包括摄像模组40。摄像模组40收容在显示屏10与壳体20形成的收容腔内。摄像模组40可以是可见光摄像头，也可以是红外光摄像头。当摄像模组40是可见光摄像头时，摄像模组40获取到待检测物的二维图像信息为RGB图像；当摄像模组40是红外光摄像头时，摄像模组40获取到待检测物的二维图像为红外图像。在本申请的实施例中，摄像模组40为可见光摄像头。Please refer to FIG. 1, FIG. 2 and FIG. 5, the electronic device 100 further includes a camera module 40. The camera module 40 is accommodated in the accommodating cavity formed by the display screen 10 and the housing 20. The camera module 40 may be a visible light camera or an infrared light camera. When the camera module 40 is a visible light camera, the two-dimensional image information obtained by the camera module 40 of the object to be detected is an RGB image; when the camera module 40 is an infrared camera, the camera module 40 obtains the second image of the object to be detected. The two-dimensional image is an infrared image. In the embodiment of the present application, the camera module 40 is a visible light camera.

可以理解地，当设置在显示屏10下的深度图像获取模组30用于人脸解锁时，只有识别到二维信息中存在人脸，才需要开启深度图像获取模组30以获取人脸的深度信息图像进行解锁；若二维信息中不存在人脸，则不需要。由于先利用摄像模组40判断待检测物中是否含有人脸，存在人脸才开启深度图像获取模组30，大大减少了发射器31发射的检测信号穿过显示屏10的次数，从而既减少了闪屏，又降低了发射器31发射的检测信号对显示屏10造成的损坏，提高显示屏10寿命。Understandably, when the depth image acquisition module 30 provided under the display screen 10 is used for face unlocking, only when a human face is recognized in the two-dimensional information, the depth image acquisition module 30 needs to be turned on to acquire the information of the face. The depth information image is unlocked; if there is no face in the two-dimensional information, it is not required. Since the camera module 40 is first used to determine whether the object to be detected contains a human face, the depth image acquisition module 30 is turned on when there is a human face, which greatly reduces the number of times the detection signal emitted by the transmitter 31 passes through the display screen 10, thereby reducing both In addition to the splash screen, the damage to the display screen 10 caused by the detection signal emitted by the transmitter 31 is reduced, and the life of the display screen 10 is improved.

需要说明的是，开启深度图像获取模组30并不是指立即驱动发射器31发射检测信号，而是当检测到待检测物的二维图像信息中存在人脸后，深度图像获取模组30已经上电，发射器31做好发射光线的准备，只有在显示屏10第一次显示图像的同时，发射器31才正式朝显示屏10外发射检测信号。It should be noted that turning on the depth image acquisition module 30 does not mean that the transmitter 31 is immediately driven to transmit the detection signal, but when a human face is detected in the two-dimensional image information of the object to be detected, the depth image acquisition module 30 has been When the power is turned on, the transmitter 31 is ready to emit light. Only when the display screen 10 displays an image for the first time, the transmitter 31 officially emits a detection signal to the outside of the display screen 10.

请参阅图2及图5，电子设备100还包括处理器50。步骤04及步骤05均可由处理器50执行。也即是说，处理器50用于比对深度信息图像与预设深度图像，及在深度信息图像与预设图像的相似度大于预定值时，解锁电子设备100。Please refer to FIG. 2 and FIG. 5, the electronic device 100 further includes a processor 50. Both step 04 and step 05 can be executed by the processor 50. In other words, the processor 50 is used to compare the depth information image with the preset depth image, and unlock the electronic device 100 when the similarity between the depth information image and the preset image is greater than a predetermined value.

具体地，将获得的深度信息图像与预设深度图像分别进行人脸特征提取，以获得与预设深度图像对应的第一特征图像及与深度信息图像对应的第二特征图像；对第一特征图像中的各个特征与第二特征图像中的各个特征进行分类，并分别进行向量化表示。获得与预设深度图像对应的第一特征图像中的特征向量及与待深度信息图像对应的第二特征图像的特征向量后，计算每一张第一特征图像中的每个类别的特征向量与第二特征图像中对应类别的特征向量之间的差距。例如，选取第一特征图像中表示眼睛宽度的特征向量与第二特征图像中表示眼睛宽度的特征向量，计算这两个向量之间的差距；或选取第一特征图像中表示鼻梁高度的特征向量与第二特征图像中表示鼻梁高度的特征向量，计算这两个向量之间的差距。Specifically, the obtained depth information image and the preset depth image are respectively subjected to facial feature extraction to obtain a first feature image corresponding to the preset depth image and a second feature image corresponding to the depth information image; Each feature in the image is classified with each feature in the second feature image, and the vectorized representation is performed respectively. After obtaining the feature vector in the first feature image corresponding to the preset depth image and the feature vector of the second feature image corresponding to the depth information image, calculate the feature vector of each category in each first feature image and The gap between the feature vectors of the corresponding categories in the second feature image. For example, select the feature vector representing the width of the eyes in the first feature image and the feature vector representing the width of the eyes in the second feature image, and calculate the difference between the two vectors; or select the feature vector representing the height of the bridge of the nose in the first feature image Calculate the difference between the two vectors with the feature vector representing the height of the bridge of the nose in the second feature image.

根据多个类别对应的多个差距计算出深度信息图像与预设深度图像之间的综合差距，并用综合差距来表示相似度。在一些实施例中，可利用欧氏距离计算综合差距并且用欧氏距离值表示相似度，例如，特征向量的类别包括眼睛、鼻子、嘴巴、耳朵，并且第一特征图像中表示眼睛的特征向量为A、第二特征图像中表示眼睛的特征向量为A0；第一特征图像中表示鼻子的特征向量为B、第二特征图像中表示鼻子的特征向量为B0；第一特征图像中表示嘴巴的特征向量为C、第二特征图像中表示嘴巴的特征向量为C0；第一特征图像表示耳朵的特征向量为D、第二特征图像中表示耳朵的特征向量为D0，则根据欧氏距离计算综合差距L为第一特征图像与第二特征图像上相同类别特征向量之间差值的平方和的算术平方根，即用数学公式表达为：

用计算获得的L值表示深度信息图像中人脸与预设深度图像中人脸的相似度，计算的欧氏距离值越小表示综合差距越小，即该深度信息图像中的人脸与预设深度图像中人脸越相似，即相似度越高。当深度信息图像中的人脸与预设深度图像中的人脸之间的相似度大于预定值时，即可认为此时使用电子设备100的用户是该电子设备100的授权用户，则可解锁电子设备100。 According to multiple gaps corresponding to multiple categories, the comprehensive gap between the depth information image and the preset depth image is calculated, and the comprehensive gap is used to represent the similarity. In some embodiments, the Euclidean distance can be used to calculate the comprehensive gap and the Euclidean distance value is used to indicate the similarity. For example, the category of the feature vector includes eyes, nose, mouth, and ears, and the feature vector of the eyes is represented in the first feature image. Is A, the feature vector representing the eyes in the second feature image is A0; the feature vector representing the nose in the first feature image is B, the feature vector representing the nose in the second feature image is B0; the feature vector representing the mouth in the first feature image The feature vector is C, the feature vector representing the mouth in the second feature image is C0; the feature vector representing the ears in the first feature image is D, and the feature vector representing the ears in the second feature image is D0, then the synthesis is calculated based on the Euclidean distance The gap L is the arithmetic square root of the sum of the squares of the difference between the feature vectors of the same category on the first feature image and the second feature image, that is, expressed by the mathematical formula:

The calculated L value is used to indicate the similarity between the face in the depth information image and the face in the preset depth image. The smaller the calculated Euclidean distance value, the smaller the comprehensive gap, that is, the face in the depth information image and the preset depth image It is assumed that the more similar the human faces in the depth image, the higher the similarity. When the similarity between the face in the depth information image and the face in the preset depth image is greater than a predetermined value, it can be considered that the user using the electronic device 100 at this time is an authorized user of the electronic device 100, and the unlocking can be performed Electronic equipment 100.

请一并参阅图8，本申请还提供一种计算机可读存储介质200，其上存储有计算机程序210，程序被处理器50执行的情况下，实现上述任意一种实施方式的控制方法的步骤。Please also refer to FIG. 8. This application also provides a computer-readable storage medium 200 on which a computer program 210 is stored. When the program is executed by the processor 50, the steps of the control method of any one of the above embodiments are implemented. .

例如，请参阅图6及图8，程序被处理器50执行的情况下，实现以下控制方法的步骤：For example, referring to FIG. 6 and FIG. 8, when the program is executed by the processor 50, the steps of the following control method are implemented:

012：接收穿过显示屏10后被待检测物反射回的第一检测信号以获取待检测物与电子设备100之间的距离；根据距离从预存的距离-功率对应关系中获取第二功率；012: Receive the first detection signal reflected by the object to be detected after passing through the display screen 10 to obtain the distance between the object to be detected and the electronic device 100; obtain the second power from the pre-stored distance-power correspondence according to the distance;

013：以第二功率朝待检测物发射第二检测信号；013: Transmit a second detection signal at the second power to the object to be detected;

014：接收穿过显示屏后被待检测物反射回的第二检测信号以获取待检测物的深度信息图像。014: Receive the second detection signal reflected by the object to be detected after passing through the display screen to obtain the depth information image of the object to be detected.

再例如，请参阅图2及图8，程序被处理器50执行的情况下，实现以下控制方法的步骤：For another example, referring to FIG. 2 and FIG. 8, when the program is executed by the processor 50, the steps of the following control method are implemented:

计算机可读存储介质200可设置在电子设备200内，也可设置在云端服务器内，此时，电子设备200能够与云端服务器进行通讯来获取到相应的计算机程序210。The computer-readable storage medium 200 may be set in the electronic device 200 or in a cloud server. At this time, the electronic device 200 can communicate with the cloud server to obtain the corresponding computer program 210.

可以理解，计算机程序210包括计算机程序代码。计算机程序代码可以为源代码形式、对象代码形式、可执行文件或某些中间形式等。计算机可读存储介质可以包括：能够携带计算机程序代码的任何实体或装置、记录介质、U盘、移动硬盘、磁碟、光盘、计算机存储器、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、以及软件分发介质等。It can be understood that the computer program 210 includes computer program code. The computer program code may be in the form of source code, object code, executable file, or some intermediate forms, etc. The computer-readable storage medium may include: any entity or device capable of carrying computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random memory Access memory (RAM, Random Access Memory), and software distribution media, etc.

处理器50可以是指驱动板。驱动板可以是中央处理单元(Central Processing Unit，CPU)，还可以是其他通用处理器50、数字信号处理器230(Digital Signal Processor，DSP)、专用集成电路(Application Specific Integrated Circuit，ASIC)、现成可编程门阵列(Field-Programmable Gate Array，FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。The processor 50 may refer to a driver board. The driver board can be a central processing unit (Central Processing Unit, CPU), other general-purpose processors 50, digital signal processors 230 (Digital Signal Processor, DSP), application specific integrated circuits (ASIC), ready-made Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc.

在本说明书的描述中，参考术语“一个实施方式”、“一些实施方式”、“示意性实施方式”、“示例”、“具体示例”或“一些示例”等的描述意指结合所述实施方式或示例描述的具体特征、结构、材料或者特点包含于本申请的至少一个实施方式或示例中。在本说明书中，对上述术语的示意性表述不一定指的是相同的实施方式或示例。而且，描述的具体特征、结构、材料或者特点可以在任何的一个或多个实施方式或示例中以合适的方式结合。此外，在不相互矛盾的情况下，本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。In the description of this specification, the description with reference to the terms “one embodiment”, “some embodiments”, “exemplary embodiments”, “examples”, “specific examples” or “some examples” etc. means to combine the described implementations The specific features, structures, materials, or characteristics described by the manners or examples are included in at least one embodiment or example of the present application. In this specification, the schematic representation of the above-mentioned terms does not necessarily refer to the same embodiment or example. Moreover, the described specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art can combine and combine the different embodiments or examples and the features of the different embodiments or examples described in this specification without contradicting each other.

流程图中或在此以其他方式描述的任何过程或方法描述可以被理解为，表示包括一个或更多个用于实现特定逻辑功能或过程的步骤的可执行指令的代码的模块、片段或部分，并且本申请的优选实施方式的范围包括另外的实现，其中可以不按所示出或讨论的顺序，包括根据所涉及的功能按基本同时的方式或按相反的顺序，来执行功能，这应被本申请的实施例所属技术领域的技术人员所理解。Any process or method description described in the flowchart or described in other ways herein can be understood as a module, segment, or part of code that includes one or more executable instructions for implementing specific logical functions or steps of the process , And the scope of the preferred embodiments of the present application includes additional implementations, which may not be in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order according to the functions involved. This should It is understood by those skilled in the art to which the embodiments of the present application belong.

尽管上面已经示出和描述了本申请的实施方式，可以理解的是，上述实施方式是示例性的，不能理解为对本申请的限制，本领域的普通技术人员在本申请的范围内可以对上述实施方式进行变化、修改、替换和变型。Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limitations on the present application. Those of ordinary skill in the art can comment on the above within the scope of the present application. The implementation mode undergoes changes, modifications, replacements and modifications.

Claims

一种用于电子设备的控制方法，其特征在于，所述电子设备包括深度图像获取模组、壳体及显示屏，所述深度图像获取模组设置在所述壳体内并位于所述显示屏的下方，所述深度图像获取模组包括发射器及接收器；所述控制方法包括：A control method for an electronic device, wherein the electronic device includes a depth image acquisition module, a housing, and a display screen, and the depth image acquisition module is arranged in the housing and located on the display screen. Below, the depth image acquisition module includes a transmitter and a receiver; the control method includes:

在所述显示屏刷新的同时，所述发射器向所述显示屏方向发射检测信号，所述接收器接收穿过所述显示屏后经待检测物反射后的所述检测信号，以获得所述待检测物的深度信息图像；其中，所述显示屏的刷新频率与所述发射器的投射频率相同。While the display screen is refreshing, the transmitter transmits a detection signal in the direction of the display screen, and the receiver receives the detection signal that is reflected by the object to be detected after passing through the display screen to obtain the detection signal. The depth information image of the object to be detected; wherein the refresh frequency of the display screen is the same as the projection frequency of the transmitter.
根据权利要求1所述的控制方法，其特征在于，所述在所述显示屏刷新的同时，所述发射器向所述显示屏方向发射检测信号，所述接收器接收穿过所述显示屏后被待检测物反射回的所述检测信号以获得所述待检测物的深度信息图像包括：The control method according to claim 1, wherein the transmitter transmits a detection signal in the direction of the display screen while the display screen is refreshed, and the receiver receives and passes through the display screen. The detection signal reflected back by the object to be detected to obtain the depth information image of the object to be detected includes:

以第一功率朝所述待检测物发射第一检测信号；Transmitting a first detection signal to the object to be detected with a first power;

接收穿过所述显示屏后被所述待检测物反射回的所述第一检测信号以获取所述待检测物与所述电子设备的距离；根据所述距离从预存的距离-功率对应关系中获取第二功率；Receiving the first detection signal that is reflected by the object to be detected after passing through the display screen to obtain the distance between the object to be detected and the electronic device; according to the distance from a pre-stored distance-power correspondence To obtain the second power;

以第二功率朝所述待检测物发射所述第二检测信号；Transmitting the second detection signal to the object to be detected with a second power;

接收穿过所述显示屏后被所述待检测物反射回的所述第二检测信号以获取待检测物的深度信息图像。The second detection signal reflected by the object to be detected after passing through the display screen is received to obtain a depth information image of the object to be detected.
根据权利要求2所述的控制方法，其特征在于，所述第一功率小于所述第二功率；或The control method according to claim 2, wherein the first power is less than the second power; or

所述第二功率等于所述第一功率。The second power is equal to the first power.
根据权利要求2所述的控制方法，其特征在于，所述控制方法包括：The control method according to claim 2, wherein the control method comprises:

在发射所述第一检测信号的同时，所述显示屏以第一刷新频率显示图像，所述第一检测信号的投射频率与所述第一刷新频率相同；While transmitting the first detection signal, the display screen displays an image at a first refresh frequency, and the projection frequency of the first detection signal is the same as the first refresh frequency;

在发射所述第二检测信号的同时，所述显示屏以第二刷新频率显示图像，第二检测信号的投射频率与所述第二刷新频率相同，所述第一刷新频率小于所述第二刷新频率。While transmitting the second detection signal, the display screen displays images at a second refresh frequency, the projection frequency of the second detection signal is the same as the second refresh frequency, and the first refresh frequency is less than the second refresh frequency. Refresh frequency.
根据权利要求4所述的控制方法，其特征在于，所述第一检测信号的投射频率等于所述第二检测信号的投射频率，且所述第一检测信号的第一功率小于所述第二检测信号的第二功率。The control method according to claim 4, wherein the projection frequency of the first detection signal is equal to the projection frequency of the second detection signal, and the first power of the first detection signal is less than the second detection signal. The second power of the detection signal.
根据权利要求2或4所述的控制方法，其特征在于，所述控制方法包括：The control method according to claim 2 or 4, wherein the control method comprises:

获取所述待检测物的二维图像信息；及Acquiring the two-dimensional image information of the object to be detected; and

在所述二维图像信息中存在人脸时，则启动所述深度图像获取模组。When there is a human face in the two-dimensional image information, the depth image acquisition module is activated.
根据权利要求6所述的控制方法，其特征在于，所述控制方法包括：The control method according to claim 6, wherein the control method comprises:

比对所述深度信息图像与预设深度图像；Comparing the depth information image with a preset depth image;

在所述深度信息图像与所述预设图像的相似度大于预定值时，解锁所述电子设备。When the similarity between the depth information image and the preset image is greater than a predetermined value, unlock the electronic device.
一种电子设备，其特征在于，所述电子设备包括：An electronic device, characterized in that, the electronic device includes:

壳体；case;

显示屏，所述显示屏设置在所述壳体上；及A display screen, the display screen is arranged on the housing; and

深度图像获取模组，所述深度图像获取模组设置在所述壳体内并位于所述显示屏的下方，所述深度图像获取模组包括发射器及接收器；在所述显示屏显示图像的同时，所述发射器向所述显示屏方向发射检测信号，所述接收器接收穿过所述显示屏后被待检测物反射回的所述检测信号以获得所述待检测物的深度信息图像；其中，所述显示屏的刷新频率与所述发射器的投射频率相同。A depth image acquisition module, the depth image acquisition module is arranged in the housing and located below the display screen, the depth image acquisition module includes a transmitter and a receiver; At the same time, the transmitter transmits a detection signal in the direction of the display screen, and the receiver receives the detection signal reflected by the object to be detected after passing through the display screen to obtain a depth information image of the object to be detected ; Wherein, the refresh frequency of the display screen is the same as the projection frequency of the transmitter.
根据权利要求8所述的电子设备，其特征在于，The electronic device according to claim 8, wherein:

所述发射器用于以第一功率朝所述待检测物发射第一检测信号；The transmitter is used to transmit a first detection signal to the object to be detected with a first power;

所述接收器用于接收穿过所述显示屏后被所述待检测物反射回的所述第一检测信号以获取所述待检测物与所述电子设备的距离；The receiver is configured to receive the first detection signal reflected by the object to be detected after passing through the display screen to obtain the distance between the object to be detected and the electronic device;

所述发射器还用于以第二功率朝所述待检测物发射所述第二检测信号，所述第二功率是根据所述距离从预存的距离-功率对应关系获取的；The transmitter is further configured to transmit the second detection signal toward the object to be detected at a second power, where the second power is obtained from a pre-stored distance-power correspondence relationship according to the distance;

所述接收器接收穿过所述显示屏后被所述待检测物反射回的所述第二检测信号以获取待检测物的深度信息图像。The receiver receives the second detection signal reflected by the object to be detected after passing through the display screen to obtain a depth information image of the object to be detected.
根据权利要求9所述的电子设备，其特征在于，所述第一功率小于所述第二功率；或The electronic device according to claim 9, wherein the first power is less than the second power; or

所述第二功率等于所述第一功率。The second power is equal to the first power.
根据权利要求9所述的电子设备，其特征在于，The electronic device according to claim 9, wherein:

所述发射器在发射所述第一检测信号的同时，所述显示屏以第一刷新频率显示图像，所述第一检测信号的投射频率与所述第一刷新频率相同；While the transmitter transmits the first detection signal, the display screen displays an image at a first refresh frequency, and the projection frequency of the first detection signal is the same as the first refresh frequency;

所述发射器在发射所述第二检测信号的同时，所述显示屏以第二刷新频率显示图像，所述第二检测信号的投射频率与所述第二刷新频率相同，所述第一刷新频率小于所述第二刷新频率。While the transmitter transmits the second detection signal, the display screen displays an image at a second refresh frequency, the projection frequency of the second detection signal is the same as the second refresh frequency, and the first refresh The frequency is less than the second refresh frequency.
根据权利要求11所述的电子设备，其特征在于，所述第一检测信号的投射频率等于所述第二检测信号的投射频率，且所述第一检测信号的第一功率小于所述第二检测信号的第二功率。11. The electronic device according to claim 11, wherein the projection frequency of the first detection signal is equal to the projection frequency of the second detection signal, and the first power of the first detection signal is less than that of the second detection signal. The second power of the detection signal.
根据权利要求9或11所述的电子设备，其特征在于，所述电子设备还包括：The electronic device according to claim 9 or 11, wherein the electronic device further comprises:

摄像模组，所述摄像模组用于获取待检测物的二维图像信息；其中：Camera module, the camera module is used to obtain two-dimensional image information of the object to be detected; wherein:

在所述二维图像信息中存在人脸时，所述深度图像获取模组启动。When there is a human face in the two-dimensional image information, the depth image acquisition module is activated.
根据权利要求13所述的电子设备，其特征在于，所述电子设备还包括：The electronic device according to claim 13, wherein the electronic device further comprises:

处理器，所述处理器用于比对所述深度信息图像与预设深度图像；其中：A processor, the processor is configured to compare the depth information image with a preset depth image; wherein:

在所述深度信息图像与所述预设图像的相似度大于预定值时，所述电子设备解锁。When the similarity between the depth information image and the preset image is greater than a predetermined value, the electronic device is unlocked.
根据权利要求8所述的电子设备，其特征在于，所述显示屏包括：The electronic device according to claim 8, wherein the display screen comprises:

第一基板；First substrate

第二基板，所述第二基板设置在所述第一基板的一侧，所述第二基板上开设有至少一个通孔，所述深度图像获取模组设置在所述通孔中；及A second substrate, the second substrate is disposed on one side of the first substrate, the second substrate is provided with at least one through hole, and the depth image acquisition module is disposed in the through hole; and

连接层，所述连接层用于连接所述第一基板及所述第二基板，所述连接层的折射率与所述通孔内空气的折射率之前的差值在预定范围内。The connection layer is used to connect the first substrate and the second substrate, and the difference between the refractive index of the connection layer and the refractive index of the air in the through hole is within a predetermined range.
一种包含计算机程序的非易失性计算机可读存储介质，其特征在于，所述计算机程序被处理器执行时，使得所述处理器执行控制方法，所述控制方法包括：A non-volatile computer-readable storage medium containing a computer program, wherein when the computer program is executed by a processor, the processor is caused to execute a control method, and the control method includes:

在所述显示屏刷新的同时，所述发射器向所述显示屏方向发射检测信号，所述接收器接收穿过所述显示屏后经待检测物反射后的所述检测信号，以获得所述待检测物的深度信息图像；其中，所述显示屏的刷新频率与所述发射器的投射频率相同。While the display screen is refreshing, the transmitter transmits a detection signal in the direction of the display screen, and the receiver receives the detection signal that is reflected by the object to be detected after passing through the display screen to obtain the detection signal. The depth information image of the object to be detected; wherein the refresh frequency of the display screen is the same as the projection frequency of the transmitter.
根据权利要求16所述的计算机可读存储介质，其特征在于，所述在所述显示屏刷新的同时，所述发射器向所述显示屏方向发射检测信号，所述接收器接收穿过所述显示屏后被待检测物反射回的所述检测信号以获得所述待检测物的深度信息图像包括：The computer-readable storage medium according to claim 16, wherein the transmitter transmits a detection signal in the direction of the display screen while the display screen is refreshed, and the receiver receives The detection signal reflected by the object to be detected after the display screen to obtain the depth information image of the object to be detected includes:

以第一功率朝所述待检测物发射第一检测信号；Transmitting a first detection signal to the object to be detected with a first power;

接收穿过所述显示屏后被所述待检测物反射回的所述第一检测信号以获取所述待检测物与所述电子设备的距离；根据所述距离从预存的距离-功率对应关系中获取第二功率；Receiving the first detection signal that is reflected by the object to be detected after passing through the display screen to obtain the distance between the object to be detected and the electronic device; according to the distance from a pre-stored distance-power correspondence To obtain the second power;

以第二功率朝所述待检测物发射所述第二检测信号；Transmitting the second detection signal to the object to be detected with a second power;

接收穿过所述显示屏后被所述待检测物反射回的所述第二检测信号以获取待检测物的深度信息图像。The second detection signal reflected by the object to be detected after passing through the display screen is received to obtain a depth information image of the object to be detected.
根据权利要求16所述的计算机可读存储介质，其特征在于，所述第一功率小于所述第二功率；或The computer-readable storage medium according to claim 16, wherein the first power is less than the second power; or

所述第二功率等于所述第一功率。The second power is equal to the first power.
根据权利要求17所述的计算机可读存储介质，其特征在于，所述控制方法还包括：The computer-readable storage medium according to claim 17, wherein the control method further comprises:

在发射所述第一检测信号的同时，所述显示屏以第一刷新频率显示图像，所述第一检测信号的投射频率与所述第一刷新频率相同；While transmitting the first detection signal, the display screen displays an image at a first refresh frequency, and the projection frequency of the first detection signal is the same as the first refresh frequency;

在发射所述第二检测信号的同时，所述显示屏以第二刷新频率显示图像，第二检测信号的投射频率与所述第二刷新频率相同，所述第一刷新频率小于所述第二刷新频率。While transmitting the second detection signal, the display screen displays images at a second refresh frequency, the projection frequency of the second detection signal is the same as the second refresh frequency, and the first refresh frequency is less than the second refresh frequency. Refresh frequency.
根据权利要求19所述的计算机可读存储介质，其特征在于，所述第一检测信号的投射频率等于所述第二检测信号的投射频率，且第一检测信号的第一功率小于所述第二检测信号的第二功率。The computer-readable storage medium of claim 19, wherein the projection frequency of the first detection signal is equal to the projection frequency of the second detection signal, and the first power of the first detection signal is less than the first power of the first detection signal. 2. The second power of the detection signal.
根据权利要求17或19所述的计算机可读存储介质，其特征在于，所述控制方法包括：The computer-readable storage medium according to claim 17 or 19, wherein the control method comprises:

获取所述待检测物的二维图像信息；及Acquiring the two-dimensional image information of the object to be detected; and

在所述二维图像信息中存在人脸时，则启动所述深度图像获取模组。When there is a human face in the two-dimensional image information, the depth image acquisition module is activated.
根据权利要求21所述的计算机可读存储介质，其特征在于，所述控制方法包括：The computer-readable storage medium according to claim 21, wherein the control method comprises:

比对所述深度信息图像与预设深度图像；Comparing the depth information image with a preset depth image;

在所述深度信息图像与所述预设图像的相似度大于预定值时，解锁所述电子设备。When the similarity between the depth information image and the preset image is greater than a predetermined value, unlock the electronic device.