WO2019218943A1 - Front dual camera-based security verification method and electronic device - Google Patents

Front dual camera-based security verification method and electronic device Download PDF

Info

Publication number
WO2019218943A1
WO2019218943A1 PCT/CN2019/086433 CN2019086433W WO2019218943A1 WO 2019218943 A1 WO2019218943 A1 WO 2019218943A1 CN 2019086433 W CN2019086433 W CN 2019086433W WO 2019218943 A1 WO2019218943 A1 WO 2019218943A1
Authority
WO
WIPO (PCT)
Prior art keywords
face
user
camera
image
dimensional information
Prior art date
Application number
PCT/CN2019/086433
Other languages
French (fr)
Chinese (zh)
Inventor
武隽
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Publication of WO2019218943A1 publication Critical patent/WO2019218943A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2221/00—Indexing scheme relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F2221/21—Indexing scheme relating to G06F21/00 and subgroups addressing additional information or applications relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F2221/2133—Verifying human interaction, e.g., Captcha

Definitions

  • the present application relates to the field of information processing technologies, and in particular, to a security verification method and an electronic device based on a front dual camera.
  • the present application provides a security verification method and an electronic device based on a front dual camera, which can reduce hardware cost while ensuring security verification of an application.
  • the embodiment of the present application provides a security verification method based on a front dual camera, including:
  • the three-dimensional information is invoked through a preset interface for face security verification.
  • the method further includes:
  • the color image and the infrared image are processed by an image processor to obtain three-dimensional information of the user's face, including:
  • acquiring iris information in the infrared image including:
  • Iris information in the human eye region is extracted.
  • the method further includes:
  • the three-dimensionality of the user's face After acquiring the three-dimensional information of the user's face, encrypting the three-dimensional information of the user's face, and before calling the three-dimensional information through the preset interface for face security verification, the three-dimensionality of the user's face The information is decrypted.
  • the face security verification is in a trusted operating environment TEE.
  • the preset interface is a bus interface that conforms to a preset standard, and includes an MIPI bus interface, an I2C synchronous serial bus interface, and an SPI bus interface.
  • Another embodiment of the present application provides an electronic device having a front dual camera, including a housing and a first camera, a second camera, an image processor, and a controller located in the housing.
  • the first camera is configured to acquire a color image of a user's face
  • the second camera is configured to acquire an infrared image of the user's face
  • the image processor is connected to the first camera and the second camera, respectively, for receiving the color image and the infrared image, and acquiring three-dimensional information of the user's face;
  • the controller is connected to the image processor, and is configured to invoke the three-dimensional information to perform face security verification through a preset interface.
  • controller is further configured to:
  • the image processor is specifically configured to:
  • controller is specifically configured to:
  • Iris information in the human eye region is extracted.
  • controller is further configured to:
  • the three-dimensionality of the user's face After acquiring the three-dimensional information of the user's face, encrypting the three-dimensional information of the user's face, and before calling the three-dimensional information through the preset interface for face security verification, the three-dimensionality of the user's face The information is decrypted.
  • the face security verification is in a trusted operating environment TEE.
  • the preset interface is a bus interface that conforms to a preset standard, and includes an MIPI bus interface, an I2C synchronous serial bus interface, and an SPI bus interface.
  • a further embodiment of the present application provides a non-transitory computer readable storage medium having stored thereon a computer program, which is executed by a processor to implement a front-facing dual camera as described in the first aspect of the present application. Security verification method.
  • FIG. 1 is a flow chart of a method for secure verification based on a front dual camera according to an embodiment of the present application
  • FIG. 3 is a schematic diagram showing the effect of a parallax diagram of a dual camera
  • FIG. 4 is a flowchart of a front dual camera based security verification method according to another embodiment of the present application.
  • FIG. 5 is a schematic diagram showing the effect of cutting a human eye region according to an embodiment of the present application.
  • FIG. 6 is a flowchart of a front dual camera based security verification method according to still another embodiment of the present application.
  • FIG. 7 is a block diagram showing the structure of an electronic device having a front dual camera according to an embodiment of the present application.
  • the use of dual cameras can realize applications such as 3D face recognition, and realize operations such as unlocking the screen.
  • applications with higher security levels such as payment scenarios
  • the security of 3D face recognition cannot meet the payment requirements.
  • the operating system such as the Android system
  • the security verification process mainly implemented at the application level, the operating system (such as the Android system) is also an open source system, and the security is not high. Once the system is hacked, the user's information in the application is stolen.
  • the present application proposes a security verification method based on a front dual camera, which uses the color image and the infrared image respectively acquired by the two cameras to acquire the three-dimensional information of the user's face, and is relatively safe with respect to the planar information of the two-dimensional image. More sexual.
  • the color image and the infrared image are sent to a hardware image processor, and the image processor of the hardware processes the image, directly compared to the application directly It is safer to call the original image.
  • FIG. 1 is a flow chart of a front dual camera based security verification method in accordance with one embodiment of the present application.
  • the method of this embodiment can be performed by a controller of the hardware in conjunction with a corresponding application.
  • the security verification method based on the front dual camera includes:
  • Step S101 Acquire a color image of a user's face through the first camera.
  • a color image of a user's face can be acquired by the first camera.
  • the first camera is an ordinary captured image camera, and color information can be acquired.
  • Step S102 acquiring an infrared image of the user's face through the second camera.
  • an infrared image of a user's face can be acquired by the second camera.
  • the second camera is an infrared camera, and is mainly used to capture an infrared image of a user's face.
  • Step S103 the color image and the infrared image are processed by the image processor to obtain three-dimensional information of the user's face.
  • the color image and the infrared image may be sent to the image processor, and the original image is processed in the image processor of the hardware, and the data is already calculated in the hardware compared to the processing directly sent to the application, the hacker Unable to get raw data and therefore more secure.
  • the image processor is used to extract the first feature of the user's face in the color image, extract the second feature of the user's face in the infrared image, and then determine the relationship between the first feature and the second feature by using the principle of triangulation.
  • the displacement difference of the same feature is then used to establish the three-dimensional information of the user's face according to the displacement difference.
  • the dual camera resolution depth is the same as the human eye's resolution of the depth of the scene, mainly relying on binocular vision to distinguish.
  • the imaged object is drawn, and the positions of the two cameras are OR and OT, and the focal planes of the two cameras.
  • the focal plane is at a distance f from the plane of the two cameras.
  • the two cameras in the plane position are imaged to obtain two captured images.
  • P and P' are the positions of the same object in different captured images, respectively.
  • the distance from the P point to the left boundary of the captured image is XR
  • the distance from the P' point to the left boundary of the captured image is XT.
  • OR and OT are two cameras, respectively, and the two cameras are on the same plane with a distance of B.
  • the distance Z between the object in Figure 2 and the plane of the two cameras has the following relationship:
  • d is the difference in distance between the positions of the same object in different captured images. Since B and f are constant values, the distance Z of the object can be determined according to d.
  • the distance between the objects in the scene and the camera is the same as the first camera and
  • the displacement difference, the posture difference, and the like of the second camera imaging are proportional, and therefore, in one embodiment of the present application, the above-described distance Z can be obtained according to such a proportional relationship.
  • a color image acquired by the first camera and an infrared image acquired by the second camera are used to calculate a map of the same point difference, which is represented by a disparity map, which is represented by two graphs.
  • Step S104 Calling the three-dimensional information through the preset interface to perform face security verification.
  • the preset interface is a bus interface conforming to a preset standard, including a MIPI (Mobile Industry Processor Interface) bus interface, an I2C (Inter-Integrated Circuit) synchronous serial bus interface, and an SPI (Serial Peripheral) Interface (Serial Peripheral Interface) bus interface.
  • MIPI Mobile Industry Processor Interface
  • I2C Inter-Integrated Circuit
  • SPI Serial Peripheral Interface
  • the processed three-dimensional information can be invoked through a preset interface, so that the controller can perform face security verification using the three-dimensional information, such as performing a screen unlocking operation.
  • the above bus interface complies with the security protocol and the face security verification is in the Trusted Execution Environment (TEE)
  • the three-dimensional information can be safely called for security verification.
  • the data information such as the contour and height of the face is calculated.
  • the above data information has been processed in the image processor.
  • the verification is performed, the above data information is simply called, and the feature comparison is performed with the pre-stored data to implement face security verification. For example, if the verification is passed, the screen can be unlocked.
  • the security verification method based on the front dual camera of the embodiment of the present application acquires a color image of the user's face through the first camera, acquires an infrared image of the user's face through the second camera, and uses the image processor to color image and infrared
  • the image is processed to obtain the three-dimensional information of the user's face, and the three-dimensional information is invoked through the preset interface for face security verification, which can improve the security of the face security verification.
  • FIG. 4 is a flow chart of a front dual camera based security verification method in accordance with another embodiment of the present application.
  • the security verification method based on the front dual camera includes:
  • Step S105 acquiring iris information in the infrared image, and calling the iris information for iris security verification.
  • the front dual camera can be used for 3D face recognition and other applications to achieve screen unlocking and other operations.
  • applications with higher security levels such as payment scenarios
  • the security of 3D face recognition cannot meet the payment requirements.
  • you have to make a payment you must front-end an iris recognition module to achieve secure payment through iris verification.
  • the iris recognition module has a narrow viewing angle, and it is not convenient to put the human eye into a designated area for recognition.
  • the dual camera module and the iris recognition module have too many modules and high hardware costs.
  • the second camera is designed to integrate the iris recognition function, and fully utilize the performance of the second camera to meet the requirements of applications with higher security requirements.
  • image recognition of the infrared image may be performed to acquire a human eye region in the infrared image, and then extract iris information in the human eye region. Finally, the iris information is used for iris security verification to implement applications with high security levels such as payment.
  • the resolution of the existing iris recognition image is 2 million pixels (2M), and the field of view angle FOV is 34.6 degrees, which can meet the requirement of 1 million pixel points of a single eye for iris recognition.
  • the resolution of the second camera when acquiring the infrared image is 16 million pixels, and the human eye recognition technology is used to recognize the human eye region, and a relatively small image is cut to meet the needs of the iris recognition. That is, in an infrared image of 16 million pixels (16M) and a viewing angle FOV of 75.6 degrees, a screen of 2 million pixels and a field of view FOV of 34.6 degrees (human eye area) can be cut. The latter can meet the needs of the resolution of iris recognition.
  • the second camera as an integrated iris recognition function
  • the iris is not required to be placed in a designated area, and the operation is more convenient, and the hardware cost is reduced.
  • the design is more beautiful.
  • the security verification method based on the front dual camera may further include the following steps:
  • Step S106 After acquiring the three-dimensional information of the user's face, encrypt the three-dimensional information of the user's face, and decrypt the three-dimensional information of the user's face before calling the three-dimensional information for face security verification through the preset interface.
  • the three-dimensional information of the user's face is obtained by using the image processor, the three-dimensional information can be encrypted to prevent the hacker from cracking the three-dimensional information from the application layer, and the user information is prevented from being stolen. Then, before calling the three-dimensional information for face security verification, the three-dimensional information of the user's face is decrypted. Through this process, security can be further enhanced.
  • the present application also proposes an electronic device having a front dual camera.
  • FIG. 7 is a structural block diagram of an electronic device having a front dual camera according to an embodiment of the present application. As shown in FIG. 7, the device includes a housing 700 and a first camera 710, a second camera 720, and an image located in the housing. Processor 730 and controller 740.
  • the first camera 710 is configured to acquire a color image of a user's face.
  • the second camera 720 is configured to acquire an infrared image of the user's face.
  • the image processor 730 is connected to the first camera 710 and the second camera 720 respectively for receiving color images and infrared images, and acquiring three-dimensional information of the user's face.
  • the image processor 730 can include an image processor ISP and a signal processor DSP.
  • the controller 740 is connected to the image processor 730 for calling the three-dimensional information through the preset interface for face security verification.
  • the electronic device with the front dual camera of the embodiment of the present application acquires the color image of the user's face through the first camera, acquires the infrared image of the user's face through the second camera, and uses the image processor to color image and infrared image.
  • the processing is performed to obtain the three-dimensional information of the user's face, and the three-dimensional information is invoked through the preset interface for face security verification, which can improve the security of the face security verification.
  • the controller 740 can also be used to directly call the infrared image acquired by the second camera, extract the iris information in the infrared image, and call the iris information for iris security verification.
  • the second camera as an integrated iris recognition function, it is not necessary to put the human eye into a designated area during the iris recognition, the operation is more convenient, and the hardware cost is reduced, and the design is more beautiful.
  • the present application further provides a non-transitory computer readable storage medium having stored thereon a computer program, characterized in that the program is executed by the processor to implement the pre-pair based on the first aspect of the embodiment.
  • the camera's security verification method is a non-transitory computer readable storage medium having stored thereon a computer program, characterized in that the program is executed by the processor to implement the pre-pair based on the first aspect of the embodiment.
  • first and second are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated.
  • features defining “first” or “second” may include at least one of the features, either explicitly or implicitly.
  • the meaning of "a plurality” is at least two, such as two, three, etc., unless specifically defined otherwise.
  • a "computer-readable medium” can be any apparatus that can contain, store, communicate, propagate, or transport a program for use in an instruction execution system, apparatus, or device, or in conjunction with the instruction execution system, apparatus, or device.
  • computer readable media include the following: electrical connections (electronic devices) having one or more wires, portable computer disk cartridges (magnetic devices), random access memory (RAM), Read only memory (ROM), erasable editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM).
  • the computer readable medium may even be a paper or other suitable medium on which the program can be printed, as it may be optically scanned, for example by paper or other medium, followed by editing, interpretation or, if appropriate, other suitable The method is processed to obtain the program electronically and then stored in computer memory.
  • portions of the application can be implemented in hardware, software, firmware, or a combination thereof.
  • multiple steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system.
  • a suitable instruction execution system For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques well known in the art: having logic gates for implementing logic functions on data signals. Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.
  • each functional unit in each embodiment of the present application may be integrated into one processing module, or each unit may exist physically separately, or two or more units may be integrated into one module.
  • the above integrated modules can be implemented in the form of hardware or in the form of software functional modules.
  • the integrated modules, if implemented in the form of software functional modules and sold or used as stand-alone products, may also be stored in a computer readable storage medium.
  • the above mentioned storage medium may be a read only memory, a magnetic disk or an optical disk or the like. While the embodiments of the present application have been shown and described above, it is understood that the above-described embodiments are illustrative and are not to be construed as limiting the scope of the present application. The embodiments are subject to variations, modifications, substitutions and variations.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Security & Cryptography (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • Ophthalmology & Optometry (AREA)
  • Collating Specific Patterns (AREA)

Abstract

Disclosed are a front dual camera-based security verification method and an electronic device. The method comprises: obtaining a color image of a user face by means of a first camera; obtaining an infrared image of the user face by means of a second camera; processing the color image and the infrared image by using an image processor so as to obtain three-dimensional information of the user face; and invoking the three-dimensional information by means of a preset interface to perform face security verification. According to the front dual camera-based security verification method and the electronic device in embodiments of the present application, the color image of the user face is obtained by means of the first camera, the infrared image of the user face is obtained by means of the second camera, the color image and the infrared image are processed by using the image processor to obtain the three-dimensional information of the user face, and face security verification is performed by invoking the three-dimensional information by means of the preset interface, so that the security of the face security verification can be increased.

Description

基于前置双摄像头的安全验证方法及电子设备Safety verification method based on front dual camera and electronic device
相关申请的交叉引用Cross-reference to related applications
本申请要求OPPO广东移动通信有限公司于2018年05月15日提交的、发明名称为“基于前置双摄像头的安全验证方法及电子设备”、中国专利申请号为“201810462093.8”的优先权。This application claims the priority of the invention titled "Safety Verification Method Based on Front Dual Camera and Electronic Equipment" and the Chinese Patent Application No. "201810462093.8" submitted by OPPO Guangdong Mobile Communications Co., Ltd. on May 15, 2018.
技术领域Technical field
本申请涉及信息处理技术领域，尤其涉及一种基于前置双摄像头的安全验证方法及电子设备。The present application relates to the field of information processing technologies, and in particular, to a security verification method and an electronic device based on a front dual camera.
背景技术Background technique
随着科技的不断进步，具有前置双摄像头的手机越来越多。使用前置双摄像头，可以方便喜欢自拍的用户，得到虚化效果更好的自拍相片。同时，利用双摄像头还可以实现3D人脸识别等应用，实现屏幕解锁等操作。但是，对于安全级别要求更高的应用，如支付场景，3D人脸识别的安全性便无法满足支付需求。如果一定要做支付，那么就必须要前置一个虹膜识别模组，通过虹膜验证来实现安全支付。但是，虹膜识别模组拍摄的视角比较窄，需要将人眼放入指定的区域才能进行识别，不够方便。并且，双摄像头模组加虹膜识别模组，模组数量过多，占用前面板的位置，硬件成本高，不够美观。With the continuous advancement of technology, more and more mobile phones with front dual cameras. With the front dual camera, you can easily enjoy self-portraits and get self-portrait photos with better blur effect. At the same time, the use of dual cameras can also achieve 3D face recognition and other applications, to achieve screen unlocking and other operations. However, for applications with higher security levels, such as payment scenarios, the security of 3D face recognition cannot meet the payment requirements. If you have to make a payment, you must front-end an iris recognition module to achieve secure payment through iris verification. However, the iris recognition module has a narrow viewing angle, and it is not convenient to put the human eye into a designated area for recognition. Moreover, the dual camera module and the iris recognition module have too many modules, occupying the position of the front panel, high hardware cost, and being not aesthetically pleasing.
申请内容Application content
本申请提供一种基于前置双摄像头的安全验证方法及电子设备，能够降低硬件成本，同时保证应用的安全验证。The present application provides a security verification method and an electronic device based on a front dual camera, which can reduce hardware cost while ensuring security verification of an application.
本申请实施例提供一种基于前置双摄像头的安全验证方法，包括：The embodiment of the present application provides a security verification method based on a front dual camera, including:
通过第一摄像头获取用户人脸的彩色图像；Obtaining a color image of the user's face through the first camera;
通过第二摄像头获取所述用户人脸的红外图像；Acquiring an infrared image of the user's face through the second camera;
利用图像处理器对所述彩色图像和所述红外图像进行处理，以获取所述用户人脸的三维信息；Processing the color image and the infrared image by using an image processor to obtain three-dimensional information of the user's face;
通过预设接口调用所述三维信息进行人脸安全验证。The three-dimensional information is invoked through a preset interface for face security verification.
可选的，方法还包括：Optionally, the method further includes:
获取所述红外图像中的虹膜信息，并调用所述虹膜信息进行虹膜安全验证。Obtaining iris information in the infrared image and invoking the iris information for iris security verification.
可选的，利用图像处理器对所述彩色图像和所述红外图像进行处理，以获取所述用户人脸的三维信息，包括：Optionally, the color image and the infrared image are processed by an image processor to obtain three-dimensional information of the user's face, including:
提取所述彩色图像中的用户人脸的第一特征；Extracting a first feature of a user's face in the color image;
提取所述红外图像中的用户人脸的第二特征；Extracting a second feature of the user's face in the infrared image;
利用三角测距原理确定所述第一特征与所述第二特征之间的相同特征的位移差；Determining a displacement difference of the same feature between the first feature and the second feature by using a triangulation principle;
根据所述位移差建立所述用户人脸的三维信息。And establishing three-dimensional information of the user's face according to the displacement difference.
可选的，获取所述红外图像中的虹膜信息，包括：Optionally, acquiring iris information in the infrared image, including:
对所述红外图像进行图像识别，以获取所述红外图像中的人眼区域；Performing image recognition on the infrared image to obtain a human eye region in the infrared image;
提取所述人眼区域中的虹膜信息。Iris information in the human eye region is extracted.
可选的，所述方法还包括：Optionally, the method further includes:
在获取所述用户人脸的三维信息之后，对所述用户人脸的三维信息进行加密，并在通过预设接口调用所述三维信息进行人脸安全验证之前，对所述用户人脸的三维信息进行解密。After acquiring the three-dimensional information of the user's face, encrypting the three-dimensional information of the user's face, and before calling the three-dimensional information through the preset interface for face security verification, the three-dimensionality of the user's face The information is decrypted.
可选的，所述人脸安全验证处于可信运行环境TEE下。Optionally, the face security verification is in a trusted operating environment TEE.
可选的，所述预设接口为符合预设标准的总线接口，包括MIPI总线接口、I2C同步串行总线接口、SPI总线接口。Optionally, the preset interface is a bus interface that conforms to a preset standard, and includes an MIPI bus interface, an I2C synchronous serial bus interface, and an SPI bus interface.
本申请另一实施例提供一种具有前置双摄像头的电子设备，包括壳体和位于壳体内的第一摄像头、第二摄像头、图像处理器和控制器，Another embodiment of the present application provides an electronic device having a front dual camera, including a housing and a first camera, a second camera, an image processor, and a controller located in the housing.
其中，所述第一摄像头，用于获取用户人脸的彩色图像；The first camera is configured to acquire a color image of a user's face;
所述第二摄像头，用于获取所述用户人脸的红外图像；The second camera is configured to acquire an infrared image of the user's face;
所述图像处理器，分别与所述第一摄像头和所述第二摄像头连接，用于接收所述彩色图像和所述红外图像，并获取所述用户人脸的三维信息；The image processor is connected to the first camera and the second camera, respectively, for receiving the color image and the infrared image, and acquiring three-dimensional information of the user's face;
所述控制器，与所述图像处理器相连，用于通过预设接口调用所述三维信息进行人脸安全验证。The controller is connected to the image processor, and is configured to invoke the three-dimensional information to perform face security verification through a preset interface.
可选的，所述控制器，还用于：Optionally, the controller is further configured to:
直接调用所述第二摄像头获取的所述红外图像，提取所述红外图像中的虹膜信息，并调用所述虹膜信息进行虹膜安全验证。Directly calling the infrared image acquired by the second camera, extracting iris information in the infrared image, and calling the iris information to perform iris security verification.
可选的，所述图像处理器，具体用于：Optionally, the image processor is specifically configured to:
提取所述彩色图像中的用户人脸的第一特征；Extracting a first feature of a user's face in the color image;
提取所述红外图像中的用户人脸的第二特征；Extracting a second feature of the user's face in the infrared image;
利用三角测距原理确定所述第一特征与所述第二特征之间的相同特征的位移差；Determining a displacement difference of the same feature between the first feature and the second feature by using a triangulation principle;
根据所述位移差建立所述用户人脸的三维信息。And establishing three-dimensional information of the user's face according to the displacement difference.
可选的，所述控制器，具体用于：Optionally, the controller is specifically configured to:
对所述红外图像进行图像识别，以获取所述红外图像中的人眼区域；Performing image recognition on the infrared image to obtain a human eye region in the infrared image;
提取所述人眼区域中的虹膜信息。Iris information in the human eye region is extracted.
可选的，所述控制器，还用于：Optionally, the controller is further configured to:
在获取所述用户人脸的三维信息之后，对所述用户人脸的三维信息进行加密，并在通过预设接口调用所述三维信息进行人脸安全验证之前，对所述用户人脸的三维信息进行解密。After acquiring the three-dimensional information of the user's face, encrypting the three-dimensional information of the user's face, and before calling the three-dimensional information through the preset interface for face security verification, the three-dimensionality of the user's face The information is decrypted.
可选的，所述人脸安全验证处于可信运行环境TEE下。Optionally, the face security verification is in a trusted operating environment TEE.
可选的，所述预设接口为符合预设标准的总线接口，包括MIPI总线接口、I2C同步串行总线接口、SPI总线接口。Optionally, the preset interface is a bus interface that conforms to a preset standard, and includes an MIPI bus interface, an I2C synchronous serial bus interface, and an SPI bus interface.
本申请又一实施例提供一种非临时性计算机可读存储介质，其上存储有计算机程序，该计算机程序被处理器执行时实现如本申请第一方面实施例所述的基于前置双摄像头的安全验证方法。A further embodiment of the present application provides a non-transitory computer readable storage medium having stored thereon a computer program, which is executed by a processor to implement a front-facing dual camera as described in the first aspect of the present application. Security verification method.
本申请实施例提供的技术方案可以包括以下有益效果：The technical solutions provided by the embodiments of the present application may include the following beneficial effects:
通过第一摄像头获取用户人脸的彩色图像，并通过第二摄像头获取所述用户人脸的红外图像，以及利用图像处理器对所述彩色图像和所述红外图像进行处理，以获取所述用户人脸的三维信息，并通过预设接口调用所述三维信息进行人脸安全验证，可以提高人脸安全验证的安全性。Acquiring a color image of the user's face through the first camera, acquiring an infrared image of the user's face through the second camera, and processing the color image and the infrared image by using an image processor to obtain the user The three-dimensional information of the face and the call of the three-dimensional information through the preset interface for face security verification can improve the security of the face security verification.
本申请附加的方面和优点将在下面的描述中部分给出，部分将从下面的描述中变得明显，或通过本申请的实践了解到。The aspects and advantages of the present invention will be set forth in part in the description which follows.
附图说明DRAWINGS
本申请上述的和/或附加的方面和优点从下面结合附图对实施例的描述中将变得明显和容易理解，其中，The above and/or additional aspects and advantages of the present invention will become apparent and readily understood from
图1是根据本申请一个实施例的基于前置双摄像头的安全验证方法的流程图；1 is a flow chart of a method for secure verification based on a front dual camera according to an embodiment of the present application;
图2为三角测距原理的效果示意图；2 is a schematic diagram of the effect of the principle of triangulation;
图3为双摄像头的视差图的效果示意图；3 is a schematic diagram showing the effect of a parallax diagram of a dual camera;
图4是根据本申请另一个实施例的基于前置双摄像头的安全验证方法的流程图；4 is a flowchart of a front dual camera based security verification method according to another embodiment of the present application;
图5是根据本申请一个实施例的裁切人眼区域的效果示意图；FIG. 5 is a schematic diagram showing the effect of cutting a human eye region according to an embodiment of the present application; FIG.
图6是根据本申请又一个实施例的基于前置双摄像头的安全验证方法的流程图；6 is a flowchart of a front dual camera based security verification method according to still another embodiment of the present application;
图7是根据本申请一个实施例的具有前置双摄像头的电子设备的结构框图。7 is a block diagram showing the structure of an electronic device having a front dual camera according to an embodiment of the present application.
具体实施方式Detailed ways
下面详细描述本申请的实施例，所述实施例的示例在附图中示出，其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施例是示例性的，旨在用于解释本申请，而不能理解为对本申请的限制。The embodiments of the present application are described in detail below, and the examples of the embodiments are illustrated in the drawings, wherein the same or similar reference numerals are used to refer to the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are intended to be illustrative, and are not to be construed as limiting.
下面参考附图描述本申请实施例的基于前置双摄像头的安全验证方法及电子设备。A front-end dual camera-based security verification method and an electronic device according to an embodiment of the present application are described below with reference to the accompanying drawings.
目前，具有前置双摄像头的手机越来越多，利用双摄像头可以实现3D人脸识别等应用，实现屏幕解锁等操作。但是，对于安全级别要求更高的应用，如支付场景，3D人脸识别的安全性便无法满足支付需求。并且，在安全验证过程中，主要在应用层面实现，操作***(如Android***)也是开源的***，安全性不高，一旦***被黑客入侵，应用程序中用户的信息存在被盗的风险。At present, there are more and more mobile phones with front dual cameras, and the use of dual cameras can realize applications such as 3D face recognition, and realize operations such as unlocking the screen. However, for applications with higher security levels, such as payment scenarios, the security of 3D face recognition cannot meet the payment requirements. Moreover, in the security verification process, mainly implemented at the application level, the operating system (such as the Android system) is also an open source system, and the security is not high. Once the system is hacked, the user's information in the application is stolen.
为此，本申请提出一种基于前置双摄像头的安全验证方法，利用两个摄像头分别获取的彩色图像和红外图像，获取到用户人脸的三维信息，相对于二维图像的平面信息，安全性更高。并且，在应用程序进行人脸安全验证之前，先将彩色图像和红外图像发送至一个硬件的图像处理器中，由该硬件的图像处理器来对图像进行处理，相比于直接由应用程序直接调用原始图像，更加安全。To this end, the present application proposes a security verification method based on a front dual camera, which uses the color image and the infrared image respectively acquired by the two cameras to acquire the three-dimensional information of the user's face, and is relatively safe with respect to the planar information of the two-dimensional image. More sexual. Moreover, before the application performs face security verification, the color image and the infrared image are sent to a hardware image processor, and the image processor of the hardware processes the image, directly compared to the application directly It is safer to call the original image.
图1是根据本申请一个实施例的基于前置双摄像头的安全验证方法的流程图。1 is a flow chart of a front dual camera based security verification method in accordance with one embodiment of the present application.
本实施例的方法可以由硬件的控制器配合相应的应用程序来执行。The method of this embodiment can be performed by a controller of the hardware in conjunction with a corresponding application.
如图1所示，该基于前置双摄像头的安全验证方法包括：As shown in FIG. 1, the security verification method based on the front dual camera includes:
步骤S101，通过第一摄像头获取用户人脸的彩色图像。Step S101: Acquire a color image of a user's face through the first camera.
在本申请的一个实施例中，可通过第一摄像头获取用户人脸的彩色图像。其中，第一摄像头为普通的拍摄图像摄像头，可以获取彩色信息。In one embodiment of the present application, a color image of a user's face can be acquired by the first camera. Wherein, the first camera is an ordinary captured image camera, and color information can be acquired.
步骤S102，通过第二摄像头获取用户人脸的红外图像。Step S102, acquiring an infrared image of the user's face through the second camera.
在本申请的一个实施例中，可通过第二摄像头获取用户人脸的红外图像。In an embodiment of the present application, an infrared image of a user's face can be acquired by the second camera.
其中，第二摄像头为红外摄像头，主要用于捕获用户人脸的红外图像。The second camera is an infrared camera, and is mainly used to capture an infrared image of a user's face.
步骤S103，利用图像处理器对彩色图像和红外图像进行处理，以获取用户人脸的三维信息。Step S103, the color image and the infrared image are processed by the image processor to obtain three-dimensional information of the user's face.
为了提高安全性，可将彩色图像和红外图像发送至图像处理器，在硬件的图像处理器中对上述原始图像进行处理，相比于直接发送给应用程序处理，数据已经在硬件中运算，黑客无法获取原始的数据，因此更加安全。In order to improve security, the color image and the infrared image may be sent to the image processor, and the original image is processed in the image processor of the hardware, and the data is already calculated in the hardware compared to the processing directly sent to the application, the hacker Unable to get raw data and therefore more secure.
具体地，可利用图像处理器提取彩色图像中的用户人脸的第一特征，提取红外图像中的用户人脸的第二特征，再利用三角测距原理确定第一特征与第二特征之间的相同特征的位移差，然后根据位移差建立用户人脸的三维信息。Specifically, the image processor is used to extract the first feature of the user's face in the color image, extract the second feature of the user's face in the infrared image, and then determine the relationship between the first feature and the second feature by using the principle of triangulation. The displacement difference of the same feature is then used to establish the three-dimensional information of the user's face according to the displacement difference.
下面简单介绍一下三角测距原理：The following briefly introduces the principle of triangulation:
在实际场景中，双摄像头分辨深度与人眼分辨景物的深度的原理相同，主要是依靠双目视觉分辨出。如图2所示，在实际空间中，画出了成像对象，以及两个摄像头所在位置OR和OT，以及两个摄像头的焦平面，焦平面距离两个摄像头所在平面的距离为f，在焦平面位置两个摄像头进行成像，从而得到两张拍摄图像。In the actual scene, the dual camera resolution depth is the same as the human eye's resolution of the depth of the scene, mainly relying on binocular vision to distinguish. As shown in Figure 2, in the actual space, the imaged object is drawn, and the positions of the two cameras are OR and OT, and the focal planes of the two cameras. The focal plane is at a distance f from the plane of the two cameras. The two cameras in the plane position are imaged to obtain two captured images.
P和P’分别是同一对象在不同拍摄图像中的位置。其中，P点距离所在拍摄图像的左侧边界的距离为XR，P’点距离所在拍摄图像的左侧边界的距离为XT。OR和OT分别为两个摄像头，这两个摄像头在同一平面，距离为B。P and P' are the positions of the same object in different captured images, respectively. The distance from the P point to the left boundary of the captured image is XR, and the distance from the P' point to the left boundary of the captured image is XT. OR and OT are two cameras, respectively, and the two cameras are on the same plane with a distance of B.
基于三角测距原理，图2中的对象与两个摄像头所在平面之间的距离Z，具有如下关系：Based on the principle of triangulation, the distance Z between the object in Figure 2 and the plane of the two cameras has the following relationship:
Figure PCTCN2019086433-appb-000001
Figure PCTCN2019086433-appb-000001
基于此，可以推得
Figure PCTCN2019086433-appb-000002
其中，d为同一对象在不同拍摄图像中的位置之间的距离差。由于B、f为定值，因此，根据d可以确定出对象的距离Z。 Based on this, you can push
Figure PCTCN2019086433-appb-000002
Where d is the difference in distance between the positions of the same object in different captured images. Since B and f are constant values, the distance Z of the object can be determined according to d.
当然，除了三角测距法，也可以采用其他的方式来计算图像的深度信息，比如，第一摄像头和第二摄像头针对同一个场景拍照时，场景中的物体距离摄像头的距离与第一摄像头和第二摄像头成像的位移差、姿势差等成比例关系，因此，在本申请的一个实施例中，可以根据这种比例关系获取上述距离Z。Of course, in addition to the triangulation method, other methods may be used to calculate the depth information of the image. For example, when the first camera and the second camera take photos for the same scene, the distance between the objects in the scene and the camera is the same as the first camera and The displacement difference, the posture difference, and the like of the second camera imaging are proportional, and therefore, in one embodiment of the present application, the above-described distance Z can be obtained according to such a proportional relationship.
举例而言，如图3所示，通过第一摄像头获取的彩色图像以及第二摄像头获取的红外图像，计算出相同点差异的图，这里用视差图表示，这个图上表示的是两张图上相同点的位移差异，但是由于三角定位中的位移差异和Z成正比，因此很多时候视差图就直接被用作携带深度信息的景深图。For example, as shown in FIG. 3, a color image acquired by the first camera and an infrared image acquired by the second camera are used to calculate a map of the same point difference, which is represented by a disparity map, which is represented by two graphs. The difference in displacement at the same point, but since the displacement difference in the triangulation is proportional to Z, many times the disparity map is directly used as the depth map carrying the depth information.
基于以上分析可知，双摄像头获取用户人脸的三维信息时，需要获取用户人脸在不同图像中的位置，因此，如果用于获取三维信息的两张图像较为接近，则会提高三维信息获取的效率和准确率。Based on the above analysis, when the dual camera acquires the three-dimensional information of the user's face, it is necessary to acquire the position of the user's face in different images. Therefore, if the two images used to acquire the three-dimensional information are relatively close, the three-dimensional information acquisition is improved. Efficiency and accuracy.
步骤S104，通过预设接口调用三维信息进行人脸安全验证。Step S104: Calling the three-dimensional information through the preset interface to perform face security verification.
其中，预设接口为符合预设标准的总线接口，包括MIPI(移动产业处理器接口，Mobile Industry Processor Interface)总线接口、I2C(Inter－Integrated Circuit)同步串行总线接口、SPI(串行外设接口，Serial Peripheral Interface)总线接口。The preset interface is a bus interface conforming to a preset standard, including a MIPI (Mobile Industry Processor Interface) bus interface, an I2C (Inter-Integrated Circuit) synchronous serial bus interface, and an SPI (Serial Peripheral) Interface (Serial Peripheral Interface) bus interface.
在本申请的一个实施例中，可通过预设接口调用处理得到的三维信息，从而使得控制器可以利用三维信息进行人脸安全验证，如进行屏幕解锁操作。由于上述总线接口符合安 全协议，且人脸安全验证时处于可信运行环境(TEE，Trust Execution Environment)下，因此可安全地调用三维信息，从而进行安全验证。例如：基于人脸的三维信息，计算得到人脸的轮廓、高度等数据信息。上述数据信息已经在图像处理器中处理，验证时只需调用上述数据信息，与预存的数据进行特征比对，即可实现人脸安全验证。例如：如果验证通过，便可以实现屏幕解锁。In an embodiment of the present application, the processed three-dimensional information can be invoked through a preset interface, so that the controller can perform face security verification using the three-dimensional information, such as performing a screen unlocking operation. Since the above bus interface complies with the security protocol and the face security verification is in the Trusted Execution Environment (TEE), the three-dimensional information can be safely called for security verification. For example, based on the three-dimensional information of the face, the data information such as the contour and height of the face is calculated. The above data information has been processed in the image processor. When the verification is performed, the above data information is simply called, and the feature comparison is performed with the pre-stored data to implement face security verification. For example, if the verification is passed, the screen can be unlocked.
本申请实施例的基于前置双摄像头的安全验证方法，通过第一摄像头获取用户人脸的彩色图像，并通过第二摄像头获取用户人脸的红外图像，以及利用图像处理器对彩色图像和红外图像进行处理，以获取用户人脸的三维信息，并通过预设接口调用三维信息进行人脸安全验证，可以提高人脸安全验证的安全性。The security verification method based on the front dual camera of the embodiment of the present application acquires a color image of the user's face through the first camera, acquires an infrared image of the user's face through the second camera, and uses the image processor to color image and infrared The image is processed to obtain the three-dimensional information of the user's face, and the three-dimensional information is invoked through the preset interface for face security verification, which can improve the security of the face security verification.
图4是根据本申请另一个实施例的基于前置双摄像头的安全验证方法的流程图。4 is a flow chart of a front dual camera based security verification method in accordance with another embodiment of the present application.
如图4所示，基于前置双摄像头的安全验证方法包括：As shown in FIG. 4, the security verification method based on the front dual camera includes:
步骤S105，获取红外图像中的虹膜信息，并调用虹膜信息进行虹膜安全验证。Step S105, acquiring iris information in the infrared image, and calling the iris information for iris security verification.
目前，利用前置双摄像头可以实现3D人脸识别等应用，实现屏幕解锁等操作。但是，对于安全级别要求更高的应用，如支付场景，3D人脸识别的安全性便无法满足支付需求。如果一定要做支付，那么就必须要前置一个虹膜识别模组，通过虹膜验证来实现安全支付。但是，虹膜识别模组拍摄的视角比较窄，需要将人眼放入指定的区域才能进行识别，不够方便。而且双摄像头模组加虹膜识别模组，设置的模组数量过多，硬件成本高。为此，本实施例将第二摄像头设计为集成虹膜识别功能，充分发挥第二摄像头的性能，满足安全级别要求更高的应用的需求。At present, the front dual camera can be used for 3D face recognition and other applications to achieve screen unlocking and other operations. However, for applications with higher security levels, such as payment scenarios, the security of 3D face recognition cannot meet the payment requirements. If you have to make a payment, you must front-end an iris recognition module to achieve secure payment through iris verification. However, the iris recognition module has a narrow viewing angle, and it is not convenient to put the human eye into a designated area for recognition. Moreover, the dual camera module and the iris recognition module have too many modules and high hardware costs. To this end, the second camera is designed to integrate the iris recognition function, and fully utilize the performance of the second camera to meet the requirements of applications with higher security requirements.
具体地，可对红外图像进行图像识别，以获取红外图像中的人眼区域，然后提取人眼区域中的虹膜信息。最终，利用该虹膜信息进行虹膜安全验证，实现诸如支付等安全级别要求高的应用。Specifically, image recognition of the infrared image may be performed to acquire a human eye region in the infrared image, and then extract iris information in the human eye region. Finally, the iris information is used for iris security verification to implement applications with high security levels such as payment.
举例来说，现有的虹膜辨识用的图像的分辨率为200万像素(2M)，视场角FOV为34.6度，这样可以满足虹膜识别的单眼100万个像素点的要求。如图5所示，第二摄像头获取红外图像时的分辨率为1600万像素，通过人眼识别技术，识别出人眼区域，裁切出一个相对较小的画面，来满足虹膜识别的需求，即可以在1600万像素(16M)、视场角FOV为75.6度的红外图像中，裁切出200万像素，视场角FOV为34.6度的画面(人眼区域)。后者可以满足虹膜识别的分辨率的需求。For example, the resolution of the existing iris recognition image is 2 million pixels (2M), and the field of view angle FOV is 34.6 degrees, which can meet the requirement of 1 million pixel points of a single eye for iris recognition. As shown in FIG. 5, the resolution of the second camera when acquiring the infrared image is 16 million pixels, and the human eye recognition technology is used to recognize the human eye region, and a relatively small image is cut to meet the needs of the iris recognition. That is, in an infrared image of 16 million pixels (16M) and a viewing angle FOV of 75.6 degrees, a screen of 2 million pixels and a field of view FOV of 34.6 degrees (human eye area) can be cut. The latter can meet the needs of the resolution of iris recognition.
本申请实施例的基于前置双摄像头的安全验证方法，通过将第二摄像头设计为集成虹膜识别功能，在虹膜识别时，无需将人眼放入指定的区域，操作更加方便，同时降低硬件成本，设计更美观。In the security verification method based on the front dual camera of the embodiment of the present application, by designing the second camera as an integrated iris recognition function, the iris is not required to be placed in a designated area, and the operation is more convenient, and the hardware cost is reduced. The design is more beautiful.
在本申请的又一个实施例中，如图6所示，基于前置双摄像头的安全验证方法，还可包括以下步骤：In still another embodiment of the present application, as shown in FIG. 6, the security verification method based on the front dual camera may further include the following steps:
步骤S106，在获取用户人脸的三维信息之后，对用户人脸的三维信息进行加密，并在通过预设接口调用三维信息进行人脸安全验证之前，对用户人脸的三维信息进行解密。Step S106: After acquiring the three-dimensional information of the user's face, encrypt the three-dimensional information of the user's face, and decrypt the three-dimensional information of the user's face before calling the three-dimensional information for face security verification through the preset interface.
也就是说，在利用图像处理器获取用户人脸的三维信息之后，可以对该三维信息进行加密操作，防止黑客从应用层破解三维信息，避免用户信息被盗。然后，在调用三维信息进行人脸安全验证之前，再对用户人脸的三维信息进行解密。通过该过程，可以进一步增强安全性。That is to say, after the three-dimensional information of the user's face is obtained by using the image processor, the three-dimensional information can be encrypted to prevent the hacker from cracking the three-dimensional information from the application layer, and the user information is prevented from being stolen. Then, before calling the three-dimensional information for face security verification, the three-dimensional information of the user's face is decrypted. Through this process, security can be further enhanced.
为了实现上述实施例，本申请还提出了一种具有前置双摄像头的电子设备。In order to implement the above embodiments, the present application also proposes an electronic device having a front dual camera.
图7是根据本申请一个实施例的具有前置双摄像头的电子设备的结构框图，如图7所示，该装置包括壳体700和位于壳体内的第一摄像头710、第二摄像头720、图像处理器730和控制器740。7 is a structural block diagram of an electronic device having a front dual camera according to an embodiment of the present application. As shown in FIG. 7, the device includes a housing 700 and a first camera 710, a second camera 720, and an image located in the housing. Processor 730 and controller 740.
其中，第一摄像头710，用于获取用户人脸的彩色图像。The first camera 710 is configured to acquire a color image of a user's face.
第二摄像头720，用于获取用户人脸的红外图像。The second camera 720 is configured to acquire an infrared image of the user's face.
图像处理器730，分别与第一摄像头710和第二摄像头720连接，用于接收彩色图像和红外图像，并获取用户人脸的三维信息。其中，图像处理器730可包括影像处理器ISP，信号处理器DSP。The image processor 730 is connected to the first camera 710 and the second camera 720 respectively for receiving color images and infrared images, and acquiring three-dimensional information of the user's face. The image processor 730 can include an image processor ISP and a signal processor DSP.
控制器740，与图像处理器730相连，用于通过预设接口调用三维信息进行人脸安全验证。The controller 740 is connected to the image processor 730 for calling the three-dimensional information through the preset interface for face security verification.
需要说明的是，前述对基于前置双摄像头的安全验证方法的解释说明，也适用于本申请实施例的具有前置双摄像头的电子设备，本申请实施例中未公布的细节，在此不再赘述。It should be noted that the foregoing description of the security verification method based on the front dual camera is also applicable to the electronic device with the front dual camera in the embodiment of the present application. The details not disclosed in the embodiment of the present application are not Let me repeat.
本申请实施例的具有前置双摄像头的电子设备，通过第一摄像头获取用户人脸的彩色图像，并通过第二摄像头获取用户人脸的红外图像，以及利用图像处理器对彩色图像和红外图像进行处理，以获取用户人脸的三维信息，并通过预设接口调用三维信息进行人脸安全验证，可以提高人脸安全验证的安全性。The electronic device with the front dual camera of the embodiment of the present application acquires the color image of the user's face through the first camera, acquires the infrared image of the user's face through the second camera, and uses the image processor to color image and infrared image. The processing is performed to obtain the three-dimensional information of the user's face, and the three-dimensional information is invoked through the preset interface for face security verification, which can improve the security of the face security verification.
此外，控制器740还可用于直接调用第二摄像头获取的红外图像，提取红外图像中的虹膜信息，并调用虹膜信息进行虹膜安全验证。通过将第二摄像头设计为集成虹膜识别功能，在虹膜识别时，无需将人眼放入指定的区域，操作更加方便，同时降低硬件成本，设计更美观。In addition, the controller 740 can also be used to directly call the infrared image acquired by the second camera, extract the iris information in the infrared image, and call the iris information for iris security verification. By designing the second camera as an integrated iris recognition function, it is not necessary to put the human eye into a designated area during the iris recognition, the operation is more convenient, and the hardware cost is reduced, and the design is more beautiful.
为实现上述实施例，本申请还提出一种非临时性计算机可读存储介质，其上存储有计 算机程序，其特征在于，该程序被处理器执行时实现第一方面实施例的基于前置双摄像头的安全验证方法。In order to implement the above embodiments, the present application further provides a non-transitory computer readable storage medium having stored thereon a computer program, characterized in that the program is executed by the processor to implement the pre-pair based on the first aspect of the embodiment. The camera's security verification method.
在本说明书的描述中，参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本申请的至少一个实施例或示例中。在本说明书中，对上述术语的示意性表述不必须针对的是相同的实施例或示例。而且，描述的具体特征、结构、材料或者特点可以在任一个或多个实施例或示例中以合适的方式结合。此外，在不相互矛盾的情况下，本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。In the description of the present specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" and the like means a specific feature described in connection with the embodiment or example. A structure, material or feature is included in at least one embodiment or example of the application. In the present specification, the schematic representation of the above terms is not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any one or more embodiments or examples. In addition, various embodiments or examples described in the specification, as well as features of various embodiments or examples, may be combined and combined.
此外，术语“第一”、“第二”仅用于描述目的，而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此，限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个该特征。在本申请的描述中，“多个”的含义是至少两个，例如两个，三个等，除非另有明确具体的限定。Moreover, the terms "first" and "second" are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, features defining "first" or "second" may include at least one of the features, either explicitly or implicitly. In the description of the present application, the meaning of "a plurality" is at least two, such as two, three, etc., unless specifically defined otherwise.
流程图中或在此以其他方式描述的任何过程或方法描述可以被理解为，表示包括一个或更多个用于实现特定逻辑功能或过程的步骤的可执行指令的代码的模块、片段或部分，并且本申请的优选实施方式的范围包括另外的实现，其中可以不按所示出或讨论的顺序，包括根据所涉及的功能按基本同时的方式或按相反的顺序，来执行功能，这应被本申请的实施例所属技术领域的技术人员所理解。Any process or method description in the flowcharts or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a particular logical function or process. And the scope of the preferred embodiments of the present application includes additional implementations, in which the functions may be performed in a substantially simultaneous manner or in the reverse order depending on the functions involved, in accordance with the illustrated or discussed order. It will be understood by those skilled in the art to which the embodiments of the present application pertain.
在流程图中表示或在此以其他方式描述的逻辑和/或步骤，例如，可以被认为是用于实现逻辑功能的可执行指令的定序列表，可以具体实现在任何计算机可读介质中，以供指令执行***、装置或设备(如基于计算机的***、包括处理器的***或其他可以从指令执行***、装置或设备取指令并执行指令的***)使用，或结合这些指令执行***、装置或设备而使用。就本说明书而言，"计算机可读介质"可以是任何可以包含、存储、通信、传播或传输程序以供指令执行***、装置或设备或结合这些指令执行***、装置或设备而使用的装置。计算机可读介质的更具体的示例(非穷尽性列表)包括以下：具有一个或多个布线的电连接部(电子装置)，便携式计算机盘盒(磁装置)，随机存取存储器(RAM)，只读存储器(ROM)，可擦除可编辑只读存储器(EPROM或闪速存储器)，光纤装置，以及便携式光盘只读存储器(CDROM)。另外，计算机可读介质甚至可以是可在其上打印所述程序的纸或其他合适的介质，因为可以例如通过对纸或其他介质进行光学扫描，接着进行编辑、解译或必要时以其他合适方式进行处理来以电子方式获得所述程序，然后将其存储在计算机存储器中。The logic and/or steps represented in the flowchart or otherwise described herein, for example, may be considered as an ordered list of executable instructions for implementing logical functions, and may be embodied in any computer readable medium, Used in conjunction with, or in conjunction with, an instruction execution system, apparatus, or device (eg, a computer-based system, a system including a processor, or other system that can fetch instructions and execute instructions from an instruction execution system, apparatus, or device) Or use with equipment. For the purposes of this specification, a "computer-readable medium" can be any apparatus that can contain, store, communicate, propagate, or transport a program for use in an instruction execution system, apparatus, or device, or in conjunction with the instruction execution system, apparatus, or device. More specific examples (non-exhaustive list) of computer readable media include the following: electrical connections (electronic devices) having one or more wires, portable computer disk cartridges (magnetic devices), random access memory (RAM), Read only memory (ROM), erasable editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM). In addition, the computer readable medium may even be a paper or other suitable medium on which the program can be printed, as it may be optically scanned, for example by paper or other medium, followed by editing, interpretation or, if appropriate, other suitable The method is processed to obtain the program electronically and then stored in computer memory.
应当理解，本申请的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中，多个步骤或方法可以用存储在存储器中且由合适的指令执行***执行的软件或固件来实现。例如，如果用硬件来实现，和在另一实施方式中一样，可用本领域公知的下列技术中的任一项或他们的组合来实现：具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路，具有合适的组合逻辑门电路的专用集成电路，可编程门阵列(PGA)，现场可编程门阵列(FPGA)等。It should be understood that portions of the application can be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, multiple steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques well known in the art: having logic gates for implementing logic functions on data signals. Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.
本技术领域的普通技术人员可以理解实现上述实施例方法携带的全部或部分步骤是可以通过程序来指令相关的硬件完成，所述的程序可以存储于一种计算机可读存储介质中，该程序在执行时，包括方法实施例的步骤之一或其组合。One of ordinary skill in the art can understand that all or part of the steps carried by the method of implementing the above embodiments can be completed by a program to instruct related hardware, and the program can be stored in a computer readable storage medium. When executed, one or a combination of the steps of the method embodiments is included.
此外，在本申请各个实施例中的各功能单元可以集成在一个处理模块中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个模块中。上述集成的模块既可以采用硬件的形式实现，也可以采用软件功能模块的形式实现。所述集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时，也可以存储在一个计算机可读取存储介质中。In addition, each functional unit in each embodiment of the present application may be integrated into one processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules. The integrated modules, if implemented in the form of software functional modules and sold or used as stand-alone products, may also be stored in a computer readable storage medium.
上述提到的存储介质可以是只读存储器，磁盘或光盘等。尽管上面已经示出和描述了本申请的实施例，可以理解的是，上述实施例是示例性的，不能理解为对本申请的限制，本领域的普通技术人员在本申请的范围内可以对上述实施例进行变化、修改、替换和变型。The above mentioned storage medium may be a read only memory, a magnetic disk or an optical disk or the like. While the embodiments of the present application have been shown and described above, it is understood that the above-described embodiments are illustrative and are not to be construed as limiting the scope of the present application. The embodiments are subject to variations, modifications, substitutions and variations.

Claims (20)

  1. 一种基于前置双摄像头的安全验证方法，其特征在于，包括以下步骤：A security verification method based on a front dual camera, characterized in that it comprises the following steps:
    通过第一摄像头获取用户人脸的彩色图像；Obtaining a color image of the user's face through the first camera;
    通过第二摄像头获取所述用户人脸的红外图像；Acquiring an infrared image of the user's face through the second camera;
    利用图像处理器对所述彩色图像和所述红外图像进行处理，以获取所述用户人脸的三维信息；Processing the color image and the infrared image by using an image processor to obtain three-dimensional information of the user's face;
    通过预设接口调用所述三维信息进行人脸安全验证。The three-dimensional information is invoked through a preset interface for face security verification.
  2. 如权利要求1所述的方法，其特征在于，还包括：The method of claim 1 further comprising:
    获取所述红外图像中的虹膜信息，并调用所述虹膜信息进行虹膜安全验证。Obtaining iris information in the infrared image and invoking the iris information for iris security verification.
  3. 如权利要求1或2所述的方法，其特征在于，利用图像处理器对所述彩色图像和所述红外图像进行处理，以获取所述用户人脸的三维信息，包括：The method of claim 1 or 2, wherein processing the color image and the infrared image with an image processor to obtain three-dimensional information of the user's face comprises:
    提取所述彩色图像中的用户人脸的第一特征；Extracting a first feature of a user's face in the color image;
    提取所述红外图像中的用户人脸的第二特征；Extracting a second feature of the user's face in the infrared image;
    利用三角测距原理确定所述第一特征与所述第二特征之间的相同特征的位移差；Determining a displacement difference of the same feature between the first feature and the second feature by using a triangulation principle;
    根据所述位移差建立所述用户人脸的三维信息。And establishing three-dimensional information of the user's face according to the displacement difference.
  4. 如权利要求2所述的方法，其特征在于，获取所述红外图像中的虹膜信息，包括：The method of claim 2, wherein acquiring iris information in the infrared image comprises:
    对所述红外图像进行图像识别，以获取所述红外图像中的人眼区域；Performing image recognition on the infrared image to obtain a human eye region in the infrared image;
    提取所述人眼区域中的虹膜信息。Iris information in the human eye region is extracted.
  5. 如权利要求1-4任一项所述的方法，其特征在于，还包括：The method of any of claims 1-4, further comprising:
    在获取所述用户人脸的三维信息之后，对所述用户人脸的三维信息进行加密，并在通过预设接口调用所述三维信息进行人脸安全验证之前，对所述用户人脸的三维信息进行解密。After acquiring the three-dimensional information of the user's face, encrypting the three-dimensional information of the user's face, and before calling the three-dimensional information through the preset interface for face security verification, the three-dimensionality of the user's face The information is decrypted.
  6. 如权利要求1-5任一项所述的方法，其特征在于，所述人脸安全验证处于可信运行环境TEE下。The method of any of claims 1-5, wherein the face security verification is under a trusted operating environment TEE.
  7. 如权利要求1-6任一项所述的方法，其特征在于，所述预设接口为符合预设标准的总线接口，包括MIPI总线接口、I2C同步串行总线接口、SPI总线接口。The method according to any one of claims 1-6, wherein the preset interface is a bus interface conforming to a preset standard, and includes an MIPI bus interface, an I2C synchronous serial bus interface, and an SPI bus interface.
  8. 一种基于前置双摄像头的安全验证装置，其特征在于，包括：A security verification device based on a front dual camera, comprising:
    第一获取模块，用于通过第一摄像头获取用户人脸的彩色图像；a first acquiring module, configured to acquire a color image of a user's face through the first camera;
    第二获取模块，用于通过第二摄像头获取所述用户人脸的红外图像；a second acquiring module, configured to acquire an infrared image of the user's face through the second camera;
    处理模块，用于利用图像处理器对所述彩色图像和所述红外图像进行处理，以获取所 述用户人脸的三维信息；a processing module, configured to process the color image and the infrared image by using an image processor to obtain three-dimensional information of the user's face;
    人脸验证模块，用于通过预设接口调用所述三维信息进行人脸安全验证。The face verification module is configured to invoke the three-dimensional information to perform face security verification through a preset interface.
  9. 如权利要求8所述的装置，其特征在于，还包括：The device of claim 8 further comprising:
    虹膜验证模块，用于获取所述红外图像中的虹膜信息，并调用所述虹膜信息进行虹膜安全验证。The iris verification module is configured to acquire iris information in the infrared image, and invoke the iris information to perform iris security verification.
  10. 如权利要求8或9所述的装置，其特征在于，所述处理模块，具体用于：The device according to claim 8 or 9, wherein the processing module is specifically configured to:
    提取所述彩色图像中的用户人脸的第一特征；Extracting a first feature of a user's face in the color image;
    提取所述红外图像中的用户人脸的第二特征；Extracting a second feature of the user's face in the infrared image;
    利用三角测距原理确定所述第一特征与所述第二特征之间的相同特征的位移差；Determining a displacement difference of the same feature between the first feature and the second feature by using a triangulation principle;
    根据所述位移差建立所述用户人脸的三维信息。And establishing three-dimensional information of the user's face according to the displacement difference.
  11. 如权利要求9所述的装置，其特征在于，所述虹膜验证模块，具体用于：The device according to claim 9, wherein the iris verification module is specifically configured to:
    对所述红外图像进行图像识别，以获取所述红外图像中的人眼区域；Performing image recognition on the infrared image to obtain a human eye region in the infrared image;
    提取所述人眼区域中的虹膜信息。Iris information in the human eye region is extracted.
  12. 如权利要求8-11任一项所述的装置，其特征在于，还包括：The device of any of claims 8-11, further comprising:
    加密解密模块，用于在获取所述用户人脸的三维信息之后，对所述用户人脸的三维信息进行加密，并在通过预设接口调用所述三维信息进行人脸安全验证之前，对所述用户人脸的三维信息进行解密。The encryption and decryption module is configured to encrypt the three-dimensional information of the user's face after acquiring the three-dimensional information of the user's face, and before calling the three-dimensional information through the preset interface for face security verification, The three-dimensional information of the user's face is decrypted.
  13. 一种具有前置双摄像头的电子设备，其特征在于，包括壳体和位于壳体内的第一摄像头、第二摄像头、图像处理器和控制器，An electronic device with a front dual camera, comprising: a housing and a first camera, a second camera, an image processor and a controller located in the housing;
    其中，所述第一摄像头，用于获取用户人脸的彩色图像；The first camera is configured to acquire a color image of a user's face;
    所述第二摄像头，用于获取所述用户人脸的红外图像；The second camera is configured to acquire an infrared image of the user's face;
    所述图像处理器，分别与所述第一摄像头和所述第二摄像头连接，用于接收所述彩色图像和所述红外图像，并获取所述用户人脸的三维信息；The image processor is connected to the first camera and the second camera, respectively, for receiving the color image and the infrared image, and acquiring three-dimensional information of the user's face;
    所述控制器，与所述图像处理器相连，用于通过预设接口调用所述三维信息进行人脸安全验证。The controller is connected to the image processor, and is configured to invoke the three-dimensional information to perform face security verification through a preset interface.
  14. 如权利要求13所述的电子设备，其特征在于，所述控制器，还用于：The electronic device according to claim 13, wherein the controller is further configured to:
    直接调用所述第二摄像头获取的所述红外图像，提取所述红外图像中的虹膜信息，并调用所述虹膜信息进行虹膜安全验证。Directly calling the infrared image acquired by the second camera, extracting iris information in the infrared image, and calling the iris information to perform iris security verification.
  15. 如权利要求13或14所述的电子设备，其特征在于，所述图像处理器，具体用于：The electronic device according to claim 13 or 14, wherein the image processor is specifically configured to:
    提取所述彩色图像中的用户人脸的第一特征；Extracting a first feature of a user's face in the color image;
    提取所述红外图像中的用户人脸的第二特征；Extracting a second feature of the user's face in the infrared image;
    利用三角测距原理确定所述第一特征与所述第二特征之间的相同特征的位移差；Determining a displacement difference of the same feature between the first feature and the second feature by using a triangulation principle;
    根据所述位移差建立所述用户人脸的三维信息。And establishing three-dimensional information of the user's face according to the displacement difference.
  16. 如权利要求14所述的电子设备，其特征在于，所述控制器，具体用于：The electronic device according to claim 14, wherein the controller is specifically configured to:
    对所述红外图像进行图像识别，以获取所述红外图像中的人眼区域；Performing image recognition on the infrared image to obtain a human eye region in the infrared image;
    提取所述人眼区域中的虹膜信息。Iris information in the human eye region is extracted.
  17. 如权利要求13-16任一项所述的电子设备，其特征在于，所述控制器，还用于：The electronic device according to any one of claims 13 to 16, wherein the controller is further configured to:
    在获取所述用户人脸的三维信息之后，对所述用户人脸的三维信息进行加密，并在通过预设接口调用所述三维信息进行人脸安全验证之前，对所述用户人脸的三维信息进行解密。After acquiring the three-dimensional information of the user's face, encrypting the three-dimensional information of the user's face, and before calling the three-dimensional information through the preset interface for face security verification, the three-dimensionality of the user's face The information is decrypted.
  18. 如权利要求13-17任一项所述的电子设备，其特征在于，所述人脸安全验证处于可信运行环境TEE下。The electronic device according to any one of claims 13-17, wherein the face security verification is in a trusted operating environment TEE.
  19. 如权利要求13-18任一项所述的电子设备，其特征在于，所述预设接口为符合预设标准的总线接口，包括MIPI总线接口、I2C同步串行总线接口、SPI总线接口。The electronic device according to any one of claims 13 to 18, wherein the preset interface is a bus interface conforming to a preset standard, and includes an MIPI bus interface, an I2C synchronous serial bus interface, and an SPI bus interface.
  20. 一种非临时性计算机可读存储介质，其上存储有计算机程序，其特征在于，该程序被处理器执行时实现如权利要求1-7任一项所述的基于前置双摄像头的安全验证方法。A non-transitory computer readable storage medium having stored thereon a computer program, characterized in that the program is executed by a processor to implement secure verification based on front dual camera according to any one of claims 1-7 method.
PCT/CN2019/086433 2018-05-15 2019-05-10 Front dual camera-based security verification method and electronic device WO2019218943A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810462093.8A CN108694389A (en) 2018-05-15 2018-05-15 Safe verification method based on preposition dual camera and electronic equipment
CN201810462093.8 2018-05-15

Publications (1)

Publication Number Publication Date
WO2019218943A1 true WO2019218943A1 (en) 2019-11-21

Family

ID=63846283

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/086433 WO2019218943A1 (en) 2018-05-15 2019-05-10 Front dual camera-based security verification method and electronic device

Country Status (2)

Country Link
CN (1) CN108694389A (en)
WO (1) WO2019218943A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113518061A (en) * 2020-10-16 2021-10-19 腾讯科技（深圳）有限公司 Data transmission method, device, apparatus, system and medium in face recognition

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108694389A (en) * 2018-05-15 2018-10-23 Oppo广东移动通信有限公司 Safe verification method based on preposition dual camera and electronic equipment
CN111144169A (en) * 2018-11-02 2020-05-12 深圳比亚迪微电子有限公司 Face recognition method and device and electronic equipment
CN114125244A (en) * 2021-12-03 2022-03-01 上海商米科技集团股份有限公司 Camera module, implementation method and mobile device
CN115527293B (en) * 2022-11-25 2023-04-07 广州万协通信息技术有限公司 Method for opening door by security chip based on human body characteristics and security chip device

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105187727A (en) * 2015-06-17 2015-12-23 广州市巽腾信息科技有限公司 Image information acquisition device, image acquisition method and use of image information acquisition device
WO2016069882A1 (en) * 2014-10-30 2016-05-06 Delta ID Inc. Systems and methods for secure biometric processing
CN106372601A (en) * 2016-08-31 2017-02-01 上海依图网络科技有限公司 In vivo detection method based on infrared visible binocular image and device
CN106815914A (en) * 2017-01-25 2017-06-09 辛明江 A kind of gate control system and unlocking method based on face recognition technology
CN106874871A (en) * 2017-02-15 2017-06-20 广东光阵光电科技有限公司 A kind of recognition methods of living body faces dual camera and identifying device
CN107194231A (en) * 2017-06-27 2017-09-22 上海与德科技有限公司 Unlocking method, device and mobile terminal based on iris
CN108694389A (en) * 2018-05-15 2018-10-23 Oppo广东移动通信有限公司 Safe verification method based on preposition dual camera and electronic equipment

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106485118A (en) * 2016-09-19 2017-03-08 信利光电股份有限公司 Electronic equipment and its identifying system, decryption method
CN107368726A (en) * 2017-06-23 2017-11-21 广东欧珀移动通信有限公司 The unlocking method and terminal of terminal

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016069882A1 (en) * 2014-10-30 2016-05-06 Delta ID Inc. Systems and methods for secure biometric processing
CN105187727A (en) * 2015-06-17 2015-12-23 广州市巽腾信息科技有限公司 Image information acquisition device, image acquisition method and use of image information acquisition device
CN106372601A (en) * 2016-08-31 2017-02-01 上海依图网络科技有限公司 In vivo detection method based on infrared visible binocular image and device
CN106815914A (en) * 2017-01-25 2017-06-09 辛明江 A kind of gate control system and unlocking method based on face recognition technology
CN106874871A (en) * 2017-02-15 2017-06-20 广东光阵光电科技有限公司 A kind of recognition methods of living body faces dual camera and identifying device
CN107194231A (en) * 2017-06-27 2017-09-22 上海与德科技有限公司 Unlocking method, device and mobile terminal based on iris
CN108694389A (en) * 2018-05-15 2018-10-23 Oppo广东移动通信有限公司 Safe verification method based on preposition dual camera and electronic equipment

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113518061A (en) * 2020-10-16 2021-10-19 腾讯科技（深圳）有限公司 Data transmission method, device, apparatus, system and medium in face recognition
CN113518061B (en) * 2020-10-16 2024-01-05 腾讯科技（深圳）有限公司 Data transmission method, equipment, device, system and medium in face recognition

Also Published As

Publication number Publication date
CN108694389A (en) 2018-10-23

Similar Documents

Publication Publication Date Title
WO2019218943A1 (en) Front dual camera-based security verification method and electronic device
TWI736883B (en) Method for image processing and electronic device
CN108805024B (en) Image processing method, image processing device, computer-readable storage medium and electronic equipment
EP3067746B1 (en) Photographing method for dual-camera device and dual-camera device
US9906772B2 (en) Method for performing multi-camera capturing control of an electronic device, and associated apparatus
WO2013146269A1 (en) Image capturing device, image processing method, and program
CN107113415A (en) The method and apparatus for obtaining and merging for many technology depth maps
TW201741999A (en) Method and system for generating depth information
EP3624006A1 (en) Image processing method, apparatus, computer-readable storage medium, and electronic device
TWI450024B (en) 3-dimensional depth image generating system and method thereof
CN108711054B (en) Image processing method, image processing device, computer-readable storage medium and electronic equipment
US20130258059A1 (en) Three-dimensional (3d) image photographing apparatus and method
WO2016184131A1 (en) Image photographing method and apparatus based on dual cameras and computer storage medium
WO2016011758A1 (en) Image processing method and image processing apparatus
WO2020024576A1 (en) Camera calibration method and apparatus, electronic device, and computer-readable storage medium
US20150029311A1 (en) Image processing method and image processing apparatus
CN107710213B (en) Apparatus, method, medium for depth-based user authentication
CN108712400B (en) Data transmission method and device, computer readable storage medium and electronic equipment
TWI608737B (en) Image projection
US20180007276A1 (en) Head down warning system
JP2016504828A (en) Method and system for capturing 3D images using a single camera
WO2019196669A1 (en) Laser-based security verification method and apparatus, and terminal device
WO2020015403A1 (en) Method and device for image processing, computer readable storage medium and electronic device
TWI549478B (en) Method for generating 3d image and electronic apparatus using the same
WO2015070536A1 (en) User information acquisition method and user information acquisition apparatus

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19803316

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19803316

Country of ref document: EP

Kind code of ref document: A1