CN215376329U - 3D and 2D multimode face imaging module and electronic equipment - Google Patents
3D and 2D multimode face imaging module and electronic equipment Download PDFInfo
- Publication number
- CN215376329U CN215376329U CN202121075917.XU CN202121075917U CN215376329U CN 215376329 U CN215376329 U CN 215376329U CN 202121075917 U CN202121075917 U CN 202121075917U CN 215376329 U CN215376329 U CN 215376329U
- Authority
- CN
- China
- Prior art keywords
- camera
- imaging module
- infrared
- speckle
- face imaging
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Length Measuring Devices By Optical Means (AREA)
Abstract
The utility model discloses a 3D and 2D multimode face imaging module and electronic equipment, belonging to the technical field of biological feature recognition, wherein the multimode face imaging module comprises a PCB (printed Circuit Board), and a speckle emitter, a near-infrared light supplement lamp, a 3D camera and a processor are arranged on the PCB, wherein: the speckle emitter is used for projecting a structured light pattern into space; the 3D camera is a near-infrared camera and is used for collecting a structured light pattern modulated by a target to be recognized when the speckle transmitter works and collecting a near-infrared face image of the target to be recognized when the near-infrared light supplement lamp works; the input end of the processor is connected with the signal output end of the 3D camera, and the processor is used for analyzing and calculating the structured light pattern modulated by the target to be recognized to obtain the depth image of the target to be recognized. The utility model can simultaneously acquire the near-infrared face image and the 3D face image, wherein the acquisition of the 3D face image and the acquisition of the near-infrared face image are multiplexed by the same camera, so that the volume of the equipment can be reduced, and the cost of the equipment can be reduced.
Description
Technical Field
The utility model relates to the technical field of biological feature recognition, in particular to a 3D and 2D multi-mode face imaging module and electronic equipment.
Background
Human face is one of the most important biological characteristics of human body, and human face research mainly focuses on human face recognition, and the expression model of human face is divided into two-dimensional human face and three-dimensional human face. The two-dimensional face recognition research time is relatively long and can be divided into visible light and near infrared face recognition, and the two-dimensional face recognition method is relatively mature in flow and is used in multiple fields.
The visible light face recognition is to collect face images under the visible light environment to perform face recognition, and the face recognition is suitable for being applied under the environment with good light; the near-infrared face recognition is to collect a face image under an active infrared light source environment to perform face recognition, the active near-infrared light source can weaken the adverse effect of ambient light on face imaging, and the infrared active light source is located in an invisible wave band and cannot damage eyes of people, so the near-infrared face recognition is a good choice.
With the continuous development of the technology, depth cameras are appeared to make it easier to capture the depth of a face image, a scanner uses a speckle emitter to emit a light pattern (such as a grating) on the face and calculate the shape of the surface according to the deformation of the light pattern, so as to calculate the face depth information, and a 3D (three-dimensional) face image itself contains the spatial shape information of the face and is less affected by external factors.
Near-infrared face images of a user can be acquired through the active near-infrared light source, 3D face images of the user can be acquired through the depth camera, and various electronic devices are developing towards miniaturization and low power consumption at present, so that the trend of simultaneously acquiring the near-infrared face images and the 3D face images on one miniature electronic device is already reached.
SUMMERY OF THE UTILITY MODEL
The utility model aims to provide a 3D and 2D multimode face imaging module and electronic equipment which can simultaneously acquire a near-infrared face image and a 3D face image.
In order to solve the technical problems, the utility model provides the following technical scheme:
on the one hand, provide a 3D and 2D multimode people face imaging module, including the PCB board, be equipped with speckle transmitter, near-infrared light filling lamp, 3D camera and treater on the PCB board, wherein:
the speckle emitter is used for projecting a structured light pattern into space;
the 3D camera is a near-infrared camera and is used for collecting a structured light pattern modulated by a target to be recognized when the speckle transmitter works and collecting a near-infrared face image of the target to be recognized when the near-infrared light supplement lamp works;
the input end of the processor is connected with the signal output end of the 3D camera, and the processor is used for analyzing and calculating the structured light pattern modulated by the target to be recognized to obtain the depth image of the target to be recognized.
In some embodiments of the utility model, a control module is further arranged on the PCB, and the control module is in control connection with the speckle emitter, the near-infrared light supplement lamp, the 3D camera and the processor.
In some embodiments of the utility model, the distance between the speckle emitter and the 3D camera is 30-50 mm.
In some embodiments of the present invention, the speckle emitters are two and located on two sides of the 3D camera, respectively, and the distances between the two speckle emitters and the 3D camera are different.
In some embodiments of the present invention, the PCB board is further provided with an RGB camera, and the control module is in control connection with the RGB camera.
In some embodiments of the present invention, the distance between the RGB camera and the 3D camera is 1-10 mm.
In some embodiments of the present invention, a proximity sensor is further disposed on the PCB, and the proximity sensor is configured to output a trigger signal to the control module when the target to be recognized is located within a preset range of the multi-modal face imaging module.
In some embodiments of the present invention, a front case is disposed on the PCB, a mounting through hole for exposing the speckle emitter, the near-infrared light supplement lamp, the proximity sensor, the RGB camera, and the 3D camera is disposed on the front case, and a heat dissipation structure is further disposed on the front case.
In some embodiments of the utility model, a support is arranged between the PCB board and the front shell, and the support is provided with a positioning through hole for the speckle emitter, the near-infrared light supplement lamp, the proximity sensor, the RGB camera and the 3D camera to pass through; the support is provided with a convex block, and the front shell is provided with a groove matched with the convex block; the PCB, the support and the front shell are fixedly connected through screws positioned at the corners.
In another aspect, an electronic device is provided, which includes the above multi-modality face imaging module.
The utility model has the following beneficial effects:
the 3D and 2D multimode face imaging module and the electronic equipment can simultaneously acquire the near-infrared face image and the 3D face image, wherein the 3D face image and the near-infrared face image are acquired by multiplexing the same camera, so that the size of the equipment can be reduced, and the cost of the equipment can be reduced.
Drawings
FIG. 1 is a schematic diagram of the overall structure of a 3D and 2D multi-mode face imaging module according to the present invention;
FIG. 2 is a schematic diagram of a split structure of the multi-modality face imaging module shown in FIG. 1;
fig. 3 is a schematic circuit diagram of the multi-modality face imaging module shown in fig. 1.
Detailed Description
In order to make the technical problems, technical solutions and advantages of the present invention more apparent, the following detailed description is given with reference to the accompanying drawings and specific embodiments.
On one hand, the utility model provides a D and 2D multimode face imaging module, as shown in fig. 1-3, comprising a PCB board 1, wherein the PCB board 1 is provided with a speckle emitter 2, a near-infrared fill light 3, a 3D camera 4 and a processor 11, wherein:
the speckle emitter 2 is used to project a structured light pattern into space;
the 3D camera 4 is a near-infrared camera and is used for collecting a structured light pattern modulated by a target (human face) to be recognized when the speckle emitter 2 works and collecting a near-infrared human face image of the target to be recognized when the near-infrared light supplement lamp 3 works;
the input end of the processor 11 is connected to the signal output end of the 3D camera 4, the processor 11 is configured to analyze and calculate the structured light pattern modulated by the target to be recognized to obtain a depth image (i.e., a 3D face image) of the target to be recognized, and the analyzing and calculating method is common knowledge in the art and is not described herein again. Specifically, the processor 11 may be a DSP (Digital Signal Processing) chip, such as TMS320C1X/C2X, TMS320C2XX/C5X, TMS320C54X/C62XX series of TI, ADSP21XX series of AD, DSP16/16A of AT & T, MC56000 of Motolora, and the like.
The face recognition operation can be specifically executed by an electronic device including the multi-modal face imaging module, or by an upper computer in communication with the multi-modal face imaging module, and a face recognition algorithm is common knowledge in the art and is not described herein again.
Typically, the speckle emitter 2 is used to project a non-visible light pattern, such as near infrared light, and correspondingly, the 3D camera 4 should also be a near infrared camera. In the application, the 3D face image and the near-infrared face image are acquired and multiplexed by the same camera, so that the size of the equipment can be reduced, and the cost of the equipment is reduced.
For the convenience of controlling the working time of each device, it is preferable that the PCB board 1 is further provided with a control module 10, and the control module 10 is in control connection (electrically connected and capable of sending a control signal to control) with the speckle emitter 2, the near-infrared light supplement lamp 3, the 3D camera 4 and the processor 11. Specifically, the control module 10 may be a single chip microcomputer, and the specific model may be STM8, STM32, AT89C51, or the like.
There is a certain distance between the speckle emitter 2 and the 3D camera 4, here called the baseline. For the acquisition of a 3D face image, the length of a base line can influence the measurement range and precision of a 3D camera, and generally, the longer the base line is, the larger the measurement range is; in addition, for the same measurement distance, the longer the baseline, the higher the measurement accuracy. However, when the baseline is long, the size of the 3D camera is required to be larger, which makes it difficult to embed into some miniature electronic devices, and therefore, the selection of the baseline should be a comprehensive consideration of the size of the 3D camera, the measurement range, the accuracy, and the like. Preferably, the distance from the base line is 30-50mm, for example 40 mm.
In some embodiments, a module which is the same as the speckle emitter and is on the same straight line with the component can be also arranged on the other side of the 3D camera, but the two speckle emitters are respectively positioned on two sides of the 3D camera, so that the multi-mode face imaging device based on the active binocular structured light principle is formed. In one embodiment, the base line distances between the two speckle emitters and the 3D camera are different, so that application requirements of different measurement ranges can be met, for example, when the measurement distance is long, the speckle emitter with a longer base line and the 3D camera can be used for measurement, or the two speckle emitters are simultaneously started, but depth measurement is respectively performed, and finally obtained two depth images are fused to obtain a depth image with a measurement range and a higher resolution.
In order to enable the D and 2D multi-mode face imaging module to have more functions, generally, the RGB camera 5 may be further configured on the PCB 1, and the control module 10 is connected to the RGB camera 5 in a control manner, so that the multi-mode face imaging module can synchronously acquire a 3D face image/near-infrared face image and an RGB image. Because a certain distance exists between the RGB camera 5 and the 3D camera 4, a certain parallax inevitably exists between the 3D face image/near-infrared face image and the RGB image respectively obtained. In some applications, it is desirable to utilize 3D/near infrared face images and RGB images without parallax. For this reason, the RGB camera and the 3D camera often need to be calibrated to obtain the relative positional relationship therebetween, and the parallax can be eliminated according to the calibration result, which is often referred to as registration. The smaller the distance between the RGB camera and the 3D camera is, the smaller the parallax is, and the difficulty of registration is reduced, so that the RGB camera is often relatively close to the 3D camera, and the distance between the RGB camera and the 3D camera is preferably 1-10 mm.
In other embodiments, the PCB 1 may also be configured with a proximity sensor 6, which may be specifically located beside the near-infrared fill light 3 and near one side of the 3D camera 4, and the proximity sensor has a sensitivity characteristic to an approaching object to identify the approach of the object, so as to output a trigger signal to the control module 10 when the target to be identified is located within a preset range of the multi-modal face imaging module, and based on the trigger signal, for example, the RGB camera 5 and the 3D camera 4 may be controlled to start, so as to acquire an RGB face image and a 3D face image.
In the utility model, the speckle emitter 2, the near-infrared light supplement lamp 3, the proximity sensor 6, the RGB camera 5 and the 3D camera 4 can be positioned on the same straight line. Near-infrared light filling lamp 3 and proximity sensor 6 are close to a little relatively, and RGB camera 5 is close to 3D camera 4 a little relatively.
For making multimode people face imaging module have better encapsulation nature, can be equipped with preceding shell 7 on the PCB board 1 to encapsulate the components and parts introduced in the above-mentioned embodiment, can be equipped with on the preceding shell 7 and be used for making speckle emitter 2, near-infrared light filling lamp 3, proximity sensor 6, RGB camera 5 and 3D camera 4 expose the installation thru hole, need guarantee the stability of each components and parts in the electronic equipment this moment, and the thermal diffusivity of each components and parts. The heat dissipation structure 71 is disposed on the front case 7, and the heat dissipation structure 71 may be a heat dissipation hole or the like.
Fig. 2 is a schematic diagram of a split structure of the D and 2D multimode face imaging module of the utility model, as shown in fig. 2, a support 8 may be disposed between the PCB 1 and the front case 7, the speckle emitter 2, the near-infrared fill light 3, the proximity sensor 6, the RGB camera 5, and the 3D camera 4 are fixed on the support 8, the support 8 is provided with positioning through holes for the speckle emitter 2, the near-infrared fill light 3, the proximity sensor 6, the RGB camera 5, and the 3D camera 4 to pass through, so as to ensure that the upper ends of the components are fixed in the horizontal direction, and in addition, the bottom of each component is supported by the PCB 1 to ensure that the components are fixed in the vertical direction, thereby achieving structural stability of each component. Preferably, the sectional area of the upper end of each component is smaller than that of the lower end, and the sectional area of the upper end of each positioning through hole is smaller than that of the lower end, so that the structural stability of the component can be further improved.
Wherein, can also be equipped with lug 81 on the support 8, be equipped with on the preceding shell 7 with lug 81 matched with recess 72, lug 81 and recess 72 cooperation, alright fix speckle emitter 2, near-infrared light filling lamp 3, proximity sensor 6, RGB camera 5 and 3D camera 4 from this better, prevent installation error such as rotation, dislocation, also prevented to appear not hard up scheduling problem in the use.
As shown in fig. 2, four corners of the front case 7 can be provided with through holes, four corners of the PCB board 1 can also be provided with through holes, and the front case 7, the support 8 and the PCB board 1 are matched to fix the speckle emitter 2, the near-infrared light supplement lamp 3, the proximity sensor 6, the RGB camera 5 and the 3D camera 4. Specifically, after the components are assembled on the support 8 and the positions of the front shell 7, the support 8 with the components and the PCB 1 are fixed, the components are assembled together by screws 9 to form the multi-mode face imaging module of the present invention.
The support 8 is typically made of a relatively rigid material, such as steel, aluminum alloy, zinc alloy, or the like. A connector is generally disposed at the end of the PCB 1, and the connector may be any type of connector, and the front case 7 and the support 8 form an interface 12 corresponding to the connector for transmitting data.
The working principle of the 3D and 2D multimode face imaging module of the utility model is described as follows:
when proximity sensor senses 6 and gets into when presetting working range to the user, control module 10 on the PCB board 1 outputs first level, control speckle transmitter 2 sends the structured light pattern, 3D camera 4 receives the structured light pattern after being modulated by the face, carry out the analysis to the structured light pattern of modulation through processor 11 on the PCB board 1 and calculate the depth image that obtains the target, processor 11 carries out the analysis to the target depth image of gathering simultaneously, when obtaining clear, when complete 3D face image, control module 10 outputs the second level, control near-infrared light filling lamp 3 opens, 3D camera 4 gathers near-infrared face image.
In conclusion, the 3D and 2D multimode human face imaging module has the advantages of small volume, stable structure and good heat dissipation performance; the three-dimensional face image acquisition system can acquire a 3D face image, a near-infrared face image and an RGB face image simultaneously, and multiplex a near-infrared camera, so that the equipment cost is reduced.
On the other hand, the present invention provides an electronic device, which includes the above 3D and 2D multi-mode face imaging module, and the structure of the 3D and 2D multi-mode face imaging module is the same as that of the above, so that the details are not repeated herein.
In the electronic equipment, the same camera is multiplexed by the 3D face image acquisition and the near-infrared face image acquisition, so that the equipment volume can be reduced, and the equipment cost can be reduced.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the utility model as defined in the appended claims.
Claims (10)
1. The utility model provides a 3D and 2D multimode people face imaging module, includes the PCB board, its characterized in that, be equipped with speckle transmitter, near-infrared light filling lamp, 3D camera and treater on the PCB board, wherein:
the speckle emitter is used for projecting a structured light pattern into space;
the 3D camera is a near-infrared camera and is used for collecting a structured light pattern modulated by a target to be recognized when the speckle transmitter works and collecting a near-infrared face image of the target to be recognized when the near-infrared light supplement lamp works;
the input end of the processor is connected with the signal output end of the 3D camera, and the processor is used for analyzing and calculating the structured light pattern modulated by the target to be recognized to obtain the depth image of the target to be recognized.
2. The 3D and 2D multimode human face imaging module according to claim 1, wherein a control module is further arranged on the PCB, and the control module is in control connection with the speckle emitter, the near infrared fill light, the 3D camera and the processor.
3. The 3D and 2D multimode face imaging module of claim 2, wherein the distance between the speckle emitter and the 3D camera is 30-50 mm.
4. The 3D and 2D multi-mode face imaging module according to claim 2, wherein the speckle emitters are two and located on two sides of the 3D camera respectively, and the distance between the two speckle emitters and the 3D camera is different.
5. The 3D and 2D multi-mode human face imaging module according to claim 2, wherein an RGB camera is further arranged on the PCB, and the control module is in control connection with the RGB camera.
6. The 3D and 2D multi-mode face imaging module according to claim 5, wherein the distance between the RGB camera and the 3D camera is 1-10 mm.
7. The 3D and 2D multi-mode face imaging module according to claim 5, wherein a proximity sensor is further disposed on the PCB board, and the proximity sensor is configured to output a trigger signal to the control module when the target to be recognized is located within a preset range of the multi-mode face imaging module.
8. The 3D and 2D multi-mode human face imaging module according to claim 7, wherein a front shell is arranged on the PCB, mounting through holes for exposing the speckle emitter, the near infrared fill light, the proximity sensor, the RGB camera and the 3D camera are arranged on the front shell, and a heat dissipation structure is further arranged on the front shell.
9. The 3D and 2D multimode human face imaging module according to claim 8, wherein a support is arranged between the PCB and the front shell, and a positioning through hole for the speckle emitter, the near infrared fill light, the proximity sensor, the RGB camera and the 3D camera to pass through is arranged on the support; the support is provided with a convex block, and the front shell is provided with a groove matched with the convex block; the PCB, the support and the front shell are fixedly connected through screws positioned at the corners.
10. An electronic device comprising the 3D and 2D multi-mode face imaging module of any of claims 1-9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202121075917.XU CN215376329U (en) | 2021-05-19 | 2021-05-19 | 3D and 2D multimode face imaging module and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202121075917.XU CN215376329U (en) | 2021-05-19 | 2021-05-19 | 3D and 2D multimode face imaging module and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN215376329U true CN215376329U (en) | 2021-12-31 |
Family
ID=79630659
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202121075917.XU Active CN215376329U (en) | 2021-05-19 | 2021-05-19 | 3D and 2D multimode face imaging module and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN215376329U (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115294676B (en) * | 2022-07-08 | 2024-03-19 | 重庆甲智甲创科技有限公司 | Face recognition unlocking method and face recognition unlocking device |
-
2021
- 2021-05-19 CN CN202121075917.XU patent/CN215376329U/en active Active
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115294676B (en) * | 2022-07-08 | 2024-03-19 | 重庆甲智甲创科技有限公司 | Face recognition unlocking method and face recognition unlocking device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109756654B (en) | TOF (time of flight) camera module, manufacturing method thereof, TOF depth image imaging method and electronic equipment | |
| CN105095844B (en) | Binocular iris image data acquisition module and method | |
| CN111698494B (en) | Electronic device | |
| JP2005244974A (en) | Method of forming integrated circuit package | |
| CN109819173B (en) | Depth fusion method based on TOF imaging system and TOF camera | |
| CN109737868A (en) | Flight time mould group and electronic equipment | |
| WO2015169220A1 (en) | Light-deflection three-dimensional imaging device and projection device, and application thereof | |
| CN215376329U (en) | 3D and 2D multimode face imaging module and electronic equipment | |
| US20180088446A1 (en) | Function enhancement device, attaching/detaching structure for function enhancement device, and function enhancement system | |
| WO2018028152A1 (en) | Image acquisition device and virtual reality device | |
| CN207817206U (en) | A kind of laser radar | |
| CN210867879U (en) | Face identification module and intelligent lock | |
| CN110530611B (en) | Calibration method, laser emission module, depth camera and electronic equipment | |
| CN201322912Y (en) | Circuit board module of optics indicating device | |
| CN215599695U (en) | 3D structured light face recognition module | |
| CN210694195U (en) | Integrated 3D imaging device and electronic equipment | |
| CN214335963U (en) | Learning machine | |
| CN210093398U (en) | 3D imaging device and electronic equipment | |
| CN211877244U (en) | Temperature measuring instrument | |
| CN210833416U (en) | Grating type three-dimensional scanning equipment | |
| CN220170186U (en) | Laser profiler and 3D printing system | |
| CN221173608U (en) | Vibration detection device and electronic equipment | |
| CN210732516U (en) | Image recognition device and robot | |
| CN214587005U (en) | Image processor, three-dimensional imaging device and electronic equipment | |
| CN215832660U (en) | Industrial camera |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |