WO2021042854A1 - Pop-up three-dimensional recognition device and mobile terminal - Google Patents
Pop-up three-dimensional recognition device and mobile terminal Download PDFInfo
- Publication number
- WO2021042854A1 WO2021042854A1 PCT/CN2020/099895 CN2020099895W WO2021042854A1 WO 2021042854 A1 WO2021042854 A1 WO 2021042854A1 CN 2020099895 W CN2020099895 W CN 2020099895W WO 2021042854 A1 WO2021042854 A1 WO 2021042854A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- pop
- dimensional
- camera
- push rod
- dimensional recognition
- Prior art date
Links
- 230000003287 optical effect Effects 0.000 claims abstract description 35
- 230000008878 coupling Effects 0.000 claims description 10
- 238000010168 coupling process Methods 0.000 claims description 10
- 238000005859 coupling reaction Methods 0.000 claims description 10
- 230000007613 environmental effect Effects 0.000 claims description 3
- 230000000630 rising effect Effects 0.000 claims description 2
- 230000008602 contraction Effects 0.000 claims 1
- 238000005516 engineering process Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 230000000694 effects Effects 0.000 description 7
- 230000006870 function Effects 0.000 description 7
- 230000007246 mechanism Effects 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 239000006260 foam Substances 0.000 description 2
- 230000001939 inductive effect Effects 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000008094 contradictory effect Effects 0.000 description 1
- 230000001186 cumulative effect Effects 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000000034 method Methods 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
- H04M1/026—Details of the structure or mounting of specific components
- H04M1/0264—Details of the structure or mounting of specific components for a camera module assembly
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
- H04M1/026—Details of the structure or mounting of specific components
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/12—Details of telephonic subscriber devices including a sensor for measuring a physical value, e.g. temperature or motion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/20—Details of telephonic subscriber devices including a rotatable camera
Definitions
- the invention relates to the field of three-dimensional recognition and mobile terminals.
- the three-dimensional recognition devices mounted on mobile terminals on the market are mainly optical devices (including cameras and target depth information acquisition devices) that use structured light or TOF (time of flight) technology fixed inside the fuselage.
- These three-dimensional recognition devices are all one-way applications, that is, either located on the front of the terminal (the side where the screen is located) and facing the front, or fixed on the electric push rod behind the internal display of the fuselage by integrating a pop-up front camera. , And fixed to the front, or located on the back of the terminal and facing the rear.
- the present invention provides a pop-up three-dimensional recognition device
- the pop-up three-dimensional recognition device includes: a pushing member, the pushing member includes a driving member and a push rod, the driving member is used to drive the The push rod extends or retracts;
- the three-dimensional recognition assembly includes a pop-up body and a depth camera and a multi-fold optical zoom camera arranged on the pop-up body; a rotating part, the rotating part is connected to the push rod And the pop-up body, the rotating member is used to drive the pop-up body to rotate so as to rotate the depth camera and the multiple optical zoom camera provided on the pop-up body.
- the present invention also provides a mobile terminal that includes a housing and the above-mentioned pop-up three-dimensional recognition device, the housing is formed with a receiving groove, and the pop-up three-dimensional recognition The device is telescopically installed in the containing tank.
- FIG. 1 is a schematic diagram of a dual-motor scheme of a pop-up three-dimensional recognition device according to an embodiment of the present invention
- FIG. 2 is a schematic diagram of a single-motor solution of a pop-up three-dimensional recognition device according to an embodiment of the present invention
- FIG. 3 is a schematic diagram of a control circuit of a single-motor scheme of a pop-up three-dimensional recognition device according to an embodiment of the present invention
- FIG. 4 is a schematic diagram of a control path of a pop-up three-dimensional recognition device according to an embodiment of the present invention.
- FIG. 5 is a schematic diagram of a mobile terminal according to another embodiment of the present invention.
- Fig. 6 is another schematic diagram of a mobile terminal according to another embodiment of the present invention (with an RGB camera added);
- FIG. 7 is still another schematic diagram of a mobile terminal according to another embodiment of the present invention.
- Fig. 8 is a schematic diagram of another state of Fig. 7.
- the direction in the present invention is based on the direction shown in FIG. 1, that is, the "up, down, horizontal, and vertical" in the present invention correspond to the “up, down, horizontal, and vertical” in FIG. 1, respectively. direction.
- the present invention provides a pop-up three-dimensional recognition device, including:
- a pushing member the pushing member includes a driving member and a push rod 19, and the driving member is used to drive the push rod 19 to extend or retract;
- the three-dimensional recognition component includes a pop-up body 21 and a depth camera 22 and a multiple optical zoom camera 23 arranged on the pop-up body 21;
- the rotating member is connected to the push rod 19 and the ejecting body 21, and the rotating member is used to drive the ejecting body 21 to rotate so as to rotate the depth camera 22 and the multiple optical zoom camera 23 provided on the ejecting body 21.
- the push rod 19 is extended to push out the three-dimensional recognition assembly 2 and the rotating member to a preset position, and the ejector 21 is driven to rotate by the rotating member, so that the depth camera 22 and the multiple optical zoom provided on the ejector 21 are made.
- the camera 23 rotates.
- this embodiment can make the three-dimensional recognition device of the mobile terminal pop up and rotate, so that a single recognition device can implement three-dimensional recognition in both directions, which saves costs.
- This embodiment is particularly suitable for mobile terminals, especially mobile phones.
- the pop-up three-dimensional recognition device is arranged in the housing 70.
- the push rod 19 of the mobile phone screen is extended to expose the three-dimensional recognition component 2 to the housing 70 on the top of the mobile phone, and the camera can start to take pictures or take a video.
- the three-dimensional recognition assembly 2 can be driven to rotate 360° through the rotating member, so that images of various angles can be taken.
- the above-mentioned driving member may be a driving motor.
- the current mainstream direction of the depth camera 22 is to use TOF (time of flight, time of flight) technology and structured light technology.
- TOF technology emits infrared light to the target through an infrared pulse transmitter, the infrared camera receives the infrared light reflected by the target, and the system calculates the time difference between the received infrared light and the previously emitted infrared light to establish the depth information of the scene.
- structured light technology involves infrared fill light, infrared dot-matrix projector, infrared camera, distance sensor, etc., by calculating the difference between the received light spot array reflected by the scene and the previously emitted structural characteristic light spot array
- the structured light has a large baseline (that is, the projector and the receiver need to keep a certain distance), and the TOF technology baseline can be almost zero.
- the existing TOF technology is used solely for forward and backward applications, so the depth camera 22 shown in FIG. 5 preferably adopts the TOF technical solution.
- An infrared transmitter and an infrared receiver are provided outside the depth camera 22.
- the multi-fold optical zoom camera 23 at present, two times or less can be realized with a camera module close to a cube, and three times or more need to be considered as a periscope type, consisting of a lens, an upward turning prism, a zoom/focus lens group, and a lens.
- the group is composed of driving mechanism, upper filter, lower filter, lower turning prism and optical sensor substrate, etc.
- the lens group is a zoom/focus lens group.
- the periscope multi-fold optical zoom camera 23 module cavity is significantly elongated by the lens group to become a significant cuboid; the steering lens and the steering lens change the light path to this lens group cavity, and the lens group driving mechanism controls the lens group distance conversion Achieve multiple optical zoom (the lens presents a wide-angle to telephoto effect).
- the effect of optical zoom is much better than that of digital zoom by software means.
- Multi-fold optical zoom can be flexibly configured according to different scenes to achieve better camera results, which is very suitable for the trend of continuous improvement of camera performance of mobile terminals.
- the system controls it at a relatively short focal length to achieve close-up portrait selfies or maintain a telephoto, but by adjusting the lens group or inserting a clip to meet the macro function (the so-called telephoto) Macro lens) to achieve the needs of macro shooting; when used in the backward direction, the system mainly controls it at a long focal length to achieve the ideal long-range shooting requirements.
- the focal length can also be arbitrarily changed to meet diverse camera requirements.
- This front-to-back conversion can be achieved by rotating the ejection body 21 by 180 degrees.
- the periscope type multiple optical zoom camera 23 can be integrated into the rotating structure of the pop-up body 21, which is beneficial for optimizing the structural space.
- the depth camera 22 and the periscope multi-fold optical zoom camera 23 are combined into the pop-up body 21, and the depth D information of the depth camera 22 and the two-dimensional RGB information of the multi-fold optical zoom camera 23 are synthesized into three-dimensional RGBD information for three-dimensional Identification and related applications.
- Rotating the pop-up body 21 can perform three-dimensional recognition applications in any direction. Of course, it is typically directly turned from the forward direction to the backward direction to realize the backward three-dimensional recognition. In this way, it can not only meet the current mature three-dimensional face recognition security unlocking and payment applications, but also meet the current backward three-dimensional recognition-based AR/VR photography & games, virtual shopping, ranging, indoor positioning and navigation, etc. Apply trends.
- the pushing member further includes a coupling 11, a revolving frame 12, a limit proximity sensor set on the revolving frame 12, a screw rod 15, and a screw rod 15
- the nut base 16, the push rod 19 is connected to the nut base 16, and the coupling 11 is connected to the driving member 18 and the screw rod 15.
- the bottom of the screw 15 is embedded on the coupling 11, and the top is connected to the upper end of the revolving frame 12.
- the driving member 18 drives the screw rod 15 to rotate through the coupling 11 (here the screw rod 15 only rotates, and does not move in the up and down direction), so that the nut seat 16 sleeved on the screw rod 15 moves up and down, so that the screw connected to the nut seat 16
- the push rod 19 extends or retracts.
- the screw rod 15 is only provided with threads in the part located in the revolving frame 12, so as to limit the stroke interval of the nut seat 16.
- the nut seat 16 preferably uses balls to form a ball screw 15. It is also possible to install a nut seat retaining ring 17 at a position close to the top of the revolving frame 12 on the nut seat 16, and the push rod 19 is connected to the nut seat retaining ring 17.
- the driving member 18 drives the screw rod 15 to rotate through the coupling 11 to drive the nut base 16 to move up and down, thereby changing the rotational movement of the driving member 18 into linear motion, and then drives the three-dimensional recognition assembly 2 fixed on the push rod 19 to move up and down.
- the upper limit proximity sensor switch 13 and the lower limit proximity sensor switch 14 are respectively arranged inside the turret 12 at positions corresponding to the upper and lower limit of the stroke of the nut seat 16.
- the upper limit proximity switch 13 and the lower limit proximity switch 14 can be made of Hall devices. It can also be made of optocoupler and thyristor.
- the driver 18 is shut down to prevent the driver 18 from continuously running at the upper or lower stroke limit.
- the lens area of the depth camera 22 and the multi-fold optical zoom camera 23 in the three-dimensional recognition component is not large, the camera module and connection lines behind the lens occupy a large space, so the shape of the pop-up body 21 is usually wide in the upper part and narrow in the lower part.
- the upper part is a cube whose cross-section is rectangular, trapezoidal or elliptical and close to a regular plane shape
- the lower part is a cylinder or an ellipsoid shape close to a cylinder. Therefore, the ejection body 21 needs to rise above the top of the casing 70 to rotate (it cannot rotate inside the casing 70).
- the housing 70 is formed with a receiving groove 80, and the pop-up three-dimensional recognition device is telescopically installed in the receiving groove 80; at the same time, the pop-up three-dimensional recognition
- the device also includes a fixed base 90 (usually firmly fixed with the housing 70 or the middle frame inside the mobile terminal), the middle opening through the push rod 19 is used to ensure the stable operation of the pusher, and the push rod 19 In the retracted state, the rod 19 supports the ejection body 21.
- a fixed base 90 usually firmly fixed with the housing 70 or the middle frame inside the mobile terminal
- the receiving groove 80 is presented in the form of openings in the baffle 72, the baffle 72 can also be directly made into a trough to directly wrap the receiving trough 80, or even a trough-shaped baffle 72. It can be integrated with the fixed base 90.
- the present invention mainly has the following two implementation schemes:
- the first implementation scheme dual-motor scheme
- the dual motors here refer to the driving part 18 and the rotating motor 30.
- a rotating motor 30 capable of driving the ejection body 21 to rotate is provided at the bottom of the ejection body 21.
- the rotating motor 30 drives the ejection body 21 to rotate, so that the camera provided on the ejection body 21 rotates and changes direction.
- the direction and angle of rotation of the pop-up body 21 can be arbitrary, and the rotation angle can reach 360°.
- the common mode is forward+backward, so that the camera on the pop-up body 21 can be reused forward and backward.
- the rotating motor 30 drives the ejector 21 to rotate, causing structural damage to the ejector 21 (so the ejector 21 is still in the mobile phone).
- the nut seat 16 reaches the upper limit of the stroke, the corresponding upper limit is close to the inductive switch 13 and then the driving member 18 is turned off, and the control circuit of the rotating motor 30 is turned on at the same time.
- the upper limit proximity switch 13 immediately turns off the control circuit of the rotating motor 30, which ensures that the rotating motor 30 can only work after the nut seat 16 reaches the upper limit of the stroke, when the nut seat 16 is about to fall When the rotating motor 30 stops rotating.
- the rotating motor 30 stops rotating.
- the driving member 18 will not be triggered to reverse the rotation immediately after the state of the upper limit proximity sensor switch 13 changes, but the reverse rotation can only be performed after the return notification signal of the rotating electric machine 30 is received.
- an angle sensor (or angle sensor) 50 capable of sensing the rotation of the drive shaft of the rotating motor 30 can be provided at the bottom of the ejector 21. When the angle sensor 50 detects that the rotation angle is 0 degrees or 360 When the degree is higher, the angle sensor 50 sends a return notification signal to the driving member 18.
- the angle sensor 50 can also send a return notification signal to the driving member 18 when the angle sensor 50 detects that the rotation angle is 180 degrees.
- the above-mentioned angle sensor 50 is preferably a three-axis Hall angle sensor 50.
- an ambient light sensor may be provided at the bottom of the pop-up body 21, and it is determined whether to control the rotating motor 30 to rotate according to the current state value of the ambient light sensor.
- the second implementation scheme single motor scheme
- a torsion spring 40 is placed between the upper outer end of the revolving frame 12 and the lower end of the fixed base 90, and the torsion spring 40 is preloaded to keep the revolving frame 12 in a balanced position.
- a nut seat retainer ring 17 is placed inside the top of the slewing frame 12. The nut seat 16 is driven by the drive member 18 in the turret 12 to stop rising when the nut seat retainer ring 17, and then the drive member 18 overcomes the torque generated by the torsion spring 40, so that The nut base 16 and the revolving frame 12 can continue to rotate within 360 degrees, thereby driving the three-dimensional identification assembly 2 fixed with the nut base 16 to rotate.
- the driving member 18 rotates in the reverse direction, and the driving member 18 drives the screw rod 15 to apply a reverse torque.
- the torsion spring 40 drives the slewing frame 12 and the nut base 16 to reversely rotate to a balanced position, and then the nut base 16 descends. Therefore, the nut seat 16 forms an upward movement—forward rotation—reverse rotation—downward movement, and then the push rod 19 and the ejector 21 fixed together with the nut seat 16 form a lifting and rotating mechanism accordingly.
- the lifting and rotating mechanism of the pop-up body 21 needs to be performed under the strict logic control circuit of the system, otherwise the pop-up body 21 may cause structural damage if it is lifted or rotated at an improper time. For this reason, after the upper limit proximity sensor switch 13 in the single-motor scheme is triggered to shut down the drive member 18 due to the proximity of the nut base 16, the system performs corresponding control through the combinational logic control circuit.
- the system control instruction performs forced reversal on the current state of the upper limit proximity sensor switch 13 shutting down the drive member 18 after a preset time delay through the delay circuit, or forced reversal according to the state of the optional ambient light sensor at the bottom of the pop-up body 21, In order to be able to start the driving member 18 again to overcome the pretension force of the torsion spring 40 to rotate. Then, after the system controls the driving member 18 to complete the equal reverse rotation, the driving member 18 is set to the off state (that is, the state of the driving member 18 is restored to the state consistent with the upper limit proximity sensor switch 13 turning off the driving member 18). At this time, the push rod 19 changes from rotation to lifting.
- the upper limit proximity sensor switch 13 is at the same time as the driving member 18 is shut down.
- the lower limit proximity sensor switch 14 is set by the system to be able to move the driving member 18. This is set again
- the off state is to facilitate the upper limit proximity sensor switch 13 and the lower limit proximity sensor switch 14 to achieve state interlocking according to the forward and reverse control signals, which is beneficial to the reliability of the reciprocating movement of the push rod 19 during the lifting period.
- the logic control circuit of this part is shown in the switch control circuit of the driver 18 in the lower left part of FIG. 3.
- the system can control the relevant circuits in the driving chip of the driver 18 through pulse control signals and forward/reverse control signals, thereby realizing effective control of the stepping progress and forward and reverse rotation of the driver 18, as shown in Figure 3 as a whole (Compared with the use of time relay and linkage switch, the chip control saves space and occupies more).
- the turret 12 can be fixed, and the nut base 16 rotates with respect to the screw rod 15 and only moves up and down, and does not rotate left and right.
- the turret 12 and the turret in the single-motor drive solution The nut base 16 rotates at the top of the ascent stroke. This rotation causes the push rod 19 fixed with the nut base 16 to also rotate, so that the ejector 21 of the three-dimensional identification assembly 2 fixed with the push rod 19 also rotates. Realize the 3D recognition component 2 to change the orientation.
- the ejector 21 after the ejector 21 rotates, it can also stop the rotation when the sensor 50 at the bottom of the ejector 21 that can sense the rotation of the push rod 19 reaches 360 degrees, and then reverse the rotation back to 0 degrees ( The reverse value is negative), when it rotates to the intermediate value of 0 ⁇ 360 degrees, it will definitely turn back to 0 degrees.
- the system counts the cumulative value of the angle sensor 50 at the bottom of the pop-up body 21, and the system reads the angle sensor 50 as 0 degrees.
- the action state of the upper limit proximity sensor switch 13 will be reversed again (that is, return to the original action state of the upper limit proximity sensor switch 13 to facilitate the interlocking of the state through the latch and the lower limit proximity sensor switch 14) and the control circuit of the driver 18 will switch back to The reverse state prepares the driving member 18 for reverse rotation.
- the state change of the nut base 16 will immediately trigger the driving member 18 of the electric push rod 19 to reverse.
- an additional conventional RGB camera 24 can also be added to the pop-up 21 device according to application requirements. For example, it is used to make up for the lack of performance of the multi-fold optical zoom camera 23, which is dedicated to telephoto or macro functions or long-distance functions. A camera that has both focal and macro functions, a camera that enhances the high-definition resolution for forward applications, and so on.
- the pop-up body 21 When the pop-up body 21 is turned backward, as shown in the right figure of FIG. 5, it can form a comprehensive camera function combination effect of telephoto + wide angle + depth + main camera.
- the multi-zoom camera is used to control the short focal length to achieve close-up portrait selfies when used in the forward direction, and to control the long focal length to achieve the ideal long-range shooting requirements when used in the backward direction;
- the wide-angle camera 25 can be increased The large viewing area achieves a wider field of view and a grand and spectacular artistic effect;
- the depth camera 22 receives the infrared rays previously emitted to the scene and then the system calculates the infrared round-trip time difference to determine the depth of the scene, so as to realize the stereo recognition of the scene;
- the main camera is committed to With ultra-high precision, users can get a more perfect scene detail shooting experience.
- the cameras on the pop-up body 21 are a depth camera 22 based on TOF technology at the upper part and a multi-zoom camera at the lower part.
- the upper part of the depth camera 22 is an infrared transmitter, and the lower part is an infrared receiver (infrared camera).
- the multi-zoom camera adopts a periscope type, and the lower part of the periscope cavity penetrates into the narrowed cylindrical part of the lower part of the pop-up body 21.
- the present invention also provides a mobile terminal.
- the mobile terminal includes a housing 70 and the above-mentioned pop-up three-dimensional recognition device.
- the housing 70 is formed with a receiving groove, and the pop-up three-dimensional recognition device is telescopically installed in the housing 70.
- the mobile terminal can be a mobile phone or a tablet computer. Since the mobile terminal includes all the technical solutions of the above-mentioned pop-up three-dimensional recognition device, it has at least all the beneficial effects brought by all the above-mentioned technical solutions, which will not be repeated here.
- Waterproof and dustproof foam and a baffle 72 can also be added to the inside of the housing 70, wherein the middle opening of the baffle 72 can accommodate the ejector 21 to lift up and down.
- the baffle 72 in Fig. 2 can also be made to be thicker in the longitudinal direction and directly integrated with the fixed base 90. However, in general, it is not enough to leave a sinking space for the pop-up body 21 to be hidden inside the fuselage. Other cameras are placed in the space, so the pop-up body 21 of the three-dimensional recognition component 2 and the camera fixed on the rear of the fuselage can only be arranged in a misplaced layout, which is the state shown in Figure 1.
- the mobile terminal body when the thickness of the mobile terminal body is relatively thick, and there is enough space between the sinking space of the pop-up body 21 of the baffle 72 and the laterally parallel body rear shell, a typical wide-angle camera 25 can be placed.
- the rear camera (can be fixed on the baffle 72 or the fixed base 90 or can be fixed with another structure).
- the pop-up body 21 of the three-dimensional recognition component 2 and the camera fixed at the rear of the body do not need to be misaligned, and the mobile terminal can achieve the effects of FIG. 7 and FIG. 8.
- the pop-up and rotatable three-dimensional recognition assembly 2 containing two-dimensional and three-dimensional optical sensing devices can ensure that the front of the mobile terminal can normally have the function of a three-dimensional or three-dimensional front camera while ensuring a complete and full screen on the front of the mobile terminal. After changing the orientation, it can continue to be applied to three-dimensional recognition, especially when it is facing backwards, it can simultaneously participate in the realization of the comprehensive rear-facing camera function of the typical multi-function combination of telephoto + wide-angle + depth + main camera.
- the above-mentioned mobile terminal also has a processor and a memory.
- the processor runs the program by acquiring the information of the limit proximity sensor switch and the control circuit to ensure that the pop-up body is ejected to the preset position (the edge of the outer surface of the housing) before starting the pair of rotating parts.
- the pop-up body rotates and adjusts the rotation direction according to the information from the angle sensor; after the pop-up body pops up and determines the direction, the processor calculates the depth information of the depth camera about the target object and obtains the color information of the multi-fold optical zoom camera about the target object.
- the depth information and color information are fused and processed into three-dimensional image information to realize three-dimensional recognition of the target.
- the processor running program is stored in the memory of the mobile terminal.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Environmental & Geological Engineering (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Studio Devices (AREA)
Abstract
Description
标号Label |
名称 | 标号Label | 名称name | |
1111 |
联轴器 |
1212 |
回转架 |
|
1313 |
上限接近感应开关Upper limit |
1414 |
下限接近感应开关Lower limit |
|
1515 |
丝杆 |
1616 |
螺母座 |
|
1717 |
螺母座挡圈Nut |
1818 |
驱动件 |
|
1919 |
推杆 |
22 | 三维识别组件Three-dimensional recognition component | |
21twenty one | 弹出体Pop-up | 22twenty two | 深度摄像头Depth camera | |
23twenty three | 多倍光学变焦摄像头Multiple optical zoom camera | 24twenty four |
RGB摄像头 |
|
2525 |
广角摄像头Wide- |
2626 |
高清主摄像头HD |
|
2727 |
闪光灯 |
3030 |
旋转电机 |
|
4040 |
扭转弹簧 |
5050 |
角度传感器 |
|
6060 |
环境光学传感器Environmental |
7070 |
壳体 |
|
7171 |
防尘防水泡棉Dustproof and |
7272 |
挡板 |
|
8080 |
容纳槽 |
9090 | 固定基座Fixed base |
Claims (13)
- 一种弹出式三维识别装置,其特征在于,包括:A pop-up three-dimensional recognition device, which is characterized in that it comprises:推动件,所述推动件包括驱动件和推杆,所述驱动件用于驱动所述推杆伸出或缩回;A pushing member, the pushing member includes a driving member and a push rod, and the driving member is used to drive the push rod to extend or retract;三维识别组件,所述三维识别组件包括弹出体和设置在所述弹出体上的深度摄像头和多倍光学变焦摄像头;A three-dimensional recognition component, the three-dimensional recognition component comprising a pop-up body and a depth camera and a multi-fold optical zoom camera arranged on the pop-up body;旋转件,所述旋转件连接所述推杆和所述弹出体,所述旋转件用于驱动所述弹出体旋转以使得设置于所述弹出体上的深度摄像头和多倍光学变焦摄像头旋转。A rotating member that connects the push rod and the pop-up body, and the rotating member is used to drive the pop-up body to rotate so as to rotate the depth camera and the multiple optical zoom camera provided on the pop-up body.
- 根据权利要求1所述的弹出式三维识别装置,其特征在于,所述推动件设置限位接近感应开关以用于感知所述推杆伸缩的上限位状态和下限位状态,所述弹出体底部设置角度传感器用于感应所述推杆转动的角度;The pop-up three-dimensional identification device according to claim 1, wherein the pusher is provided with a limit proximity sensor switch for sensing the upper limit state and the lower limit state of the push rod expansion and contraction, and the bottom of the pop-up body Setting an angle sensor for sensing the angle of rotation of the push rod;其中,所述限位接近感应开关感知所述推杆的上限位状态,以用于控制所述弹出体弹出到预设位置后再启动所述旋转件驱动所述弹出体旋转,所述角度传感器与所述驱动件信号连接以用于调整所述弹出体的旋转方向。Wherein, the limit proximity sensor switch senses the upper limit state of the push rod, and is used to control the ejection body to eject to a preset position before starting the rotating member to drive the ejection body to rotate, and the angle sensor Signal connection with the driving member for adjusting the rotation direction of the ejection body.
- 根据权利要求2所述的弹出式三维识别装置,其特征在于,所述推动件还包括联轴器、回转架和设置在所述回转架的丝杆、套装于所述丝杆的螺母座,所述推杆与所述螺母座连接,所述联轴器连接所述驱动件和所述丝杆,所述限位接近感应开关设置于所述回转架;The pop-up three-dimensional identification device according to claim 2, wherein the pushing member further comprises a coupling, a revolving frame, a screw rod arranged on the revolving frame, and a nut seat sleeved on the screw rod, The push rod is connected with the nut base, the coupling is connected with the driving part and the screw rod, and the limit proximity sensor switch is arranged on the rotating frame;所述的弹出式三维识别装置还包括固定基座,在所述推杆缩回状态下,所述固定基座托住所述弹出体。The pop-up three-dimensional recognition device further includes a fixed base, and when the push rod is retracted, the fixed base supports the pop-up body.
- 根据权利要求3所述的弹出式三维识别装置,其特征在于,所述旋转件包括旋转电机,所述旋转电机与所述弹出体传动连接。The pop-up three-dimensional identification device according to claim 3, wherein the rotating member comprises a rotating motor, and the rotating motor is drivingly connected with the pop-up body.
- 根据权利要求4所述的弹出式三维识别装置,其特征在于,The pop-up three-dimensional recognition device according to claim 4, wherein:所述驱动件通过所述联轴器驱动所述丝杆转动,以使得套装在所述丝杆 上的所述螺母座上下移动;The driving member drives the screw rod to rotate through the coupling, so that the nut seat sleeved on the screw rod moves up and down;所述旋转电机位于所述推杆的上端、所述弹出体的底部。The rotating motor is located at the upper end of the push rod and the bottom of the ejection body.
- 根据权利要求3所述的弹出式三维识别装置,其特征在于,所述旋转件包括扭转弹簧,所述扭转弹簧的一端与所述固定基座连接,所述扭转弹簧的另一端与所述回转架连接;The pop-up three-dimensional identification device according to claim 3, wherein the rotating member comprises a torsion spring, one end of the torsion spring is connected to the fixed base, and the other end of the torsion spring is connected to the rotating base. Frame connection所述驱动件通过所述联轴器驱动所述丝杆转动,以使得套装在所述丝杆上的所述螺母座上下移动,并在所述螺母座到达其上限位置而停止上升后驱动所述螺母座旋转。The driving member drives the screw rod to rotate through the coupling, so that the nut base sleeved on the screw rod moves up and down, and drives the screw rod after the nut base reaches its upper limit position and stops rising. The nut seat rotates.
- 根据权利要求2至4中任一项所述的弹出式三维识别装置,其特征在于,所述三维识别装置还包括控制电路,所述控制电路与所述驱动件连接,以用于控制所述驱动件正转或反转。The pop-up three-dimensional recognition device according to any one of claims 2 to 4, wherein the three-dimensional recognition device further comprises a control circuit, and the control circuit is connected to the driving member for controlling the The drive unit rotates forward or reverse.
- 根据权利要求7所述的弹出式三维识别装置,其特征在于,所述限位接近感应开关包括上限接近感应开关和下限接近感应开关,所述上限接近感应开关设置于所述回转架的上端,所述下限接近感应开关设置于所述回转架的下端;所述限位接近感应开关为霍尔感应器件,所述霍尔感应器件与所述控制电路信号连接。The pop-up three-dimensional identification device according to claim 7, wherein the limit proximity sensor switch comprises an upper limit proximity sensor switch and a lower limit proximity sensor switch, and the upper limit proximity sensor switch is arranged at the upper end of the revolving frame, The lower limit proximity sensor switch is arranged at the lower end of the revolving frame; the limit proximity sensor switch is a Hall sensor device, and the Hall sensor device is signally connected to the control circuit.
- 根据权利要求3所述的弹出式三维识别装置,其特征在于,所述弹出体底部设置有环境光学传感器,所述环境光学传感器用于对弹出体是否弹出到预设位置进行辅助判断。The pop-up three-dimensional recognition device according to claim 3, wherein an environmental optical sensor is provided at the bottom of the pop-up body, and the environmental optical sensor is used to assist in determining whether the pop-up body is popped up to a preset position.
- 根据权利要求1所述的弹出式三维识别装置,其特征在于,所述深度摄像头用于在所述旋转件带动下获取多个方向下的目标物体的深度信息;所述多倍光学变焦摄像头用于在所述旋转件带动下获取多个方向下的目标物的彩色信息,所述多倍光学变焦摄像头可以通过调整光学焦距适配多个方向的不同摄像需求。The pop-up three-dimensional recognition device according to claim 1, wherein the depth camera is used to obtain the depth information of the target object in multiple directions under the drive of the rotating member; the multiple optical zoom camera is used for In order to obtain the color information of the target in multiple directions under the driving of the rotating member, the multi-fold optical zoom camera can adapt to different camera requirements in multiple directions by adjusting the optical focal length.
- 根据权利要求10所述的弹出式三维识别装置,其特征在于,The pop-up three-dimensional recognition device according to claim 10, wherein:所述多倍光学变焦摄像头可以通过调整光学焦距适配前向自拍和后向远景拍摄彩色信息时的不同摄像需求。The multiple optical zoom camera can adjust the optical focal length to adapt to different camera requirements for forward Selfie and backward long-range shooting of color information.
- 一种移动终端,其特征在于,所述移动终端包括壳体和上述权利要求1-11中任一项所述的弹出式三维识别装置,所述壳体形成有容纳槽,所述弹出式三维识别装置可伸缩地安装于所述容纳槽内。A mobile terminal, characterized in that, the mobile terminal comprises a housing and the pop-up three-dimensional identification device according to any one of the above claims 1-11, the housing is formed with a receiving groove, and the pop-up three-dimensional The identification device is telescopically installed in the containing groove.
- 根据权利要求12所述的移动终端,其特征在于,所述移动终端还具有处理器和存储器,所述处理器通过获取限位接近感应开关和控制电路的信息进行程序运行以确保所述弹出体弹出到预设位置后再启动旋转件对所述弹出体进行旋转,并根据角度传感器信息调整旋转方向,所述预设位置为所述壳体的外表面边沿;The mobile terminal according to claim 12, wherein the mobile terminal further has a processor and a memory, and the processor executes program operation by acquiring information about the limit proximity sensor switch and the control circuit to ensure that the ejection body After being ejected to a preset position, the rotating member is started to rotate the ejection body, and the rotation direction is adjusted according to the angle sensor information, where the preset position is the edge of the outer surface of the housing;所述处理器在所述弹出体弹出并确定方向后,通过计算所述深度摄像头关于目标物的深度信息和所述多倍光学变焦摄像头关于目标物的彩色信息,把深度信息和彩色信息融合处理为三维图像信息,进而实现对目标物的三维识别;After the pop-up body is ejected and the direction is determined, the processor calculates the depth information of the depth camera about the target object and the color information of the multi-fold optical zoom camera about the target object, and then merges the depth information and the color information. It is the three-dimensional image information, and then realizes the three-dimensional recognition of the target object;所述程序存储在所述移动终端的所述存储器中。The program is stored in the memory of the mobile terminal.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910824312.7 | 2019-09-02 | ||
CN201910824312.7A CN112532768B (en) | 2019-09-02 | 2019-09-02 | Pop-up three-dimensional identification device and mobile terminal |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021042854A1 true WO2021042854A1 (en) | 2021-03-11 |
Family
ID=74851972
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2020/099895 WO2021042854A1 (en) | 2019-09-02 | 2020-07-02 | Pop-up three-dimensional recognition device and mobile terminal |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN112532768B (en) |
WO (1) | WO2021042854A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115460338A (en) * | 2022-09-09 | 2022-12-09 | 江苏三棱智慧物联发展股份有限公司 | Intelligent Internet of things security management method and system |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113843154B (en) * | 2021-09-08 | 2023-06-13 | 浙江华眼视觉科技有限公司 | Single-piece separating device based on RGBD camera |
Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070279481A1 (en) * | 2004-09-23 | 2007-12-06 | Chambers Michael J | Mobile Communication Device Having Panoramic Imagemaking Capability |
US20110117958A1 (en) * | 2009-11-19 | 2011-05-19 | Lg Electronics Inc. | Mobile terminal and controlling method thereof |
US20150189175A1 (en) * | 2013-12-31 | 2015-07-02 | Futurewei Technologies Inc. | Automatic rotatable camera for panorama taking in mobile terminals |
CN106094990A (en) * | 2016-06-12 | 2016-11-09 | 张帆 | The screen maximized electronic equipment of accounting and using method thereof |
CN106657455A (en) * | 2016-10-25 | 2017-05-10 | 深圳奥比中光科技有限公司 | Electronic device with rotary camera |
CN106899721A (en) * | 2017-04-28 | 2017-06-27 | 广东欧珀移动通信有限公司 | Electronic installation |
CN207968579U (en) * | 2018-02-09 | 2018-10-12 | 广东欧珀移动通信有限公司 | Mobile terminal |
CN109547600A (en) * | 2018-12-25 | 2019-03-29 | 罗轶 | Thin cloud platform mobile phone |
CN208862908U (en) * | 2018-10-31 | 2019-05-14 | 信利光电股份有限公司 | A kind of camera arrangement using TOF |
CN109819079A (en) * | 2019-04-08 | 2019-05-28 | 维沃移动通信(杭州)有限公司 | A kind of terminal and camera control method |
CN111050154A (en) * | 2019-12-12 | 2020-04-21 | 天目爱视(北京)科技有限公司 | Mobile terminal with lifting type rotary 3D acquisition device |
-
2019
- 2019-09-02 CN CN201910824312.7A patent/CN112532768B/en active Active
-
2020
- 2020-07-02 WO PCT/CN2020/099895 patent/WO2021042854A1/en active Application Filing
Patent Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070279481A1 (en) * | 2004-09-23 | 2007-12-06 | Chambers Michael J | Mobile Communication Device Having Panoramic Imagemaking Capability |
US20110117958A1 (en) * | 2009-11-19 | 2011-05-19 | Lg Electronics Inc. | Mobile terminal and controlling method thereof |
US20150189175A1 (en) * | 2013-12-31 | 2015-07-02 | Futurewei Technologies Inc. | Automatic rotatable camera for panorama taking in mobile terminals |
CN106094990A (en) * | 2016-06-12 | 2016-11-09 | 张帆 | The screen maximized electronic equipment of accounting and using method thereof |
CN106657455A (en) * | 2016-10-25 | 2017-05-10 | 深圳奥比中光科技有限公司 | Electronic device with rotary camera |
CN106899721A (en) * | 2017-04-28 | 2017-06-27 | 广东欧珀移动通信有限公司 | Electronic installation |
CN207968579U (en) * | 2018-02-09 | 2018-10-12 | 广东欧珀移动通信有限公司 | Mobile terminal |
CN208862908U (en) * | 2018-10-31 | 2019-05-14 | 信利光电股份有限公司 | A kind of camera arrangement using TOF |
CN109547600A (en) * | 2018-12-25 | 2019-03-29 | 罗轶 | Thin cloud platform mobile phone |
CN109819079A (en) * | 2019-04-08 | 2019-05-28 | 维沃移动通信(杭州)有限公司 | A kind of terminal and camera control method |
CN111050154A (en) * | 2019-12-12 | 2020-04-21 | 天目爱视(北京)科技有限公司 | Mobile terminal with lifting type rotary 3D acquisition device |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115460338A (en) * | 2022-09-09 | 2022-12-09 | 江苏三棱智慧物联发展股份有限公司 | Intelligent Internet of things security management method and system |
CN115460338B (en) * | 2022-09-09 | 2024-05-24 | 江苏三棱智慧物联发展股份有限公司 | Intelligent Internet of things security management method and system |
Also Published As
Publication number | Publication date |
---|---|
CN112532768B (en) | 2023-09-05 |
CN112532768A (en) | 2021-03-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2021042854A1 (en) | Pop-up three-dimensional recognition device and mobile terminal | |
US9712749B2 (en) | Electronic device having multiple sides | |
US9880447B2 (en) | Camera module assembly with movable reflective elements | |
US11640000B2 (en) | System and method of capturing and generating panoramic three-dimensional images | |
CN102012627B (en) | Binocular stereo camera and 3d imaging system | |
KR20220002637A (en) | Control method of electronic device and electronic device | |
CN103533221A (en) | Camera lens device capable of shooting in two directions and mobile phone provided with camera lens device | |
EP4072118A1 (en) | Photographing method, photographing module, and electronic apparatus | |
CN105049687A (en) | Double-camera mobile terminal | |
CN108769325A (en) | Electronic device | |
EP4246952A1 (en) | Tof apparatus and electronic device | |
US11467475B2 (en) | Electronic device and concealed camera | |
CN111314506B (en) | Camera module and electronic equipment | |
CN112822415B (en) | Camera module and terminal equipment | |
CN208386660U (en) | Electronic device | |
US20220046177A1 (en) | Control device, camera device, movable object, control method, and program | |
WO2019120089A1 (en) | Lens device, camera device and moving body | |
US11886106B2 (en) | Photographing module and electronic device | |
WO2021031840A1 (en) | Device, photographing apparatus, moving body, method, and program | |
TW201308972A (en) | Mobile phone with 3-D imaging function | |
CN103916570B (en) | Circumscribed zoom modules and camera device | |
CN201298140Y (en) | A single lens stereo image optical signal acquisition device | |
US20210136293A1 (en) | Terminal device and shooting method | |
CN112313943A (en) | Device, imaging device, moving object, method, and program | |
CN211908920U (en) | Camera module and electronic equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20861566 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20861566 Country of ref document: EP Kind code of ref document: A1 |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20861566 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 25.08.2022) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20861566 Country of ref document: EP Kind code of ref document: A1 |