CN112532768A - Pop-up three-dimensional recognition device and mobile terminal - Google Patents

Pop-up three-dimensional recognition device and mobile terminal Download PDF

Info

Publication number
CN112532768A
CN112532768A CN201910824312.7A CN201910824312A CN112532768A CN 112532768 A CN112532768 A CN 112532768A CN 201910824312 A CN201910824312 A CN 201910824312A CN 112532768 A CN112532768 A CN 112532768A
Authority
CN
China
Prior art keywords
pop
dimensional recognition
driving
recognition device
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910824312.7A
Other languages
Chinese (zh)
Other versions
CN112532768B (en
Inventor
张永亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN201910824312.7A priority Critical patent/CN112532768B/en
Priority to PCT/CN2020/099895 priority patent/WO2021042854A1/en
Publication of CN112532768A publication Critical patent/CN112532768A/en
Application granted granted Critical
Publication of CN112532768B publication Critical patent/CN112532768B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/0202Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/026Details of the structure or mounting of specific components
    • H04M1/0264Details of the structure or mounting of specific components for a camera module assembly
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/0202Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/026Details of the structure or mounting of specific components
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72454User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/57Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/695Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/12Details of telephonic subscriber devices including a sensor for measuring a physical value, e.g. temperature or motion
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/20Details of telephonic subscriber devices including a rotatable camera

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Environmental & Geological Engineering (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Studio Devices (AREA)

Abstract

The invention provides a pop-up three-dimensional recognition device and a mobile terminal, wherein the three-dimensional recognition device comprises a pushing piece, a three-dimensional recognition component and a rotating piece, the pushing piece comprises a driving piece and a push rod, and the driving piece is used for driving the push rod to extend out or retract; the three-dimensional recognition assembly comprises a pop-up body, a depth camera and a multiple optical zoom camera, wherein the depth camera and the multiple optical zoom camera are arranged on the pop-up body; the rotating piece is connected with the push rod and the ejecting body and used for driving the ejecting body to rotate so as to enable the depth camera and the multiple optical zooming camera arranged on the ejecting body to rotate. The pushing piece is provided with a limit induction switch and a control circuit, the popping body is provided with an angle sensor, the mobile terminal processor performs program operation by acquiring information of the limit induction switch and the control circuit to ensure that the popping body stretches out of the mobile terminal shell and then starts the rotating piece to rotate the popping body, and further the rotating direction of the popping body is adjusted by acquiring information of the angle sensor. The processor runs a program stored in the mobile terminal memory.

Description

Pop-up three-dimensional recognition device and mobile terminal
Technical Field
The invention relates to the field of mobile terminals, in particular to a pop-up three-dimensional recognition device and a mobile terminal.
Background
Some mobile terminals in the market today have a front camera that is separated from the outside of the display screen in a pop-up manner to maintain the integrity of the screen surface of the display screen. The front camera is fixed on an electric push rod behind a display screen in the machine body, and the system controls the electric push rod to move up and down through a program instruction to realize a pop-up effect.
Meanwhile, the pop-up camera of the mobile terminal in the market is limited to be fixed towards the front, the pop-up structure has no rotation function, and the three-dimensional recognition device adopting the structured light or TOF (time of flight) technology is also fixed in the machine body, and can only be forward or backward and can not change the direction.
In view of the above, there is a need to provide a new pop-up three-dimensional recognition apparatus and a mobile terminal, so as to solve or at least alleviate the above technical drawbacks.
Disclosure of Invention
The invention mainly aims to provide a pop-up three-dimensional recognition device and a mobile terminal, and aims to solve the technical problem that the three-dimensional recognition device of the mobile terminal in the prior art cannot pop up and rotate.
To achieve the above object, according to one aspect of the present invention, there is provided a pop-up three-dimensional recognition apparatus including:
the pushing part comprises a driving part and a push rod, and the driving part is used for driving the push rod to extend or retract;
the three-dimensional recognition assembly comprises a popup body, and a depth camera and a multiple optical zoom camera which are arranged on the popup body;
the rotating piece is connected with the push rod and the ejecting body and used for driving the ejecting body to rotate so that the depth camera and the multiple optical zoom camera arranged on the ejecting body rotate.
Preferably, the pushing member is provided with a limit proximity inductive switch for sensing an upper limit state and a lower limit state of the extension of the push rod, and the bottom of the ejecting body is provided with an angle sensor for sensing the rotation angle of the push rod;
the limit proximity inductive switch senses upper limit state information of the push rod and is used for controlling the ejecting body to eject to a preset position and then starting the rotating piece to drive the ejecting body to rotate, and the angle sensor is in signal connection with the driving piece and is used for adjusting the rotating direction of the ejecting body.
Preferably, the pushing member further comprises a coupling, a rotating frame, a limit proximity inductive switch arranged on the rotating frame, a screw rod and a nut seat sleeved on the screw rod, the push rod is connected with the nut seat, and the coupling is connected with the driving member and the screw rod;
the pop-up three-dimensional recognition device also comprises a fixed base, wherein the fixed base is used for ensuring the stable operation of the pushing piece, and the fixed base supports the pop-up body in the retraction state of the push rod.
Preferably, the rotating member comprises two driving modes of a rotating motor and a torsion spring;
when the rotating piece is a rotating motor, the rotating motor is in transmission connection with the ejecting body;
when the rotating piece is a torsion spring, one end of the torsion spring is connected with the fixed base, and the other end of the torsion spring is connected with the rotary frame.
Preferably, the three-dimensional identification device further comprises a control circuit, and the control circuit is connected with the driving member and used for controlling the driving member to rotate forwards or backwards.
Preferably, the limit proximity inductive switch comprises an upper limit proximity inductive switch and a lower limit proximity inductive switch, the upper limit proximity inductive switch is arranged at the upper end of the revolving frame, and the lower limit proximity inductive switch is arranged at the lower end of the revolving frame; the limiting proximity inductive switch is a Hall sensing device, and the Hall sensing device is in signal connection with the control circuit.
Preferably, an environment optical sensor is arranged at the bottom of the pop-up body, and the environment optical sensor is used for performing auxiliary judgment on whether the pop-up body pops up to a preset position.
Preferably, the depth camera is used for acquiring depth information of target objects in multiple directions under the driving of the rotating member;
the multifold optical zoom camera is used for acquiring the color information of the target object under multiple directions under the driving of the rotating piece, and can adapt to different camera shooting requirements of multiple directions, particularly forward self-shooting and backward long-range shooting of the color information through adjusting the optical focal length.
According to another aspect of the present invention, the present invention further provides a mobile terminal, which includes a housing and the pop-up three-dimensional recognition device, wherein the housing is formed with a receiving slot, and the pop-up three-dimensional recognition device is telescopically mounted in the receiving slot.
Preferably, the mobile terminal further comprises a processor and a memory, the processor performs program operation by obtaining information of the position-limiting proximity inductive switch and the control circuit to ensure that the popup body pops up to a preset position, namely the edge of the outer surface of the shell, and then starts the rotating piece to rotate the popup body and adjust the rotating direction according to the information of the angle sensor;
after the popup body pops up and the direction is determined, the processor fuses the depth information and the color information into three-dimensional image information by calculating the depth information of the depth camera about the target object and acquiring the color information of the multiple optical zoom camera about the target object, so as to realize the three-dimensional identification of the target object;
the processor runs a program stored in the memory of the mobile terminal.
According to another aspect of the present invention, the present invention further provides a mobile terminal, which includes a housing and the pop-up three-dimensional recognition device, wherein the housing is formed with a receiving slot, and the pop-up three-dimensional recognition device is telescopically mounted in the receiving slot.
The mobile terminal is provided with a processor and a memory, the processor performs program operation by acquiring information of the limit inductive switch and the control circuit to ensure that the popup body is popped to a preset position, namely the edge of the outer surface of the shell, then the rotating piece is started to rotate the popup body, and the rotating direction is adjusted according to the information of the angle sensor.
Further, after the popup body pops up and determines the direction, the processor processes the depth information and the color information into three-dimensional image information by calculating the depth information of the depth camera about the target object and acquiring the color information of the multiple optical zoom camera about the target object, and further realizes the three-dimensional recognition of the target object.
The processor runs a program stored in the memory of the mobile terminal.
In the technical scheme of the invention, the pop-up three-dimensional recognition device comprises a push piece, a three-dimensional recognition component and a rotating piece, wherein the push piece comprises a driving piece and a push rod, and the driving piece is used for driving the push rod to extend out or retract; the three-dimensional recognition assembly comprises a pop-up body, a depth camera and a multiple optical zoom camera, wherein the depth camera and the multiple optical zoom camera are arranged on the pop-up body; the rotating piece is connected with the push rod and the ejecting body and used for driving the ejecting body to rotate so that the camera arranged on the ejecting body rotates. The three-dimensional identification assembly and the rotating piece are pushed out to the preset position through the extension of the push rod, and the rotating piece drives the pop-up body to rotate, so that the three-dimensional identification assembly arranged on the pop-up body rotates. Compared with the prior art, the method has the advantage that the three-dimensional recognition device of the mobile terminal can pop up and rotate.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the structures shown in the drawings without creative efforts.
FIG. 1 is a schematic diagram of a dual-motor scheme of a pop-up three-dimensional recognition apparatus according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a single motor scheme of a pop-up three-dimensional recognition device according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a single motor scheme control circuit of a pop-up three-dimensional recognition device according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a control path of a pop-up three-dimensional recognition apparatus according to an embodiment of the present invention;
FIG. 5 is a diagram of a mobile terminal according to another embodiment of the present invention;
fig. 6 is another schematic diagram of a mobile terminal according to another embodiment of the present invention (with an RGB camera added);
fig. 7 is a further schematic diagram of a mobile terminal according to another embodiment of the invention;
fig. 8 is a schematic view of another state of fig. 7.
The reference numbers illustrate:
Figure BDA0002188576820000041
Figure BDA0002188576820000051
the implementation, functional features and advantages of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, are within the scope of the present invention.
It should be noted that all the directional indicators (such as the upper and lower … …) in the embodiment of the present invention are only used to explain the relative position relationship, movement, etc. of the components in a specific posture (as shown in the drawings), and if the specific posture is changed, the directional indicator is changed accordingly.
In addition, the descriptions related to "first", "second", etc. in the present invention are only for descriptive purposes and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature.
Moreover, the technical solutions in the embodiments of the present invention may be combined with each other, but it is necessary to be able to be realized by a person skilled in the art, and when the technical solutions are contradictory or cannot be realized, the combination of the technical solutions should be considered to be absent, and is not within the protection scope of the present invention.
It should be noted that the directions in the present invention are based on the directions shown in fig. 1, that is, "up, down, horizontal, and vertical" in the present invention correspond to "up, down, horizontal, and vertical" directions in fig. 1, respectively.
Referring to fig. 1 and 2, according to an aspect of the present invention, there is provided a pop-up three-dimensional recognition apparatus including:
the pushing part comprises a driving part and a push rod 19, and the driving part is used for driving the push rod 19 to extend or retract;
a three-dimensional recognition component 2 including a pop-up body 21, and a depth camera 22 and a multiple optical zoom camera 23 provided on the pop-up body 21;
and a rotating member connecting the push rod 19 and the ejecting body 21, the rotating member being configured to drive the ejecting body 21 to rotate so as to rotate the depth camera 22 and the multiple optical zoom camera 23 disposed on the ejecting body 21.
In the above embodiment, the three-dimensional recognition assembly 2 and the rotating member are pushed out to the preset position by the extension of the push rod 19, and the ejecting body 21 is driven to rotate by the rotating member so that the depth camera 22 and the multiple optical zoom camera 23 provided on the ejecting body 21 are rotated. Compared with the prior art, the method has the advantage that the three-dimensional recognition device of the mobile terminal can pop up and rotate. The embodiment is particularly suitable for mobile terminals, especially mobile phones. The pop-up three-dimensional recognition device is arranged in the shell 70, when the pop-up three-dimensional recognition device is required to be used, the push rod 19 is controlled to extend out through the keys of the mobile phone screen to expose the three-dimensional recognition component 2 outside the shell 70 at the top of the mobile phone, the camera can start to take pictures or take pictures, and the three-dimensional recognition component 2 can be driven to rotate 360 degrees through the rotating piece, so that images at various angles can be taken. Compared with the prior art, the method has the advantage that the three-dimensional recognition device of the mobile terminal can pop up and rotate. The driving member may be a driving motor.
The depth camera 22 is currently implemented by using a time of flight (TOF) technology and a structured light technology. The TOF technology transmits infrared light to a target object through an infrared pulse transmitter, an infrared camera receives the infrared light reflected by the target object, and a system calculates the time difference between the received infrared light and the previously transmitted infrared light to determine scene depth information. For TOF technique, structured light technique relates to infrared light filling lamp, infrared dot matrix projector, infrared camera, distance sensor etc. and through calculating the facula array of the change of received through scenery reflection and the difference of the structural feature light spot array of transmitting before and establishing scenery depth information, the device is more and bulky, and the diffraction facula of stripe adjustment easily receives highlight interference and decay seriously, so backward the application effect is poor. At the same time, structured light has a large baseline (baseline, i.e. the projector and receiver need to be kept at a certain distance), the TOF technology baseline can be almost zero. In addition to the separate use of existing TOF technology for forward and backward applications, the depth camera 22 of fig. 5 prefers the TOF technology solution. Two parts outside the depth camera 22, an infrared transmitter and an infrared receiver.
For the multiple optical zoom camera 23, at present, two times or less can be realized by a camera module close to a cube, and more than three times of the camera module need to be considered to be made into a periscopic type, and the camera module comprises a lens, an upper steering prism, a zoom/focus lens group, a lens group driving mechanism, an upper filter, a lower steering prism, an optical induction substrate and the like, wherein the lens group is the zoom/focus lens group. The periscopic multiple optical zoom camera 23 module cavity is significantly lengthened by the lens group to form a significant cuboid; the turning lens and the turning lens change the light path to the lens group cavity, and the lens group driving mechanism controls the lens group distance transformation to realize multiple times of optical zooming (the lens presents a wide-angle to long-focus effect). The optical zooming effect is far better than the digital zooming effect of a software means, and the multiple optical zooming can be flexibly configured according to different scenes to obtain a better shooting effect, so that the method is very suitable for the trend that the shooting performance of the mobile terminal is continuously improved. When the multiple optical zoom camera 23 is used in the forward direction, the system controls the camera to have a relatively short focal length to realize the self-photographing of a close range portrait or maintain a long focal length, but meets the requirements of a macro function (namely, a long-focus macro lens) for realizing macro photographing and the like by regulating and controlling a lens group or inserting a clamping piece; when the system is used for backward direction, the system mainly controls the system to be in a long focal length to realize ideal long-range shooting requirements, and certainly, the focal length can be randomly changed to meet the diversified shooting requirements. This back-and-forth translation may be achieved by rotating ejection body 21 180 degrees. In particular, the periscopic multiple optical zoom camera 23 can be fused to the rotating structure of the pop-up body 21, which is beneficial to optimizing the structural space.
The depth camera 22 and the periscopic multiple optical zoom camera 23 are jointly arranged in the pop-up body 21, and the depth D information of the depth camera 22 and the two-dimensional RGB information of the multiple optical zoom camera 23 are combined into three-dimensional RGBD information, so that three-dimensional recognition and related application are facilitated; when the pop-up body 21 is rotated, the three-dimensional recognition application can be performed in any direction, and the backward three-dimensional recognition is typically realized by directly converting from the forward direction to the backward direction. Therefore, the system can meet the requirements of the current mature forward face three-dimensional identification safe unlocking and payment application, and can also fit with the current backward AR/VR photographing and game, virtual shopping, distance measurement, indoor positioning navigation and other wider application trends.
According to the preferred embodiment of the present invention, referring to fig. 1 and 2 again, the pushing member further includes a coupling 11, a turret 12, a limit proximity sensor switch disposed on the turret 12, a lead screw 15, and a nut seat 16 sleeved on the lead screw 15, wherein the push rod 19 is connected with the nut seat 16, and the coupling 11 connects the driving member 18 and the lead screw 15. The bottom of the screw rod 15 is embedded into the coupling 11, and the top is connected with the upper end of the revolving frame 12. The driving member 18 drives the screw rod 15 to rotate through the coupling 11 (here, the screw rod 15 only rotates, and does not move in the up-down direction), so that the nut seat 16 sleeved on the screw rod 15 moves up and down, and the push rod 19 connected with the nut seat 16 extends or retracts. Only the part of the screw rod 15 positioned in the rotary frame 12 is provided with threads, so that the stroke interval of the nut seat 16 is limited, and the effect of forming the ball screw rod 15 by adopting balls for the nut seat 16 is better. A nut seat retainer ring 17 can be additionally arranged at the position of the nut seat 16 close to the top end of the rotating frame 12, and a push rod 19 is connected with the nut seat retainer ring 17. In this embodiment, the driving member 18 drives the screw rod 15 to rotate through the coupling 11, and drives the nut seat 16 to move up and down, so as to change the rotational motion of the driving member 18 into a linear motion, and further drive the three-dimensional identification component 2 fixed on the push rod 19 to move up and down. The nut seat 16 is respectively provided with an upper limit proximity inductive switch 13 and a lower limit proximity inductive switch 14 at the inner positions of the rotary frame 12 corresponding to the upper limit and the lower limit of the stroke, the upper limit proximity inductive switch 13 and the lower limit proximity inductive switch 14 can be made of Hall devices (optical couplers and thyristors, also available), and when the nut seat 16 approaches the upper limit proximity inductive switch 13 or the lower limit proximity inductive switch 14, the driving piece 18 is stopped, so as to prevent the driving piece 18 from continuously operating at the upper limit and the lower limit of the stroke. Although the lens area of the depth camera 22 and the multiple optical zoom camera 23 in the three-dimensional recognition module is not large, the camera module and the connection circuit behind the lens occupy a large space, so that the pop-up body 21 is generally wide at the top and narrow at the bottom, the top is a cube with a rectangular, trapezoidal or elliptical cross section and a shape close to a regular plane, and the bottom is a cylinder or an ellipse close to a cylinder. Therefore, the ejector 21 needs to be rotated (not rotated inside the housing 70) with the upper portion raised out of the top of the housing 70.
According to a preferred embodiment of the present invention, still referring to fig. 1 and 2, said housing 70 is formed with a receiving groove 80, and the pop-up three-dimensional recognition means is telescopically mounted in said receiving groove 80; meanwhile, the pop-up three-dimensional recognition device further includes a fixing base 90 (which is usually firmly fixed with the housing 70 or the middle frame inside the mobile terminal), and a middle opening passes through the push rod 19 for ensuring the stable operation of the push member and supporting the pop-up body 21 in the retracted state of the push rod 19. In particular, although the receiving slot 80 is shown as an opening of the baffle 72 in fig. 1 and 2, the baffle 72 may be directly formed into a hopper shape to directly wrap the receiving slot 80, and even the hopper-shaped baffle 72 may be integrally formed with the fixed base 90.
The invention mainly has the following two embodiments:
the first method comprises the following steps: double-motor scheme
Referring to fig. 1, the dual motor refers here to the drive member 18 and the rotary motor 30. The solution is that a rotating motor 30 capable of driving the ejection body 21 to rotate is arranged at the bottom of the ejection body 21, besides the driving element 18, at the upper end of the push rod 19. After the ejection body 21 and the camera head are partially pushed out to a predetermined position (which may be after the mobile phone case 70 is pushed out), the rotation motor 30 drives the ejection body 21 to rotate, so that the camera head provided to the ejection body 21 rotates to change the direction. The direction and angle of the rotation of the pop-up body 21 can be arbitrary, the rotation angle can reach 360 degrees, and the common mode is forward and backward, so that the camera on the pop-up body 21 can be multiplexed forward and backward.
It should be noted that, in the above solution, in order to avoid that the ejection body 21 is not completely extended out of the housing 70, the rotating motor 30 drives the ejection body 21 to rotate, which results in structural damage to the ejection body 21 (and therefore the ejection body 21 is still inside the mobile phone housing), when the nut seat 16 reaches the upper limit of the stroke, the corresponding upper limit approaches the inductive switch 13 and then the driving member 18 is turned off, and at the same time, the control circuit of the rotating motor 30 is turned on. The upper limit approach sensor switch 13 immediately shuts off the control circuit for the rotary motor 30 once the nut holder 16 is lowered from the top of the stroke, which ensures that the rotary motor 30 can only be operated after the nut holder 16 reaches the upper limit of the stroke, and the rotary motor 30 stops rotating when the nut holder 16 is about to be lowered. Of course, it is necessary to ensure that the ejection body 21 is restored to the state before the rotation after the last rotation of the rotation motor 30 is completed, otherwise the retraction into the inside of the body is impossible (as long as the ejection body 21 is not regularly circular, it is ensured that the direction of the ejection body 21 coincides with the direction before the ejection of the mobile phone case 70, or else it may be caught and not retracted). Therefore, the driver 18 is not immediately triggered to rotate in reverse when the state of the upper limit proximity sensor switch 13 changes, but is allowed to rotate in reverse until the return notification signal of the rotating electric machine 30 is received. To confirm whether the rotation motor 30 returns to the initial position, an angle sensor 50 capable of sensing rotation of a transmission shaft of the rotation motor 30 may be disposed at the bottom of the ejecting body 21, and when the angle sensor 50 detects that the rotation angle is 0 degree or 360 degrees, the angle sensor 50 sends a homing notification signal to the driving member 18. Of course, if the ejection body 21 has a regular rectangular or elliptical cross section, the angle sensor 50 may send a homing notification signal to the driving member 18 when the angle sensor 50 detects that the rotation angle is 180 degrees. The angle sensor 50 is preferably a three-axis hall angle sensor 50. In order to ensure that the rotation of the rotary motor 30 is started when the ejection body 21 is exposed outside the housing 70, an ambient light sensor may be provided at the bottom of the ejection body 21, and whether or not to control the rotation of the rotary motor 30 may be determined based on a state value of the ambient light sensor at that time.
And the second method comprises the following steps: single motor scheme
Referring to fig. 2, a torsion spring 40 is disposed between the outer upper end of the turret 12 and the lower end of the fixed base 90, and the torsion spring 40 is pre-stressed to maintain the turret 12 in a balanced position. The nut seat retaining ring 17 is placed on the inner side of the top of the rotary frame 12, the nut seat 16 stops rising when rising to the nut seat retaining ring 17 along with the driving of the driving part 18 in the rotary frame 12, and then the driving part 18 overcomes the torque generated by the torsion spring 40, so that the nut seat 16 and the rotary frame 12 can continuously rotate within 360 degrees, and the three-dimensional identification assembly 2 fixed with the nut seat 16 is driven to rotate. Further, the driving member 18 rotates reversely, the driving member 18 drives the lead screw 15 to apply a reverse torque, the torsion spring 40 drives the rotary frame 12 and the nut seat 16 to rotate reversely to the equilibrium position, and then the nut seat 16 descends. The nut seat 16 is thus raised, rotated in the forward direction, rotated in the reverse direction, and lowered, and the push rod 19 and the ejection body 21, which are fixed to the nut seat 16, are correspondingly raised and lowered and rotated.
It is important to note that the mechanism for lifting and rotating the ejecting body 21 needs to be performed under a strict logic control circuit of the system, even if the lifting or rotating of the ejecting body 21 at an inappropriate time may cause structural damage. For this reason, the upper limit approach inductive switch 13 in the single motor scheme is controlled by the combinational logic control circuit after the nut socket 16 approaches the triggered shutdown driving member 18. Firstly, the system control command performs forced reversal on the state of the upper limit proximity inductive switch 13 when the driving element 18 is currently turned off after a preset time is delayed by a delay circuit, or performs forced reversal according to the state of the optional ambient light sensor at the bottom of the ejecting body 21, so that the driving element 18 can be started again to rotate against the pretightening force of the torsion spring 40. Then, after the system controls the driving member 18 to complete the same amount of reverse rotation, the driving member 18 is set to the off state (i.e., the state of the driving member 18 is restored to the state consistent with the upper limit proximity sensor switch 13 turning off the driving member 18). At this time, the push rod 19 is in a stage of changing from rotation to lifting, the upper limit proximity inductive switch 13 is in a stage of stopping the driving piece 18, meanwhile, the lower limit proximity inductive switch 14 is set to be capable of driving the driving piece 18 by the system, and the setting of the off state again is convenient for the upper limit proximity inductive switch 13 and the lower limit proximity inductive switch 14 to realize state interlocking according to a positive and negative rotation control signal, and is beneficial to the reliability of reciprocating during the lifting of the push rod 19. The logic control circuit of this part is shown as the drive member 18 switch control circuit in the lower left part of fig. 3. In addition, the system can control related circuits in the driving chip of the driving part 18 through a pulse control signal and a forward/reverse rotation control signal, so as to effectively control the stepping progress and forward/reverse rotation of the driving part 18, as shown in fig. 3 (the chip control is more space-saving compared with a time relay and a linked switch).
It should be noted that, in the above-mentioned two-motor driving scheme, the rotary frame 12 may be fixed, and the nut seat 16 may only move up and down and not rotate left and right with respect to the rotation of the lead screw 15, but in the single-motor driving scheme, the rotary frame 12 and the nut seat 16 may rotate at the top end of the lifting stroke, and this rotation may also rotate the push rod 19 fixed with the nut seat 16, and further the three-dimensional recognition component 2 pop-up body 21 fixed with the push rod 19 may also rotate, thereby realizing the direction change of the three-dimensional recognition component 2.
After the pop-up body 21 of the single-motor scheme rotates, the angle sensor 50 can be arranged at the bottom of the pop-up body 21, the rotation can be stopped when the angle sensor 50 positioned at the bottom of the pop-up body 21 can sense the rotation of the push rod 19 reaches 360 degrees, then the rotation is reversely rotated back to 0 degree (the reverse value is negative), the rotation can be reversely rotated back to 0 degree when the angle sensor 50 rotates to a middle value of 0-360 degrees, the system counts the accumulated value of the angle sensor 50 at the bottom of the pop-up body 21, the system reads the angle sensor 50 to be 0 degree and can reversely rotate the action state of the upper limit approaching induction switch 13 again (namely, the upper limit approaching induction switch 13 returns to the original action state so as to be interlocked with the lower limit approaching induction switch 14 state through the latch) and the control circuit of the driving piece. When the driver 18 rotates reversely to the lower limit and approaches the inductive switch 14, the state change caused by the approach of the nut seat 16 immediately triggers the electric push rod 19 to rotate reversely by the driver 18.
The single motor scheme and dual motor scheme control paths described above are shown in fig. 4.
As shown in fig. 4, an additional conventional RGB camera 24 may be added to the pop-up body 21 according to the application requirement, such as a camera dedicated to the telephoto or macro function or both the telephoto and macro function for compensating the performance deficiency of the multiple optical zoom camera 23, a camera for enhancing the high resolution in the forward application, and so on.
When the pop-up body 21 turns backward, as shown in the right diagram of fig. 5, a combined effect of all image pickup functions of tele + wide + depth + main image pickup can be formed. For each single camera, the multiple zooming camera is used for controlling short focal length to realize the requirements of close range portrait self-shooting and the like in the forward direction and mainly controlling long focal length to realize the ideal long-range shooting requirement in the backward direction; the wide-angle camera 25 can enlarge the viewing surface, so as to achieve the artistic effects of wider visual field and grand and magnificent appearance; after the depth camera 22 receives the infrared rays which are transmitted to the scenery before and reflected back, the system calculates the infrared round-trip time difference to determine the depth of the scenery, thereby realizing the three-dimensional recognition of the scenery; the main camera aims at ultrahigh precision, so that a user can obtain more perfect scene detail shooting experience. In terms of camera combination, at present, two cameras are usually combined for shooting, and most of the other three cameras are respectively combined with a main camera, so that complementary and enhanced shooting effects are achieved. The cameras on the pop-up body 21 are a depth camera 22 based on TOF technology on the upper part and a multiple zoom camera on the lower part. The depth camera 22 has an infrared transmitter at the upper portion and an infrared receiver (infrared camera) at the lower portion. The multifold zooming camera adopts a periscopic mode, and the lower part of a periscopic cavity body extends into the narrowed cylinder part at the lower part of the pop-up body 21.
According to another aspect of the present invention, the present invention further provides a mobile terminal comprising a housing 70 and the above-mentioned pop-up three-dimensional recognition device, wherein the housing 70 is formed with a receiving slot, and the pop-up three-dimensional recognition device is telescopically mounted in the receiving slot. The mobile terminal can be a mobile phone or a tablet computer. Since the mobile terminal includes all technical solutions of the pop-up three-dimensional recognition device, at least all beneficial effects brought by all the technical solutions are achieved, and are not described in detail herein. Waterproof dustproof foam and a baffle plate 72 can be additionally arranged on the inner side of the shell 70, wherein the middle of the baffle plate 72 is provided with a hole for accommodating the popup body 21 to lift. The baffle 72 of fig. 2 can also be made to be a structure that is directly integrated with the fixed base 90, but in general, because a sinking space for the pop-up body 21 to be hidden inside the body is provided, and there is not enough lateral space for placing other cameras, the pop-up body 21 and the cameras fixed at the rear of the body of the three-dimensional recognition component 2 can only be arranged in a staggered manner, that is, in the state of fig. one. However, when the thickness of the mobile terminal body is thick, in the case that there is enough space between the sinking space of the pop-up body 21 of the barrier 72 and the rear case of the body which is laterally parallel, a rear camera such as the wide-angle camera 25 may be placed again (it may be fixed on the barrier 72 or the fixed base 90 or may be fixed in another structure). Thus, the three-dimensional recognition component 2 pop-up body 21 and the camera fixed at the rear part of the body do not need to be arranged in a staggered way, and the mobile terminal can achieve the effects of fig. 7 and 8. The optical sensor device of fig. 8 also ensures that the space occupied by the revolving frame 12 and the motor of the electric push rod 19 is not large, otherwise the main camera and the flashlight 27 can only be arranged in a staggered way as shown in fig. seven and fig. one. Fig. 1 can also be handled as in fig. 8 in a case where the lateral space occupation of the motor or the pusher 19 of the ejector body 21 is not large. According to the embodiment, the three-dimensional identification component 2 which is raised in a pop-up mode and can rotate and comprises the two-dimensional optical sensing device and the three-dimensional optical sensing device can normally have the three-dimensional or three-dimensional front camera function under the condition that the front face of the mobile terminal is completely and comprehensively shielded, can be continuously applied to three-dimensional identification after the orientation is changed in a rotating mode, and can synchronously participate in realizing the comprehensive backward camera function of the multifunctional combination of the long focus, the wide angle, the depth and the main camera particularly in the backward direction.
In addition, the mobile terminal is also provided with a processor and a memory, the processor performs program operation by acquiring information of the limit proximity inductive switch and the control circuit so as to ensure that the popup body pops up to a preset position as the edge of the outer surface of the shell, then the rotating piece is started to rotate the popup body, and the rotating direction is adjusted according to the information of the angle sensor; after the popup body pops up and the direction is determined, the processor fuses the depth information and the color information into three-dimensional image information by calculating the depth information of the depth camera about the target object and acquiring the color information of the multiple optical zoom camera about the target object, and further realizes three-dimensional identification of the target object, and the processor runs a program and stores the program in a memory of the mobile terminal.
In the above technical solutions, the above are only preferred embodiments of the present invention, and the technical scope of the present invention is not limited thereby, and all the technical concepts of the present invention include the claims of the present invention, which are directly or indirectly applied to other related technical fields by using the equivalent structural changes made in the content of the description and the drawings of the present invention.

Claims (10)

1. A pop-up three-dimensional recognition device, comprising:
the pushing part comprises a driving part and a push rod, and the driving part is used for driving the push rod to extend or retract;
the three-dimensional recognition assembly comprises a popup body, and a depth camera and a multiple optical zoom camera which are arranged on the popup body;
the rotating piece is connected with the push rod and the ejecting body and used for driving the ejecting body to rotate so that the depth camera and the multiple optical zoom camera arranged on the ejecting body rotate.
2. The pop-up three-dimensional recognition device according to claim 1, wherein the pushing member is provided with a limit proximity sensing switch for sensing an upper limit state and a lower limit state of the extension and retraction of the push rod, and the bottom of the pop-up body is provided with an angle sensor for sensing a rotation angle of the push rod;
the limit proximity inductive switch senses upper limit state information of the push rod and is used for controlling the ejecting body to eject to a preset position and then starting the rotating piece to drive the ejecting body to rotate, and the angle sensor is in signal connection with the driving piece and is used for adjusting the rotating direction of the ejecting body.
3. The pop-up three-dimensional recognition device according to claim 2, wherein the pushing member further comprises a coupling, a turret, a limit proximity sensor switch arranged on the turret, a lead screw, and a nut seat sleeved on the lead screw, the push rod is connected with the nut seat, and the coupling connects the driving member and the lead screw;
the pop-up three-dimensional recognition device also comprises a fixed base, wherein the fixed base is used for ensuring the stable operation of the pushing piece, and the fixed base supports the pop-up body in the retraction state of the push rod.
4. The pop-up three-dimensional recognition device according to claim 3, wherein the rotating member includes both driving means of a rotating motor and a torsion spring;
when the rotating piece is a rotating motor, the rotating motor is in transmission connection with the ejecting body;
when the rotating piece is a torsion spring, one end of the torsion spring is connected with the fixed base, and the other end of the torsion spring is connected with the rotary frame.
5. The pop-up three-dimensional recognition device of claim 2, further comprising a control circuit connected to the driving member for controlling the driving member to rotate forward or backward.
6. The pop-up three-dimensional recognition device according to claim 3, wherein the limit proximity sensing switch comprises an upper limit proximity sensing switch and a lower limit proximity sensing switch, the upper limit proximity sensing switch is disposed at an upper end of the turret, and the lower limit proximity sensing switch is disposed at a lower end of the turret; the limiting proximity inductive switch is a Hall sensing device, and the Hall sensing device is in signal connection with the control circuit.
7. The pop-up three-dimensional recognition device according to claim 3, wherein an environmental optical sensor is disposed at the bottom of the pop-up body, and the environmental optical sensor is used for assisting in determining whether the pop-up body pops up to a preset position.
8. The pop-up three-dimensional recognition device according to claim 1, wherein the depth camera is configured to obtain depth information of the target object in multiple directions under the driving of the rotating member; the multifold optical zoom camera is used for acquiring the color information of the target object under multiple directions under the driving of the rotating piece, and can adapt to different camera shooting requirements of multiple directions, particularly forward self-shooting and backward long-range shooting of the color information through adjusting the optical focal length.
9. A mobile terminal, characterized in that it comprises a housing and a pop-up three-dimensional recognition device according to any of the preceding claims 1-8, said housing being formed with a receiving slot, said pop-up three-dimensional recognition device being telescopically mounted in said receiving slot.
10. The mobile terminal according to claim 9, wherein the mobile terminal further comprises a processor and a memory, the processor performs program operation by acquiring information of a limit proximity inductive switch and a control circuit to ensure that the popup body pops up to a preset position, namely the edge of the outer surface of the housing, and then starts the rotating member to rotate the popup body and adjust the rotating direction according to the information of the angle sensor;
after the popup body pops up and the direction is determined, the processor fuses the depth information and the color information into three-dimensional image information by calculating the depth information of the depth camera about the target object and acquiring the color information of the multiple optical zoom camera about the target object, so as to realize the three-dimensional identification of the target object;
the processor runs a program stored in the memory of the mobile terminal.
CN201910824312.7A 2019-09-02 2019-09-02 Pop-up three-dimensional identification device and mobile terminal Active CN112532768B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201910824312.7A CN112532768B (en) 2019-09-02 2019-09-02 Pop-up three-dimensional identification device and mobile terminal
PCT/CN2020/099895 WO2021042854A1 (en) 2019-09-02 2020-07-02 Pop-up three-dimensional recognition device and mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910824312.7A CN112532768B (en) 2019-09-02 2019-09-02 Pop-up three-dimensional identification device and mobile terminal

Publications (2)

Publication Number Publication Date
CN112532768A true CN112532768A (en) 2021-03-19
CN112532768B CN112532768B (en) 2023-09-05

Family

ID=74851972

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910824312.7A Active CN112532768B (en) 2019-09-02 2019-09-02 Pop-up three-dimensional identification device and mobile terminal

Country Status (2)

Country Link
CN (1) CN112532768B (en)
WO (1) WO2021042854A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113843154A (en) * 2021-09-08 2021-12-28 浙江华眼视觉科技有限公司 Single piece splitter based on RGBD camera

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115460338B (en) * 2022-09-09 2024-05-24 江苏三棱智慧物联发展股份有限公司 Intelligent Internet of things security management method and system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106094990A (en) * 2016-06-12 2016-11-09 张帆 The screen maximized electronic equipment of accounting and using method thereof
CN106899721A (en) * 2017-04-28 2017-06-27 广东欧珀移动通信有限公司 Electronic installation
CN109547600A (en) * 2018-12-25 2019-03-29 罗轶 Thin cloud platform mobile phone
CN109819079A (en) * 2019-04-08 2019-05-28 维沃移动通信(杭州)有限公司 A kind of terminal and camera control method

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101074284B1 (en) * 2004-09-23 2011-10-17 에이저 시스템즈 인크 Mobile communication device having panoramic imagemaking capability
US8922625B2 (en) * 2009-11-19 2014-12-30 Lg Electronics Inc. Mobile terminal and controlling method thereof
US10021296B2 (en) * 2013-12-31 2018-07-10 Futurewei Technologies, Inc. Automatic rotatable camera for panorama taking in mobile terminals
CN106657455B (en) * 2016-10-25 2023-05-05 奥比中光科技集团股份有限公司 Electronic equipment with rotatable camera
CN207968579U (en) * 2018-02-09 2018-10-12 广东欧珀移动通信有限公司 Mobile terminal
CN208862908U (en) * 2018-10-31 2019-05-14 信利光电股份有限公司 A kind of camera arrangement using TOF
CN111050154B (en) * 2019-12-12 2020-11-24 天目爱视(北京)科技有限公司 Mobile terminal with lifting type rotary 3D acquisition device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106094990A (en) * 2016-06-12 2016-11-09 张帆 The screen maximized electronic equipment of accounting and using method thereof
CN106899721A (en) * 2017-04-28 2017-06-27 广东欧珀移动通信有限公司 Electronic installation
CN109547600A (en) * 2018-12-25 2019-03-29 罗轶 Thin cloud platform mobile phone
CN109819079A (en) * 2019-04-08 2019-05-28 维沃移动通信(杭州)有限公司 A kind of terminal and camera control method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113843154A (en) * 2021-09-08 2021-12-28 浙江华眼视觉科技有限公司 Single piece splitter based on RGBD camera

Also Published As

Publication number Publication date
WO2021042854A1 (en) 2021-03-11
CN112532768B (en) 2023-09-05

Similar Documents

Publication Publication Date Title
US20170061210A1 (en) Infrared lamp control for use with iris recognition authentication
CN110581938A (en) Mobile terminal, mobile terminal control method, and computer storage medium
CN112532768A (en) Pop-up three-dimensional recognition device and mobile terminal
WO2010044913A1 (en) Controller in a camera for creating a panoramic image
CN108965663A (en) Electronic device
CN211239925U (en) Mobile terminal
CN111263041B (en) Camera module, electronic equipment and control method of camera module
US9060108B1 (en) Apparatus and methods for redirecting light to provide for reorientation of a camera
CN108769493A (en) CCD camera assembly and electronic device
CN108769325A (en) Electronic device
US20140092199A1 (en) Tv apparatus
EP4246952A1 (en) Tof apparatus and electronic device
US9247125B2 (en) Auxiliary light projection apparatus, flash apparatus, and photographing apparatus
EP3761626B1 (en) Concealable camera and electronic device having a concealable camera
CN210807351U (en) Mobile terminal
CN105163022B (en) Camera module and electronic device
US6839086B1 (en) Camera including multiple lenses, a ranging means, and multiple image processors
US11886106B2 (en) Photographing module and electronic device
CN208386660U (en) Electronic device
CN104111512A (en) Lens Barrel Having Retractable Lens, And Image Pickup Apparatus
JP5754044B2 (en) Imaging apparatus and image communication system
JPH0588068A (en) Image pickup device
CN111314506A (en) Camera module and electronic equipment
CN103916570B (en) Circumscribed zoom modules and camera device
EP3817346B1 (en) Terminal device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant