WO2022174811A1 - 拍摄辅助方法、电子设备及存储介质 - Google Patents

拍摄辅助方法、电子设备及存储介质 Download PDF

Info

Publication number
WO2022174811A1
WO2022174811A1 PCT/CN2022/076821 CN2022076821W WO2022174811A1 WO 2022174811 A1 WO2022174811 A1 WO 2022174811A1 CN 2022076821 W CN2022076821 W CN 2022076821W WO 2022174811 A1 WO2022174811 A1 WO 2022174811A1
Authority
WO
WIPO (PCT)
Prior art keywords
photographing device
screen
function
photographing
main
Prior art date
Application number
PCT/CN2022/076821
Other languages
English (en)
French (fr)
Inventor
徐源源
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2022174811A1 publication Critical patent/WO2022174811A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/02—Constructional features of telephone sets
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/02—Constructional features of telephone sets
    • H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/026—Details of the structure or mounting of specific components
    • H04M1/0264—Details of the structure or mounting of specific components for a camera module assembly
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/02—Constructional features of telephone sets
    • H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/026—Details of the structure or mounting of specific components
    • H04M1/0266—Details of the structure or mounting of specific components for a display module assembly
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/45—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image

Definitions

  • the embodiments of the present disclosure relate to the field of electronic technologies, and in particular, to a photographing assistance method, an electronic device, and a storage medium.
  • Cameras are already very important components in mobile phones.
  • the functions of the camera are generally: shooting and recording images, face recognition, and fingerprint recognition under the optical screen.
  • the proactive recording image and the face recognition function are similar and basically reused; but the fingerprint recognition under the optical screen is only used to identify fingerprints and has not been fully utilized.
  • the purpose of the embodiments of the present disclosure is to provide an auxiliary method for shooting, an electronic device and a storage medium, so as to improve the utilization efficiency of the under-screen shooting device.
  • an embodiment of the present disclosure provides a shooting assistance method, including: determining at least one main shooting device and at least one auxiliary shooting device corresponding to the triggered function; wherein, the at least one auxiliary shooting device is a screen A lower photographing device; assisting at least one main photographing device to complete a triggered function according to an image photographed by at least one auxiliary photographing device.
  • Embodiments of the present disclosure also provide an electronic device, including: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by at least one processor.
  • One processor executes, so that at least one processor can execute the above-mentioned shooting assistance method.
  • Embodiments of the present disclosure further provide a computer-readable storage medium storing a computer program, and when the computer program is executed by a processor, the above-mentioned shooting assistance method is implemented.
  • the off-screen photographing device can be used as an auxiliary photographing device to assist the main photographing device to complete the triggered function, thereby improving the utilization efficiency of the off-screen photographing device and improving the ability of the main photographing device to trigger the triggered Completion of the function.
  • assisting at least one main photographing device to complete a triggered function according to an image photographed by at least one auxiliary photographing device includes: acquiring an image photographed by at least one auxiliary photographing device; according to the recognized gesture and the preset correspondence between the gesture and the control instruction, determine the control instruction corresponding to the recognized gesture; according to the corresponding control instruction, control at least one main photographing device to capture images.
  • This embodiment enables the main photographing device to be controlled by recognizing the gestures in the image photographed by the auxiliary photographing device, so that the electronic device can realize the remote operation, and the operation flexibility of the electronic device is improved.
  • control instruction includes any one of an instruction to adjust the parameters of at least one main camera, an instruction to control the at least one main camera to stop image capture, and an instruction to control at least one main camera to start image capture.
  • the triggered function is a back-camera function
  • at least one main photographing device is a non-screen camera of the electronic device.
  • the main capturing device is controlled to complete the post-shooting function, thereby realizing the air-space operation.
  • the triggered function is a proactive function
  • at least one main photographing device is another under-screen photographing device; according to the image captured by the at least one auxiliary photographing device, the at least one main photographing device is assisted to complete the triggered function
  • the method includes: optimizing the image captured by the at least one main capturing device according to the image captured by the at least one auxiliary capturing device. This embodiment optimizes the image captured by the main capture device based on the image captured by the auxiliary capture device, which can relieve the framing pressure of a single under-screen capture device, improve the quality of the image captured by the main capture device, and ensure the effect of proactive capture to the greatest extent.
  • the auxiliary photographing device is an off-screen photographing device used for fingerprint recognition. This embodiment can improve the proactive effect based on the existing structure of the electronic device with the fingerprint identification function, reduce the modification of the electronic device, and reduce the cost.
  • the triggered function is a face recording function or a face recognition function
  • at least one main photographing device corresponding to the face recording function or the face recognition function is an off-screen photographing device of an electronic device used for proactive photography
  • at least one auxiliary photographing device corresponding to the face entry function or the face recognition function is an off-screen photographing device used for fingerprint identification of electronic equipment
  • at least one main photographing device assist at least one main photographing device to complete the triggering function, including: optimizing the image captured by at least one main capturing device according to the image captured by at least one auxiliary capturing device; performing face entry or face recognition based on the optimized image; or, based on the image captured by at least one auxiliary capturing device , and images captured by at least one main photographing device for face entry or face recognition.
  • the method further includes: determining parameters of at least one main photographing device and at least one auxiliary photographing device according to the triggered function device parameters. This embodiment enables both the main photographing device and the auxiliary photographing device to achieve better effects when each function is triggered.
  • FIG. 1 is a flowchart of a shooting assistance method according to a first embodiment of the present disclosure
  • FIG. 2 is a flowchart of a shooting assistance method according to a second embodiment of the present disclosure
  • FIG. 3 is a schematic position diagram of an off-screen photographing device of a terminal in the photographing assistance method in the second embodiment of the present disclosure shown in FIG. 2;
  • FIG. 4 is a schematic structural diagram of an electronic device in a fourth embodiment according to the present disclosure.
  • the first embodiment of the present disclosure relates to a photographing assistance method, including the following steps: determining at least one main photographing device and at least one auxiliary photographing device corresponding to the triggered function; wherein, the at least one auxiliary photographing device is an off-screen photographing device ; assisting at least one main photographing device to complete the triggered function according to the image captured by at least one auxiliary photographing device.
  • the under-screen shooting device can be used as an auxiliary shooting device to assist the main shooting device to complete the triggered function, thereby improving the utilization efficiency of the under-screen shooting device and the completion effect of the main shooting device on the triggered function.
  • the photographing assistance method in this embodiment is applied to an electronic device, for example, a terminal (mobile phone, computer, etc.). As shown in Figure 1, it specifically includes the following steps:
  • Step 101 Determine at least one main photographing device and at least one auxiliary photographing device corresponding to the triggered function.
  • At least one auxiliary photographing device is an off-screen photographing device, and the main photographing device may be an off-screen photographing device or a non-off-screen photographing device.
  • the under-screen photographing device refers to a photographing device set below the screen with the shooting direction facing the screen, for example, a front-facing camera of an electronic device.
  • a non-off-screen shooting device refers to a shooting device whose shooting direction is not towards the screen, for example, a rear camera of an electronic device.
  • the triggered functions include a forward-camera function, a back-camera function, a face recording function, and a face recognition function.
  • the main photographing device corresponding to the proactive function is an off-screen photographing device
  • the auxiliary photographing device corresponding to the proactive function is another off-screen photographing device.
  • the main photographing device corresponding to the back-camera function is a non-under-screen photographing device
  • the auxiliary photographing device corresponding to the back-camera function is an off-screen photographing device.
  • At least one main photographing device corresponding to the face entry function and the face recognition function is an off-screen photographing device used for proactive photography of an electronic device, and at least one auxiliary photographing device corresponding to the face entry function and the face recognition function is an electronic device.
  • main photographing devices and auxiliary photographing devices may also be respectively set for other triggered functions, which are not listed one by one here.
  • the process of determining at least one main camera and at least one auxiliary camera corresponding to the triggered function by the electronic device will be illustrated by taking the non-off-screen camera as the rear camera and the off-screen camera as the front camera as an example.
  • the electronic device detects the parameters of its own devices in real time, determines the triggered function according to the parameter change of each device, and determines at least one main camera and at least one main camera under the triggered function according to the triggered function.
  • a secondary camera is
  • the electronic device detects that the parameter change of the pressure sensor corresponding to the power-on button indicates that the power-on button is pressed, and the current screen of the electronic device is in an off-screen state, it is determined that the triggered function includes the face recognition function, and at least one main The photographing device and the at least one auxiliary photographing device are different front cameras of the electronic device.
  • the electronic device detects that a parameter change on the screen indicates that the camera control on the screen is pressed, and the triggered function of the camera recorded by the electronic device is a proactive function, then it is determined that the triggered function is a proactive function, and at least one main The photographing device and the at least one auxiliary photographing device are different front cameras of the electronic device. If the electronic device detects that the parameter change on the screen indicates that the flip control on the screen is pressed, it is determined that the triggered function is the rear camera function, at least one main camera is a rear camera, and at least one auxiliary camera is a front camera.
  • the electronic device detects that a parameter change on the screen indicates that the camera control on the screen is pressed, and the triggered function of the camera recorded by the electronic device is a back-camera function, then it is determined that the triggered function is a back-camera function, and at least one main The shooting device is a rear camera, and at least one auxiliary shooting device is a front camera. If the electronic device detects that the parameter change on the screen indicates that the flip control on the screen is pressed, it is determined that the triggered function is the proactive function, and the at least one main photographing device and the at least one auxiliary photographing device are two different front cameras of the electronic device. .
  • the triggered functions may also be determined in other ways, for example, the triggered functions are determined according to received instructions, which are not listed one by one in this embodiment.
  • Step 102 assist at least one primary photographing device to complete the triggered function according to the image captured by at least one secondary photographing device.
  • the at least one auxiliary capturing device assists the at least one main capturing device to complete the image capturing.
  • the at least one auxiliary photographing device assists the at least one main photographing device to complete the face recognition.
  • the following describes a process in which the at least one auxiliary photographing device assists the at least one main photographing device to complete the triggered function.
  • the electronic device acquires an image captured by at least one auxiliary photographing device; recognizes a gesture in the image captured by at least one auxiliary photographing device; A control instruction corresponding to the recognized gesture is determined; according to the corresponding control instruction, at least one main photographing device is controlled to capture an image.
  • the main capturing device is controlled, so that the electronic device can be operated at a distance, and the flexibility of the operation of the electronic device is improved.
  • control instruction includes any one of an instruction to adjust parameters of at least one main photographing apparatus, an instruction to control at least one main photographing apparatus to stop image capturing, and an instruction to control at least one main photographing apparatus to start image capturing.
  • the parameters of the main photographing device can be adjusted based on the gesture change caused by the shaking, so as to reduce the influence of the shaking on the photographing effect of the main photographing device.
  • the preset correspondence between the gesture and the control instruction indicates: if the recognized gesture is palm advance, the corresponding control instruction is to adjust the focal length of the main photographing device according to the first preset multiple; wherein, the first preset multiple is greater than 1 ; If the gesture recognized is that the palm is pulled away, the corresponding control instruction is to adjust the focal length of the main photographing device according to the second preset multiple; wherein, the second preset multiple is less than 1; if the gesture recognized is to make a fist, the corresponding control The instruction is an instruction for controlling at least one main photographing device to start image capturing; if the recognized control instruction is a palm swing, the corresponding control instruction is an instruction for controlling at least one main photographing device to stop image capturing.
  • the triggered function of the electronic device in the first example is a back-camera function
  • at least one main photographing device is a non-screen camera of the electronic device.
  • the main shooting device is a rear camera
  • the auxiliary shooting device is a front camera.
  • the electronic device includes a plurality of off-screen photographing devices
  • the auxiliary photographing device corresponding to the back-camera function is an off-screen photographing device with the smallest power consumption among the multiple off-screen photographing devices, so as to reduce the system power consumption overhead.
  • the electronic device can control the main photographing device to complete the post-photography function based on the gestures recognized in the images captured by the auxiliary photographing device, thereby realizing the remote operation.
  • the triggered function is the proactive function
  • at least one main camera is another under-screen camera
  • the electronic device optimizes the image captured by the at least one main camera according to the image captured by the at least one auxiliary camera .
  • the electronic device performs preset optimization processing on at least one main photographing device; uses images photographed by at least one auxiliary photographing device to supplement the optimized image to increase the details of the optimized image and improve the image quality.
  • At least one main photographing device is an off-screen photographing device of an electronic device for taking a proactive photo
  • at least one auxiliary photographing device is an off-screen photographing device of an electronic device that is used for fingerprint recognition.
  • this embodiment can improve the proactive effect based on the existing structure of the electronic device with the fingerprint identification function, reduce the modification of the electronic device, and reduce the cost.
  • the principle of fingerprint recognition under the optical screen is roughly as follows: using the light transmittance of the screen itself, cooperate with the screen to emit light to illuminate the user's finger, and the camera below the screen captures the reflected image of the user's finger to identify and unlock.
  • the realization principle of the under-screen shooting device is basically to use the light transmittance of the screen, but in order to increase the light transmittance, the pixel layout will be reduced, thereby increasing the pixel gap, increasing the light transmittance, and then assisting with image algorithm optimization, Finally achieved the shooting goal.
  • one off-screen photographing device is used to assist another off-screen photographing device to complete functions such as forward shooting, which can achieve better imaging effects while avoiding the problem that the pixel layout is too sparse in one place, which leads to excessive differences in display effects. .
  • optimizing the image captured by the main camera based on the image captured by the auxiliary camera can ease the framing pressure of a single off-screen camera, improve the quality of the image captured by the main camera, and maximize the effect of proactive shooting. Since the shooting effect of the under-screen shooting device is affected by the light transmittance of the screen, optimizing the image shot under the proactive function based on the image shot by the auxiliary shooting device can improve the quality of the image shot under the proactive function and reduce the light transmittance of the screen.
  • the impact on the image captured by the proactive function reduces the requirements for the light transmittance of the area of the screen corresponding to the under-screen camera, so that there is no need to adjust the pixel layout of the screen for the under-screen camera, avoiding blindly in a certain area.
  • the local area pursues light transmittance for the imaging effect, the pixels are too sparse and the display effect is poor.
  • the triggered function is a face recording function
  • at least one main photographing device corresponding to the face recording function is an off-screen photographing device of an electronic device used for proactive photography
  • at least one main photographing device corresponding to the face recording function is an electronic device.
  • the auxiliary photographing device is an off-screen photographing device used for fingerprint identification of an electronic device.
  • the electronic device optimizes the image captured by the at least one main capture device according to the image captured by the at least one auxiliary capture device; performs face entry based on the optimized image; or, based on the image captured by the at least one auxiliary capture device, and the at least one main capture device Captured images for face entry.
  • the under-screen photographing device used for fingerprint identification is a camera with an adjustable focal length.
  • the focal length of the under-screen photographing device used for fingerprint identification is the normal focal length.
  • the image of the under-screen photographing device used for fingerprint recognition and the image captured by the under-screen photographing device used for proactive photography are entered into the facial features.
  • the triggered function is the fingerprint recognition function
  • the focal length of the under-screen photographing device for fingerprint identification is the closest focal length
  • the highlight backlight function is turned on, and the electronic device performs fingerprinting based on the image captured by the under-screen photographing device for fingerprint identification. Enter.
  • the triggered function is a face recognition function
  • at least one main photographing device corresponding to the face recognition function is an off-screen photographing device of an electronic device used for proactive photography
  • at least one main photographing device corresponding to the face recognition function is an electronic device.
  • the auxiliary photographing device is an off-screen photographing device used for fingerprint identification of an electronic device.
  • the electronic device optimizes the image captured by the at least one main capture device according to the image captured by the at least one auxiliary capture device; performs face recognition based on the optimized image; or, based on the image captured by the at least one auxiliary capture device and the at least one main capture device Captured images for face recognition.
  • the off-screen photographing device used for fingerprint identification of the electronic device is used to assist the off-screen photographing device used for front-facing photography to perform face recognition, and the faces are photographed from different angles through the two off-screen photographing devices, so that the Face features can be compared from different angles to avoid recognition errors caused by plane photos and improve security.
  • using the under-screen photographing device for fingerprint identification to assist face recognition improves the utilization rate of the under-screen photographing device for fingerprint identification and reduces costs.
  • auxiliary photographing device may also adopt other auxiliary forms to assist the main photographing device, which are not listed one by one in this embodiment.
  • the present embodiment provides a photographing assistance method.
  • the under-screen photographing device can be used as an auxiliary photographing device to assist the main photographing device to complete the triggered function, thereby improving the utilization efficiency of the under-screen photographing device and improving the ability of the main photographing device to be used by the subject.
  • the completion effect of the triggered function By switching parameters such as the focal length of each shooting device, the electronic device fully and effectively utilizes the resources of each under-screen shooting device under the screen, reducing the burden of a single shooting device. Since the screen does not need to blindly improve the light transmittance, it is unnecessary to reduce the pixel arrangement excessively, thereby improving the display effect of the area of the screen corresponding to the under-screen photographing device.
  • the second embodiment of the present disclosure relates to a photographing assistance method.
  • the second embodiment is substantially the same as the first embodiment, with the main difference: in this embodiment, at least one main photographing device corresponding to the triggered function is determined. After and at least one auxiliary photographing device, the parameters of at least one main photographing device and the parameters of at least one auxiliary photographing device are determined according to the triggered function.
  • steps 201 to 203 are roughly the same as steps 101 and 102 respectively, and will not be repeated here, and the following mainly Introducing the differences:
  • Step 201 Determine at least one main photographing device and at least one auxiliary photographing device corresponding to the triggered function.
  • Step 202 Determine the parameters of at least one main photographing device and the parameters of at least one auxiliary photographing device according to the triggered function.
  • the electronic device adjusts the parameters of at least one main photographing device and at least one auxiliary photographing device based on the triggered function, so that both the main photographing device and the auxiliary photographing device can achieve better effects when each function is triggered.
  • the parameter of at least one main photographing device and the parameter of at least one auxiliary photographing device are both focal lengths.
  • the triggered function is a proactive function, a face recognition function, or a face recording function
  • the focal lengths of the at least one main photographing device and the at least one auxiliary photographing device are both adjusted to normal focal lengths.
  • the triggered function is a rear-camera function
  • the focal length of at least one main photographing device is set to a telephoto focus
  • the focal length of at least one auxiliary photographing device is adjusted to a normal focal length.
  • Step 403 Assist at least one main photographing device to complete the triggered function according to the image captured by at least one auxiliary photographing device.
  • the following takes an electronic device as a terminal as an example to illustrate the photographing assistance method mentioned in this embodiment.
  • the terminal includes at least two under-screen sensor areas, and the two under-screen sensor areas each have a certain degree of light transmittance.
  • the under-screen sensing area corresponds to an under-screen shooting device, and the under-screen shooting device includes camera units with different focus areas; or a plurality of camera units corresponding to different focal lengths.
  • the terminal includes two off-screen sensor areas, and each off-screen sensor area is provided with an off-screen photographing device.
  • the positions of the two under-screen cameras are shown in Figure 3.
  • the top of the terminal includes a first under-screen photographing device 301, a camera used for taking a picture with a front camera, and has two functions of normal focal length and telephoto.
  • the middle and lower part of the terminal includes a second under-screen photographing device 302, a camera used for fingerprint recognition, which has the functions of close focus, normal focus and high-brightness backlight.
  • the light transmittance of the area of the screen of the terminal corresponding to the under-screen photographing device may be relatively low, and the impact on the display effect is small.
  • the terminal solves the imaging quality problem in each scene through the mutual cooperation of algorithms among a group of shooting devices. Among them, in each scene, the cooperation between the shooting devices is as follows:
  • Scenario 1 The terminal detects that the user triggers the fingerprint entry function, and activates the close focus and highlight backlight of the second under-screen camera 302 to identify and record the fingerprint currently pressed on the fingerprint reader.
  • Scenario 2 The terminal detects that the user triggers the face entry function, and activates the normal focal length of the first-screen shooting device 301 and the normal focal length of the second-screen shooting device 302; during the recording process, the first-screen shooting device 301 and The second under-screen photographing device 302 simultaneously records facial features from different angles.
  • Scenario 3 The terminal detects that the system of the terminal is awakened by a unified wake-up method, such as pressing the power button or double-clicking the screen to activate the biometric verification function. If the fingerprint recognition function of the system has been turned on at this time, but the face recognition function has not been turned on, it is determined that the triggered function is the fingerprint recognition function, and the close focus and highlight backlight of the shooting device 302 under the second screen are activated; if the fingerprint recognition function is not turned on On, the face recognition function has been turned on, then it is determined that the triggered function is the face recognition function, and the normal focal length of the photographing device 301 under the first screen and the normal focal length of the photographing device 302 under the second screen are activated; The systems are all turned on, then start the normal focal length of the first under-screen photographing device 301 and the normal focal length of the second under-screen photographing device 302.
  • a unified wake-up method such as pressing the power button or double-clicking the screen to activate the biometric verification
  • the screen detects that the area corresponding to the second under-screen photographing device 302 is touched, the second under-screen photographing device 302 is touched.
  • the under-screen photographing device 302 is switched to close focus, and the highlight backlight of the second under-screen photographing device 302 is turned on.
  • the first off-screen photographing device 301 and the second off-screen photographing device 302 compare facial features from different angles to avoid errors in the recognition of plane photos and improve security.
  • Scenario 4 The terminal detects that the system is awakened by the preset first unlocking method. For example, double-clicking the screen in the fingerprint recognition area triggers the fingerprint recognition function, and activates the close focus and highlight backlight of the camera 302 under the second screen.
  • Scenario 5 The terminal detects that the system is awakened by the second preset unlocking method, such as double-clicking the screen or swiping down in the camera area under the top screen, the face recognition function is triggered, and the normal shooting device 301 under the first screen is activated.
  • the focal length and the normal focal length of the second under-screen photographing device 302 are activated.
  • Scenario 6 The terminal detects that the system triggers the proactive photographing function, and activates the normal focal length of the first under-screen photographing device 301 and the second under-screen photographing device 302 .
  • the terminal displays the image captured by the first off-screen capturing device 301 on the screen, and adjusts the focal length in response to the user's adjustment.
  • the terminal uses the image captured by the second under-screen capturing device 302 as the underlying image.
  • the user presses the shutter the current image of the first under-screen photographing device 301 is acquired, optimization processing for the under-screen photographing device such as defogging is performed, and the current image of the second under-screen photographing device 302 is acquired as a supplement.
  • the original image of the second under-screen photographing device 302 can be used as the basis for detail calculation, and a better photo effect can be finally obtained.
  • the image difference caused by the difference in focal length is calculated synchronously as a detailed calculation basis.
  • Scenario 7 The terminal detects that the system triggers the rear camera function, and activates the normal focal length of the non-under-screen camera (ie, the rear camera) and the under-screen camera with the smallest power consumption among the under-screen cameras for the front camera (the second one is the second one).
  • the normal focal length of the under-screen photographing device 302 is taken as an example).
  • the second under-screen photographing device 302 acts as a gesture detector in the post-photography, and performs a rough adjustment of the post-camera focal length, so as to avoid shaking caused by touching the body to affect the imaging.
  • the terminal detects the movement trajectory of the user's palm through the second under-screen photographing device 302 and controls the first under-screen photographing device 301 .
  • the focal length is increased in units of 1X (enlarged the image).
  • the focal length is reduced (zoomed out) in units of 1X.
  • the speed of zooming in and zooming out is proportional to the speed at which the palm of the user is detected to be pulled in and out, or the speed of the rotation of the finger.
  • what the terminal presents on the user interface is a normal screen lock or selfie interface.
  • a corresponding icon is displayed in the screen area corresponding to the photographing device to prompt the current working photographing device and the state of the focal length of the photographing.
  • two off-screen photographing devices are enabled at the same time, which can ensure the characteristics of the three-dimensional face, and can prevent the deception effect of flat photos like 3D structured light, and save the structure cost.
  • the image supplementary optimization of another under-screen camera is used to relieve the framing pressure of a single under-screen camera and maximize the effect of proactive shooting.
  • the image detection and judgment of the under-screen camera with low power consumption is used to adjust the post-camera focal length, take pictures during the shooting, and end the shooting, so as to avoid the shaking caused by touching the camera body to affect the imaging effect.
  • the present embodiment provides a photographing assistance method.
  • the under-screen photographing device can be used as an auxiliary photographing device to assist the main photographing device to complete the triggered function, thereby improving the utilization efficiency of the under-screen photographing device and improving the ability of the main photographing device to be used by the subject.
  • the electronic device adjusts the parameters of at least one main photographing device and the parameters of at least one auxiliary photographing device based on the triggered function, so that the main photographing device and the auxiliary photographing device can achieve better performance when each function is triggered. Effect.
  • the third embodiment of the present disclosure relates to an electronic device, as shown in FIG. 4 , comprising: at least one processor 401 ; and a memory 402 communicatively connected to the at least one processor 401 ; Instructions executed by one processor 401, the instructions are executed by at least one processor 401, so that at least one processor 401 can execute the above-mentioned shooting assistance method.
  • the memory and the processor are connected by a bus, and the bus may include any number of interconnected buses and bridges, and the bus connects one or more processors and various circuits of the memory. In FIG. 4, the connection through the bus is taken as an example.
  • the bus may also connect together various other circuits, such as peripherals, voltage regulators, and power management circuits, which are well known in the art and therefore will not be described further herein.
  • the bus interface provides the interface between the bus and the transceiver.
  • a transceiver may be a single element or multiple elements, such as multiple receivers and transmitters, providing a means for communicating with various other devices over a transmission medium.
  • the data processed by the processor is transmitted on the wireless medium through the antenna, and further, the antenna also receives the data and transmits the data to the processor.
  • the processor is responsible for managing the bus and general processing, and can also provide various functions, including timing, peripheral interface, voltage regulation, power management, and other control functions. Instead, memory may be used to store data used by the processor in performing operations.
  • the memory 402 can be used to store non-volatile software programs, non-volatile computer-executable programs and modules.
  • the instructions in the embodiments of the present application are stored in the memory 402 .
  • the processor 401 executes various functional applications and data processing of the device by running the non-volatile software programs, instructions and modules stored in the memory 402, that is, the above-mentioned shooting assistance method is implemented.
  • the memory 402 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function; the storage data area may store an option list and the like.
  • memory 402 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device.
  • memory 402 may optionally include memory located remotely relative to processor 401, and these remote memories may be connected to external devices via a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
  • One or more modules are stored in the memory 402, and when executed by the one or more processors 401, execute the shooting assistance method in any of the above method embodiments.
  • the above product can execute the method provided by the embodiment of the present application, and has functional modules and beneficial effects corresponding to the execution method.
  • the method provided by the embodiment of the present application please refer to the method provided by the embodiment of the present application.
  • a fourth embodiment of the present disclosure relates to a computer-readable storage medium storing a computer program.
  • the above method embodiments are implemented when the computer program is executed by the processor.
  • the aforementioned storage medium includes: U disk, mobile hard disk, Read-Only Memory (ROM, Read-Only Memory), Random Access Memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program codes .

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Studio Devices (AREA)

Abstract

本公开实施例涉及电子技术领域，公开了一种拍摄辅助方法、电子设备及存储介质。本申请的部分实施例中，拍摄辅助方法包括：确定与被触发的功能对应的至少一个主拍摄装置和至少一个辅拍摄装置；其中，所述至少一个辅拍摄装置为屏下拍摄装置；根据所述至少一个辅拍摄装置拍摄的图像，辅助所述至少一个主拍摄装置完成所述被触发的功能。本公开的部分实施例能够提高屏下拍摄装置的利用效率。

Description

拍摄辅助方法、电子设备及存储介质
相关申请的交叉引用
本公开基于2021年02月19日提交的发明名称为“拍摄辅助方法、电子设备及存储介质”的中国专利申请CN202110191846.8，并且要求该专利申请的优先权，通过引用将其所公开的内容全部并入本公开。
技术领域
本公开实施例涉及电子技术领域，特别涉及一种拍摄辅助方法、电子设备及存储介质。
背景技术
摄像头在手机中已经是非常重要的器件。目前摄像头功能一般为：拍摄记录影像、人脸识别、光学屏下指纹识别。其中，前摄记录影像和人脸识别功能接近，基本复用；但光学屏下指纹识别则只用来识别指纹，还没有得到更为充分的利用。
发明内容
本公开实施例的目的在于提供一种拍摄辅助方法、电子设备及存储介质，使得提高屏下拍摄装置的利用效率。
为解决上述技术问题，本公开的实施例提供了一种拍摄辅助方法，包括：确定与被触发的功能对应的至少一个主拍摄装置和至少一个辅拍摄装置；其中，至少一个辅拍摄装置为屏下拍摄装置；根据至少一个辅拍摄装置拍摄的图像，辅助至少一个主拍摄装置完成被触发的功能。
本公开的实施例还提供了一种电子设备，包括：至少一个处理器；以及，与至少一个处理器通信连接的存储器；其中，存储器存储有可被至少一个处理器执行的指令，指令被至少一个处理器执行，以使至少一个处理器能够执行上述的拍摄辅助方法。
本公开的实施例还提供了一种计算机可读存储介质，存储有计算机程序，计算机程序被处理器执行时实现上述的拍摄辅助方法。
本公开实施例相对于现有技术而言，屏下拍摄装置可以作为辅拍摄装置，辅助主拍摄装置完成被触发的功能，从而提高屏下拍摄装置的利用效率，提高主拍摄装置对被触发的功能的完成效果。
在部分实施例中，根据至少一个辅拍摄装置拍摄的图像，辅助至少一个主拍摄装置完成被触发的功能，包括：获取至少一个辅拍摄装置拍摄的图像；识别至少一个辅拍摄装置拍摄的图像中的手势；根据识别到的手势，以及预设的手势与控制指令的对应关系，确定识别到的手势对应的控制指令；根据对应的控制指令，控制至少一个主拍摄装置，以便拍摄图像。该实施例使得通过识别辅拍摄装置拍摄的图像中的手势，控制主拍摄装置，使得电子设备可以实现隔空操作，提高电子设备操作的灵活性。
在部分实施例中，控制指令包括：调整至少一个主拍摄装置的参数的指令、控制至少一 个主拍摄装置停止图像拍摄的指令和控制至少一个主拍摄装置开始图像拍摄的指令中的任意一个。该实施例使得能够基于手势变化，调整主拍摄装置的参数，以减小抖动对主拍摄装置的拍摄效果的影响。
在部分实施例中，被触发的功能为后摄功能，至少一个主拍摄装置为电子设备的非屏下摄像头。该实施例基于辅拍摄装置拍摄的图像中识别到的手势，控制主拍摄装置完成后摄功能，实现了隔空操作。
在部分实施例中，被触发的功能为前摄功能，至少一个主拍摄装置为另一屏下拍摄装置；根据至少一个辅拍摄装置拍摄的图像，辅助至少一个主拍摄装置完成被触发的功能，包括：根据至少一个辅拍摄装置拍摄的图像，优化至少一个主拍摄装置拍摄的图像。该实施例基于辅拍摄装置拍摄的图像优化主拍摄装置拍摄的图像，可以缓解单个屏下拍摄装置的取景压力，提高主拍摄装置拍摄的图像的质量，最大程度保证前摄拍摄效果。
在部分实施例中，辅拍摄装置为用于指纹识别的屏下拍摄装置。该实施例能够基于具备指纹识别功能的电子设备的现有结构提高前摄效果，减少对电子设备的改动，降低成本。
在部分实施例中，被触发的功能为人脸录入功能或人脸识别功能，人脸录入功能或人脸识别功能对应的至少一个主拍摄装置为电子设备的用于前摄拍照的屏下拍摄装置，人脸录入功能或人脸识别功能对应的至少一个辅拍摄装置为电子设备的用于指纹识别的屏下拍摄装置；根据至少一个辅拍摄装置拍摄的图像，辅助至少一个主拍摄装置完成被触发的功能，包括：根据至少一个辅拍摄装置拍摄的图像，优化至少一个主拍摄装置拍摄的图像；基于优化后的图像进行人脸录入或人脸识别；或者，基于至少一个辅拍摄装置拍摄的图像，以及至少一个主拍摄装置拍摄的图像，进行人脸录入或人脸识别。该实施例避免了一味地在某个局部区域为了成像效果追求透光率时，导致像素过于稀疏，显示效果差的问题。
在部分实施例中，在确定与被触发的功能对应的至少一个主拍摄装置和至少一个辅拍摄装置之后，还包括：根据被触发的功能，确定至少一个主拍摄装置的参数和至少一个辅拍摄装置的参数。该实施例使得主拍摄装置和辅拍摄装置在各个功能被触发时均能达到较好的效果。
附图说明
一个或多个实施例通过与之对应的附图中的图片进行示例性说明，这些示例性说明并不构成对实施例的限定。
图1是根据本公开的第一实施例中的拍摄辅助方法的流程图；
图2是根据本公开的第二实施例中的拍摄辅助方法的流程图；
图3是图2所示的本公开的第二实施例中的拍摄辅助方法中终端的屏下拍摄装置的位置示意图；
图4是根据本公开的第四实施例中的电子设备的结构示意图。
具体实施方式
为使本公开实施例的目的、技术方案和优点更加清楚，下面将结合附图对本公开的各实施例进行详细的阐述。然而，本领域的普通技术人员可以理解，在本公开各实施例中，为了 使读者更好地理解本申请而提出了许多技术细节。但是，即使没有这些技术细节和基于以下各实施例的种种变化和修改，也可以实现本申请所要求保护的技术方案。以下各个实施例的划分是为了描述方便，不应对本公开的具体实现方式构成任何限定，各个实施例在不矛盾的前提下可以相互结合相互引用。
本公开的第一实施例涉及一种拍摄辅助方法，包括以下步骤：确定与被触发的功能对应的至少一个主拍摄装置和至少一个辅拍摄装置；其中，至少一个辅拍摄装置为屏下拍摄装置；根据至少一个辅拍摄装置拍摄的图像，辅助至少一个主拍摄装置完成被触发的功能。采用该拍摄辅助方法时，屏下拍摄装置可以作为辅拍摄装置，辅助主拍摄装置完成被触发的功能，从而提高屏下拍摄装置的利用效率，提高主拍摄装置对被触发的功能的完成效果。
下面对本实施例的拍摄辅助方法的实现细节进行说明，以下内容仅为方便理解而提供的实现细节，并非实施本方案的必须。
本实施例中的拍摄辅助方法应用于电子设备，例如，终端(手机，电脑等)。如图1所示，具体包括以下步骤：
步骤101，确定与被触发的功能对应的至少一个主拍摄装置和至少一个辅拍摄装置。
具体地，至少一个辅拍摄装置为屏下拍摄装置，主拍摄装置可以是屏下拍摄装置或非屏下拍摄装置。屏下拍摄装置是指被设置屏幕下方的、拍摄方向朝向屏幕的拍摄装置，例如，电子设备的前置摄像头。非屏下拍摄装置是指拍摄方向不是朝向屏幕的拍摄装置，例如，电子设备的后置摄像头。
在一个例子中，被触发的功能包括前摄功能、后摄功能、人脸录入功能和人脸识别功能。前摄功能对应的主拍摄装置为屏下拍摄装置，前摄功能对应的辅拍摄装置为另一屏下装置。后摄功能对应的主拍摄装置为非屏下拍摄装置，后摄功能对应的辅拍摄装置为屏下装置。人脸录入功能和人脸识别功能对应的至少一个主拍摄装置为电子设备的用于前摄拍照的屏下拍摄装置，人脸录入功能和人脸识别功能对应的至少一个辅拍摄装置为电子设备的用于指纹识别的屏下拍摄装置。
需要说明的是，本领域技术人员可以理解，实际应用中，还可以对其他被触发的功能分别设置对应的主拍摄装置和辅拍摄装置，此处不一一列举。
以下以非屏下拍摄装置为后置摄像头，屏下拍摄装置为前置摄像头为例，对电子设备确定与被触发的功能对应的至少一个主拍摄装置和至少一个辅拍摄装置过程进行举例说明。
在一个例子中，电子设备实时检测自身各器件的参数，根据各器件的参数变化，确定被触发的功能；并根据被触发的功能，确定该被触发的功能下的至少一个主拍摄装置和至少一个辅拍摄装置。
例如，若电子设备检测到开机按键对应的压力传感器的参数变化指示开机按键被按下，且当前电子设备的屏幕为灭屏状态，则确定被触发的功能为包括人脸识别功能，至少一个主拍摄装置和至少一个辅拍摄装置为电子设备的不同的前置摄像头。
又如，若电子设备检测屏幕的参数变化指示屏幕中相机控件被按下，且电子设备记录的相机的被触发的功能为前摄功能，则确定被触发的功能为前摄功能，至少一个主拍摄装置和至少一个辅拍摄装置为电子设备的不同的前置摄像头。若电子设备检测屏幕的参数变化指示屏幕中翻转控件被按下，则确定被触发的功能为后摄功能，至少一个主拍摄装置为后置摄像 头，至少一个辅拍摄装置为前置摄像头。
再如，若电子设备检测屏幕的参数变化指示屏幕中相机控件被按下，且电子设备记录的相机的被触发的功能为后摄功能，则确定被触发的功能为后摄功能，至少一个主拍摄装置为后置摄像头，至少一个辅拍摄装置为前置摄像头。若电子设备检测屏幕的参数变化指示屏幕中翻转控件被按下，则确定被触发的功能为前摄功能，至少一个主拍摄装置和至少一个辅拍摄装置为电子设备的两个不同的前置摄像头。
需要说明的是，本领域技术人员可以理解，实际应用中，也可以通过其他方式确定被触发的功能，例如，根据接收到的指令，确定被触发的功能，本实施方式不一一列举。
步骤102：根据至少一个辅拍摄装置拍摄的图像，辅助至少一个主拍摄装置完成被触发的功能。
具体地，当电子设备被触发的功能与拍摄图像相关时，至少一个辅拍摄装置辅助至少一个主拍摄装置完成图像拍摄。当电子设备被触发的功能与人脸识别相关时，至少一个辅拍摄装置辅助至少一个主拍摄装置完成人脸识别。
以下对至少一个辅拍摄装置辅助至少一个主拍摄装置完成被触发的功能的过程进行举例说明。
在第一个例子中，电子设备获取至少一个辅拍摄装置拍摄的图像；识别至少一个辅拍摄装置拍摄的图像中的手势；根据识别到的手势，以及预设的手势与控制指令的对应关系，确定识别到的手势对应的控制指令；根据对应的控制指令，控制至少一个主拍摄装置，以便拍摄图像。
值得一提的是，通过识别辅拍摄装置拍摄的图像中的手势，控制主拍摄装置，使得电子设备可以实现隔空操作，提高电子设备操作的灵活性。
可选择的，控制指令包括：调整至少一个主拍摄装置的参数的指令、控制至少一个主拍摄装置停止图像拍摄的指令和控制至少一个主拍摄装置开始图像拍摄的指令中的任意一个。
值得一提的是，用户拍摄图像时，若出现抖动情况，用户的手的位置等会发生变化。因此，可以基于抖动造成的手势变化，调整主拍摄装置的参数，以减小抖动对主拍摄装置的拍摄效果的影响。
例如，预设的手势与控制指令的对应关系指示：若识别到的手势为手掌推进，对应的控制指令为按照第一预设倍数调整主拍摄装置的焦距；其中，第一预设倍数大于1；若识别到的手势为手掌拉远，对应的控制指令为按照第二预设倍数调整主拍摄装置的焦距；其中，第二预设倍数小于1；若识别到的手势为握拳，对应的控制指令为控制至少一个主拍摄装置开始图像拍摄的指令；若识别到的控制指令为手掌左右摇摆，对应的控制指令为控制至少一个主拍摄装置停止图像拍摄的指令。
需要说明的是，本领域技术人员可以理解，实际应用中，还可以设置其他手势和控制指令的对应关系，本实施方式仅为举例说明，不一一列举。
可选择的，第一个例子中的电子设备被触发的功能为后摄功能，至少一个主拍摄装置为电子设备的非屏下摄像头。例如，主拍摄装置为后置摄像头，辅拍摄装置为前置摄像头。
可选择的，电子设备包括多个屏下拍摄装置，后摄功能对应的辅拍摄装置为多个屏下拍摄装置中功耗最小的屏下拍摄装置，以降低***功耗开销。
值得一提的是，电子设备能够基于辅拍摄装置拍摄的图像中识别到的手势，控制主拍摄装置完成后摄功能，实现了隔空操作。
在第二个例子中，被触发的功能为前摄功能，至少一个主拍摄装置为另一屏下拍摄装置，电子设备根据至少一个辅拍摄装置拍摄的图像，优化至少一个主拍摄装置拍摄的图像。例如，电子设备对至少一个主拍摄装置进行预设的优化处理；利用至少一个辅拍摄装置拍摄的图像，对优化处理后的图像进行补充，以增加优化处理后的图像的细节，提高图像质量。
可选择的，至少一个主拍摄装置为电子设备的用于前摄拍照的屏下拍摄装置，至少一个辅拍摄装置为电子设备的用于指纹识别的屏下拍摄装置。
值得一提的是，该实施例能够基于具备指纹识别功能的电子设备的现有结构结构提高前摄效果，减少对电子设备的改动，降低成本。
具体地，光学屏下指纹识别的原理大致如下：利用屏幕本身的透光率，配合屏幕发光，照亮用户的手指，由屏幕下方的摄像头拍摄用户手指的反射图像，识别并解锁。屏下拍摄装置的实现原理基本上是利用屏幕的透光率，只不过为了使透光率增加，会减少像素布局，从而增大像素空隙，增加了透光率，再辅助以影像算法优化，最终达成拍摄目标。但缺陷在于增加透光率就会造成屏下摄像区域屏幕的像素不足造成显示效果不佳，特别是与大屏区域差异往往视觉可见，对视觉体验造成比较严重的影响。本实施例中，采用一个屏下拍摄装置辅助另一屏下拍摄装置完成前摄等功能，可以在达到较好成像效果的同时，避免在一个地方像素布局过于稀疏导致显示效果差异过大的问题。
值得一提的是，基于辅拍摄装置拍摄的图像优化主拍摄装置拍摄的图像，可以缓解单个屏下拍摄装置的取景压力，提高主拍摄装置拍摄的图像的质量，最大程度保证前摄拍摄效果。由于屏下拍摄装置的拍摄效果受屏幕的透光率影响，基于辅拍摄装置拍摄的图像优化前摄功能下拍摄的图像，可以提高前摄功能下拍摄的图像的质量，降低屏幕的透光率对前摄功能拍摄的图像的影响，降低对屏幕的与屏下拍摄装置对应的区域的透光率的要求，从而使得无需为了屏下拍摄装置调整屏幕的像素布局，避免了一味地在某个局部区域为了成像效果追求透光率时，导致像素过于稀疏，显示效果差的问题。
在第三个例子中，被触发的功能为人脸录入功能，人脸录入功能对应的至少一个主拍摄装置为电子设备的用于前摄拍照的屏下拍摄装置，人脸录入功能对应的至少一个辅拍摄装置为电子设备的用于指纹识别的屏下拍摄装置。电子设备根据至少一个辅拍摄装置拍摄的图像，优化至少一个主拍摄装置拍摄的图像；基于优化后的图像进行人脸录入；或者，基于至少一个辅拍摄装置拍摄的图像，以及至少一个主拍摄装置拍摄的图像，进行人脸录入。具体地，用于指纹识别的屏下拍摄装置为焦距可调节的摄像头，当被触发的功能为人脸录入功能时，用于指纹识别的屏下拍摄装置的焦距为正常焦距，电子设备基于用于指纹识别的屏下拍摄装置的图像和用于前摄拍照的屏下拍摄装置拍摄的图像，录入人脸特征。当被触发的功能为指纹识别功能时，用于指纹识别的屏下拍摄装置的焦距为最近焦距，且开启高亮背光功能，电子设备基于用于指纹识别的屏下拍摄装置拍摄的图像进行指纹录入。
在第四个例子中，被触发的功能为人脸识别功能，人脸识别功能对应的至少一个主拍摄装置为电子设备的用于前摄拍照的屏下拍摄装置，人脸识别功能对应的至少一个辅拍摄装置为电子设备的用于指纹识别的屏下拍摄装置。电子设备根据至少一个辅拍摄装置拍摄的图像， 优化至少一个主拍摄装置拍摄的图像；基于优化后的图像进行人脸识别；或者，基于至少一个辅拍摄装置拍摄的图像，以及至少一个主拍摄装置拍摄的图像，进行人脸识别。
值得一提的是，使用电子设备的用于指纹识别的屏下拍摄装置辅助用于前摄拍照的屏下拍摄装置进行人脸识别，通过两个屏下拍摄装置从不同角度拍摄人脸，使得可以从不同角度进行人脸特征比较，避免平面照片造成的识别错误，提高了安全性。此外，使用用于指纹识别的屏下拍摄装置辅助人脸识别，提高了用于指纹识别的屏下拍摄装置的利用率，降低了成本。
需要说明的是，本领域技术人员可以理解，实际应用中，辅拍摄装置还可以采取其他辅助形式辅助主拍摄装置，本实施方式不一一列举。
由此，本实施例提供了一种拍摄辅助方法，屏下拍摄装置可以作为辅拍摄装置，辅助主拍摄装置完成被触发的功能，从而提高屏下拍摄装置的利用效率，提高主拍摄装置对被触发的功能的完成效果。电子设备通过切换各拍摄装置的焦距等参数，充分有效运用屏幕下的各个屏下拍摄装置的资源，减轻单个拍摄装置的负担。由于屏幕无需一味地提高透光率，使得无需过度减少像素排布，从而提升屏幕的与屏下拍摄装置对应的区域的显示效果。
本公开的第二实施例涉及一种拍摄辅助方法，第二实施例与第一实施例大致相同，主要区别在于：在本实施例中，在确定与被触发的功能对应的至少一个主拍摄装置和至少一个辅拍摄装置之后，根据被触发的功能，确定至少一个主拍摄装置的参数和至少一个辅拍摄装置的参数。
本实施例中的拍摄辅助方法的具体流程图如图2所示，包括步骤201至步骤203，其中，步骤201和步骤203分别与步骤101和步骤102大致相同，此处不再赘述，下面主要介绍不同之处：
步骤201：确定与被触发的功能对应的至少一个主拍摄装置和至少一个辅拍摄装置。
步骤202：根据被触发的功能，确定至少一个主拍摄装置的参数和至少一个辅拍摄装置的参数。
具体地，电子设备基于被触发的功能，调整至少一个主拍摄装置的参数和至少一个辅拍摄装置的参数，使得主拍摄装置和辅拍摄装置在各个功能被触发时均能达到较好的效果。
例如，至少一个主拍摄装置的参数和至少一个辅拍摄装置的参数均为焦距。若被触发的功能为前摄功能或人脸识别功能或人脸录入功能，将至少一个主拍摄装置和至少一个辅拍摄装置的焦距均调整为正常焦距。若被触发的功能为后摄功能，将至少一个主拍摄装置的焦距为远焦，将至少一个辅拍摄装置的焦距调整为正常焦距。
步骤403：根据至少一个辅拍摄装置拍摄的图像，辅助至少一个主拍摄装置完成被触发的功能。
以下以电子设备为终端为例，对本实施例提及的拍摄辅助方法进行举例说明。
在一个例子中，终端包括具有至少两个屏下传感器区域，两个屏下传感区域的屏幕均具有一定的透光性。屏下传感区域对应设置屏下拍摄装置，屏下拍摄装置包括具有不同对焦区域的摄像单元；或者多个对应不同焦段的摄像单元。例如，终端包括两个屏下传感器区域，各屏下传感器区域各设置一个屏下拍摄装置。两个屏下拍摄装置的位置如图3所示。由图可知，终端顶部包含一个第一屏下拍摄装置301，用于前摄拍照的摄像头，具有正常焦距和远 焦两种功能。终端中下部包含一个第二屏下拍摄装置302，用于指纹识别的摄像头，具有近焦、正常焦距和高亮背光功能。终端的屏幕的与屏下拍摄装置对应的区域的透光率可以相对较低，对显示效果的影响较小。终端通过一组拍摄装置之间算法的互相配合来解决各个场景下的成像质量问题。其中，各场景下，拍摄装置之间的配合如下：
场景1：终端检测到用户触发指纹录入功能，则启动第二屏下拍摄装置302的近焦和高亮背光，识别并记录当前按压在指纹识别器上的指纹。
场景2：终端检测到用户触发人脸录入功能，启动第一屏下拍摄装置301的正常焦距和启动第二屏下拍摄装置302的正常焦距；在录入过程中，第一屏下拍摄装置301和第二屏下拍摄装置302同时记录不同角度的人脸特征。
场景3：终端检测到终端的***被用统一的唤醒方式唤醒，如点按电源键或双击屏幕，启动生物识别验证功能。若此时***的指纹识别功能已开启，人脸识别功能未开启，则确定被触发的功能为指纹识别功能，启动第二屏下拍摄装置302的近焦和高亮背光；若指纹识别功能未开启，人脸识别功能已开启，则确定被触发的功能为人脸识别功能，启动第一屏下拍摄装置301的正常焦距和第二屏下拍摄装置302的正常焦距；若指纹识别功能和人脸***均已开启，则启动第一屏下拍摄装置301的正常焦距和第二屏下拍摄装置302的正常焦距，当屏幕检测到第二屏下拍摄装置302对应的区域有触摸时，将第二屏下拍摄装置302切换为近焦，并打开第二屏下拍摄装置302的高亮背光。
值得一提的是，该场景下，第一屏下拍摄装置301和第二屏下拍摄装置302通过不同角度的人脸特征比较，避免平面照片的识别错误，提高安全性。
场景4：终端检测到***被以预设的第一解锁方式唤醒，比如在指纹识别区域双击屏幕，则为触发指纹识别功能，启动第二屏下拍摄装置302的近焦和高亮背光。
场景5：终端检测到***被以预设的第二解锁方式唤醒，比如在顶部屏下摄像区域双击屏幕或向下滑动，则为触发人脸识别功能，启动第一屏下拍摄装置301的正常焦距和第二屏下拍摄装置302的正常焦距。
场景6：终端检测到***触发前摄拍照功能，启动第一屏下拍摄装置301和第二屏下拍摄装置302的正常焦距。终端在屏幕中显示第一屏下拍摄装置301拍摄的图像，并响应用户的焦距调节调整。终端将第二屏下拍摄装置302拍摄的图像作为底层图像。当用户按下快门时，获取第一屏下拍摄装置301的当前图像，进行去雾等针对屏下拍摄装置的优化处理，获取第二屏下拍摄装置302的当前图像作为补充。比如当第一屏下拍摄装置301由于高强度去雾算法导致图像过曝等情况产生时，可以利用第二屏下拍摄装置302的原始图像作为细节计算依据，最终获得更优的照片效果。
可选择的，当用户将第一屏下拍摄装置301的焦距调节为远焦，无法与第二屏下拍摄装置302的焦距同步时，同步计算焦距差异带来的图像差异作为细节计算依据。
场景7：终端检测到***触发后摄拍照功能，启动非屏下拍摄装置的正常焦距(即后置摄像头)和前摄的各屏下拍摄装置中功耗最小的屏下拍摄装置(以第二屏下拍摄装置302为例)的正常焦距。第二屏下拍摄装置302作为后摄拍照中的手势检测器，进行后摄焦距的粗调，避免触碰机身带来的抖动影响成像。终端通过第二屏下拍摄装置302检测用户手掌的运动轨迹，控制第一屏下拍摄装置301。
例如，当检测到用户手掌的运动轨迹为由远及近(即手势为推进)或手指顺时针旋转时，以1X为单位增大焦距(放大图像)，当检测到用户手掌的运动轨迹为由近及远(即手势为拉远)或者手指逆时针旋转时，以1X为单位减少焦距(缩小图像)。可选择的，放大和缩小的速度以检测到用户手掌拉近推远的速度，或，手指的旋转的速度成正比关系。当检测到用户的手掌变成握拳时，自动抓拍当前图像；当检测到用户的手掌快速左右摆动时，停止当前摄像。
可选择的，终端在用户界面上呈现的是正常的锁屏或自拍界面。当启动拍摄装置时，在拍摄装置对应的屏幕区域给出对应图示提示当前工作的拍摄装置和摄像焦距状态。
该例子中，在录入和验证人脸信息时，同时启用两个屏下拍摄装置，可以保证立体人脸的特征，起到与3D结构光一样的防止平面照片的欺骗效果，节约结构成本。在拍摄前摄照片时，通过另一个屏下拍摄装置的图像补充优化，缓解单个屏下拍摄装置的取景压力，最大程度保证前摄拍摄效果。在后摄摄像时，通过较低功耗的屏下拍摄装置拍摄的图像检测判断，进行后摄焦距调节或拍摄中拍照、结束拍摄等操作，避免触碰机身带来的抖动影响成像效果。
由此，本实施例提供了一种拍摄辅助方法，屏下拍摄装置可以作为辅拍摄装置，辅助主拍摄装置完成被触发的功能，从而提高屏下拍摄装置的利用效率，提高主拍摄装置对被触发的功能的完成效果。除此之外，电子设备基于被触发的功能，调整至少一个主拍摄装置的参数和至少一个辅拍摄装置的参数，使得主拍摄装置和辅拍摄装置在各个功能被触发时均能达到较好的效果。
此外，本领域技术人员可以理解，上面各种方法的步骤划分，只是为了描述清楚，实现时可以合并为一个步骤或者对某些步骤进行拆分，分解为多个步骤，只要包括相同的逻辑关系，都在本专利的保护范围内；对算法中或者流程中添加无关紧要的修改或者引入无关紧要的设计，但不改变其算法和流程的核心设计都在该专利的保护范围内。
本公开的第三实施例涉及一种电子设备，如图4所示，包括：至少一个处理器401；以及，与至少一个处理器401通信连接的存储器402；其中，存储器402存储有可被至少一个处理器401执行的指令，指令被至少一个处理器401执行，以使至少一个处理器401能够执行上述的拍摄辅助方法。
其中，存储器和处理器采用总线方式连接，总线可以包括任意数量的互联的总线和桥，总线将一个或多个处理器和存储器的各种电路连接在一起。图4中以通过总线连接为例。总线还可以将诸如***设备、稳压器和功率管理电路等之类的各种其他电路连接在一起，这些都是本领域所公知的，因此，本文不再对其进行进一步描述。总线接口在总线和收发机之间提供接口。收发机可以是一个元件，也可以是多个元件，比如多个接收器和发送器，提供用于在传输介质上与各种其他装置通信的单元。经处理器处理的数据通过天线在无线介质上进行传输，进一步，天线还接收数据并将数据传送给处理器。
处理器负责管理总线和通常的处理，还可以提供各种功能，包括定时，***接口，电压调节、电源管理以及其他控制功能。而存储器可以被用于存储处理器在执行操作时所使用的数据。
存储器402作为一种非易失性计算机可读存储介质，可用于存储非易失性软件程序、非易失性计算机可执行程序以及模块，如本申请实施方式中指令就存储于存储器402中。处理 器401通过运行存储在存储器402中的非易失性软件程序、指令以及模块，从而执行设备的各种功能应用以及数据处理，即实现上述拍摄辅助方法。存储器402可以包括存储程序区和存储数据区，其中，存储程序区可存储操作***、至少一个功能所需要的应用程序；存储数据区可存储选项列表等。此外，存储器402可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实施方式中，存储器402可选包括相对于处理器401远程设置的存储器，这些远程存储器可以通过网络连接至外接设备。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。
一个或者多个模块存储在存储器402中，当被一个或者多个处理器401执行时，执行上述任意方法实施方式中的拍摄辅助方法。
上述产品可执行本申请实施方式所提供的方法，具备执行方法相应的功能模块和有益效果，未在本实施方式中详尽描述的技术细节，可参见本申请实施方式所提供的方法。
本公开的第四实施方式涉及一种计算机可读存储介质，存储有计算机程序。计算机程序被处理器执行时实现上述方法实施例。
即，本领域技术人员可以理解，实现上述实施例方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成，该程序存储在一个存储介质中，包括若干指令用以使得一个设备(可以是单片机，芯片等)或处理器(processor)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。
本领域的普通技术人员可以理解，上述各实施例是实现本公开的具体实施例，而在实际应用中，可以在形式上和细节上对其作各种改变，而不偏离本公开的精神和范围。

Claims (10)

  1. 一种拍摄辅助方法，包括：
    确定与被触发的功能对应的至少一个主拍摄装置和至少一个辅拍摄装置；其中，所述至少一个辅拍摄装置为屏下拍摄装置；
    根据所述至少一个辅拍摄装置拍摄的图像，辅助所述至少一个主拍摄装置完成所述被触发的功能。
  2. 根据权利要求1所述的拍摄辅助方法，其中，所述根据所述至少一个辅拍摄装置拍摄的图像，辅助所述至少一个主拍摄装置完成所述被触发的功能，包括：
    获取所述至少一个辅拍摄装置拍摄的图像；
    识别所述至少一个辅拍摄装置拍摄的图像中的手势；
    根据识别到的手势，以及预设的手势与控制指令的对应关系，确定所述识别到的手势对应的控制指令；
    根据所述对应的控制指令，控制所述至少一个主拍摄装置，以便拍摄图像。
  3. 根据权利要求2所述的拍摄辅助方法，其中，所述控制指令包括：调整所述至少一个主拍摄装置的参数的指令、控制所述至少一个主拍摄装置停止图像拍摄的指令和控制所述至少一个主拍摄装置开始图像拍摄的指令中的任意一个。
  4. 根据权利要求2或3所述的拍摄辅助方法，其中，所述被触发的功能为后摄功能，所述至少一个主拍摄装置为所述电子设备的非屏下摄像头。
  5. 根据权利要求1所述的拍摄辅助方法，其中，所述被触发的功能为前摄功能，所述至少一个主拍摄装置为另一屏下拍摄装置；
    所述根据所述至少一个辅拍摄装置拍摄的图像，辅助所述至少一个主拍摄装置完成所述被触发的功能，包括：
    根据所述至少一个辅拍摄装置拍摄的图像，优化所述至少一个主拍摄装置拍摄的图像。
  6. 根据权利要求5所述的拍摄辅助方法，其中，所述辅拍摄装置为用于指纹识别的屏下拍摄装置。
  7. 根据权利要求1所述的拍摄辅助方法，其中，所述被触发的功能为人脸录入功能或人脸识别功能，所述人脸录入功能或所述或人脸识别功能对应的至少一个主拍摄装置为电子设备的用于前摄拍照的屏下拍摄装置，所述人脸录入功能或所述人脸识别功能对应的至少一个辅拍摄装置为所述电子设备的用于指纹识别的屏下拍摄装置；
    所述根据所述至少一个辅拍摄装置拍摄的图像，辅助所述至少一个主拍摄装置完成所述被触发的功能，包括：
    根据所述至少一个辅拍摄装置拍摄的图像，优化所述至少一个主拍摄装置拍摄的图像；基于优化后的图像进行人脸录入或人脸识别；或者，基于所述至少一个辅拍摄装置拍摄的图像，以及所述至少一个主拍摄装置拍摄的图像，进行人脸录入或人脸识别。
  8. 根据权利要求1至7中任一项所述的拍摄辅助方法，其中，在所述确定与被触发的功能对应的至少一个主拍摄装置和至少一个辅拍摄装置之后，还包括：
    根据所述被触发的功能，确定所述至少一个主拍摄装置的参数和所述至少一个辅拍摄装 置的参数。
  9. 一种电子设备，包括：
    至少一个处理器；以及，
    与所述至少一个处理器通信连接的存储器；其中，所述存储器存储有可被所述至少一个处理器执行的指令，所述指令被所述至少一个处理器执行，以使所述至少一个处理器能够执行如权利要求1至8中任一项所述拍摄辅助方法。
  10. 一种计算机可读存储介质，存储有计算机程序，所述计算机程序被处理器执行时实现权利要求1至8中任一项所述的拍摄辅助方法。
PCT/CN2022/076821 2021-02-19 2022-02-18 拍摄辅助方法、电子设备及存储介质 WO2022174811A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110191846.8 2021-02-19
CN202110191846.8A CN114979414A (zh) 2021-02-19 2021-02-19 拍摄辅助方法、电子设备及存储介质

Publications (1)

Publication Number Publication Date
WO2022174811A1 true WO2022174811A1 (zh) 2022-08-25

Family

ID=82932100

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/076821 WO2022174811A1 (zh) 2021-02-19 2022-02-18 拍摄辅助方法、电子设备及存储介质

Country Status (2)

Country Link
CN (1) CN114979414A (zh)
WO (1) WO2022174811A1 (zh)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104010125A (zh) * 2013-02-22 2014-08-27 联想(北京)有限公司 电子设备和方法
CN204406325U (zh) * 2015-01-09 2015-06-17 长春大学 一种手势识别装置
US20180191940A1 (en) * 2016-12-30 2018-07-05 Altek Semiconductor Corp. Image capturing device and control method thereof
CN110209273A (zh) * 2019-05-23 2019-09-06 Oppo广东移动通信有限公司 手势识别方法、交互控制方法、装置、介质与电子设备
CN111147752A (zh) * 2019-12-31 2020-05-12 维沃移动通信有限公司 变焦倍数调节方法、电子设备及介质

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104010125A (zh) * 2013-02-22 2014-08-27 联想(北京)有限公司 电子设备和方法
CN204406325U (zh) * 2015-01-09 2015-06-17 长春大学 一种手势识别装置
US20180191940A1 (en) * 2016-12-30 2018-07-05 Altek Semiconductor Corp. Image capturing device and control method thereof
CN110209273A (zh) * 2019-05-23 2019-09-06 Oppo广东移动通信有限公司 手势识别方法、交互控制方法、装置、介质与电子设备
CN111147752A (zh) * 2019-12-31 2020-05-12 维沃移动通信有限公司 变焦倍数调节方法、电子设备及介质

Also Published As

Publication number Publication date
CN114979414A (zh) 2022-08-30

Similar Documents

Publication Publication Date Title
US9307151B2 (en) Method for controlling camera of device and device thereof
TWI528225B (zh) 電子設備及其根據手勢控制拍照的方法
EP3346329B1 (en) Image processing method and apparatus
TWI661350B (zh) 電子裝置及其拍照控制方法和系統
RU2649773C2 (ru) Управление камерой посредством функции распознавания лица
JP4807167B2 (ja) なりすまし検知装置
CN113840070B (zh) 拍摄方法、装置、电子设备及介质
US20170126989A1 (en) Apparatus and method for processing an image in device
WO2013013615A1 (zh) 基于眨眼特征提取的控制方法及基于该方法的拍摄眼镜
US20200084387A1 (en) Low power mode for one or more cameras of a multiple camera system
US10708467B2 (en) Information processing apparatus that performs authentication processing for approaching person, and control method thereof
CN111491102A (zh) 拍照场景的检测方法、***、移动终端及存储介质
WO2022089284A1 (zh) 拍摄处理方法、装置、电子设备和可读存储介质
US20150138309A1 (en) Photographing device and stitching method of captured image
WO2023045626A1 (zh) 图像采集方法、装置、终端、计算机可读存储介质及计算机程序产品
EP2613520B1 (en) Apparatus and method of displaying camera view area in portable terminal
KR20240004839A (ko) 촬영 방법, 장치 및 전자기기
WO2023040288A1 (zh) 显示设备及设备控制方法
WO2024061134A1 (zh) 拍摄方法、装置、电子设备及介质
WO2021185374A1 (zh) 一种拍摄图像的方法及电子设备
WO2022174811A1 (zh) 拍摄辅助方法、电子设备及存储介质
CN106210498A (zh) 移动终端相机控制方法及装置
TW201714074A (zh) 使用手勢的拍照方法、系統與電子裝置
WO2018196615A1 (zh) 拍照的控制方法及装置
CN113794833B (zh) 拍摄方法、装置和电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22755584

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 12/01/2024)