CN113395451B - Video shooting method and device, electronic equipment and storage medium - Google Patents

Video shooting method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN113395451B
CN113395451B CN202110691616.8A CN202110691616A CN113395451B CN 113395451 B CN113395451 B CN 113395451B CN 202110691616 A CN202110691616 A CN 202110691616A CN 113395451 B CN113395451 B CN 113395451B
Authority
CN
China
Prior art keywords
audio
state
audio signal
camera
audio signals
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110691616.8A
Other languages
Chinese (zh)
Other versions
CN113395451A (en
Inventor
王英茂
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN202110691616.8A priority Critical patent/CN113395451B/en
Publication of CN113395451A publication Critical patent/CN113395451A/en
Application granted granted Critical
Publication of CN113395451B publication Critical patent/CN113395451B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/665Control of cameras or camera modules involving internal camera communication with the image sensor, e.g. synchronising or multiplexing SSIS control signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/45Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Studio Devices (AREA)

Abstract

The application discloses a video shooting method and device, electronic equipment and a storage medium, and relates to the technical field of electronic equipment. The method is applied to electronic equipment, the electronic equipment comprises a front camera, a rear camera and a microphone, and the method comprises the following steps: when the electronic equipment carries out video shooting, the state of the front camera is obtained to be used as a first state, the state of the rear camera is obtained to be used as a second state, audio processing parameters corresponding to the first state and the second state are determined from a plurality of audio processing parameters to be used as target audio processing parameters, and a plurality of audio signals collected through the microphone are processed based on the target audio processing parameters. According to the method and the device, different audio processing parameters are adopted to process the audio signals collected by the microphone according to different states of the camera when video shooting is carried out, and the audio and video effect of video shooting is improved.

Description

Video shooting method and device, electronic equipment and storage medium
Technical Field
The present disclosure relates to the field of electronic device technologies, and in particular, to a video shooting method and apparatus, an electronic device, and a storage medium.
Background
With the development of science and technology, electronic equipment is more widely used and more functions are more and more, and the electronic equipment becomes one of the necessary things in daily life of people. At present, electronic equipment can be used for video shooting, but in the process of video shooting, many noises can be collected at the same time, and the effect of video shooting is seriously influenced.
Disclosure of Invention
In view of the above problems, the present application provides a video capturing method, apparatus, electronic device and storage medium to solve the above problems.
In a first aspect, an embodiment of the present application provides a video shooting method, which is applied to an electronic device, where the electronic device includes a front camera, a rear camera, and a microphone, and the method includes: when the electronic equipment carries out video shooting, acquiring the state of the front camera as a first state, and acquiring the state of the rear camera as a second state; determining an audio processing parameter corresponding to the first state and the second state from a plurality of audio processing parameters as a target audio processing parameter; processing a plurality of audio signals acquired by the microphone based on the target audio processing parameter.
In a second aspect, an embodiment of the present application provides a video shooting device, which is applied to an electronic device, where the electronic device includes a front camera, a rear camera, and a microphone, and the device includes: the state acquisition module is used for acquiring the state of the front camera as a first state and acquiring the state of the rear camera as a second state when the electronic equipment carries out video shooting; an audio processing parameter obtaining module, configured to determine, from among multiple audio processing parameters, an audio processing parameter corresponding to the first state and the second state as a target audio processing parameter; and the audio processing module is used for processing a plurality of audio signals collected by the microphone based on the target audio processing parameters.
In a third aspect, an embodiment of the present application provides an electronic device, including a front camera, a rear camera, a microphone, a memory, and a processor, where the front camera, the rear camera, the microphone, and the memory are coupled to the processor, and the memory stores instructions, and when the instructions are executed by the processor, the processor performs the above method.
In a fourth aspect, the present application provides a computer-readable storage medium, in which a program code is stored, and the program code can be called by a processor to execute the above method.
According to the video shooting method and device, the electronic equipment and the storage medium, when the electronic equipment carries out video shooting, the audio processing parameters corresponding to the camera used for video shooting are determined from the multiple audio processing parameters, and the determined audio processing parameters are used for processing the audio signals collected by the microphone, so that the audio signals collected by the microphone are processed by adopting different audio processing parameters according to different states of the camera during video shooting, and the audio and video effects of video shooting are improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 shows a schematic flow chart of a video shooting method according to an embodiment of the present application. (ii) a
FIG. 2 is a schematic diagram illustrating video capture provided by an embodiment of the present application;
FIG. 3 is a schematic diagram illustrating video capture provided by an embodiment of the present application;
FIG. 4 is a flow chart illustrating a video capture method according to another embodiment of the present application;
FIG. 5 is a flow chart illustrating a video capture method according to yet another embodiment of the present application;
FIG. 6 is a flowchart illustrating a video capture method according to another embodiment of the present application;
FIG. 7 shows a flow chart of step S430 of the video capture method shown in FIG. 6 of the present application;
FIG. 8 is a schematic flow chart diagram illustrating a video capture method according to yet another embodiment of the present application;
FIG. 9 is a schematic flow chart diagram illustrating a video capture method according to yet another embodiment of the present application;
FIG. 10 is a flow chart illustrating a video capture method according to yet another embodiment of the present application;
FIG. 11 shows a block diagram of a video camera provided in an embodiment of the present application;
fig. 12 is a block diagram of an electronic device for executing a video capture method according to an embodiment of the present application;
fig. 13 illustrates a storage unit for storing or carrying program codes for implementing a video capturing method according to an embodiment of the present application.
Detailed Description
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.
The electronic device generally comprises a camera and a microphone, and when the electronic device takes images through the camera, audio signals need to be acquired through the microphone, so that video shooting of the electronic device is achieved. However, when the electronic device only shoots an image signal in a certain direction through the camera, the microphone simultaneously captures audio signals in all directions, so that the capturing direction of the image signal is different from that of the audio signal, excessive noise is generated, and the video shooting effect is seriously affected.
In view of the above problems, the inventors have found through long-term research and provide a video shooting method, a video shooting device, an electronic device, and a storage medium according to embodiments of the present application, and implement improvement of an audio and video effect of video shooting by processing audio signals acquired by a microphone according to different states of a camera during video shooting by using different audio processing parameters. The specific video shooting method is described in detail in the following embodiments.
Referring to fig. 1, fig. 1 is a schematic flowchart illustrating a video shooting method according to an embodiment of the present application. The video shooting method is used for processing the audio signals collected by the microphone by adopting different audio processing parameters according to different states of the camera during video shooting, so that the audio and video effect of video shooting is improved. In a specific embodiment, the video shooting method is applied to the video shooting device 200 shown in fig. 11 and the electronic device 100 (fig. 12) equipped with the video shooting device 200, and the specific flow of the embodiment will be described below by taking the electronic device as an example, but it is understood that the electronic device applied in the embodiment may include a smart phone, a tablet computer, a wearable electronic device, and the like, and is not limited herein. In this embodiment, the electronic device includes a front camera, a rear camera, and a microphone, and the following will explain in detail with respect to the flow shown in fig. 1, where the video shooting method specifically includes the following steps:
step S110: when the electronic equipment carries out video shooting, the state of the front camera is acquired as a first state, and the state of the rear camera is acquired as a second state.
In this embodiment, the electronic device may include a front camera, a rear camera, and microphones, where the front camera and the rear camera may be disposed oppositely, and the number of the microphones may be one or more, where when the number of the microphones is multiple, the microphones may be distributed on the same plane of the device body, and the microphones may also be distributed in the device body in a three-dimensional manner, which is not limited herein.
In some embodiments, whether the electronic device performs video shooting through the camera or not can be detected, and when the electronic device is detected to perform video shooting through the camera, the state of a front camera and the state of a rear camera of the electronic device can be detected, that is, whether the electronic device performs video shooting through the front camera, performs video shooting through the rear camera, or performs video shooting through the front camera and the rear camera together can be detected; when it is detected that the electronic device does not perform video shooting through the camera, the state of the front camera and the state of the rear camera of the electronic device may not be detected. The scene for video shooting may include video call, video conference, video teaching, live video, short video shooting, and the like, which is not limited herein.
Referring to fig. 2, fig. 2 is a schematic diagram illustrating video shooting according to an embodiment of the present disclosure. As shown in fig. 2, the user holds the electronic device 100 to perform video shooting, and in fig. 2, the video shooting object may be the user himself (i.e. self-shooting), at this time, the front camera is turned on and the rear camera is turned off.
Referring to fig. 3, fig. 3 is a schematic diagram illustrating a video capture according to an embodiment of the present disclosure. As shown in fig. 3, the user holds the electronic device 100 to perform video shooting, and in fig. 3, the object of the video shooting may be another user (i.e., the user takes a picture), and at this time, the rear camera is turned on and the front camera is turned off.
As one way, detecting whether the electronic device performs video shooting through the camera may include: whether a camera of the electronic equipment is continuously in an open state within preset time is detected, when the camera of the electronic equipment is continuously in the open state within the preset time, the electronic equipment can be determined to carry out video shooting through the camera, and when the camera of the electronic equipment is not opened or the opened time is smaller than the preset time, the electronic equipment can be determined not to carry out video shooting through the camera.
As another way, detecting whether the electronic device performs video shooting through a camera may include: whether the electronic equipment starts the video recording function is detected, when the electronic equipment starts the video recording function is detected, the electronic equipment can be determined to carry out video shooting through the camera, and when the electronic equipment does not start the video recording function is detected, the electronic equipment can be determined not to carry out video shooting through the camera.
As another mode, detecting whether the electronic device performs video shooting through the camera may include: the method comprises the steps that a target control is displayed on a display interface of the electronic equipment, wherein the target control is used for triggering video shooting, so that touch operation aiming at the target control can be detected, when the touch operation aiming at the target control is detected, the electronic equipment can be determined to carry out video shooting through a camera, and when the touch operation aiming at the target control is not detected, the electronic equipment can be determined not to carry out video shooting through the camera.
As another mode, detecting whether the electronic device performs video shooting through a camera may include: whether a target voice instruction is received or not can be detected, wherein the target voice instruction is used for indicating video shooting, therefore, when the target voice instruction is received, the electronic equipment can be determined to carry out video shooting through the camera, and when the target voice instruction is not received, the electronic equipment can be determined not to carry out video shooting through the camera.
In some embodiments, when it is determined that the electronic device performs video shooting, the state of the front camera may be acquired and the acquired state of the front camera may be taken as the first state, and the state of the rear camera may be acquired and the acquired state of the rear camera may be taken as the second state. When the electronic device performs video shooting, the first state and the second state may include: the first state is an on state and the second state is an on state, the first state is an on state and the second state is an off state, and the first state is an off state and the second state is an on state.
Step S120: determining an audio processing parameter corresponding to the first state and the second state from among a plurality of audio processing parameters as a target audio processing parameter.
In this embodiment, after the first state and the second state are acquired, the corresponding audio processing parameter may be determined as the target audio processing parameter from among the plurality of audio processing parameters based on the first state and the second state. The plurality of audio processing parameters may be preset and stored by the electronic device, or may be preset and stored by a server connected to the electronic device, which is not limited herein.
In some embodiments, the electronic device may be preset with mapping relationships among a plurality of audio processing parameters, a plurality of first states, and a plurality of second states. Therefore, in this embodiment, after the first state and the second state are obtained, the audio processing parameters corresponding to the first state and the second state may be searched for as the target audio processing parameters based on the mapping relationship.
For example, as shown in table 1, assuming that the number of the plurality of audio processing parameters is three, and the three audio processing parameters include a first audio processing parameter, a second audio processing parameter, and a third audio processing parameter, the combination between the first state and the second state includes: the first state is an on state and the second state is an off state, the first state is an off state and the second state is an on state and the first state is an on state and the second state is an on state, based on which the first audio processing parameter may establish a mapping relationship with the first state being the on state and the second state being the off state, the second audio processing parameter may establish a mapping relationship with the first state being the off state and the second state being the on state, and the third audio processing parameter may establish a mapping relationship with the first state being the on state and the second state being the on state.
TABLE 1
Figure BDA0003126985770000051
Figure BDA0003126985770000061
As shown in table 1, when the first state is the on state and the second state is the off state, the first audio processing parameter can be searched and obtained as the target audio processing parameter based on the mapping relationship; when the first state is the closed state and the second state is the open state, the second audio processing parameter can be searched and obtained as the target audio processing parameter based on the mapping relation; when the first state is the on state and the second state is the on state, the third audio processing parameter can be searched and obtained as the target audio processing parameter based on the mapping relation.
As an implementation manner, the first audio processing parameter may be to enhance the audio signal on the front side of the electronic device and attenuate the audio signals on the back side and the side of the electronic device, the second audio processing parameter may be to enhance the audio signal on the back side of the electronic device and attenuate the audio signals on the front side and the side of the electronic device, and the third audio processing parameter may be to enhance the audio signal on the front side and the back side of the electronic device and attenuate the audio signals on the side of the electronic device, which is not limited herein.
Step S130: processing a plurality of audio signals acquired by the microphone based on the target audio processing parameter.
In this embodiment, the electronic device may simultaneously acquire the audio signal through the microphone in the process of performing video shooting through the camera. The microphone can collect audio signals of all directions around the electronic equipment, so that when the electronic equipment is in the process of video shooting through the camera, if a plurality of sound sources are around the electronic equipment, the microphone can collect the plurality of audio signals. In some implementations, the electronic device, after determining a target audio processing parameter from the plurality of audio processing parameters, may process the plurality of audio signals captured by the microphone based on the target audio processing parameter.
As one mode, when the electronic device determines a first audio processing parameter as a target audio processing parameter from the plurality of audio processing parameters, based on the first audio processing parameter, an audio signal of a sound source located on the front side of the electronic device among the plurality of audio signals collected by the microphone may be subjected to enhancement processing, and audio signals of the sound source located on the back side and the side of the electronic device may be subjected to attenuation processing.
As still another way, when the electronic device determines a second audio processing parameter as the target audio processing parameter from the plurality of audio processing parameters, then based on the second audio processing parameter, an audio signal of a sound source located on the back side of the electronic device among the plurality of audio signals collected by the microphones may be subjected to enhancement processing, and audio signals of sound sources located on the front side and the side of the electronic device may be subjected to attenuation processing.
As another mode, when the electronic device determines a third audio processing parameter as the target audio processing parameter from the multiple audio processing parameters, based on the third audio processing parameter, an audio signal of a sound source located on the front side and an audio signal of a back side of the electronic device in the multiple audio signals collected by the microphones may be subjected to enhancement processing, and an audio signal of a sound source located on the side of the electronic device may be subjected to attenuation processing.
According to the video shooting method provided by one embodiment of the application, when the electronic equipment carries out video shooting, the state of the front camera is obtained to serve as the first state, the state of the rear camera is obtained to serve as the second state, the audio processing parameters corresponding to the first state and the second state are determined from the multiple audio processing parameters and serve as target audio processing parameters, the multiple audio signals collected through the microphone are processed based on the target audio processing parameters, therefore, according to different states of the camera during video shooting, the audio signals collected through the microphone are processed through different audio processing parameters, and the audio and video effect of video shooting is improved.
Referring to fig. 4, fig. 4 is a schematic flowchart illustrating a video shooting method according to another embodiment of the present application. The method is applied to the electronic device, which includes a front camera, a rear camera, and a microphone, in this embodiment, the first state is an open state and the second state is a closed state, which will be described in detail with reference to the flow shown in fig. 4, and the video shooting method specifically includes the following steps:
step S210: when the electronic equipment carries out video shooting, the state of the front camera is obtained as a first state, and the state of the rear camera is obtained as a second state.
Step S220: determining, from a plurality of audio processing parameters, audio processing parameters corresponding to the first state and the second state as a target, and determining, from a plurality of audio processing parameters, audio processing parameters corresponding to the first state and the second state as a target audio processing parameter.
For the detailed description of steps S210 to S220, refer to steps S110 to S120, which are not described herein again.
Step S230: and acquiring an audio signal corresponding to the front camera from the plurality of audio signals as a first audio signal.
In this embodiment, the first state is an on state and the second state is an off state. That is, when the electronic device performs video shooting, the front camera is in an open state and the rear camera is in a closed state, and the electronic device performs video shooting through the front camera.
In some embodiments, when it is determined that the front camera of the electronic device is turned on and the rear camera of the electronic device is turned off, an audio signal corresponding to the front camera may be acquired from a plurality of audio signals, and the audio signal corresponding to the front camera may be used as the first audio signal.
As one mode, when it is determined that the front camera of the electronic device is turned on and the rear camera of the electronic device is turned off, an audio signal (an audio signal corresponding to the front camera) on the front side of the electronic device may be obtained from a plurality of audio signals, and the audio signal corresponding to the front camera may be used as the first audio signal.
As another mode, when it is determined that the front camera of the electronic device is turned on and the rear camera is turned off, sound source positions corresponding to the plurality of audio signals collected by the microphone may be acquired, a sound source position located within a viewing angle range of the front camera may be acquired from the plurality of sound source positions as a first target sound source position, and an audio signal corresponding to the first target sound source position may be acquired as a first audio signal.
Step S240: and performing enhancement processing on the first audio signal, and performing attenuation processing on audio signals except the first audio signal in the plurality of audio signals.
In some embodiments, after determining the first audio signal corresponding to the front camera, the first audio signal may be subjected to enhancement processing, and the audio signals except the first audio signal among the plurality of audio signals may be subjected to attenuation processing. It can be understood that, through the enhancement processing of the first audio signal and the attenuation processing of the other audio signals, the source directions of the image signal and the audio signal of the video shooting can be basically consistent, and the video shooting effect is improved.
As one mode, performing enhancement processing on the first audio signal, and performing attenuation processing on the audio signals other than the first audio signal among the plurality of audio signals may include: increasing the volume of the first audio signal and decreasing the volume of audio signals other than the first audio signal among the plurality of audio signals; increasing the gain of the first audio signal and reducing the gain of the audio signals except the first audio signal in the plurality of audio signals; the definition of the first audio signal is improved, and the definition of the audio signals except the first audio signal in the plurality of audio signals is reduced.
In another embodiment of the present application, compared to the video shooting method shown in fig. 1, in the video shooting method provided in this embodiment, when the front camera is turned on and the rear camera is turned off, the audio signal corresponding to the front camera is enhanced, and other audio signals except the audio signal corresponding to the front camera are attenuated, so as to improve the audio effect of video shooting.
Referring to fig. 5, fig. 5 is a schematic flowchart illustrating a video shooting method according to still another embodiment of the present application. The method is applied to the electronic device, which includes a front camera, a rear camera, and a microphone, in this embodiment, the first state is an off state, and the second state is an on state, which will be described in detail with reference to the flow shown in fig. 5, and the video shooting method specifically includes the following steps:
step S310: when the electronic equipment carries out video shooting, the state of the front camera is obtained as a first state, and the state of the rear camera is obtained as a second state.
Step S320: determining an audio processing parameter corresponding to the first state and the second state from among a plurality of audio processing parameters as a target audio processing parameter.
For the detailed description of steps S310 to S320, please refer to steps S110 to S120, which are not described herein again.
Step S330: and acquiring an audio signal corresponding to the rear camera from the plurality of audio signals as a second audio signal.
In this embodiment, the first state is an off state and the second state is an on state. That is, when the electronic device performs video shooting, the front camera is in a closed state and the rear camera is in an open state, and the electronic device performs video shooting through the rear camera.
In some embodiments, when it is determined that the front camera of the electronic device is turned off and the rear camera of the electronic device is turned on, an audio signal corresponding to the rear camera may be acquired from a plurality of audio signals, and the audio signal corresponding to the rear camera may be used as the first audio signal.
As one mode, when it is determined that the front camera of the electronic device is turned off and the rear camera is turned on, an audio signal (an audio signal corresponding to the rear camera) on the back side of the electronic device may be obtained from the plurality of audio signals, and the audio signal corresponding to the rear camera may be used as the second audio signal.
As another mode, when it is determined that the front camera of the electronic device is turned off and the rear camera of the electronic device is turned on, sound source positions corresponding to the plurality of audio signals collected by the microphone may be acquired, a sound source position located within a viewing angle range of the rear camera may be acquired from the plurality of sound source positions as a second target sound source position, and an audio signal corresponding to the second target sound source position may be acquired as a second audio signal.
Step S340: and performing enhancement processing on the second audio signal, and performing attenuation processing on audio signals except the second audio signal in the plurality of audio signals.
In some embodiments, after determining the second audio signal corresponding to the rear camera, the second audio signal may be subjected to enhancement processing, and the audio signals except the second audio signal of the plurality of audio signals may be subjected to attenuation processing. It can be understood that, by the enhancement processing of the second audio signal and the attenuation processing of the other audio signals, the source directions of the image signal and the audio signal of the video shooting can be substantially consistent, and the video shooting effect can be improved.
As one mode, performing enhancement processing on the second audio signal, and performing attenuation processing on the audio signals other than the second audio signal among the plurality of audio signals may include: increasing the volume of the second audio signal and decreasing the volume of audio signals other than the second audio signal among the plurality of audio signals; increasing the gain of the second audio signal and reducing the gain of the audio signals except the second audio signal in the plurality of audio signals; and improving the definition of the second audio signal and reducing the definition of the audio signals except the second audio signal in the plurality of audio signals.
Compared with the video shooting method shown in fig. 1, the video shooting method provided in another embodiment of the present application further performs enhancement processing on the audio signal corresponding to the rear camera when the front camera is turned off and the rear camera is turned on, and performs attenuation processing on other audio signals except the audio signal corresponding to the rear camera, so as to improve the audio effect of video shooting.
Referring to fig. 6, fig. 6 is a schematic flowchart illustrating a video shooting method according to another embodiment of the present application. The method is applied to the electronic device, which includes a front camera, a rear camera, and a microphone, in this embodiment, the first state is an on state, and the second state is an on state, which will be described in detail with reference to the flow shown in fig. 6, and the video shooting method specifically includes the following steps:
step S410: when the electronic equipment carries out video shooting, the state of the front camera is obtained as a first state, and the state of the rear camera is obtained as a second state.
Step S420: determining, from among a plurality of audio processing parameters, an audio processing parameter corresponding to the first state and the second state as a target audio processing parameter.
For the detailed description of steps S410 to S420, refer to steps S110 to S120, which are not described herein again.
Step S430: and acquiring an audio signal corresponding to the front camera as a first audio signal and acquiring an audio signal corresponding to the rear camera as a second audio signal from the plurality of audio signals.
In this embodiment, the first state is an on state and the second state is an on state. That is, when the electronic device performs video shooting, the front camera is in an open state, the rear camera is in an open state, and the electronic device performs video shooting through the front camera and the rear camera at the same time, wherein when the electronic device performs video shooting through the front camera and the rear camera at the same time, a video can be formed through information collected by the front camera, another video can be formed through information collected by the rear camera, and a video can also be formed through information collected by the front camera and information collected by the rear camera, which is not limited herein.
In some embodiments, when it is determined that the front camera of the electronic device is turned on and the rear camera is turned on, an audio signal corresponding to the front camera may be acquired from a plurality of audio signals, and the audio signal corresponding to the front camera may be used as the first audio signal, and the audio signal corresponding to the rear camera may be acquired, and the audio signal corresponding to the rear camera may be used as the second audio signal.
As one mode, when it is determined that the front camera of the electronic device is turned on and the rear camera of the electronic device is turned on, an audio signal of the front side of the electronic device (an audio signal corresponding to the front camera) may be acquired from a plurality of audio signals, and the audio signal corresponding to the front camera may be used as the first audio signal and the audio signal of the rear side of the electronic device (an audio signal corresponding to the rear camera) may be acquired, and the audio signal corresponding to the rear camera may be used as the second audio signal.
Referring to fig. 7, fig. 7 is a flowchart illustrating step S430 of the video capturing method illustrated in fig. 6 of the present application. As will be explained in detail with respect to the flow shown in fig. 7, the method may specifically include the following steps:
step S431: and acquiring sound source positions corresponding to the plurality of audio signals respectively.
In some embodiments, when the electronic device collects a plurality of audio signals through the microphone, a sound source position corresponding to each of the plurality of audio signals may be acquired. As one way, the electronic device may obtain the sound source positions corresponding to the plurality of audio signals through a sound source localization technique.
Step S432: and acquiring a sound source position located in the visual angle range of the front camera from the plurality of sound source positions as a first target sound source position, and acquiring a sound source position located in the visual angle range of the rear camera from the plurality of sound source positions as a second target sound source position.
In this embodiment, since the front camera is in the open state for video shooting, the viewing angle range of the front camera during video shooting and the position area corresponding to the viewing angle range can be obtained. Based on this, after the sound source positions corresponding to the plurality of audio signals are obtained, the sound source positions of the plurality of audio signals and the position area corresponding to the visual angle range of the front camera may be compared, respectively, to obtain the sound source position located within the visual angle range of the front camera from the plurality of sound source positions as the first sound source position.
In this embodiment, since the rear camera is in the open state for video shooting, the viewing angle range of the rear camera during video shooting and the position area corresponding to the viewing angle range can be obtained. Based on this, after the sound source positions corresponding to the plurality of audio signals are acquired, the sound source positions of the plurality of audio signals and the position area corresponding to the viewing angle range of the rear camera may be compared, respectively, to acquire the sound source position located within the viewing angle range of the rear camera from the plurality of sound source positions as the first sound source position.
Step S433: and acquiring an audio signal corresponding to the first target sound source position as the first audio signal, and acquiring an audio signal corresponding to the second target sound source position as the second audio signal.
In this embodiment, after determining the first target sound source position, an audio signal corresponding to the first target sound source position may be acquired from a plurality of audio signals as the first audio signal.
In this embodiment, after the second target sound source position is determined, an audio signal corresponding to the second target sound source position may be acquired from among the plurality of audio signals as the second audio signal.
Step S440: and performing enhancement processing on the first audio signal and the second audio signal, and performing attenuation processing on audio signals except the first audio signal and the second audio signal in the plurality of audio signals.
In some embodiments, after determining the first audio signal corresponding to the front camera and the second audio signal corresponding to the rear camera, the first audio signal and the second audio signal may be subjected to enhancement processing, and the audio signals except the first audio signal and the second audio signal of the plurality of audio signals may be subjected to attenuation processing. It can be understood that, by the enhancement processing of the first audio signal and the second audio signal and the attenuation processing of the other audio signals, the source directions of the image signal and the audio signal of the video shooting can be basically consistent, and the video shooting effect can be improved.
As one mode, performing enhancement processing on the first audio signal and the second audio signal, and performing attenuation processing on an audio signal other than the first audio signal and the second audio signal among the plurality of audio signals may include: increasing the volume of the first audio signal and the second audio signal, and decreasing the volume of the audio signals other than the first audio signal and the second audio signal among the plurality of audio signals; increasing the gain of the first audio signal and the second audio signal, and decreasing the gain of the audio signals except the first audio signal and the second audio signal in the plurality of audio signals; the definition of the first audio signal and the second audio signal is improved, and the definition of the audio signals except the first audio signal and the second audio signal in the plurality of audio signals is reduced.
Step S450: when the audio signals corresponding to the front camera and the audio signals corresponding to the rear camera are not included in the audio signals, acquiring an audio signal with the maximum loudness from the audio signals as a third audio signal.
In some embodiments, when it is determined that the front camera of the electronic device is turned on and the rear camera of the electronic device is turned on, it may be detected whether an audio signal corresponding to the front camera is included in the plurality of audio signals collected by the microphone and whether an audio signal corresponding to the rear camera is included. If it is detected that the audio signals do not include the audio signal corresponding to the front camera and the audio signal corresponding to the rear camera, it can be considered that the audio signals having the same direction as the image signals do not exist in the plurality of acquired audio signals in the process of video shooting of the electronic device.
As a practical manner, when the audio signal corresponding to the front camera and the audio signal corresponding to the rear camera are not included in the plurality of audio signals, the audio signal with the highest loudness may be acquired from the plurality of audio signals as the third audio signal, that is, the audio signal with the highest loudness in the plurality of audio signals may be regarded as the audio signal that is most desirably acquired by the electronic device as the audio signal in the video.
Step S460: and performing enhancement processing on the third audio signal, and performing attenuation processing on audio signals except the third audio signal in the plurality of audio signals.
In some embodiments, after determining the third audio signal, the third audio signal may be subjected to enhancement processing, and the audio signals other than the third audio signal of the plurality of audio signals may be subjected to attenuation processing. It can be understood that the audio signal of the video shooting can be more expected by the enhancement processing of the third audio signal and the attenuation processing of the other audio signals, and the effect of the video shooting can be improved.
As one mode, performing enhancement processing on the third audio signal, and performing attenuation processing on the audio signals other than the third audio signal among the plurality of audio signals may include: increasing the volume of the third audio signal and decreasing the volume of the audio signals except the third audio signal in the plurality of audio signals; increasing the gain of the third audio signal and reducing the gain of the audio signals except the third audio signal in the plurality of audio signals; and improving the definition of the third audio signal and reducing the definition of the audio signals except the third audio signal in the plurality of audio signals.
Compared with the video shooting method shown in fig. 1, in the video shooting method provided in another embodiment of the present application, when the front camera is turned on and the rear camera is turned on, the audio signal corresponding to the front camera and the audio signal corresponding to the rear camera are enhanced, and the other audio signals except the audio signal corresponding to the front camera and the audio signal corresponding to the rear camera are attenuated, so as to improve the audio effect of video shooting. In addition, when the audio signals do not include the audio signals corresponding to the front camera and the rear camera, the audio signal with the maximum loudness is subjected to enhancement processing, and other audio signals except the audio signal with the maximum loudness are subjected to attenuation processing, so that the audio effect of video shooting is improved.
Referring to fig. 8, fig. 8 is a schematic flowchart illustrating a video shooting method according to still another embodiment of the present application. The method is applied to the electronic device, where the electronic device includes a front camera, a rear camera, and a microphone, in this embodiment, the first state is an open state, and the second state is an open state, which will be described in detail with reference to a flow shown in fig. 8, and the video shooting method may specifically include the following steps:
step S510: when the electronic equipment carries out video shooting, the state of the front camera is obtained as a first state, and the state of the rear camera is obtained as a second state.
Step S520: determining an audio processing parameter corresponding to the first state and the second state from among a plurality of audio processing parameters as a target audio processing parameter.
For the detailed description of steps S410 to S420, refer to steps S510 to S520, which are not described herein again.
Step S530: and acquiring an audio signal corresponding to the front camera as a first audio signal and acquiring an audio signal corresponding to the rear camera as a second audio signal from the plurality of audio signals.
Step S540: and performing enhancement processing on the first audio signal and the second audio signal, and performing attenuation processing on audio signals except the first audio signal and the second audio signal in the plurality of audio signals.
For the detailed description of steps S530 to S540, refer to steps S430 to S440, which are not described herein again.
Step S550: and when the audio signals do not comprise the audio signal corresponding to the front camera and the audio signal corresponding to the rear camera, outputting prompt information, wherein the prompt information is used for prompting to adjust the shooting direction of the electronic equipment.
In some embodiments, when it is determined that the front camera of the electronic device is turned on and the rear camera of the electronic device is turned on, it may be detected whether an audio signal corresponding to the front camera is included in the plurality of audio signals collected by the microphone and whether an audio signal corresponding to the rear camera is included. If it is detected that the audio signals do not include the audio signal corresponding to the front camera and the audio signal corresponding to the rear camera, it can be considered that the audio signals having the same direction as the image signals do not exist in the plurality of acquired audio signals in the process of video shooting of the electronic device.
As an implementable manner, when the audio signal corresponding to the front camera and the audio signal corresponding to the rear camera are not included in the plurality of audio signals, it may be considered that the shooting direction of the electronic device is deviated or the sound source position is changed, and at this time, a prompt message may be output to prompt adjustment of the shooting direction of the electronic device, so that the adjusted shooting direction is consistent with the direction of the sound source position, thereby improving the video shooting effect.
Compared with the video shooting method shown in fig. 1, the video shooting method provided in another embodiment of the present application further performs enhancement processing on the audio signal corresponding to the front camera and the audio signal corresponding to the rear camera when the front camera is turned on and the rear camera is turned on, and performs attenuation processing on the audio signal corresponding to the front camera and other audio signals except the audio signal corresponding to the rear camera, so as to improve the audio effect of video shooting. In addition, when the audio signals do not comprise the audio signals corresponding to the front camera and the rear camera, the shooting direction of the electronic equipment is prompted to rotate so as to improve the video shooting effect.
Referring to fig. 9, fig. 9 is a schematic flowchart illustrating a video shooting method according to yet another embodiment of the present application. The method is applied to the electronic device, the electronic device includes a front camera, a rear camera and a microphone, and the following details are set forth with respect to the flow shown in fig. 9, and the video shooting method may specifically include the following steps:
step S610: when the electronic equipment carries out video shooting, the state of the front camera is acquired as a first state, and the state of the rear camera is acquired as a second state.
Step S620: determining an audio processing parameter corresponding to the first state and the second state from among a plurality of audio processing parameters as a target audio processing parameter.
For the detailed description of step S610 to step S620, refer to step S110 to step S120, which are not described herein again.
Step S630: a phase and amplitude of a plurality of audio signals arriving at each of the plurality of microphones is obtained.
In this embodiment, the number of the microphones is multiple, and the microphones are spatially distributed in the main body of the electronic device, for example, the number of the microphones may be 3. Based on this structure, the phase difference and amplitude difference between the same sound source and each microphone can be known.
In some embodiments, during the video shooting, the camera may collect an image signal and the microphones may collect audio signals, wherein during the audio signal collection, the microphones may acquire a phase and an amplitude of each of the collected audio signals reaching each of the microphones.
For example, assume that the microphones include a first microphone, a second microphone, and a third microphone, and the plurality of audio signals includes a first audio signal, a second audio signal, and a third audio signal. The phase and amplitude of the first audio signal arriving at the first microphone, the phase and amplitude of the first audio signal arriving at the second microphone, the phase and amplitude of the first audio signal arriving at the third microphone, the phase and amplitude of the second audio signal arriving at the first microphone, the phase and amplitude of the second audio signal arriving at the second microphone, the phase and amplitude of the second audio signal arriving at the third microphone, the phase and amplitude of the third audio signal arriving at the first microphone, the phase and amplitude of the third audio signal arriving at the second microphone, and the phase and amplitude of the third audio signal arriving at the third microphone may be obtained.
Step S640: and acquiring the phase difference and the amplitude difference of each audio signal reaching the plurality of microphones based on the phase and the amplitude of each audio signal reaching each microphone.
In this embodiment, after obtaining the phase and amplitude of each audio signal arriving at each microphone, the phase difference and amplitude difference of each audio signal arriving at multiple microphones can be calculated and obtained based on the phase and amplitude of each audio signal arriving at each microphone.
For example, assume that the microphones include a first microphone, a second microphone, and a third microphone, and the plurality of audio signals include a first audio signal, a second audio signal, and a third audio signal. Then the phase difference and amplitude difference between the first audio signal arriving at the first microphone and the first audio signal arriving at the second microphone, and the phase difference and amplitude difference between the first audio signal arriving at the first microphone and the first audio signal arriving at the third microphone … … may be obtained, which are not described herein again.
Step S650: and acquiring sound source positions corresponding to the plurality of audio signals respectively based on the phase difference, the amplitude difference and the position relation among the plurality of microphones.
In this embodiment, after obtaining the phase difference and the amplitude difference of each audio signal reaching the multiple microphones, the sound source positions corresponding to the multiple audio signals may be obtained based on the phase difference, the amplitude difference, and the positional relationship among the multiple microphones, where the sound source positions corresponding to the multiple audio signals may be used to provide a reference basis for subsequent audio signal processing based on the target audio processing parameter. As one way, since the electronic device has a limited volume and the relative distance between the plurality of microphones is small, the relative distance between the plurality of microphones can be ignored by default, and then the sound source positions corresponding to the plurality of audio signals can be obtained based on the phase difference and the amplitude difference.
In some embodiments, the phase difference and the amplitude difference may be calculated by a preset spatial distribution function, and a sound source position corresponding to each of the plurality of audio signals is obtained. The obtaining manner of the preset spatial distribution function may include: when a video shooting test is carried out in advance, a coordinate system comprising an X axis, a Y axis and a Z axis is established, the electronic equipment is located at the original point of the coordinate system, the sound source is respectively placed at different position points (at least 8 position points) in the interval of the X axis, the Y axis and the Z axis so as to ensure that the positive value and the negative value of each axis have a tested position point), and during the test, the spatial distribution function of the sound source is established through the phase difference and the amplitude difference of different sound source points reaching a plurality of microphones to serve as a preset spatial distribution function.
In some embodiments, the sound source positions corresponding to the plurality of audio signals corresponding to the phase difference and the amplitude difference may be obtained through a mapping relationship established in advance.
Step S660: processing a plurality of audio signals acquired by the microphone based on the target audio processing parameter.
For detailed description of step S660, please refer to step S130, which is not described herein again.
In another embodiment of the present application, compared to the video capturing method shown in fig. 1, in the video capturing method provided in this embodiment, the sound source positions corresponding to the plurality of audio signals are determined according to the phase difference and the amplitude difference between the audio signals reaching the plurality of microphones, and the processing manner for the audio signals is determined according to the sound source position of each audio signal, so as to improve the audio processing effect.
Referring to fig. 10, fig. 10 is a schematic flow chart illustrating a video shooting method according to still another embodiment of the present application. The method is applied to the electronic device, the electronic device includes a front camera, a rear camera and a microphone, and the following will be described in detail with respect to the flow shown in fig. 10, and the video shooting method may specifically include the following steps:
step S710: when the electronic equipment carries out video shooting, the state of the front camera is obtained as a first state, and the state of the rear camera is obtained as a second state.
For the detailed description of step S710, please refer to step S110, which is not described herein again.
Step S720: determining a video capture direction based on the first state and the second state.
In this embodiment, after acquiring the state of the front camera as the first state and acquiring the state of the rear camera as the second state, the video capturing direction may be determined based on the first state and the second state.
As one mode, when the first state is an on state and the rear camera is an off state, it may be determined that the video capturing direction is the forward direction based on the first state and the second state.
As still another way, when the first state is the off state and the rear camera is the on state, it may be determined that the video capturing direction is the rear direction based on the first state and the second state.
As another mode, when the first state is the on state and the rear camera is the on state, it may be determined that the video capturing direction is the forward direction and the backward direction based on the first state and the second state.
Step S730: determining an audio processing parameter corresponding to the video capturing direction from the plurality of audio processing parameters as the target audio processing parameter.
In this embodiment, after the video capturing direction is acquired, a corresponding audio processing parameter may be determined as a target audio processing parameter from among a plurality of audio processing parameters based on the video capturing direction. In some embodiments, the electronic device may be preset with a mapping relationship between a plurality of audio processing parameters and a video capturing direction. Therefore, in this embodiment, in acquiring the video capturing Fang Xianghou, the audio processing parameter corresponding to the video capturing direction can be found based on the mapping relationship as the target audio processing parameter.
For example, as shown in table 2, assuming that the number of the plurality of audio processing parameters is three, and the three audio processing parameters include a first audio processing parameter, a second audio processing parameter, and a third audio processing parameter, the video capturing direction includes: based on the forward direction, the backward direction, the forward direction and the backward direction, the first audio processing parameter can establish a mapping relation with the forward direction, the second audio processing parameter can establish a mapping relation with the backward direction, and the third audio processing parameter can establish a mapping relation with the forward direction and the backward direction.
TABLE 2
Audio processing parameters Video shooting direction
First audio processing parameter Forward direction of rotation
Second audio processing parameter Back to back
Third audio processing parameter Forward and backward directions
As shown in table 2, when the video shooting direction is the forward direction, based on the mapping relationship, the first audio processing parameter can be searched and obtained as the target audio processing parameter; when the video shooting direction is backward, a second audio processing parameter can be searched and obtained as a target audio processing parameter based on the mapping relation; when the video shooting direction is the forward direction and the backward direction, based on the mapping relation, a third audio processing parameter can be searched and obtained as a target audio processing parameter.
Step S740: processing a plurality of audio signals acquired by the microphone based on the target audio processing parameter.
For detailed description of step S740, please refer to step S130, which is not described herein again.
In another embodiment of the present application, when an electronic device performs video shooting, a state of a front camera is obtained as a first state, a state of a rear camera is obtained as a second state, a video shooting direction is determined based on the first state and the second state, an audio processing parameter corresponding to the video shooting direction is determined from a plurality of audio processing parameters, the audio processing parameter is used as a target audio processing parameter, and a plurality of audio signals collected by a microphone are processed based on the target audio processing parameter. Compared with the video shooting method shown in fig. 1, the present embodiment further determines the video shooting direction based on the state of the front camera and the state of the rear camera, and correspondingly determines the target audio processing parameter, thereby improving the accuracy of the determined target audio processing parameter.
Referring to fig. 11, fig. 11 is a block diagram illustrating a video camera according to an embodiment of the present disclosure. The video camera 200 is applied to the above-mentioned electronic device, which includes a front camera, a rear camera and a microphone, and will be explained with reference to the block diagram shown in fig. 11, the video camera 200 includes: a state obtaining module 210, an audio processing parameter obtaining module 220, and an audio processing module 230, wherein:
the state obtaining module 210 is configured to obtain, when the electronic device performs video shooting, a state of the front camera as a first state, and obtain a state of the rear camera as a second state.
An audio processing parameter obtaining module 220, configured to determine an audio processing parameter corresponding to the first state and the second state from a plurality of audio processing parameters, as a target audio processing parameter.
Further, the audio processing parameter obtaining module 220 includes: the video shooting direction determining submodule and the audio processing parameter obtaining submodule, wherein:
and the video shooting direction determining submodule is used for determining the video shooting direction based on the first state and the second state.
And the audio processing parameter acquisition sub-module is used for determining an audio processing parameter corresponding to the video shooting direction from the plurality of audio processing parameters as the target audio processing parameter.
An audio processing module 230, configured to process a plurality of audio signals collected by the microphones based on the target audio processing parameter.
Further, when the first state is an on state and the second state is an off state, the audio processing module 230 includes: a first audio signal acquisition sub-module and a first audio processing sub-module for
And the first audio signal acquisition submodule is used for acquiring an audio signal corresponding to the front camera from the plurality of audio signals as a first audio signal.
And the first audio processing submodule is used for performing enhancement processing on the first audio signal and performing attenuation processing on audio signals except the first audio signal in the plurality of audio signals.
Further, when the first state is an off state and the second state is an on state, the audio processing module 230 includes: a second audio signal acquisition sub-module and a second audio processing sub-module, wherein:
and the second audio signal acquisition submodule is used for acquiring the audio signal corresponding to the rear camera from the plurality of audio signals as a second audio signal.
And the second audio processing submodule is used for enhancing the second audio signal and attenuating the audio signals except the second audio signal in the plurality of audio signals.
Further, when the first state is an on state and the second state is an on state, the audio processing module 230 includes: a third audio signal acquisition sub-module and a third audio signal processing sub-module, wherein:
and the third audio signal acquisition submodule is used for acquiring an audio signal corresponding to the front camera from the plurality of audio signals as a first audio signal and acquiring an audio signal corresponding to the rear camera as a second audio signal.
Further, the third audio signal acquisition sub-module includes: sound source position acquisition unit, target sound source position acquisition unit and audio signal acquisition unit, wherein:
and the sound source position acquisition unit is used for acquiring the sound source positions corresponding to the plurality of audio signals respectively.
And the target sound source position acquisition unit is used for acquiring a sound source position positioned in the visual angle range of the front camera from a plurality of sound source positions as a first target sound source position, and acquiring a sound source position positioned in the visual angle range of the rear camera from the plurality of sound source positions as a second target sound source position.
And the audio signal acquisition unit is used for acquiring the audio signal corresponding to the first target sound source position as the first audio signal and acquiring the audio signal corresponding to the second target sound source position as the second audio signal.
And the third audio signal processing submodule is used for performing enhancement processing on the first audio signal and the second audio signal and performing attenuation processing on audio signals except the first audio signal and the second audio signal in the plurality of audio signals.
Further, the audio processing module 230 further includes: a fourth audio signal acquisition sub-module and a fourth audio signal processing sub-module, wherein:
and the fourth audio signal acquisition submodule is used for acquiring an audio signal with the maximum loudness from the plurality of audio signals as a third audio signal when the audio signal corresponding to the front camera and the audio signal corresponding to the rear camera are not included in the plurality of audio signals.
And the fourth audio signal processing submodule is used for performing enhancement processing on the third audio signal and performing attenuation processing on the audio signals except the third audio signal in the plurality of audio signals.
Further, the audio processing module 230 further includes: a prompt information output sub-module, wherein:
and the prompt information output submodule is used for outputting prompt information when the audio signals do not comprise the audio signal corresponding to the front camera and the audio signal corresponding to the rear camera, wherein the prompt information is used for prompting to adjust the shooting direction of the electronic equipment.
Further, the number of the microphones is multiple, and the microphones are stereoscopically distributed in the main body of the electronic device, the video capturing apparatus 200 further includes: parameter acquisition module, parameter difference acquisition module and sound source position acquisition module, wherein:
a parameter acquisition module to acquire a phase and an amplitude of a plurality of audio signals arriving at each of the plurality of microphones, respectively.
And the parameter difference acquisition module is used for acquiring the phase difference and the amplitude difference of each audio signal reaching the plurality of microphones based on the phase and the amplitude of each audio signal reaching each microphone.
And the sound source position acquisition module is used for acquiring the sound source positions corresponding to the plurality of audio signals based on the phase difference, the amplitude difference and the position relation among the plurality of microphones.
It can be clearly understood by those skilled in the art that, for convenience and simplicity of description, the specific working processes of the above-described devices and modules may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In several embodiments provided in the present application, the coupling of the modules to each other may be electrical, mechanical or other forms of coupling.
In addition, functional modules in the embodiments of the present application may be integrated into one processing module, or each of the modules may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode.
Referring to fig. 12, a block diagram of an electronic device 100 according to an embodiment of the present disclosure is shown. The electronic device 100 may be a smart phone, a tablet computer, an electronic book, or other electronic devices capable of running an application. The electronic device 100 in the present application may include one or more of the following components: processor 110, memory 120, front-facing camera 130, rear-facing camera 140, microphone 150, and one or more applications, wherein the one or more applications may be stored in memory 120 and configured to be executed by the one or more processors 110, the one or more programs configured to perform the methods as described in the foregoing method embodiments.
Processor 110 may include one or more processing cores, among other things. The processor 110 connects various parts within the overall electronic device 100 using various interfaces and lines, and performs various functions of the electronic device 100 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 120 and calling data stored in the memory 120. Alternatively, the processor 110 may be implemented in hardware using at least one of Digital Signal Processing (DSP), field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 110 may integrate one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing the content to be displayed; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 110, but may be implemented by a communication chip.
The Memory 120 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). The memory 120 may be used to store instructions, programs, code, sets of codes, or sets of instructions. The memory 120 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like. The data storage area may also store data created by the electronic device 100 during use (e.g., phone book, audio-video data, chat log data), and the like.
Referring to fig. 13, a block diagram of a computer-readable storage medium according to an embodiment of the present application is shown. The computer-readable medium 300 has stored therein a program code that can be called by a processor to execute the method described in the above-described method embodiments.
The computer-readable storage medium 300 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Alternatively, the computer-readable storage medium 300 includes a non-volatile computer-readable storage medium. The computer readable storage medium 300 has storage space for program code 310 for performing any of the method steps of the method described above. The program code can be read from and written to one or more computer program products. The program code 310 may be compressed, for example, in a suitable form.
To sum up, according to the video shooting method, the video shooting device, the electronic device and the storage medium provided by the embodiment of the application, when the electronic device performs video shooting, the audio processing parameters corresponding to the camera used for video shooting are determined from the multiple audio processing parameters, and the determined audio processing parameters are used for processing the audio signals acquired by the microphone, so that the audio signals acquired by the microphone are processed by adopting different audio processing parameters according to different states of the camera during video shooting, and the audio and video effects of video shooting are improved.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not necessarily depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims (9)

1. A video shooting method is applied to electronic equipment, wherein the electronic equipment comprises a front camera, a rear camera and a microphone, and the method comprises the following steps:
when the electronic equipment carries out video shooting, acquiring the state of the front camera as a first state, and acquiring the state of the rear camera as a second state;
determining an audio processing parameter corresponding to the first state and the second state from a plurality of audio processing parameters as a target audio processing parameter;
processing a plurality of audio signals collected by the microphone based on the target audio processing parameter;
when the first state is an on state and the second state is an on state, the processing the plurality of audio signals collected by the microphone based on the target audio processing parameter includes:
acquiring an audio signal corresponding to the front camera as a first audio signal and acquiring an audio signal corresponding to the rear camera as a second audio signal from the plurality of audio signals;
performing enhancement processing on the first audio signal and the second audio signal, and performing attenuation processing on audio signals except the first audio signal and the second audio signal in the plurality of audio signals;
and when the audio processing parameters do not comprise the audio signal corresponding to the front camera and the audio signal corresponding to the rear camera, outputting prompt information, wherein the prompt information is used for prompting to adjust the shooting direction of the electronic equipment so as to enable the adjusted shooting direction to be consistent with the direction of the sound source position.
2. The method of claim 1, wherein processing the plurality of audio signals collected by the microphone based on the target audio processing parameter when the first state is an on state and the second state is an off state comprises:
acquiring an audio signal corresponding to the front camera from the plurality of audio signals as a first audio signal;
and performing enhancement processing on the first audio signal, and performing attenuation processing on audio signals except the first audio signal in the plurality of audio signals.
3. The method of claim 1, wherein processing the plurality of audio signals captured by the microphone based on the target audio processing parameter when the first state is an off state and the second state is an on state comprises:
acquiring an audio signal corresponding to the rear camera from the plurality of audio signals as a second audio signal;
and performing enhancement processing on the second audio signal, and performing attenuation processing on audio signals except the second audio signal in the plurality of audio signals.
4. The method according to claim 1, wherein the acquiring, from the plurality of audio signals, an audio signal corresponding to the front camera as a first audio signal and an audio signal corresponding to the rear camera as a second audio signal comprises:
acquiring sound source positions corresponding to the plurality of audio signals respectively;
acquiring a sound source position located within a visual angle range of the front camera from a plurality of sound source positions as a first target sound source position, and acquiring a sound source position located within a visual angle range of the rear camera from the plurality of sound source positions as a second target sound source position;
and acquiring an audio signal corresponding to the first target sound source position as the first audio signal, and acquiring an audio signal corresponding to the second target sound source position as the second audio signal.
5. The method according to any one of claims 1-4, wherein the number of the microphones is multiple, and the multiple microphones are spatially distributed in the main body of the electronic device, and before processing the multiple audio signals collected by the microphones based on the target audio processing parameter, the method further comprises:
obtaining a phase and an amplitude of a plurality of audio signals arriving at each of the plurality of microphones, respectively;
acquiring a phase difference and an amplitude difference of each audio signal arriving at the plurality of microphones based on the phase and the amplitude of each audio signal arriving at each microphone;
and acquiring sound source positions corresponding to the plurality of audio signals respectively based on the phase difference, the amplitude difference and the position relation among the plurality of microphones.
6. The method according to any of claims 1-4, wherein the determining, from a plurality of audio processing parameters, an audio processing parameter corresponding to the first state and the second state as a target audio processing parameter comprises:
determining a video shooting direction based on the first state and the second state;
determining an audio processing parameter corresponding to the video photographing direction from among the plurality of audio processing parameters as the target audio processing parameter.
7. The utility model provides a video shooting device which characterized in that is applied to electronic equipment, electronic equipment includes leading camera, rear camera and microphone, the device includes:
the state acquisition module is used for acquiring the state of the front camera as a first state and acquiring the state of the rear camera as a second state when the electronic equipment carries out video shooting;
an audio processing parameter obtaining module, configured to determine, from among multiple audio processing parameters, an audio processing parameter corresponding to the first state and the second state as a target audio processing parameter;
an audio processing module, configured to process a plurality of audio signals collected by the microphone based on the target audio processing parameter;
when the first state is an on state and the second state is an on state, the audio processing module includes:
the third audio signal acquisition submodule is used for acquiring an audio signal corresponding to the front camera from the plurality of audio signals as a first audio signal and acquiring an audio signal corresponding to the rear camera as a second audio signal;
the third audio signal processing submodule is used for performing enhancement processing on the first audio signal and the second audio signal and performing attenuation processing on audio signals except the first audio signal and the second audio signal in the plurality of audio signals;
and the prompt information output submodule is used for outputting prompt information when the audio processing parameters do not comprise the audio signal corresponding to the front camera and the audio signal corresponding to the rear camera, wherein the prompt information is used for prompting and adjusting the shooting direction of the electronic equipment so as to enable the adjusted shooting direction to be consistent with the direction of the sound source position.
8. An electronic device comprising a front-facing camera, a rear-facing camera, a microphone, a memory, and a processor, the front-facing camera, the rear-facing camera, the microphone, and the memory coupled to the processor, the memory storing instructions that, when executed by the processor, the processor performs the method of any of claims 1-6.
9. A computer-readable storage medium, having stored thereon program code that can be invoked by a processor to perform the method according to any one of claims 1 to 6.
CN202110691616.8A 2021-06-22 2021-06-22 Video shooting method and device, electronic equipment and storage medium Active CN113395451B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110691616.8A CN113395451B (en) 2021-06-22 2021-06-22 Video shooting method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110691616.8A CN113395451B (en) 2021-06-22 2021-06-22 Video shooting method and device, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN113395451A CN113395451A (en) 2021-09-14
CN113395451B true CN113395451B (en) 2023-04-18

Family

ID=77623316

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110691616.8A Active CN113395451B (en) 2021-06-22 2021-06-22 Video shooting method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN113395451B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114071324A (en) * 2021-12-21 2022-02-18 Oppo广东移动通信有限公司 Audio processing method and device and electronic equipment

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004304560A (en) * 2003-03-31 2004-10-28 Fujitsu Ltd Electronic apparatus
US8451312B2 (en) * 2010-01-06 2013-05-28 Apple Inc. Automatic video stream selection
US9274744B2 (en) * 2010-09-10 2016-03-01 Amazon Technologies, Inc. Relative position-inclusive device interfaces
CN104699445A (en) * 2013-12-06 2015-06-10 华为技术有限公司 Audio information processing method and device
CN104991573A (en) * 2015-06-25 2015-10-21 北京品创汇通科技有限公司 Locating and tracking method and apparatus based on sound source array
CN108076300B (en) * 2017-12-15 2020-07-07 Oppo广东移动通信有限公司 Video processing method, video processing device and mobile terminal
CN112637529B (en) * 2020-12-18 2023-06-02 Oppo广东移动通信有限公司 Video processing method and device, storage medium and electronic equipment

Also Published As

Publication number Publication date
CN113395451A (en) 2021-09-14

Similar Documents

Publication Publication Date Title
CN107534725B (en) Voice signal processing method and device
CN108766457B (en) Audio signal processing method, audio signal processing device, electronic equipment and storage medium
CN113676592B (en) Recording method, recording device, electronic equipment and computer readable medium
CN112995566B (en) Sound source positioning method based on display device, display device and storage medium
WO2016082199A1 (en) Method for recording sound of image-recorded object and mobile terminal
CN114697812A (en) Sound collection method, electronic equipment and system
CN113395451B (en) Video shooting method and device, electronic equipment and storage medium
CN110392334B (en) Microphone array audio signal self-adaptive processing method, device and medium
CN113596240B (en) Recording method, recording device, electronic equipment and computer readable medium
CN113542466A (en) Audio processing method, electronic device and storage medium
WO2023231787A9 (en) Audio processing method and apparatus
US11902754B2 (en) Audio processing method, apparatus, electronic device and storage medium
CN113676593B (en) Video recording method, video recording device, electronic equipment and storage medium
EP4280211A1 (en) Sound signal processing method and electronic device
CN112752059B (en) Video conference system and video conference method
CN114422743A (en) Video stream display method, device, computer equipment and storage medium
CN115061380A (en) Device control method and device, electronic device and readable storage medium
JP2020088618A (en) Video conference system, communication terminal, and method for controlling microphone of communication terminal
WO2022161146A1 (en) Video recording method and electronic device
CN111144287A (en) Audio-visual auxiliary communication method, device and readable storage medium
WO2021073336A1 (en) A system and method for creating real-time video
WO2022228089A1 (en) Method for audio reception, apparatus, and related electronic device
CN115499537B (en) Microphone control method and device, mobile terminal and storage medium
CN117636928A (en) Pickup device and related audio enhancement method
CN115527561A (en) Audio recording method and device and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant