CN112289336B - Audio signal processing method and device - Google Patents
Audio signal processing method and device Download PDFInfo
- Publication number
- CN112289336B CN112289336B CN202011194355.0A CN202011194355A CN112289336B CN 112289336 B CN112289336 B CN 112289336B CN 202011194355 A CN202011194355 A CN 202011194355A CN 112289336 B CN112289336 B CN 112289336B
- Authority
- CN
- China
- Prior art keywords
- audio signal
- microphone
- rechecked
- microphones
- echo
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005236 sound signal Effects 0.000 title claims abstract description 339
- 238000003672 processing method Methods 0.000 title claims abstract description 16
- 238000012545 processing Methods 0.000 claims abstract description 65
- 238000000034 method Methods 0.000 claims abstract description 64
- 238000001514 detection method Methods 0.000 abstract description 66
- 230000000903 blocking effect Effects 0.000 abstract description 56
- 230000006854 communication Effects 0.000 abstract description 9
- 230000002159 abnormal effect Effects 0.000 abstract description 8
- 238000004891 communication Methods 0.000 abstract description 8
- 241000209140 Triticum Species 0.000 description 13
- 235000021307 Triticum Nutrition 0.000 description 13
- 238000013461 design Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 230000000694 effects Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000005070 sampling Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/19—Arrangements of transmitters, receivers, or complete sets to prevent eavesdropping, to attenuate local noise or to prevent undesired transmission; Mouthpieces or receivers specially adapted therefor
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L2021/02082—Noise filtering the noise being echo, reverberation of the speech
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
- G10L2021/02165—Two microphones, one receiving mainly the noise signal and the other one mainly the speech signal
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Quality & Reliability (AREA)
- Telephone Function (AREA)
Abstract
The application discloses an audio signal processing method and device, and belongs to the technical field of communication. The method comprises the following steps: acquiring a first audio signal acquired by a microphone and a transmitted second audio signal, determining that the intensity of the first audio signal is not lower than a to-be-rechecked microphone corresponding to an intensity threshold, determining an echo path of the to-be-rechecked microphone, and processing the first audio signal acquired by the microphone with the echo path conforming to a preset condition under the condition that the to-be-rechecked microphone comprises the microphone with the echo path not conforming to the preset condition, so as to obtain a target audio signal. In the audio signal processing process, after the first microphone blocking detection, the second microphone blocking detection is performed on a plurality of microphones which are detected to be normal according to the change of the echo paths of the microphones, so that abnormal audio signals can be avoided when the microphone blocking detection is wrong, and the quality of the target audio signals can be improved.
Description
Technical Field
The application belongs to the technical field of communication, and particularly relates to an audio signal processing method and device.
Background
Along with development of electronic technology, electronic devices generally adopt a multi-microphone design, audio signals at different positions of the electronic device are collected through multiple microphones, and target audio signals are obtained through processing by combining the audio signals at different positions. For example, the electronic device adopts a dual-microphone design, and can acquire audio signals at two positions through two microphones arranged at two ends of the electronic device respectively, process the two audio signals to obtain a target audio signal, and achieve the effect of dual-microphone noise reduction.
When the multi-microphone design is adopted, in the voice call process, the microphone is shielded by hands or other foreign matters, the occurrence of the microphone blockage occurs, and the audio signal acquired by the microphone with the microphone blockage is an abnormal audio signal. If the target audio signal is obtained by adopting abnormal audio signal processing, the problems that the voice of the user in the audio signal collected by the normal microphone is restrained, noise and echo cannot be removed and the like can be caused. Therefore, when the electronic device adopts a multi-microphone design, in the voice call process, whether each microphone is blocked needs to be detected respectively, and the audio signals collected by the microphones without the blocking need to be processed to obtain target audio signals.
In the process of implementing the present application, the inventor finds that at least the following problems exist in the prior art: in the detection process of the blocking microphone, an audio signal sent by a loudspeaker in the electronic equipment is transmitted to the microphone through the internal structure of the electronic equipment, so that the detection error of the blocking microphone is caused, the audio signal cannot be correctly selected, and the quality of a target audio signal is reduced.
Content of the application
The embodiment of the application aims to provide an audio signal processing method and device, which can solve the problem that the blocking wheat is detected in error and the audio signal cannot be selected correctly.
In order to solve the technical problems, the application is realized as follows:
in a first aspect, an embodiment of the present application provides an audio signal processing method, including:
acquiring first audio signals acquired by the at least two microphones and second audio signals sent by second electronic equipment;
determining a to-be-rechecked microphone with the intensity of the first audio signal not lower than a corresponding intensity threshold from the at least two microphones;
under the condition that the number of the microphones to be rechecked is at least two, determining an echo path of the microphones to be rechecked according to the first audio signal and the second audio signal acquired by the microphones to be rechecked; the echo path is used for representing a propagation path of the second audio signal to the microphone to be rechecked;
and under the condition that the microphone to be rechecked comprises a microphone with an echo path which does not meet the preset condition, processing the first audio signal acquired by the microphone with the echo path which meets the preset condition to obtain a target audio signal.
In a second aspect, an embodiment of the present application provides an audio signal processing apparatus, including:
The acquisition module is used for acquiring the first audio signals acquired by the at least two microphones and the second audio signals sent by the second electronic equipment;
a first determining module, configured to determine, from the at least two microphones, a to-be-rechecked microphone whose intensity of the first audio signal is not lower than a corresponding intensity threshold;
the second determining module is used for determining an echo path of the microphone to be re-detected according to the first audio signal and the second audio signal acquired by the microphone to be re-detected under the condition that the number of the microphones to be re-detected is at least two; the echo path is used for representing a propagation path of the second audio signal to the microphone to be rechecked;
the processing module is used for processing the first audio signal acquired by the microphone with the echo path meeting the preset condition to obtain a target audio signal when the microphone with the echo path meeting the preset condition is included in the microphone to be re-detected.
In a third aspect, an embodiment of the present application provides an electronic device, including a processor, a memory, and a program or instruction stored on the memory and executable on the processor, the program or instruction implementing the steps of the method according to the first aspect when executed by the processor.
In a fourth aspect, embodiments of the present application provide a readable storage medium having stored thereon a program or instructions which when executed by a processor perform the steps of the method according to the first aspect.
In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and where the processor is configured to execute a program or instructions to implement a method according to the first aspect.
In the embodiment of the application, the first audio signals collected by at least two microphones and the second audio signals sent by the second electronic equipment are obtained, the to-be-rechecked microphones with the intensity of the first audio signals not lower than the corresponding intensity threshold value are determined from the at least two microphones, the echo paths of the to-be-rechecked microphones are determined according to the first audio signals and the second audio signals collected by the to-be-rechecked microphones under the condition that the number of the to-be-rechecked microphones is at least two, and the first audio signals collected by the microphones with the echo paths meeting the preset conditions are processed under the condition that the to-be-rechecked microphones comprise microphones with the echo paths not meeting the preset conditions, so as to obtain the target audio signals. For the electronic equipment adopting the multi-microphone design, in the audio signal processing process, after the first microphone blocking detection, if a plurality of microphones with normal detection exist, the second microphone blocking detection is carried out on the plurality of microphones with normal detection according to the change of the echo paths of the microphones, so that abnormal audio signals can be prevented from being used when the first microphone blocking detection is wrong, and the quality of target audio signals can be improved.
Drawings
Fig. 1 is a flowchart of steps of a method of processing an audio signal according to an exemplary embodiment;
FIG. 2 is a schematic diagram of an echo cancellation algorithm provided in accordance with an exemplary embodiment;
fig. 3 is a flowchart of steps of another audio signal processing method provided in accordance with an exemplary embodiment;
fig. 4 is a block diagram of an audio signal processing apparatus provided according to an exemplary embodiment;
FIG. 5 is a block diagram of an electronic device provided in accordance with an exemplary embodiment;
fig. 6 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
The terms first, second and the like in the description and in the claims, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that embodiments of the application may be practiced otherwise than as specifically illustrated or described herein. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship.
Where the term "session" refers to a use of an Application (App) that calculates the beginning of a session from a non-foreground to a foreground presentation (including cold and hot starts of the Application), and the Application switches from the foreground presentation to the non-foreground (including returning to the desktop, killing processes, or switching to other applications, etc.) to the end of the session.
The audio signal processing method provided by the embodiment of the application is described in detail below through specific embodiments and application scenes thereof with reference to the accompanying drawings.
Referring to fig. 1, fig. 1 is a flowchart illustrating steps of an audio signal processing method according to an exemplary embodiment, and as shown in fig. 1, the method is applied to a first electronic device having at least two microphones, and may include:
step 101, acquiring first audio signals acquired by at least two microphones and second audio signals sent by second electronic equipment.
The electronic device, such as a mobile phone, a tablet computer, a wearable device, and the like, may integrate a plurality of microphones, for example, a mobile phone designed by three microphones may include three microphones disposed at different positions of the mobile phone.
In this embodiment, the first electronic device may collect the audio signals through the plurality of microphones during the voice call with the second electronic device. For example, in a mobile phone employing a three-microphone design, after establishing voice communication with a second electronic device, a first electronic device may control the first microphone to acquire sound information around the electronic device (including sound information of a user and sound information in the environment) to acquire a first audio signal a, and similarly may control a second microphone to acquire a first audio signal B and a third microphone to acquire a first audio signal C. Meanwhile, the first electronic device may receive a second audio signal transmitted by the second electronic device through voice communication.
Wherein, because the audio signal is continuous signal, electronic equipment can carry out the frame processing to first audio signal and second audio signal in the process of acquireing first audio signal and second audio signal. For example, a length of one frame of audio signal may be set to 10 milliseconds (ms), and the electronic device may acquire one frame of first audio signal a, one frame of first audio signal B, one frame of first audio signal C, and one frame of second audio signal a having a length of 10 ms. The specific number of microphones in the electronic device may be set according to requirements, for example, the number of microphones may be two, three, or four, which is not limited in this embodiment.
Step 102, determining a to-be-rechecked microphone with the intensity of the first audio signal not lower than a corresponding intensity threshold from at least two microphones.
The method comprises the steps that an intensity threshold corresponding to a first audio signal is used for carrying out first microphone blocking detection on a microphone, and when the intensity of the first audio signal acquired by the microphone is greater than or equal to (not lower than) the corresponding intensity threshold, the microphone is determined to be not blocked, and the microphone is the microphone to be re-detected; conversely, it may be determined that a microphone is plugged. The microphone to be re-detected is a microphone with normal first blocking detection, and second blocking detection is needed to determine whether the first blocking detection is misjudged. The specific values of the intensity thresholds can be set according to requirements, and the intensity thresholds corresponding to different microphones can be the same or different.
In this embodiment, after the first audio signals collected by each microphone are obtained, the first electronic device may first perform the first microphone blocking detection on each microphone according to the first audio signals collected by each microphone, to determine the microphone that is not blocked, that is, the microphone to be re-detected. For example, for the first microphone, a frame of the first audio signal a includes three sampling points D (n-2), D (n-1) and D (n), "n" represents the current time (in practical application, a frame of the audio signal includes a large number of sampling points), the first electronic device may first determine absolute values of D (n-2), D (n-1) and D (n), and then calculate a sum of all the absolute values to obtain the intensity value of the first audio signal a. Similarly, the intensity value of an audio signal B and the intensity value of the first audio signal C can be calculated. The intensity of the first audio signal may be represented in different manners, for example, an absolute value of each sampling point in the first audio signal a may also be calculated, and then an average value of all absolute values is calculated to obtain an intensity value of the first audio signal a. The representation of the first audio signal strength may be set according to requirements, which is not limited in this embodiment.
After the intensity value of each first audio signal is obtained by calculation, the first electronic device can respectively compare the intensity value of each first audio signal with the corresponding intensity threshold value to determine whether the wheat blockage occurs. For example, after the intensity value of the first audio signal a is calculated, the intensity value of the first audio signal a may be compared with the intensity threshold value a corresponding to the first microphone, and if the intensity value of the first audio signal a is smaller than the intensity threshold value a, it may be determined that the first microphone is blocked. Similarly, the intensity value of the first audio signal B may be compared with the intensity threshold value B corresponding to the second microphone, if the intensity value of the first audio signal B is not lower than the intensity threshold value B, it may be determined that the second microphone is not blocked, and the intensity value of the first audio signal C is compared with the intensity threshold value C corresponding to the third microphone, if the intensity value of the first audio signal C is not lower than the intensity threshold value C, it may be determined that the third microphone is not blocked, thereby determining that the microphones to be re-detected include the second microphone and the third microphone, and completing the first detection of blocking microphones.
Step 103, determining an echo path of the microphone to be re-detected according to the first audio signal and the second audio signal acquired by the microphone to be re-detected under the condition that the number of the microphones to be re-detected is at least two.
The echo path is used for representing a propagation path of the second audio signal to the microphone to be rechecked. The first electronic device may play out the second audio signal through the speaker after acquiring the second audio signal transmitted by the second electronic device. At this time, the second audio signal exists in the environment described by the electronic device, and the audio component corresponding to the second audio signal included in the first audio signal collected by the microphone, that is, the echo collected by the microphone. The first electronic device can estimate an echo path of the microphone to be rechecked through the first audio signal and the second audio signal.
In this embodiment, when the number of microphones to be rechecked is at least two, the second detection of blocking of at least two microphones to be rechecked may be performed according to the change of the echo path of each microphone. In combination with the above example, for the second microphone, the echo path of the second microphone may be obtained by processing the first audio signal B and the second audio signal by an echo cancellation algorithm. As shown in fig. 2, fig. 2 is a schematic diagram of an echo cancellation algorithm according to an exemplary embodiment, where the echo cancellation algorithm, for example, a least mean square (Least Mean Squares, LMS) algorithm, may use a second audio signal that is about to be played by a speaker as a reference signal of the second microphone, and use a first audio signal B as an input of the LSM algorithm, calculate an echo path B of the second microphone as [ H (n-4), H (n-3), H (n-2), H (n-1), H (n) ], and calculate an echo estimated value B of the second microphone as [ E (n-2), E (n-1), E (n) ], and subtract the echo estimated value B from the first audio signal B to obtain an audio signal after echo cancellation (only using the echo path in this embodiment). As shown in fig. 2, the echo path of the second microphone represents the path that the second audio signal played out by the speaker travels through the external environment (first path) and, after traveling through the internal structure of the first electronic device (second path), enters the second microphone. Similarly, the echo path C and the echo estimated value C of the third microphone may be calculated.
The echo cancellation algorithm may also be any one of an LMS algorithm and a normalized least mean square (Normalized Least Mean Square, NLMS) algorithm, and the implementation does not specifically limit the echo cancellation algorithm.
104, processing the first audio signal acquired by the microphone with the echo path meeting the preset condition to obtain a target audio signal when the microphone to be re-detected comprises the microphone with the echo path not meeting the preset condition.
In this embodiment, after determining the echo path of each microphone to be rechecked, the change state of the echo path of each microphone to be rechecked may be determined, and according to the change state of the echo path of each microphone to be rechecked, the microphones whose echo paths meet the preset condition and the microphones whose echo paths do not meet the preset condition are determined respectively. For example, the mean square error of echo path B and echo path C, respectively, may be calculated, and represent the state of change of echo path B and echo path C, respectively. After the mean square error of the echo path B and the mean square error of the echo path C are obtained, if the mean square error of the echo path B is smaller than or equal to (not exceeding) the preset error, the preset error is the preset condition, it may be determined that the echo path B meets the preset condition, and if the mean square error of the echo path C is larger than (exceeding) the preset error, it may be determined that the echo path C does not meet the preset condition. The specific value of the preset error may be set according to the requirement, the representation method of the change state of the echo path may be set according to the requirement, and the embodiment is not limited thereto.
When the echo path does not meet the preset condition, the echo path of the microphone is indicated to be changed greatly. As shown in fig. 2, the audio signal played by the speaker may be transferred to the second microphone through the first path, or may be transferred to the second microphone through the second path, and when the echo path of the microphone changes greatly because the second path remains unchanged, it may be that the external environment (the first path) where the electronic device is located changes greatly, or the microphone is blocked by a foreign object, so that the first path changes; in contrast, when the echo path meets the preset condition, the echo path of the microphone is unchanged or changed less, which means that the external environment where the electronic device is located is changed less or unchanged. Therefore, when the echo path of at least one of the at least two microphones to be rechecked is unchanged or has small change, it can be determined that the external environment where the first electronic device is located is not changed, and at this time, if the echo paths of the other microphones have large change, it is indicated that the other microphones are blocked by foreign objects, and thus the blocking occurs.
In combination with the above example, after determining that the echo path meets the second microphone of the preset condition, it may be determined that the environment where the first electronic device is located is less changed or is unchanged, and meanwhile, the echo path of the third microphone does not meet the preset condition, it may be determined that the third microphone is blocked. After the third microphone is blocked, the first audio signal C collected by the third microphone is abnormal, the first audio signal C cannot be used, and at the moment, the first audio signal B collected by the second microphone can be processed to obtain a target audio signal.
In this embodiment, in the process of processing the first audio signal collected by the microphone whose echo path meets the preset condition, an audio processing algorithm may be selected according to the microphone whose echo path meets the preset condition, and the first audio signal collected by the microphone whose echo path meets the preset condition is processed. In combination with the above example, if the second microphone is disposed at the top of the mobile phone, an audio processing algorithm for the microphone disposed at the top of the mobile phone may be selected from a plurality of preset audio processing algorithms, and the first audio signal B is processed to obtain a target audio signal, and the target audio signal is sent to the second electronic device. Similarly, if the number of the microphones of the echo path accords with the preset condition is two, an audio processing algorithm aiming at the two microphones can be selected according to the two microphones, the two collected first audio signals are processed to obtain a target audio signal, and if the number of the microphones of the echo path accords with the preset condition is more than two, an audio processing algorithm aiming at the plurality of microphones can be selected, and the collected first audio signals are processed to obtain the target audio signal. The specific implementation of the audio processing algorithm may be set according to requirements, which is not limited in this embodiment.
Under normal conditions, when the microphone is blocked, the intensity of the first audio signal collected by the microphone is lower than a corresponding intensity threshold value, and the microphone with the blocking can be determined by the first time of blocking detection. However, in the voice communication process, the audio signal played by the speaker is transmitted to the microphone through the internal structure of the electronic device, and when the microphone is blocked, the audio signal transmitted through the second path may cause the intensity of the audio signal collected by the microphone to be not lower than the corresponding intensity threshold, so that the microphone with the microphone blocked cannot be detected due to the detection error of the microphone blocked. At this time, if the collected audio signal is still processed using the original audio processing algorithm, the quality of the target audio signal may be degraded. For example, when the third microphone blocks the microphone, if the first audio signal B and the first audio signal C are still processed by using the audio processing algorithms corresponding to the two microphones, the sound information of the user in the first audio signal B may be suppressed, or the noise and the echo in the first audio signal B may not be removed.
In summary, in this embodiment, the first audio signals collected by at least two microphones and the second audio signal sent by the second electronic device are obtained, the to-be-rechecked microphones whose intensities of the first audio signals are not lower than the corresponding intensity threshold are determined from the at least two microphones, the echo paths of the to-be-rechecked microphones are determined according to the corresponding first audio signals and second audio signals when the number of the to-be-rechecked microphones is at least two, and the first audio signals collected by the microphones whose echo paths meet the preset conditions are processed when the to-be-rechecked microphones include microphones whose echo paths do not meet the preset conditions, so as to obtain the target audio signals. For the electronic equipment adopting the multi-microphone design, in the audio signal processing process, after the first microphone blocking detection, if a plurality of microphones for normal detection exist, the second microphone blocking detection is carried out on the plurality of microphones for normal detection according to the change of the echo paths of the microphones, so that abnormal audio signals can be prevented from being used when the first microphone blocking detection is wrong, and the quality of target audio signals can be improved.
As shown in fig. 3, fig. 3 is a flowchart illustrating steps of another audio signal processing method according to an exemplary embodiment, the method may include:
step 301, acquiring first audio signals acquired by at least two microphones and second audio signals sent by a second electronic device.
Step 302, determining a to-be-rechecked microphone with the intensity of the first audio signal not lower than a corresponding intensity threshold from at least two microphones.
Step 303, determining an echo path and an echo estimated value of the microphone to be re-detected according to the first audio signal and the second audio signal acquired by the microphone to be re-detected when the number of the microphones to be re-detected is at least two.
In this embodiment, when the number of microphones to be rechecked is at least two, the echo path and the echo estimation value of each microphone may be determined by an echo cancellation algorithm according to the first audio signal and the second audio signal acquired by each microphone. The determining process of the echo path and the echo estimation value can refer to step 103, which is not described in detail in this embodiment.
Step 304, determining that the intensity of the echo estimated value of at least one microphone to be re-detected is not lower than the corresponding intensity threshold.
When the intensity of the echo estimated value is not lower than the intensity threshold, it means that the echo transmitted through the internal structure of the electronic device can cause the intensity of the audio signal collected by the microphone to be greater than or equal to the corresponding intensity threshold, and cause the first-time detection error of the blocking microphone. Conversely, when the intensity of the echo estimated value is lower than the intensity threshold, it means that the echo transmitted through the internal structure of the electronic device will not cause the intensity of the audio signal collected by the microphone to be greater than or equal to the corresponding intensity threshold, and will not cause the first detection error of the blocking microphone.
In connection with step 104, after the echo estimate B and the echo estimate C are calculated, an echo intensity value of the echo estimate B may be calculated, and an echo intensity value of the echo estimate C may be calculated. If the intensity value of the echo estimated value B is not lower than the intensity threshold value corresponding to the first microphone and/or the intensity value of the echo estimated value C is not lower than the intensity threshold value corresponding to the second microphone, it may be determined that the audio signal played by the speaker may cause the intensity of the first audio signal B to be greater than or equal to the intensity threshold value B and cause the intensity of the first audio signal C to be greater than or equal to the intensity threshold value C. At this time, although the second microphone and the third microphone are normal in the first detection of the blocking microphone, there may be erroneous judgment in the detection of the blocking microphone, and the second detection of the blocking microphone is required, and the step 305 is continued. The intensity value calculation process of the echo estimation value is the same as that of the first audio signal, which is not limited in this embodiment.
Conversely, if the intensity of the echo estimated value of each microphone to be re-detected is lower than the corresponding intensity threshold, it is indicated that the audio signal played by the speaker does not affect the first detection of blocking microphone, and the second detection of blocking microphone is not required, and step 305 is not required to be continuously executed at this time, and the first audio signal B and the first audio signal C can be directly processed according to the second microphone and the third microphone to obtain the target audio signal.
In practical application, when the intensity of the echo estimated value of at least one microphone to be rechecked is not lower than the corresponding intensity threshold, the second time of wheat blocking detection is executed, and when the intensity of the echo estimated value of each microphone to be rechecked is lower than the corresponding intensity threshold, the second time of wheat blocking detection is not executed, so that the power consumption of the electronic equipment can be reduced, and the processing efficiency of the audio signal is improved.
Optionally, the method may further include:
and under the condition that the intensity of the echo estimated value of the microphone to be re-detected is lower than the corresponding intensity threshold value, processing the first audio signal acquired by the microphone to be re-detected to obtain a target audio signal.
In this embodiment, when the intensity of the echo estimated value of each microphone to be rechecked is lower than the corresponding intensity threshold, it may be determined that the audio signal played by the speaker cannot affect the first blocking microphone, and at this time, the first audio signals collected by the microphones to be rechecked may be directly processed to obtain the target audio signal. In combination with the above example, when it is determined that the intensity value of the echo estimated value B is smaller than the intensity threshold corresponding to the second microphone and the intensity value of the echo estimated value C is smaller than the intensity threshold corresponding to the third microphone, an audio processing algorithm corresponding to the second microphone and the third microphone may be selected to process the first audio signal B and the second audio signal C, so as to obtain the target audio signal.
In practical application, when the intensity of the echo estimated value of each microphone to be re-detected is lower than the corresponding intensity threshold value, the first audio signal acquired by the microphone to be re-detected is processed to obtain a target audio signal, so that false detection in the first microphone blocking detection can be eliminated, and the accuracy of the audio signal processing process is improved.
Optionally, before step 304, the method may further include:
it is determined that the intensity of the second audio signal is not below the corresponding intensity threshold.
When the intensity of the second audio signal is not lower than the corresponding intensity threshold value, the audio signal which indicates that the loudspeaker plays can generate echo; conversely, when the intensity of the second audio signal is below the corresponding intensity threshold, the audio signal indicative of speaker play cannot generate echo.
In this embodiment, before executing step 304, it may be determined whether the intensity of the second audio signal is lower than the corresponding intensity threshold, and when the intensity of the second audio signal is lower than the corresponding intensity threshold, since the playing of the second audio signal cannot generate echo, the first time of wheat blocking detection error cannot be caused, step 304 is not executed, and the second time of wheat blocking detection is not performed. Conversely, when the intensity of the second audio signal is not lower than the corresponding intensity threshold, it indicates that an echo can be generated when the second audio signal is played, which may cause the first time of detection error of the wheat blocking, and then the second time of detection of the wheat blocking is continued.
In practical application, when the intensity of the second audio signal is determined not to be lower than the corresponding intensity threshold, the second time of wheat blockage detection is executed, and when the intensity of the second audio signal is determined to be lower than the corresponding intensity threshold, the second time of wheat blockage detection is not executed, so that the frequency of executing the second time of wheat blockage detection can be reduced, and the power consumption of the electronic equipment is reduced.
Optionally, the method may further include:
and under the condition that the intensity of the second audio signal is lower than the corresponding intensity threshold value, processing the first audio signal acquired by the microphone to be re-detected to obtain a target audio signal.
In this embodiment, when the intensity of the second audio signal is lower than the corresponding intensity threshold, it may be determined that the audio signal played by the speaker cannot generate echo, and the first detection of blocking is not affected. At this time, the second detection of the blocking microphone is not executed, and the first audio signal acquired by the microphone to be re-detected is directly processed to obtain the target audio signal. The microphone can be prevented from being subjected to secondary microphone blocking detection, and the power consumption of the electronic equipment is reduced.
Step 305, in the case that the microphone to be retested includes a microphone whose echo path does not meet the preset condition, processing the first audio signal acquired by the microphone whose echo path meets the preset condition to obtain the target audio signal.
Optionally, the method may further include:
and under the condition that the echo path of each microphone to be re-detected does not meet the preset condition, processing the first audio signal acquired by the microphone to be re-detected to obtain a target audio signal.
In this embodiment, when the echo path of each microphone to be re-detected does not meet the preset condition, it may be determined that the change of the echo path is caused by the change of the external environment, and at this time, the first audio signals collected by the plurality of microphones to be re-detected may be directly processed to obtain the target audio signal. In combination with the above example, when the echo paths of the second microphone and the third microphone do not meet the preset conditions, the first audio signal B and the first audio signal C may be directly processed according to the second microphone and the third microphone winnowing audio signal processing algorithm, so as to obtain the target audio signal.
In practical application, when the echo path of each microphone to be rechecked does not meet the corresponding preset condition, it can be determined that the change of the echo path is caused by the change of the external environment, and the first time of blocking detection error cannot be caused by the broadcasting of the second audio signal, so that the accuracy of blocking detection can be improved.
Optionally, the method may further include:
and under the condition that the echo path of each microphone to be re-detected accords with the preset condition, processing the first audio signal acquired by the microphone to be re-detected to obtain a target audio signal.
In this embodiment, when the echo path of each microphone to be rechecked meets a preset condition, it may be determined that the environment where the first electronic device is located is not changed, and since the echo path of each microphone to be rechecked meets the preset condition, it may be determined that the broadcasting of the second audio signal does not cause the first-time detection error, so that each microphone to be rechecked is not affected by the echo, and no microphone to be rechecked is blocked. At this time, the first audio signal B and the first audio signal C may be processed directly according to the second microphone and the third microphone winnowing audio signal processing algorithm, to obtain the target audio signal.
It should be noted that, in the audio signal processing method provided in the embodiment of the present application, the execution body may be an audio signal processing apparatus, or a control module in the audio signal processing apparatus for executing the loading audio signal processing method. In the embodiment of the present application, an audio signal processing device executes a method for processing a loaded audio signal, which is described as an example.
Referring to fig. 4, fig. 4 is a block diagram of an audio signal processing apparatus provided according to an exemplary embodiment, and as shown in fig. 4, the apparatus 400 may include: an acquisition module 401, a first determination module 402, a second determination module 403, a third determination module 404, and a processing module 404.
The acquiring module 401 is configured to acquire a first audio signal acquired by at least two microphones, and a second audio signal sent by a second electronic device.
The first determining module 402 is configured to determine, from at least two microphones, a microphone to be re-detected whose intensity of the first audio signal is not lower than a corresponding intensity threshold.
The second determining module 403 is configured to determine, when the number of microphones to be re-detected is at least two, an echo path of the microphones to be re-detected according to the first audio signal and the second audio signal acquired by the microphones to be re-detected; the echo path is used for representing a propagation path of the second audio signal to the microphone to be rechecked.
The processing module 404 is configured to process, when the microphone to be re-detected includes a microphone whose echo path does not meet the preset condition, a first audio signal acquired by the microphone whose echo path meets the preset condition, so as to obtain a target audio signal.
Optionally, the apparatus 400 may further include: the third determination module and the fourth determination module.
The third determining module is used for determining an echo estimated value of the microphone to be re-detected according to the first audio signal and the second audio signal acquired by the microphone to be re-detected
The fourth determining module is configured to determine that the intensity of the echo estimated value of the at least one microphone to be rechecked is not lower than a corresponding intensity threshold.
The apparatus 400 may further include: and a fifth determining module, configured to determine that the intensity of the second audio signal is not lower than the corresponding intensity threshold.
Optionally, the processing module 404 is further configured to process the first audio signal acquired by the microphone to be re-detected to obtain the target audio signal when the intensity of the second audio signal is lower than the corresponding intensity threshold; or under the condition that the intensity of the echo estimated value of the microphone to be re-detected is lower than the corresponding intensity threshold value, processing the first audio signal acquired by the microphone to be re-detected to obtain a target audio signal.
Optionally, the processing module 404 is further configured to process the first audio signal collected by the microphones to be re-detected to obtain the target audio signal when the echo path of each microphone to be re-detected does not meet the preset condition.
The audio signal processing device in the embodiment of the application can be a device, and can also be a component, an integrated circuit or a chip in a terminal. The device may be a mobile electronic device or a non-mobile electronic device. By way of example, the mobile electronic device may be a cell phone, tablet computer, notebook computer, palm computer, vehicle mounted electronic device, wearable device, ultra-mobile personal computer (ultra-mobile personal computer, UMPC), netbook or personal digital assistant (personal digital assistant, PDA), etc., and the non-mobile electronic device may be a server, network attached storage (Network Attached Storage, NAS), personal computer (personal computer, PC), television (TV), teller machine or self-service machine, etc., and embodiments of the present application are not limited in particular.
The audio signal processing device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an ios operating system, or other possible operating systems, and the embodiment of the present application is not limited specifically.
The audio signal processing device provided in the embodiment of the present application can implement each process implemented by the audio signal processing device in the method embodiments of fig. 1 and 3, and in order to avoid repetition, a detailed description is omitted here.
In summary, in this embodiment, the first audio signals collected by at least two microphones and the second audio signal sent by the second electronic device are obtained, the to-be-rechecked microphones whose intensities of the first audio signals are not lower than the corresponding intensity threshold are determined from the at least two microphones, the echo paths of the to-be-rechecked microphones are determined according to the corresponding first audio signals and second audio signals when the number of the to-be-rechecked microphones is at least two, and the first audio signals collected by the microphones whose echo paths meet the preset conditions are processed when the to-be-rechecked microphones include microphones whose echo paths do not meet the preset conditions, so as to obtain the target audio signals. For the electronic equipment adopting the multi-microphone design, in the audio signal processing process, after the first microphone blocking detection, if a plurality of microphones for normal detection exist, the second microphone blocking detection is carried out on the plurality of microphones for normal detection according to the change of the echo paths of the microphones, so that abnormal audio signals can be prevented from being used when the first microphone blocking detection is wrong, and the quality of target audio signals can be improved.
Optionally, an embodiment of the present application further provides an electronic device, as shown in fig. 5, where fig. 5 is a block diagram of an electronic device provided according to an exemplary embodiment, where the electronic device includes a processor 501, a memory 502, and a program or an instruction stored in the memory 502 and capable of running on the processor 501, where the program or the instruction is executed by the processor 501 to implement each process of the foregoing embodiment of the audio signal processing method, and the process can achieve the same technical effect, and is not repeated herein.
It should be noted that, the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.
Fig. 6 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
The electronic device 600 includes, but is not limited to: radio frequency unit 601, network module 602, audio output unit 603, input unit 604, sensor 605, display unit 606, user input unit 607, interface unit 608, memory 609, and processor 610.
Those skilled in the art will appreciate that the electronic device 600 may further include a power source (e.g., a battery) for powering the various components, which may be logically connected to the processor 610 by a power management system to perform functions such as managing charge, discharge, and power consumption by the power management system. The electronic device structure shown in fig. 6 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than shown, or may combine certain components, or may be arranged in different components, which are not described in detail herein.
The processor 610 is configured to obtain a first audio signal collected by at least two microphones and a second audio signal sent by the second electronic device;
Determining a to-be-rechecked microphone with the intensity of the first audio signal not lower than a corresponding intensity threshold value from at least two microphones;
under the condition that the number of the microphones to be rechecked is at least two, determining an echo path of the microphones to be rechecked according to the first audio signal and the second audio signal acquired by the microphones to be rechecked; the echo path is used for representing a propagation path of the second audio signal to the microphone to be rechecked;
and under the condition that the microphone to be rechecked comprises a microphone with an echo path which does not meet the preset condition, processing the first audio signal acquired by the microphone with the echo path which meets the preset condition to obtain a target audio signal.
In this embodiment, a first audio signal collected by at least two microphones and a second audio signal sent by a second electronic device are obtained, from the at least two microphones, a to-be-rechecked microphone whose intensity of the first audio signal is not lower than a corresponding intensity threshold is determined, in the case that the number of to-be-rechecked microphones is at least two, an echo path of the to-be-rechecked microphone is determined according to the corresponding first audio signal and second audio signal, and in the case that the to-be-rechecked microphone includes a microphone whose echo path does not meet a preset condition, the first audio signal collected by the microphone whose echo path meets the preset condition is processed, so as to obtain a target audio signal. For the electronic equipment adopting the multi-microphone design, in the audio signal processing process, after the first microphone blocking detection, if a plurality of microphones for normal detection exist, the second microphone blocking detection is carried out on the plurality of microphones for normal detection according to the change of the echo paths of the microphones, so that abnormal audio signals can be prevented from being used when the first microphone blocking detection is wrong, and the quality of target audio signals can be improved.
The processor 610 is further configured to determine an echo estimation value of the microphone to be re-detected according to the first audio signal and the second audio signal acquired by the microphone to be re-detected;
and determining that the intensity of the echo estimated value of at least one microphone to be rechecked is not lower than a corresponding intensity threshold.
In practical application, when the intensity of the echo estimated value of at least one microphone to be rechecked is not lower than the corresponding intensity threshold, the second time of wheat blocking detection is executed, and when the intensity of the echo estimated value of each microphone to be rechecked is lower than the corresponding intensity threshold, the second time of wheat blocking detection is not executed, so that the power consumption of the electronic equipment can be reduced, and the processing efficiency of the audio signal is improved.
Wherein the processor 610 is further configured to determine that the intensity of the second audio signal is not lower than the corresponding intensity threshold.
In practical application, when the intensity of the second audio signal is not lower than the corresponding intensity threshold, the second time of detection of the blocking microphone is executed, so that the frequency of executing the second time of detection of the blocking microphone can be reduced, and the power consumption of the electronic equipment is reduced.
The processor 610 is further configured to process the first audio signal collected by the microphone to be re-detected to obtain a target audio signal when the intensity of the second audio signal is lower than the corresponding intensity threshold; or alternatively, the process may be performed,
And under the condition that the intensity of the echo estimated value of the microphone to be re-detected is lower than the corresponding intensity threshold value, processing the first audio signal acquired by the microphone to be re-detected to obtain a target audio signal.
In practical application, when the intensity of the echo estimated value of each microphone to be re-detected is lower than the corresponding intensity threshold value, the first audio signal acquired by the microphone to be re-detected is processed to obtain a target audio signal, so that false detection in the first microphone blocking detection can be eliminated, and the accuracy of the audio signal processing process is improved.
The processor 610 is further configured to process the first audio signal collected by the microphones to be re-detected to obtain a target audio signal when the echo path of each microphone to be re-detected does not meet the preset condition.
In practical application, when the echo path of each microphone to be rechecked does not meet the preset condition, it can be determined that the change of the echo path is caused by the change of the external environment, and the first detection error of the blocking microphone is not caused by the broadcasting of the second audio signal, so that the accuracy of the detection of the blocking microphone is improved.
The embodiment of the application also provides a readable storage medium, on which a program or an instruction is stored, which when executed by a processor, implements each process of the above-mentioned audio signal processing method embodiment, and can achieve the same technical effects, so that repetition is avoided, and no further description is given here.
Wherein the processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium such as a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk or an optical disk, and the like.
The embodiment of the application further provides a chip, which comprises a processor and a communication interface, wherein the communication interface is coupled with the processor, and the processor is used for running programs or instructions to realize the processes of the embodiment of the audio signal processing method, and can achieve the same technical effects, so that repetition is avoided, and the description is omitted here.
It should be understood that the chips referred to in the embodiments of the present application may also be referred to as system-on-chip chips, chip systems, or system-on-chip chips, etc.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in an opposite order depending on the functions involved, e.g., the described methods may be performed in an order different from that described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present application.
The embodiments of the present application have been described above with reference to the accompanying drawings, but the present application is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those having ordinary skill in the art without departing from the spirit of the present application and the scope of the claims, which are to be protected by the present application.
Claims (10)
1. An audio signal processing method, applied to a first electronic device having at least two microphones, the method comprising:
acquiring first audio signals acquired by the at least two microphones and second audio signals sent by second electronic equipment;
determining a to-be-rechecked microphone with the intensity of the first audio signal not lower than a corresponding intensity threshold from the at least two microphones;
under the condition that the number of the microphones to be rechecked is at least two, determining an echo path of the microphones to be rechecked according to the first audio signal and the second audio signal acquired by the microphones to be rechecked; the echo path is used for representing a propagation path of the second audio signal to the microphone to be rechecked;
and under the condition that the microphone to be rechecked comprises a microphone with an echo path which does not meet the preset condition, processing the first audio signal acquired by the microphone with the echo path which meets the preset condition to obtain a target audio signal.
2. The method according to claim 1, wherein, in the case that the microphone to be re-inspected includes a microphone whose echo path does not meet a preset condition, processing a first audio signal acquired by a microphone whose echo path meets the preset condition, and before obtaining a target audio signal, further includes:
Determining an echo estimated value of the microphone to be rechecked according to the first audio signal and the second audio signal acquired by the microphone to be rechecked;
and determining that the intensity of the echo estimated value of at least one to-be-rechecked microphone is not lower than a corresponding intensity threshold.
3. The method of claim 2, further comprising, prior to said determining that the intensity of the echo estimate for at least one of the microphones to be re-examined is not below a corresponding intensity threshold:
determining that the intensity of the second audio signal is not below a corresponding intensity threshold.
4. A method according to claim 3, further comprising:
processing the first audio signal acquired by the microphone to be re-detected under the condition that the intensity of the second audio signal is lower than a corresponding intensity threshold value to obtain the target audio signal; or alternatively, the process may be performed,
and under the condition that the intensity of the echo estimated value of the microphone to be rechecked is lower than a corresponding intensity threshold value, processing the first audio signal acquired by the microphone to be rechecked to obtain the target audio signal.
5. The method of any one of claims 1-4, further comprising:
And under the condition that the echo path of each microphone to be rechecked does not meet the preset condition, processing the first audio signal acquired by the microphone to be rechecked to obtain the target audio signal.
6. An audio signal processing apparatus, provided to a first electronic device having at least two microphones, comprising:
the acquisition module is used for acquiring the first audio signals acquired by the at least two microphones and the second audio signals sent by the second electronic equipment;
a first determining module, configured to determine, from the at least two microphones, a to-be-rechecked microphone whose intensity of the first audio signal is not lower than a corresponding intensity threshold;
the second determining module is used for determining an echo path of the microphone to be re-detected according to the first audio signal and the second audio signal acquired by the microphone to be re-detected under the condition that the number of the microphones to be re-detected is at least two; the echo path is used for representing a propagation path of the second audio signal to the microphone to be rechecked;
the processing module is used for processing the first audio signal acquired by the microphone with the echo path meeting the preset condition to obtain a target audio signal when the microphone with the echo path meeting the preset condition is included in the microphone to be re-detected.
7. The apparatus as recited in claim 6, further comprising:
the third determining module is used for determining an echo estimated value of the microphone to be rechecked according to the first audio signal and the second audio signal acquired by the microphone to be rechecked;
and a fourth determining module, configured to determine that the intensity of the echo estimated value of at least one to-be-rechecked microphone is not lower than a corresponding intensity threshold.
8. The apparatus as recited in claim 7, further comprising:
and a fifth determining module, configured to determine that the intensity of the second audio signal is not lower than a corresponding intensity threshold.
9. The apparatus of claim 8, wherein the processing module is further configured to process the first audio signal acquired by the microphone to be re-examined to obtain the target audio signal if the intensity of the second audio signal is lower than a corresponding intensity threshold; or alternatively, the process may be performed,
and under the condition that the intensity of the echo estimated value of the microphone to be rechecked is lower than a corresponding intensity threshold value, processing the first audio signal acquired by the microphone to be rechecked to obtain the target audio signal.
10. The apparatus according to any one of claims 6 to 9, wherein the processing module is further configured to process the first audio signal acquired by the microphones to be re-inspected to obtain the target audio signal if the echo path of each of the microphones to be re-inspected does not meet the preset condition.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011194355.0A CN112289336B (en) | 2020-10-30 | 2020-10-30 | Audio signal processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011194355.0A CN112289336B (en) | 2020-10-30 | 2020-10-30 | Audio signal processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112289336A CN112289336A (en) | 2021-01-29 |
| CN112289336B true CN112289336B (en) | 2023-10-27 |
Family
ID=74353870
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011194355.0A Active CN112289336B (en) | 2020-10-30 | 2020-10-30 | Audio signal processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112289336B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113555030B (en) * | 2021-07-29 | 2024-05-31 | 杭州萤石软件有限公司 | Audio signal processing method, device and equipment |
| CN113543010B (en) * | 2021-09-15 | 2022-02-22 | 阿里巴巴达摩院(杭州)科技有限公司 | Detection method and device for microphone equipment, storage medium and processor |
| CN114220457A (en) * | 2021-10-29 | 2022-03-22 | 成都中科信息技术有限公司 | Audio data processing method and device of dual-channel communication link and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105979053A (en) * | 2016-04-18 | 2016-09-28 | 广东欧珀移动通信有限公司 | Method and device for detecting microphone in mobile terminal and mobile terminal |
| US10187504B1 (en) * | 2016-09-23 | 2019-01-22 | Apple Inc. | Echo control based on state of a device |
| JP2019165417A (en) * | 2018-03-20 | 2019-09-26 | トヨタ自動車株式会社 | Microphone and speaker integration device and vehicle |
| CN110691314A (en) * | 2019-10-22 | 2020-01-14 | 苏州思必驰信息科技有限公司 | Linear microphone array performance test method and clamp |
-
2020
- 2020-10-30 CN CN202011194355.0A patent/CN112289336B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105979053A (en) * | 2016-04-18 | 2016-09-28 | 广东欧珀移动通信有限公司 | Method and device for detecting microphone in mobile terminal and mobile terminal |
| US10187504B1 (en) * | 2016-09-23 | 2019-01-22 | Apple Inc. | Echo control based on state of a device |
| JP2019165417A (en) * | 2018-03-20 | 2019-09-26 | トヨタ自動車株式会社 | Microphone and speaker integration device and vehicle |
| CN110691314A (en) * | 2019-10-22 | 2020-01-14 | 苏州思必驰信息科技有限公司 | Linear microphone array performance test method and clamp |
Non-Patent Citations (1)
| Title |
|---|
| 针对头佩式麦克风阵列的声源定位算法研究;张奕等;计算机工程与应用;第51卷(第24期);266-270 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112289336A (en) | 2021-01-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112289336B (en) | Audio signal processing method and device | |
| JP2021500778A (en) | Echo cancellation method and equipment based on delay time estimation | |
| CN111951819A (en) | Echo cancellation method, device and storage medium | |
| US11245788B2 (en) | Acoustic echo cancellation based sub band domain active speaker detection for audio and video conferencing applications | |
| CN108630219B (en) | Processing system, method and device for echo suppression audio signal feature tracking | |
| CN113170024B (en) | Echo cancellation method, delay estimation device, storage medium and equipment | |
| CN110431624B (en) | Residual echo detection method, residual echo detection device, voice processing chip and electronic equipment | |
| CN112468924A (en) | Earphone noise reduction method and device | |
| WO2022028083A1 (en) | Noise reduction method and apparatus for electronic device, storage medium and electronic device | |
| CN111081233B (en) | Audio processing method and electronic equipment | |
| CN101766016A (en) | Voice mixing device, and its noise suppressing method and program | |
| CN111081246B (en) | Method and device for awakening live broadcast robot, electronic equipment and storage medium | |
| CN110503973B (en) | Audio signal transient noise suppression method, system and storage medium | |
| WO2022143522A1 (en) | Audio signal processing method and apparatus, and electronic device | |
| CN109119097B (en) | Pitch detection method, device, storage medium and mobile terminal | |
| CN111370015A (en) | Echo cancellation method, echo cancellation device, electronic equipment and storage medium | |
| CN112399302B (en) | Audio playing method and device of wearable audio playing device | |
| CN106297816B (en) | Echo cancellation nonlinear processing method and device and electronic equipment | |
| WO2024041512A1 (en) | Audio noise reduction method and apparatus, and electronic device and readable storage medium | |
| WO2024017110A1 (en) | Voice noise reduction method, model training method, apparatus, device, medium, and product | |
| CN113345459A (en) | Method and device for detecting double-talk state, computer equipment and storage medium | |
| CN113766385B (en) | Earphone noise reduction method and device | |
| CN110021289B (en) | Sound signal processing method, device and storage medium | |
| CN111986694A (en) | Audio processing method, device, equipment and medium based on transient noise suppression | |
| CN115696110A (en) | Audio device and audio signal processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |