CN112019967B - Earphone noise reduction method and device, earphone equipment and storage medium - Google Patents
Earphone noise reduction method and device, earphone equipment and storage medium Download PDFInfo
- Publication number
- CN112019967B CN112019967B CN202010940245.8A CN202010940245A CN112019967B CN 112019967 B CN112019967 B CN 112019967B CN 202010940245 A CN202010940245 A CN 202010940245A CN 112019967 B CN112019967 B CN 112019967B
- Authority
- CN
- China
- Prior art keywords
- signal
- voice signal
- noise reduction
- voice
- microphone
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1083—Reduction of ambient noise
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Circuit For Audible Band Transducer (AREA)
- Soundproofing, Sound Blocking, And Sound Damping (AREA)
Abstract
The application discloses a method and a device for earphone noise reduction, earphone equipment and a storage medium. The method judges whether the environment of the earphone is a wind noise scene or not according to the environment sound signal of the environment of the earphone, and then under the condition of the wind noise scene, the voice signal is obtained in a mode of receiving vibration waves through the vibration sensor, so that the influence of wind noise on the finally obtained noise-reduced voice signal is reduced, under the condition of a non-wind noise scene, the frequency width of the finally obtained noise-reduced voice signal is ensured in a mode of obtaining the voice signal through the noise-reduced microphone, the voice noise-reduction effect under the conversation scene is comprehensively improved, and the overall quality of the voice signal is further improved. In addition, the application also provides an earphone noise reduction device, earphone equipment and a storage medium, and the beneficial effects are as described above.
Description
Technical Field
The present application relates to the field of noise reduction for earphones, and in particular, to an earphone noise reduction method and apparatus, an earphone device, and a storage medium.
Background
Along with people constantly improve to the requirement of earphone tone quality, current earphone often integrates the microphone in order to realize the voice conversation function, along with the environment sound in the current earphone service environment is more and more complicated, leads to current earphone to need further to improve the pronunciation noise reduction effect under the conversation scene, and then improves speech signal's whole quality.
Therefore, the problem to be solved by technical personnel in the field is to provide an earphone noise reduction method to improve the voice noise reduction effect in a call scene and further improve the overall quality of a voice signal.
Disclosure of Invention
The application aims to provide an earphone noise reduction method and device, earphone equipment and a storage medium, so that the voice noise reduction effect in a conversation scene is improved, and the overall quality of a voice signal is further improved.
In order to solve the above technical problem, the present application provides a method for reducing noise of an earphone, including:
receiving an ambient sound signal;
judging whether the environmental sound signal is a sound signal generated by a wind noise scene;
if the environmental sound signal is a sound signal generated by a wind noise scene, receiving a first voice signal based on a vibration sensor, and receiving a second voice signal by using a voice microphone;
obtaining a noise reduction voice signal based on the first voice signal and the second voice signal;
if the environmental sound signal is not the sound signal generated by the wind noise scene, receiving a third voice signal based on the noise reduction microphone, and receiving a second voice signal by using the voice microphone;
and obtaining the noise reduction voice signal based on the third voice signal and the second voice signal.
Preferably, the determining whether the ambient sound signal is a sound signal generated by a wind noise scene includes:
judging whether the ratio of the target frequency lower than a preset threshold value in the environmental sound signal reaches a preset ratio threshold value or not;
if yes, executing the step that the environment sound signal is the sound signal generated by the wind noise scene;
otherwise, a step is performed in which the ambient sound signal is not a sound signal generated by a wind noise scene.
Preferably, the determining whether the environmental sound signal is a sound signal generated by a wind noise scene includes:
judging whether the signal frequency spectrum of the environmental sound signal is continuous or not;
if yes, executing the step that the environment sound signal is the sound signal generated by the wind noise scene;
otherwise, the step of not generating an acoustic signal for the wind noise scene by the ambient acoustic signal is performed.
Preferably, the determining whether the environmental sound signal is a sound signal generated by a wind noise scene includes:
judging whether the ratio of the target frequency lower than the preset threshold value in the environmental sound signal reaches the preset ratio threshold value or not, wherein the signal frequency spectrum of the environmental sound signal is continuous;
if yes, executing the step that the environment sound signal is the sound signal generated by the wind noise scene;
otherwise, a step is performed in which the ambient sound signal is not a sound signal generated by a wind noise scene.
Preferably, obtaining the noise-reduced speech signal based on the first speech signal and the second speech signal comprises:
filtering the first voice signal in the second voice signal to obtain a first process voice signal;
acquiring a double-microphone noise reduction signal obtained based on double-microphone noise reduction operation;
and filtering the first process voice signal in the double-microphone noise reduction signal to obtain a noise reduction voice signal.
Preferably, obtaining the noise-reduced speech signal based on the third speech signal and the second speech signal includes:
filtering the third voice signal in the second voice signal to obtain a second process voice signal;
acquiring a double-microphone noise reduction signal obtained based on double-microphone noise reduction operation;
and filtering the second process voice signal in the double-microphone noise reduction signal to obtain a noise reduction voice signal.
Preferably, the receiving the first voice signal based on the vibration sensor includes:
receiving a first voice signal based on a gravity sensor or a bone sensor;
receiving a third speech signal based on a noise reduction microphone, comprising:
receiving a third voice signal based on a feedback microphone;
obtaining a double-microphone noise reduction signal obtained based on the double-microphone noise reduction operation, comprising:
and acquiring a double-microphone noise reduction signal obtained by executing double-microphone noise reduction operation based on the voice microphone and the feedforward microphone.
In addition, this application still provides a device of making an uproar falls in earphone, includes:
the environment sound signal receiving module is used for receiving an environment sound signal;
the scene judging module is used for judging whether the environmental sound signal is a sound signal generated by a wind noise scene, if so, the first receiving module and the first noise reduction module are sequentially called, and otherwise, the second receiving module and the second noise reduction module are sequentially called;
the first receiving module is used for receiving a first voice signal based on the vibration sensor and receiving a second voice signal by using the voice microphone;
the first noise reduction module is used for obtaining a noise reduction voice signal based on the first voice signal and the second voice signal;
the second receiving module is used for receiving the third voice signal based on the noise reduction microphone and receiving the second voice signal by using the voice microphone;
and the second noise reduction module is used for obtaining a noise reduction voice signal based on the third voice signal and the second voice signal.
In addition, the present application also provides an earphone device, including:
a vibration sensor;
a noise reduction microphone;
a voice microphone;
a memory for storing a computer program;
a processor for executing a computer program to enable receiving an ambient acoustic signal; judging whether the environmental sound signal is a sound signal generated by a wind noise scene; if the environment sound signal is a sound signal generated by a wind noise scene, receiving a first voice signal based on a vibration sensor, and receiving a second voice signal by using a voice microphone; obtaining a noise reduction voice signal based on the first voice signal and the second voice signal; if the environmental sound signal is not the sound signal generated by the wind noise scene, receiving a third voice signal based on the noise reduction microphone, and receiving a second voice signal by using the voice microphone; and obtaining a noise reduction voice signal based on the third voice signal and the second voice signal.
Furthermore, the present application also provides a computer readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the above-mentioned earphone noise reduction method.
The method for reducing the noise of the earphone comprises the steps of firstly receiving an environment sound signal, further judging whether the environment sound signal is a sound signal generated by a wind noise scene or not, further receiving a first voice signal based on a vibration sensor if the environment sound signal is the sound signal generated by the wind noise scene, receiving a second voice signal by using a voice microphone, and further obtaining a noise reduction voice signal based on the first voice signal and the second voice signal; and if the environmental sound signal is not the sound signal generated by the wind noise scene, further receiving a third voice signal based on the noise reduction microphone, receiving a second voice signal by using the voice microphone, and further obtaining a noise reduction voice signal based on the third voice signal and the second voice signal. According to the method, whether the environment where the earphone is located is a wind noise scene or not is judged according to the environmental sound signals of the environment where the earphone is located, then under the condition of the wind noise scene, the influence of wind noise on the finally obtained noise-reduced voice signals is reduced in a mode that the voice signals are obtained through the vibration sensor, under the condition of a non-wind noise scene, the frequency width of the finally obtained noise-reduced voice signals is ensured in a mode that the voice signals are obtained through the noise-reduced microphone, the voice noise reduction effect under the conversation scene is comprehensively improved, and the overall quality of the voice signals is further improved. In addition, the application also provides an earphone noise reduction device, earphone equipment and a storage medium, and the beneficial effects are as described above.
Drawings
In order to more clearly illustrate the embodiments of the present application, the drawings required for the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained by those skilled in the art without inventive effort.
Fig. 1 is a flowchart of a method for reducing noise of an earphone disclosed in an embodiment of the present application;
fig. 2 is a flowchart of a specific noise reduction method for an earphone disclosed in an embodiment of the present application;
fig. 3 is a flowchart of a specific noise reduction method for an earphone disclosed in an embodiment of the present application;
fig. 4 is a flowchart of a specific noise reduction method for an earphone disclosed in an embodiment of the present application;
fig. 5 is a schematic structural diagram of a noise reduction device for an earphone disclosed in an embodiment of the present application;
fig. 6 is a schematic diagram of a positional relationship between a microphone and a sensor of an earphone device in a specific application scenario disclosed in the embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only some embodiments of the present application, and not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without any creative effort belong to the protection scope of the present application.
Along with people constantly improve to the requirement of earphone tone quality, current earphone often integrates the microphone in order to realize the voice conversation function, along with the environment sound in the current earphone service environment is more and more complicated, leads to current earphone to need further to improve the pronunciation noise reduction effect under the conversation scene, and then improves speech signal's whole quality.
Therefore, the core of the application is to provide an earphone noise reduction method to improve the voice noise reduction effect in a call scene, and further improve the overall quality of voice signals.
Referring to fig. 1, an embodiment of the present application discloses a method for reducing noise of an earphone, including:
step S10: an ambient sound signal is received.
It should be noted that the ambient sound signal in this step refers to a sound signal in an environment where the earphone is located, and the manner of receiving the ambient sound signal may specifically be that the sound signal is collected by a voice microphone or a noise reduction microphone in the earphone, and preferably, the ambient sound signal is received by a voice microphone closest to a sound source when the user speaks.
Step S11: and judging whether the environmental sound signal is the sound signal generated by the wind noise scene, if so, sequentially executing the step S12 to the step S13, and otherwise, sequentially executing the step S14 to the step S15.
After the environmental sound signal is obtained, the step further determines whether the environmental sound signal is a sound signal generated by a wind noise scene, where the wind noise scene refers to a scene in which the generated sound signal includes a wind noise signal.
Step S12: the first voice signal is received based on the vibration sensor, and the second voice signal is received by the voice microphone.
Step S13: and obtaining a noise reduction voice signal based on the first voice signal and the second voice signal.
It should be noted that, when it is determined that the environmental sound signal is a sound signal generated in a wind noise scene, the embodiment further receives the first speech signal based on the vibration sensor, and receives the second speech signal by using the speech microphone, so as to obtain the noise-reduced speech signal based on the first speech signal and the second speech signal. The vibration sensor is a sensor capable of generating a sound signal by collecting vibration waves, the first voice signal and the second voice signal are voice signals collected through two different ways, and the voice signals include but are not limited to voice signals generated when a user of the headset speaks, and may also be voice signals generated under an environment where the headset is located.
Under the scene of wind noise, the first voice signal is received through the vibration sensor, the interference of the wind noise to the first voice signal can be relatively reduced, and then the noise reduction accuracy of the noise reduction voice signal can be relatively improved through the first voice signal and the second voice signal.
Step S14: the noise reduction-based microphone receives the third voice signal and the voice microphone receives the second voice signal.
Step S15: and obtaining a noise reduction voice signal based on the third voice signal and the second voice signal.
It should be noted that, when it is determined that the ambient sound signal is not a sound signal generated by a wind noise scene, the embodiment further receives the third speech signal based on the noise reduction microphone, and receives the second speech signal by using the speech microphone, so as to obtain the noise reduction speech signal based on the third speech signal and the second speech signal. The third speech signal and the second speech signal are speech signals collected through two different approaches.
Under the scene of no wind noise, the voice signal received by the noise reduction microphone has higher voice bandwidth than the voice signal received by the vibration sensor, so that the noise reduction voice signal is obtained based on the third voice signal and the second voice signal, and the voice distortion can be relatively avoided.
The method for reducing the noise of the earphone comprises the steps of firstly receiving an environment sound signal, further judging whether the environment sound signal is a sound signal generated by a wind noise scene or not, further receiving a first voice signal based on a vibration sensor if the environment sound signal is the sound signal generated by the wind noise scene, receiving a second voice signal by using a voice microphone, and further obtaining a noise reduction voice signal based on the first voice signal and the second voice signal; and if the environmental sound signal is not the sound signal generated by the wind noise scene, further receiving a third voice signal based on the noise reduction microphone, receiving a second voice signal by using the voice microphone, and further obtaining a noise reduction voice signal based on the third voice signal and the second voice signal. The method judges whether the environment of the earphone is a wind noise scene or not according to the environment sound signal of the environment of the earphone, and then under the condition of the wind noise scene, the voice signal is obtained in a mode of receiving vibration waves through the vibration sensor, so that the influence of wind noise on the finally obtained noise-reduced voice signal is reduced, under the condition of a non-wind noise scene, the frequency width of the finally obtained noise-reduced voice signal is ensured in a mode of obtaining the voice signal through the noise-reduced microphone, the voice noise-reduction effect under the conversation scene is comprehensively improved, and the overall quality of the voice signal is further improved.
In addition to the foregoing embodiments, as a preferred implementation, obtaining a noise-reduced speech signal based on a first speech signal and a second speech signal includes:
filtering the first voice signal in the second voice signal to obtain a first process voice signal;
acquiring a double-microphone noise reduction signal obtained based on double-microphone noise reduction operation;
and filtering the first process voice signal in the double-microphone noise reduction signal to obtain a noise reduction voice signal.
It should be noted that, in the present embodiment, in the process of obtaining the noise-reduced voice signal based on the first voice signal and the second voice signal, the first voice signal received by the vibration sensor is first filtered in the second voice signal received by the voice microphone to obtain the first process voice signal, and then the dual-microphone noise-reduction signal obtained based on the dual-microphone noise-reduction operation is obtained, and the first process voice signal is filtered in the dual-microphone noise-reduction signal to obtain the noise-reduced voice signal.
In this embodiment, there is no fixed execution sequence between the step of obtaining the dual-microphone noise reduction signal obtained based on the dual-microphone noise reduction operation and the step of filtering the first voice signal in the second voice signal to obtain the first process voice signal, and the steps may also be executed simultaneously, which is not limited specifically herein.
In this embodiment, the expression of the process of obtaining the noise reduction voice signal based on the first voice signal and the second voice signal is as follows:
according to a first voice signal S collected by a vibration sensorGAnd a second voice signal S collected by the voice microphonetComparing to obtain a second voice signal StExtracting a clean speech signal, i.e. Sclean：
Sdv＝St–k*SG(ii) a Wherein k is a noise reduction coefficient; (S)dvIncluding wind noise and other noise signals and a portion of the speech signal that is corrupted);
the signal acquired by the double-microphone noise reduction scheme is SD：
Sclean＝SD–r*Sdv(ii) a Wherein r is a noise reduction coefficient.
The embodiment further improves the reliability of obtaining the noise reduction voice signal based on the first voice signal and the second voice signal.
In addition to the foregoing embodiments, as a preferred implementation manner, obtaining a noise-reduced speech signal based on a third speech signal and a second speech signal includes:
filtering the third voice signal in the second voice signal to obtain a second process voice signal;
acquiring a double-microphone noise reduction signal obtained based on double-microphone noise reduction operation;
and filtering the voice signal of the second process in the double-microphone noise reduction signal to obtain a noise reduction voice signal.
It should be noted that, in this embodiment, in the process of obtaining the noise-reduced voice signal based on the third voice signal and the second voice signal, the third voice signal is first filtered in the second voice signal to obtain the second process voice signal, so as to obtain the dual-microphone noise-reduced signal obtained based on the dual-microphone noise reduction operation, and the second process voice signal is filtered in the dual-microphone noise-reduced signal to obtain the noise-reduced voice signal.
In this embodiment, there is no fixed execution sequence between the step of obtaining the double-microphone noise reduction signal obtained based on the double-microphone noise reduction operation and the step of filtering the third speech signal in the second speech signal to obtain the second process speech signal, and the steps may also be executed simultaneously, which is not limited specifically herein.
In this embodiment, the expression of the process of obtaining the noise reduction speech signal based on the third speech signal and the second speech signal is as follows:
according to the third voice signal S collected by the noise reduction microphoneFBAnd a second voice signal S collected by the voice microphonetComparing to obtain a second voice signal StExtracting a clean speech signal Sclean：
Sdv＝St–l*SFB；(SdvContaining a small portion of the ambient noise signal);
the signal acquired by the double-microphone noise reduction scheme is SD：
Sclean＝SD–n*Sdv(ii) a Wherein n is a noise reduction coefficient.
The embodiment further improves the reliability of obtaining the noise reduction voice signal based on the first voice signal and the second voice signal.
On the basis of the above embodiment, as a preferred implementation, the receiving a first voice signal based on a vibration sensor includes:
receiving a first voice signal based on a gravity sensor or a bone sensor;
receiving a third speech signal based on a noise reduction microphone, comprising:
receiving a third voice signal based on a feedback microphone;
obtaining a double-microphone noise reduction signal obtained based on the double-microphone noise reduction operation, comprising:
and acquiring a double-microphone noise reduction signal obtained by executing double-microphone noise reduction operation based on the voice microphone and the feedforward microphone.
It should be noted that the present embodiment focuses on that the first voice signal is received by a gravity sensor (G-sensor) or a bone sensor, so that the accuracy of the first voice signal can be relatively ensured; on this basis, the third voice signal is received based on a feedback microphone (feedback mic), and the dual-microphone noise reduction operation is performed based on the voice microphone and a feedforward microphone (feedback mic). The embodiment further improves the voice noise reduction effect of the earphone in the conversation scene, and further improves the overall quality of the voice signal.
Referring to fig. 2, an embodiment of the present application discloses a method for reducing noise of a headphone, including:
step S20: an ambient sound signal is received.
Step S21: whether the ratio of the target frequency lower than the preset threshold in the ambient sound signal reaches the preset ratio threshold is judged, if yes, the step S22 and the step S23 are executed, and if not, the step S24 and the step S25 are executed.
Step S22: the first voice signal is received based on the vibration sensor, and the second voice signal is received by the voice microphone.
Step S23: and obtaining the noise reduction voice signal based on the first voice signal and the second voice signal.
Step S24: the noise reduction-based microphone receives the third voice signal and the voice microphone receives the second voice signal.
Step S25: and obtaining a noise reduction voice signal based on the third voice signal and the second voice signal.
It should be noted that, in this embodiment, the manner of determining whether the ambient sound signal is a sound signal generated in a wind noise scene is specifically determined whether the ratio of the target frequency in the ambient sound signal, which is lower than a preset threshold, in the ambient sound signal reaches a preset ratio threshold, where the preset threshold may be smaller than or equal to a minimum value of a human sound frequency interval, and when the ratio of the target frequency in the ambient sound signal, which is lower than the minimum value of the human sound frequency interval, in the ambient sound signal reaches the preset ratio threshold, the ambient sound signal is considered as a sound signal generated in the wind noise scene, otherwise, the ambient sound signal is not considered as a sound signal generated in the wind noise scene. The method and the device further improve the accuracy of the process of judging whether the environmental sound signal is the sound signal generated by the wind noise scene, and further ensure the overall reliability of the noise reduction process of the earphone.
Referring to fig. 3, an embodiment of the present application discloses a method for reducing noise of an earphone, including:
step S30: an ambient sound signal is received.
Step S31: whether the signal spectrums of the ambient sound signals are continuous or not is judged, if yes, the step S32 and the step S33 are executed, and if not, the step S34 and the step S35 are executed.
Step S32: the first voice signal is received based on the vibration sensor, and the second voice signal is received by the voice microphone.
Step S33: and obtaining the noise reduction voice signal based on the first voice signal and the second voice signal.
Step S34: the noise reduction-based microphone receives the third voice signal and the voice microphone receives the second voice signal.
Step S35: and obtaining a noise reduction voice signal based on the third voice signal and the second voice signal.
It should be noted that, in this embodiment, the manner of determining whether the ambient sound signal is a sound signal generated in a wind noise scene is specifically determined whether the signal spectrum of the ambient sound signal is continuous, and because it is considered that the frequency spectrum of the wind noise signal is often continuous in the wind noise scene and the frequency spectrum of the voice signal is often spaced, in this embodiment, by determining whether the signal spectrum of the ambient sound signal is continuous, when the signal spectrum of the ambient sound signal is continuous, the ambient sound signal is considered to be a sound signal generated in the wind noise scene, otherwise, the ambient sound signal is considered not to be a sound signal generated in the wind noise scene. The method and the device further improve the accuracy of the process of judging whether the environmental sound signal is the sound signal generated by the wind noise scene, and further ensure the overall reliability of the noise reduction process of the earphone.
Referring to fig. 4, an embodiment of the present application discloses a method for reducing noise of an earphone, including:
step S40: an ambient sound signal is received.
Step S41: judging whether the ratio of the target frequency lower than the preset threshold in the environment sound signal reaches the preset ratio threshold and the signal spectrum of the environment sound signal is continuous, if so, executing the step S42 and the step S43, otherwise, executing the step S44 and the step S45.
Step S42: the first voice signal is received based on the vibration sensor, and the second voice signal is received by the voice microphone.
Step S43: and obtaining a noise reduction voice signal based on the first voice signal and the second voice signal.
Step S44: the noise reduction-based microphone receives the third voice signal and the voice microphone receives the second voice signal.
Step S45: and obtaining the noise reduction voice signal based on the third voice signal and the second voice signal.
It should be noted that, in this embodiment, the manner of determining whether the ambient sound signal is a sound signal generated in a wind noise scene is specifically determined to determine whether two conditions, that is, whether the ratio of the target frequency lower than the preset threshold in the ambient sound signal to the ambient sound signal reaches the preset ratio threshold and the signal spectrum of the ambient sound signal is continuous, are simultaneously satisfied, and then when the ratio of the target frequency lower than the preset threshold in the ambient sound signal to the ambient sound signal reaches the preset ratio threshold and the signal spectrum of the ambient sound signal is continuous, the ambient sound signal is considered as the sound signal generated in the wind noise scene, otherwise, the ambient sound signal is not the sound signal generated in the wind noise scene. The method and the device further improve the accuracy of the process of judging whether the environmental sound signal is the sound signal generated by the wind noise scene, and further ensure the overall reliability of the noise reduction process of the earphone.
Referring to fig. 5, an embodiment of the present application discloses a noise reduction device for a headphone, including:
an ambient sound signal receiving module 10, configured to receive an ambient sound signal;
the scene judging module 11 is configured to judge whether the ambient sound signal is a sound signal generated by a wind noise scene, if so, sequentially invoke the first receiving module 12 and the first noise reduction module 13, and otherwise, sequentially invoke the second receiving module 14 and the second noise reduction module 15;
a first receiving module 12, configured to receive a first voice signal based on the vibration sensor, and receive a second voice signal by using a voice microphone;
a first noise reduction module 13, configured to obtain a noise reduction voice signal based on the first voice signal and the second voice signal;
a second receiving module 14, configured to receive the third voice signal based on the noise reduction microphone, and receive the second voice signal by using the voice microphone;
and a second noise reduction module 15, configured to obtain a noise-reduced voice signal based on the third voice signal and the second voice signal.
In a specific embodiment, the scene determining module 11 includes:
the frequency judgment module is used for judging whether the ratio of the target frequency lower than the preset threshold value in the environmental sound signal reaches the preset ratio threshold value or not; if yes, sequentially calling the first receiving module 12 and the first noise reduction module 13; otherwise, the second receiving module 14 and the second noise reduction module 15 are called in sequence.
In a specific embodiment, the scene determining module 11 includes:
the frequency spectrum judging module is used for judging whether the signal frequency spectrum of the environmental sound signal is continuous or not; if yes, the first receiving module 12 and the first noise reduction module 13 are called in sequence; otherwise, the second receiving module 14 and the second noise reduction module 15 are called in sequence.
In a specific embodiment, the scene determining module 11 includes:
the comprehensive judgment module is used for judging whether the ratio of the target frequency lower than a preset threshold value in the environmental sound signal reaches a preset ratio threshold value and the signal frequency spectrum of the environmental sound signal is continuous; if yes, sequentially calling the first receiving module 12 and the first noise reduction module 13; otherwise, the second receiving module 14 and the second noise reduction module 15 are called in sequence.
In one embodiment, the first noise reduction module 13 includes:
the first filtering module is used for filtering the first voice signal in the second voice signal to obtain a first process voice signal;
the noise reduction signal acquisition module is used for acquiring a double-microphone noise reduction signal obtained based on double-microphone noise reduction operation;
and the first double-microphone filtering module is used for filtering the first process voice signal in the double-microphone noise reduction signal to obtain a noise reduction voice signal.
In one embodiment, the second noise reduction module 15 includes:
the second filtering module is used for filtering a third voice signal in the second voice signal to obtain a second process voice signal;
the noise reduction signal acquisition module is used for acquiring a double-microphone noise reduction signal obtained based on double-microphone noise reduction operation;
and the second double-microphone filtering module is used for filtering the second process voice signal in the double-microphone noise reduction signal to obtain a noise reduction voice signal.
In one embodiment, the first receiving module includes:
the sensor receiving module is used for receiving a first voice signal based on a gravity sensor or a bone sensor;
a second receiving module comprising:
a feedback microphone receiving module for receiving a third voice signal based on a feedback microphone;
a noise reduction signal acquisition module comprising:
and the double-microphone noise reduction signal acquisition module is used for acquiring a double-microphone noise reduction signal obtained by executing double-microphone noise reduction operation based on the voice microphone and the feedforward microphone.
The earphone noise reduction device provided by the application firstly receives an environment sound signal, and then judges whether the environment sound signal is a sound signal generated by a wind noise scene, if the environment sound signal is the sound signal generated by the wind noise scene, the earphone noise reduction device further receives a first voice signal based on a vibration sensor, and receives a second voice signal by using a voice microphone, and then a noise reduction voice signal is obtained based on the first voice signal and the second voice signal; and if the environmental sound signal is not the sound signal generated by the wind noise scene, further receiving a third voice signal based on the noise reduction microphone, receiving a second voice signal by using the voice microphone, and further obtaining a noise reduction voice signal based on the third voice signal and the second voice signal. The device judges whether the environment where the earphone is located is a wind noise scene according to the environment sound signal of the environment where the earphone is located, and then under the condition of the wind noise scene, the voice signal is obtained in a mode of receiving vibration waves through the vibration sensor, so that the influence of the wind noise on the finally obtained noise-reduction voice signal is reduced, under the non-wind noise scene, the frequency width of the finally obtained noise-reduction voice signal is ensured in a mode of obtaining the voice signal through the noise-reduction microphone, the voice noise-reduction effect under the conversation scene is comprehensively improved, and the overall quality of the voice signal is further improved.
In addition, the embodiment of the application also discloses an earphone device, which comprises:
a vibration sensor;
a noise reduction microphone;
a voice microphone;
a memory for storing a computer program;
a processor for executing a computer program to enable receiving an ambient sound signal; judging whether the environmental sound signal is a sound signal generated by a wind noise scene; if the environmental sound signal is a sound signal generated by a wind noise scene, receiving a first voice signal based on a vibration sensor, and receiving a second voice signal by using a voice microphone; obtaining a noise reduction voice signal based on the first voice signal and the second voice signal; if the environmental sound signal is not the sound signal generated by the wind noise scene, receiving a third voice signal based on the noise reduction microphone, and receiving a second voice signal by using the voice microphone; and obtaining a noise reduction voice signal based on the third voice signal and the second voice signal.
According to the earphone noise reduction device, an environment sound signal is received firstly, whether the environment sound signal is a sound signal generated by a wind noise scene or not is judged, if the environment sound signal is the sound signal generated by the wind noise scene, a first voice signal is received further based on a vibration sensor, a second voice signal is received by a voice microphone, and a noise reduction voice signal is obtained based on the first voice signal and the second voice signal; and if the environment sound signal is not the sound signal generated by the wind noise scene, further receiving a third voice signal based on the noise reduction microphone, receiving a second voice signal by utilizing the voice microphone, and further obtaining the noise reduction voice signal based on the third voice signal and the second voice signal. This equipment is according to the environmental acoustic signal of the environment that the earphone is located, judge whether the environment that the earphone is located makes an uproar the scene for the wind, and then under the scene's that makes an uproar the condition in the wind, acquire speech signal with the mode of receiving the vibration wave through vibration sensor, reduce the influence that the wind made an uproar the speech signal that makes an uproar finally obtained with this, under the scene of making an uproar in the non-wind, the bandwidth of the speech signal that makes an uproar that finally obtains is ensured through the mode that the microphone that makes an uproar obtained speech signal that makes an uproar, the pronunciation noise reduction effect under the conversation scene has been synthesized to have improved, and then the whole quality of speech signal has been improved.
In a specific application scenario, the noise reduction microphones included in the earphone device are specifically a feedback microphone and a feedforward microphone.
Fig. 6 is a schematic diagram showing a positional relationship between a microphone and a sensor of an earphone device in a specific application scenario.
The headphone apparatus in fig. 6 includes therein: a voice microphone 101; a feedforward microphone 102; a combination feedback microphone and vibration sensor 103.
In addition, the embodiment of the application also discloses a computer readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the earphone noise reduction method are realized.
The computer-readable storage medium provided by the application firstly receives an environment sound signal, and then judges whether the environment sound signal is a sound signal generated by a wind noise scene, if so, the computer-readable storage medium further receives a first voice signal based on a vibration sensor, and receives a second voice signal by using a voice microphone, and then obtains a noise reduction voice signal based on the first voice signal and the second voice signal; and if the environment sound signal is not the sound signal generated by the wind noise scene, further receiving a third voice signal based on the noise reduction microphone, receiving a second voice signal by utilizing the voice microphone, and further obtaining the noise reduction voice signal based on the third voice signal and the second voice signal. The computer readable storage medium judges whether the environment where the earphone is located is a wind noise scene according to the environmental sound signal of the environment where the earphone is located, and then under the condition of the wind noise scene, the voice signal is obtained in a mode of receiving vibration waves through the vibration sensor, so that the influence of wind noise on the finally obtained noise-reduced voice signal is reduced, under the non-wind noise scene, the frequency width of the finally obtained noise-reduced voice signal is ensured in a mode of obtaining the voice signal through the noise-reducing microphone, the voice noise reduction effect under the conversation scene is comprehensively improved, and the overall quality of the voice signal is further improved.
The above details describe a method and an apparatus for reducing noise of an earphone, an earphone device, and a storage medium provided by the present application. The embodiments are described in a progressive mode in the specification, the emphasis of each embodiment is on the difference from the other embodiments, and the same and similar parts among the embodiments can be referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description. It should be noted that, for those skilled in the art, it is possible to make several improvements and modifications to the present application without departing from the principle of the present application, and such improvements and modifications also fall within the scope of the claims of the present application.
It is further noted that, in the present specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
Claims (9)
1. A method for reducing noise in a headphone, comprising:
receiving an ambient sound signal;
judging whether the environmental sound signal is a sound signal generated by a wind noise scene;
if the environmental sound signal is a sound signal generated by a wind noise scene, receiving a first voice signal based on a vibration sensor, and receiving a second voice signal by using a voice microphone;
obtaining a noise reduction voice signal based on the first voice signal and the second voice signal;
if the environmental sound signal is not the sound signal generated by the wind noise scene, receiving a third voice signal based on a noise reduction microphone, and receiving the second voice signal by using the voice microphone;
obtaining the noise reduction voice signal based on the third voice signal and the second voice signal;
wherein the obtaining a noise-reduced speech signal based on the first speech signal and the second speech signal comprises:
filtering the first voice signal in the second voice signal to obtain a first process voice signal;
acquiring a double-microphone noise reduction signal obtained based on double-microphone noise reduction operation;
and filtering the first process voice signal in the double-microphone noise reduction signal to obtain the noise reduction voice signal.
2. The method of claim 1, wherein the determining whether the ambient sound signal is a sound signal generated by a wind noise scene comprises:
judging whether the ratio of the target frequency lower than a preset threshold value in the environmental sound signal reaches a preset ratio threshold value or not;
if yes, executing the step that the environmental sound signal is a sound signal generated by a wind noise scene;
otherwise, the step of not generating an acoustic signal for the wind noise scene is performed.
3. The method of claim 1, wherein the determining whether the ambient sound signal is a sound signal generated by a wind noise scene comprises:
judging whether the signal frequency spectrum of the environment sound signal is continuous or not;
if yes, executing the step that the environmental sound signal is a sound signal generated by a wind noise scene;
otherwise, the step of not generating an acoustic signal for the wind noise scene is performed.
4. The method of claim 1, wherein the determining whether the ambient sound signal is a sound signal generated by a wind noise scene comprises:
judging whether the ratio of the target frequency lower than a preset threshold value in the environment sound signal reaches a preset ratio threshold value or not, wherein the signal frequency spectrum of the environment sound signal is continuous;
if so, executing the step that the environmental sound signal is a sound signal generated by a wind noise scene;
otherwise, the step of not generating an acoustic signal for the wind noise scene is performed.
5. The method of claim 1, wherein the deriving the noise-reduced speech signal based on the third speech signal and the second speech signal comprises:
filtering the third voice signal in the second voice signal to obtain a second process voice signal;
acquiring a double-microphone noise reduction signal obtained based on double-microphone noise reduction operation;
and filtering the second process voice signal in the double-microphone noise reduction signal to obtain the noise reduction voice signal.
6. The headphone noise reduction method of claim 5, wherein the receiving a first speech signal based on a vibration sensor comprises:
receiving the first voice signal based on a gravity sensor or a bone sensor;
the noise reduction based microphone receiving a third speech signal comprising:
receiving the third speech signal based on a feedback microphone;
the acquiring of the double-microphone noise reduction signal obtained based on the double-microphone noise reduction operation includes:
and acquiring the double-microphone noise reduction signal obtained by executing the double-microphone noise reduction operation based on the voice microphone and the feedforward microphone.
7. An apparatus for reducing noise in a headphone, comprising:
the environment sound signal receiving module is used for receiving an environment sound signal;
the scene judging module is used for judging whether the environmental sound signal is a sound signal generated by a wind noise scene, if so, the first receiving module and the first noise reduction module are sequentially called, and otherwise, the second receiving module and the second noise reduction module are sequentially called;
the first receiving module is used for receiving a first voice signal based on the vibration sensor and receiving a second voice signal by using the voice microphone;
the first noise reduction module is configured to obtain a noise reduction voice signal based on the first voice signal and the second voice signal;
the second receiving module is configured to receive a third voice signal based on a noise reduction microphone and receive the second voice signal by using the voice microphone;
the second noise reduction module is configured to obtain the noise-reduced voice signal based on the third voice signal and the second voice signal;
wherein the first noise reduction module comprises:
the first filtering module is used for filtering the first voice signal in the second voice signal to obtain a first process voice signal;
the noise reduction signal acquisition module is used for acquiring a double-microphone noise reduction signal obtained based on double-microphone noise reduction operation;
and the first double-microphone filtering module is used for filtering the first process voice signal in the double-microphone noise reduction signal to obtain the noise reduction voice signal.
8. An earphone device, comprising:
a vibration sensor;
a noise reduction microphone;
a voice microphone;
a memory for storing a computer program;
a processor for executing the computer program to enable receiving an ambient acoustic signal; judging whether the environmental sound signal is a sound signal generated by a wind noise scene; if the environment sound signal is a sound signal generated by a wind noise scene, receiving a first voice signal based on the vibration sensor, and receiving a second voice signal by using the voice microphone; obtaining a noise reduction voice signal based on the first voice signal and the second voice signal; if the environmental sound signal is not the sound signal generated by the wind noise scene, receiving a third voice signal based on the noise reduction microphone, and receiving the second voice signal by using the voice microphone; obtaining the noise reduction voice signal based on the third voice signal and the second voice signal; wherein the obtaining a noise-reduced speech signal based on the first speech signal and the second speech signal comprises: filtering the first voice signal in the second voice signal to obtain a first process voice signal; acquiring a double-microphone noise reduction signal obtained based on double-microphone noise reduction operation; and filtering the first process voice signal in the double-microphone noise reduction signal to obtain the noise reduction voice signal.
9. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a computer program which, when being executed by a processor, carries out the steps of the headphone noise reduction method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010940245.8A CN112019967B (en) | 2020-09-09 | 2020-09-09 | Earphone noise reduction method and device, earphone equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010940245.8A CN112019967B (en) | 2020-09-09 | 2020-09-09 | Earphone noise reduction method and device, earphone equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112019967A CN112019967A (en) | 2020-12-01 |
| CN112019967B true CN112019967B (en) | 2022-07-22 |
Family
ID=73522504
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010940245.8A Active CN112019967B (en) | 2020-09-09 | 2020-09-09 | Earphone noise reduction method and device, earphone equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112019967B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113362845B (en) * | 2021-05-28 | 2022-12-23 | 阿波罗智联(北京)科技有限公司 | Method, apparatus, device, storage medium and program product for noise reduction of sound data |
| CN113490093B (en) * | 2021-06-28 | 2023-11-07 | 北京安声浩朗科技有限公司 | TWS earphone |
| CN114264365B (en) * | 2021-12-14 | 2024-04-30 | 歌尔科技有限公司 | Wind noise detection method, device, terminal equipment and storage medium |
| CN115148177A (en) * | 2022-05-31 | 2022-10-04 | 歌尔股份有限公司 | Method and device for reducing wind noise, intelligent head-mounted equipment and medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4380004A (en) * | 1981-03-19 | 1983-04-12 | Coats Montgomery R | Emergency sound detector device |
| CN110012378A (en) * | 2019-04-08 | 2019-07-12 | 深圳市九音科技有限公司 | A kind of method of voice de-noising, earplug and computer storage medium |
| CN110931031A (en) * | 2019-10-09 | 2020-03-27 | 大象声科（深圳）科技有限公司 | Deep learning voice extraction and noise reduction method fusing bone vibration sensor and microphone signals |
| CN111327985A (en) * | 2020-03-06 | 2020-06-23 | 华勤通讯技术有限公司 | Earphone noise reduction method and device |
| CN111405406A (en) * | 2020-03-27 | 2020-07-10 | 歌尔股份有限公司 | Noise reduction method and device for hybrid noise reduction earphone, wireless earphone and storage medium |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8433564B2 (en) * | 2009-07-02 | 2013-04-30 | Alon Konchitsky | Method for wind noise reduction |
-
2020
- 2020-09-09 CN CN202010940245.8A patent/CN112019967B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4380004A (en) * | 1981-03-19 | 1983-04-12 | Coats Montgomery R | Emergency sound detector device |
| CN110012378A (en) * | 2019-04-08 | 2019-07-12 | 深圳市九音科技有限公司 | A kind of method of voice de-noising, earplug and computer storage medium |
| CN110931031A (en) * | 2019-10-09 | 2020-03-27 | 大象声科（深圳）科技有限公司 | Deep learning voice extraction and noise reduction method fusing bone vibration sensor and microphone signals |
| CN111327985A (en) * | 2020-03-06 | 2020-06-23 | 华勤通讯技术有限公司 | Earphone noise reduction method and device |
| CN111405406A (en) * | 2020-03-27 | 2020-07-10 | 歌尔股份有限公司 | Noise reduction method and device for hybrid noise reduction earphone, wireless earphone and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112019967A (en) | 2020-12-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112019967B (en) | Earphone noise reduction method and device, earphone equipment and storage medium | |
| JP5293817B2 (en) | Audio signal processing apparatus and audio signal processing method | |
| JP6034793B2 (en) | Audio signal generation system and method | |
| US9343056B1 (en) | Wind noise detection and suppression | |
| KR101444100B1 (en) | Noise cancelling method and apparatus from the mixed sound | |
| CN112767963B (en) | Voice enhancement method, device and system and computer readable storage medium | |
| CN109195042B (en) | Low-power-consumption efficient noise reduction earphone and noise reduction system | |
| WO2016056167A1 (en) | Echo cancellation device, echo cancellation program, and echo cancellation method | |
| JP6545419B2 (en) | Acoustic signal processing device, acoustic signal processing method, and hands-free communication device | |
| CN110782912A (en) | Sound source control method and speaker device | |
| KR20200074199A (en) | Voice noise canceling method and device, server and storage media | |
| US20080228473A1 (en) | Method and apparatus for adjusting hearing intelligibility in mobile phones | |
| CN103426433A (en) | Noise cancellation method | |
| CN109040500B (en) | Echo cancellation method, echo cancellation device, earphone device and computer-readable storage medium | |
| US10972844B1 (en) | Earphone and set of earphones | |
| WO2018167960A1 (en) | Speech processing device, speech processing system, speech processing method, and speech processing program | |
| CN111327985A (en) | Earphone noise reduction method and device | |
| JP2022505997A (en) | Deep learning voice extraction and noise reduction method that fuses bone vibration sensor and microphone signal | |
| EP2482566B1 (en) | Method for generating an audio signal | |
| KR20170032237A (en) | Reducing instantaneous wind noise | |
| CN107452398B (en) | Echo acquisition method, electronic device and computer readable storage medium | |
| JP3434215B2 (en) | Sound pickup device, speech recognition device, these methods, and program recording medium | |
| CN113593599A (en) | Method for removing noise signal in voice signal | |
| JP3435687B2 (en) | Sound pickup device | |
| JP7043344B2 (en) | Echo suppression device, echo suppression method and echo suppression program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |