CN115175046A

CN115175046A - Earphone noise reduction method and device, electronic equipment and computer readable storage medium

Info

Publication number: CN115175046A
Application number: CN202210828366.2A
Authority: CN
Inventors: 韦韧; 伊海珂
Original assignee: Shanghai Wuqi Microelectronics Co Ltd
Current assignee: Shanghai Wuqi Microelectronics Co Ltd
Priority date: 2022-07-13
Filing date: 2022-07-13
Publication date: 2022-10-11

Abstract

The application provides a method and a device for reducing noise of an earphone, electronic equipment and a computer readable storage medium, and relates to the technical field of earphones. The method comprises the following steps: when a feedforward noise reduction filter of the earphone equipment is set as a first feedforward noise reduction filter coefficient, testing first frequency response data corresponding to the earphone equipment; when the feedforward noise reduction filter of the earphone equipment is set to be a second feedforward noise reduction filter coefficient, testing second frequency response data corresponding to the earphone equipment; calculating to obtain a target frequency response of the feedforward noise reduction filter according to the first frequency response data and the second frequency response data; the feedforward noise reduction filter is adjusted based on the target frequency response. The method and the device have the advantages that the target frequency response under the ideal condition of the feedforward noise reduction filter is determined by testing a plurality of frequency response data corresponding to the earphone device when different feedforward noise reduction filter coefficients are tested, so that the feedforward noise reduction filter is adjusted according to the target frequency response, the noise reduction effect of the earphone device is effectively improved, and the method and the device are suitable for various different wearing conditions.

Description

Earphone noise reduction method and device, electronic equipment and computer readable storage medium

Technical Field

The present application relates to the field of earphone technologies, and in particular, to an earphone noise reduction method and apparatus, an electronic device, and a computer-readable storage medium.

Background

An ear microphone is generally configured outside an Active Noise Control (ANC) Noise reduction earphone at present for collecting environmental sounds; an in-ear microphone is disposed inside the earphone for picking up the residual sound. The feedforward noise reduction module can process audio data collected by the microphone outside the ear, and the audio data is filtered by the feedforward noise reduction filter and then played by the loudspeaker. Therefore, the feedforward noise reduction filter is designed, original environmental sound residues can be counteracted in the auditory canal, and the purpose of active noise reduction is achieved.

Because the frequency response of the loudspeaker and the microphone of each earphone is different, certain calibration can be performed according to the acoustic characteristics of different earphones in the production stage, so that the earphones achieve a better noise reduction effect. In addition, in order to calibrate the difference between the human ear and the ear canal environment used in the test, the feedforward noise reduction filter can be calibrated under the condition that the human ear really wears the earphone, so as to further improve the noise reduction effect of the earphone. However, the currently adopted calibration method has large delay, large workload, long search time and large influence by sudden noise, which results in poor calibration effect on the filter, thereby resulting in poor noise reduction effect after the earphone is calibrated, and failing to meet the wearing requirements of different users in different scenes.

Disclosure of Invention

In view of this, embodiments of the present application provide a method and an apparatus for reducing noise of an earphone, an electronic device, and a computer-readable storage medium, so as to solve the problem in the prior art that a noise reduction effect of an earphone device is poor.

In order to solve the above problem, in a first aspect, an embodiment of the present application provides a method for reducing noise of a headphone, where the method includes:

when a feedforward noise reduction filter of the earphone equipment is set to be a first feedforward noise reduction filter coefficient, testing first frequency response data corresponding to the earphone equipment;

when the feedforward noise reduction filter of the earphone equipment is set to be a second feedforward noise reduction filter coefficient, testing second frequency response data corresponding to the earphone equipment;

calculating to obtain a target frequency response of the feedforward noise reduction filter according to the first frequency response data and the second frequency response data;

adjusting the feedforward noise reduction filter based on the target frequency response.

In the implementation process, when the user wearing the earphone device starts the noise reduction function of the earphone, the feedforward noise reduction filter in the earphone device can be set to be different feedforward noise reduction filter coefficients on the premise of keeping the current stable noise reduction effect, and a plurality of frequency response data corresponding to the earphone device under different coefficients are tested. Through the plurality of frequency response data, the target frequency response of the feedforward noise reduction filter under the ideal condition can be calculated, so that the adjustment operations such as compensation or update are carried out on the coefficient of the feedforward noise reduction filter according to the target frequency response, and the optimization of the noise reduction effect when the feedforward noise reduction filter carries out feedforward active noise reduction is realized. The noise reduction effect of the earphone equipment can be adaptively adjusted and optimized in the noise reduction process, and the earphone equipment is suitable for different wearing conditions of various different users during use.

Optionally, when the feedforward noise reduction filter of the headphone device is set to be the first feedforward noise reduction filter coefficient, testing the first frequency response data corresponding to the headphone device includes:

acquiring first headphone data of the headphone device when the feedforward noise reduction filter of the headphone device is set to a first feedforward noise reduction filter coefficient;

and determining the first frequency response data corresponding to the earphone equipment according to the first earphone data and the first feedforward noise reduction filter coefficient.

In the implementation process, the corresponding first earphone data is acquired when the feedforward noise reduction filter is provided with the first feedforward noise reduction filter coefficient, so that the current first frequency response data of the earphone device is calculated according to the first earphone data and the first feedforward noise reduction filter coefficient, and the accuracy and the real-time performance of the first frequency response data are effectively improved.

Optionally, the first headphone data comprises first audio data and second audio data; the collecting first earphone data of the earphone device comprises:

acquiring the first audio data of an in-ear microphone in the headphone device;

acquiring the second audio data of an off-ear microphone in the headset device;

the first frequency response data comprises a first noise reduction frequency response and a first feedforward noise reduction filter frequency response; the determining the first frequency response data corresponding to the headset device according to the first headset data and the first feedforward noise reduction filter coefficient includes:

calculating to obtain the first noise reduction frequency response between the in-ear microphone and the out-of-ear microphone according to the first audio data and the second audio data;

and determining the frequency response of the first feedforward noise reduction filter according to the coefficient of the first feedforward noise reduction filter.

In the implementation process, the first frequency response data includes a first frequency response of the feedforward noise reduction filter when the feedforward noise reduction filter performs feedforward active noise reduction and a first noise reduction frequency response of the headphone device when the headphone device performs active noise reduction. The first noise reduction frequency response is difference data of frequency responses between first audio data of an in-ear microphone and second audio data of an out-of-ear microphone in the earphone device, which are acquired when the earphone device works by using a first feedforward noise reduction filter coefficient. The current real-time audio data of the two microphones are respectively collected, and the first noise reduction frequency response of the frequency response difference between the in-ear microphone and the out-of-ear microphone can be calculated according to the frequency domain characteristics of the two audio data. And the frequency response of the first feedforward noise reduction filter corresponding to the set coefficient of the first feedforward noise reduction filter is determined, so that the actual noise reduction frequency response of the feedforward noise reduction filter during noise reduction is determined, and the accuracy and the real-time performance of the first frequency response data are improved.

Optionally, when the feedforward noise reduction filter of the headphone device is set as a second feedforward noise reduction filter coefficient, testing second frequency response data corresponding to the headphone device includes:

determining the corresponding second feedforward noise reduction filter coefficient according to the first feedforward noise reduction filter coefficient;

acquiring second headphone data of the headphone device when the feedforward noise reduction filter of the headphone device is set to a second feedforward noise reduction filter coefficient;

and determining the second frequency response data corresponding to the earphone equipment according to the second earphone data and the second feedforward noise reduction filter coefficient.

In the implementation process, a second feedforward noise reduction filter coefficient different from the first feedforward noise reduction filter coefficient is determined through the first feedforward noise reduction filter coefficient, and corresponding second earphone data is acquired when the feedforward noise reduction filter is set with the second feedforward noise reduction filter coefficient, so that the current second frequency response data of the earphone equipment is calculated according to the second earphone data and the second feedforward noise reduction filter coefficient, and the accuracy and the real-time performance of the second frequency response data are effectively improved.

Optionally, the second headphone data comprises third audio data and fourth audio data; the acquiring second headphone data of the headphone device includes:

acquiring the third audio data of an in-ear microphone in the headphone device;

acquiring the fourth audio data of an off-ear microphone in the headset device;

the second frequency response data comprises a second noise reduction frequency response and a second feedforward noise reduction filter frequency response; determining the second frequency response data corresponding to the headphone device according to the second headphone data and the second feedforward noise reduction filter coefficient includes:

calculating to obtain the second noise reduction frequency response between the in-ear microphone and the out-of-ear microphone according to the third audio data and the fourth audio data;

and determining the frequency response of the second feedforward noise reduction filter according to the coefficient of the second feedforward noise reduction filter.

In the implementation process, the second frequency response data includes a second frequency response of the feedforward noise reduction filter when the feedforward noise reduction filter performs feedforward active noise reduction and a second noise reduction frequency response of the headphone device when the headphone device performs active noise reduction. And the second noise reduction frequency response is the difference data of the frequency response between the third audio data of the in-ear microphone and the fourth audio data of the out-of-ear microphone in the earphone equipment, which are acquired when the earphone equipment works by using the second feedforward noise reduction filter coefficient. The current real-time audio data of the two microphones are respectively acquired, a second noise reduction frequency response of the frequency response difference between the in-ear microphone and the out-of-ear microphone can be calculated according to the frequency domain characteristics of the two audio data, and the frequency response of the second feedforward noise reduction filter corresponding to the second noise reduction frequency response is determined through the set second feedforward noise reduction filter coefficient, so that the actual noise reduction frequency response of the feedforward noise reduction filter during noise reduction is determined, and the accuracy and the real-time performance of the second frequency response data are improved.

Optionally, the adjusting the feedforward noise reduction filter based on the target frequency response includes:

adjusting the current filter coefficient of the feedforward noise reduction filter according to the target frequency response to obtain an adjusted filter coefficient;

configuring the feedforward noise reduction filter to operate with the adjusted filter coefficients.

In the implementation process, according to the calculated target frequency response of the feedforward noise reduction filter under the ideal condition, the current filter coefficient of the feedforward noise reduction filter is optimized by adopting an optimization algorithm, the corresponding adjustment filter coefficient can be obtained, and the feedforward noise reduction filter is configured to adjust the filter coefficient to perform feedforward active noise reduction and other work, so that the difference between the actual frequency response and the target frequency response of the feedforward noise reduction filter is reduced, the noise reduction effect of the feedforward noise reduction filter is effectively optimized, and therefore in the noise reduction process, the noise reduction effect in the earphone equipment is adaptively and iteratively calibrated and adjusted according to the specific wearing condition of the earphone equipment.

Optionally, the method further comprises:

testing a first noise reduction effect of the earphone equipment before the feedforward noise reduction filter is adjusted;

testing a second noise reduction effect of the earphone equipment after the feedforward noise reduction filter is adjusted;

and determining an optimization result of the earphone equipment according to the first noise reduction effect and the second noise reduction effect.

In the implementation process, two noise reduction effects before and after the adjustment of the feedforward noise reduction filter in the earphone equipment are respectively tested, and the two noise reduction effects obtained through the test are compared, so that the result after the noise reduction optimization of the earphone equipment can be determined, and whether the earphone equipment is optimized or not is determined according to the optimization result, or whether the noise reduction effect of the earphone equipment needs to be optimized continuously or not is determined.

In a second aspect, an embodiment of the present application further provides an apparatus for reducing noise of a headphone, where the apparatus includes:

the system comprises a first testing module, a second testing module and a control module, wherein the first testing module is used for testing first frequency response data corresponding to the earphone equipment when a feedforward noise reduction filter of the earphone equipment is set to be a first feedforward noise reduction filter coefficient;

the second testing module is used for testing second frequency response data corresponding to the earphone equipment when the feedforward noise reduction filter of the earphone equipment is set to be a second feedforward noise reduction filter coefficient;

the calculation module is used for calculating and obtaining the target frequency response of the feedforward noise reduction filter according to the first frequency response data and the second frequency response data;

and the adjusting module is used for adjusting the feedforward noise reduction filter based on the target frequency response.

In a third aspect, an embodiment of the present application further provides an electronic device, where the electronic device includes a memory and a processor, where the memory stores program instructions, and when the processor reads and executes the program instructions, the processor executes steps in any implementation manner of the above earphone noise reduction method.

In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, where computer program instructions are stored, and when the computer program instructions are read and executed by a processor, the steps in any implementation manner of the above earphone noise reduction method are executed.

In summary, the present application provides an earphone noise reduction method, an earphone noise reduction device, an electronic device, and a computer readable storage medium, during noise reduction, different feedforward noise reduction filter coefficients are set according to a specific wearing condition of an earphone device for testing, and a target frequency response of the feedforward noise reduction filter under an ideal condition is determined according to multiple noise reduction frequency response data under different conditions, so as to adjust the feedforward noise reduction filter according to the target frequency response, thereby effectively improving the noise reduction effect of the earphone device, and being suitable for multiple different wearing conditions.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.

Fig. 1 is a schematic block diagram of an electronic device according to an embodiment of the present disclosure;

fig. 2 is a schematic flowchart of a noise reduction method for an earphone according to an embodiment of the present disclosure;

fig. 3 is a detailed flowchart of a step S200 according to an embodiment of the present disclosure;

fig. 4 is a detailed flowchart of step S300 according to an embodiment of the present disclosure;

fig. 5 is a detailed flowchart of a step S500 according to an embodiment of the present disclosure;

fig. 6 is a schematic flowchart of another noise reduction method for a headphone according to an embodiment of the present disclosure;

fig. 7 is a schematic structural diagram of a noise reduction device for a headphone according to an embodiment of the present application.

Icon: 100-an electronic device; 111-a memory; 112-a memory controller; 113-a processor; 114-peripheral interfaces; 115-a communication unit; 116-a display unit; 700-headphone noise reduction means; 710-a first test module; 720-a second test module; 730-a calculation module; 740-an adjustment module.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. It is obvious that the described embodiments are only a few of the embodiments of the present application, and not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without any creative effort belong to the protection scope of the embodiments of the present application.

Currently, various bluetooth headsets, such as TWS (True Wireless Stereo) headsets, are generally provided with an ANC (Active Noise Control) function, and can collect Noise signals recorded by a microphone in a headset device, and the Noise signals are processed by a filter in the system and played at a speaker; by reasonably designing the frequency response of the filter, the noise signal heard by the human ear can be reduced, and the noise reduction effect is achieved, for example, an ear microphone is configured at the outer side of the earphone device and used for collecting environmental sound; an in-ear microphone is provided inside the headphone device for picking up residual sound. The feedforward noise reduction module can process audio data collected by the microphone outside the ear, and the audio data is filtered by the feedforward noise reduction filter and then played by the loudspeaker. The earphone can also be provided with a self-adaptive ANC function, and the noise reduction effect is correspondingly influenced according to wearing and using environments of different people, for example, in the wearing process of a user, an internal chip of the earphone adjusts an internal active noise reduction strategy by measuring the current environment so as to achieve the optimal noise reduction effect under the current environment and the like.

With the continuous development and progress of the earphone market, the noise reduction function of the earphone equipment is more and more required by users. Generally, in the production process of earphone equipment, a set of better active noise reduction parameters is calibrated according to the acoustic characteristics of earphones, so that better noise reduction performance can be obtained when a user uses the earphone equipment. For example, because the frequency responses of the speaker and the microphone of each earphone device are different, a certain calibration is usually performed according to the acoustic characteristics of different earphone devices in the production process, so that the earphone devices achieve a better noise reduction effect. In addition, in order to calibrate the difference between the human ear and the ear canal environment used in the test, the feedforward noise reduction filter can be optimized under the condition that the human ear really wears the earphone device, so that the noise reduction effect of the feedforward noise reduction filter is calibrated, the noise reduction effect of the earphone device is further improved, and the like.

In the calibration method adopted in the prior art, various problems of large delay, large workload, long search time and large influence by burst noise exist, so that the calibration effect of the filter is poor, the noise reduction effect after the earphone equipment is calibrated is still poor, the active noise reduction parameters calibrated in the production process cannot completely meet the acoustic characteristics of users in use, and the wearing requirements of different users in different scenes cannot be met.

In order to solve the above problems, embodiments of the present application provide a method and an apparatus for reducing noise of an earphone, an electronic device, and a Computer readable storage medium, which are applied to an electronic device, where the electronic device may include noise-reducing earphone devices of various types, or an electronic device with logic calculation functions, such as a server, a Personal Computer (PC), a tablet PC, a smart phone, and a Personal Digital Assistant (PDA), and the like, and can calibrate a feedforward noise reduction filter of an earphone device according to a noise reduction frequency response obtained through testing, so as to improve a noise reduction effect of the earphone device.

Optionally, referring to fig. 1, fig. 1 is a block schematic diagram of an electronic device according to an embodiment of the present disclosure. The electronic device 100 may include a memory 111, a memory controller 112, a processor 113, a peripheral interface 114, a communication unit 115, and a display unit 116. It will be understood by those of ordinary skill in the art that the structure shown in fig. 1 is merely an illustration and is not intended to limit the structure of the electronic device 100. For example, electronic device 100 may also include more or fewer components than shown in FIG. 1, or have a different configuration than shown in FIG. 1.

The above-mentioned memory 111, memory controller 112, processor 113, peripheral interface 114, communication unit 115 and display unit 116 are electrically connected to each other directly or indirectly, so as to implement data transmission or interaction. For example, the components may be electrically connected to each other via one or more communication buses or signal lines. The processor 113 is used to execute the executable modules stored in the memory.

The Memory 111 may be, but is not limited to, a Random Access Memory (RAM), a Read Only Memory (ROM), a Programmable Read-Only Memory (PROM), an Erasable Read-Only Memory (EPROM), an electrically Erasable Read-Only Memory (EEPROM), and the like. The memory 111 is used for storing a program, the processor 113 executes the program after receiving an execution instruction, and the method executed by the electronic device 100 defined by the process disclosed in any embodiment of the present application may be applied to the processor 113, or implemented by the processor 113.

The processor 113 may be an integrated circuit chip having signal processing capability. The Processor 113 may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the Integrated Circuit may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. The various methods, steps, and logic blocks disclosed in the embodiments of the present application may be implemented or performed. The general purpose processor may be a microprocessor, any conventional processor, etc.

The peripheral interface 114 couples various input/output devices to the processor 113 and memory 111. In some embodiments, the peripheral interface 114, the processor 113, and the memory controller 112 may be implemented in a single chip. In other examples, they may be implemented separately from each other.

The communication unit 115 is used to communicatively connect the electronic device and an external device. The communication unit 115 may be, but is not limited to, various communication chips and the like.

The display unit 116 provides an interactive interface (e.g., a user operation interface) between the electronic device 100 and the user or is used for displaying image data to the user for reference. In this embodiment, the display unit may be a liquid crystal display or a touch display. In the case of a touch display, the display can be a capacitive touch screen or a resistive touch screen, which supports single-point and multi-point touch operations. The support of single-point and multi-point touch operations means that the touch display can sense touch operations simultaneously generated from one or more positions on the touch display, and the sensed touch operations are sent to the processor for calculation and processing. In the embodiment of the present application, the display unit 116 may display related data such as a spectrum curve of the frequency response data.

The electronic device in this embodiment may be configured to perform each step in each of the headphone noise reduction methods provided in this embodiment. The following describes the implementation process of the noise reduction method of the earphone in detail by using several embodiments.

Referring to fig. 2, fig. 2 is a schematic flow chart of a noise reduction method for a headset according to an embodiment of the present disclosure, where the method may include steps S200-S500.

Step S200, when the feedforward noise reduction filter of the earphone equipment is set to be the coefficient of the first feedforward noise reduction filter, first frequency response data corresponding to the earphone equipment is tested.

In the process of starting the noise reduction function of the earphone device to reduce noise, the feedforward noise reduction filter in the earphone device is set as the coefficient of the first feedforward noise reduction filter on the premise of keeping the current stable noise reduction effect, so as to test the first frequency response data corresponding to the current earphone device.

Optionally, in order to improve the accuracy in calibration, before the noise reduction frequency response data is tested, the user may wear the headphone device correctly to ensure that the position of the headphone device is stable and does not change greatly with the adjustment of the posture of the human body. If the earphone device is an earplug type noise reduction earphone, a user is generally required to select a proper earplug size, and meanwhile, tight wearing is guaranteed, no air leakage condition exists, and the like. In the test process, in order to improve the accuracy in calibration, the user can keep quiet, situations of swallowing speech, playing music, answering a call and the like are reduced, surrounding environment sound is moderate, and the noise reduction effect is convenient to test and adjust.

And step S300, when the feedforward noise reduction filter of the earphone equipment is set to be the coefficient of the second feedforward noise reduction filter, testing second frequency response data corresponding to the earphone equipment.

After the first frequency response data is tested, the feedforward noise reduction filter in the earphone equipment can be set to be a second feedforward noise reduction filter coefficient different from the first feedforward noise reduction filter coefficient, so that noise reduction frequency responses of different wearing persons and using scenes are respectively tested, and second frequency response data corresponding to the current earphone equipment can be tested.

Alternatively, the first frequency response data and the second frequency response data are difference data reflecting frequency responses between the plurality of audio data when the headphone apparatus actively reduces noise, and may be in the form of frequency response curves.

And step S400, calculating to obtain the target frequency response of the feedforward noise reduction filter according to the first frequency response data and the second frequency response data.

The target frequency response of the feedforward noise reduction filter under the ideal condition can be calculated according to the noise reduction effect between the first frequency response data and the second frequency response data and the difference between the noise reduction frequency responses.

Optionally, more different feedforward noise reduction filter coefficients may be set to calculate the target frequency response, for example, third frequency response data corresponding to the third feedforward noise reduction filter coefficient is tested, so as to improve the accuracy of the target frequency response.

Optionally, when the target frequency response is calculated, a plurality of parameters corresponding to a plurality of frequency response data in the feedforward noise reduction filter may be combined to perform calculation, so as to improve the accuracy of the target frequency response.

Step S500, adjusting the feedforward noise reduction filter based on the target frequency response.

According to the target frequency response of the feedforward noise reduction filter under the ideal condition obtained through calculation, the coefficient in the feedforward noise reduction filter can be updated, and therefore the noise reduction effect of the earphone equipment is optimized.

Optionally, a self-adaptive feedforward noise reduction filter may be cascaded after the feedforward noise reduction filter, and after the target frequency response of the feedforward noise reduction filter is obtained through calculation, the coefficient of the self-adaptive feedforward noise reduction filter may be updated according to the target frequency response, so that the actual frequency response of the feedforward noise reduction filter and the self-adaptive feedforward noise reduction filter cascaded approaches the target frequency response, and the active noise reduction effect of the feedforward noise reduction filter is optimized.

In the embodiment shown in fig. 2, the noise reduction effect of the earphone device can be adaptively adjusted and optimized in the noise reduction process, and the earphone device is suitable for different wearing conditions of different users.

Optionally, referring to fig. 3, fig. 3 is a detailed flowchart of step S200 according to an embodiment of the present disclosure, and step S200 may further include steps S210 to S220.

Step S210, when a feedforward noise reduction filter of the earphone equipment is set to be a first feedforward noise reduction filter coefficient, collecting first earphone data of the earphone equipment;

in the noise reduction process, the feedforward noise reduction filter is always kept in an open state, and when the feedforward noise reduction filter works with different feedforward noise reduction filter coefficients, corresponding frequency response data are different. Therefore, when the feedforward noise reduction filter of the headphone apparatus is set to the first feedforward noise reduction filter coefficient, the first headphone data in each microphone in the headphone apparatus can be acquired in real time.

Optionally, the earphone device may include an in-ear microphone and an out-of-ear microphone, the first earphone data may include first audio data and second audio data, and the method during the acquiring may include: collecting first audio data of an in-ear microphone in a headset device; second audio data of an extra-aural microphone in the headphone apparatus is acquired. The audio data of different microphones in the earphone device can be collected respectively, so that the pertinence and the effectiveness of the first earphone data are improved.

Alternatively, in a common usage scenario, the out-of-ear microphone may be a microphone for feed-forward noise reduction acquisition, and in some other usage scenarios, the out-of-ear microphone may also be another microphone, such as a talking microphone.

Step S220, determining first frequency response data corresponding to the earphone device according to the first earphone data and the first feedforward noise reduction filter coefficient.

The first frequency response data corresponding to the headphone device under the first feedforward noise reduction filter coefficient may be determined according to the frequency response difference between the audio data of each microphone in the first headphone data and the first feedforward noise reduction filter coefficient.

Optionally, the first frequency response data includes a first frequency response of the feedforward noise reduction filter when the feedforward noise reduction filter performs feedforward active noise reduction, and a first noise reduction frequency response of the headphone device when the headphone device performs active noise reduction. A first de-noising frequency response between the in-ear microphone and the out-of-ear microphone may be calculated based on the first audio data and the second audio data. Because the frequency response of the feedforward noise reduction filter corresponds to the coefficient of the feedforward noise reduction filter, the frequency response of the first feedforward noise reduction filter can be determined according to the coefficient of the first feedforward noise reduction filter, or the corresponding frequency response of the first feedforward noise reduction filter is preset in the earphone equipment, and when the earphone equipment works with the coefficient of the first feedforward noise reduction filter, the frequency response of the corresponding first feedforward noise reduction filter can be determined.

For example, when calculating the first denoise frequency response, the first denoise frequency response may be calculated by comparing frequency domain characteristics between the first audio data and the second audio data collected by the in-ear microphone and the out-of-ear microphone. For example, in the same time period, the data of the two microphones may be windowed, and then FFT (Fast Fourier transform) processing is performed to obtain frequency domain responses, and then the frequency domain responses at multiple frequency points are divided, where a complex field value is the first noise reduction frequency response of the corresponding frequency point.

Optionally, in order to obtain a more accurate first noise reduction frequency response, the results of multiple FFTs may be averaged in a complex number domain, and a single frequency point may be subjected to time domain averaging, or multiple nearby frequency points may be subjected to averaging, for example, multiple frequency points are subjected to frequency domain averaging first and then to time domain averaging, or are subjected to time domain averaging first and then to frequency domain averaging, so as to obtain a more accurate first noise reduction frequency response. For example, when the external noise energy is low, data for a long time may be selected to be averaged, so as to obtain a stable and accurate first noise reduction frequency response.

Optionally, in a long-time averaging process, data after each FFT may be screened, and points with obviously abnormal indexes, such as noise reduction depth, may be removed, so as to further improve stability.

Alternatively, the frequency point selection may be determined by the frequency band in which the feedforward noise reduction is effective, for example, set between 50Hz and 3 kHz. In the interval, different feedforward noise reduction filter coefficients have larger influence on the final noise reduction frequency response, K frequency points can be selected in the interval, and the value range of a certain frequency point K is K =0,1, \ 8230;, K-1. The first denoising frequency response at the kth frequency point in the first frequency response data under the first feedforward denoising filter coefficient can be recorded as H ₁ (k) The first feedforward noise reduction filter frequency response is denoted as F ₁ (k)。

In the embodiment shown in fig. 3, the actual noise reduction frequency response of the headphone device when performing noise reduction with the first feedforward noise reduction filter coefficient can be determined, and the accuracy and the real-time performance of the first frequency response data are improved.

Optionally, referring to fig. 4, fig. 4 is a detailed flowchart of step S300 according to an embodiment of the present disclosure, and step S300 may further include steps S310 to S330.

Step S310, determining a corresponding second feedforward noise reduction filter coefficient according to the first feedforward noise reduction filter coefficient.

Wherein a different second feedforward noise reduction filter coefficient having a difference from the first feedforward noise reduction filter coefficient may be determined.

Alternatively, a plurality of different feedforward noise reduction filter coefficients may be stored in the headphone in advance, or a fixed gain may be added or subtracted on the basis of the first feedforward noise reduction filter coefficient to determine the second feedforward noise reduction filter coefficient.

Alternatively, the second feedforward noise reduction filter coefficient and the first feedforward noise reduction filter coefficient may be designed to have a difference, but both have sufficient noise reduction effect, so that the user does not feel a particularly significant noise reduction difference before and after switching. Through rationally setting up the filter coefficient of making an uproar and filter coefficient fall in second feedforward and the first feedforward, can reduce the discomfort that the people ear brought to the noise reduction effect change in the update process when the test, make the test more natural, can not produce influence by a wide margin to user's use, improved user's use effectively and experienced.

Step S320, when the feedforward noise reduction filter of the headphone device is set as the second feedforward noise reduction filter coefficient, collecting second headphone data of the headphone device.

The second headphone data in each microphone in the headphone device may be acquired in real time when the feedforward noise reduction filter of the headphone device is set to the second feedforward noise reduction filter coefficient.

Optionally, the second headphone data comprises third audio data and fourth audio data; the method at the time of acquisition may include: collecting third audio data of an in-ear microphone in the earphone device; fourth audio data of an extra-aural microphone in the headphone apparatus is acquired. The audio data of different microphones in the earphone device can be collected respectively, so that the pertinence and the effectiveness of the second earphone data are improved.

And step S330, determining second frequency response data corresponding to the earphone equipment according to the second earphone data and the second feedforward noise reduction filter coefficient.

And determining second frequency response data corresponding to the earphone equipment under the second feedforward noise reduction filter coefficient according to the frequency response difference between the audio data of the microphones in the second earphone data and the second feedforward noise reduction filter coefficient.

Optionally, the second frequency response data includes a second frequency response of the feedforward noise reduction filter when the feedforward noise reduction filter performs feedforward active noise reduction and a second noise reduction frequency response of the headphone device when the headphone device performs active noise reduction. Can be calculated according to the third audio data and the fourth audio dataTo a second noise reduction frequency response between the in-ear microphone and the out-of-ear microphone. The frequency response of the feedforward noise reduction filter corresponds to the coefficient of the feedforward noise reduction filter, so that the frequency response of the second feedforward noise reduction filter can be determined according to the coefficient of the second feedforward noise reduction filter, or the corresponding frequency response of the second feedforward noise reduction filter is preset in the earphone equipment, and when the earphone equipment works with the coefficient of the second feedforward noise reduction filter, the frequency response of the corresponding second feedforward noise reduction filter can be determined. The second denoising frequency response at the k-th frequency point in the second frequency response data under the second feedforward denoising filter coefficient can be recorded as H ₂ (k) And the second feedforward noise reduction filter frequency response is denoted as F ₂ (k)。

Optionally, the calculation method of the second denoising frequency response is the same as that of the first denoising frequency response, and is not described again.

It should be noted that, when calculating the target frequency response of the feedforward noise reduction filter according to the first frequency response data and the second frequency response data, the calculation method may be:

assuming that the ideal feedforward target frequency response on the frequency point k is T (k), the denoising effects corresponding to different denoising frequency responses are as follows:

since other conditions are the same, the difference between different noise reduction frequency responses is:

thus, the calculated target frequency response is:

and calculating the target frequency response of the feedforward denoising filter under the ideal condition according to the frequency response of the feedforward denoising filter in the plurality of frequency response data and the denoising frequency response.

In the embodiment shown in fig. 4, the actual denoising frequency response of the headphone device during denoising with the second feedforward denoising filter coefficient can be determined, and the accuracy and the real-time performance of the second frequency response data are improved.

Optionally, referring to fig. 5, fig. 5 is a detailed flowchart illustrating a step S500 according to an embodiment of the present disclosure, where the method may include steps S510-S520.

Step S510, adjusting the current filter coefficient of the feedforward noise reduction filter according to the target frequency response to obtain an adjusted filter coefficient.

The current filter coefficient of the feedforward noise reduction filter can be optimized by adopting an optimization algorithm according to the calculated target frequency response under the ideal condition of the feedforward noise reduction filter, so that the corresponding adjustment filter coefficient is obtained.

Optionally, the optimization algorithm may be a gradient descent algorithm, a grid search algorithm, a neural network algorithm, or the like, and may reduce a difference between an actual frequency response and a target frequency response of the feedforward noise reduction filter.

In step S520, the feedforward noise reduction filter is configured to adjust the filter coefficients to work.

The coefficient of the adjusting filter of the feedforward noise reduction filter is configured to take effect, so that the feedforward noise reduction filter carries out filtering by the coefficient of the adjusting filter, carries out feedforward active noise reduction and other work by the actual frequency response close to the target frequency response, and effectively optimizes the noise reduction effect of the feedforward noise reduction filter.

Optionally, the feedforward noise reduction filter may be a filter of an IIR structure, which can reduce the delay condition of the system, or may be a filter of another structure.

In the embodiment shown in fig. 5, the noise reduction effect in the headphone device can be adaptively and iteratively calibrated and adjusted according to the specific wearing condition of the headphone device during the noise reduction process.

Optionally, referring to fig. 6, fig. 6 is a schematic flowchart of another noise reduction method for a headset according to an embodiment of the present application, where the method may further include steps S610 to S630.

Step S610, testing the feedforward noise reduction filter to adjust the first noise reduction effect of the front earphone device.

Before the feedforward noise reduction filter is adjusted, the earphone device can be configured to work in a feedforward active noise reduction mode of the unadjusted feedforward noise reduction filter, and a current corresponding first noise reduction effect is tested.

And S620, testing a second noise reduction effect of the earphone equipment after the feedforward noise reduction filter is adjusted.

After the feedforward noise reduction filter is adjusted, the earphone device is configured to work in a feedforward active noise reduction mode of the adjusted feedforward noise reduction filter, and a second noise reduction effect corresponding to the current time is tested.

Step S630, determining an optimization result of the headphone device according to the first noise reduction effect and the second noise reduction effect.

Wherein, two noise reduction effects obtained by the test can be compared to determine the optimization result of the earphone device. When the second noise reduction effect is better than the first noise reduction effect, the noise reduction result after calibration is improved compared with the noise reduction result before calibration, and the optimization result of the earphone equipment is successful; when the second noise reduction effect is lower than or equal to the first noise reduction effect, the calibrated noise reduction result has no improvement compared with the noise reduction result before calibration, and the optimization result of the headphone device is failure in optimization.

In the embodiment shown in fig. 6, the result of the noise reduction optimization performed by the headphone device can be determined, so as to determine whether the optimization of the headphone device is completed or whether the noise reduction effect of the headphone device needs to be continuously optimized according to the optimization result.

Referring to fig. 7, fig. 7 is a schematic structural diagram of a noise reduction apparatus for headphones according to an embodiment of the present disclosure, where the noise reduction apparatus 700 for headphones may include:

the first testing module 710 is configured to test first frequency response data corresponding to the headphone device when a feedforward noise reduction filter of the headphone device is set to be a first feedforward noise reduction filter coefficient;

the second testing module 720 is configured to test second frequency response data corresponding to the headphone device when the feedforward noise reduction filter of the headphone device is set to be a second feedforward noise reduction filter coefficient;

the calculating module 730 is configured to calculate a target frequency response of the feedforward noise reduction filter according to the first frequency response data and the second frequency response data;

an adjusting module 740 configured to adjust the feedforward noise reduction filter based on the target frequency response.

In an optional embodiment, the first testing module 710 may further include a first acquiring sub-module and a first determining sub-module;

the first acquisition submodule is used for acquiring first earphone data of the earphone equipment when a feedforward noise reduction filter of the earphone equipment is set to be a first feedforward noise reduction filter coefficient;

and the first determining submodule is used for determining first frequency response data corresponding to the earphone equipment according to the first earphone data and the first feedforward noise reduction filter coefficient.

In an alternative embodiment, the first headphone data includes first audio data and second audio data; the first acquisition submodule can also comprise a first acquisition unit and a second acquisition unit;

the earphone device comprises a first acquisition unit, a second acquisition unit and a control unit, wherein the first acquisition unit is used for acquiring first audio data of an in-ear microphone in the earphone device;

the second acquisition unit is used for acquiring second audio data of an ear microphone in the earphone device;

the first frequency response data comprises a first noise reduction frequency response and a first feedforward noise reduction filter frequency response; the first determining submodule is further used for calculating and obtaining a first noise reduction frequency response between the in-ear microphone and the out-of-ear microphone according to the first audio data and the second audio data; a first feedforward noise reduction filter frequency response is determined based on the first feedforward noise reduction filter coefficient.

In an optional embodiment, the second testing module 720 may further include a coefficient determining sub-module, a second collecting sub-module, and a second determining sub-module;

the coefficient determining submodule is used for determining a corresponding second feedforward noise reduction filter coefficient according to the first feedforward noise reduction filter coefficient;

the second acquisition submodule is used for acquiring second earphone data of the earphone equipment when the feedforward noise reduction filter of the earphone equipment is set to be a second feedforward noise reduction filter coefficient;

and the second determining submodule is used for determining second frequency response data corresponding to the earphone equipment according to the second earphone data and the second feedforward noise reduction filter coefficient.

In an alternative embodiment, the second headphone data includes third audio data and fourth audio data; the second acquisition submodule can also comprise a third acquisition unit and a fourth acquisition unit;

the third acquisition unit is used for acquiring third audio data of an in-ear microphone in the earphone device;

the fourth acquisition unit is used for acquiring fourth audio data of an ear microphone in the earphone device;

the second frequency response data comprises a second denoising frequency response and a second feedforward denoising filter frequency response; the second determining submodule is further used for calculating to obtain a second noise reduction frequency response between the in-ear microphone and the out-of-ear microphone according to the third audio data and the fourth audio data; and determining the frequency response of the second feedforward noise reduction filter according to the coefficient of the second feedforward noise reduction filter.

In an optional embodiment, the adjusting module 740 may further include an adjusting sub-module and a configuring sub-module;

the adjusting submodule is used for adjusting the current filter coefficient of the feedforward noise reduction filter according to the target frequency response to obtain an adjusting filter coefficient;

a configuration submodule configured to configure the feedforward noise reduction filter to adjust filter coefficients to operate.

In an optional embodiment, the headphone noise reduction apparatus 700 may further include an effect module and a comparison module;

the effect module is used for testing a first noise reduction effect of the feedforward noise reduction filter for adjusting the front earphone equipment; testing a second noise reduction effect of the earphone equipment after the feedforward noise reduction filter is adjusted;

and the comparison module is used for determining the optimization result of the earphone equipment according to the first noise reduction effect and the second noise reduction effect.

Since the principle of the noise reduction device 700 in the embodiment of the present application for solving the problem is similar to that of the embodiment of the noise reduction method for the earphone described above, the implementation of the noise reduction device 700 in the embodiment of the present application can refer to the description in the embodiment of the noise reduction method for the earphone described above, and repeated details are not repeated.

The embodiment of the present application further provides a computer-readable storage medium, where computer program instructions are stored in the computer-readable storage medium, and when the computer program instructions are read and executed by a processor, the steps in any one of the methods for reducing noise of an earphone provided in the embodiment are executed.

In summary, the embodiments of the present application provide a method and an apparatus for reducing noise of an earphone, an electronic device, and a computer-readable storage medium, in the noise reduction process, different coefficients of a feedforward noise reduction filter are set according to a specific wearing condition of the earphone for testing, and a target frequency response of the feedforward noise reduction filter under an ideal condition is determined according to a plurality of noise reduction frequency response data under different conditions, so as to adjust the feedforward noise reduction filter according to the target frequency response, thereby effectively improving the noise reduction effect of the earphone, and being suitable for various wearing conditions.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. The apparatus embodiments described above are merely illustrative, and for example, the block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of devices according to various embodiments of the present application. In this regard, each block in the block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams, and combinations of blocks in the block diagrams, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

In addition, functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.

The functions may be stored in a computer-readable storage medium if they are implemented in the form of software functional modules and sold or used as separate products. Based on such understanding, the technical solutions of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.

The above description is only an example of the present application and is not intended to limit the scope of the present application, and various modifications and changes may be made to the present application by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application. It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.

The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily think of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising 8230; \8230;" 8230; "does not exclude the presence of additional like elements in a process, method, article, or apparatus that comprises the element.

Claims

1. A method for reducing noise in a headphone, the method comprising:

2. The method of claim 1, wherein testing the headset device for corresponding first frequency response data while a feedforward noise reduction filter of the headset device is set to first feedforward noise reduction filter coefficients comprises:

when the feedforward noise reduction filter of the earphone equipment is set as a first feedforward noise reduction filter coefficient, acquiring first earphone data of the earphone equipment;

3. The method of claim 2, wherein the first headphone data comprises first audio data and second audio data; the acquiring first headphone data of the headphone device includes:

acquiring the first audio data of an in-ear microphone in the headphone device;

acquiring the second audio data of an off-ear microphone in the headset device;

the first frequency response data comprises a first noise reduction frequency response and a first feedforward noise reduction filter frequency response; the determining the first frequency response data corresponding to the headphone device according to the first headphone data and the first feedforward noise reduction filter coefficient includes:

4. The method of claim 1, wherein testing the corresponding second frequency response data of the headphone device while the feedforward noise reduction filter of the headphone device is set to the second feedforward noise reduction filter coefficient comprises:

5. The method of claim 4, wherein the second headphone data comprises third audio data and fourth audio data; the acquiring second headphone data of the headphone device includes:

acquiring the third audio data of an in-ear microphone in the headphone device;

acquiring the fourth audio data of an out-of-ear microphone in the headset device;

6. The method of claim 1, wherein said adjusting the feedforward noise reduction filter based on the target frequency response comprises:

7. The method of claim 1, further comprising:

8. An apparatus for reducing noise in a headphone, the apparatus comprising:

9. An electronic device, comprising a memory having stored therein program instructions and a processor that, when executed, performs the steps of the method of any one of claims 1-7.

10. A computer-readable storage medium having computer program instructions stored thereon for execution by a processor to perform the steps of the method of any one of claims 1-7.