CN111540372B - Method and device for noise reduction processing of multi-microphone array - Google Patents
Method and device for noise reduction processing of multi-microphone array Download PDFInfo
- Publication number
- CN111540372B CN111540372B CN202010346678.0A CN202010346678A CN111540372B CN 111540372 B CN111540372 B CN 111540372B CN 202010346678 A CN202010346678 A CN 202010346678A CN 111540372 B CN111540372 B CN 111540372B
- Authority
- CN
- China
- Prior art keywords
- reference signal
- ith
- signals
- microphone array
- updated
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012545 processing Methods 0.000 title claims abstract description 52
- 230000009467 reduction Effects 0.000 title claims abstract description 41
- 238000000034 method Methods 0.000 title claims abstract description 28
- 238000012937 correction Methods 0.000 claims description 6
- 238000007781 pre-processing Methods 0.000 claims description 6
- 238000004422 calculation algorithm Methods 0.000 abstract description 27
- 230000000875 corresponding effect Effects 0.000 description 11
- 230000003044 adaptive effect Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 10
- 230000006870 function Effects 0.000 description 10
- 238000004590 computer program Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 6
- 230000000694 effects Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000004075 alteration Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000002596 correlated effect Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
- G10L2021/02166—Microphone arrays; Beamforming
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Quality & Reliability (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The embodiment of the application provides a method and a device for noise reduction processing of a multi-microphone array, wherein the method comprises the steps of obtaining m reference signals of the multi-microphone array, updating weight parameters of an ith reference signal in the m reference signals of the multi-microphone array according to preset interval moments to obtain updated weight parameters of the ith reference signal, determining output noise signals of the ith reference signal according to the updated weight parameters of the ith reference signal and the ith reference signal, and determining output noise signals of reference signals without updated weight parameters in the m reference signals according to the weight parameters of reference signals without updated weight parameters in the m reference signals and the reference signals without updated weight parameters in the m reference signals. The weight parameters of the current reference signals are updated in a preset interval time mode, so that the number of times of updating the weight parameters can be reduced, and the calculated amount of the multi-microphone array noise reduction algorithm in the prior art is reduced.
Description
Technical Field
The embodiment of the application relates to the technical field of information, in particular to a method and a device for noise reduction processing of a multi-microphone array.
Background
Wake-up is one of the application processes of the smart device and its important functions. In general, in order to improve the voice wake-up rate in a strong noise environment, a simple single-microphone noise reduction is often not required, and in order to improve the voice wake-up rate of the system in a strong noise environment, multiple microphones are required to perform noise reduction processing. However, when the current beam-based multi-microphone noise reduction algorithm is implemented, the multi-channel noise reduction algorithm is divided into a plurality of channels to perform independent signal processing, and each channel is used for realizing noise reduction according to the adaptive filter noise reduction algorithm, but each frame of each channel is updated with weight, so that the complexity of signal processing is greatly improved while the performance is improved relative to that of a single microphone, the calculated amount of the noise reduction algorithm is increased, and the requirement on product hardware is higher due to the improvement of the complexity.
In summary, there is a need for a method for reducing noise in a multi-microphone array, which is used to reduce the amount of computation of the noise reduction algorithm in the prior art.
Disclosure of Invention
The embodiment of the application provides a method and a device for multi-microphone array noise reduction processing, which are used for reducing the calculated amount of a multi-microphone array noise reduction algorithm in the prior art.
In a first aspect, an embodiment of the present application provides a method for noise reduction processing of a multi-microphone array, including:
obtaining m reference signals of a multi-microphone array, wherein the m reference signals of the multi-microphone array are obtained by performing Fourier transform on m original voice signals collected by the multi-microphone array and preprocessing and determining the m original voice signals; m is an integer greater than or equal to 2;
updating the weight parameter of the ith reference signal in m reference signals of the multi-microphone array according to a preset interval moment to obtain the updated weight parameter of the ith reference signal, wherein i is an integer which is more than or equal to 1 and less than or equal to m;
determining an output noise signal of the ith reference signal according to the weight parameter of the ith reference signal after updating and the ith reference signal, and determining an output noise signal of a reference signal without updating weight parameters in the m reference signals according to the weight parameters of the reference signal without updating weight parameters in the m reference signals and the reference signal without updating weight parameters in the m reference signals;
and processing the m original voice signals of the multi-microphone array according to the output noise signal of the ith reference signal and the output noise signal of the reference signal of which the weight parameter is not updated in the m reference signals to obtain m target voice signals of the multi-microphone array.
According to the technical scheme, the weight parameters of the ith reference signal in the m reference signals of the multi-microphone array are updated according to preset interval moments, the updated weight parameters of the ith reference signal are obtained, the output noise signals of the ith reference signal are determined according to the updated weight parameters of the ith reference signal and the ith reference signal, the output noise signals of the reference signals without updated weight parameters in the m reference signals and the reference signals without updated weight parameters in the m reference signals are determined, and then the m original voice signals of the multi-microphone array are processed according to the output noise signals of the ith reference signal and the output noise signals of the reference signals without updated weight parameters in the m reference signals, so that the m target voice signals of the multi-microphone array are obtained. The weight parameters of the current reference signals are updated according to the preset interval time, so that the updating times of the weight parameters can be effectively reduced, the problem that the weight parameters are updated at each time of each reference signal in the prior art can be solved, and the calculated amount of the multi-microphone array noise reduction algorithm in the prior art is reduced.
Optionally, the m reference signals of the multi-microphone array correspond to m filters;
the updating the weight parameter of the ith reference signal in the m reference signals of the multiple microphones according to the preset interval time comprises the following steps:
sequentially determining an ith reference signal to be updated at the current moment from m reference signals of the multi-microphone array according to preset interval moments;
updating the weight parameter of the ith filter in the m filters according to the ith reference signal to be updated;
determining weight parameters of the ith filter according to formula (1);
the formula (1) is:
wherein w (k+1) is a weight parameter of the ith filter at k+1, w (k) is a weight parameter of the ith filter at k, x (k) is the ith reference signal to be updated at k, alpha is a correction constant, mu is an iteration step factor, e * (k) And the error voice signal of the ith filter at the k moment is obtained.
According to the technical scheme, the ith reference signal to be updated at the current moment is determined from the m reference signals of the multi-microphone array in sequence according to the preset interval moment, and the weight parameter of the ith filter in the m filters is updated according to the ith reference signal to be updated by an updating formula of the weight parameter of the ith filter, so that the updating times of the weight parameter of the filter can be effectively reduced, the problem that the weight parameter is updated at each moment of each reference signal in the prior art can be solved, and the calculated amount of the multi-microphone array noise reduction algorithm in the prior art is reduced.
Optionally, the determining the output noise signal of the reference signal with the non-updated weight parameter in the m reference signals according to the weight parameter of the reference signal with the non-updated weight parameter in the m reference signals includes:
when the weight parameter of the ith reference signal is updated, determining output noise signals corresponding to the reference signals with the weight parameters which are not updated in the m reference signals according to the weight parameters corresponding to the time before the updating time by the reference signals with the weight parameters which are not updated in the m reference signals.
In the above technical solution, when the weight parameter of the ith reference signal is updated, the reference signals of which the weight parameters are not updated in the m reference signals determine output noise signals corresponding to the reference signals of which the weight parameters are not updated in the m reference signals according to the weight parameters corresponding to the time before the update time. When the weight parameter of the ith reference signal is updated, the weight parameters before the current moment are adopted by other reference signals without updated weight parameters, so that the updating times of the weight parameters of the filter are reduced, and the calculated amount of a noise reduction algorithm can be greatly reduced.
Optionally, the processing the m original voice signals of the multi-microphone array according to the output noise signal of the ith reference signal and the output noise signal of the reference signal with the weight parameter not updated in the m reference signals to obtain m target voice signals of the multi-microphone array includes:
and eliminating noise signals in m original voice signals of the multi-microphone array according to the output noise signal of the ith reference signal and the output noise signal of the reference signal of which the weight parameter is not updated in the m reference signals, so as to obtain m target voice signals of the multi-microphone array.
In the above technical solution, by performing the cancellation processing on the noise signals in the m original voice signals of the multi-microphone array according to the output noise signal of the ith reference signal and the output noise signal of the reference signal of the m reference signals, where the weight parameter is not updated, noise signal interference in the non-target direction in the m original voice signals of the multi-microphone array can be cancelled, so that useful m target voice signals are obtained.
In a second aspect, an embodiment of the present application further provides an apparatus for noise reduction processing of a multi-microphone array, including:
the acquisition unit is used for acquiring m reference signals of the multi-microphone array, wherein the m reference signals of the multi-microphone array are obtained by carrying out Fourier transform on m original voice signals acquired by the multi-microphone array and carrying out preprocessing determination; m is an integer greater than or equal to 2;
the processing unit is used for updating the weight parameter of the ith reference signal in the m reference signals of the multi-microphone array according to preset interval moments to obtain the updated weight parameter of the ith reference signal, wherein i is an integer which is more than or equal to 1 and less than or equal to m; determining an output noise signal of the ith reference signal according to the weight parameter of the ith reference signal after updating and the ith reference signal, and determining an output noise signal of a reference signal without updating weight parameters in the m reference signals according to the weight parameters of the reference signal without updating weight parameters in the m reference signals and the reference signal without updating weight parameters in the m reference signals; and processing the m original voice signals of the multi-microphone array according to the output noise signal of the ith reference signal and the output noise signal of the reference signal of which the weight parameter is not updated in the m reference signals to obtain m target voice signals of the multi-microphone array.
Optionally, the m reference signals of the multi-microphone array correspond to m filters;
the processing unit is specifically configured to:
sequentially determining an ith reference signal to be updated at the current moment from m reference signals of the multi-microphone array according to preset interval moments;
updating the weight parameter of the ith filter in the m filters according to the ith reference signal to be updated;
determining weight parameters of the ith filter according to formula (1);
the formula (1) is:
wherein w (k+1) is a weight parameter of the ith filter at k+1, w (k) is a weight parameter of the ith filter at k, x (k) is the ith reference signal to be updated at k, alpha is a correction constant, mu is an iteration step factor, e * (k) And the error voice signal of the ith filter at the k moment is obtained.
Optionally, the processing unit is specifically configured to:
when the weight parameter of the ith reference signal is updated, determining output noise signals corresponding to the reference signals with the weight parameters which are not updated in the m reference signals according to the weight parameters corresponding to the time before the updating time by the reference signals with the weight parameters which are not updated in the m reference signals.
Optionally, the processing unit is specifically configured to:
and eliminating noise signals in m original voice signals of the multi-microphone array according to the output noise signal of the ith reference signal and the output noise signal of the reference signal of which the weight parameter is not updated in the m reference signals, so as to obtain m target voice signals of the multi-microphone array.
In a third aspect, embodiments of the present application provide a computing device comprising:
a memory for storing program instructions;
and the processor is used for calling the program instructions stored in the memory and executing the method of the multi-microphone array noise reduction processing according to the obtained program.
In a fourth aspect, embodiments of the present application provide a computer-readable storage medium storing computer-executable instructions for causing a computer to perform a method of multi-microphone array noise reduction processing.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of a system architecture according to an embodiment of the present application;
fig. 2 is a schematic flow chart of a method for noise reduction processing of a multi-microphone array according to an embodiment of the present application;
FIG. 3 is a schematic diagram of an adaptive filter algorithm according to an embodiment of the present application;
fig. 4 is a schematic diagram of processing a reference signal in an adaptive filter according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of a device for noise reduction processing of a multi-microphone array according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be described in further detail below with reference to the accompanying drawings, and it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
Fig. 1 is a system architecture according to an embodiment of the present application. As shown in fig. 1, the system architecture may be a server 100 including a processor 110, a communication interface 120, and a memory 130.
The communication interface 120 is used for communicating with a terminal device, receiving and transmitting information transmitted by the terminal device, and realizing communication.
The processor 110 is a control center of the server 100, connects various parts of the entire server 100 using various interfaces and lines, and performs various functions of the server 100 and processes data by running or executing software programs and/or modules stored in the memory 130, and calling data stored in the memory 130. Optionally, the processor 110 may include one or more processing units.
The memory 130 may be used to store software programs and modules, and the processor 110 performs various functional applications and data processing by executing the software programs and modules stored in the memory 130. The memory 130 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, application programs required for at least one function, and the like; the storage data area may store data created according to business processes, etc. In addition, memory 130 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.
It should be noted that the structure shown in fig. 1 is merely an example, and the embodiment of the present application is not limited thereto.
Based on the above description, fig. 2 illustrates a flow of a method for multi-microphone array noise reduction processing according to an embodiment of the present application, where the flow may be performed by an apparatus for multi-microphone array noise reduction processing.
As shown in fig. 2, the process specifically includes:
in step 201, m reference signals of a multi-microphone array are acquired.
In the embodiment of the application, m reference signals of the multi-microphone array are determined by carrying out Fourier transform and preprocessing on m original voice signals acquired by the multi-microphone array; m is an integer of 2 or more. Wherein, the multi-microphone array refers to an arrangement group comprising a plurality of microphones; fourier transforms, which can represent a function satisfying certain conditions as a trigonometric function (sine and/or cosine function) or a linear combination of their integrals, can transform a time domain signal, which is originally difficult to process, into a frequency domain signal, which is easy to analyze, and in different fields, fourier transforms have a variety of different forms, such as continuous fourier transforms and discrete fourier transforms.
Step 202, updating the weight parameter of the ith reference signal in the m reference signals of the multi-microphone array according to a preset interval time to obtain the updated weight parameter of the ith reference signal.
In the embodiment of the application, according to preset interval time, an ith reference signal to be updated at the current time is determined from m reference signals of a multi-microphone array in sequence, and the weight parameter of the ith filter in the m filters is updated according to the ith reference signal to be updated, so that the weight parameter of the ith reference signal after updating is obtained.
Determining a weight parameter of an ith filter according to a formula (1), wherein the formula (1) is as follows:
wherein w (k+1) is the weight parameter of the ith filter at k+1 time, w (k) is the weight parameter of the ith filter at k time, x (k) is the ith reference signal to be updated at k time, alpha is a correction constant, mu is an iteration step factor, e * (k) Is the error speech signal of the ith filter at time k.
Specifically, the multi-microphone array noise reduction algorithm is implemented by dividing the multi-microphone array noise reduction algorithm into a plurality of channels for separate signal processing, and each channel is used for noise reduction according to an adaptive filter algorithm, such as NLMS (Normalized Least Mean Square Algorithm, normalized minimum mean square error) algorithm. Furthermore, an adaptive filterThe principle of the algorithm is shown in FIG. 3, i.e. the signal s (k) is transmitted along the channel to a multi-microphone array which receives an uncorrelated noise field n in addition to the useful signal s (k) from the source 0 (k) The original input is s (k) +n 0 (k) The reference input signal is n 1 (k) And n 0 (k) And is correlated and uncorrelated with the signal being s (k). The adaptive filter receives control of the error e (k), adjusts the weighting parameter w (k) such that its output y (k) tends to or equals its associated n in d (k) 0 (k) The difference between the outputs e (k) as d (k) and y (k) is then approximately equal to the s (k) signal. The self-adaptive filter is an algorithm or device which uses the estimation of the statistical characteristics of input and output signals as the basis and adopts a specific algorithm to automatically adjust the weight parameters of the filter so as to achieve the optimal filtering characteristic, and mainly comprises a filter structure and a self-adaptive algorithm. In addition, the form of inputting the reference signal into the adaptive filter for processing is as shown in fig. 4, and the calculation steps for noise reduction according to the NLMS algorithm are as follows:
step1: given w (0).
Step2: calculating the output value y (k) =w (k) of the adaptive filter T *x(k)。
Step3: error speech signal e (k) =d (k) -y (k) is calculated.
Step4: and updating the weight parameters of the adaptive filter according to the formula (1) at preset interval moments.
For example, when there are N paths of signals, the NLMS algorithm does not need to update the weight parameters for each frame of each channel, but may update the weight parameters of the current path in a frame-by-frame or frame-by-frame manner. The purpose of reducing the calculated amount is realized by updating the w value of only one channel per frame, if 5 paths of signals are respectively 1,2,3,4 and 5 paths, at the time t=0, the algorithm only updates the w value of the first path, the w values of other paths are not updated, at the time t=1, only the w value of the second path is updated, the w values of other paths are not updated, and the like, at the time t=5, only the w value of the fifth path is updated, and the w values of other paths are not updated, so that the calculated amount of the algorithm is reduced from the original 5N to N in the NLMS algorithm calculation part. Wherein the frame interval corresponds to one time, and the frame interval corresponds to several times.
It should be noted that, for N channels, instead of every N channels, each channel may be calculated once every 2N times, so long as the noise reduction effect is satisfied, the longer the interval, the lower the calculated amount, the noise reduction effect will have a certain effect, and a compromise needs to be taken.
Step 203, determining an output noise signal of the ith reference signal according to the updated weight parameter of the ith reference signal and the ith reference signal, and determining an output noise signal of a reference signal with no updated weight parameter in the m reference signals according to the weight parameter of the reference signal with no updated weight parameter in the m reference signals and the reference signal with no updated weight parameter in the m reference signals.
In the embodiment of the application, according to the updated weight parameter of the ith reference signal and the ith reference signal, determining the output noise signal of the ith reference signal, and when the weight parameter of the ith reference signal is updated, determining the output noise signal corresponding to the reference signal with the weight parameter which is not updated in the m reference signals according to the weight parameter corresponding to the moment before the updating moment in the m reference signals. When the weight parameters are calculated, the weight parameters of the adaptive filters corresponding to the reference signals are not required to be calculated each time, and the weight parameters before the previous frames can be adopted by the current frame, so that the calculated amount of a noise reduction algorithm can be greatly reduced, and the influence on the noise reduction effect is small.
And 204, processing the m original voice signals of the multi-microphone array according to the output noise signal of the ith reference signal and the output noise signal of the reference signal of which the weight parameter is not updated in the m reference signals to obtain m target voice signals of the multi-microphone array.
In the embodiment of the application, according to the output noise signal of the ith reference signal and the output noise signal of the reference signal of which the weight parameter is not updated in the m reference signals, noise signals in the non-target direction in the m original voice signals of the multi-microphone array are eliminated, so that m target voice signals of the multi-microphone array are obtained.
The above embodiment shows that, by updating the weight parameter of the ith reference signal in the m reference signals of the multi-microphone array according to the preset interval time, the weight parameter of the ith reference signal after updating is obtained, then the output noise signal of the ith reference signal is determined according to the weight parameter of the ith reference signal after updating and the ith reference signal, and the output noise signal of the reference signal without updating the weight parameter in the m reference signals and the reference signal without updating the weight parameter in the m reference signals are determined, and then the m original speech signals of the multi-microphone array are processed according to the output noise signal of the ith reference signal and the output noise signal of the reference signal without updating the weight parameter in the m reference signals, so as to obtain the m target speech signals of the multi-microphone array. The weight parameters of the current reference signals are updated according to the preset interval time, so that the updating times of the weight parameters can be effectively reduced, the problem that the weight parameters are updated at each time of each reference signal in the prior art can be solved, and the calculated amount of the multi-microphone array noise reduction algorithm in the prior art is reduced.
Based on the same technical concept, fig. 5 illustrates an apparatus for multi-microphone array noise reduction processing according to an embodiment of the present application, which may perform a flow of a method for multi-microphone array noise reduction processing.
As shown in fig. 5, the apparatus includes:
an obtaining unit 501, configured to obtain m reference signals of a multi-microphone array, where the m reference signals of the multi-microphone array are determined by performing fourier transform and preprocessing on m original speech signals acquired by the multi-microphone array; m is an integer greater than or equal to 2;
a processing unit 502, configured to update a weight parameter of an i-th reference signal in m reference signals of the multi-microphone array according to a preset interval time, to obtain an updated weight parameter of the i-th reference signal, where i is an integer greater than or equal to 1 and less than or equal to m; determining an output noise signal of the ith reference signal according to the weight parameter of the ith reference signal after updating and the ith reference signal, and determining an output noise signal of a reference signal without updating weight parameters in the m reference signals according to the weight parameters of the reference signal without updating weight parameters in the m reference signals and the reference signal without updating weight parameters in the m reference signals; and processing the m original voice signals of the multi-microphone array according to the output noise signal of the ith reference signal and the output noise signal of the reference signal of which the weight parameter is not updated in the m reference signals to obtain m target voice signals of the multi-microphone array.
Optionally, the m reference signals of the multi-microphone array correspond to m filters;
the processing unit 502 is specifically configured to:
sequentially determining an ith reference signal to be updated at the current moment from m reference signals of the multi-microphone array according to preset interval moments;
updating the weight parameter of the ith filter in the m filters according to the ith reference signal to be updated;
determining weight parameters of the ith filter according to formula (1);
the formula (1) is:
wherein w (k+1) is a weight parameter of the ith filter at k+1, w (k) is a weight parameter of the ith filter at k, x (k) is the ith reference signal to be updated at k, alpha is a correction constant, mu is an iteration step factor, e * (k) And the error voice signal of the ith filter at the k moment is obtained.
Optionally, the processing unit 502 is specifically configured to:
when the weight parameter of the ith reference signal is updated, determining output noise signals corresponding to the reference signals with the weight parameters which are not updated in the m reference signals according to the weight parameters corresponding to the time before the updating time by the reference signals with the weight parameters which are not updated in the m reference signals.
Optionally, the processing unit 502 is specifically configured to:
and eliminating noise signals in m original voice signals of the multi-microphone array according to the output noise signal of the ith reference signal and the output noise signal of the reference signal of which the weight parameter is not updated in the m reference signals, so as to obtain m target voice signals of the multi-microphone array.
Based on the same technical idea, an embodiment of the present application provides a computing device including:
a memory for storing program instructions;
and the processor is used for calling the program instructions stored in the memory and executing the method of the multi-microphone array noise reduction processing according to the obtained program.
Based on the same technical idea, the embodiments of the present application provide a computer-readable storage medium storing computer-executable instructions for causing a computer to perform a method of multi-microphone array noise reduction processing.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present application have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiments and all such alterations and modifications as fall within the scope of the application.
It will be apparent to those skilled in the art that various modifications and variations can be made to the present application without departing from the spirit or scope of the application. Thus, it is intended that the present application also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.
Claims (8)
1. A method for multi-microphone array noise reduction processing, comprising:
obtaining m reference signals of a multi-microphone array, wherein the m reference signals of the multi-microphone array are obtained by performing Fourier transform on m original voice signals collected by the multi-microphone array and preprocessing and determining the m original voice signals; m is an integer greater than or equal to 2;
updating the weight parameter of the ith reference signal in m reference signals of the multi-microphone array according to a preset interval moment to obtain the updated weight parameter of the ith reference signal, wherein i is an integer which is more than or equal to 1 and less than or equal to m;
determining an output noise signal of the ith reference signal according to the weight parameter of the ith reference signal after updating and the ith reference signal, and determining an output noise signal of a reference signal without updating weight parameters in the m reference signals according to the weight parameters of the reference signal without updating weight parameters in the m reference signals and the reference signal without updating weight parameters in the m reference signals;
processing m original voice signals of the multi-microphone array according to the output noise signal of the ith reference signal and the output noise signal of the reference signal of which the weight parameter is not updated in the m reference signals to obtain m target voice signals of the multi-microphone array;
m reference signals of the multi-microphone array correspond to m filters;
the updating the weight parameter of the ith reference signal in the m reference signals of the multiple microphones according to the preset interval time comprises the following steps:
sequentially determining an ith reference signal to be updated at the current moment from m reference signals of the multi-microphone array according to preset interval moments;
updating the weight parameter of the ith filter in the m filters according to the ith reference signal to be updated;
determining weight parameters of the ith filter according to formula (1);
the formula (1) is:
wherein w (k+1) is a weight parameter of the ith filter at k+1, w (k) is a weight parameter of the ith filter at k, x (k) is the ith reference signal to be updated at k, alpha is a correction constant, mu is an iteration step factor, e * (k) And the error voice signal of the ith filter at the k moment is obtained.
2. The method of claim 1, wherein the determining the output noise signal of the reference signal of the m reference signals for which the weight parameter is not updated based on the weight parameter of the reference signal of the m reference signals for which the weight parameter is not updated comprises:
when the weight parameter of the ith reference signal is updated, determining output noise signals corresponding to the reference signals with the weight parameters which are not updated in the m reference signals according to the weight parameters corresponding to the time before the updating time by the reference signals with the weight parameters which are not updated in the m reference signals.
3. The method according to any one of claims 1 to 2, wherein the processing the m original speech signals of the multi-microphone array according to the output noise signal of the i-th reference signal and the output noise signal of the reference signal of the m reference signals, in which the weight parameter is not updated, to obtain m target speech signals of the multi-microphone array includes:
and eliminating noise signals in m original voice signals of the multi-microphone array according to the output noise signal of the ith reference signal and the output noise signal of the reference signal of which the weight parameter is not updated in the m reference signals, so as to obtain m target voice signals of the multi-microphone array.
4. An apparatus for multi-microphone array noise reduction processing, comprising:
the acquisition unit is used for acquiring m reference signals of the multi-microphone array, wherein the m reference signals of the multi-microphone array are obtained by carrying out Fourier transform on m original voice signals acquired by the multi-microphone array and carrying out preprocessing determination; m is an integer greater than or equal to 2;
the processing unit is used for updating the weight parameter of the ith reference signal in the m reference signals of the multi-microphone array according to preset interval moments to obtain the updated weight parameter of the ith reference signal, wherein i is an integer which is more than or equal to 1 and less than or equal to m; determining an output noise signal of the ith reference signal according to the weight parameter of the ith reference signal after updating and the ith reference signal, and determining an output noise signal of a reference signal without updating weight parameters in the m reference signals according to the weight parameters of the reference signal without updating weight parameters in the m reference signals and the reference signal without updating weight parameters in the m reference signals; processing m original voice signals of the multi-microphone array according to the output noise signal of the ith reference signal and the output noise signal of the reference signal of which the weight parameter is not updated in the m reference signals to obtain m target voice signals of the multi-microphone array;
m reference signals of the multi-microphone array correspond to m filters;
the processing unit is specifically configured to:
sequentially determining an ith reference signal to be updated at the current moment from m reference signals of the multi-microphone array according to preset interval moments;
updating the weight parameter of the ith filter in the m filters according to the ith reference signal to be updated;
determining weight parameters of the ith filter according to formula (1);
the formula (1) is:
wherein w (k+1) is a weight parameter of the ith filter at k+1, w (k) is a weight parameter of the ith filter at k, x (k) is the ith reference signal to be updated at k, alpha is a correction constant, mu is an iteration step factor, e * (k) And the error voice signal of the ith filter at the k moment is obtained.
5. The apparatus of claim 4, wherein the processing unit is specifically configured to:
when the weight parameter of the ith reference signal is updated, determining output noise signals corresponding to the reference signals with the weight parameters which are not updated in the m reference signals according to the weight parameters corresponding to the time before the updating time by the reference signals with the weight parameters which are not updated in the m reference signals.
6. The apparatus according to any one of claims 4 to 5, wherein the processing unit is specifically configured to:
and eliminating noise signals in m original voice signals of the multi-microphone array according to the output noise signal of the ith reference signal and the output noise signal of the reference signal of which the weight parameter is not updated in the m reference signals, so as to obtain m target voice signals of the multi-microphone array.
7. A computing device, comprising:
a memory for storing program instructions;
a processor for invoking program instructions stored in said memory and for performing the method according to any of claims 1 to 3 in accordance with the obtained program.
8. A computer-readable storage medium storing computer-executable instructions for causing a computer to perform the method of any one of claims 1 to 3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010346678.0A CN111540372B (en) | 2020-04-28 | 2020-04-28 | Method and device for noise reduction processing of multi-microphone array |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010346678.0A CN111540372B (en) | 2020-04-28 | 2020-04-28 | Method and device for noise reduction processing of multi-microphone array |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111540372A CN111540372A (en) | 2020-08-14 |
| CN111540372B true CN111540372B (en) | 2023-09-12 |
Family
ID=71978893
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010346678.0A Active CN111540372B (en) | 2020-04-28 | 2020-04-28 | Method and device for noise reduction processing of multi-microphone array |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111540372B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1851806A (en) * | 2006-05-30 | 2006-10-25 | 北京中星微电子有限公司 | Adaptive microphone array system and its voice signal processing method |
| CN106373588A (en) * | 2016-09-05 | 2017-02-01 | 广东顺德中山大学卡内基梅隆大学国际联合研究院 | Adaptive microphone array calibration method based on variable step NLMS algorithm |
| JP2018072771A (en) * | 2016-11-04 | 2018-05-10 | 株式会社ヤクルト本社 | Active silencer |
| CN108172231A (en) * | 2017-12-07 | 2018-06-15 | 中国科学院声学研究所 | A kind of dereverberation method and system based on Kalman filtering |
| CN108390663A (en) * | 2018-03-09 | 2018-08-10 | 电信科学技术研究院有限公司 | A kind of update method and device of finite impulse response filter coefficient vector |
| CN110599996A (en) * | 2019-09-09 | 2019-12-20 | 电子科技大学 | Active noise control system using upper computer for real-time off-line updating |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012014451A1 (en) * | 2010-07-26 | 2012-02-02 | パナソニック株式会社 | Multi-input noise suppresion device, multi-input noise suppression method, program, and integrated circuit |
| JP7162242B2 (en) * | 2018-10-15 | 2022-10-28 | パナソニックＩｐマネジメント株式会社 | ACTIVE NOISE REDUCTION DEVICE, MOBILE DEVICE, AND ACTIVE NOISE REDUCTION METHOD |
| CN109616136B (en) * | 2018-12-21 | 2020-01-17 | 出门问问信息科技有限公司 | Adaptive beam forming method, device and system |
| CN110335582B (en) * | 2019-07-11 | 2023-12-19 | 吉林大学 | Active noise reduction method suitable for impulse noise active control |
-
2020
- 2020-04-28 CN CN202010346678.0A patent/CN111540372B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1851806A (en) * | 2006-05-30 | 2006-10-25 | 北京中星微电子有限公司 | Adaptive microphone array system and its voice signal processing method |
| CN106373588A (en) * | 2016-09-05 | 2017-02-01 | 广东顺德中山大学卡内基梅隆大学国际联合研究院 | Adaptive microphone array calibration method based on variable step NLMS algorithm |
| JP2018072771A (en) * | 2016-11-04 | 2018-05-10 | 株式会社ヤクルト本社 | Active silencer |
| CN108172231A (en) * | 2017-12-07 | 2018-06-15 | 中国科学院声学研究所 | A kind of dereverberation method and system based on Kalman filtering |
| CN108390663A (en) * | 2018-03-09 | 2018-08-10 | 电信科学技术研究院有限公司 | A kind of update method and device of finite impulse response filter coefficient vector |
| CN110599996A (en) * | 2019-09-09 | 2019-12-20 | 电子科技大学 | Active noise control system using upper computer for real-time off-line updating |
Non-Patent Citations (1)
| Title |
|---|
| 赵贤宇,王作英.用于语音识别的鲁棒自适应麦克风阵列算法.清华大学学报(自然科学版).(第10期),第1433-1436页. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111540372A (en) | 2020-08-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7018130B2 (en) | Echo cancellation method and equipment based on delay time estimation | |
| CN109767783B (en) | Voice enhancement method, device, equipment and storage medium | |
| CN110634500B (en) | Method for calculating prior signal-to-noise ratio, electronic device and storage medium | |
| US10755728B1 (en) | Multichannel noise cancellation using frequency domain spectrum masking | |
| CN111429932A (en) | Voice noise reduction method, device, equipment and medium | |
| US9036816B1 (en) | Frequency domain acoustic echo cancellation using filters and variable step-size updates | |
| CN106601266A (en) | Echo cancellation method, device and system | |
| CN112602150A (en) | Noise estimation method, noise estimation device, voice processing chip and electronic equipment | |
| CN111540372B (en) | Method and device for noise reduction processing of multi-microphone array | |
| CN117318671B (en) | Self-adaptive filtering method based on fast Fourier transform | |
| CN107969164B (en) | Adaptive inter-channel discrimination rescaling filter | |
| CN117594053A (en) | Voice noise reduction method, processing terminal and storage medium | |
| CN111599374B (en) | Single-channel voice dereverberation method and device | |
| CN112420066B (en) | Noise reduction method, device, computer equipment and computer readable storage medium | |
| CN108510996B (en) | Fast iteration adaptive filtering method | |
| US9159336B1 (en) | Cross-domain filtering for audio noise reduction | |
| JP6625198B2 (en) | Divided block frequency domain adaptive filter device including adaptive filter module and correction module | |
| CN111968620A (en) | Algorithm testing method and device, electronic equipment and storage medium | |
| CN108039179B (en) | Efficient self-adaptive algorithm for microphone array generalized sidelobe canceller | |
| CN105957534B (en) | Adaptive filter method and sef-adapting filter | |
| EP4199368A1 (en) | Adaptive delay diversity filter, and echo cancelling device and method using same | |
| CN110648681B (en) | Speech enhancement method, device, electronic equipment and computer readable storage medium | |
| CN110232905B (en) | Uplink noise reduction method and device and electronic equipment | |
| CN114360566A (en) | Noise reduction processing method and device for voice signal and storage medium | |
| CN110677782B (en) | Signal adaptive noise filter |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |