US20150372723A1 - Method and apparatus for mitigating feedback in a digital radio receiver - Google Patents
Method and apparatus for mitigating feedback in a digital radio receiver Download PDFInfo
- Publication number
- US20150372723A1 US20150372723A1 US14/653,776 US201214653776A US2015372723A1 US 20150372723 A1 US20150372723 A1 US 20150372723A1 US 201214653776 A US201214653776 A US 201214653776A US 2015372723 A1 US2015372723 A1 US 2015372723A1
- Authority
- US
- United States
- Prior art keywords
- energy
- band
- frequency
- determining
- feedback
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims description 98
- 230000000116 mitigating effect Effects 0.000 title claims description 5
- 230000005236 sound signal Effects 0.000 claims abstract description 39
- 230000009467 reduction Effects 0.000 claims abstract description 17
- 230000007774 longterm Effects 0.000 claims description 8
- 238000009499 grossing Methods 0.000 claims description 3
- 230000003044 adaptive effect Effects 0.000 abstract description 8
- 230000008569 process Effects 0.000 description 53
- 238000011156 evaluation Methods 0.000 description 17
- 238000001514 detection method Methods 0.000 description 15
- 238000010586 diagram Methods 0.000 description 12
- 230000001172 regenerating effect Effects 0.000 description 8
- 230000008901 benefit Effects 0.000 description 7
- 238000004364 calculation method Methods 0.000 description 7
- 230000002688 persistence Effects 0.000 description 7
- 238000013459 approach Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 238000006243 chemical reaction Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 230000035945 sensitivity Effects 0.000 description 3
- 238000001228 spectrum Methods 0.000 description 3
- 238000007796 conventional method Methods 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 239000013589 supplement Substances 0.000 description 2
- 230000001629 suppression Effects 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 230000005534 acoustic noise Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000003292 diminished effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000005284 excitation Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 239000000047 product Substances 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000012109 statistical procedure Methods 0.000 description 1
- 230000002459 sustained effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B7/00—Radio transmission systems, i.e. using radiation field
- H04B7/015—Reducing echo effects
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L21/0232—Processing in the frequency domain
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L2021/02082—Noise filtering the noise being echo, reverberation of the speech
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M9/00—Arrangements for interconnection not involving centralised switching
- H04M9/08—Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic
- H04M9/082—Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic using echo cancellers
Definitions
- the present disclosure relates generally to mitigating feedback, and more particularly to detecting the onset of acoustic-sourced feedback in a digital radio receiver and applying suppressive filtering to mitigate and reduce the feedback.
- Feedback in audio systems is caused by the output signal coupling to an input through an acoustic path, creating a regenerative signal in the loop that results in an undesirable sound. It occurs in all types of systems, from simple public address systems to sophisticated wireless radio communication systems.
- the conventional ways of dealing with feedback sound include several approaches. One approach is physically separating the input (e.g. microphone) and the output (e.g. speaker) sufficiently to prevent the regenerative signal from occurring. Of course, this is not always possible.
- Another approach is to simply apply a notch filter at the feedback frequency. This approach is only effective if the feedback occurs at a known frequency, or if the frequency is determined and then a corresponding filter applied, and if the filter doesn't unduly affect the frequency content of desired signals.
- FIG. 1 is a block diagram of a transmitting device and receiving device in accordance with some embodiments
- FIG. 2 is a functional block diagram of a feedback suppressor in accordance with some embodiments
- FIG. 3 is a flow chart diagram of a method for detecting feedback in a mid-band frequency region of a signal in accordance with some embodiments
- FIG. 4 is a flow chart diagram of a method for detecting feedback in a low-band frequency region of a signal in accordance with some embodiments
- FIG. 5 is a functional block diagram of a feedback suppressor in accordance with some embodiments.
- FIG. 6 is a index chart used by a feedback suppressor in accordance with some embodiments.
- FIG. 7 is a series of energy indexed histograms derived from the index chart of FIG. 6 at several times.
- FIG. 8 is a flow chart diagram of a method of performing feedback detection in accordance with some embodiments.
- Embodiments include a method for mitigating feedback in a radio receiver that includes various processes and steps, such as receiving, at the radio receiver, a radio signal and generating a digital audio signal from the radio signal.
- the digital audio signal is formatted into a series of frames.
- the method further includes determining an energy level in each of a plurality of frequency bands of the digital audio signal and calculating at least one ratio of a signal energy level of a first frequency band of the plurality of frequency bands to a signal energy level of a second frequency band of the plurality of frequency bands.
- the method further includes determining that the at least one ratio exceeds a threshold and determining, based at least in part upon determining that the at least one ratio is not consistent with a voice signal, that feedback is occurring in one of the plurality of frequency bands, and applying a gain reduction to the frequency band in which feedback is occurring.
- FIG. 1 is a block diagram 100 of a transmitting device 102 and receiving device 104 in accordance with some embodiments.
- the transmitting device 102 and the receiving device 104 are both two-way radio devices such as those commonly used by public safety and other such personnel.
- a two-way radio operates in a half-duplex mode; the user can either speak (transmit) or listen (receive) but not both at the same time (e.g. full duplex).
- Two-way radios can communicate directly with each other, without using a network, and can also be trunked which uses a networked infrastructure, repeaters, and other equipment.
- the transmitting device 102 shows only the transmitter line up, while the receiving device 104 only shows the receiver line up. Both devices, however, will contain both the transmitter and receiver components shown here for transmitting device 102 , and receiving device 104 .
- a microphone 106 receives acoustic sound signals which are converted by the microphone 106 into an electrical analog signal that is amplified by the microphone amplifier 110 .
- the amplified analog signal is then digitized by an analog to digital converter 110 .
- An uplink audio processor block 112 formats the digital signal produced by the analog to digital converter 110 for transmitting, such as by grouping digital samples into frames which are then processed to reduce the noise in the samples by a noise suppressor block 114 .
- the processed audio samples output from the noise suppressor 114 are then speech encoded by a speech encoder 116 .
- the speech encoder 116 models speech into a set of parameters, as is done, for example, using vector sum excited linear predictive (VSELP) or advanced multi-band excitation (AMBE) modeling.
- VSELP vector sum excited linear predictive
- AMBE advanced multi-band excitation
- the encoded speech signal produced by the speech encoder 116 is provided to a transmitter 118 that modulates and transmits the signal over a radio channel 120 .
- the radio channel 120 can be a direct channel between the transmitting device 102 and the receiving device 104 or it can be through a network, repeater, or other such equipment that relays the signal from the transmitting device 102 to the receiving device 104 .
- the receiving device 104 receives the data over the radio channel 120 at a receiver 122 .
- the receiver 122 contains a demodulator that demodulates the received signal to obtain the speech encoded signal that was transmitted by the transmitting device 102 .
- the receiver 122 provides the received encoded signal to a speech decoder 124 that applies a speech decoding process to the signal provided by the receiver 122 .
- the speech decoder 124 essentially reverses the encoding performed by speech encoder 116 to produce a digital audio signal.
- the digital audio signal can be organized in frames of audio samples which are processed by an acoustic feedback suppressor 126 .
- the acoustic feedback suppressor 126 processes the received audio samples to detect signals that do not have the typical characteristics of speech, and which appear likely to be the onset of a regenerative signal component.
- the acoustic feedback suppressor 126 determines the energy of the audio signal in various frequency bands and can apply various tests to determine if the audio signal has energy content that is distributed in the frequency spectrum of the audio signal in a way that resembles speech, both in an instant and over time.
- the acoustic feedback suppressor 126 will reduce the gain in one or more frequency bands. As the signal continues to be received, the gain reduction continues to be applied over time, until the non-speech energy is sufficiently diminished. If the audio signal appears to be speech, though, the acoustic feedback suppressor 126 does not modify the signal.
- the output of the acoustic feedback suppressor 126 is provided to a downlink audio processing block 128 which can include equalizers, adaptive/fixed gain controllers, an intelligibility booster, and local sound generators, such as tone, voice announcement and comfortable noise generators that are used to format the digital audio signal for conversion to analog.
- the D/A conversion is achieved using a digital to analog converter 130 .
- the digital to analog converter 130 produces an analog audio signal which is amplified to a selected volume level by output amplifier 132 .
- the output amplifier applies the amplified analog audio signal to a speaker 134 .
- the speaker converts the electrical analog audio signal into an acoustic signal so that a nearby listener can hear the acoustic signal.
- the speaker output 136 can be received at the microphone 106 of the transmitting device, which can result in regenerative feedback.
- the feedback can rapidly increase as the sound loops through the transmitting device 102 and the receiving device 104 .
- the acoustic feedback suppressor 126 detects audio energy that indicates the audio signal is not likely speech, or includes energy that is not likely speech, and applies an adaptive gain reduction to frequency bands that appear to be experiencing the onset of regenerative feedback.
- audio signals that tend to have higher energy content in higher frequency ranges than in lower frequencies are not consistent with speech, and are likely to be the result of feedback.
- the peak energy in human speech shifts over time as the speaker speaks and pronounces different sounds and words. Accordingly, if the energy in mid and/or low frequency bands is consistent at the same frequency over a period of time where it would be unlikely to be speech, feedback may be occurring. Knowing the characteristic of typical human speech allows the embodiments taught herein to detect audio signals that do not appear to be speech and which are consistent with feedback. An adaptive gain reduction can then be applied to mitigate whatever feedback may be occurring.
- the acoustic noise suppressor 126 is in the receiver path 104 of a radio device, but it will be appreciated by those skilled in the art that it can be equivalently placed in the transmit path 102 .
- FIG. 2 is a functional block diagram of a feedback suppressor 200 in accordance with some embodiments.
- the feedback suppressor 200 can be used as the acoustic feedback suppressor 126 of FIG. 1 in some embodiments.
- the various processes performed by the feedback suppressor 200 are abstracted into boxes in FIG. 2 . Each process can be implemented, for example, by a digital signal processor executing appropriate instruction code designed to perform the abstracted processes.
- a speech decoder 202 receives encoded speech 204 from a demodulator of a radio receiver (e.g. receiver 122 ).
- the speech decoder 202 decodes the speech to produce a digital audio signal that is provided to both an adaptive sensitivity calculation block 206 and a windowing block 208 .
- the adaptive sensitivity calculation block 206 determines the fundamental frequency or pitch of the audio signal, such as by using, for example, an average magnitude difference function.
- the fundamental frequency is used to dynamically select thresholds for a high band feedback detector 224 .
- the pitch is determined on voiced speech.
- the windowing block 208 formats the decoded speech into windows or frames of samples.
- the windowing block 208 produces frames of 10 millisecond (ms) length, having 80 (eighty) samples of the decoded speech signal having 24 (twenty four) buffer samples before and after the 80 (eighty)samples of the decoded speech to produce 128 point frames with 8 KHz sampling rate.
- Each frame is processed on a frame by frame basis.
- the frames are processed by a time to frequency conversion block 210 (e.g. digital Fourier transform) to produce a frequency spectrum for each frame which is provided to a band energy calculation block 212 .
- the band energy calculation block 212 determines the energy in each of a plurality of defined frequency bands.
- the frequency bands can be defined as a very low band 214 that goes from the lowest frequency (e.g. 0 Hz) of the receiver to 500 Hz, a low band 216 that goes from the lowest frequency to 1400 Hz, or to a frequency in a range such as 1000 to 1400 Hz.
- the frequency bands can further include a mid band 218 from 500 Hz to 2000 Hz, a high band 220 from 1400 Hz to the highest frequency of the receiver, such as 4000 Hz, and a very high band 222 from 2000 Hz to the highest frequency.
- the size of the frequency bands 214 - 222 as shown here are not meant to be proportional to energy content or magnitude, and are arranged here only to show their range and how they can overlap.
- the band energy calculation block 212 determines the magnitude of the energy contained in the respective band.
- the band energy calculations are provided to each of several band feedback detector blocks, which include the high band feedback detector block 224 , the mid band feedback detector block 226 , and the low band feedback detector block 228 .
- the high band feedback detector 224 uses the output of the adaptive sensitivity calculation 206 to determine appropriate thresholds based on the pitch of voiced speech in the audio signal. Two ratios are determined; the ratio of the energy in the low band 216 to the energy in the high band 220 , and the ratio of the energy in the very low band 214 to the energy in the very high band 222 . Since the energy in human speech is mostly in the lower frequencies, if these ratios are too low it indicates the audio signal contains unusually high frequency content that is uncharacteristic of speech, and may therefore be feedback in the high bands.
- the ratio of the energy in the low band 216 to the energy in the high band 220 is compared to a first threshold, and the ratio of the energy in the very low band 214 to the energy in the very high band 222 is compared to a second threshold, where the first and second thresholds are based on the determined pitch.
- the mid band feedback detector 226 also determines two energy ratios, the ratio of energy in the mid band 218 to the energy in the very high band 222 , and the energy in the mid band 218 to the energy in the very low band 214 .
- the operation of the mid band feedback detector 226 is shown in FIG. 3 , which is a flow chart diagram of a method 300 for detecting feedback in a mid-band frequency region of a signal in accordance with some embodiments.
- the two mid band energy ratios have been calculated for a present frame (mid to very high and mid to very low).
- the method 300 can determine whether there is weak mid-band feedback occurring, as in process 304 , by comparing the mid to very low and mid to very high energy ratios to mid-band weak low threshold and a mid-band weak high threshold, respectively. If the ratios are larger than these thresholds, then weak mid-band feedback may be occurring, and a counter for weak feedback is incremented in process 306 . The counter value is then evaluated in process 308 . The counter indicates whether the weak mid-band feedback has been occurring for a sufficient period as it is incremented with each successive frame that the mid band ratios fall under their respective thresholds. If the mid band ratios do not fall under their respective thresholds, the counter is reset, as in process 318 .
- a weak mid band flag can be set in process 310 .
- the method 300 also determines if there is strong mid band feedback occurring in process 312 .
- the mid band ratios are compared to mid band strong low and mid band strong high thresholds, which are lower than the mid band weak low and mid band weak strong thresholds, respectively. If the mid band energy ratios fall under the mid band strong thresholds, the strong mid band feedback flag is set in process 314 . Once the weak and strong mid band feedback determinations have been made, the method 300 terminates 316 .
- the feedback suppressor 200 also includes the low band feedback detection block 228 .
- Low band feedback which occurs under 500 Hz (the very low band 214 ) can be difficult to detect because speech tends to have significant energy in the low band region.
- speech also varies with time, so while speech energy is high in the low band, it changes in magnitude over time, unlike feedback which tends to be consistent. Therefore, to detect low band feedback, the energy consistency over time must be examined.
- FIG. 4 shows a flow chart diagram of a method 400 for detecting feedback in a low-band frequency region of a signal in accordance with some embodiments.
- the low band feedback block 228 has calculated the signal to noise ratio (SNR) in the low band for several consecutive frames.
- the method 400 compares the present SNR (SNR(n)) with the SNR of the most recent (or other recent) frame (SNR(n ⁇ 1)), in process 404 . If the difference between the present and recent SNR level is less than a preselected amount (e.g. “yes” out of process 404 ), then an SNR threshold counter is incremented in process 406 , otherwise the SNR threshold counter is reset in process 414 . When the SNR threshold counter is incremented, the count value of the SNR threshold counter is evaluated in process 408 .
- the SNR increment counter meets a preselected value, which corresponds to a time duration which would indicate that the energy in the low band has been consistent, rather than varying as speech would, then low band feedback has been detected, as indicated in process 410 , where a flag can be set for further operations.
- the method then terminates 412 for the present frame.
- the SNR can be determined by a variety of known means. In some embodiments the SNR can be determined as 10 log(maximum low band energy/minimum low band energy).
- a voice activity detector (VAD) block 230 determines whether the present frame contains voice activity. Voice activity can be determined based on the time-smoothed maximum and minimum energies in the very low band 214 . If the difference between the maximum energy and the minimum energy in the very low band 214 is greater than a VAD threshold, then a VAD flag can be set, indicating the present frame contains speech, otherwise the flag is cleared indicating there is no speech in the present frame. When there is no speech present and indicated by the VAD 230 , then all gain adjustments can be reset to a normalized level.
- a sub-band gain generator 232 determines the gain to be applied to the various bands, 214 , 218 , 222 .
- An overall gain can be determined as the product of the two ratios determined in the high band feedback detector block 224 , which are the ratio of the energies of the low band 216 to the high band 220 and the very low band 214 to the very high band 222 . The smaller these ratios, the more likely there is feedback occurring.
- the gain can further be smoothed by taking into account the gain used in the most recent frame along with a smoothing value. This allows for the gain to ramp up, as well, when speech is detected as indicated by the VAD 230 .
- the gain multiplier block 234 the new gain factors are applied to their respective bands.
- the gain multiplied frame is then converted back into the time domain in frequency to time conversion block 236 and the output 238 is a signal that has been examined for feedback, and when detected, mitigation measures have been applied to reduce the effect of feedback.
- FIG. 5 is a functional block diagram of a feedback detector 500 in accordance with some embodiments.
- the feedback detector 500 can be used as an additional or alternative processing element in the acoustic feedback suppressor 126 of FIG. 1 in some embodiments. In some embodiments it can be used to supplement and help verify the feedback detection processes performed by the feedback suppressor described in FIGS. 2-4 .
- the speech decoder 502 can operate as the speech decoder 124 of FIG. 1 , and decodes received encoded speech to produce a digital audio signal which is windowed 504 to produce a succession of frames. Each frame contains a plurality of time-based samples for consideration, and may be padded with zeros to produce a frame of a pre-determined length.
- a frequency representation (frequency frame) of each time frame is produced by, for example, a fast Fourier transform block 506 .
- the frequency frame is then processed to determine the energy in each of a plurality of frequency bands or filterbank channels in process 508 .
- the energies can be determined for 16 (sixteen) frequency bands or filterbank channels distributed along a Bark frequency scale, although other frequency scales can be used, as well.
- the highest filterbank channel energy is stored (maxFBE) and at least the three channels having the highest energies are ranked (e.g. 1 st , 2 nd , and 3 rd highest and corresponding indices, e.g. 1 through 16) in process 510 .
- the average long and short term energies are calculated in process 522 .
- the short term energy is the total energy of the present frame (ASTE)
- ATE average long term energy
- the filterbank channel energy rankings of process 510 can be used to form a histogram to track the changes in rankings of the filterbank channels over a period of time in process 512 .
- An accumulated count of how often a particular channel contains the maximum energy in a frame is stored in a bin (e.g. one of 16 bins) corresponding to a filterbank channel in the histogram table.
- the count in each histogram bin is time-weighted so that the histogram represents the filterbank maximum energy occurrence distribution over a limited, moving time window.
- the length of the time window is nominally between 0.15 and 1.0 seconds, corresponding to the duration of a typical speech syllable.
- a set of probabilities for the maximum energy occurring in each filterbank channel (p[i]), and the expected values (pev[i]) are calculated in process 514 using common statistical procedures.
- the band(s) containing feedback usually exhibit the highest, second, or third highest energy probabilities.
- energy duration can be used as a parameter to detect possible howling because the duration of a feedback event is usually longer than that of a syllabic speech sound, and because its band residency is more stationary.
- the maximum acoustic energy of speech tends to vary more in time and in frequency than does feedback energy.
- the fact that feedback generally has a longer duration in a given frequency band or adjacent bands can be used to further discriminate between normal speech and the presence of feedback.
- Minimum duration limits can be set for detecting a feedback condition where the limits are shorter for higher bands than in lower bands.
- the highest energy sustained speech sounds are voiced sounds occurring at lower frequencies so longer dwell times must be assigned to differentiate feedback. Accordingly, dwell times for each filterbank band having the maximum energy and maximum energy probability can be determined in process 518 .
- the percentage of low band energy for example, in one embodiment the band from 80-300 Hz, of the total frame energy is determined, and in process 524 a high to low band energy ratio (hblbRatio), is determined, where the total energy in the higher filterbank channels above 500 Hz is divided by the energy in the channels below 500 Hz.
- hblbRatio high to low band energy ratio
- the limits of these frequency bands may be adjusted dependent on the total frequency response of the decoded output speech from FIG. 1 block 124 .
- Different audio pre-filtering lineups and codec responses may alter the overall bandpass at the decoder output, FIG. 1 , block 124 .
- the various parameters and ratios are all evaluated by a feedback detector logic block 526 .
- the feedback detector logic consists of a sequence of comparison tests in which the signal-derived parameters maxEcnt[i], maxPcnt[i], maxFBE, ALTE, elbPRCNT, hblbRatio, maxFBEI[i][j], and maxFBEP[i][j] are compared against empirically derived threshold constants. If the logical result of the comparisons is true a howling detection flag (HowlDetFlg) is set to logical 1. If not the flag is set to 0.
- the output of the feedback detector logic 526 is an indication of whether feedback is occurring, and if so, in what band or bands, which is evaluated in process 528 .
- the suppression can be applied in process 530 that is adapted to the detected feedback.
- a gain reduction factor is determined, and applied to one or more of the filterbank channels (0-15) to modify each frame in the frequency domain. After applying the gain reduction, if any is needed, the frequency frame is converted back into a processed time frame using an inverse Fourier operation, and the processed time frame is then forwarded to, for example, the downlink audio processing block 128 of FIG. 1 .
- FIG. 8 A flowchart of one embodiment of the feedback detector logic in FIG. 5 block 526 is shown in FIG. 8 .
- the HowlDetFlg feedback present flag and indices of the filterbank channels in which it most likely occurs are made available in process 528 .
- this information is passed on to an embodiment of the feedback suppressor as exemplified in FIG. 2 , and in particular blocks 224 , 226 , and 228 and can be used to supplement or supersede the feedback detection performed in these processes.
- the howling detector of FIGS. 5 and 8 may use another means to suppress and attenuate the feedback in specific filterbank channels as in process 530 , independent of the methods used in embodiment of the feedback suppressor depicted in FIGS. 2-4 .
- FIG. 6 is an index chart 600 used by a feedback suppressor in accordance with some embodiments.
- the chart 600 indexes the frequency bands (rows) or filterbank channels having the highest three energies with frequency increasing along the vertical axis 602 .
- Each column corresponds to a frame of information at regular periods, with time increasing along the horizontal axis 604 .
- the highest energy is denoted with a filled circle, the second highest with a gray circle, and the third highest with an white circle.
- the chart 600 charts a sound burst that commences as voiced speech and then becomes feedback in the high band. From the origin to period 606 the highest energy bands are concentrated in the lower frequency bands.
- the energy in the low bands diminishes, as would be consistent with a sound that terminates with unvoiced speech, where there is higher energy concentrated in the mid band frequencies. From period 608 to period 610 , and thereafter, the energy is concentrated in the higher bands, and the highest energy is persistently in one filterbank channel 612 , as is consistent with feedback or howling.
- FIG. 7 is a series of energy indexed histograms 700 derived from the index chart of FIG. 6 at several times. Each histogram charts frequency along their horizontal axis, in discrete divisions corresponding to the filterbank channels along the vertical axis of FIG. 6 , and a count of ranking over a period of time (e.g. multiple frames), based on the ranking performed by, for example, process 510 in FIG. 5 , is charted along the vertical axis.
- the histogram can be produced by summing the energy in each filterbank channel of each frame for a period of time. Histogram 702 can represent the energy distribution from the origin to period 606 in FIG. 6 .
- the energy is concentrated in the lower filterbank channels, as is consistent with voiced speech.
- histogram 704 the energy is more centrally distributed, as would be consistent, for example, in the time between periods 606 and 608 of FIG. 6 .
- feedback such as howling
- the energy tends to be concentrated in fewer filter channels as indicated I histogram 706 .
- FIG. 8 is a flow chart diagram of a method 800 of performing feedback suppression in accordance with some embodiments.
- the method 800 can operate as the feedback detector logic 526 of FIG. 5 .
- a present frame under consideration has been converted to a frequency frame.
- the process has been executed for several frames in succession prior to the present frame so that there is a history in the various parameters to be determined.
- the various parameters are determined, as in process 804 , including the percentage of energy in the low band relative to the total energy (elbPRCNT), the average long term energy (ALTE) of the past n consecutive frames, the short term energy of the present frame (ASTE), the ratio of high band energy to low band energy (bhlbRatio), the maximum filter band energy index (maxFBE[i][j]), the maximum filterbank energy (maxFBE), the count of successive frames of a filterbank channel having maximum energy (maxEcnt[i]), and the count of successive frames of a filterbank channel having the highest probability of having the highest energy (maxPcnt[i]).
- a high band evaluation is performed in process 812 .
- the evaluation 812 determines whether either maxEcnt[i] or maxPcnt[i] exceed 20 frames (in the present example), whether the index number is 5 or higher (ensuring only the higher frequencies are used in this evaluation), and whether the maximum filterbank energy is greater than the average long term energy. If this evaluation is false, meaning at least one condition is not true, the high band (HB) persistence flag is cleared in process 814 . If the high band evaluation is true, meaning all conditions are true, then the high band persistence flag is set (or not cleared if already set) in process 816 .
- a low band evaluation is performed in process 806 .
- the evaluation 806 determines whether either maxEcnt[i] exceeds 50 successive frames or if maxPcnt[i] exceed 100 successive frames (in the present example), whether the index number is lower than 5 (ensuring only the lower frequencies are used in this evaluation), and whether the maximum filterbank energy is greater than the average long term energy. If this evaluation is false, meaning at least one condition is not true, the low band (LB) persistence flag is cleared in process 810 . If the low band evaluation is true, meaning all conditions are true, then the low band persistence flag is set (or not cleared if already set) in process 808 .
- a high band feedback detection evaluation is performed in process 818 , which determines whether the maximum filterbank index probability is greater than 3 (in this example) or whether the high band energy to low band energy ratio is greater than 2, and whether the high band persistence flag is set, and whether the maximum filterbank energy is greater than 2% of the average long term energy. If the high band feedback detection evaluation 818 is true, then the feedback detected flag is set in process 824 and the method can terminate 826 . If the high band feedback detection evaluation 818 is false, meaning at least one of the conditions is not true, the feedback detected flag is not set, and the low band feedback detection evaluation 820 is performed.
- a low band feedback detection evaluation is performed in process 820 , which determines whether the low band persistence flag is set, whether the low band persistence flag is set, whether the energy in the low band is at least 20% of the total frame energy, and whether the maximum filterbank energy is at least 2% of the average long-term energy. If the low band feedback detection evaluation 820 is true, meaning all conditions are true, then the feedback detected flag is set in process 824 . If the low band feedback detection evaluation 820 is false, meaning at least one condition is not true, then the feedback detected flag is cleared in process 822 and the method terminates 826 .
- the method 800 terminates 826 , if the feedback detected flag is set, then an appropriate gain reduction can be applied to the frequency frame before converting it back to the time domain. Since the feedback detection and gain reduction are applied over successive frames, the frequency bands in which the feedback has been detected will continue to diminish until the feedback conditions are longer evident. Due to the regenerative nature of feedback, the gain reduction propagates through the feedback loop to eliminate the feedback. Once the feedback conditions are no longer met, the gain can be ramped back up to normal levels, or until the feedback conditions are evident again.
- Embodiments as exemplified herein have the benefit of quickly identifying feedback, such as howling, but evaluating a received audio signal against characteristics of speech, such as having an unusually high energy in a high band compared to a low band, having low band energy that is both persistent and consistent in form, rather than more variable like speech.
- a includes . . . a”, “contains . . . a” does not, without more constraints, preclude the existence of additional identical elements in the process, method, article, or apparatus that comprises, has, includes, contains the element.
- the terms “a” and “an” are defined as one or more unless explicitly stated otherwise herein.
- the terms “substantially”, “essentially”, “approximately”, “about” or any other version thereof, are defined as being close to as understood by one of ordinary skill in the art, and in one non-limiting embodiment the term is defined to be within 10%, in another embodiment within 5%, in another embodiment within 1% and in another embodiment within 0.5%.
- the term “coupled” as used herein is defined as connected, although not necessarily directly and not necessarily mechanically.
- a device or structure that is “configured” in a certain way is configured in at least that way, but may also be configured in ways that are not listed.
- processors such as microprocessors, digital signal processors, customized processors and field programmable gate arrays (FPGAs) and unique stored program instructions (including both software and firmware) that control the one or more processors to implement, in conjunction with certain non-processor circuits, some, most, or all of the functions of the method and/or apparatus described herein.
- processors or “processing devices” such as microprocessors, digital signal processors, customized processors and field programmable gate arrays (FPGAs) and unique stored program instructions (including both software and firmware) that control the one or more processors to implement, in conjunction with certain non-processor circuits, some, most, or all of the functions of the method and/or apparatus described herein.
- FPGAs field programmable gate arrays
- unique stored program instructions including both software and firmware
- an embodiment can be implemented as a computer-readable storage medium having computer readable code stored thereon for programming a computer (e.g., comprising a processor) to perform a method as described and claimed herein.
- Examples of such computer-readable storage mediums include, but are not limited to, a hard disk, a CD-ROM, an optical storage device, a magnetic storage device, a ROM (Read Only Memory), a PROM (Programmable Read Only Memory), an EPROM (Erasable Programmable Read Only Memory), an EEPROM (Electrically Erasable Programmable Read Only Memory) and a Flash memory.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Quality & Reliability (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Telephone Function (AREA)
- Mobile Radio Communication Systems (AREA)
- Circuits Of Receivers In General (AREA)
Abstract
Description
- The present disclosure relates generally to mitigating feedback, and more particularly to detecting the onset of acoustic-sourced feedback in a digital radio receiver and applying suppressive filtering to mitigate and reduce the feedback.
- Feedback in audio systems is caused by the output signal coupling to an input through an acoustic path, creating a regenerative signal in the loop that results in an undesirable sound. It occurs in all types of systems, from simple public address systems to sophisticated wireless radio communication systems. The conventional ways of dealing with feedback sound include several approaches. One approach is physically separating the input (e.g. microphone) and the output (e.g. speaker) sufficiently to prevent the regenerative signal from occurring. Of course, this is not always possible. Another approach is to simply apply a notch filter at the feedback frequency. This approach is only effective if the feedback occurs at a known frequency, or if the frequency is determined and then a corresponding filter applied, and if the filter doesn't unduly affect the frequency content of desired signals. However, in more complex systems there can be various types of feedback occurring at different frequencies, with different characteristics. Pre-emptively inserting filters to address all forms of feedback would not be practical. Since feedback is regenerative, another approach that is often used is to vary the pitch of audio signals to prevent the regenerative effect from occurring. Pitch can either be shifted to avoid a known resonance frequency or frequency band, or the fundamental pitch of a sound can be determined and varied above and below the fundamental pitch. Pitch shifting is effective, but can often be detected by a listener and is thus not an optimum solution. Other methods include simply detecting a strong tone-like signal in the audio spectrum of the signal through the system and responding by lowering volume, or applying a notch filter at the feedback frequency. This, however, presumes feedback is occurring, which means that listeners are hearing feedback by the time the system detects and applies a measure to address the feedback.
- All of the conventional methods are effective, but have their drawbacks. They either require identifying feedback as it occurs, meaning it is being heard by the time it is detected, or requires foreknowledge as to the frequency so that a selected filter can be applied.
- Accordingly, there is a need for a method and apparatus for suppressing feedback in an audio system that operates faster than conventional methods and in an adaptive manner to address different kinds of feedback.
- The accompanying figures, where like reference numerals refer to identical or functionally similar elements throughout the separate views, together with the detailed description below, are incorporated in and form part of the specification, and serve to further illustrate embodiments of concepts that include the claimed invention, and explain various principles and advantages of those embodiments.
-
FIG. 1 is a block diagram of a transmitting device and receiving device in accordance with some embodiments; -
FIG. 2 is a functional block diagram of a feedback suppressor in accordance with some embodiments; -
FIG. 3 is a flow chart diagram of a method for detecting feedback in a mid-band frequency region of a signal in accordance with some embodiments; -
FIG. 4 is a flow chart diagram of a method for detecting feedback in a low-band frequency region of a signal in accordance with some embodiments; -
FIG. 5 is a functional block diagram of a feedback suppressor in accordance with some embodiments; -
FIG. 6 is a index chart used by a feedback suppressor in accordance with some embodiments; -
FIG. 7 is a series of energy indexed histograms derived from the index chart ofFIG. 6 at several times; and -
FIG. 8 is a flow chart diagram of a method of performing feedback detection in accordance with some embodiments. - Skilled artisans will appreciate that elements in the figures are illustrated for simplicity and clarity and have not necessarily been drawn to scale. For example, the dimensions of some of the elements in the figures may be exaggerated relative to other elements to help to improve understanding of embodiments of the present invention.
- The apparatus and method components have been represented where appropriate by conventional symbols in the drawings, showing only those specific details that are pertinent to understanding the embodiments of the present invention so as not to obscure the disclosure with details that will be readily apparent to those of ordinary skill in the art having the benefit of the description herein.
- Embodiments include a method for mitigating feedback in a radio receiver that includes various processes and steps, such as receiving, at the radio receiver, a radio signal and generating a digital audio signal from the radio signal. The digital audio signal is formatted into a series of frames. The method further includes determining an energy level in each of a plurality of frequency bands of the digital audio signal and calculating at least one ratio of a signal energy level of a first frequency band of the plurality of frequency bands to a signal energy level of a second frequency band of the plurality of frequency bands. The method further includes determining that the at least one ratio exceeds a threshold and determining, based at least in part upon determining that the at least one ratio is not consistent with a voice signal, that feedback is occurring in one of the plurality of frequency bands, and applying a gain reduction to the frequency band in which feedback is occurring.
- applying a gain reduction to the frequency band in which feedback is occurring.
FIG. 1 is a block diagram 100 of atransmitting device 102 and receivingdevice 104 in accordance with some embodiments. The transmittingdevice 102 and thereceiving device 104 are both two-way radio devices such as those commonly used by public safety and other such personnel. A two-way radio operates in a half-duplex mode; the user can either speak (transmit) or listen (receive) but not both at the same time (e.g. full duplex). Two-way radios can communicate directly with each other, without using a network, and can also be trunked which uses a networked infrastructure, repeaters, and other equipment. The transmittingdevice 102 shows only the transmitter line up, while thereceiving device 104 only shows the receiver line up. Both devices, however, will contain both the transmitter and receiver components shown here for transmittingdevice 102, and receivingdevice 104. - In the
transmitting device 102, amicrophone 106 receives acoustic sound signals which are converted by themicrophone 106 into an electrical analog signal that is amplified by themicrophone amplifier 110. The amplified analog signal is then digitized by an analog todigital converter 110. An uplinkaudio processor block 112 formats the digital signal produced by the analog todigital converter 110 for transmitting, such as by grouping digital samples into frames which are then processed to reduce the noise in the samples by anoise suppressor block 114. The processed audio samples output from thenoise suppressor 114 are then speech encoded by aspeech encoder 116. Thespeech encoder 116 models speech into a set of parameters, as is done, for example, using vector sum excited linear predictive (VSELP) or advanced multi-band excitation (AMBE) modeling. The encoded speech signal produced by thespeech encoder 116 is provided to atransmitter 118 that modulates and transmits the signal over aradio channel 120. Theradio channel 120 can be a direct channel between thetransmitting device 102 and thereceiving device 104 or it can be through a network, repeater, or other such equipment that relays the signal from the transmittingdevice 102 to thereceiving device 104. - The
receiving device 104 receives the data over theradio channel 120 at areceiver 122. Thereceiver 122 contains a demodulator that demodulates the received signal to obtain the speech encoded signal that was transmitted by thetransmitting device 102. Thereceiver 122 provides the received encoded signal to aspeech decoder 124 that applies a speech decoding process to the signal provided by thereceiver 122. Thespeech decoder 124 essentially reverses the encoding performed byspeech encoder 116 to produce a digital audio signal. The digital audio signal can be organized in frames of audio samples which are processed by anacoustic feedback suppressor 126. Theacoustic feedback suppressor 126 processes the received audio samples to detect signals that do not have the typical characteristics of speech, and which appear likely to be the onset of a regenerative signal component. Theacoustic feedback suppressor 126 determines the energy of the audio signal in various frequency bands and can apply various tests to determine if the audio signal has energy content that is distributed in the frequency spectrum of the audio signal in a way that resembles speech, both in an instant and over time. When the audio signal energy distribution with respect to frequency is distributed such that is it unlikely to be speech, or when, over time, the energy distribution fails to behave like speech, theacoustic feedback suppressor 126 will reduce the gain in one or more frequency bands. As the signal continues to be received, the gain reduction continues to be applied over time, until the non-speech energy is sufficiently diminished. If the audio signal appears to be speech, though, theacoustic feedback suppressor 126 does not modify the signal. - The output of the
acoustic feedback suppressor 126 is provided to a downlinkaudio processing block 128 which can include equalizers, adaptive/fixed gain controllers, an intelligibility booster, and local sound generators, such as tone, voice announcement and comfortable noise generators that are used to format the digital audio signal for conversion to analog. The D/A conversion is achieved using a digital toanalog converter 130. The digital toanalog converter 130 produces an analog audio signal which is amplified to a selected volume level byoutput amplifier 132. The output amplifier applies the amplified analog audio signal to aspeaker 134. The speaker converts the electrical analog audio signal into an acoustic signal so that a nearby listener can hear the acoustic signal. If the receivingdevice 104 is sufficiently close to the transmittingdevice 102, thespeaker output 136 can be received at themicrophone 106 of the transmitting device, which can result in regenerative feedback. The feedback can rapidly increase as the sound loops through the transmittingdevice 102 and the receivingdevice 104. However, theacoustic feedback suppressor 126 detects audio energy that indicates the audio signal is not likely speech, or includes energy that is not likely speech, and applies an adaptive gain reduction to frequency bands that appear to be experiencing the onset of regenerative feedback. - It is known that the energy in human voiced speech signals tends to be greatest under 1500 Hz. The fundamental frequency of adult male speech is in the region of 125 Hz, adult female speech has a fundamental frequency around 200 Hz, while child speech varies around 250 Hz to 400 Hz. Above about 1400 Hz, the average energy (over time) for voiced speech decreases at about 6 dB per decade. Unvoiced sounds, like fricatives in consonants, have significant energy at higher frequencies, but are relatively short in duration. Furthermore, the frequency response of audio components commonly used in devices such as two-way radios tends to peak at high frequencies, significantly above those where most of the energy in human speech occurs. Accordingly, in general, audio signals that tend to have higher energy content in higher frequency ranges than in lower frequencies are not consistent with speech, and are likely to be the result of feedback. Furthermore, the peak energy in human speech shifts over time as the speaker speaks and pronounces different sounds and words. Accordingly, if the energy in mid and/or low frequency bands is consistent at the same frequency over a period of time where it would be unlikely to be speech, feedback may be occurring. Knowing the characteristic of typical human speech allows the embodiments taught herein to detect audio signals that do not appear to be speech and which are consistent with feedback. An adaptive gain reduction can then be applied to mitigate whatever feedback may be occurring. As shown here the
acoustic noise suppressor 126 is in thereceiver path 104 of a radio device, but it will be appreciated by those skilled in the art that it can be equivalently placed in the transmitpath 102. -
FIG. 2 is a functional block diagram of afeedback suppressor 200 in accordance with some embodiments. Thefeedback suppressor 200 can be used as theacoustic feedback suppressor 126 ofFIG. 1 in some embodiments. The various processes performed by thefeedback suppressor 200 are abstracted into boxes inFIG. 2 . Each process can be implemented, for example, by a digital signal processor executing appropriate instruction code designed to perform the abstracted processes. - A
speech decoder 202 receives encodedspeech 204 from a demodulator of a radio receiver (e.g. receiver 122). Thespeech decoder 202 decodes the speech to produce a digital audio signal that is provided to both an adaptivesensitivity calculation block 206 and awindowing block 208. The adaptivesensitivity calculation block 206 determines the fundamental frequency or pitch of the audio signal, such as by using, for example, an average magnitude difference function. The fundamental frequency is used to dynamically select thresholds for a highband feedback detector 224. The pitch is determined on voiced speech. - The
windowing block 208 formats the decoded speech into windows or frames of samples. In some embodiments thewindowing block 208 produces frames of 10 millisecond (ms) length, having 80 (eighty) samples of the decoded speech signal having 24 (twenty four) buffer samples before and after the 80 (eighty)samples of the decoded speech to produce 128 point frames with 8 KHz sampling rate. Each frame is processed on a frame by frame basis. The frames are processed by a time to frequency conversion block 210 (e.g. digital Fourier transform) to produce a frequency spectrum for each frame which is provided to a bandenergy calculation block 212. The bandenergy calculation block 212 determines the energy in each of a plurality of defined frequency bands. For example, the frequency bands can be defined as a verylow band 214 that goes from the lowest frequency (e.g. 0 Hz) of the receiver to 500 Hz, alow band 216 that goes from the lowest frequency to 1400 Hz, or to a frequency in a range such as 1000 to 1400 Hz. The frequency bands can further include amid band 218 from 500 Hz to 2000 Hz, ahigh band 220 from 1400 Hz to the highest frequency of the receiver, such as 4000 Hz, and a veryhigh band 222 from 2000 Hz to the highest frequency. The size of the frequency bands 214-222 as shown here are not meant to be proportional to energy content or magnitude, and are arranged here only to show their range and how they can overlap. - For each band 214-222 the band
energy calculation block 212 determines the magnitude of the energy contained in the respective band. The band energy calculations are provided to each of several band feedback detector blocks, which include the high bandfeedback detector block 224, the mid bandfeedback detector block 226, and the low bandfeedback detector block 228. - The high
band feedback detector 224 uses the output of theadaptive sensitivity calculation 206 to determine appropriate thresholds based on the pitch of voiced speech in the audio signal. Two ratios are determined; the ratio of the energy in thelow band 216 to the energy in thehigh band 220, and the ratio of the energy in the verylow band 214 to the energy in the veryhigh band 222. Since the energy in human speech is mostly in the lower frequencies, if these ratios are too low it indicates the audio signal contains unusually high frequency content that is uncharacteristic of speech, and may therefore be feedback in the high bands. The ratio of the energy in thelow band 216 to the energy in thehigh band 220 is compared to a first threshold, and the ratio of the energy in the verylow band 214 to the energy in the veryhigh band 222 is compared to a second threshold, where the first and second thresholds are based on the determined pitch. - The mid
band feedback detector 226 also determines two energy ratios, the ratio of energy in themid band 218 to the energy in the veryhigh band 222, and the energy in themid band 218 to the energy in the verylow band 214. The operation of the midband feedback detector 226 is shown inFIG. 3 , which is a flow chart diagram of amethod 300 for detecting feedback in a mid-band frequency region of a signal in accordance with some embodiments. At thestart 302 the two mid band energy ratios have been calculated for a present frame (mid to very high and mid to very low). Themethod 300 can determine whether there is weak mid-band feedback occurring, as inprocess 304, by comparing the mid to very low and mid to very high energy ratios to mid-band weak low threshold and a mid-band weak high threshold, respectively. If the ratios are larger than these thresholds, then weak mid-band feedback may be occurring, and a counter for weak feedback is incremented inprocess 306. The counter value is then evaluated inprocess 308. The counter indicates whether the weak mid-band feedback has been occurring for a sufficient period as it is incremented with each successive frame that the mid band ratios fall under their respective thresholds. If the mid band ratios do not fall under their respective thresholds, the counter is reset, as inprocess 318. If the counter indicates that the preselected number of consecutive frames have elapsed where the mid band ratios fall under their respective thresholds, then a weak mid band flag can be set inprocess 310. Themethod 300 also determines if there is strong mid band feedback occurring inprocess 312. The mid band ratios are compared to mid band strong low and mid band strong high thresholds, which are lower than the mid band weak low and mid band weak strong thresholds, respectively. If the mid band energy ratios fall under the mid band strong thresholds, the strong mid band feedback flag is set inprocess 314. Once the weak and strong mid band feedback determinations have been made, themethod 300 terminates 316. - Returning to
FIG. 2 , thefeedback suppressor 200 also includes the low bandfeedback detection block 228. Low band feedback, which occurs under 500 Hz (the very low band 214), can be difficult to detect because speech tends to have significant energy in the low band region. However, speech also varies with time, so while speech energy is high in the low band, it changes in magnitude over time, unlike feedback which tends to be consistent. Therefore, to detect low band feedback, the energy consistency over time must be examined. A method for performing low band feedback detection is shown inFIG. 4 , which shows a flow chart diagram of amethod 400 for detecting feedback in a low-band frequency region of a signal in accordance with some embodiments. At thestart 402, the lowband feedback block 228 has calculated the signal to noise ratio (SNR) in the low band for several consecutive frames. Themethod 400 then compares the present SNR (SNR(n)) with the SNR of the most recent (or other recent) frame (SNR(n−1)), inprocess 404. If the difference between the present and recent SNR level is less than a preselected amount (e.g. “yes” out of process 404), then an SNR threshold counter is incremented inprocess 406, otherwise the SNR threshold counter is reset inprocess 414. When the SNR threshold counter is incremented, the count value of the SNR threshold counter is evaluated inprocess 408. If the SNR increment counter meets a preselected value, which corresponds to a time duration which would indicate that the energy in the low band has been consistent, rather than varying as speech would, then low band feedback has been detected, as indicated inprocess 410, where a flag can be set for further operations. The method then terminates 412 for the present frame. The SNR can be determined by a variety of known means. In some embodiments the SNR can be determined as 10 log(maximum low band energy/minimum low band energy). - Referring again to
FIG. 2 , once the high, mid, and low band feedback detection processes 224, 226, and 228, respectively, have been performed for the present frame, further processing is performed. A voice activity detector (VAD) block 230 determines whether the present frame contains voice activity. Voice activity can be determined based on the time-smoothed maximum and minimum energies in the verylow band 214. If the difference between the maximum energy and the minimum energy in the verylow band 214 is greater than a VAD threshold, then a VAD flag can be set, indicating the present frame contains speech, otherwise the flag is cleared indicating there is no speech in the present frame. When there is no speech present and indicated by theVAD 230, then all gain adjustments can be reset to a normalized level. - A
sub-band gain generator 232 determines the gain to be applied to the various bands, 214, 218, 222. An overall gain can be determined as the product of the two ratios determined in the high bandfeedback detector block 224, which are the ratio of the energies of thelow band 216 to thehigh band 220 and the verylow band 214 to the veryhigh band 222. The smaller these ratios, the more likely there is feedback occurring. The gain can further be smoothed by taking into account the gain used in the most recent frame along with a smoothing value. This allows for the gain to ramp up, as well, when speech is detected as indicated by theVAD 230. In thegain multiplier block 234, the new gain factors are applied to their respective bands. The gain multiplied frame is then converted back into the time domain in frequency totime conversion block 236 and theoutput 238 is a signal that has been examined for feedback, and when detected, mitigation measures have been applied to reduce the effect of feedback. -
FIG. 5 is a functional block diagram of afeedback detector 500 in accordance with some embodiments. Thefeedback detector 500 can be used as an additional or alternative processing element in theacoustic feedback suppressor 126 ofFIG. 1 in some embodiments. In some embodiments it can be used to supplement and help verify the feedback detection processes performed by the feedback suppressor described inFIGS. 2-4 . Thespeech decoder 502 can operate as thespeech decoder 124 ofFIG. 1 , and decodes received encoded speech to produce a digital audio signal which is windowed 504 to produce a succession of frames. Each frame contains a plurality of time-based samples for consideration, and may be padded with zeros to produce a frame of a pre-determined length. A frequency representation (frequency frame) of each time frame is produced by, for example, a fastFourier transform block 506. The frequency frame is then processed to determine the energy in each of a plurality of frequency bands or filterbank channels inprocess 508. In some embodiments the energies can be determined for 16 (sixteen) frequency bands or filterbank channels distributed along a Bark frequency scale, although other frequency scales can be used, as well. Upon determining the filterbank energies, the highest filterbank channel energy is stored (maxFBE) and at least the three channels having the highest energies are ranked (e.g. 1st, 2nd, and 3rd highest and corresponding indices, e.g. 1 through 16) inprocess 510. These ranked results are stored in a table, array, or other data structure along with their corresponding channel indices (maxFBEI[i][j], i=1, . . . , 16, j=1 energy, j=2 index) with the lowest index (i=1) corresponding to the channel with the highest energy. Additional, or even all other filterbank energies, can be likewise rank ordered. Furthermore, the average long and short term energies are calculated inprocess 522. The short term energy is the total energy of the present frame (ASTE), whereas the average long term energy (ALTE) is the average of a number of previous frames over a period of time, such as, for example 1 second. - The filterbank channel energy rankings of
process 510 can be used to form a histogram to track the changes in rankings of the filterbank channels over a period of time inprocess 512. An accumulated count of how often a particular channel contains the maximum energy in a frame is stored in a bin (e.g. one of 16 bins) corresponding to a filterbank channel in the histogram table. The count in each histogram bin is time-weighted so that the histogram represents the filterbank maximum energy occurrence distribution over a limited, moving time window. The length of the time window is nominally between 0.15 and 1.0 seconds, corresponding to the duration of a typical speech syllable. From the histogram a set of probabilities for the maximum energy occurring in each filterbank channel (p[i]), and the expected values (pev[i]) are calculated inprocess 514 using common statistical procedures. The filterbank channel energy probabilities along with their indices (maxFBEP[i][1,2], i=1, . . . , 16, j=1 probability, j=2 index) are then ranked ordered from highest to lowest so that the channels having the highest probabilities of containing the maximum energy may be easily identified inprocess 516 with the lowest index (1=1) corresponding to the channel with the highest energy probability. The band(s) containing feedback usually exhibit the highest, second, or third highest energy probabilities. In addition, energy duration can be used as a parameter to detect possible howling because the duration of a feedback event is usually longer than that of a syllabic speech sound, and because its band residency is more stationary. The maximum acoustic energy of speech tends to vary more in time and in frequency than does feedback energy. The fact that feedback generally has a longer duration in a given frequency band or adjacent bands can be used to further discriminate between normal speech and the presence of feedback. Minimum duration limits can be set for detecting a feedback condition where the limits are shorter for higher bands than in lower bands. Usually the highest energy sustained speech sounds are voiced sounds occurring at lower frequencies so longer dwell times must be assigned to differentiate feedback. Accordingly, dwell times for each filterbank band having the maximum energy and maximum energy probability can be determined inprocess 518. This is accomplished by keeping a count of consecutive frames for each filterbank channel that exhibits the 1st 2nd, or 3rd highest probability of having the highest energy, and having the highest energy. If the channel does not meet the criteria the count is reset to zero. These dwell counts are stored in a memory array, maxEcnt[i] and maxPcnt[i] where i is the index of a specific filterbank channel. - In
process 520 the percentage of low band energy (elbPRCNT), for example, in one embodiment the band from 80-300 Hz, of the total frame energy is determined, and in process 524 a high to low band energy ratio (hblbRatio), is determined, where the total energy in the higher filterbank channels above 500 Hz is divided by the energy in the channels below 500 Hz. Note that the limits of these frequency bands may be adjusted dependent on the total frequency response of the decoded output speech fromFIG. 1 block 124. Different audio pre-filtering lineups and codec responses may alter the overall bandpass at the decoder output,FIG. 1 , block 124. The various parameters and ratios are all evaluated by a feedbackdetector logic block 526. The feedback detector logic consists of a sequence of comparison tests in which the signal-derived parameters maxEcnt[i], maxPcnt[i], maxFBE, ALTE, elbPRCNT, hblbRatio, maxFBEI[i][j], and maxFBEP[i][j] are compared against empirically derived threshold constants. If the logical result of the comparisons is true a howling detection flag (HowlDetFlg) is set to logical 1. If not the flag is set to 0. The output of thefeedback detector logic 526 is an indication of whether feedback is occurring, and if so, in what band or bands, which is evaluated inprocess 528. When feedback is occurring, as indicated, for example, by a flag set by thefeedback detector logic 526 to indicate such, the suppression can be applied inprocess 530 that is adapted to the detected feedback. Generally, a gain reduction factor is determined, and applied to one or more of the filterbank channels (0-15) to modify each frame in the frequency domain. After applying the gain reduction, if any is needed, the frequency frame is converted back into a processed time frame using an inverse Fourier operation, and the processed time frame is then forwarded to, for example, the downlinkaudio processing block 128 ofFIG. 1 . - A flowchart of one embodiment of the feedback detector logic in
FIG. 5 block 526 is shown inFIG. 8 . Note that the threshold parameters shown inFIG. 8 are only representative and different embodiments may use different parameters. The HowlDetFlg feedback present flag and indices of the filterbank channels in which it most likely occurs are made available inprocess 528. In one embodiment this information is passed on to an embodiment of the feedback suppressor as exemplified inFIG. 2 , and inparticular blocks FIGS. 5 and 8 may use another means to suppress and attenuate the feedback in specific filterbank channels as inprocess 530, independent of the methods used in embodiment of the feedback suppressor depicted inFIGS. 2-4 . -
FIG. 6 is anindex chart 600 used by a feedback suppressor in accordance with some embodiments. Thechart 600 indexes the frequency bands (rows) or filterbank channels having the highest three energies with frequency increasing along thevertical axis 602. Each column corresponds to a frame of information at regular periods, with time increasing along thehorizontal axis 604. The highest energy is denoted with a filled circle, the second highest with a gray circle, and the third highest with an white circle. Thechart 600 charts a sound burst that commences as voiced speech and then becomes feedback in the high band. From the origin toperiod 606 the highest energy bands are concentrated in the lower frequency bands. Betweenperiods period 608 toperiod 610, and thereafter, the energy is concentrated in the higher bands, and the highest energy is persistently in onefilterbank channel 612, as is consistent with feedback or howling. -
FIG. 7 is a series of energy indexedhistograms 700 derived from the index chart ofFIG. 6 at several times. Each histogram charts frequency along their horizontal axis, in discrete divisions corresponding to the filterbank channels along the vertical axis ofFIG. 6 , and a count of ranking over a period of time (e.g. multiple frames), based on the ranking performed by, for example,process 510 inFIG. 5 , is charted along the vertical axis. In some embodiments, the histogram can be produced by summing the energy in each filterbank channel of each frame for a period of time.Histogram 702 can represent the energy distribution from the origin toperiod 606 inFIG. 6 . The energy is concentrated in the lower filterbank channels, as is consistent with voiced speech. Inhistogram 704, the energy is more centrally distributed, as would be consistent, for example, in the time betweenperiods FIG. 6 . When feedback, such as howling, is occurring, as in the time betweenperiods FIG. 6 , the energy tends to be concentrated in fewer filter channels as indicated I histogram 706. -
FIG. 8 is a flow chart diagram of amethod 800 of performing feedback suppression in accordance with some embodiments. Themethod 800 can operate as thefeedback detector logic 526 ofFIG. 5 . At thestart 802, a present frame under consideration has been converted to a frequency frame. Furthermore, there it can be assumed in the present example that the process has been executed for several frames in succession prior to the present frame so that there is a history in the various parameters to be determined. Accordingly, the various parameters are determined, as inprocess 804, including the percentage of energy in the low band relative to the total energy (elbPRCNT), the average long term energy (ALTE) of the past n consecutive frames, the short term energy of the present frame (ASTE), the ratio of high band energy to low band energy (bhlbRatio), the maximum filter band energy index (maxFBE[i][j]), the maximum filterbank energy (maxFBE), the count of successive frames of a filterbank channel having maximum energy (maxEcnt[i]), and the count of successive frames of a filterbank channel having the highest probability of having the highest energy (maxPcnt[i]). - A high band evaluation is performed in
process 812. Theevaluation 812 determines whether either maxEcnt[i] or maxPcnt[i] exceed 20 frames (in the present example), whether the index number is 5 or higher (ensuring only the higher frequencies are used in this evaluation), and whether the maximum filterbank energy is greater than the average long term energy. If this evaluation is false, meaning at least one condition is not true, the high band (HB) persistence flag is cleared inprocess 814. If the high band evaluation is true, meaning all conditions are true, then the high band persistence flag is set (or not cleared if already set) inprocess 816. - A low band evaluation is performed in
process 806. Theevaluation 806 determines whether either maxEcnt[i] exceeds 50 successive frames or if maxPcnt[i] exceed 100 successive frames (in the present example), whether the index number is lower than 5 (ensuring only the lower frequencies are used in this evaluation), and whether the maximum filterbank energy is greater than the average long term energy. If this evaluation is false, meaning at least one condition is not true, the low band (LB) persistence flag is cleared inprocess 810. If the low band evaluation is true, meaning all conditions are true, then the low band persistence flag is set (or not cleared if already set) inprocess 808. - A high band feedback detection evaluation is performed in
process 818, which determines whether the maximum filterbank index probability is greater than 3 (in this example) or whether the high band energy to low band energy ratio is greater than 2, and whether the high band persistence flag is set, and whether the maximum filterbank energy is greater than 2% of the average long term energy. If the high bandfeedback detection evaluation 818 is true, then the feedback detected flag is set inprocess 824 and the method can terminate 826. If the high bandfeedback detection evaluation 818 is false, meaning at least one of the conditions is not true, the feedback detected flag is not set, and the low bandfeedback detection evaluation 820 is performed. - A low band feedback detection evaluation is performed in
process 820, which determines whether the low band persistence flag is set, whether the low band persistence flag is set, whether the energy in the low band is at least 20% of the total frame energy, and whether the maximum filterbank energy is at least 2% of the average long-term energy. If the low bandfeedback detection evaluation 820 is true, meaning all conditions are true, then the feedback detected flag is set inprocess 824. If the low bandfeedback detection evaluation 820 is false, meaning at least one condition is not true, then the feedback detected flag is cleared inprocess 822 and the method terminates 826. - Once the
method 800 terminates 826, if the feedback detected flag is set, then an appropriate gain reduction can be applied to the frequency frame before converting it back to the time domain. Since the feedback detection and gain reduction are applied over successive frames, the frequency bands in which the feedback has been detected will continue to diminish until the feedback conditions are longer evident. Due to the regenerative nature of feedback, the gain reduction propagates through the feedback loop to eliminate the feedback. Once the feedback conditions are no longer met, the gain can be ramped back up to normal levels, or until the feedback conditions are evident again. - Embodiments as exemplified herein have the benefit of quickly identifying feedback, such as howling, but evaluating a received audio signal against characteristics of speech, such as having an unusually high energy in a high band compared to a low band, having low band energy that is both persistent and consistent in form, rather than more variable like speech.
- In the foregoing specification, specific embodiments have been described. However, one of ordinary skill in the art appreciates that various modifications and changes can be made without departing from the scope of the invention as set forth in the claims below. Accordingly, the specification and figures are to be regarded in an illustrative rather than a restrictive sense, and all such modifications are intended to be included within the scope of present teachings.
- The benefits, advantages, solutions to problems, and any element(s) that may cause any benefit, advantage, or solution to occur or become more pronounced are not to be construed as a critical, required, or essential features or elements of any or all the claims. The invention is defined solely by the appended claims including any amendments made during the pendency of this application and all equivalents of those claims as issued.
- Moreover in this document, relational terms such as first and second, top and bottom, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. The terms “comprises,” “comprising,” “has”, “having,” “includes”, “including,” “contains”, “containing” or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises, has, includes, contains a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. An element proceeded by “comprises . . . a”, “has . . . a”, “includes . . . a”, “contains . . . a” does not, without more constraints, preclude the existence of additional identical elements in the process, method, article, or apparatus that comprises, has, includes, contains the element. The terms “a” and “an” are defined as one or more unless explicitly stated otherwise herein. The terms “substantially”, “essentially”, “approximately”, “about” or any other version thereof, are defined as being close to as understood by one of ordinary skill in the art, and in one non-limiting embodiment the term is defined to be within 10%, in another embodiment within 5%, in another embodiment within 1% and in another embodiment within 0.5%. The term “coupled” as used herein is defined as connected, although not necessarily directly and not necessarily mechanically. A device or structure that is “configured” in a certain way is configured in at least that way, but may also be configured in ways that are not listed.
- It will be appreciated that some embodiments may be comprised of one or more generic or specialized processors (or “processing devices”) such as microprocessors, digital signal processors, customized processors and field programmable gate arrays (FPGAs) and unique stored program instructions (including both software and firmware) that control the one or more processors to implement, in conjunction with certain non-processor circuits, some, most, or all of the functions of the method and/or apparatus described herein. Alternatively, some or all functions could be implemented by a state machine that has no stored program instructions, or in one or more application specific integrated circuits (ASICs), in which each function or some combinations of certain of the functions are implemented as custom logic. Of course, a combination of the two approaches could be used.
- Moreover, an embodiment can be implemented as a computer-readable storage medium having computer readable code stored thereon for programming a computer (e.g., comprising a processor) to perform a method as described and claimed herein. Examples of such computer-readable storage mediums include, but are not limited to, a hard disk, a CD-ROM, an optical storage device, a magnetic storage device, a ROM (Read Only Memory), a PROM (Programmable Read Only Memory), an EPROM (Erasable Programmable Read Only Memory), an EEPROM (Electrically Erasable Programmable Read Only Memory) and a Flash memory. Further, it is expected that one of ordinary skill, notwithstanding possibly significant effort and many design choices motivated by, for example, available time, current technology, and economic considerations, when guided by the concepts and principles disclosed herein will be readily capable of generating such software instructions and programs and ICs with minimal experimentation.
- The Abstract of the Disclosure is provided to allow the reader to quickly ascertain the nature of the technical disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. In addition, in the foregoing Detailed Description, it can be seen that various features are grouped together in various embodiments for the purpose of streamlining the disclosure. This method of disclosure is not to be interpreted as reflecting an intention that the claimed embodiments require more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive subject matter lies in less than all features of a single disclosed embodiment. Thus the following claims are hereby incorporated into the Detailed Description, with each claim standing on its own as a separately claimed subject matter.
Claims (20)
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2012/086873 WO2014094242A1 (en) | 2012-12-18 | 2012-12-18 | Method and apparatus for mitigating feedback in a digital radio receiver |
Publications (2)
Publication Number | Publication Date |
---|---|
US20150372723A1 true US20150372723A1 (en) | 2015-12-24 |
US9749021B2 US9749021B2 (en) | 2017-08-29 |
Family
ID=50977537
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/653,776 Active US9749021B2 (en) | 2012-12-18 | 2012-12-18 | Method and apparatus for mitigating feedback in a digital radio receiver |
Country Status (3)
Country | Link |
---|---|
US (1) | US9749021B2 (en) |
CN (1) | CN104871436B (en) |
WO (1) | WO2014094242A1 (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160071524A1 (en) * | 2014-09-09 | 2016-03-10 | Nokia Corporation | Audio Modification for Multimedia Reversal |
US9495973B2 (en) * | 2015-01-26 | 2016-11-15 | Acer Incorporated | Speech recognition apparatus and speech recognition method |
US9589577B2 (en) * | 2015-01-26 | 2017-03-07 | Acer Incorporated | Speech recognition apparatus and speech recognition method |
CN113259814A (en) * | 2020-02-11 | 2021-08-13 | 迪芬尼声学科技股份有限公司 | Method for detecting audio feedback and audio processing system and use thereof |
US20220076659A1 (en) * | 2020-09-08 | 2022-03-10 | Realtek Semiconductor Corporation | Voice activity detection device and method |
US11315591B2 (en) * | 2018-12-19 | 2022-04-26 | Amlogic (Shanghai) Co., Ltd. | Voice activity detection method |
US11450336B1 (en) * | 2020-11-25 | 2022-09-20 | Dialpad, Inc. | System and method for smart feedback cancellation |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6439682B2 (en) * | 2013-04-11 | 2018-12-19 | 日本電気株式会社 | Signal processing apparatus, signal processing method, and signal processing program |
CN105895115A (en) * | 2016-04-01 | 2016-08-24 | 北京小米移动软件有限公司 | Squeal determining method and squeal determining device |
CN107645696B (en) * | 2016-07-20 | 2019-04-19 | 腾讯科技(深圳)有限公司 | One kind is uttered long and high-pitched sounds detection method and device |
US10540983B2 (en) | 2017-06-01 | 2020-01-21 | Sorenson Ip Holdings, Llc | Detecting and reducing feedback |
CN108922558B (en) * | 2018-08-20 | 2020-11-27 | 广东小天才科技有限公司 | Voice processing method, voice processing device and mobile terminal |
US10530936B1 (en) | 2019-03-15 | 2020-01-07 | Motorola Solutions, Inc. | Method and system for acoustic feedback cancellation using a known full band sequence |
CN112562717B (en) * | 2020-12-01 | 2023-08-18 | 广州华多网络科技有限公司 | Howling detection method and device, storage medium and computer equipment |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5260980A (en) * | 1990-08-24 | 1993-11-09 | Sony Corporation | Digital signal encoder |
US20050094827A1 (en) * | 2003-08-20 | 2005-05-05 | Phonak Ag | Feedback suppression in sound signal processing using frequency translation |
US20090080674A1 (en) * | 2005-05-18 | 2009-03-26 | Matsushita Electric Industrial Co., Ltd. | Howling control apparatus and acoustic apparatus |
US20090201983A1 (en) * | 2008-02-07 | 2009-08-13 | Motorola, Inc. | Method and apparatus for estimating high-band energy in a bandwidth extension system |
Family Cites Families (29)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4091236A (en) | 1976-09-07 | 1978-05-23 | The University Of Akron | Automatically tunable notch filter and method for suppression of acoustical feedback |
US4449237A (en) | 1982-04-14 | 1984-05-15 | Cincinnati Electronics Corporation | Audio feedback suppressor |
US5396561A (en) | 1990-11-14 | 1995-03-07 | Nelson Industries, Inc. | Active acoustic attenuation and spectral shaping system |
JP3235925B2 (en) | 1993-11-19 | 2001-12-04 | 松下電器産業株式会社 | Howling suppression device |
US5646990A (en) | 1995-09-21 | 1997-07-08 | Rockwell International Corporation | Efficient speakerphone anti-howling system |
JP3152160B2 (en) | 1996-11-13 | 2001-04-03 | ヤマハ株式会社 | Howling detection prevention circuit and loudspeaker using the same |
SG77611A1 (en) | 1997-11-13 | 2001-01-16 | Univ Singapore | Acoustic echo cancellation equipped with howling suppressor and double-talk detector |
CN1269688A (en) * | 1999-03-29 | 2000-10-11 | 王岳火 | Automatic sound regulating method |
US6480610B1 (en) * | 1999-09-21 | 2002-11-12 | Sonic Innovations, Inc. | Subband acoustic feedback cancellation in hearing aids |
JP2004165888A (en) | 2002-11-12 | 2004-06-10 | Oki Electric Ind Co Ltd | Howling processor |
JP4094455B2 (en) | 2003-03-05 | 2008-06-04 | 松下電器産業株式会社 | Howling suppression device |
US7227959B2 (en) | 2003-03-10 | 2007-06-05 | Shure Incorporated | Multi-channel digital feedback reducer system |
US6990194B2 (en) | 2003-05-19 | 2006-01-24 | Acoustic Technology, Inc. | Dynamic balance control for telephone |
US20040240690A1 (en) | 2003-05-27 | 2004-12-02 | Blamey Peter J. | Oscillation detection |
JP4287762B2 (en) | 2004-02-20 | 2009-07-01 | パナソニック株式会社 | Howling detection method and apparatus, and acoustic apparatus including the same |
WO2005125273A1 (en) | 2004-06-16 | 2005-12-29 | Matsushita Electric Industrial Co., Ltd. | Howling detector and its method |
US7742608B2 (en) | 2005-03-31 | 2010-06-22 | Polycom, Inc. | Feedback elimination method and apparatus |
US7840014B2 (en) | 2005-04-05 | 2010-11-23 | Roland Corporation | Sound apparatus with howling prevention function |
US7664275B2 (en) | 2005-07-22 | 2010-02-16 | Gables Engineering, Inc. | Acoustic feedback cancellation system |
WO2009059300A2 (en) | 2007-11-02 | 2009-05-07 | Melodis Corporation | Pitch selection, voicing detection and vibrato detection modules in a system for automatic transcription of sung or hummed melodies |
JP4697267B2 (en) | 2008-07-01 | 2011-06-08 | ソニー株式会社 | Howling detection apparatus and howling detection method |
US8045738B2 (en) | 2008-10-31 | 2011-10-25 | Zounds Hearing, Inc. | System for managing feedback |
EP2442590B1 (en) | 2008-11-24 | 2014-07-02 | Oticon A/S | Method to reduce feed-back in hearing aids |
JP5136396B2 (en) | 2008-12-25 | 2013-02-06 | ヤマハ株式会社 | Howling suppression device |
EP2211339B1 (en) * | 2009-01-23 | 2017-05-31 | Oticon A/s | Listening system |
JP5278219B2 (en) | 2009-07-17 | 2013-09-04 | ヤマハ株式会社 | Howling canceller |
CN102196109B (en) * | 2010-03-01 | 2013-07-31 | 联芯科技有限公司 | Residual echo detection method and system |
CN102223456B (en) * | 2010-04-14 | 2013-09-11 | 华为终端有限公司 | Echo signal processing method and apparatus thereof |
CN102185991A (en) * | 2011-03-01 | 2011-09-14 | 杭州华三通信技术有限公司 | Echo cancellation method, system and device |
-
2012
- 2012-12-18 US US14/653,776 patent/US9749021B2/en active Active
- 2012-12-18 WO PCT/CN2012/086873 patent/WO2014094242A1/en active Application Filing
- 2012-12-18 CN CN201280077806.XA patent/CN104871436B/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5260980A (en) * | 1990-08-24 | 1993-11-09 | Sony Corporation | Digital signal encoder |
US20050094827A1 (en) * | 2003-08-20 | 2005-05-05 | Phonak Ag | Feedback suppression in sound signal processing using frequency translation |
US20090080674A1 (en) * | 2005-05-18 | 2009-03-26 | Matsushita Electric Industrial Co., Ltd. | Howling control apparatus and acoustic apparatus |
US20090201983A1 (en) * | 2008-02-07 | 2009-08-13 | Motorola, Inc. | Method and apparatus for estimating high-band energy in a bandwidth extension system |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160071524A1 (en) * | 2014-09-09 | 2016-03-10 | Nokia Corporation | Audio Modification for Multimedia Reversal |
US9495973B2 (en) * | 2015-01-26 | 2016-11-15 | Acer Incorporated | Speech recognition apparatus and speech recognition method |
US9589577B2 (en) * | 2015-01-26 | 2017-03-07 | Acer Incorporated | Speech recognition apparatus and speech recognition method |
US11315591B2 (en) * | 2018-12-19 | 2022-04-26 | Amlogic (Shanghai) Co., Ltd. | Voice activity detection method |
CN113259814A (en) * | 2020-02-11 | 2021-08-13 | 迪芬尼声学科技股份有限公司 | Method for detecting audio feedback and audio processing system and use thereof |
GB2595949A (en) * | 2020-02-11 | 2021-12-15 | Tymphany Acoustic Tech Ltd | Audio Feedback Detection and Suppression |
GB2595949B (en) * | 2020-02-11 | 2022-08-03 | Tymphany Acoustic Tech Ltd | Audio Feedback Detection and Suppression |
US20220076659A1 (en) * | 2020-09-08 | 2022-03-10 | Realtek Semiconductor Corporation | Voice activity detection device and method |
US11875779B2 (en) * | 2020-09-08 | 2024-01-16 | Realtek Semiconductor Corporation | Voice activity detection device and method |
US11450336B1 (en) * | 2020-11-25 | 2022-09-20 | Dialpad, Inc. | System and method for smart feedback cancellation |
Also Published As
Publication number | Publication date |
---|---|
CN104871436B (en) | 2018-03-16 |
US9749021B2 (en) | 2017-08-29 |
WO2014094242A1 (en) | 2014-06-26 |
CN104871436A (en) | 2015-08-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9749021B2 (en) | Method and apparatus for mitigating feedback in a digital radio receiver | |
JP7177185B2 (en) | Signal classification method and signal classification device, and encoding/decoding method and encoding/decoding device | |
CN102016995B (en) | An apparatus for processing an audio signal and method thereof | |
KR100944252B1 (en) | Detection of voice activity in an audio signal | |
EP2352145B1 (en) | Transient speech signal encoding method and device, decoding method and device, processing system and computer-readable storage medium | |
EP3537437B1 (en) | Device and method for reducing quantization noise in a time-domain decoder | |
US8600073B2 (en) | Wind noise suppression | |
US9253568B2 (en) | Single-microphone wind noise suppression | |
CN1985304B (en) | System and method for enhanced artificial bandwidth expansion | |
US20150215700A1 (en) | Percentile filtering of noise reduction gains | |
US20170372719A1 (en) | Sibilance Detection and Mitigation | |
US10381024B2 (en) | Method and apparatus for voice activity detection | |
US8165872B2 (en) | Method and system for improving speech quality | |
TW201606753A (en) | Method for estimating noise in an audio signal, noise estimator, audio encoder, audio decoder, and system for transmitting audio signals | |
CN103337245B (en) | Based on the noise suppressing method of signal to noise ratio curve and the device of subband signal | |
US9330674B2 (en) | System and method for improving sound quality of voice signal in voice communication | |
US11081120B2 (en) | Encoded-sound determination method | |
US11232804B2 (en) | Low complexity dense transient events detection and coding | |
EP3261089B1 (en) | Sibilance detection and mitigation | |
EP2760022B1 (en) | Audio bandwidth dependent noise suppression |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MOTOROLA SOLUTIONS, INC., ILLINOIS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:GAO, YI;CHEN, LU-MING;KUSHNER, WILLIAM M.;AND OTHERS;REEL/FRAME:031816/0171 Effective date: 20131115 |
|
AS | Assignment |
Owner name: MOTOROLA SOLUTIONS, INC., ILLINOIS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:GAO, YI;CHEN, LU-MING;KUSHNER, WILLIAM M;AND OTHERS;REEL/FRAME:035947/0189 Effective date: 20131115 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |